| *** owalsh_ has quit IRC | 00:00 | |
| *** owalsh- has joined #tripleo | 00:00 | |
| *** owalsh has quit IRC | 00:01 | |
| *** owalsh- is now known as owalsh | 00:01 | |
| *** mjturek has quit IRC | 00:07 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
|---|---|---|
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 00:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 00:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 00:10 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Fix undercloud password idempotency https://review.openstack.org/576990 | 00:11 |
| *** yolanda_ has quit IRC | 00:16 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Add different upload cleanup behaviours https://review.openstack.org/578233 | 00:23 |
| *** dxiri has quit IRC | 00:25 | |
| *** atarlov has joined #tripleo | 00:31 | |
| *** mjturek has joined #tripleo | 00:36 | |
| *** lifeless has quit IRC | 00:38 | |
| *** bfournie has joined #tripleo | 00:40 | |
| *** lifeless has joined #tripleo | 00:45 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: ovn: Add dns_servers configuration support https://review.openstack.org/571958 | 00:46 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Add ability to pre-assign IPs by role on ctlplane https://review.openstack.org/572525 | 00:47 |
| *** owalsh_ has joined #tripleo | 00:49 | |
| *** mjturek has quit IRC | 00:50 | |
| *** owalsh- has joined #tripleo | 00:50 | |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Adjust roles_data during FFU https://review.openstack.org/558081 | 00:50 |
| *** owalsh has quit IRC | 00:53 | |
| *** owalsh_ has quit IRC | 00:54 | |
| *** owalsh has joined #tripleo | 00:54 | |
| *** owalsh- has quit IRC | 00:55 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 01:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 01:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 01:10 |
| *** mrsoul_ has quit IRC | 01:12 | |
| *** Petersingh has joined #tripleo | 01:20 | |
| *** mrsoul_ has joined #tripleo | 01:21 | |
| *** yamahata has quit IRC | 01:22 | |
| *** fzdarsky__ has joined #tripleo | 01:27 | |
| *** fzdarsky_ has quit IRC | 01:31 | |
| *** atarlov has quit IRC | 01:34 | |
| *** stendulker has joined #tripleo | 01:34 | |
| *** ramishra has joined #tripleo | 01:38 | |
| *** mdnadeem has joined #tripleo | 01:43 | |
| *** zshi has quit IRC | 01:46 | |
| *** zshi has joined #tripleo | 01:46 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade stable/queens: Adjust roles_data during FFU https://review.openstack.org/578244 | 01:51 |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 02:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 02:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 02:10 |
| *** stendulker has quit IRC | 02:12 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Remove deprecated mitaka/liberty logic for workers https://review.openstack.org/572500 | 02:18 |
| *** bkopilov has quit IRC | 02:30 | |
| openstackgerrit | Steve Baker proposed openstack/python-tripleoclient master: Add --cleanup argument for image uploads https://review.openstack.org/578251 | 02:37 |
| *** psachin has joined #tripleo | 02:38 | |
| *** noslzzp_ has joined #tripleo | 02:41 | |
| *** itlinux has joined #tripleo | 02:44 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Run image prepare with --verbose https://review.openstack.org/578256 | 02:48 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: Leave undercloud images locally after prepare https://review.openstack.org/578257 | 02:49 |
| *** jaganathan has joined #tripleo | 03:02 | |
| *** invsblduck has quit IRC | 03:02 | |
| *** noama has joined #tripleo | 03:06 | |
| *** atarlov has joined #tripleo | 03:10 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 03:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 03:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 03:10 |
| *** lblanchard has quit IRC | 03:25 | |
| *** Petersingh is now known as Petersingh|afk | 03:32 | |
| *** atarlov has quit IRC | 03:43 | |
| *** hamzy has joined #tripleo | 03:47 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: turn off undercloud idempotency check on fs002 https://review.openstack.org/577809 | 03:47 |
| *** udesale has joined #tripleo | 03:50 | |
| *** noama has quit IRC | 03:50 | |
| *** agopi has quit IRC | 03:50 | |
| *** psahoo has joined #tripleo | 03:58 | |
| Tengu | hello there :) | 04:00 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Include docker package in mistral-executor image https://review.openstack.org/578264 | 04:02 |
| *** bkopilov has joined #tripleo | 04:02 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Don't quote names with sgdisk https://review.openstack.org/578265 | 04:04 |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-specs master: [WIP] Spec for improved privilege escalation in py-scripts https://review.openstack.org/572761 | 04:09 |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 04:10 |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 04:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 04:10 |
| *** nyechiel has quit IRC | 04:10 | |
| *** dxiri has joined #tripleo | 04:11 | |
| openstackgerrit | Andrew Austin proposed openstack/puppet-tripleo master: Add mechanism for cookie-based sessions in endpoints. https://review.openstack.org/577309 | 04:12 |
| *** nguyenhai has quit IRC | 04:26 | |
| *** ykarel has joined #tripleo | 04:27 | |
| *** Petersingh|afk is now known as Petersingh | 04:29 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: Undercloud specific volumes for mistral-executor container https://review.openstack.org/578278 | 04:31 |
| *** nguyenhai has joined #tripleo | 04:33 | |
| *** nguyenhai_ has joined #tripleo | 04:33 | |
| *** nguyenhai has quit IRC | 04:34 | |
| *** nguyenhai_ has quit IRC | 04:34 | |
| *** nguyenhai has joined #tripleo | 04:34 | |
| *** skramaja has joined #tripleo | 04:34 | |
| *** psachin has quit IRC | 04:41 | |
| *** noama has joined #tripleo | 04:44 | |
| *** dxiri has quit IRC | 04:50 | |
| *** atarlov has joined #tripleo | 04:52 | |
| *** psahoo has quit IRC | 05:02 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 05:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 05:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 05:10 |
| *** psahoo has joined #tripleo | 05:10 | |
| *** atarlov has quit IRC | 05:11 | |
| *** atarlov has joined #tripleo | 05:11 | |
| *** ratailor has joined #tripleo | 05:12 | |
| *** atarlov has quit IRC | 05:15 | |
| *** yprokule has joined #tripleo | 05:17 | |
| *** tdasilva has quit IRC | 05:21 | |
| *** aufi has joined #tripleo | 05:22 | |
| *** atarlov has joined #tripleo | 05:23 | |
| *** janki has joined #tripleo | 05:24 | |
| *** atarlov has quit IRC | 05:27 | |
| *** atarlov has joined #tripleo | 05:28 | |
| *** waleedm has joined #tripleo | 05:28 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Add the ability to scaleup the openshift stack https://review.openstack.org/578285 | 05:31 |
| *** tdasilva has joined #tripleo | 05:33 | |
| *** quiquell|off is now known as quiquell|rover | 05:36 | |
| quiquell|rover | Good morning folks | 05:36 |
| quiquell|rover | To run ARA with the undercloud playbooks https://review.openstack.org/#/c/577960/ | 05:37 |
| *** nyechiel has joined #tripleo | 05:37 | |
| quiquell|rover | We are missing +1w it wil help ups debug timeouts at gate jobs | 05:37 |
| *** vpickard has joined #tripleo | 05:38 | |
| *** vpickard_ has quit IRC | 05:41 | |
| *** yolanda_ has joined #tripleo | 05:47 | |
| *** atarlov has quit IRC | 05:47 | |
| *** atarlov has joined #tripleo | 05:48 | |
| *** mrsoul_ is now known as mschuppert | 05:50 | |
| *** atarlov has quit IRC | 05:52 | |
| *** saneax has joined #tripleo | 05:58 | |
| *** gvrangan has joined #tripleo | 06:03 | |
| *** gvrangan has quit IRC | 06:05 | |
| *** yolanda__ has joined #tripleo | 06:06 | |
| *** yolanda_ has quit IRC | 06:09 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 06:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 06:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 06:10 |
| *** karthiks has joined #tripleo | 06:11 | |
| *** yolanda__ has quit IRC | 06:14 | |
| *** kbyrne has quit IRC | 06:15 | |
| *** kbyrne has joined #tripleo | 06:16 | |
| *** cylopez has joined #tripleo | 06:16 | |
| *** threestrands has quit IRC | 06:19 | |
| *** aufi has quit IRC | 06:20 | |
| *** ccamacho has joined #tripleo | 06:22 | |
| *** ffiore_ has joined #tripleo | 06:26 | |
| *** dmellado has joined #tripleo | 06:29 | |
| *** yolanda__ has joined #tripleo | 06:30 | |
| *** jcoufal has joined #tripleo | 06:32 | |
| *** bogdando has joined #tripleo | 06:35 | |
| *** jcoufal_ has joined #tripleo | 06:36 | |
| *** jcoufal has quit IRC | 06:39 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Use openstack CLI for ironic https://review.openstack.org/578292 | 06:39 |
| quiquell|rover | Some cores to unblock promotions: ^ | 06:41 |
| *** agurenko has joined #tripleo | 06:41 | |
| *** dparkes has joined #tripleo | 06:41 | |
| *** quiquell|rover is now known as quique|rover|afk | 06:42 | |
| *** kopecmartin has joined #tripleo | 06:42 | |
| *** pcaruana has joined #tripleo | 06:44 | |
| *** yolanda__ has quit IRC | 06:50 | |
| *** yolanda__ has joined #tripleo | 06:53 | |
| *** yolanda__ is now known as yolanda | 06:53 | |
| *** Petersingh is now known as Petersingh|afk | 06:54 | |
| *** udesale has quit IRC | 06:54 | |
| *** udesale has joined #tripleo | 06:55 | |
| *** shreshtha has joined #tripleo | 06:57 | |
| *** udesale has quit IRC | 06:59 | |
| *** ksambor has joined #tripleo | 07:00 | |
| *** udesale has joined #tripleo | 07:00 | |
| *** hjensas|afk has quit IRC | 07:02 | |
| *** pcaruana has quit IRC | 07:02 | |
| *** slaweq has joined #tripleo | 07:03 | |
| *** tesseract has joined #tripleo | 07:07 | |
| *** quique|rover|afk is now known as quiquell|rover | 07:08 | |
| quiquell|rover | bogdando, sshnaidm: To unblock promotion https://review.openstack.org/#/c/578292/ | 07:10 |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 07:10 |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 07:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 07:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 07:10 |
| *** lebauce_ has quit IRC | 07:20 | |
| *** Petersingh|afk is now known as Petersingh | 07:22 | |
| *** jaosorior has quit IRC | 07:23 | |
| *** shardy has quit IRC | 07:28 | |
| *** zoli is now known as zoli|wfh | 07:28 | |
| *** zoli|wfh is now known as zoli | 07:28 | |
| *** brault has quit IRC | 07:30 | |
| *** brault has joined #tripleo | 07:30 | |
| *** shardy has joined #tripleo | 07:31 | |
| *** florianf|afk is now known as florianf | 07:31 | |
| *** Haresh has joined #tripleo | 07:35 | |
| *** ukalifon has joined #tripleo | 07:39 | |
| *** tosky has joined #tripleo | 07:40 | |
| *** amoralej|off is now known as amoralej | 07:42 | |
| *** nguyenhai has quit IRC | 07:43 | |
| *** jpena|off is now known as jpena | 07:46 | |
| *** Petersingh is now known as Petersingh|lunch | 07:46 | |
| *** nguyenhai has joined #tripleo | 07:48 | |
| *** rcernin has quit IRC | 07:51 | |
| *** aufi has joined #tripleo | 07:51 | |
| *** rcernin has joined #tripleo | 07:53 | |
| *** noama has quit IRC | 07:53 | |
| *** pcaruana has joined #tripleo | 07:57 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 08:00 |
| *** invsblduck has joined #tripleo | 08:00 | |
| *** jpich has joined #tripleo | 08:02 | |
| *** invsblduck has quit IRC | 08:04 | |
| sshnaidm | quiquell|rover, hmm.. linters failed | 08:04 |
| quiquell|rover | sshnaidm: ack | 08:04 |
| *** pdeore has joined #tripleo | 08:05 | |
| sshnaidm | quiquell|rover, http://logs.openstack.org/92/578292/1/check/openstack-tox-linters/1bfbbc8/job-output.txt.gz | 08:05 |
| quiquell|rover | sshnaidm: Looks unrelated, but I have to look at it | 08:06 |
| sshnaidm | quiquell|rover, yeah, try to change a little commit message to run them again | 08:06 |
| quiquell|rover | sshnaidm: recheck would be enough | 08:06 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: ceilometer: deprecation cleanup https://review.openstack.org/577797 | 08:09 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: DNM: check lint https://review.openstack.org/578309 | 08:09 |
| sshnaidm | quiquell|rover, recheck won't help | 08:09 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 08:10 |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 08:10 |
| sshnaidm | quiquell|rover, while jobs running, it doesn't have effect | 08:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 08:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 08:10 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Don't quote names with sgdisk https://review.openstack.org/578265 | 08:10 |
| quiquell|rover | sshnaidm: With comment it will stop the running ones ? | 08:11 |
| sshnaidm | quiquell|rover, no, it doesn't stop, you need to change something, for example commit message | 08:12 |
| *** paramite has joined #tripleo | 08:13 | |
| quiquell|rover | sshnaidm: ack | 08:13 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Use openstack CLI for ironic https://review.openstack.org/578292 | 08:14 |
| quiquell|rover | sshnaidm: Done | 08:14 |
| paramite | mandre, Please express your noes until it's too late: https://review.openstack.org/#/c/578111 | 08:16 |
| *** milan_ has joined #tripleo | 08:16 | |
| *** ykarel is now known as ykarel|lunch | 08:16 | |
| bogdando | PTAL https://review.openstack.org/#/q/topic:docker-opts+(status:open+OR+status:merged) | 08:19 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Disable ssl certificate validation in tempest https://review.openstack.org/578052 | 08:19 |
| *** slaweq has quit IRC | 08:20 | |
| *** ykarel|lunch has quit IRC | 08:20 | |
| *** ykarel|lunch has joined #tripleo | 08:21 | |
| *** dtantsur|afk is now known as dtantsur | 08:22 | |
| *** akrivoka has joined #tripleo | 08:25 | |
| *** ccamacho has quit IRC | 08:27 | |
| *** mrunge_ is now known as mrunge | 08:27 | |
| *** ccamacho has joined #tripleo | 08:27 | |
| *** holser_ has joined #tripleo | 08:30 | |
| *** jcoufal_ has quit IRC | 08:32 | |
| mandre | paramite: thanks for letting me know, i added my -1 to the already long list of -1 | 08:32 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart master: Run tempest on standalone job https://review.openstack.org/578320 | 08:34 |
| *** slaweq has joined #tripleo | 08:36 | |
| ykarel|lunch | quiquell|rover, it looks a real issue as most of the tox-linters job failing | 08:37 |
| quiquell|rover | ykarel|lunch: Yep, already looking at it | 08:39 |
| ykarel|lunch | ack | 08:39 |
| *** Petersingh|lunch is now known as Petersingh | 08:41 | |
| *** holser_ has quit IRC | 08:44 | |
| *** ykarel|lunch is now known as ykarel | 08:45 | |
| *** rcernin has quit IRC | 08:47 | |
| *** holser_ has joined #tripleo | 08:47 | |
| *** shardy has quit IRC | 08:48 | |
| *** derekh has joined #tripleo | 08:52 | |
| *** shardy has joined #tripleo | 08:52 | |
| *** d0ugal has quit IRC | 08:54 | |
| *** salmankhan has joined #tripleo | 08:57 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Remove the OVS-DPDK deprecated parameters https://review.openstack.org/566239 | 08:57 |
| quiquell|rover | sshnaidm, ykarel: Fixing linting, old ansible-lint version | 09:01 |
| *** gfidente has joined #tripleo | 09:03 | |
| *** gfidente has quit IRC | 09:03 | |
| *** gfidente has joined #tripleo | 09:03 | |
| sshnaidm | quiquell|rover, weird.. I fixed it to specific version that worked | 09:03 |
| ykarel | quiquell|rover, ack | 09:03 |
| quiquell|rover | sshnaidm: yaml is not fixed, and looks like the API has beign change | 09:03 |
| quiquell|rover | sshnaidm: after upgrading it's working... | 09:04 |
| quiquell|rover | sshnaidm: Now I have to change all tripleo projects :-/ | 09:04 |
| quiquell|rover | sshnaidm: Why do we want to pin it ? | 09:04 |
| sshnaidm | quiquell|rover, because it was broken and blocked all tripleo projects | 09:04 |
| quiquell|rover | sshnaidm: ok | 09:04 |
| quiquell|rover | sshnaidm: Now it's broken again :-/ | 09:04 |
| sshnaidm | quiquell|rover, that's why I pinned it to specific version, how can it be broken..? | 09:04 |
| quiquell|rover | Humm tripleo-upgrades is not at codesearch ? | 09:06 |
| *** suuuper has joined #tripleo | 09:07 | |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 09:10 |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778865 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 09:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 09:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 09:10 |
| openstack | Launchpad bug 1778865 in tripleo "Failing openstack-pox-linter TypeError: unbound method construct_mapping()" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:10 |
| quiquell|rover | beautiful | 09:10 |
| *** aufi has quit IRC | 09:12 | |
| *** dxiri has joined #tripleo | 09:12 | |
| cgoncalves | how can one enable a service in a deployed overcloud? add the THT env file to "openstack overcloud deploy" and re-run or "openstack overcloud update"? | 09:12 |
| *** Petersingh is now known as Petersingh|afk | 09:12 | |
| openstackgerrit | Oliver Walsh proposed openstack/diskimage-builder master: WIP: Add DIB element to install NVIDIA GPU drivers https://review.openstack.org/573223 | 09:13 |
| *** hjensas|afk has joined #tripleo | 09:15 | |
| *** holser_ has quit IRC | 09:16 | |
| *** dxiri has quit IRC | 09:17 | |
| *** holser_ has joined #tripleo | 09:17 | |
| *** atarlov has joined #tripleo | 09:18 | |
| *** leanderthal has joined #tripleo | 09:19 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-validations master: Upgrade ansible-lint https://review.openstack.org/578336 | 09:19 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Upgrade ansible-lint https://review.openstack.org/578339 | 09:20 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Upgrade ansible-lint https://review.openstack.org/578340 | 09:21 |
| gfidente | hey guys, we need a review here : https://review.openstack.org/#/c/575571/ | 09:22 |
| *** atarlov_ has joined #tripleo | 09:22 | |
| quiquell|rover | sshnaidm, ykarelÂ, cores: to fix linter problem, https://review.openstack.org/578336, https://review.openstack.org/578339, https://review.openstack.org/578340 | 09:23 |
| *** atarlov has quit IRC | 09:26 | |
| *** holser_ has quit IRC | 09:27 | |
| *** holser_ has joined #tripleo | 09:28 | |
| *** holser_ has quit IRC | 09:30 | |
| *** holser_ has joined #tripleo | 09:30 | |
| *** holser_ has quit IRC | 09:32 | |
| *** ykarel has quit IRC | 09:35 | |
| *** ykarel has joined #tripleo | 09:39 | |
| *** Petersingh|afk is now known as Petersingh | 09:40 | |
| shardy | cgoncalves: you add the tht env file then re-run the openstack overcloud deploy command | 09:44 |
| cgoncalves | shardy, thanks! | 09:45 |
| *** threestrands has joined #tripleo | 09:45 | |
| *** threestrands has quit IRC | 09:46 | |
| shardy | gfidente: lgtm, although personally I'd prefer list_join over yaql | 09:47 |
| *** threestrands has joined #tripleo | 09:47 | |
| gfidente | shardy ah just saw your comment | 09:48 |
| *** holser_ has joined #tripleo | 09:48 | |
| gfidente | I think I started with yaql trying to make it do a bigger chunk of the work | 09:48 |
| gfidente | then left it there when it was only doing join | 09:48 |
| gfidente | I'll update it | 09:48 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-docs master: Developer docs for updates https://review.openstack.org/578069 | 09:48 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Do not grant caps if pool name is empty https://review.openstack.org/575571 | 09:51 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Use openstack CLI for ironic https://review.openstack.org/578292 | 09:51 |
| gfidente | shardy done | 09:51 |
| *** fzdarsky__ has quit IRC | 09:52 | |
| shardy | gfidente: ack thanks, +2! | 09:52 |
| gfidente | ty | 09:52 |
| openstackgerrit | Merged openstack/diskimage-builder master: Add iscsi-boot element for CentOS images https://review.openstack.org/542708 | 09:54 |
| shardy | sshnaidm: Hi, do you happen to know where I can find logs for the RDO jobs? | 09:54 |
| shardy | e.g https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/16514/ | 09:54 |
| shardy | the links in the jenkins report don't lead anywhere :( | 09:54 |
| *** holser_ has quit IRC | 09:55 | |
| dtantsur | shardy: IIRC you open console log, and the link is in the end of it | 09:55 |
| sshnaidm | quiquell|rover, I didn't set ansible-lint version for tripleo-upgrades master, it was constantly failing, so it uses it from openstack requirements | 09:55 |
| * dtantsur loves who hidden and confusing RDO and TripleO logs can be | 09:55 | |
| sshnaidm | shardy, yeah, you need to open console and then the link in the button: https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/16514/console | 09:56 |
| *** holser_ has joined #tripleo | 09:56 | |
| quiquell|rover | sshnaidm: It hasn't it pinned | 09:56 |
| shardy | dtantsur, sshnaidm: aha I see now, thanks | 09:56 |
| sshnaidm | quiquell|rover, yes, it uses it from openstack constraints | 09:56 |
| sshnaidm | shardy, it will change in this week :D | 09:56 |
| shardy | I wonder if we could get the jenkins links to direct to the logs, as that'd be more intuitive wrt upstream CI | 09:56 |
| sshnaidm | shardy, no, we couldn't, but this week it moves to zuulv3 and will be exactly as in upstream | 09:57 |
| dtantsur | \o/ | 09:57 |
| shardy | sshnaidm: Ok, cool well that sounds like it'll solve the problem then :) | 09:57 |
| sshnaidm | shardy, yeah, should be | 09:57 |
| dtantsur | now the only tribal knowledge will be where the actual things are in the logs :) | 09:57 |
| shardy | Ok thanks - I was suspicious as the same job failed twice but it seems unrelated to my change | 09:59 |
| shardy | recheck recheck | 09:59 |
| quiquell|rover | What's the source of truth to know what are the tripleo projects ? | 09:59 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: DNM: check lint https://review.openstack.org/578309 | 10:00 |
| *** cylopez has quit IRC | 10:01 | |
| sshnaidm | quiquell|rover, I think all starting with tripleo-* | 10:02 |
| sshnaidm | quiquell|rover, if it's about linter, we use ansible-lint in oooq, extras and upgrades | 10:02 |
| sshnaidm | quiquell|rover, upgrades - 3 branches :/ | 10:03 |
| *** mdnadeem has quit IRC | 10:03 | |
| *** nyechiel has quit IRC | 10:04 | |
| *** nyechiel_ has joined #tripleo | 10:04 | |
| quiquell|rover | sshnaidm: upgrades are not pinning it, they take the latest | 10:04 |
| quiquell|rover | sshnaidm: That's why I didn't change it there | 10:04 |
| *** jcoufal has joined #tripleo | 10:05 | |
| sshnaidm | quiquell|rover, it does, just not in master | 10:06 |
| *** salmankhan has quit IRC | 10:06 | |
| *** salmankhan has joined #tripleo | 10:06 | |
| sshnaidm | quiquell|rover, upgrades - 3 branches | 10:06 |
| quiquell|rover | sshnaidm: argg ok | 10:07 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP][DNM] test to gather zuul inventory informations https://review.openstack.org/576879 | 10:08 |
| openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Run tempest on standalone job https://review.openstack.org/578347 | 10:09 |
| *** bkopilov has quit IRC | 10:09 | |
| openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Run tempest on standalone job https://review.openstack.org/578347 | 10:09 |
| *** atarlov has joined #tripleo | 10:09 | |
| *** pchavva has joined #tripleo | 10:10 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 10:10 |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778865 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 10:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 10:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 10:10 |
| openstack | Launchpad bug 1778865 in tripleo "Failing openstack-pox-linter TypeError: unbound method construct_mapping()" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell) | 10:10 |
| *** atarlov_ has quit IRC | 10:11 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Enable collectd to connect to metrics QDR https://review.openstack.org/576057 | 10:12 |
| sri_ | shardy: FYI I've tested 5 node allinone in got created successfully, but I had to change the ServicesDefault to https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/multinode.yaml#L17..L60, when I use default Controller ServicesDefault and added NovaCompute,NovaLibvirt I run into this error http://paste.openstack.org/show/724390/ | 10:13 |
| *** atarlov has quit IRC | 10:13 | |
| *** gkadam__ has quit IRC | 10:16 | |
| *** gkadam__ has joined #tripleo | 10:16 | |
| *** jaosorior has joined #tripleo | 10:18 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart-extras master: Adds check for python-virtualenv with error message https://review.openstack.org/578081 | 10:18 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: QDR for metrics collection purposes https://review.openstack.org/572312 | 10:23 |
| shardy | sri_: ack yeah I think that's expected, the multinode.yaml service list is the best reference for an all-in-one configuration | 10:24 |
| shardy | probably we should add an AllInOne role to tht/roles/ | 10:25 |
| *** zoli is now known as zoli|lunch | 10:29 | |
| sri_ | shardy: sounds good :) | 10:29 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP][DNM] test to gather zuul inventory informations https://review.openstack.org/576879 | 10:30 |
| *** pcaruana has quit IRC | 10:31 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-upgrade stable/pike: Upgrade ansible-lint https://review.openstack.org/578351 | 10:31 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-upgrade stable/queens: Upgrade ansible-lint https://review.openstack.org/578352 | 10:31 |
| quiquell|rover | sshnaidm: queens, pike | 10:31 |
| quiquell|rover | sshnaidm: Do you know If I am missing any ? | 10:32 |
| *** Petersingh has quit IRC | 10:33 | |
| quiquell|rover | sshnaidm: It was ansible upgrade that break them | 10:34 |
| sshnaidm | quiquell|rover, which ansible upgrade? | 10:36 |
| quiquell|rover | sshnaidm: The issuw was fixed here https://github.com/willthames/ansible-lint/issues/263 | 10:36 |
| quiquell|rover | sshnaidm: But I think we haven't update ansible... | 10:37 |
| quiquell|rover | sshnaidm: Do we ? | 10:37 |
| sshnaidm | quiquell|rover, no, it's still on review https://review.openstack.org/#/c/558121/ | 10:38 |
| sshnaidm | quiquell|rover, this issue is about ansible vault, we don't use it | 10:38 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart-extras master: Add memory and swap info into collect-logs collect task https://review.openstack.org/578023 | 10:38 |
| quiquell|rover | sshnaidm: Have run it manually calling tox | 10:38 |
| quiquell|rover | sshnaidm: | 10:39 |
| *** shardy has quit IRC | 10:44 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Adding missing pacemaker definition for scenario000. https://review.openstack.org/577783 | 10:44 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Missing puppet restart resource definition in scenario000. https://review.openstack.org/577784 | 10:44 |
| openstackgerrit | Merged openstack/tripleo-common master: Let TripleO generate ODLPassword https://review.openstack.org/577831 | 10:44 |
| openstackgerrit | Merged openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/578012 | 10:44 |
| openstackgerrit | Merged openstack/tripleo-common master: Don't resolve outputs when getting stacks https://review.openstack.org/572807 | 10:44 |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Provide timestamps in Ansible output by default https://review.openstack.org/577103 | 10:44 |
| quiquell|rover | sshnaidm: This is the ansible-lint fix https://github.com/willthames/ansible-lint/blob/master/lib/ansiblelint/utils.py#L550 | 10:45 |
| *** jaganathan has quit IRC | 10:46 | |
| gfidente | jistr maybe you want to give a look at the nodedatalookup stuff we discussed at PTG https://review.openstack.org/#/c/577956 | 10:47 |
| gfidente | jistr I believe dumping .json and matching it into host_vars works decently | 10:47 |
| janki | jistr, hey. can you workflow this one plz - https://review.openstack.org/#/c/577834/ | 10:47 |
| jistr | gfidente: ack i added myself as a reviewer | 10:47 |
| gfidente | jistr not sure if we want to make it "global" or ceph-ansible only, but I'd start with the ceph-ansible version cause we need it there quickly anyway :D | 10:48 |
| janki | depends-on patch is merged | 10:48 |
| gfidente | jistr++ thakns | 10:48 |
| jistr | janki: done | 10:48 |
| jistr | janki: btw did you get a chance to try the update with https://review.openstack.org/#/c/577754/ ? | 10:49 |
| janki | jistr, no. I am doing it today. waiting for d/s CI to finish initial setup | 10:50 |
| janki | jistr, update works very fine with all other patches. we have had almost 100% success so far | 10:50 |
| openstackgerrit | Merged openstack/instack-undercloud stable/queens: Make sure we start nova-compute after ironic-conductor. https://review.openstack.org/576909 | 10:50 |
| openstackgerrit | Merged openstack/tripleo-common master: Include --xattrs when creating the undercloud backup. https://review.openstack.org/577406 | 10:50 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Use role_name instead of tripleo_role_name https://review.openstack.org/578044 | 10:50 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Create zuul-hosts file for pre.yaml network setup https://review.openstack.org/577007 | 10:50 |
| openstackgerrit | Merged openstack/tripleo-common master: Send a zaqar message with 'list_validations' result https://review.openstack.org/563701 | 10:50 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add option to override confirmation in yaml-nic-config-2-script.py https://review.openstack.org/567456 | 10:50 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Support enabling Debug in OVN metadata agent https://review.openstack.org/574472 | 10:50 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Fix deps repo in master-undercloud-queens-overcloud.yml https://review.openstack.org/574724 | 10:50 |
| jistr | janki: perfect :) please once you have tried the update with post_update_tasks, give some feedback in gerrit. ODL is the only use case for them right now, so we'll merge (or not) based on the ODL feedback. | 10:51 |
| janki | jistr, yes ofcourse | 10:52 |
| jistr | thanks | 10:52 |
| jistr | wow so many merged patches, nice :) the gate was queued up like 12 hours or so :) | 10:53 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP][DNM] test to gather zuul inventory informations https://review.openstack.org/576879 | 10:56 |
| jistr | ccamacho: can be un-minus-2'd and +A'd https://review.openstack.org/#/c/577793 | 11:01 |
| *** pchavva has quit IRC | 11:05 | |
| *** aufi has joined #tripleo | 11:06 | |
| *** milan_ has quit IRC | 11:06 | |
| *** dparkes has quit IRC | 11:09 | |
| openstackgerrit | Derek Higgins proposed openstack/tripleo-quickstart-extras master: Setup Ironic in Overcloud https://review.openstack.org/509728 | 11:10 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777130 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 11:10 |
| openstack | Launchpad bug 1777130 in tripleo "RDO cloud is down" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778865 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 11:10 |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 11:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 11:10 |
| openstack | Launchpad bug 1778865 in tripleo "Failing openstack-pox-linter TypeError: unbound method construct_mapping()" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell) | 11:10 |
| *** fzdarsky__ has joined #tripleo | 11:15 | |
| *** jpena is now known as jpena|lunch | 11:15 | |
| *** leanderthal has quit IRC | 11:23 | |
| *** udesale has quit IRC | 11:24 | |
| *** pradk has joined #tripleo | 11:24 | |
| *** zoli|lunch is now known as zoli | 11:26 | |
| *** zoli is now known as zoli|wfh | 11:26 | |
| *** zoli|wfh is now known as zoli | 11:26 | |
| *** shreshtha has quit IRC | 11:30 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP][DNM] test to gather zuul inventory informations https://review.openstack.org/576879 | 11:32 |
| *** amoralej is now known as amoralej|lunch | 11:37 | |
| *** pradk has quit IRC | 11:37 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Update for openshift 3.9 https://review.openstack.org/574233 | 11:45 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Add ability to set openshift container images https://review.openstack.org/576441 | 11:45 |
| janki | jistr, hey | 11:47 |
| *** jfrancoa has joined #tripleo | 11:48 | |
| jistr | janki: hey | 11:49 |
| *** morazi has joined #tripleo | 11:49 | |
| *** leanderthal has joined #tripleo | 11:49 | |
| janki | jistr, I am deploying with auto generate odlpassword. I cloned tripleo-common, did seetup.py install and doing overcloud deploy. I get this error resources.ServiceChain: Property error: resources[27].properties: Property OpenDaylightPassword not assigned | 11:49 |
| janki | it had worked fine in CI. I checked odlpassword value in puppet hieradata | 11:50 |
| *** pradk has joined #tripleo | 11:50 | |
| jistr | sudo systemctl restart openstack-mistral-executor | 11:50 |
| jistr | sudo systemctl restart openstack-mistral-engine | 11:50 |
| jistr | janki: you may need to do these ^^ | 11:50 |
| janki | jistr, ahh yes. yes. totally forgot those | 11:51 |
| * jistr lunch, bbl | 11:51 | |
| *** ansmith has quit IRC | 11:54 | |
| *** atoth has joined #tripleo | 11:55 | |
| *** raildo has joined #tripleo | 11:55 | |
| *** abishop has joined #tripleo | 11:57 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Add generate_overcloud_roles var to overcloud-deploy role https://review.openstack.org/572713 | 11:58 |
| *** cylopez has joined #tripleo | 12:00 | |
| *** pdeore has quit IRC | 12:00 | |
| *** lblanchard has joined #tripleo | 12:00 | |
| *** leanderthal has quit IRC | 12:00 | |
| *** nyechiel_ has quit IRC | 12:02 | |
| *** leanderthal has joined #tripleo | 12:02 | |
| redrobot | o/ | 12:03 |
| jaosorior | #startmeeting TripleO Security Squad | 12:04 |
| openstack | Meeting started Wed Jun 27 12:04:07 2018 UTC and is due to finish in 60 minutes. The chair is jaosorior. Information about MeetBot at http://wiki.debian.org/MeetBot. | 12:04 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 12:04 |
| jaosorior | hello folks! | 12:04 |
| *** openstack changes topic to " (Meeting topic: TripleO Security Squad)" | 12:04 | |
| openstack | The meeting name has been set to 'tripleo_security_squad' | 12:04 |
| raildo | o/ | 12:04 |
| redrobot | 👋 | 12:04 |
| jaosorior | #link https://etherpad.openstack.org/p/tripleo-security-squad | 12:04 |
| jaosorior | as always, there's the etherpad link | 12:04 |
| *** jfrancoa has quit IRC | 12:04 | |
| jaosorior | Tengu, moguimar: around? | 12:05 |
| lhinds | hey jaosorior | 12:05 |
| *** dtantsur is now known as dtantsur|brb | 12:06 | |
| lhinds | et al | 12:06 |
| jaosorior | lhinds: hey! how's it going? | 12:06 |
| mwhahaha | weshay|ruck: quiquell|rover: looks like introspection failures in ovb, are we missing a patch or something in rdo cloud? | 12:06 |
| lhinds | good thanks | 12:06 |
| jaosorior | I guess we can start | 12:06 |
| jaosorior | #topic Pubilc TLS by default work update | 12:06 |
| *** openstack changes topic to "Pubilc TLS by default work update (Meeting topic: TripleO Security Squad)" | 12:06 | |
| jaosorior | So, this work all depends on the work that Jaganathan Palanisamy is doing | 12:07 |
| jaosorior | mostly this patch https://review.openstack.org/#/c/572678/ | 12:07 |
| jaosorior | skramaja: do you know if there's any blockers that Jaganathan has? any way we could help? | 12:08 |
| *** jpena|lunch is now known as jpena | 12:08 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-upgrade stable/queens: Unpin ansible-lint from fixed version https://review.openstack.org/578364 | 12:08 |
| jaosorior | uhm... I guess h e's not around | 12:09 |
| jaosorior | anyway, so, this is my last week before my PTO | 12:09 |
| jaosorior | so, if someone wants to take over this work, it would be very appreciated | 12:10 |
| *** leanderthal has quit IRC | 12:10 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-upgrade stable/pike: Unpin ansible-lint from fixed version https://review.openstack.org/578365 | 12:10 |
| jaosorior | else we'll have to postpone it for Stein | 12:10 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778865 | 12:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 12:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 12:10 |
| openstack | Launchpad bug 1778865 in tripleo "Failing openstack-pox-linter TypeError: unbound method construct_mapping()" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell) | 12:10 |
| sshnaidm | quiquell|rover, https://review.openstack.org/578365 https://review.openstack.org/578364 | 12:10 |
| jaosorior | So, if there's anybody interested, please let me know and I'll guide you through what's left to do | 12:10 |
| jaosorior | maybe Tengu ^^ ? | 12:11 |
| jaosorior | anyway, that's all on that topic | 12:11 |
| jaosorior | any questions/feedbnack? | 12:11 |
| *** jcoufal has quit IRC | 12:11 | |
| *** rh-jelabarre has joined #tripleo | 12:11 | |
| jaosorior | #topic Limit TripleO users work update] | 12:12 |
| *** openstack changes topic to "Limit TripleO users work update] (Meeting topic: TripleO Security Squad)" | 12:12 | |
| jaosorior | lhinds: now that you're around, mind giving an update on this? | 12:12 |
| lhinds | so I have my spec up: https://review.openstack.org/#/c/572760/ | 12:12 |
| lhinds | could do with some reviews if possible folks, just what you think of the approach | 12:12 |
| lhinds | in the meantime I have the main script developed that I am just working out how to best call in CI | 12:13 |
| lhinds | I will check that in soon'ish and tag it on the blueprint | 12:13 |
| lhinds | that's it for now | 12:14 |
| jaosorior | Note there is also https://review.openstack.org/#/c/572761/ that would cover TripleO | 12:14 |
| jaosorior | TripleO's python scripts | 12:14 |
| jaosorior | mainly python-tripleoclient | 12:14 |
| lhinds | Yep, that's Tengu who I think is back from PTO now | 12:14 |
| jaosorior | I think he might be in his NHO though | 12:14 |
| lhinds | ah ok | 12:14 |
| lhinds | beer holiday in Munich | 12:15 |
| jaosorior | alright, any questions/feedback on this topic? | 12:15 |
| skramaja | jaosorior: sorted out with latest comments. we will be adding a parameter to identify if hw data is required or not in the plan-environment. will be enabled for nfv and hci | 12:15 |
| jaosorior | skramaja: any estimates on when that will be sorted out? | 12:15 |
| *** dprince has joined #tripleo | 12:17 | |
| jaosorior | #topic any other business | 12:17 |
| *** openstack changes topic to "any other business (Meeting topic: TripleO Security Squad)" | 12:17 | |
| skramaja | jaosorior: i assume jagan is working on it. havent spoken to him. will appraise him tomorrow. | 12:17 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart master: Adds virtualenv into dependencies for the reproducer script https://review.openstack.org/578366 | 12:17 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart-extras master: Adds check for python-virtualenv with error message https://review.openstack.org/578081 | 12:17 |
| jaosorior | Anything else folks want to bring up to the meeting? | 12:17 |
| jaosorior | skramaja: thanks | 12:17 |
| *** shardy has joined #tripleo | 12:17 | |
| weshay|ruck | quiquell|rover, did you see mwhahaha's question? | 12:17 |
| redrobot | jaosorior, not sure if we wanted to talk about Vault during this meeting? | 12:17 |
| jaosorior | redrobot: we could bring it up if you have any updates relevant to the TripleO implications of it :D else we can discuss that offline. | 12:18 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Unpin ansible-lint https://review.openstack.org/578340 | 12:18 |
| quiquell|rover | weshay|ruck: Nop | 12:18 |
| jaosorior | I mean, off the meeting | 12:18 |
| quiquell|rover | weshay|ruck: where ? | 12:18 |
| *** cylopez has quit IRC | 12:19 | |
| lhinds | nothing from me | 12:19 |
| redrobot | I took some notes on things to consider when deploying Vault | 12:19 |
| *** dparkes has joined #tripleo | 12:19 | |
| jaosorior | Alright, lets take a look | 12:19 |
| redrobot | #link https://etherpad.openstack.org/p/production-vault | 12:19 |
| weshay|ruck | mwhahaha, I see fs01/35 master working on no-op changes | 12:19 |
| *** ratailor has quit IRC | 12:19 | |
| mwhahaha | weshay|ruck: when did those last run? | 12:20 |
| jaosorior | redrobot: what is SSSS? | 12:20 |
| weshay|ruck | Jun 27, 2018 8:00:21 AM | 12:20 |
| redrobot | Shamir's Secret-Sharing Scheme | 12:20 |
| weshay|ruck | https://review.openstack.org/#/c/560445 | 12:20 |
| mwhahaha | weshay|ruck: k it was overnight so maybe it's ok now | 12:20 |
| jaosorior | redrobot: ah that, right | 12:20 |
| quiquell|rover | mwhahaha, weshay|ruck: What question ? | 12:21 |
| weshay|ruck | mwhahaha, ya.. I was having issues last night as well | 12:21 |
| quiquell|rover | RDO is ok now | 12:21 |
| jaosorior | redrobot: is there any other scheme to protect the key that would be considered secure? | 12:21 |
| redrobot | not in Vault, no | 12:21 |
| jaosorior | OK | 12:21 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Add the ability to scaleup the openshift stack https://review.openstack.org/578285 | 12:21 |
| jaosorior | so I guess the answer is a yes :D | 12:21 |
| redrobot | Haha | 12:21 |
| jaosorior | that was easy | 12:21 |
| redrobot | yeah, that's where it gets tricky... not sure how much TripleO automates vs. how much is left to the deployer to figure out | 12:22 |
| jaosorior | and I guess we can stick with the default until we do further research about how many is good | 12:22 |
| jaosorior | redrobot: well, the more we can automate the better :D | 12:22 |
| redrobot | The thing about SSSS is that you can't really automate Vault unsealing | 12:22 |
| redrobot | since each key-shard holder will need to submit their own piece | 12:23 |
| jaosorior | uhm | 12:23 |
| jaosorior | how does that work/ | 12:23 |
| jaosorior | ? | 12:23 |
| redrobot | so, when you start Vault, it starts up in a "sealed" state | 12:23 |
| redrobot | so the encryption key is not available to it | 12:23 |
| *** leanderthal has joined #tripleo | 12:23 | |
| jaosorior | right | 12:23 |
| redrobot | when you use SSSS, each piece is held by a key holder (security person working at deployers company) | 12:24 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-upgrade stable/pike: Unpin ansible-lint https://review.openstack.org/578351 | 12:24 |
| redrobot | and each needs to submit their piece to the API | 12:24 |
| redrobot | until X (threshold) pieces have been submitted | 12:24 |
| redrobot | then Vault can recreate the master key and unencrypt the encryption key and become "unsealed" | 12:24 |
| moguimar | the thing about SSSS is how many key shards we'd like to have for tripleO | 12:25 |
| redrobot | and then you can start using it. | 12:25 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-upgrade stable/queens: Unpin ansible-lint https://review.openstack.org/578352 | 12:25 |
| *** ykarel has quit IRC | 12:25 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Unpin ansible-lint https://review.openstack.org/578339 | 12:25 |
| jaosorior | Alright, so we would deploy Vault using Ansible (which is ran on TripleO). Wouldn't it be possible to have ansible have all the keys on first-installation, temporarily, and unseal the vault | 12:25 |
| jaosorior | >? | 12:25 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-validations master: Unpin ansible-lint https://review.openstack.org/578368 | 12:26 |
| redrobot | moguimar, I think the issue is that 1 shard implies 1 person is available who understands GPG and is available to unseal the Vault | 12:26 |
| jaosorior | if not, we wouldn't be able to deploy anything... and this wouldn't be a very practical thing :/ | 12:26 |
| quiquell|rover | weshay|ruck: We need to land 5 patches to unblock check | 12:26 |
| weshay|ruck | unblock check? | 12:26 |
| *** pdeore has joined #tripleo | 12:26 | |
| quiquell|rover | weshay|ruck: linting is failing | 12:26 |
| redrobot | jaosorior, it's that tradeoff between security and convenience | 12:26 |
| redrobot | in order to let Ansible have enough shards, you can't use GPG to protect the shard-generation | 12:27 |
| moguimar | we can start with the threshold of 1 | 12:27 |
| moguimar | and then think about increasing it later if necessary | 12:27 |
| weshay|ruck | mwhahaha, assuming the patch to turn off idempotency undercloud in fs02 was not in the latest run.. although having a time finding the git commit used | 12:27 |
| redrobot | moguimar, what do you think about GPG usage to protect shards? | 12:28 |
| quiquell|rover | weshay|ruck: It was not in the last run. | 12:28 |
| jaosorior | redrobot: we don't have a way to have steps in between to pause the deployment and get folks to start inputing their keys... and even if we did, that's not great usability for folks that are already using TripleO :/ | 12:28 |
| weshay|ruck | quiquell|rover, where is the git commit in the log? | 12:28 |
| weshay|ruck | for tq | 12:28 |
| quiquell|rover | weshay|ruck: commit for idempotency https://review.openstack.org/#/c/577809/ | 12:28 |
| weshay|ruck | https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload/335/consoleFull | 12:28 |
| quiquell|rover | weshay|ruck: The run from my morning didn't have it | 12:28 |
| * weshay|ruck is blind | 12:28 | |
| weshay|ruck | apparently | 12:28 |
| *** rlandy has joined #tripleo | 12:29 | |
| moguimar | I think having all the shards at the same place is virtually equal to having only one shard | 12:29 |
| moguimar | So I'd go with a single key for now | 12:29 |
| jaosorior | fair enough | 12:29 |
| *** trown|outtypewww is now known as trown | 12:30 | |
| redrobot | moguimar, I can agree with that, but then what does it matter if you have only one shard vs only having the master key? | 12:30 |
| moguimar | they are the same =D | 12:30 |
| redrobot | I'm actually not even sure if SSSS supports a threshold of one? | 12:30 |
| moguimar | I'm just using a common word | 12:30 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Verify the Swift container exists with a small utility workflow https://review.openstack.org/528213 | 12:30 |
| redrobot | moguimar, so you're basically saying SSSS should not be used? | 12:30 |
| redrobot | I'm fine with that, btw | 12:30 |
| redrobot | would make things easier | 12:30 |
| moguimar | I've heard somewhere in the documentation that a single key is 1 shard with 1 threshold | 12:31 |
| jaosorior | redrobot: well, either way this is just preliminary discussion. Ideally this will all go into a blueprint | 12:31 |
| moguimar | s/heard/read | 12:31 |
| redrobot | k, | 12:31 |
| redrobot | moving on, I understand HA a bit more | 12:32 |
| jaosorior | hopefully by having a blueprint there will be more folks with relevant feedback | 12:32 |
| weshay|ruck | lolz | 12:32 |
| moguimar | the thing is how to get different players to unseal the vault whenever needed | 12:32 |
| moguimar | by players I mean people or other processes | 12:32 |
| moguimar | to submit key shards to the vault server | 12:32 |
| redrobot | basically Vault open source can be clustered in a Master+Hot Standby mode | 12:32 |
| jaosorior | right | 12:32 |
| redrobot | but to enable that, you need a "HA" enabled backend | 12:32 |
| redrobot | which mysql is not | 12:33 |
| redrobot | but you could use mysql for storage | 12:33 |
| redrobot | so basically you configure 2 backends | 12:33 |
| jaosorior | lets go with that assumption for now... but I would sure like to know why it's not HA | 12:33 |
| redrobot | 1 has to be HA-backend | 12:33 |
| jaosorior | right | 12:33 |
| jaosorior | could be etcd | 12:33 |
| redrobot | as I understand it, Vault is using a distributed lock to decide what node is master | 12:33 |
| quiquell|rover | weshay|ruck: TASK [validate-undercloud : Reinstall the undercloud to check idempotency] ***** | 12:33 |
| quiquell|rover | 2018-06-27 00:06:19.688 | Wednesday 27 June 2018 00:06:19 +0000 (0:00:00.096) 0:37:55.012 ******** | 12:34 |
| quiquell|rover | 2018-06-27 00:06:19.714 | skipping: [undercloud] | 12:34 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Add support for j2-rendered user defined drop-ins https://review.openstack.org/578370 | 12:34 |
| weshay|ruck | mwhahaha, quiquell|rover this may be new.. in latest promotion jobs https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-singlenode-featureset027-master/5fd6688/undercloud/home/jenkins/undercloud_sanity_check.log.txt.gz#_2018-06-27_00_06_50 | 12:34 |
| redrobot | and for some reason, the mysql backend can't be used for that | 12:34 |
| weshay|ruck | most everything else is passing afaict | 12:34 |
| quiquell|rover | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-singlenode-featureset027-master/5fd6688/console.txt.gz#_2018-06-27_00_06_19_669 | 12:34 |
| redrobot | not sure if it's not possible or just not implemented | 12:34 |
| jaosorior | maybe just not implemented | 12:34 |
| quiquell|rover | weshay|ruck: new fire... what a wonderful news | 12:34 |
| jaosorior | alright | 12:34 |
| jaosorior | so lets say we have etcd, which is supported for HA | 12:34 |
| redrobot | Yes, then ETCD can be used for the lock, and mysql for storage | 12:35 |
| mwhahaha | weshay|ruck: i saw quiquell|rover had a patch for that | 12:35 |
| jaosorior | the caveat is that we have no automatic failover, how so? | 12:35 |
| *** zul has joined #tripleo | 12:35 | |
| quiquell|rover | mwhahaha: Yep... is the ironic api change | 12:35 |
| redrobot | so, when the master fails, a hot-standby can become master | 12:35 |
| redrobot | but afaict there is no mechanism to let the clients know | 12:35 |
| redrobot | so the client needs to be smart enough to go check other nodes when one fails out | 12:35 |
| redrobot | or we need to have a smart lb that can reconfigure itself when a master fails | 12:36 |
| quiquell|rover | weshay|ruck, mwhahaha: Need some reviewing on the fixes | 12:36 |
| * mwhahaha reviewed | 12:36 | |
| weshay|ruck | quiquell|rover, k.. we may need to change the timeout on https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/1021/console | 12:36 |
| moguimar | the simple approach is to have a round robin to all nodes | 12:36 |
| jaosorior | redrobot: what about having clients access Vault behind HAProxy? | 12:36 |
| redrobot | so only the master responds | 12:36 |
| moguimar | and the hot standby nodes just forward the request to the master | 12:37 |
| *** psahoo has quit IRC | 12:37 | |
| redrobot | hot-standby nodes always respond with a redirect | 12:37 |
| jaosorior | ah | 12:37 |
| jaosorior | I see | 12:37 |
| quiquell|rover | weshay|ruck: We can do that in RDO ? | 12:37 |
| redrobot | moguimar, ah yes, that's also an option | 12:37 |
| moguimar | they can redirect or forward | 12:37 |
| redrobot | so, with redirects turned on, and a round-robin lb, you still need to take failed masters out of rotation | 12:38 |
| *** ykarel has joined #tripleo | 12:39 | |
| jaosorior | So this basically all means we gotta write a smart Vault client library | 12:39 |
| weshay|ruck | quiquell|rover, ya | 12:39 |
| *** ykarel has quit IRC | 12:39 | |
| redrobot | well, smart lb or smart client, yeah | 12:39 |
| quiquell|rover | weshay|ruck, mwhahaha, sshnaidm: +2 +1w to be able to fix TQE check https://review.openstack.org/#/c/578339/ | 12:39 |
| jaosorior | redrobot: OR... we could go around it by tying Vault to a Virtual IP just for Vault usage and having a resource agent tied to it. | 12:39 |
| quiquell|rover | with that we can try to merge the ironic fix | 12:40 |
| *** ykarel has joined #tripleo | 12:40 | |
| sshnaidm | weshay|ruck, marios please review fixes for linter: https://review.openstack.org/#/c/578364/ https://review.openstack.org/#/c/578365 https://review.openstack.org/#/c/578340/ https://review.openstack.org/#/c/578339 | 12:40 |
| quiquell|rover | weshay|ruck, mwhahaha: The actual fix https://review.openstack.org/#/c/578292/ | 12:40 |
| redrobot | 😯 that could work too jaosorior | 12:40 |
| jaosorior | redrobot: pacemaker could be monitoring the master's health, and have a VIP attached to that node. When the master fails, it would then move the VIP to where the new master is. The caveat is that there will be a small service interruption. | 12:40 |
| jaosorior | which is 10s IIRC... however long pacemaker takes to do a monitor action | 12:41 |
| quiquell|rover | sshnaidm: Thanks | 12:41 |
| jaosorior | so yeah, it should be possible. It would just requite us to write a pacemaker resource agent that monitors Vault master nodes. | 12:41 |
| jaosorior | the magic that ties that agent to the VIP is already available via pacemaker | 12:41 |
| jaosorior | redrobot: mind if I write that down on your notes? | 12:42 |
| redrobot | jaosorior, not at all... | 12:42 |
| redrobot | my notes are y'alls notes 😁 | 12:42 |
| *** zoli is now known as zoli|afk | 12:42 | |
| jaosorior | written | 12:43 |
| redrobot | jaosorior, sweet | 12:43 |
| marios | sshnaidm: ack in a bit | 12:44 |
| redrobot | last thing to consider is the Vault Policy Engine | 12:44 |
| *** zul has quit IRC | 12:44 | |
| sshnaidm | quiquell|rover, this need to be rebased, not dependent: https://review.openstack.org/#/c/578292/ | 12:44 |
| redrobot | as policies need to be defined | 12:44 |
| sshnaidm | quiquell|rover, it's commits in the same repo | 12:44 |
| jaosorior | yay, more policy work | 12:44 |
| quiquell|rover | sshnaidm: You are right same repo | 12:44 |
| quiquell|rover | sshnaidm: Have so much commits in my brains right now | 12:45 |
| jaosorior | redrobot: OK, so we need to maintain a policy file for Vault in TripleO then, right? | 12:45 |
| redrobot | yup | 12:45 |
| sshnaidm | quiquell|rover, yeah, totally understandable.. | 12:45 |
| jaosorior | OK, once you have more notes about how that works, we can get some dedicated time to brainstorm how that would look like | 12:45 |
| moguimar | if we use more then the root token, yes | 12:45 |
| moguimar | but it sounds like a bad idea to use root token | 12:46 |
| redrobot | haha, yeah, moguimar | 12:46 |
| jaosorior | moguimar: hopefully we do use something else than root token :D | 12:46 |
| moguimar | basicaly the root token has godlike powers | 12:46 |
| moguimar | and it can create other tokens | 12:46 |
| weshay|ruck | quiquell|rover, you know how to fix https://review.openstack.org/#/c/578292/ ? | 12:46 |
| jaosorior | we could use it if we're just doing a POC though | 12:46 |
| redrobot | I was thinking we can define some paths and then build some policies around that. | 12:46 |
| moguimar | then you have policies to adress specific access level for the new tokens | 12:47 |
| weshay|ruck | thanks for the help sshnaidm | 12:47 |
| *** liverpooler has joined #tripleo | 12:47 | |
| *** myoung|off is now known as myoung | 12:47 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Use openstack CLI for ironic https://review.openstack.org/578292 | 12:47 |
| jaosorior | redrobot: if you can add some notes on how policy works for Vault that we could read, it would be great :D | 12:47 |
| quiquell|rover | sshnaidm: updated https://review.openstack.org/#/c/578292/ | 12:47 |
| redrobot | one thing I'd like to see with the Vault Policy, is that one service could not read secrets that belong to another service | 12:47 |
| jaosorior | that way I can get on-par with the stuff your checking out, and hopefully give more useful comments. | 12:48 |
| weshay|ruck | quiquell|rover, why did you abandon it? | 12:48 |
| redrobot | jaosorior, ack, I'll add more notes to the policy stuff | 12:48 |
| quiquell|rover | weshay|ruck: Didn't have time to really investigate it, just gave a fix | 12:48 |
| weshay|ruck | it just needed to be rebased | 12:48 |
| sshnaidm | quiquell|rover, abandoned? | 12:48 |
| quiquell|rover | weshay|ruck: I have reparent it with at another patch | 12:48 |
| weshay|ruck | right | 12:48 |
| weshay|ruck | no need to abandon though | 12:49 |
| quiquell|rover | weshay|ruck: brain fart, restored | 12:49 |
| jaosorior | redrobot: anyway, so far the things we could already start considering for a POC are: * master key initially (no SSSS). * etcd as a backend for HA. | 12:49 |
| weshay|ruck | quiquell|rover, :) | 12:49 |
| redrobot | jaosorior, yep, and mysql for storage backend | 12:49 |
| bogdando | folks, do you know, can I use get_file in parameter_defaults? | 12:50 |
| redrobot | (I'm assuming mysql is preferred for storage because it may already have backup policies around it?) | 12:50 |
| jaosorior | right | 12:50 |
| jaosorior | and we could start researching what's needed to be written for the pacemaker resource agent | 12:50 |
| *** jcoufal has joined #tripleo | 12:50 | |
| bogdando | I'm really stuck with https://review.openstack.org/#/c/578088/ | 12:50 |
| bogdando | need to figure out the way to refer the env file named lately | 12:51 |
| jaosorior | we could start this using the root token. And after having something that kinda works, we could move on to have a nicer implementation with proper policies | 12:51 |
| jaosorior | redrobot: does that sound alright to you? | 12:51 |
| bogdando | undercloud_config knows nothing of heat stacks, and I need to have it in the -e foo file name | 12:51 |
| redrobot | yep | 12:51 |
| jaosorior | great great | 12:51 |
| jaosorior | redrobot: thanks for bringing it up! | 12:51 |
| bogdando | so thinking of using get_file in parameters_default... would it work? | 12:51 |
| redrobot | 👍 | 12:52 |
| shardy | bogdando: No get_file won't work in an environment file | 12:52 |
| * bogdando sigh | 12:52 | |
| quiquell|rover | weshay|ruck, sshnaidm, mwhahaha, marios: https://review.openstack.org/#/c/578351/, https://review.openstack.org/#/c/578352/, https://review.openstack.org/#/c/578368/ | 12:52 |
| shardy | bogdando: you'll have to write the file then append it to the -e options | 12:52 |
| quiquell|rover | missing linting reviews | 12:52 |
| jaosorior | redrobot: anything else you want to bring up regarding that topic? | 12:52 |
| redrobot | I think that's all for now | 12:52 |
| bogdando | shardy: I cannot write it before I know the stack id | 12:52 |
| shardy | or set the StackAction in one of the environment files we already write | 12:52 |
| jaosorior | alright | 12:52 |
| bogdando | it's created later | 12:52 |
| jaosorior | thanks for joining folks! | 12:52 |
| jaosorior | Also, one thing | 12:52 |
| jaosorior | I'll be off for three weeks on PTO | 12:52 |
| sshnaidm | quiquell|rover, mm.. it's duplicates | 12:53 |
| redrobot | ah yes, I'm out on PTO next week as well | 12:53 |
| jaosorior | lhinds: could you take on driving these meetings while I'm gone? | 12:53 |
| bogdando | shardy: so I did https://review.openstack.org/#/c/578370/ but it won't help much :( | 12:53 |
| shardy | bogdando: The ID won't be known until the ephemeral stack is created, so I think the best you can do is use the name e.g the --stack option | 12:53 |
| shardy | as I said in the review previously | 12:53 |
| redrobot | jaosorior, I can't do next week, but I could do the two weeks after that. | 12:53 |
| lhinds | jaosorior: sure, np..the next two right? | 12:53 |
| bogdando | shardy: yea, but that looks too fragile... | 12:53 |
| jaosorior | lhinds: next three :D | 12:53 |
| quiquell|rover | sshnaidm: wich one ? | 12:53 |
| lhinds | shall i do next week and redrobot the following two? | 12:54 |
| moguimar | I'll be off next week as well | 12:54 |
| sshnaidm | quiquell|rover, I did for stable branches: https://review.openstack.org/578364 https://review.openstack.org/578365 | 12:54 |
| shardy | bogdando: really? I think the --stack option will be rarely used, and we can just document that (as with all tripleo deployments) the name must be unique? | 12:54 |
| jaosorior | lhinds, redrobot: that sounds like a plan! | 12:54 |
| jaosorior | thanks guys! | 12:54 |
| jaosorior | and thanks everybody for joining | 12:54 |
| lhinds | k, no worries | 12:54 |
| shardy | it'll be better than using one name anyway | 12:54 |
| jaosorior | #endmeeting | 12:54 |
| *** openstack changes topic to "Welcome to Rocky. CI status: RED RDO-Cloud is down | https://docs.openstack.org/tripleo-docs/latest" | 12:54 | |
| openstack | Meeting ended Wed Jun 27 12:54:25 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 12:54 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo_security_squad/2018/tripleo_security_squad.2018-06-27-12.04.html | 12:54 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo_security_squad/2018/tripleo_security_squad.2018-06-27-12.04.txt | 12:54 |
| redrobot | thanks jaosorior | 12:54 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo_security_squad/2018/tripleo_security_squad.2018-06-27-12.04.log.html | 12:54 |
| sshnaidm | quiquell|rover, and you have this: https://review.openstack.org/#/c/578336/ for validations | 12:54 |
| bogdando | shardy: right, but given that we name all stacks undercloud, and we'll have to deal with multi underclouds sooner or later... | 12:54 |
| bogdando | it's better off to have it implemented properly from the beginning | 12:54 |
| shardy | bogdando: not on the same physical host though? | 12:55 |
| bogdando | not sure | 12:55 |
| shardy | I don't see how/why you would, you can't deploy the same services twice on the same box | 12:55 |
| shardy | I'd say lets solve the immediate problem and worry about that if it ever happens ;) | 12:55 |
| bogdando | its side-by side | 12:55 |
| quiquell|rover | sshnaidm: Let's take your for upgrades and the other for validations | 12:55 |
| bogdando | oh well, not sure what then mwhahaha means | 12:55 |
| bogdando | and why we have to version those mark and dropin at all | 12:56 |
| shardy | bogdando: what do you mean? The containers bind ports and directories on the host, you can'd deploy side by side without using VMs | 12:56 |
| bogdando | well, can we just use a single file then? | 12:56 |
| mwhahaha | bogdando: because you can specify stack name to tripleod eploy | 12:56 |
| bogdando | why adding the stack or id or whatever? | 12:56 |
| shardy | bogdando: As I said in the review, just use the stack name | 12:56 |
| sshnaidm | quiquell|rover, btw, did you see the same problem with tripleo-validaitons? | 12:56 |
| mwhahaha | bogdando: and i've got a change to change the default stack name to not undercloud | 12:56 |
| bogdando | shardy: ack, thanks | 12:56 |
| sshnaidm | quiquell|rover, I wouldn't change it if nothing is broken there | 12:57 |
| *** edmondsw has joined #tripleo | 12:57 | |
| *** edmondsw has quit IRC | 12:57 | |
| shardy | bogdando: there is a --stack option, which may or may not be used to do "config only" deploys, so in those cases we want to avoid conflicting lockfiles | 12:57 |
| *** edmondsw has joined #tripleo | 12:57 | |
| mwhahaha | bogdando: https://review.openstack.org/#/c/577864/ | 12:57 |
| shardy | just prepending the stack name should solve for that use-case I think | 12:57 |
| shardy | and maybe adding an option to ignore/delete the lockfile | 12:57 |
| quiquell|rover | sshnaidm: I am re-running it | 12:58 |
| *** holser_ has quit IRC | 12:58 | |
| quiquell|rover | sshnaidm: validations working fine without the change | 12:59 |
| quiquell|rover | going to abandon it | 12:59 |
| sshnaidm | quiquell|rover, cool, thanks for checking | 12:59 |
| bogdando | shardy: yea, already have that flag wip | 12:59 |
| bogdando | --force-stack-update | 12:59 |
| quiquell|rover | sshnaidm: I think they are all at verifying | 12:59 |
| bogdando | I hope it's a fine name | 12:59 |
| shardy | bogdando: ack sounds good, so just including the stack name in the lockfile name should be enough I think | 12:59 |
| shardy | bogdando: isn't it the opposite? | 13:00 |
| shardy | e.g after deploy we'll always do UPDATE | 13:00 |
| *** panda|off is now known as panda | 13:00 | |
| shardy | you might want to force the same as initial CREATE | 13:00 |
| bogdando | not really | 13:00 |
| shardy | maybe we just document where to remove the lockfile | 13:00 |
| *** zul has joined #tripleo | 13:00 | |
| bogdando | IIUC | 13:00 |
| bogdando | we want instead to always override the CREATE, if users wants so | 13:00 |
| shardy | bogdando: Ok perhaps I'm missing something - when would I want to add --force-stack-update ? | 13:00 |
| bogdando | we never do update infact | 13:00 |
| quiquell|rover | sshnaidm: Huff I go for lunch now :-/ | 13:01 |
| *** quiquell|rover is now known as quique|rover|lch | 13:01 | |
| bogdando | we create one-time and forget | 13:01 |
| bogdando | ephemeral stacks | 13:01 |
| bogdando | one does not simply update ephemeral stacks! :) | 13:01 |
| *** ukalifon has quit IRC | 13:01 | |
| shardy | bogdando: yes, which your patch will fix, so that on subsequent runs we include StackAction: UPDATE forever after | 13:01 |
| bogdando | so we always do CREATE, and the flag is the subject to enforce it virtually updated if user wants | 13:01 |
| bogdando | say, after a failed operation | 13:01 |
| bogdando | see the comments slagle and dprince posted, shardy | 13:02 |
| *** pradk has quit IRC | 13:02 | |
| bogdando | shardy: there is a grey case, if stack or deploy failed | 13:02 |
| shardy | Yeah I saw them, one of us has a misunderstanding, I'll re-read | 13:02 |
| bogdando | we do not know if we now have to update or create | 13:02 |
| bogdando | so here is a flag to clarify, and do update instead of default create | 13:03 |
| shardy | bogdando: yeah I think --force-stack-update makes sense but only if we ensure the lockfile is only created at the very end of a successful deploy | 13:03 |
| bogdando | It's time to update my patch, just to show you WIP prolly | 13:03 |
| shardy | I was thinking what if I want CREATE after a successful deploy | 13:03 |
| shardy | perhaps thats a rare case | 13:03 |
| shardy | rm -f $lockfile ;) | 13:03 |
| bogdando | my head is gonna explode now | 13:03 |
| dprince | bogdando: my comments were more along the lines to make the feature warn the user to use 'update'. Rather than have it automatically do it | 13:03 |
| bogdando | thinking of those cases for two days :D | 13:04 |
| bogdando | dprince: yea, and that's I added the --foce-update-flag | 13:04 |
| dprince | bogdando: implementing that without adding an extra flag should be possible I think | 13:04 |
| bogdando | force stack update | 13:04 |
| dprince | bogdando: or perhaps just an internal flag | 13:04 |
| shardy | dprince: yeah that could work - only thing is it's different to the typical overcloud update/upgrade commands, but I guess we can align those over time | 13:05 |
| shardy | either approach could work I guess | 13:05 |
| bogdando | the case that slagle described cannot be tracked internally | 13:05 |
| bogdando | unless we add a db :D | 13:05 |
| bogdando | but that defeats the very purpose of stack ephemeral nature | 13:05 |
| *** ansmith has joined #tripleo | 13:06 | |
| shardy | sure, we're talking about a lockfile or maybe a single status value here, not a DB ;) | 13:06 |
| shardy | but just using a different CLI command seems valid too, albeit inconsisent with the current overcloud deploy approach | 13:06 |
| shardy | arguably we should be using overcloud update better anyway | 13:06 |
| *** agopi has joined #tripleo | 13:07 | |
| bogdando | it cannot be done by cuz we picked ephemeral vs persistent stacks, FWIW | 13:07 |
| dprince | bogdando: yeah, I would prefer not to keep the DB if we don't have to | 13:07 |
| slagle | i actually wonder how much we rely on stack_action anymore | 13:07 |
| bogdando | so we can't strictly follow overclouds logic | 13:07 |
| shardy | sure but we can pass data into the ephemeral stack | 13:07 |
| bogdando | slagle: a lot... | 13:07 |
| bogdando | in puppets | 13:07 |
| slagle | when i grep'd in puppet-tripleo, it's only used for rabbitmq+pacemaker | 13:07 |
| bogdando | that's a lot :D | 13:08 |
| shardy | Ok maybe that's the other option, get rid of that and have the puppet modules figure out state some other way | 13:08 |
| *** mjturek has joined #tripleo | 13:08 | |
| slagle | bogdando: um, no it isn't | 13:08 |
| bogdando | pacemaker hides the world behind | 13:08 |
| shardy | I'd assumed it would be too much work | 13:08 |
| slagle | it's 1 place | 13:08 |
| slagle | and i think it could be fixed by checking if the rabbitmq user already exists in puppet | 13:08 |
| bogdando | I cannot predict the overclouds impact... if we removed this | 13:08 |
| bogdando | hmm | 13:08 |
| shardy | only one way to find out :D | 13:08 |
| slagle | i'm not sure where else we'd have some conditional logic based on the stack action, perhaps in some tripleo-common workflows, but those aren't used with tripleo deploy | 13:10 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778865 | 13:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 13:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 13:10 |
| openstack | Launchpad bug 1778865 in tripleo "Failing openstack-pox-linter TypeError: unbound method construct_mapping()" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell) | 13:10 |
| bogdando | slagle: there is also manilla we'll want on underlcoud shortly | 13:11 |
| shardy | slagle: we've been planning to use it for the openshift update/scale-out, ref https://review.openstack.org/#/c/578285/2/extraconfig/services/openshift-master.yaml | 13:11 |
| shardy | but that can possibly be done some other way | 13:11 |
| bogdando | cinder, well prolly not, though I woldn't be so sure, given openshift on openstack track and standalone cinder and all of that | 13:11 |
| bogdando | yupp | 13:12 |
| *** Haresh has quit IRC | 13:12 | |
| bogdando | so not so simple now, not a 1 place :D | 13:12 |
| *** holser_ has joined #tripleo | 13:12 | |
| bogdando | and in pacemakers, it's bascially all under it CP | 13:13 |
| bogdando | redis, rabbit, mysql, haproxy... | 13:13 |
| bogdando | just grepping puppet tripleo for stack_action... | 13:13 |
| bogdando | slagle: ^^ | 13:13 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-common master: Add new undeploy_plan workflow https://review.openstack.org/566246 | 13:13 |
| shardy | can't we just fix the logic slagle commented on, so the lockfile isn't removed on a post-create failure? | 13:13 |
| shardy | and make the lockfile related to the --stack name? | 13:14 |
| bogdando | shardy: yea, I added a flag for that | 13:14 |
| bogdando | I'll update the patch for review, once I fix some ugly looking things | 13:14 |
| shardy | Ok sounds good | 13:14 |
| *** shardy has quit IRC | 13:14 | |
| bogdando | shadower: hm, can we add -e for a dir? | 13:15 |
| bogdando | shadower: sorry, that was for shardy | 13:15 |
| slagle | bogdando: sure, i was just pointing out it might be better to consider handling this logic in the configuration tools themselves (puppet/ansible) in the long term | 13:16 |
| *** ykarel is now known as ykarel|afk | 13:17 | |
| bogdando | yeah, I was also thinking of that path initially | 13:17 |
| slagle | bogdando: i don't really see anything that would make that impossible | 13:17 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Fix unit tests under python 3.6 https://review.openstack.org/578378 | 13:17 |
| *** bogdando has quit IRC | 13:18 | |
| *** amoralej|lunch is now known as amoralej | 13:18 | |
| *** bogdando has joined #tripleo | 13:21 | |
| *** nyechiel_ has joined #tripleo | 13:22 | |
| *** ykarel|afk has quit IRC | 13:23 | |
| *** lblanchard has quit IRC | 13:29 | |
| *** mcornea has joined #tripleo | 13:29 | |
| sri_ | dsneddon: Hi | 13:30 |
| sri_ | in all networking examples, nic1 is a default for provisioning is that right? if I wanted to use nic2 for provisioning modifying name to nic1 to nic2 should do that trick? or do i need to chage the order of the template !! | 13:30 |
| *** toure is now known as toure|biab | 13:30 | |
| sri_ | dsneddon, ^^ | 13:31 |
| *** nyechiel_ has quit IRC | 13:31 | |
| *** zoli|afk is now known as zoli|wfh | 13:32 | |
| jistr | gfidente: looks good, the UUID based variables. Btw if we had `deploy_tasks` (step based like the Puppet execution we have, but it would be Ansible instead of current Puppet), we could do the hostvars writing directly in the "main ansible run" and wouldn't have to nest there. | 13:32 |
| *** zoli|wfh is now known as zoli | 13:32 | |
| jistr | gfidente: actually we could probably do it already -- we could use host_prep_tasks instead of the nested Ansible probably? but either is fine i think | 13:33 |
| ramishra | It seems multinode jobs are timing out while running multinode-validate (tempest tests) after running for 3 hrs. Is there some infra issue or something else? | 13:34 |
| ramishra | http://logs.openstack.org/20/577620/4/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/3695c78/job-output.txt.gz#_2018-06-27_12_51_09_494537 | 13:34 |
| mwhahaha | ramishra: yea we're seeing that, unfortunately it's random | 13:34 |
| gfidente | jistr so I have to nest them because ceph-ansible is a different ansible-playbook run | 13:34 |
| *** bkopilov has joined #tripleo | 13:34 | |
| *** dtantsur|brb is now known as dtantsur | 13:35 | |
| *** itlinux has quit IRC | 13:35 | |
| *** quique|rover|lch is now known as quiquell|rover | 13:35 | |
| jistr | gfidente: ceph-ansible yes, but the node-uuid setting wouldn't have to be i think | 13:36 |
| ramishra | mwhahaha: thanks, I was wondering if we could increase the job timeout? | 13:37 |
| mwhahaha | ramishra: no, 3 hours is the upstream limit | 13:37 |
| ramishra | mwhahaha: OK | 13:37 |
| jistr | gfidente: but the nested way is also nice because we can simply reuse the same inventory as ceph-ansible uses. With host_prep_tasks we'd achieve it the same i think, but it wouldn't be so obvious from code. So no issue with nesting, still ready to +2, just keeping +1 for now to give other folks a chance to look too. | 13:39 |
| gfidente | jistr so I'd like it global | 13:40 |
| *** waleedm has quit IRC | 13:40 | |
| sri_ | bfournie: Hi if you around I have couple of question regarding to networking | 13:40 |
| jistr | gfidente: right, that would be yet another completely different approach. We'd probably pull it directly into the main common_deploy_steps_tasks.yaml | 13:40 |
| jistr | gfidente: that can be done subsequently, it's fine to start with ceph-ansible IMO | 13:41 |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates stable/queens: Fix missing parameters in OVN DVR environment files https://review.openstack.org/568858 | 13:42 |
| *** toure|biab is now known as toure | 13:43 | |
| sshnaidm | mwhahaha, do you know if we install ansible from repos, not from pip? | 13:44 |
| sshnaidm | mwhahaha, I mean for config-download, uc, etc | 13:44 |
| mwhahaha | sshnaidm: we install it from repos for the deployment | 13:44 |
| mwhahaha | we're using 2.5.2 at the moment (i last checked a few days ago) | 13:44 |
| sshnaidm | mwhahaha, so we don't pin it to some version | 13:44 |
| mwhahaha | nope | 13:44 |
| sshnaidm | mwhahaha, ok, thanks | 13:44 |
| mwhahaha | sshnaidm: there's a bug in 2.5.4 | 13:45 |
| mwhahaha | that we hit in config download | 13:45 |
| mwhahaha | sshnaidm: https://review.openstack.org/#/c/577544/ | 13:45 |
| mwhahaha | jfyi | 13:45 |
| sshnaidm | mwhahaha, ack | 13:45 |
| *** skramaja has quit IRC | 13:50 | |
| *** agurenko has quit IRC | 13:54 | |
| *** cylopez has joined #tripleo | 13:59 | |
| *** shardy has joined #tripleo | 13:59 | |
| *** hjensas|afk has quit IRC | 14:02 | |
| *** ksambor has quit IRC | 14:03 | |
| jistr | gfidente: i added you on one of our trello cards, in hope you won't mind :) Basically in Upgrades we'll need to come up with a way to update and upgrade things deployed via external_deploy_tasks and since Ceph is a prominent user, early feedback there would be welcome :) | 14:04 |
| *** udesale has joined #tripleo | 14:04 | |
| gfidente | jistr right | 14:05 |
| gfidente | ++ | 14:05 |
| jistr | gfidente: there are no solution proposals just yet... i was thinking external_update_tasks and external_upgrade_tasks would be a best generic solution but need to think it through a bit more | 14:05 |
| jistr | gfidente: i assume we'd be able to mark the deploy tasks with some yaml references and then reuse them ( &something, *something ) | 14:06 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart-extras master: Adds check for python-virtualenv with error message https://review.openstack.org/578081 | 14:07 |
| *** pradk has joined #tripleo | 14:08 | |
| *** shreshtha has joined #tripleo | 14:08 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Run tempest on standalone https://review.openstack.org/578403 | 14:09 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 14:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778865 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 14:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 14:10 |
| openstack | Launchpad bug 1778865 in tripleo "Failing openstack-pox-linter TypeError: unbound method construct_mapping()" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell) | 14:10 |
| *** noslzzp_ has quit IRC | 14:11 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: QDR for metrics collection purposes https://review.openstack.org/572312 | 14:18 |
| bfournie | hi sri_ | 14:19 |
| sri_ | bfournie, in all networking examples, nic1 is a default for provisioning is that right? if I wanted to use nic2 for provisioning modifying name to nic1 to nic2 should do that trick? or do i need to chage the order of the template !! | 14:20 |
| bfournie | sri_: will you have a nic1? its just used a mapping so it attempts to walk through all the nicx names mapping them to real nics, there is nothing tied to having nic1 for provisioning | 14:22 |
| *** itlinux has joined #tripleo | 14:22 | |
| *** shardy has quit IRC | 14:22 | |
| openstackgerrit | Merged openstack/os-net-config master: fix a typo on bond_mapped.yaml https://review.openstack.org/555508 | 14:23 |
| sri_ | bfournie, Yes I do have nic1 I am planing to use for external network with default gateway so the I can access the overcloud dashboard amd apis | 14:23 |
| bfournie | sri_: yes that is fine to modify the names in nic config templates as you suggested | 14:24 |
| sri_ | bfournie, cool, one more question I in docs it mentioned " If no isolated networks are configured, all services run on the provisioning network" is this applies to multi-nic or bond-with-vlans ? | 14:24 |
| *** larsks has joined #tripleo | 14:26 | |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates master: Store ODL logs to file https://review.openstack.org/575416 | 14:26 |
| bfournie | sri_: that applies to any nic config example, if you are not using isolated networks (i.e not including network_isolation.yaml) then all of the networks fall back to ctlplane. The normal way of deploying now is to use isolated networks | 14:26 |
| sri_ | bfournie, i see, in my setup I 've six nics on my servers. nic2 for provisioning and nic1 with a default gateway(for external service), and remaining four nics in bond. bond1(nic3,nic4) for Storage/Internal APIs/ and bond2(nic5,nic6) for tenant and floating ips. | 14:27 |
| larsks | Is docker-puppet.py hanging around? Does allowing service templates to specify a custom value for archivedirs make sense (to pull in puppet changes in directories outside of the existing short list of directories)? | 14:27 |
| bfournie | sri_: that sounds good | 14:27 |
| mwhahaha | beagles: soooo how much time does neutron need to stop? | 14:28 |
| bogdando | mwhahaha, stevebaker: hi, just noticed that releasenotes/notes/container-images-file-required-ff11154429796729.yaml is in conflict with releasenotes/notes/undercloud-container-prepare-d272bdc30c073b29.yaml (tripleoclient) | 14:28 |
| bogdando | so which is the truth? | 14:28 |
| mwhahaha | why not both? | 14:28 |
| bogdando | it's about container_images_file | 14:28 |
| * mwhahaha has no idea | 14:28 | |
| bogdando | can't be :) | 14:28 |
| sri_ | bfournie, It seems I need to create custom network templates make that work | 14:28 |
| gfidente | jistr I like host_prep_task suggestion | 14:29 |
| bogdando | the container_images_file is a required... `container_images_file` option to be not mandatory | 14:29 |
| bogdando | :D | 14:29 |
| bfournie | sri_: if that isn't the default then yes | 14:29 |
| mwhahaha | bogdando: it's no longer required | 14:29 |
| openstackgerrit | qingszhao proposed openstack/puppet-pacemaker master: Add release note link in README https://review.openstack.org/578415 | 14:29 |
| mwhahaha | bogdando: so we need to update the one that says it's required | 14:29 |
| mwhahaha | bogdando: it was required for about a month | 14:29 |
| bogdando | mwhahaha: thanks, an easy patch for you perhaps! :) | 14:30 |
| *** threestrands has quit IRC | 14:30 | |
| bogdando | basically, I have a question for release notes. Should I put there new CLI options for standalone deployments (prolly not)? | 14:31 |
| bogdando | and for undercloud --use-heat additions?.. | 14:31 |
| bogdando | it has yet been releases also | 14:31 |
| bogdando | so only to docs, it seems | 14:31 |
| gfidente | jistr added a comment | 14:31 |
| gfidente | jistr see what you think | 14:31 |
| gfidente | jistr want to make sure I got it right | 14:31 |
| mwhahaha | bogdando: no because we're going to ditch the --use-heat option soonish | 14:31 |
| bogdando | ok, thanks | 14:32 |
| bogdando | so will update docs only | 14:32 |
| jistr | gfidente: you didn't publish the comment yet? | 14:32 |
| gfidente | jistr :D | 14:32 |
| gfidente | jistr done | 14:32 |
| jistr | :)) | 14:32 |
| * jistr reading | 14:32 | |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Remove required releasenote reference https://review.openstack.org/578418 | 14:33 |
| sri_ | bfournie, understood, we are planing to DVR, if I look in network/configure that template only available in muliti-nic config, if i have custom templates I can copy that and use it my template ? | 14:33 |
| mwhahaha | bogdando: -^ | 14:33 |
| sri_ | bfournie, network/config** | 14:33 |
| *** pchavva has joined #tripleo | 14:34 | |
| openstackgerrit | Merged openstack/os-apply-config master: Update links in README https://review.openstack.org/574638 | 14:34 |
| *** janki has quit IRC | 14:35 | |
| bogdando | thanks! | 14:36 |
| *** rh-jelabarre has quit IRC | 14:37 | |
| jistr | gfidente: replied, i think the "local_action/copy" needs to go to host_prep_tasks too | 14:37 |
| openstackgerrit | Merged openstack/tripleo-docs master: Added Tempest Documentation for Tripleo https://review.openstack.org/565161 | 14:38 |
| sri_ | bfournie, Thanks for the explanation :) | 14:38 |
| jistr | gfidente: all those host_prep_tasks would have to be pulled into all Ceph service templates, e.g. via embedding the base service and reusing the host_prep_tasks output | 14:38 |
| jistr | gfidente: not sure if it's too much hassle or not... what you have is fine too | 14:39 |
| bfournie | sri_: yes you can copy that and customize it. Are you using osp-13? The steps are a bit different because jinja is used to generate the example nic files to not have so many of them. You can see the files with *j2.yaml extension. If you copy the whole openstack-tripleo-heat-templates directroy locally you can run ./tools/process-templates.py there and it will generate the *.yaml files which you can then copy and customize | 14:39 |
| bfournie | sri_: if not using pike or queens you can ignore ^ | 14:40 |
| gfidente | jistr we need to chat this at another time | 14:40 |
| gfidente | jistr cause I am going pto | 14:40 |
| gfidente | but I am fine doing a bit more work to make it global | 14:40 |
| jistr | gfidente: ack. enjoy pto :) | 14:40 |
| gfidente | maybe we can start from the self-contained version just so it works as necessary until have better plan? | 14:40 |
| *** mjturek has quit IRC | 14:41 | |
| jistr | gfidente: yes that's fine by me | 14:41 |
| openstackgerrit | qingszhao proposed openstack/puppet-tripleo master: Add release note link in README https://review.openstack.org/578422 | 14:47 |
| *** hamzy has quit IRC | 14:49 | |
| mwhahaha | weshay|ruck: looks like weirdo p-o-i jobs are rboken | 14:49 |
| * mwhahaha sighs and goes fixin' | 14:51 | |
| weshay|ruck | amoralej, who is point for weirdo jobs now? | 14:52 |
| beagles | mwhahaha, are you asking in reference to https://bugs.launchpad.net/tripleo/+bug/1778913 ? | 14:52 |
| openstack | Launchpad bug 1778913 in tripleo "containers are not gracefully stopped on shutdown/reboot" [Medium,Triaged] | 14:52 |
| amoralej | weshay|ruck, what's the problem? | 14:52 |
| mwhahaha | beagles: yea cause there's a stop-timeout that can be configured on the containers | 14:52 |
| *** quiquell|rover is now known as quiquell|off | 14:52 | |
| *** hamzy has joined #tripleo | 14:52 | |
| mwhahaha | beagles: which is to let it finish gracefully | 14:52 |
| beagles | mwhahaha, in any case the short answer is I don't think we know | 14:52 |
| mwhahaha | beagles: before sigkill | 14:52 |
| weshay|ruck | amoralej, they are blocking master | 14:53 |
| mwhahaha | beagles: ಠ_ಠ | 14:53 |
| beagles | mwhahaha, but that only matters when docker stop is used to stop the container right? | 14:53 |
| amoralej | let me see | 14:53 |
| mwhahaha | beagles: it issues a stop on shutdown (i think) | 14:53 |
| *** hamzy has quit IRC | 14:53 | |
| beagles | mwhahaha, oh maybe it does - that wasn't clear from what I was seeing but if it does and is configurable that would be cool | 14:54 |
| beagles | mwhahaha, wahat I was seeing looked like the processes were still there - and systemd itself was killing them off | 14:54 |
| amoralej | weshay|ruck, where is blocking it? | 14:54 |
| mwhahaha | beagles: so i think that's what we need to tune, i'll look into seeing if we expose that via paunch/THT after i fix p-o-i in rdo | 14:54 |
| beagles | mwhahaha, I wouldn't have expected that if "docker stop" was doing the shutting down of things | 14:54 |
| mwhahaha | beagles: it's possible but that might be something we're handling | 14:54 |
| *** hamzy has joined #tripleo | 14:54 | |
| beagles | mwhahaha, gotcha | 14:55 |
| mwhahaha | weshay|ruck: aaaaargh the failures in the gate are killing me | 14:55 |
| weshay|ruck | amoralej, are you asking me to point out the jobs? | 14:55 |
| beagles | mwhahaha, maybe a similar timeout to what we are using with 'docker stop' on minor update | 14:55 |
| weshay|ruck | mwhahaha, I don't see a new failure | 14:56 |
| weshay|ruck | mwhahaha, I see three timeouts | 14:56 |
| *** mjturek has joined #tripleo | 14:56 | |
| mwhahaha | weshay|ruck: right those | 14:57 |
| weshay|ruck | mwhahaha, k.. I'll dig into them again | 14:59 |
| amoralej | weshay|ruck, yes | 14:59 |
| amoralej | which jobs are blocking master? | 14:59 |
| weshay|ruck | amoralej, the red ones? https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo_trunk-promote-master-current-tripleo/ | 15:01 |
| weshay|ruck | amoralej, not sure what the confusion is | 15:01 |
| amoralej | weshay|ruck, those are old jobs | 15:01 |
| amoralej | we need a new promotion in tripleo | 15:02 |
| *** waleedm has joined #tripleo | 15:02 | |
| amoralej | to get the fix | 15:02 |
| amoralej | let me double check | 15:02 |
| weshay|ruck | amoralej, k thanks | 15:02 |
| weshay|ruck | mwhahaha, ^ | 15:02 |
| *** ledo_ has joined #tripleo | 15:02 | |
| mwhahaha | we don't promote puppet modules via tripleo? | 15:03 |
| mwhahaha | amoralej, weshay|ruck talking about this in #rdo | 15:03 |
| *** stendulker has joined #tripleo | 15:04 | |
| *** mjturek has quit IRC | 15:05 | |
| *** zul has quit IRC | 15:05 | |
| *** noslzzp has joined #tripleo | 15:05 | |
| *** mjturek has joined #tripleo | 15:06 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Add new abstract base job to zuul configuration https://review.openstack.org/578432 | 15:06 |
| *** waleedm has quit IRC | 15:07 | |
| *** janki has joined #tripleo | 15:08 | |
| *** rpioso|afk is now known as rpioso | 15:09 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Add new abstract base job and nodeset to zuul configuration https://review.openstack.org/578432 | 15:10 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778865 | 15:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 15:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 15:10 |
| openstack | Launchpad bug 1778865 in tripleo "Failing openstack-pox-linter TypeError: unbound method construct_mapping()" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell) | 15:10 |
| openstackgerrit | qingszhao proposed openstack/os-net-config master: Add release note link in README https://review.openstack.org/578437 | 15:12 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Revert "Revert "Switch scenario00{1,2,3,4,7} to containerized undercloud"" https://review.openstack.org/575330 | 15:12 |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: Switch the undercloud to be containerized by default https://review.openstack.org/576218 | 15:13 |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: Switch the undercloud to be containerized by default https://review.openstack.org/576218 | 15:13 |
| *** paramite has quit IRC | 15:16 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Add new run playbook https://review.openstack.org/578442 | 15:18 |
| openstackgerrit | Martin Kopec proposed openstack/tripleo-docs master: Fix typos in Tempest documentation https://review.openstack.org/578443 | 15:18 |
| *** kopecmartin has quit IRC | 15:24 | |
| *** yprokule has quit IRC | 15:24 | |
| *** jcoufal has quit IRC | 15:25 | |
| sri_ | bfournie, got it, I was using process-templates.py to generate network templates in queens, again thanks :) | 15:25 |
| *** gkadam__ has quit IRC | 15:26 | |
| bfournie | sri_: great! | 15:26 |
| *** gkadam__ has joined #tripleo | 15:26 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Add new abstract base job and nodeset to zuul configuration https://review.openstack.org/578432 | 15:29 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Add new run playbook https://review.openstack.org/578442 | 15:29 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Migrate undercloud jobs to the new base configurations https://review.openstack.org/578447 | 15:29 |
| numans_ | EmilienM, Hi, can you please take a look at this patch when you get some time - https://review.openstack.org/#/c/577376/ (this is the backport patch for queens). Thanks | 15:30 |
| *** mjturek has quit IRC | 15:33 | |
| *** edmondsw has quit IRC | 15:33 | |
| mwhahaha | nmagnezi: he's on pto, i'll take a look | 15:33 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Add new abstract base job and nodeset to zuul configuration https://review.openstack.org/578432 | 15:34 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Add new run playbook https://review.openstack.org/578442 | 15:34 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Migrate undercloud jobs to the new base configurations https://review.openstack.org/578447 | 15:34 |
| *** mjturek has joined #tripleo | 15:34 | |
| *** leanderthal has quit IRC | 15:35 | |
| *** dparkes has quit IRC | 15:35 | |
| *** slagle changes topic to "Welcome to Rocky. CI status: ??? | https://docs.openstack.org/tripleo-docs/latest" | 15:37 | |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates stable/queens: ovn: Add dns_servers configuration support https://review.openstack.org/578450 | 15:38 |
| *** paramite has joined #tripleo | 15:38 | |
| numans_ | mwhahaha, thank you for the review | 15:41 |
| *** bogdando has quit IRC | 15:41 | |
| Tengu | jaosorior: lhinds heya! I'm back yep, but on NHO starting today :) | 15:43 |
| *** saneax has quit IRC | 15:47 | |
| *** shreshtha has quit IRC | 15:47 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Add memory and swap info into collect-logs collect task https://review.openstack.org/578023 | 15:51 |
| *** karthiks has quit IRC | 15:51 | |
| *** pdeore has quit IRC | 15:51 | |
| *** lblanchard has joined #tripleo | 15:54 | |
| *** thrash is now known as thrash|biab | 15:55 | |
| Tengu | being in Munich when Germany is playing.... and apparently losing against south corea :D | 15:56 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Migrating 2-nodes jobs to the new base configuration https://review.openstack.org/578456 | 15:57 |
| *** myoung is now known as myoung|biaf | 15:59 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 16:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO https://review.openstack.org/564285 | 16:00 |
| *** mvenesio has joined #tripleo | 16:01 | |
| *** ffiore_ has quit IRC | 16:05 | |
| *** mjturek has quit IRC | 16:05 | |
| *** myoung|biaf is now known as myoung | 16:06 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-common master: WIP: use yaml stdout callback plugin https://review.openstack.org/578458 | 16:07 |
| *** dxiri has joined #tripleo | 16:08 | |
| *** ramishra has quit IRC | 16:08 | |
| *** edmondsw has joined #tripleo | 16:09 | |
| *** waleedm has joined #tripleo | 16:09 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778865 | 16:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 16:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 16:10 |
| openstack | Launchpad bug 1778865 in tripleo "Failing openstack-pox-linter TypeError: unbound method construct_mapping()" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell) | 16:10 |
| *** ledo_ has quit IRC | 16:11 | |
| weshay|ruck | mwhahaha, looking at the jobs that are timing out.. they are either related to 1hr containerized install for the undercloud.. or a near miss of the window as they timeout in tempest | 16:13 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-common master: WIP: ara with ansible deploy https://review.openstack.org/565077 | 16:13 |
| weshay|ruck | so two things | 16:13 |
| mwhahaha | k | 16:13 |
| weshay|ruck | I think we need to work w/ sbaker on the containerized undercloud perf | 16:13 |
| weshay|ruck | and to continue to push on the profiling of the undercloud / overcloud w/ ara | 16:13 |
| weshay|ruck | we are pushing on the second piece of that now | 16:14 |
| mwhahaha | weshay|ruck: it's likely container fetching which we can't really make go faster | 16:14 |
| weshay|ruck | mwhahaha, I have questions about the ansible deployment though.. | 16:14 |
| weshay|ruck | for the overcloud | 16:14 |
| weshay|ruck | afaict.. we run from the undercloud and nest some ansible localhost runs on the overcloud | 16:15 |
| weshay|ruck | wasn't 100% sure of that | 16:15 |
| weshay|ruck | maybe I mentioned that yesterday | 16:15 |
| mwhahaha | weshay|ruck: yea we still call the heat hooks | 16:16 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Migrating 2-nodes jobs to the new base configuration https://review.openstack.org/578456 | 16:16 |
| weshay|ruck | mwhahaha, so for the overcloud collecting ALL the data from both the undercloud and overcloud nodes will be a little interesting | 16:16 |
| weshay|ruck | sshnaidm, quiquell|off ^ | 16:17 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Migrating 2-nodes jobs to the new base configuration https://review.openstack.org/578456 | 16:17 |
| mwhahaha | weshay|ruck: we likely canot do that for the overcloud deploy | 16:17 |
| weshay|ruck | hrm | 16:17 |
| weshay|ruck | are you referring to the ansible playbooks executed on the overcloud nodes themselves | 16:18 |
| weshay|ruck | or both kinds of overcloud ansible-playbook invocations | 16:18 |
| weshay|ruck | mwhahaha, if this isn't a valid path, then I need to chat w/ you and find a better path | 16:19 |
| weshay|ruck | w/o gathering metrics and sending them to graphana.. this is going to be a royal pain | 16:19 |
| *** gfidente has quit IRC | 16:20 | |
| *** apetrich has quit IRC | 16:21 | |
| *** apetrich has joined #tripleo | 16:21 | |
| *** mjturek has joined #tripleo | 16:22 | |
| *** stendulker has quit IRC | 16:23 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: collect ara OC https://review.openstack.org/578462 | 16:23 |
| *** suuuper has quit IRC | 16:24 | |
| weshay|ruck | sshnaidm, thanks.. /me watching ^ | 16:26 |
| weshay|ruck | sshnaidm, hrm.. patch in merge conflict | 16:27 |
| weshay|ruck | sshnaidm, ah see why | 16:27 |
| weshay|ruck | sshnaidm, want me to fix? | 16:27 |
| *** tosky has quit IRC | 16:29 | |
| *** tosky has joined #tripleo | 16:29 | |
| *** jpich has quit IRC | 16:29 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-docs master: Update ha docs https://review.openstack.org/578466 | 16:29 |
| *** florianf is now known as florianf|afk | 16:30 | |
| mwhahaha | weshay|ruck: so i'm talking about the ansible being invoked on the overcloud nodes | 16:30 |
| mwhahaha | weshay|ruck: so we use ansible executed by mistral which calls a heat hook on the overcloud node which invokes ansible locally | 16:31 |
| weshay|ruck | ok.. mwhahaha is that just for small bits? like replacing os-net-config and such? | 16:31 |
| mwhahaha | weshay|ruck: well the important bits :D | 16:31 |
| weshay|ruck | mwhahaha, does it use a custom ansible.cfg ? | 16:32 |
| mwhahaha | would have to check | 16:32 |
| weshay|ruck | if not we can just update the ansible.cfg in /etc/ansible | 16:32 |
| weshay|ruck | I can look | 16:32 |
| weshay|ruck | doubt it's using a custom | 16:32 |
| *** noslzzp has quit IRC | 16:33 | |
| *** panda is now known as panda|bike | 16:33 | |
| mwhahaha | it might be using one we pass in via heat | 16:33 |
| *** udesale has quit IRC | 16:33 | |
| mwhahaha | since it's just the heat-ansible hook | 16:33 |
| mwhahaha | not completely sure | 16:33 |
| *** tesseract has quit IRC | 16:34 | |
| *** gkadam__ has quit IRC | 16:37 | |
| *** pradk has quit IRC | 16:40 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: collect ara OC https://review.openstack.org/578462 | 16:42 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: WIP: collect ara OC https://review.openstack.org/578462 | 16:42 |
| *** edmondsw has quit IRC | 16:43 | |
| sshnaidm | weshay|ruck, oops | 16:43 |
| weshay|ruck | :) | 16:44 |
| weshay|ruck | sshnaidm, I fixed, you should check to see if I got it the way you want it | 16:44 |
| *** edmondsw has joined #tripleo | 16:44 | |
| *** pradk has joined #tripleo | 16:44 | |
| sshnaidm | weshay|ruck, we did in the same minute :) | 16:44 |
| *** edmondsw has quit IRC | 16:44 | |
| weshay|ruck | lolz | 16:44 |
| *** rlandy is now known as rlandy|brb | 16:45 | |
| sshnaidm | weshay|ruck, but you deleted undercloud ara | 16:45 |
| weshay|ruck | sshnaidm, thought that was your intent.. didn't really grok that | 16:46 |
| weshay|ruck | sshnaidm, ya.. let's get it back in | 16:46 |
| sshnaidm | weshay|ruck, no, let's just add it | 16:46 |
| weshay|ruck | agree | 16:46 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: collect ara OC https://review.openstack.org/578462 | 16:48 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Adding wrapper script for haproxy in OVN metadata agent https://review.openstack.org/570942 | 16:50 |
| *** derekh has quit IRC | 16:51 | |
| *** cylopez has quit IRC | 16:52 | |
| *** waleedm has quit IRC | 16:53 | |
| *** ssbarnea[m] has joined #tripleo | 16:55 | |
| *** ssbarnea has left #tripleo | 16:55 | |
| openstackgerrit | wes hayutin proposed openstack/python-tripleoclient master: Add --stack to update, upgrade and ffwd-upgrade 'run' CLI. https://review.openstack.org/578485 | 17:00 |
| *** atarlov has joined #tripleo | 17:00 | |
| *** zoli is now known as zoli|gone | 17:02 | |
| *** zoli|gone is now known as zoli | 17:02 | |
| *** myoung is now known as myoung|lunch | 17:02 | |
| *** dtantsur is now known as dtantsur|afk | 17:04 | |
| *** atarlov has quit IRC | 17:05 | |
| *** rlandy|brb is now known as rlandy | 17:07 | |
| *** invsblduck has joined #tripleo | 17:07 | |
| openstackgerrit | wes hayutin proposed openstack/python-tripleoclient stable/pike: Add --stack to update, upgrade and ffwd-upgrade 'run' CLI. https://review.openstack.org/578489 | 17:08 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778865 | 17:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 17:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 17:10 |
| openstack | Launchpad bug 1778865 in tripleo "Failing openstack-pox-linter TypeError: unbound method construct_mapping()" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell) | 17:10 |
| *** jpena is now known as jpena|off | 17:12 | |
| *** shreshtha has joined #tripleo | 17:12 | |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Update --http-boot default for containerized undercloud https://review.openstack.org/578490 | 17:12 |
| *** ffiore has joined #tripleo | 17:12 | |
| *** trown is now known as trown|lunch | 17:16 | |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Update --http-boot default for containerized undercloud https://review.openstack.org/578490 | 17:20 |
| *** ffiore has quit IRC | 17:23 | |
| *** shreshtha has quit IRC | 17:26 | |
| *** dxiri has quit IRC | 17:28 | |
| *** dxiri has joined #tripleo | 17:28 | |
| weshay|ruck | holy crap we're actually going to merge some patches | 17:29 |
| *** amoralej is now known as amoralej|off | 17:29 | |
| *** dxiri has quit IRC | 17:29 | |
| *** dxiri has joined #tripleo | 17:30 | |
| mwhahaha | weshay|ruck: liar | 17:30 |
| *** zul has joined #tripleo | 17:33 | |
| *** dxiri has quit IRC | 17:33 | |
| *** dxiri has joined #tripleo | 17:34 | |
| *** dxiri has quit IRC | 17:38 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Remove unnecessary code from toci_* scripts https://review.openstack.org/576834 | 17:40 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Move get_extra_vars_from_release to functions https://review.openstack.org/577801 | 17:40 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Ensure appropriate ACL mask is set on CephX keyrings https://review.openstack.org/573142 | 17:40 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Allow fast forward upgrade of custom roles https://review.openstack.org/578178 | 17:40 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Adjust roles_data during FFU https://review.openstack.org/578244 | 17:40 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Delete default ODL Password https://review.openstack.org/577834 | 17:40 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Set ODL API restart policy to unless-stopped https://review.openstack.org/575111 | 17:40 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: ffu: Add missing nova-manage db sync for Pike upgrade https://review.openstack.org/573740 | 17:40 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Unpin ansible-lint https://review.openstack.org/578339 | 17:40 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Unpin ansible-lint from fixed version https://review.openstack.org/578364 | 17:40 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/pike: Unpin ansible-lint from fixed version https://review.openstack.org/578365 | 17:40 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Unpin ansible-lint https://review.openstack.org/578340 | 17:40 |
| *** morazi has quit IRC | 17:41 | |
| weshay|ruck | mwhahaha, I'll take it | 17:41 |
| *** weshay|ruck changes topic to "Welcome to Rocky. CI status: random time outs, debug in process | https://docs.openstack.org/tripleo-docs/latest" | 17:42 | |
| *** atarlov has joined #tripleo | 17:42 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: WIP create default settings for environment types https://review.openstack.org/494674 | 17:46 |
| *** dprince has quit IRC | 17:48 | |
| *** thrash|biab is now known as thrash | 17:50 | |
| *** dxiri has joined #tripleo | 17:51 | |
| *** salmankhan has quit IRC | 17:53 | |
| openstackgerrit | Lee Yarwood proposed openstack/tripleo-heat-templates stable/queens: ffu: Add missing nova-manage db sync for Pike upgrade https://review.openstack.org/578502 | 17:55 |
| *** atoth has quit IRC | 18:00 | |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-common stable/queens: Let TripleO generate ODLPassword https://review.openstack.org/578504 | 18:01 |
| *** edmondsw has joined #tripleo | 18:01 | |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates stable/queens: Delete default ODL Password https://review.openstack.org/578505 | 18:03 |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates stable/queens: Delete default ODL Password https://review.openstack.org/578505 | 18:06 |
| *** janki has quit IRC | 18:06 | |
| *** edmondsw has quit IRC | 18:06 | |
| *** dprince has joined #tripleo | 18:07 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778865 | 18:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 18:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 18:10 |
| openstack | Launchpad bug 1778865 in tripleo "Failing openstack-pox-linter TypeError: unbound method construct_mapping()" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell) | 18:10 |
| *** yolanda_ has joined #tripleo | 18:11 | |
| *** cylopez has joined #tripleo | 18:12 | |
| *** trown|lunch is now known as trown | 18:14 | |
| *** yolanda has quit IRC | 18:14 | |
| *** paramite has quit IRC | 18:15 | |
| *** atarlov has quit IRC | 18:17 | |
| *** atarlov has joined #tripleo | 18:17 | |
| *** hjensas|afk has joined #tripleo | 18:17 | |
| *** yamahata has joined #tripleo | 18:20 | |
| *** myoung|lunch is now known as myoung | 18:21 | |
| *** atarlov has quit IRC | 18:21 | |
| *** rh-jelabarre has joined #tripleo | 18:22 | |
| *** dxiri has quit IRC | 18:23 | |
| *** pradk has quit IRC | 18:24 | |
| *** akrivoka has quit IRC | 18:27 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: Revert "Remove unnecessary code from toci_* scripts" https://review.openstack.org/578513 | 18:30 |
| trozet | can someone tellm e where hte haproxy logs are now in master for hte docker container? I looked in /var/log/containers/haproxy/ nothing there, also looked at journalctl CONTAINER_NAME=haproxy, not mucht here either | 18:30 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Move custom env file to last https://review.openstack.org/578516 | 18:32 |
| *** pradk has joined #tripleo | 18:32 | |
| *** cylopez has quit IRC | 18:37 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Workflows for manipulating deployment status https://review.openstack.org/578518 | 18:39 |
| *** rlandy is now known as rlandy|afk | 18:41 | |
| openstackgerrit | Matt Young proposed openstack-infra/tripleo-ci master: Revert "Remove unnecessary code from toci_* scripts" https://review.openstack.org/578520 | 18:42 |
| *** morazi has joined #tripleo | 18:42 | |
| openstackgerrit | Merged openstack/tripleo-docs master: Fix typos in Tempest documentation https://review.openstack.org/578443 | 18:44 |
| *** aufi has quit IRC | 18:44 | |
| *** ksambor has joined #tripleo | 18:45 | |
| openstackgerrit | Matt Young proposed openstack-infra/tripleo-ci master: Revert "Remove unnecessary code from toci_* scripts" https://review.openstack.org/578520 | 18:46 |
| *** ksambor has quit IRC | 18:50 | |
| *** ksambor has joined #tripleo | 18:50 | |
| *** ksambor has quit IRC | 18:51 | |
| *** atoth has joined #tripleo | 18:54 | |
| *** holser_ has quit IRC | 18:55 | |
| openstackgerrit | Matt Young proposed openstack-infra/tripleo-ci master: Revert "Remove unnecessary code from toci_* scripts" https://review.openstack.org/578513 | 18:59 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Add back $WORKSPACE/logs directory creation https://review.openstack.org/578530 | 19:04 |
| *** ansmith has quit IRC | 19:06 | |
| *** dxiri has joined #tripleo | 19:07 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778865 | 19:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778974 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 19:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 19:10 |
| openstack | Launchpad bug 1778865 in tripleo "Failing openstack-pox-linter TypeError: unbound method construct_mapping()" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell) | 19:10 |
| openstack | Launchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to Matt Young (halcyondude) | 19:10 |
| *** atarlov has joined #tripleo | 19:10 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Remove "-oooq" from toci script name https://review.openstack.org/578533 | 19:10 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Add back $WORKSPACE/logs directory creation https://review.openstack.org/578530 | 19:12 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Remove "-oooq" from toci script name https://review.openstack.org/578533 | 19:12 |
| *** mjturek has quit IRC | 19:15 | |
| *** athomas has quit IRC | 19:21 | |
| *** atarlov has quit IRC | 19:32 | |
| *** atarlov has joined #tripleo | 19:33 | |
| *** rh-jelabarre has quit IRC | 19:34 | |
| *** atarlov has quit IRC | 19:37 | |
| weshay|ruck | mwhahaha, all of a sudden upstream is full of pixie dust | 19:38 |
| mwhahaha | Give it 5 mins | 19:39 |
| weshay|ruck | tru | 19:39 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Enable ARA for the undercloud install https://review.openstack.org/577960 | 19:42 |
| *** lvdombrkr has joined #tripleo | 19:43 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: add scen001 pike check to cover additional scenarios https://review.openstack.org/576858 | 19:45 |
| *** edmondsw has joined #tripleo | 19:50 | |
| *** dxiri has quit IRC | 19:53 | |
| *** edmondsw has quit IRC | 19:54 | |
| *** lvdombrkr has quit IRC | 19:55 | |
| *** pchavva has quit IRC | 20:03 | |
| *** liverpooler has quit IRC | 20:06 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Rename default stack name for standalone https://review.openstack.org/577864 | 20:09 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/pike: Unpin ansible-lint https://review.openstack.org/578351 | 20:09 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Unpin ansible-lint https://review.openstack.org/578352 | 20:09 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Remove workaround that breaks Intel(R) Xeon(R) Gold 5120 CPU @ 2.20GHz https://review.openstack.org/578142 | 20:09 |
| openstackgerrit | Merged openstack/tripleo-common master: Remove create_default_deployment_plan workflow https://review.openstack.org/578041 | 20:09 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Set ansible version to 2.5.5 for quickstart https://review.openstack.org/558121 | 20:09 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Remove tempest compute-feature-enabled.attach_encrypted_volume https://review.openstack.org/570158 | 20:09 |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778865 | 20:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778974 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 20:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 20:10 |
| openstack | Launchpad bug 1778865 in tripleo "Failing openstack-pox-linter TypeError: unbound method construct_mapping()" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell) | 20:10 |
| openstack | Launchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to Matt Young (halcyondude) | 20:10 |
| *** dxiri has joined #tripleo | 20:10 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Add new abstract base job and nodeset to zuul configuration https://review.openstack.org/578432 | 20:13 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Add new run playbook https://review.openstack.org/578442 | 20:13 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Migrate undercloud jobs to the new base configurations https://review.openstack.org/578447 | 20:13 |
| weshay|ruck | fak | 20:14 |
| *** dprince has quit IRC | 20:15 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Migrate undercloud jobs to the new base configurations https://review.openstack.org/578447 | 20:16 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Migrate undercloud jobs to the new base configurations https://review.openstack.org/578447 | 20:18 |
| *** atarlov has joined #tripleo | 20:18 | |
| *** ansmith has joined #tripleo | 20:23 | |
| *** zul has quit IRC | 20:27 | |
| *** ffiore has joined #tripleo | 20:32 | |
| *** artom has quit IRC | 20:36 | |
| weshay|ruck | mwhahaha, have a recreate running introspection now | 20:37 |
| mwhahaha | weshay|ruck: i can has access? | 20:41 |
| *** yolanda_ has quit IRC | 20:43 | |
| *** yolanda_ has joined #tripleo | 20:44 | |
| *** pradk has quit IRC | 20:51 | |
| *** pradk has joined #tripleo | 20:52 | |
| *** lblanchard has quit IRC | 20:52 | |
| *** yolanda has joined #tripleo | 20:53 | |
| *** yolanda_ has quit IRC | 20:55 | |
| *** dparkes has joined #tripleo | 20:55 | |
| *** trown is now known as trown|outtypewww | 20:55 | |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates stable/queens: Set ODL API restart policy to unless-stopped https://review.openstack.org/578555 | 20:56 |
| *** pradk has quit IRC | 20:57 | |
| *** yolanda_ has joined #tripleo | 20:59 | |
| *** yolanda has quit IRC | 21:02 | |
| *** jtomasek has quit IRC | 21:03 | |
| *** zul has joined #tripleo | 21:05 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: Use ACL instead of docker group for mistral https://review.openstack.org/577946 | 21:05 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778865 | 21:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778974 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 21:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 21:10 |
| openstack | Launchpad bug 1778865 in tripleo "Failing openstack-pox-linter TypeError: unbound method construct_mapping()" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell) | 21:10 |
| openstack | Launchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to Matt Young (halcyondude) | 21:10 |
| *** zul has quit IRC | 21:12 | |
| *** mvenesio has quit IRC | 21:18 | |
| *** mvenesio has joined #tripleo | 21:19 | |
| *** abishop has quit IRC | 21:23 | |
| *** mvenesio has quit IRC | 21:24 | |
| *** sanjay__u has joined #tripleo | 21:34 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: collect ara OC https://review.openstack.org/578462 | 21:35 |
| *** jtomasek has joined #tripleo | 21:36 | |
| *** edmondsw has joined #tripleo | 21:38 | |
| *** myoung is now known as myoung|pto | 21:41 | |
| *** agopi has quit IRC | 21:43 | |
| *** edmondsw has quit IRC | 21:43 | |
| *** toure is now known as toure|gone | 21:44 | |
| *** ffiore has quit IRC | 21:48 | |
| *** itlinux has quit IRC | 21:50 | |
| *** rcernin has joined #tripleo | 21:50 | |
| *** atarlov has quit IRC | 21:53 | |
| *** atarlov has joined #tripleo | 21:54 | |
| *** dparkes has quit IRC | 21:56 | |
| *** atarlov has quit IRC | 21:58 | |
| *** mcornea has quit IRC | 22:03 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778865 | 22:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778974 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 22:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 22:10 |
| openstack | Launchpad bug 1778865 in tripleo "Failing openstack-pox-linter TypeError: unbound method construct_mapping()" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell) | 22:10 |
| openstack | Launchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] | 22:10 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Check container health as part of the deploy https://review.openstack.org/569153 | 22:10 |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: DNM WIP: ceph bluestore in scenario001-multinode-containers https://review.openstack.org/547682 | 22:11 |
| *** liverpooler has joined #tripleo | 22:14 | |
| *** rlandy|afk is now known as rlandy | 22:15 | |
| *** agopi has joined #tripleo | 22:17 | |
| mwhahaha | beagles: not that you care but I think we can create a dummy systemd service to do a graceful docker stop on all the containers for a service to get them to SIGTERM gracefully. Or at least allow for a > 10 second delay. It does look like the l3_agent takes a while | 22:20 |
| openstackgerrit | Steve Baker proposed openstack/paunch master: Refactor docker run arg building https://review.openstack.org/578572 | 22:21 |
| weshay|ruck | mwhahaha, selinux is only enforcing on the rdo-cloud images afaict | 22:23 |
| mwhahaha | weshay|ruck: i mean it should work, but we didn't want to be dealing with selinux stuff in ci | 22:23 |
| weshay|ruck | which probably means upstream infra has it permissive, rdo does not .. and tripleo is not updating it either way | 22:24 |
| weshay|ruck | seem right? | 22:24 |
| * weshay|ruck checks an ocata job | 22:25 | |
| mwhahaha | i thought we disabled it in the ci install | 22:25 |
| mwhahaha | but it's possible | 22:25 |
| weshay|ruck | mwhahaha, if we detect rhel | 22:25 |
| weshay|ruck | rdo on rhel | 22:25 |
| weshay|ruck | ya.. rdo ocata is permissive | 22:30 |
| weshay|ruck | https://bugs.launchpad.net/tripleo/+bug/1779005 | 22:34 |
| openstack | Launchpad bug 1779005 in tripleo "The containerized undercloud is no longer setting selinux permissive on CentOS" [High,New] | 22:34 |
| openstackgerrit | Merged openstack/instack-undercloud master: Add the undercloud mistral user to the docker group https://review.openstack.org/566768 | 22:40 |
| *** liverpooler has quit IRC | 22:44 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Add host prep step for ntp time sync https://review.openstack.org/577631 | 22:48 |
| *** pmannidi has joined #tripleo | 22:53 | |
| *** jjoyce|gone has joined #tripleo | 23:06 | |
| *** jjoyce has quit IRC | 23:08 | |
| *** atarlov has joined #tripleo | 23:08 | |
| *** jjoyce has joined #tripleo | 23:08 | |
| *** jjoyce|gone has quit IRC | 23:09 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1777939 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778040 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778847 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778865 | 23:10 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1778974 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1778040 in tripleo "Error at overcloud_prep_containers Package: qpid-dispatch-router-0.8.0-1.el7.x86_64 (@delorean-master-testing)", " Requires: libqpid-proton.so.10()(64bit)" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 23:10 |
| openstack | Launchpad bug 1778847 in tripleo "fs027 __init__() got an unexpected keyword argument 'cafile'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 23:10 |
| openstack | Launchpad bug 1778865 in tripleo "Failing openstack-pox-linter TypeError: unbound method construct_mapping()" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell) | 23:10 |
| openstack | Launchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] | 23:10 |
| *** zshi has quit IRC | 23:10 | |
| *** yolanda__ has joined #tripleo | 23:11 | |
| *** yolanda_ has quit IRC | 23:15 | |
| *** yolanda__ has quit IRC | 23:18 | |
| *** yolanda has joined #tripleo | 23:20 | |
| *** yolanda_ has joined #tripleo | 23:21 | |
| *** yolanda has quit IRC | 23:24 | |
| *** dxiri has quit IRC | 23:25 | |
| *** yolanda__ has joined #tripleo | 23:25 | |
| *** edmondsw has joined #tripleo | 23:27 | |
| *** yolanda_ has quit IRC | 23:29 | |
| *** yolanda has joined #tripleo | 23:29 | |
| *** yolanda__ has quit IRC | 23:31 | |
| *** edmondsw has quit IRC | 23:32 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Leverage log_file option to capture more UC logs https://review.openstack.org/576498 | 23:33 |
| *** tosky has quit IRC | 23:35 | |
| *** atarlov has quit IRC | 23:42 | |
| *** mjturek has joined #tripleo | 23:45 | |
| beagles | mwhahaha, that's what I was thinking of doing (systemd.service that does a docker stop) | 23:46 |
| beagles | mwhahaha, I think that should pretty much do it | 23:46 |
| beagles | mwhahaha, s/doing/suggesting/ | 23:47 |
| beagles | depends on who gets to it first :) | 23:48 |
| *** mjturek has quit IRC | 23:49 | |
| mwhahaha | beagles: I started one so I'll post it tomorrow if I can figure out the systems service ordering | 23:50 |
| *** brault has quit IRC | 23:54 | |
| *** dxiri has joined #tripleo | 23:55 | |
| sshnaidm | mwhahaha, weshay|ruck http://logs.openstack.org/62/578462/5/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/c95f759/logs/ara_oooq_oc/ | 23:57 |
| sshnaidm | mwhahaha, weshay|ruck is it reasonable? a lot of same playbooks for different containers? | 23:57 |
| mwhahaha | That doesn't seem right | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!