bnemec | gfidente: Unfortunately I think the mirror server is private only: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_instack_ovb.sh#n94 | 00:00 |
---|---|---|
bnemec | I could be wrong though. Let me check. | 00:00 |
bnemec | gfidente: Good news, it has a fip: http://66.187.229.139/builds/current-tripleo/ | 00:01 |
gfidente | hey cool, thanks! | 00:01 |
gfidente | bnemec oh the module is loaded | 00:04 |
*** david-lyle has quit IRC | 00:05 | |
bnemec | gfidente: I need to take off. Hopefully the promote job will fix this, but if not I'll revisit in the morning. | 00:08 |
gfidente | bnemec thanks for helping | 00:09 |
gfidente | I am running a bit short of ideas and it's late here as well | 00:09 |
Ng | mwhahaha: so given 422218 existing and being worked on, does that mean 390396 can move ahead? :) | 00:09 |
mwhahaha | Ng: maybe :D | 00:09 |
Ng | I'll take maybe, maybe is better than no! | 00:10 |
*** dmarlin has quit IRC | 00:10 | |
*** jkilpatr has joined #tripleo | 00:10 | |
Ng | mwhahaha: thanks :) | 00:10 |
Ng | so now I need to hassle the other core :D | 00:11 |
*** ooolpbot has joined #tripleo | 00:11 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:11 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1657562 | 00:11 |
*** ooolpbot has quit IRC | 00:11 | |
openstack | Launchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged] | 00:11 |
*** owalsh is now known as owalsh-afk | 00:11 | |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-specs: Add gui logging spec https://review.openstack.org/395138 | 00:26 |
*** dsneddon_afk has quit IRC | 00:30 | |
openstackgerrit | Chris Jones proposed openstack/tripleo-common: Add action for generating fencing parameters. https://review.openstack.org/422321 | 00:36 |
openstackgerrit | Chris Jones proposed openstack/python-tripleoclient: Add baremetal_overcloud.GenerateFencing https://review.openstack.org/417898 | 00:39 |
*** gfidente has quit IRC | 00:46 | |
*** bana_k has quit IRC | 00:51 | |
*** b00tcat has quit IRC | 01:00 | |
*** ooolpbot has joined #tripleo | 01:11 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:11 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1657562 | 01:11 |
*** ooolpbot has quit IRC | 01:11 | |
openstack | Launchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged] | 01:11 |
*** limao has joined #tripleo | 01:11 | |
openstackgerrit | Merged openstack/instack-undercloud: Remove store events setting https://review.openstack.org/422184 | 01:17 |
*** lblanchard has joined #tripleo | 01:18 | |
*** saneax is now known as saneax-_-|AFK | 01:33 | |
*** dsneddon has quit IRC | 01:36 | |
*** tzumainn has quit IRC | 01:36 | |
*** sdake has quit IRC | 01:38 | |
openstackgerrit | Merged openstack/puppet-pacemaker: Add support for fence_ironic fencing agent. https://review.openstack.org/390396 | 01:40 |
*** rhallisey has quit IRC | 02:09 | |
*** ooolpbot has joined #tripleo | 02:11 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:11 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1657562 | 02:11 |
*** ooolpbot has quit IRC | 02:11 | |
openstack | Launchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged] | 02:11 |
*** cwolferh has quit IRC | 02:17 | |
*** ipsecguy_ has joined #tripleo | 02:18 | |
*** ipsecguy has quit IRC | 02:19 | |
*** links has joined #tripleo | 02:33 | |
*** zoliXXL has joined #tripleo | 02:40 | |
*** jayg|g0n` has joined #tripleo | 02:41 | |
*** jkilpatr has quit IRC | 02:41 | |
*** eggmaster has quit IRC | 02:41 | |
*** zoli|gone has quit IRC | 02:41 | |
*** dtrainor has quit IRC | 02:41 | |
*** jayg|g0n3 has quit IRC | 02:41 | |
*** vkmc has quit IRC | 02:41 | |
*** saneax-_-|AFK has quit IRC | 02:41 | |
*** tbarron has quit IRC | 02:41 | |
*** fzdarsky_ has joined #tripleo | 02:45 | |
*** dtrainor has joined #tripleo | 02:49 | |
*** fzdarsky has quit IRC | 02:49 | |
*** jkilpatr has joined #tripleo | 02:50 | |
*** bkopilov_ has quit IRC | 02:50 | |
*** bkopilov has quit IRC | 02:51 | |
*** lblanchard has quit IRC | 02:51 | |
*** lblanchard has joined #tripleo | 02:51 | |
*** lblanchard has quit IRC | 02:52 | |
*** sdake has joined #tripleo | 02:54 | |
*** jbcraig has joined #tripleo | 02:55 | |
*** thrash is now known as thrash|g0ne | 02:57 | |
*** cwolferh has joined #tripleo | 02:59 | |
*** tbarron has joined #tripleo | 03:02 | |
*** vkmc has joined #tripleo | 03:06 | |
*** saneax-_-|AFK has joined #tripleo | 03:10 | |
*** ooolpbot has joined #tripleo | 03:11 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:11 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1657562 | 03:11 |
*** ooolpbot has quit IRC | 03:11 | |
openstack | Launchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged] | 03:11 |
*** sdake has quit IRC | 03:13 | |
*** sdake has joined #tripleo | 03:15 | |
*** yamahata has quit IRC | 03:24 | |
*** rcrit has joined #tripleo | 03:25 | |
*** ramishra has joined #tripleo | 03:25 | |
rcrit | my undercloud is failing to install, pulled from master this morning | 03:25 |
rcrit | fails in neutron-db-manage | 03:25 |
rcrit | oslo_db.exception.DBError: (pymysql.err.InternalError) (1060, u"Duplicate column name 'standard_attr_id'") [SQL: u'ALTER TABLE networksegments ADD COLUMN standard_attr_id BIGINT'] | 03:26 |
*** psahoo has joined #tripleo | 03:49 | |
*** cwolferh has quit IRC | 03:50 | |
*** dmacpher has quit IRC | 03:55 | |
*** sdake has quit IRC | 04:06 | |
*** sdake has joined #tripleo | 04:07 | |
*** sudipto_ has joined #tripleo | 04:07 | |
*** sudipto has joined #tripleo | 04:07 | |
*** dmacpher has joined #tripleo | 04:09 | |
*** jerrygb has quit IRC | 04:10 | |
*** ooolpbot has joined #tripleo | 04:11 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:11 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1657562 | 04:11 |
*** ooolpbot has quit IRC | 04:11 | |
openstack | Launchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged] | 04:11 |
*** bana_k has joined #tripleo | 04:11 | |
*** gkadam has joined #tripleo | 04:12 | |
*** bkopilov has joined #tripleo | 04:14 | |
*** bkopilov_ has joined #tripleo | 04:14 | |
openstackgerrit | Keith Schincke proposed openstack-infra/tripleo-ci: [NO MERGE] Meant to see if the ceph-selinux moduled is loaded https://review.openstack.org/422226 | 04:20 |
*** limao has quit IRC | 04:30 | |
*** limao has joined #tripleo | 04:30 | |
*** tbonds has quit IRC | 04:31 | |
*** bana_k has quit IRC | 04:32 | |
*** absubram has joined #tripleo | 04:33 | |
*** limao has quit IRC | 04:35 | |
*** sudipto_ has quit IRC | 04:49 | |
*** sudipto has quit IRC | 04:49 | |
*** sdake_ has joined #tripleo | 04:57 | |
openstackgerrit | Feng Pan proposed openstack/puppet-tripleo: Adds etcd https://review.openstack.org/414730 | 04:58 |
*** sdake has quit IRC | 04:59 | |
openstackgerrit | Feng Pan proposed openstack/tripleo-heat-templates: Adds etcd composable service https://review.openstack.org/414751 | 05:00 |
*** absubram has quit IRC | 05:03 | |
*** cwolferh has joined #tripleo | 05:10 | |
*** jerrygb has joined #tripleo | 05:10 | |
*** ooolpbot has joined #tripleo | 05:11 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:11 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1657562 | 05:11 |
*** ooolpbot has quit IRC | 05:11 | |
openstack | Launchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged] | 05:11 |
*** prateek has joined #tripleo | 05:14 | |
*** limao has joined #tripleo | 05:15 | |
*** jerrygb has quit IRC | 05:15 | |
*** prateek has quit IRC | 05:17 | |
*** prateek has joined #tripleo | 05:18 | |
*** saneax-_-|AFK is now known as saneax | 05:24 | |
*** sudipto has joined #tripleo | 05:27 | |
*** sudipto_ has joined #tripleo | 05:27 | |
*** udesale has joined #tripleo | 05:31 | |
openstackgerrit | Saravanan KR proposed openstack/python-tripleoclient: Provide an option to disable password generation on deployment https://review.openstack.org/414447 | 05:44 |
*** sdake_ has quit IRC | 05:47 | |
*** masco has joined #tripleo | 05:54 | |
*** skramaja has joined #tripleo | 05:58 | |
*** pgadiya has joined #tripleo | 06:00 | |
*** limao has quit IRC | 06:05 | |
*** limao_ has joined #tripleo | 06:05 | |
*** ooolpbot has joined #tripleo | 06:11 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:11 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1657562 | 06:11 |
*** ooolpbot has quit IRC | 06:11 | |
openstack | Launchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged] | 06:11 |
*** agurenko has joined #tripleo | 06:16 | |
*** dmacpher has quit IRC | 06:16 | |
*** yamahata has joined #tripleo | 06:26 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Fix comment in freeipa_setup.sh script https://review.openstack.org/422300 | 06:27 |
*** bana_k has joined #tripleo | 06:28 | |
*** dmacpher has joined #tripleo | 06:28 | |
*** rlandy has quit IRC | 06:30 | |
*** abregman has joined #tripleo | 06:31 | |
*** dmacpher has quit IRC | 06:33 | |
*** ramishra has quit IRC | 06:36 | |
*** ramishra has joined #tripleo | 06:36 | |
*** ramishra has quit IRC | 06:43 | |
*** flepied has joined #tripleo | 06:46 | |
*** ramishra has joined #tripleo | 06:48 | |
*** jerrygb has joined #tripleo | 07:00 | |
*** flepied has quit IRC | 07:04 | |
*** jerrygb has quit IRC | 07:05 | |
*** iranzo has joined #tripleo | 07:07 | |
*** ealcaniz has joined #tripleo | 07:10 | |
*** ooolpbot has joined #tripleo | 07:11 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:11 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1657562 | 07:11 |
*** ooolpbot has quit IRC | 07:11 | |
openstack | Launchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged] | 07:11 |
*** owalsh-afk has quit IRC | 07:15 | |
*** rajinir has quit IRC | 07:16 | |
*** jprovazn has joined #tripleo | 07:17 | |
openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: Empty /etc/sysconfig/iptables if purge is true and it contains the stock iptables rules https://review.openstack.org/422425 | 07:18 |
*** hjensas has joined #tripleo | 07:20 | |
*** hjensas has quit IRC | 07:20 | |
*** hjensas has joined #tripleo | 07:20 | |
*** ohamada has joined #tripleo | 07:26 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Use already patched repos cloned by zuul for build https://review.openstack.org/419491 | 07:28 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE: test dlrn build https://review.openstack.org/422428 | 07:28 |
*** tremble has joined #tripleo | 07:31 | |
*** tremble has quit IRC | 07:31 | |
*** tremble has joined #tripleo | 07:31 | |
*** jlinkes has joined #tripleo | 07:32 | |
openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: Empty /etc/sysconfig/iptables if purge is true and it contains the stock iptables rules https://review.openstack.org/422425 | 07:38 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: Change PurgeFirewall default value to true https://review.openstack.org/422436 | 07:38 |
*** flepied has joined #tripleo | 07:39 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Create eth2 interface when network-isolation only https://review.openstack.org/422441 | 07:45 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE: test oooq https://review.openstack.org/422442 | 07:48 |
*** bana_k has quit IRC | 07:48 | |
*** florianf has joined #tripleo | 07:49 | |
*** apetrich has quit IRC | 07:58 | |
*** rasca has joined #tripleo | 07:58 | |
*** yprokule has joined #tripleo | 08:01 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Conntainers with multi-nic and net-iso https://review.openstack.org/422448 | 08:01 |
sshnaidm | mandre, ^^ | 08:02 |
*** ebarrera has joined #tripleo | 08:02 | |
mandre | sshnaidm: looking | 08:02 |
openstackgerrit | Jaganathan Palanisamy proposed openstack/os-net-config: Network service is failing with DPDK https://review.openstack.org/422449 | 08:03 |
*** aufi has joined #tripleo | 08:04 | |
*** bana_k has joined #tripleo | 08:04 | |
*** ooolpbot has joined #tripleo | 08:11 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:11 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1657562 | 08:11 |
*** ooolpbot has quit IRC | 08:11 | |
openstack | Launchpad bug 1657562 in tripleo "Ceph deployments failing on selinux error" [Critical,Triaged] | 08:11 |
*** tesseract has joined #tripleo | 08:13 | |
*** padkrish has joined #tripleo | 08:14 | |
*** mcornea has joined #tripleo | 08:16 | |
*** amoralej|off is now known as amoralej | 08:17 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE: test oooq https://review.openstack.org/422442 | 08:17 |
*** psahoo has quit IRC | 08:17 | |
*** crenguta has joined #tripleo | 08:18 | |
*** bana_k has quit IRC | 08:21 | |
*** karimb has joined #tripleo | 08:22 | |
*** owalsh-afk has joined #tripleo | 08:22 | |
*** jpena|off is now known as jpena | 08:22 | |
*** ccamacho has joined #tripleo | 08:23 | |
ccamacho | o/ | 08:25 |
*** pmannidi has quit IRC | 08:29 | |
*** cylopez has joined #tripleo | 08:29 | |
*** cmyster_ is now known as cmyster | 08:30 | |
*** cmyster has joined #tripleo | 08:30 | |
*** openstackgerrit has quit IRC | 08:33 | |
*** jpena is now known as jpena|off | 08:33 | |
*** owalsh-afk is now known as owalsh | 08:33 | |
*** psahoo has joined #tripleo | 08:35 | |
*** abregman is now known as abregman|mtg | 08:39 | |
*** jpena|off is now known as jpena | 08:40 | |
*** limao_ has quit IRC | 08:40 | |
*** limao has joined #tripleo | 08:41 | |
*** owalsh has quit IRC | 08:41 | |
*** gfidente has joined #tripleo | 08:42 | |
*** gfidente has quit IRC | 08:42 | |
*** gfidente has joined #tripleo | 08:42 | |
*** owalsh has joined #tripleo | 08:42 | |
*** limao has quit IRC | 08:45 | |
*** jpich has joined #tripleo | 08:46 | |
*** limao has joined #tripleo | 08:49 | |
*** zoliXXL is now known as zoli | 08:51 | |
*** jprovazn has quit IRC | 08:52 | |
*** openstackgerrit has joined #tripleo | 08:53 | |
openstackgerrit | Michael Chapman proposed openstack/tripleo-quickstart: Add support for virtual port types https://review.openstack.org/407347 | 08:53 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-image-elements: WIP DO NOT MERGE Add a script to zero /etc/sysconfig/iptables at build time https://review.openstack.org/422472 | 08:55 |
*** abehl has joined #tripleo | 08:56 | |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-common: WIP DO NOT MERGE Test adding iptables element https://review.openstack.org/422475 | 08:57 |
*** aufi has quit IRC | 08:57 | |
*** zzzeek has quit IRC | 09:00 | |
*** zzzeek has joined #tripleo | 09:00 | |
*** pgadiya has quit IRC | 09:01 | |
*** shardy_afk is now known as shardy | 09:03 | |
*** jprovazn has joined #tripleo | 09:03 | |
*** pgadiya has joined #tripleo | 09:04 | |
openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker: Add tries and try_sleep to ::pacemaker::stonith https://review.openstack.org/422484 | 09:05 |
*** thegodfather is now known as fabbione | 09:08 | |
*** aufi has joined #tripleo | 09:09 | |
*** owalsh has quit IRC | 09:11 | |
*** ooolpbot has joined #tripleo | 09:11 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:11 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1657562 | 09:11 |
*** ooolpbot has quit IRC | 09:11 | |
openstack | Launchpad bug 1657562 in tripleo "ceph deployments failing on selinux error" [Critical,Triaged] | 09:11 |
*** owalsh has joined #tripleo | 09:12 | |
*** owalsh has quit IRC | 09:12 | |
openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: Add retries to the ::pacemaker::stonith property https://review.openstack.org/422489 | 09:12 |
*** owalsh has joined #tripleo | 09:12 | |
*** limao has quit IRC | 09:22 | |
*** ccamacho has quit IRC | 09:23 | |
*** limao has joined #tripleo | 09:23 | |
*** padkrish has quit IRC | 09:25 | |
*** athomas has joined #tripleo | 09:25 | |
*** ramishra has quit IRC | 09:26 | |
*** abregman|mtg is now known as abregman | 09:27 | |
*** limao has quit IRC | 09:27 | |
*** ramishra has joined #tripleo | 09:28 | |
*** lucas-afk is now known as lucasagomes | 09:35 | |
*** ccamacho has joined #tripleo | 09:40 | |
*** psahoo has quit IRC | 09:40 | |
*** yamahata has quit IRC | 09:41 | |
yolanda | hi, question... i'm trying to debug an ovb job but i'd need help | 09:43 |
yolanda | i holded a node, the one shown in zuul status | 09:43 |
yolanda | but this seems to be creating others right? how can i access the related undercloud node? | 09:44 |
yolanda | i'm trying to debug http://logs.openstack.org/61/375261/43/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/01a4c27/console.html | 09:44 |
*** psahoo has joined #tripleo | 09:44 | |
yolanda | so install-types is found ok in the holded node, but i need to see on the others | 09:44 |
*** salmankhan has joined #tripleo | 09:46 | |
*** derekh has joined #tripleo | 09:48 | |
*** owalsh_ has joined #tripleo | 09:49 | |
*** owalsh has quit IRC | 09:50 | |
*** b00tcat has joined #tripleo | 09:50 | |
*** b00tcat has joined #tripleo | 09:50 | |
*** psahoo has quit IRC | 09:50 | |
*** panda|zZ is now known as panda | 09:51 | |
panda | yolanda: that build failed on undercloud install, there are no other nodes you can explore at that stage | 09:52 |
yolanda | mm so it is not finding that element, but i can see it on /usr/share/diskimage-builder/elemetns | 09:53 |
yolanda | mm so it is not finding that element, but i can see it on /usr/share/diskimage-builder/elements | 09:53 |
yolanda | panda, how can i check what's going on? seems difficult to re-run the scripts without all the exported vars | 09:54 |
yolanda | see it shows /usr/share/tripleo-puppet-elements /usr/share/instack-undercloud /usr/share/tripleo-image-elements /usr/share/diskimage-builder/elements | 09:54 |
yolanda | and i can see install-types under /usr/share/diskimage-builder/elements | 09:55 |
panda | yolanda: within the paths just above the error ? are you looking at the repo with the same hash ? | 09:55 |
yolanda | i am at the holded node that failed | 09:55 |
panda | yolanda: oh | 09:56 |
panda | yolanda: let's look at the log it indicates: install-undercloud.log, it's stored in http://logs.openstack.org/61/375261/43/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/01a4c27/logs/undercloud.tar.xz | 09:56 |
*** paramite has joined #tripleo | 09:57 | |
openstackgerrit | Luke Hinds proposed openstack/tripleo-puppet-elements: Add reference to puppet-auditd https://review.openstack.org/420040 | 09:57 |
panda | yolanda: mh, not helpful | 09:58 |
yolanda | panda yep, same thing as the console log. The install types failure | 09:58 |
yolanda | panda, seems i can reproduce the failure executing /opt/stack/new/tripleo-ci/scripts/tripleo.sh --undercloud | 09:58 |
yolanda | same error | 09:58 |
yolanda | for some reason doesnt' find that element | 09:59 |
*** nmathew has joined #tripleo | 10:00 | |
*** social has joined #tripleo | 10:01 | |
panda | yolanda: IIUC the last rebase for https://review.openstack.org/375261 was in november, is that right ? | 10:04 |
yolanda | yep... as it's a feature branch i didn't think it could affect | 10:04 |
openstackgerrit | Jaganathan Palanisamy proposed openstack/os-net-config: Network service is failing with DPDK https://review.openstack.org/422449 | 10:05 |
yolanda | i'm adding some debugging to the instack runner | 10:05 |
*** owalsh_ is now known as owalsh | 10:06 | |
panda | yolanda: never say never :). I'm not sure what's happening as dib is not something I really know. But seems like something is not honouring the path where to search for elements. Rebase is something I would do just to be on the safe side. | 10:08 |
yolanda | ok rebasing it, it doesn't hurt | 10:10 |
panda | you may find youself debbugging thing that are already solved. | 10:10 |
yolanda | indeed | 10:10 |
yolanda | oh interesting | 10:10 |
*** owalsh has quit IRC | 10:10 | |
panda | conflicts ? | 10:11 |
*** ooolpbot has joined #tripleo | 10:11 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:11 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1657562 | 10:11 |
*** ooolpbot has quit IRC | 10:11 | |
openstack | Launchpad bug 1657562 in tripleo "ceph deployments failing on selinux error" [Critical,Triaged] | 10:11 |
yolanda | mm, it finds it, but seems to crash before | 10:11 |
yolanda | see | 10:11 |
yolanda | 2017-01-19 10:09:33,106 INFO: loaded devuser | 10:11 |
yolanda | 2017-01-19 10:09:33,107 INFO: i find elERROR: 2017-01-19 10:09:33,065 -- Element 'install-types' not found | 10:11 |
*** b00tcat has quit IRC | 10:11 | |
yolanda | 2017-01-19 10:09:33,112 INFO: i find elem install-types | 10:11 |
yolanda | 2017-01-19 10:09:33,113 INFO: loaded install-types | 10:11 |
yolanda | mm, going to try and switch the order of the paths | 10:13 |
openstackgerrit | Jaganathan Palanisamy proposed openstack/os-net-config: Network service is failing with DPDK https://review.openstack.org/422449 | 10:16 |
*** akrivoka has joined #tripleo | 10:18 | |
*** sdake has joined #tripleo | 10:19 | |
yolanda | panda, it seems to be a problem in loading dependencies | 10:22 |
yolanda | not with the path or collecting the elements | 10:23 |
openstackgerrit | Jaganathan Palanisamy proposed openstack/os-net-config: Network service is failing with DPDK https://review.openstack.org/422449 | 10:23 |
yolanda | so that's likely a problem with diskimage_builder.element_dependencies function... let's see if rebase helps | 10:24 |
*** salmankhan has quit IRC | 10:24 | |
yolanda | same issue after rebase | 10:26 |
panda | yolanda: where did you rebase ? | 10:27 |
*** b00tcat has joined #tripleo | 10:27 | |
yolanda | https://review.openstack.org/#/c/375261/ | 10:27 |
*** jerrygb has joined #tripleo | 10:28 | |
nmathew | hi all | 10:29 |
nmathew | is there any support for role specific UserData | 10:29 |
nmathew | in THT | 10:29 |
openstackgerrit | Jaganathan Palanisamy proposed openstack/os-net-config: Network service is failing with DPDK https://review.openstack.org/422449 | 10:30 |
nmathew | intention is pass kernel parameters to compute roles | 10:30 |
*** akrivoka has quit IRC | 10:30 | |
*** salmankhan has joined #tripleo | 10:30 | |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui: Add packaging documentation https://review.openstack.org/418941 | 10:30 |
skramaja | nmathew: there is recent addition on PreNetworkConfig to pass the parameters and reboot. | 10:31 |
nmathew | is this avaialble in newton? | 10:31 |
skramaja | nmathew: nope. it is added in Ocata. - https://review.openstack.org/#/c/395431/3/doc/source/advanced_deployment/ovs_dpdk_config.rst | 10:32 |
nmathew | can you please point me to that link | 10:32 |
nmathew | ok thank you | 10:32 |
shardy | nmathew: No, I think on newton you'll need to use a script in UserData with a conditional that looks at the hostname | 10:32 |
skramaja | nmathew: for newton we use the first-boot user data with hostname check, | 10:32 |
nmathew | ok | 10:33 |
*** jerrygb has quit IRC | 10:33 | |
skramaja | nmathew: sample code for newton, what we used for DPDK is - https://gist.github.com/krsacme/1234bf024ac917c74913827298840c1c | 10:33 |
nmathew | thanks skramaja and shardy.. | 10:34 |
yolanda | panda ok... seems the method used in diskimage-builder in feature/v2 changed totally | 10:37 |
yolanda | and conflicts with the usage in runner | 10:37 |
yolanda | i'll talk with dib cores | 10:37 |
*** akrivoka has joined #tripleo | 10:39 | |
panda | yolanda: so the rebase must be on the design too, not only the code ... good luck | 10:39 |
yolanda | :( | 10:40 |
*** jlinkes has quit IRC | 10:40 | |
*** jlinkes has joined #tripleo | 10:40 | |
*** florianf has quit IRC | 10:40 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Use eth2 interface when network-isolation only https://review.openstack.org/422441 | 10:43 |
*** florianf has joined #tripleo | 10:44 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Use eth2 interface when network-isolation only https://review.openstack.org/422441 | 10:44 |
*** hjensas has quit IRC | 10:47 | |
openstackgerrit | Merged openstack/instack-undercloud: Add missing FW rules for Placement API https://review.openstack.org/422289 | 10:50 |
*** apetrich has joined #tripleo | 10:51 | |
*** nmathew has quit IRC | 10:52 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: set -e in run-os-net-config.sh https://review.openstack.org/411509 | 10:53 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE: test oooq https://review.openstack.org/422442 | 10:53 |
*** akrivoka has quit IRC | 10:53 | |
*** udesale has quit IRC | 10:58 | |
*** akrivoka has joined #tripleo | 10:59 | |
skramaja | shardy: one question, at what stage the hiera data files will be available on the compute node? | 11:03 |
shardy | skramaja: after the PreNetwork and NetworkDeployment have run | 11:04 |
skramaja | ok shardy. | 11:04 |
*** psahoo has joined #tripleo | 11:05 | |
*** dtantsur|afk is now known as dtantsur | 11:05 | |
shardy | skramaja: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/role.role.j2.yaml#L402 | 11:05 |
shardy | you can see it there, if you follow the depends_on you'll see which deployments happen before | 11:05 |
shardy | it's pretty early in the deploy, but after we've configured the network | 11:06 |
skramaja | any particular reason for after the network configuration? reason for the question is, i am trying to find if there is a way to configure openvswitch DPDK_OPTIONS before os-net-config. | 11:08 |
skramaja | DPDK is configured @https://github.com/openstack/puppet-vswitch/blob/master/manifests/dpdk.pp | 11:08 |
skramaja | shardy: ^ | 11:09 |
shardy | skramaja: basically the assumption has always been that you'd want to configure the networking before any other kind of configuration | 11:10 |
shardy | but here you have a chicken/egg problem because it seems you want to do configuration via puppet before you configure the network? | 11:11 |
shardy | skramaja: I guess I'd probably work around it by passing the same parameter into the PreNetwork config and services/neutron-ovs-dpdk-agent.yaml or wherever it's consumed by puppet | 11:12 |
skramaja | yes shardy. we are facing an issue in DPDK bond when DPDK is enabled at later stage. there is a workaround for now. but wanted to see if there can be proper fix. | 11:12 |
shardy | skramaja: Yeah, I can't think of a cleaner way to do it atm, because we've always assumed the network config would be done by the time we run puppet | 11:13 |
skramaja | thanks shardy. | 11:13 |
shardy | I suppose in future we could revisit that, and allow reconfiguring networking again after puppet has run | 11:13 |
*** b00tcat has quit IRC | 11:14 | |
skramaja | that would be great. thanks | 11:15 |
*** percevalbot has quit IRC | 11:19 | |
openstackgerrit | Merged openstack/instack-undercloud: Improve upgrade process to include upgrade flag https://review.openstack.org/419112 | 11:19 |
*** Baggypants12000 has quit IRC | 11:22 | |
*** zoli is now known as zoli|lunch | 11:27 | |
*** owalsh has joined #tripleo | 11:28 | |
*** athomas has quit IRC | 11:28 | |
*** apetrich_ has joined #tripleo | 11:29 | |
*** percevalbot has joined #tripleo | 11:32 | |
*** apetrich has quit IRC | 11:32 | |
*** apetrich_ has quit IRC | 11:33 | |
*** bkopilov has quit IRC | 11:35 | |
*** bkopilov_ has quit IRC | 11:35 | |
*** athomas has joined #tripleo | 11:35 | |
*** karimb has quit IRC | 11:36 | |
*** nyechiel has joined #tripleo | 11:38 | |
*** sudipto_ has quit IRC | 11:39 | |
*** sudipto has quit IRC | 11:39 | |
owalsh | shardy: just read your comment re cell_v2 upgrade in https://review.openstack.org/#/c/405241/ ... | 11:41 |
yolanda | hi, can i get reviews for some new elements in tripleo? https://review.openstack.org/419486, https://review.openstack.org/420698, https://review.openstack.org/420765, https://review.openstack.org/420805 | 11:41 |
shardy | owalsh: yeah, I'm happy to leave that to puppet-nova if/when it handles it, but right now I think we need to do the DB dance in ansible | 11:41 |
owalsh | shardy: will discuss with mwhahaha later, just thinking if that's an option at all... puppet would need to know it's an upgrade vs fresh install | 11:42 |
gfidente | owalsh shardy I am interesting in if we find a generic solution to that | 11:42 |
shardy | owalsh: Ok, well we could set such a flag in hieradata easily enough | 11:42 |
*** salmankhan1 has joined #tripleo | 11:42 | |
gfidente | I have a similar problem of distinguishing upgrades from new installs in puppet-ceph too | 11:43 |
shardy | owalsh: I was really hoping we could derive the required actions from the current system state tho | 11:43 |
gfidente | but I think it is in net contrast with the declarative idea in puppet | 11:45 |
*** salmankhan has quit IRC | 11:45 | |
owalsh | hmm.... some ideas but they ain't pretty... | 11:46 |
shardy | I was thinking puppet could just look for the cells DB and do the cells stuff if it's not there | 11:47 |
*** salmankhan has joined #tripleo | 11:47 | |
*** salmankhan1 has quit IRC | 11:47 | |
gfidente | yeah and puppet-ceph ends up being a long list of exec/unless clause already | 11:47 |
*** jkilpatr has quit IRC | 11:47 | |
shardy | if we have to, we can leave it in the ansible steps, but this is getting pretty complex and it'd be nice to avoid maintaining it in two places | 11:47 |
openstackgerrit | Merged openstack/tripleo-common: Add password and key generation for Octavia https://review.openstack.org/419536 | 11:48 |
owalsh | shardy: upgrade path and install path are different | 11:48 |
*** nyechiel has quit IRC | 11:48 | |
* shardy throws things at nova for being so difficult | 11:49 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci: Send mail tool https://review.openstack.org/421298 | 11:49 |
shardy | owalsh: And there's no way at all to inspect a system and see if it's already installed? | 11:49 |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci: Send mail tool https://review.openstack.org/421298 | 11:50 |
shardy | if we have to, we can have the environment file that triggers the upgrade set a boolean which we put in hiera | 11:50 |
shardy | but that seems kinda ugly | 11:50 |
*** salmankhan has quit IRC | 11:51 | |
owalsh | shardy: it's a long story... | 11:53 |
*** salmankhan has joined #tripleo | 11:57 | |
owalsh | shardy: TL; DR we can't run simple_config for a fresh install, it fails if there are no hosts yet | 11:57 |
*** cylopez has quit IRC | 11:58 | |
*** rhallisey has joined #tripleo | 12:00 | |
*** jpena is now known as jpena|lunch | 12:00 | |
owalsh | it's basically a migration from a non-cell setup to single cell setup | 12:01 |
EmilienM | hello | 12:02 |
*** hjensas has joined #tripleo | 12:02 | |
*** jkilpatr has joined #tripleo | 12:05 | |
openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Remove Glance Registry from undercloud https://review.openstack.org/417214 | 12:06 |
*** psahoo has quit IRC | 12:06 | |
openstackgerrit | Merged openstack/tripleo-quickstart-extras: Add support for whole disk images https://review.openstack.org/421805 | 12:08 |
shardy | EmilienM: Hey, good morning, when you get a moment, could you help me understand why https://review.openstack.org/#/c/422084/ is failing? | 12:14 |
openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient: Create command for building RAID on given nodes https://review.openstack.org/421242 | 12:14 |
shardy | I need to decide if I should give up on fixing puppet-swift and just align t-h-t with the pipeline it expects | 12:15 |
dtantsur | the final RAID patch for Ocata ^^^, everything else will follow in Pike, I think | 12:15 |
*** adarazs is now known as adarazs_lunch | 12:15 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci: Send mail tool https://review.openstack.org/421298 | 12:16 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use disable_contraints in custom roles data in CI https://review.openstack.org/410392 | 12:16 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras: Collect logs of containers https://review.openstack.org/419018 | 12:16 |
EmilienM | shardy: looking | 12:18 |
EmilienM | shardy: first, don't look ubuntu jobs, we have a major issue with them | 12:18 |
EmilienM | shardy: what you need to see is: http://logs.openstack.org/84/422084/2/check/gate-puppet-openstack-integration-4-scenario002-tempest-centos-7/3e93ae7/console.html#_2017-01-19_09_54_39_451080 | 12:18 |
EmilienM | http://logs.openstack.org/84/422084/2/check/gate-puppet-openstack-integration-4-scenario002-tempest-centos-7/3e93ae7/console.html#_2017-01-19_09_44_03_892926 | 12:19 |
EmilienM | 2 tests are failing with swift quotas | 12:19 |
owalsh | shardy: ...and the simple_setup must be run *before* the nova api db sync. For fresh install it's the reverse - we have to run the api db sync before any of the cell stuff. | 12:19 |
EmilienM | shardy: we might want to ask cschwede here | 12:20 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Implement NTP profile https://review.openstack.org/310725 | 12:21 |
openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: ntp: make sure chrony is purged before https://review.openstack.org/422164 | 12:21 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Deploy NTP with puppet-tripleo profile https://review.openstack.org/422167 | 12:21 |
shardy | EmilienM: ack, thanks - I'll try to chat with cschwede | 12:22 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: enable Placement API on multinode jobs https://review.openstack.org/422258 | 12:22 |
EmilienM | shardy: I haven't found anything in logs | 12:22 |
shardy | EmilienM: I think I'll probably just align t-h-t with what puppet-swift expects for now to move forward, as I've been blocked on this for a few days now | 12:22 |
*** pkovar has joined #tripleo | 12:22 | |
shardy | if we specify a pipeline for the proxy which matches the hard-coded things in puppet-swift, it will work I think | 12:23 |
shardy | but we'll have to keep that in sync with any changes to the swift defaults | 12:23 |
therve | shardy, You should try to disable the extension completely otherwise | 12:23 |
EmilienM | yeah :/ | 12:23 |
therve | That would skip the test I believe | 12:23 |
shardy | therve: you mean remove the two *quotas includes? | 12:24 |
shardy | yeah I wondered about that, let me try | 12:24 |
openstackgerrit | Justin Kilpatrick proposed openstack/tripleo-quickstart-extras: Add introspection with retries option https://review.openstack.org/403677 | 12:25 |
therve | shardy, I'm not exactly sure how to, but they are extensions, so there should be a way :) | 12:26 |
*** lucasagomes is now known as lucas-hungry | 12:27 | |
*** owalsh is now known as owalsh-lunch | 12:29 | |
*** jerrygb has joined #tripleo | 12:29 | |
*** gkadam has quit IRC | 12:29 | |
*** thrash|g0ne is now known as thrash | 12:30 | |
*** jlinkes_ has joined #tripleo | 12:31 | |
EmilienM | shardy: +2 on https://review.openstack.org/#/c/422084/ | 12:32 |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci: Send mail tool https://review.openstack.org/421298 | 12:32 |
shardy | EmilienM: thanks! Lets see what CI says :) | 12:34 |
*** shardy is now known as shardy_lunch | 12:34 | |
*** jlinkes has quit IRC | 12:34 | |
*** jerrygb has quit IRC | 12:34 | |
*** tosky_ has joined #tripleo | 12:38 | |
*** akrivoka has quit IRC | 12:39 | |
*** akrivoka has joined #tripleo | 12:40 | |
*** psahoo has joined #tripleo | 12:43 | |
*** zoli|lunch is now known as zoli | 12:44 | |
*** dtantsur is now known as dtantsur|lunch | 12:47 | |
*** nyechiel has joined #tripleo | 12:48 | |
EmilienM | shardy_lunch: in fact, I think your patch in puppet-swift might not be backward compatible for users who use "_" in the pipeline | 12:49 |
EmilienM | maybe we could transform the _ in - within the manifest so it's transparent for users, and we add a release note | 12:49 |
*** saneax is now known as saneax-_-|AFK | 12:49 | |
*** rbrady has quit IRC | 12:51 | |
openstackgerrit | Michael Chapman proposed openstack/tripleo-quickstart: Add config file for OPNFV scenario https://review.openstack.org/422593 | 12:51 |
*** masco has quit IRC | 12:52 | |
openstackgerrit | Michael Chapman proposed openstack/tripleo-quickstart: Add the ability to run all tasks as root https://review.openstack.org/418198 | 12:53 |
*** jpena|lunch is now known as jpena | 12:55 | |
gfidente | EmilienM magic must have happened within bnemec domain | 12:56 |
gfidente | because nothing changed that I can tell to either introduce nor fix the problem | 12:57 |
gfidente | with ceph selinux | 12:57 |
gfidente | we can ask him when he is back | 12:57 |
panda | he fixed it in his sleep | 12:57 |
gfidente | yeah he mentioned something which would refresh the cached overcloud imge | 12:58 |
EmilienM | gfidente: maybe a packaging update? | 12:58 |
*** hjensas has quit IRC | 12:58 | |
*** morazi has joined #tripleo | 13:02 | |
*** jayg|g0n` is now known as jayg | 13:08 | |
*** morazi has quit IRC | 13:10 | |
*** links has quit IRC | 13:11 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Adds a AllNodesPreUpgradeConfig before the upgrade steps https://review.openstack.org/419886 | 13:12 |
*** zoli is now known as zoli|afk | 13:13 | |
*** ansmith has joined #tripleo | 13:13 | |
*** jerrygb has joined #tripleo | 13:13 | |
openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates: Containerize MySQL https://review.openstack.org/414601 | 13:14 |
*** adarazs_lunch is now known as adarazs | 13:15 | |
*** pgadiya has quit IRC | 13:16 | |
*** lucas-hungry is now known as lucasagomes | 13:17 | |
*** dtantsur|lunch is now known as dtantsur | 13:17 | |
*** ohamada_ has joined #tripleo | 13:18 | |
*** ohamada has quit IRC | 13:18 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Adds a AllNodesPreUpgradeConfig before the upgrade steps https://review.openstack.org/419886 | 13:19 |
*** shardy_lunch is now known as shardy | 13:20 | |
*** apetrich has joined #tripleo | 13:20 | |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates: Ignore systemctl return code in yum_update.sh https://review.openstack.org/422610 | 13:21 |
shardy | EmilienM: Yeah I did wonder about how to make it backwards compatible given that the pipeline and config sections need to match | 13:21 |
*** hjensas has joined #tripleo | 13:21 | |
*** hjensas has joined #tripleo | 13:21 | |
shardy | pls comment on the review if you've got suggestions on how I can do that | 13:21 |
*** trown|outtypewww is now known as trown | 13:23 | |
*** morazi has joined #tripleo | 13:24 | |
openstackgerrit | Julie Pichon proposed openstack-infra/tripleo-ci: Remove references to Liberty (now EOL'd) https://review.openstack.org/417814 | 13:28 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Disable glance registry during upgrade https://review.openstack.org/422620 | 13:28 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Don't start all services during upgrade steps https://review.openstack.org/422621 | 13:28 |
*** nmathew has joined #tripleo | 13:29 | |
*** cylopez has joined #tripleo | 13:31 | |
shardy | Hrm, anyone seen any issues with glance token validation and version negotiation? | 13:33 |
shardy | http://paste.openstack.org/show/595615/ | 13:33 |
shardy | I see that after upgrading N->O and not yet sure why | 13:33 |
shardy | I assume things are OK for trunk deployments as CI looks OK | 13:33 |
*** ccamacho is now known as ccamacho|lunch | 13:35 | |
shardy | http://paste.openstack.org/show/595616/ shows the before/after upgrade glance-api.conf, and the glance endpoint in the catalog | 13:35 |
*** karimb has joined #tripleo | 13:39 | |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: docker: new hybrid deployment architecture and configuration https://review.openstack.org/416421 | 13:39 |
openstackgerrit | yolanda.robla proposed openstack/tripleo-image-elements: Add element to customize dracut on the agent https://review.openstack.org/420765 | 13:39 |
*** salmankhan has quit IRC | 13:40 | |
openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient: Create command for building RAID on given nodes https://review.openstack.org/421242 | 13:40 |
*** rlandy has joined #tripleo | 13:41 | |
bandini | ccamacho|lunch , ping me when back | 13:42 |
*** sudipto has joined #tripleo | 13:43 | |
*** sudipto_ has joined #tripleo | 13:43 | |
*** pradk has joined #tripleo | 13:44 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Conntainers with multi-nic and net-iso https://review.openstack.org/422448 | 13:44 |
*** sudipto has quit IRC | 13:45 | |
*** sudipto_ has quit IRC | 13:45 | |
*** nmathew has quit IRC | 13:46 | |
*** saneax-_-|AFK is now known as saneax | 13:47 | |
*** owalsh-lunch is now known as owalsh | 13:48 | |
*** tbonds has joined #tripleo | 13:50 | |
*** jeckersb is now known as jeckersb_gone | 13:51 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Make logs are readable with browser https://review.openstack.org/422638 | 13:53 |
sshnaidm | trown, adarazs ^^ | 13:53 |
adarazs | sshnaidm: going to review it, thanks | 13:54 |
trown | sshnaidm: can we do depends-on https://review.openstack.org/419039 ... want to see if depends-on working | 13:54 |
*** [1]cdearborn has joined #tripleo | 13:55 | |
EmilienM | shardy: yes I will | 13:55 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use disable_contraints in custom roles data in CI https://review.openstack.org/410392 | 13:55 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Make logs are readable with browser https://review.openstack.org/422638 | 13:55 |
sshnaidm | trown, yeah ^^ I thought it's merged already :) | 13:56 |
*** tzumainn has joined #tripleo | 13:56 | |
*** hafe has joined #tripleo | 13:57 | |
trown | sshnaidm: oh also that is just the ovb job, were you also going to do the same for multinode or should I? | 13:57 |
sshnaidm | trown, I'll do | 13:58 |
sshnaidm | EmilienM, trown please take a look at fixing patch for containers and nonha oooq jobs: https://review.openstack.org/#/c/422441/ | 13:58 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Make logs are readable with browser https://review.openstack.org/422638 | 13:59 |
*** tosky_ is now known as tosky | 13:59 | |
*** zoli|afk is now known as zoli | 13:59 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Conntainers with multi-nic and net-iso https://review.openstack.org/422448 | 14:00 |
*** udesale has joined #tripleo | 14:01 | |
adarazs | sshnaidm: I added a couple of comments | 14:01 |
*** cylopez1 has joined #tripleo | 14:01 | |
adarazs | actually now I did :) | 14:02 |
shardy | can anyone paste me the output from ls -l /var/log/ | grep cinder on a trunk deployed overcloud please? | 14:03 |
sshnaidm | adarazs, where? | 14:03 |
jpich | honza: Could be failing because the new shiny package hasn't made it out to the repos yet, trying to check now | 14:03 |
adarazs | sshnaidm: https://review.openstack.org/422638 | 14:03 |
adarazs | sshnaidm: patchset 1 | 14:03 |
*** cylopez has quit IRC | 14:03 | |
*** dprince has joined #tripleo | 14:05 | |
jpich | honza: the dlrn logs for that failed build used 3.1 still | 14:05 |
*** apetrich has quit IRC | 14:06 | |
shardy | hrm, it's selinux | 14:06 |
*** bkopilov_ has joined #tripleo | 14:06 | |
*** nyechiel has quit IRC | 14:06 | |
honza | jpich: ah, cool, good catch | 14:07 |
honza | jpich: do you have a link to the log? | 14:07 |
*** crenguta has quit IRC | 14:08 | |
*** hafe has quit IRC | 14:08 | |
*** crenguta has joined #tripleo | 14:09 | |
panda | jpich: is tripleo-ui gated now ? | 14:10 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Adds a AllNodesPreUpgradeConfig before the upgrade steps https://review.openstack.org/419886 | 14:11 |
ansiwen | mwhahaha: this will probably not backported to mitaka->newton I guess? https://bugzilla.redhat.com/show_bug.cgi?id=1411856 | 14:11 |
openstack | bugzilla.redhat.com bug 1411856 in puppet-nova "Upgrade 9->10->11 Fails: Migration cannot continue until all these have been migrated to the api database." [Unspecified,New] - Assigned to rhos-maint | 14:11 |
ansiwen | mwhahaha: I'm asking because of this bug: https://bugzilla.redhat.com/show_bug.cgi?id=1411856 | 14:11 |
shardy | slagle_: Hey I wondered if we've got a bug open anywhere to get the multinode job selinux enforcing? | 14:11 |
shardy | slagle_: upgrades are broken locally with it turned on atm | 14:11 |
openstackgerrit | Dan Radez proposed openstack/puppet-tripleo: Adding tacker service https://review.openstack.org/422644 | 14:11 |
*** leanderthal has joined #tripleo | 14:11 | |
*** egafford has joined #tripleo | 14:12 | |
*** jmelvin has joined #tripleo | 14:13 | |
ansiwen | shardy: is this maybe related to the weird ://: I was having? http://logs.openstack.org/34/398634/20/check/gate-tripleo-heat-templates-pep8-ubuntu-xenial/928e119/console.html#_2017-01-18_19_02_13_906958 | 14:14 |
jpich | honza: http://logs.openstack.org/41/418941/3/check/gate-tripleo-ci-centos-7-undercloud/a143bce/logs/delorean_repos.tar.xz in rpmbuild.log | 14:14 |
ansiwen | shardy: ERROR: ./environments/tls-endpoints-public-ip.yaml doesn't match base endpoint map | 14:14 |
jpich | panda: Yeah!! That looks correct now :) http://logs.openstack.org/41/418941/3/check/gate-tripleo-ci-centos-7-undercloud/a143bce/console.html#_2017-01-19_13_54_25_706383 Thank you for the fix! | 14:15 |
panda | jpich: great. | 14:15 |
shardy | ansiwen: aha, yes it may well be, the nonha job enables tls and uses that environment | 14:16 |
shardy | ansiwen: good catch! :) | 14:17 |
ansiwen | shardy: so, did I miss to update something? | 14:17 |
ansiwen | shardy: or are these created automatically? | 14:17 |
panda | ironic-python-agent.initramfs is created during the image building step, right ? | 14:17 |
jpich | honza: I think this is where it needs to be, only 3.1 is available for now -> http://buildlogs.centos.org/centos/7/cloud/x86_64/openstack-ocata/ | 14:18 |
mwhahaha | ansiwen: no, transport_url is not something we would really backport to mitaka. that needs a multistep upgrade process. i think 10->11 is broken because of that so it should be something that gets resolved as part of that upgrade | 14:18 |
shardy | ansiwen: yes I think you need to update the environment file in the error | 14:18 |
shardy | it's not created automatically | 14:18 |
shardy | the fact that the deploy doesn't fail is probabl a bug tho | 14:18 |
honza | jpich: it's there now, 3-2 | 14:18 |
jpich | honza: :D | 14:19 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Make logs viewable with browser https://review.openstack.org/422638 | 14:19 |
honza | jpich: literally right now, eh? | 14:19 |
jpich | Looks like it!! | 14:19 |
ansiwen | shardy: the weird thing is, this pep8 didn't fail before... is it a new validation? | 14:19 |
*** leanderthal has quit IRC | 14:19 | |
honza | jpich: another recheck then? | 14:19 |
jpich | honza: Yeah, let's have one to be sure-to be sure | 14:19 |
jpich | And once that works, recheck All The Things | 14:19 |
honza | (tm) | 14:20 |
shardy | ansiwen: yes https://github.com/openstack/tripleo-heat-templates/commit/d1e67318c42fbad2ab7d9a0a515d5f3717d8e307 | 14:20 |
dprince | EmilienM: so Debian/Ubunto doesn't allow placement to be isntalled side by side w/ Nova API. Just to confirm... we are running placement in the same Apache instance right? https://review.openstack.org/#/c/422185/ | 14:21 |
ansiwen | mwhahaha: not sure I understand. there is no possibility to fix that for mitaka->newton upgrade of the undercloud, becaus we don't have special upgrade handling there, correct? so it will be a manual step between those two upgrade steps, correct? just wonder how to proceed with that bug. | 14:21 |
EmilienM | dprince: their packages are not updated enough to have it working in puppet ci | 14:21 |
EmilienM | dprince: we'll update it in pike. | 14:21 |
EmilienM | dprince: the problem is not in placement but in nova compute and scheduler | 14:22 |
dprince | EmilienM: Ack, but does it cause a problem for us in TripleO (today) to run them side by side w/ Nova API? On Centos/RHEL that is... | 14:22 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: provide instructions on how to only use quickstart as instack-virt-setup https://review.openstack.org/422260 | 14:22 |
EmilienM | dprince: no problem in tripleo. | 14:23 |
dprince | EmilienM: yeah, I'm dropping Ubuntu from this patch then | 14:23 |
*** kjw3 has joined #tripleo | 14:24 | |
*** Goneri has joined #tripleo | 14:24 | |
*** hafe has joined #tripleo | 14:24 | |
*** lblanchard has joined #tripleo | 14:25 | |
panda | can someone help me understand if the errors here http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-mitaka/8aee8f7/logs/undercloud/var/log/image_build.txt.gz mean that dib fails to create the initram, but continues with overcloud image anyway, except failing because initram is not present ? | 14:26 |
sshnaidm | trown, EmilienM, bnemec please provide your feedback: https://review.openstack.org/422646 it will allow to run oooq jobs in check pipe for tripleo-ci (only!) in order to prevent breaking it and for further development of transition | 14:27 |
*** udesale has quit IRC | 14:27 | |
EmilienM | sshnaidm: kind of bad time now, I'll look when I can. | 14:28 |
saneax | beagles would request you to look at the patch https://review.openstack.org/#/c/417805/ | 14:28 |
sshnaidm | EmilienM, sure, we can discuss it in the mtg today later | 14:29 |
*** salmankhan has joined #tripleo | 14:30 | |
*** nyechiel has joined #tripleo | 14:30 | |
panda | yolanda: you were working with dib this morning ^ :) | 14:32 |
*** leanderthal has joined #tripleo | 14:32 | |
yolanda | panda yes, but on feature/v2 branch | 14:32 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras: collect-logs: rename text files to txt.gz https://review.openstack.org/419039 | 14:33 |
*** hafe has quit IRC | 14:35 | |
ansiwen | shardy: wouldn't it be better to let build_endpoint_map.py also created these files? seems to be the same thing to me | 14:38 |
EmilienM | if someone could review this tripleo-ci patch, to add placement services in multinode (really quick) - thanks! https://review.openstack.org/#/c/422258/ | 14:39 |
panda | shardy: does mitaka support overcloud deletion ? | 14:43 |
*** hafe has joined #tripleo | 14:43 | |
*** liverpooler has joined #tripleo | 14:44 | |
shardy | panda: yes, all releases support deleting the overcloud | 14:44 |
*** psahoo has quit IRC | 14:44 | |
shardy | panda: heat stack-delete overcloud | 14:44 |
shardy | or openstack stack delete overcloud | 14:44 |
shardy | the overcloud delete command is only in recent versions IIRC | 14:44 |
shardy | d0ugal: ^^ can confirm which ones | 14:45 |
*** saneax is now known as saneax-_-|AFK | 14:46 | |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common: Add a delete stack workflow https://review.openstack.org/422658 | 14:46 |
d0ugal | panda, shardy: mitaka would just be with the heat client. | 14:46 |
*** nyechiel has quit IRC | 14:46 | |
shardy | ansiwen: yeah probably it would, patches welcome ;) | 14:46 |
d0ugal | panda, shardy: "openstack overcloud delete" will be new in Ocata iirc | 14:47 |
panda | shardy: d0ugal sorry, I think the command actually causing the CI to fail is "openstack overcloud plan delete" | 14:47 |
shardy | that was introduced during Newton | 14:47 |
d0ugal | panda: oh, do you have an error? | 14:47 |
*** jeckersb_gone is now known as jeckersb | 14:48 | |
panda | d0ugal: yes, http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-mitaka/d7170c4/console.html | 14:48 |
* d0ugal looks | 14:48 | |
panda | d0ugal: sorry this http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-mitaka/d7170c4/console.html | 14:48 |
panda | mmmmh | 14:48 |
panda | d0ugal: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-mitaka/d7170c4/console.html#_2017-01-18_08_18_28_681770 | 14:48 |
panda | there | 14:48 |
*** liverpooler has quit IRC | 14:48 | |
*** liverpooler has joined #tripleo | 14:49 | |
jpich | oh, plan delete wouldn't have existed yet in Mitaka | 14:49 |
panda | yeah, so we have to change that part in tripleo.sh script | 14:49 |
d0ugal | yup | 14:49 |
*** milan has joined #tripleo | 14:49 | |
panda | should be replaced with something ? | 14:49 |
jpich | I don't think it's necessary, no | 14:50 |
jpich | it was just added because we missed a bug in plan delete at the time | 14:50 |
jpich | https://review.openstack.org/#/c/408301/ | 14:50 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-common: Add a PacemakerRemoteAuthkey to the default passwords https://review.openstack.org/420459 | 14:51 |
d0ugal | panda: plans didn't exist, so in Mitaka you just need to delete the stack. | 14:52 |
panda | d0ugal: jpich shardy ok, thanks! | 14:52 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common: Fix delete_node failures https://review.openstack.org/422664 | 14:52 |
larsks | Hey, are there problems with the gate-tripleo-ci-centos-7-ovb-ha job? I'm seeing a timeout, and I know bandini was seeing one yesterday, and I'm pretty sure the timeouts are unrelated to the changes themselves... | 14:53 |
openstackgerrit | yolanda.robla proposed openstack/tripleo-common: Add element to regenerate dracut on the agent https://review.openstack.org/420805 | 14:58 |
*** fultonj has joined #tripleo | 14:58 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: tripleo.sh: skip plan delete for mitaka https://review.openstack.org/422673 | 14:58 |
openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-quickstart: ensure that tripleo-quickstart volume pool is defined https://review.openstack.org/422224 | 14:58 |
*** dprince has quit IRC | 14:59 | |
*** crenguta has quit IRC | 15:01 | |
openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates: Add ec2-api service https://review.openstack.org/398634 | 15:01 |
*** thrash is now known as thrash|biab | 15:01 | |
*** hafe has quit IRC | 15:02 | |
adarazs | EmilienM, trown, sshnaidm, weshay, hrybacki, panda, rlandy and anybody else interested: TripleO CI Squad meeting in half an hour, add agenda items here: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 15:02 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: tripleo.sh: skip plan delete for mitaka https://review.openstack.org/422673 | 15:02 |
*** udesale has joined #tripleo | 15:05 | |
panda | d0ugal: jpich ^ let's make mitaka pass again :) | 15:05 |
*** ealcaniz has quit IRC | 15:05 | |
*** abehl has quit IRC | 15:08 | |
*** nyechiel has joined #tripleo | 15:08 | |
honza | jpich: CI success :) https://review.openstack.org/#/c/418941/ dance? | 15:08 |
openstackgerrit | Ana Krivokapic proposed openstack/tripleo-common: Fix class constructors https://review.openstack.org/422680 | 15:09 |
honza | jpich: i'm sure you get the emails but yay | 15:09 |
*** psahoo has joined #tripleo | 15:10 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add swift service support for composable upgrades https://review.openstack.org/405245 | 15:10 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Swift proxy align *-quotas with puppet-swift syntax https://review.openstack.org/422682 | 15:10 |
openstackgerrit | Alex Schultz proposed openstack/instack-undercloud: Validate vips when generating certificate too https://review.openstack.org/400364 | 15:11 |
bnemec | gfidente: EmilienM: My theory is that there was something in the selinux package updates that wasn't playing nicely with the way we update our cached images. | 15:11 |
bnemec | I base this primarily on the fact that only jobs using cached images seemed to hit the bug. | 15:12 |
gfidente | bnemec but did anything change in those packages from yesterday? | 15:12 |
shardy | bnemec: I'm also hitting selinux issues doing package based upgrades from N->0 | 15:12 |
shardy | which seems to be a new issue | 15:12 |
jpich | honza: Nah, thanks for the note! I'll update the Thread Where I Talk To Myself A Lot now :) | 15:12 |
bnemec | gfidente: Assuming we got a promote at some point last night, the updated packages would already be in the cached image so the ci update would be essentially a noop. | 15:13 |
jpich | honza: If you have the cycle to recheck the existing patches, particularly the ones that were already approved that would rock! | 15:13 |
honza | jpich: on it :) | 15:13 |
jpich | honza: \o/ | 15:13 |
bnemec | shardy: Fun! | 15:13 |
bnemec | /sarcasm | 15:14 |
*** prateek has quit IRC | 15:15 | |
gfidente | shardy selinux issues from the same semanage command for ceph? | 15:15 |
gfidente | cause I couldn't reproduce that outside ci | 15:15 |
shardy | gfidente: No, cinder and glance are both broken after a package based upgrade | 15:15 |
gfidente | hmm | 15:15 |
shardy | I thought it was misconfiguration and wasted $too_much time before I discovered disabling selinux fixes it | 15:16 |
shardy | and that we're running multinode jobs with selinux in permissive mode :( | 15:16 |
shardy | so CI looks perfectly fine | 15:16 |
shardy | I'll figure out the audit2allow stuff and raise some bzs I guess | 15:16 |
*** dmacpher has joined #tripleo | 15:17 | |
bnemec | Can somebody merge https://review.openstack.org/#/c/416308/ so we start getting the updates job on the cistatus page again? | 15:18 |
bnemec | It became voting yesterday. | 15:18 |
shardy | bnemec: done | 15:18 |
bnemec | shardy: Thanks! | 15:18 |
shardy | other than the selinux thing the upgrades job is looking pretty stable | 15:19 |
shardy | would be good to make that voting on t-h-t after we iron out the remaining upgrade issues | 15:19 |
*** hafe has joined #tripleo | 15:22 | |
*** dougbtv|afk is now known as dougbtv | 15:22 | |
jrist | thanks for the recheck, honza | 15:25 |
honza | recheck all the things! | 15:25 |
*** rbrady has joined #tripleo | 15:28 | |
*** rbrady has joined #tripleo | 15:28 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: tripleo.sh: skip plan delete for mitaka https://review.openstack.org/422673 | 15:29 |
panda | a SPACE! :) | 15:29 |
*** jaosorior has joined #tripleo | 15:31 | |
gfidente | shardy when you say we're doing multinode with selinux in permissive mode | 15:31 |
gfidente | that is because the image comes with selinux permissive | 15:31 |
fpan | EmilienM: could you take a look at https://review.openstack.org/#/c/414730/ and https://review.openstack.org/#/c/414751/ | 15:31 |
gfidente | because in ovb we have it in enforcing mode no? | 15:31 |
*** sanagikoki has joined #tripleo | 15:31 | |
*** karimb has quit IRC | 15:32 | |
jaosorior | EmilienM: ping | 15:33 |
jaosorior | EmilienM: so the two commits I posted seem to fix the haproxy configuration for the placement API | 15:35 |
*** rajinir has joined #tripleo | 15:35 | |
jaosorior | however, I still don't see the logs for it in the nova log directory | 15:35 |
jaosorior | EmilienM: where can I see where it possibly failed to start or load? | 15:36 |
jaosorior | shardy: hey dude, can you review this one? it adds the network for the placement API, so t-h-t can generate the _vip and _node_names values | 15:37 |
jaosorior | shardy: https://review.openstack.org/#/c/422280/ | 15:37 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Limit heat and nova workers https://review.openstack.org/368220 | 15:37 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Use eth2 interface when network-isolation only https://review.openstack.org/422441 | 15:37 |
*** ealcaniz has joined #tripleo | 15:37 | |
ealcaniz | tesseract, #01772082 | 15:37 |
shardy | gfidente: No, it's because we set it to permissive mode | 15:38 |
shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/deployed-server/deployed-server-bootstrap-centos.sh#L16 | 15:38 |
shardy | afaics at least | 15:39 |
weshay | EmilienM, if I setup an ovb job in zuul to gate containers.. would that vote? | 15:39 |
jrist | shadower: you around? | 15:39 |
jrist | shadower: wondering if there is a way to 'reset' validations | 15:39 |
gfidente | shardy ah that's multinode only still | 15:39 |
jrist | so they look fresh | 15:39 |
shardy | I assume it's because the multinode things need it that way, but we'll need to figure out a way to turn it back on | 15:39 |
shardy | gfidente: yeah, but we only test major upgrades on multinode atm | 15:39 |
shardy | jaosorior: will do | 15:40 |
*** sanagikoki has quit IRC | 15:40 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job https://review.openstack.org/419529 | 15:40 |
jaosorior | weshay: not ovb IIUC | 15:40 |
ccamacho|lunch | EmilienM when having some time, mind to check https://review.openstack.org/#/c/412454/ ? I had to rebase it a few days ago and missed your vote | 15:41 |
*** ccamacho|lunch is now known as ccamacho | 15:41 | |
*** ealcaniz has quit IRC | 15:41 | |
shardy | weshay: ovb jobs can't go in the gate queue and forcibly vote, but they can be "voting" in that cores pay attention to them and don't approve when they're failing | 15:44 |
shardy | that's worked pretty well in the past, provided folks are clear which jobs are expected to pass | 15:45 |
weshay | flaper87, so you are happy w/ a non-voting job to start w/ | 15:46 |
weshay | thanks shardy jaosorior | 15:46 |
*** dprince has joined #tripleo | 15:47 | |
*** abregman has quit IRC | 15:48 | |
flaper87 | weshay: non voting but running on every patch sounds like a good start till after ocata | 15:49 |
bandini | ccamacho: around? | 15:49 |
ccamacho | hey bandini | 15:50 |
ccamacho | yeahp | 15:50 |
weshay | ok.. cool.. I think we're all in sync then | 15:50 |
*** karimb has joined #tripleo | 15:52 | |
*** sanagikoki has joined #tripleo | 15:52 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Environment parameters https://review.openstack.org/418798 | 15:53 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Normalize parameters https://review.openstack.org/403422 | 15:53 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Update app state when parameters get updated https://review.openstack.org/409825 | 15:53 |
*** thrash|biab is now known as thrash | 15:55 | |
* EmilienM leaves 20 mins and has 4 pings :-) | 15:55 | |
* EmilienM in a mtg | 15:56 | |
openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart-extras: Fix minor issues with doc templates https://review.openstack.org/422713 | 15:56 |
*** jlinkes_ has quit IRC | 15:58 | |
*** shardy has quit IRC | 16:00 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart-extras: Enable novajoin/TLS-everywhere overcloud deploy arguments https://review.openstack.org/422310 | 16:00 |
*** florianf has quit IRC | 16:01 | |
*** shardy has joined #tripleo | 16:01 | |
*** florianf has joined #tripleo | 16:04 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Adds a pre-upgrade check that service is running (step0) https://review.openstack.org/414598 | 16:05 |
*** david-lyle has joined #tripleo | 16:06 | |
*** hafe has quit IRC | 16:06 | |
*** jcoufal has joined #tripleo | 16:08 | |
*** tremble has quit IRC | 16:08 | |
*** ebarrera has quit IRC | 16:09 | |
sanagikoki | Could someone review this ? It needs one more +2. https://review.openstack.org/#/c/413778/ | 16:09 |
*** udesale has quit IRC | 16:11 | |
*** agurenko has quit IRC | 16:13 | |
shardy | sanagikoki: can we mark that blueprint Implemented after that patch lands? | 16:13 |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations: Create the neutron-sanity-check validations https://review.openstack.org/381118 | 16:13 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Rename updates-nv to just updates https://review.openstack.org/416308 | 16:14 |
sanagikoki | shardy: Yes we can. | 16:14 |
*** mcornea has quit IRC | 16:14 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Fix a typo in deployed-server/README.rst https://review.openstack.org/416851 | 16:14 |
shardy | sanagikoki: great, thanks! :) | 16:14 |
*** rhallisey has quit IRC | 16:14 | |
*** rhallisey has joined #tripleo | 16:14 | |
jpich | honza: So... https://review.openstack.org/#/c/419964/ , a new dependency, seems to be passing CI just fine. From your understanding of How These Things Work are we about to end up with a broken CI again, or will the RPM build only fail for the dependent patch that actually uses the new dep? | 16:15 |
gfidente | bnemec just seen two runs of nonha failing again on selinux | 16:16 |
gfidente | https://review.openstack.org/#/c/422281/3 and https://review.openstack.org/#/c/422280/2 | 16:17 |
EmilienM | fpan: yes I will asap | 16:18 |
gfidente | both are upgrading libsemanage, policycoreutils and a bunch of other selinux related pkgs | 16:18 |
fpan | EmilienM: thanks! | 16:18 |
*** florianf has quit IRC | 16:19 | |
EmilienM | fpan: +A | 16:19 |
*** florianf has joined #tripleo | 16:19 | |
EmilienM | jaosorior: yes I noticed your patches fixed HAproxy config (thanks!) but placement doesn't start on ovb jobs (but does on multinode) | 16:19 |
EmilienM | weshay: no they would not vote (ovb) | 16:19 |
EmilienM | ccamacho: yes I'll look asap | 16:20 |
EmilienM | jaosorior: I'm confused why it works fine in multinode jobs and not in ovb-ha | 16:21 |
EmilienM | jaosorior: http://logs.openstack.org/21/422621/1/check/gate-tripleo-ci-centos-7-scenario002-multinode/54446a2/logs/subnode-2/var/log/nova/ | 16:21 |
weshay | bkero, can you please point me at the ping test results in http://logs.openstack.org/12/420912/3/experimental/gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv/330c45e/ | 16:21 |
EmilienM | see how it works fine in multinode | 16:21 |
*** yamahata has joined #tripleo | 16:22 | |
weshay | bkero, found it http://logs.openstack.org/12/420912/3/experimental/gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv/330c45e/logs/var/log/overcloud-pingtest.txt.gz | 16:22 |
openstackgerrit | Julie Pichon proposed openstack-infra/tripleo-ci: Use the Newton node management commands https://review.openstack.org/416982 | 16:22 |
*** absubram has joined #tripleo | 16:22 | |
jaosorior | EmilienM: what the hell | 16:22 |
EmilienM | jaosorior: :/ | 16:23 |
jaosorior | EmilienM: is there any trace inn the logs why it wouldn't have started? | 16:23 |
bkero | weshay: you beat me to it | 16:23 |
weshay | :) | 16:23 |
EmilienM | oh wait | 16:26 |
EmilienM | http://logs.openstack.org/81/422281/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/34bad57/logs/overcloud-novacompute-0/var/log/nova/nova-compute.txt.gz#_2017-01-19_02_32_34_140 | 16:26 |
EmilienM | jaosorior: ^ | 16:26 |
EmilienM | I think I missed something :D placement creds need to be on compute nodes | 16:27 |
* EmilienM huge facepalm | 16:27 | |
EmilienM | jaosorior: let me fix that asap | 16:27 |
jaosorior | EmilienM: sure | 16:27 |
EmilienM | mwhahaha: ^ fyi | 16:28 |
*** panda is now known as panda|bbl | 16:28 | |
bnemec | gfidente: Those both failed last night before the promotion though. | 16:29 |
*** aufi has quit IRC | 16:30 | |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Move nova::placement to common nova manifest https://review.openstack.org/422739 | 16:32 |
sshnaidm | next time I move my cards up :) | 16:32 |
*** hrybacki is now known as hrybacki|afkish | 16:32 | |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations: Create the neutron-sanity-check validations https://review.openstack.org/381118 | 16:33 |
honza | jpich: i think it'll only fail later (when the other patch is merged) so we should have enough time to update the RDO bits | 16:33 |
openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras: Stop pulling Atomic image https://review.openstack.org/422742 | 16:34 |
*** abehl has joined #tripleo | 16:34 | |
fultonj | EmilienM: do you recommend that all specs, or at least drafts of them, be in before the PTG? | 16:34 |
openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo: Add base profile for Octavia services https://review.openstack.org/351898 | 16:35 |
sshnaidm | trown, adarazs please review this in your time: https://review.openstack.org/419491 it's from card https://trello.com/c/dXsai25w | 16:35 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Move nova placement hiera to nova-base https://review.openstack.org/422746 | 16:35 |
EmilienM | jaosorior: done ^ | 16:35 |
jpich | honza: I will be super duper happy if it works out this way from now on :) | 16:35 |
jpich | honza: Thanks for the answer! | 16:35 |
EmilienM | fultonj: the sooner you draft a spec before PTG, the better | 16:35 |
openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo: Add base profile for Octavia services https://review.openstack.org/351898 | 16:35 |
fultonj | EmilienM: ok, thanks | 16:35 |
openstackgerrit | Merged openstack/tripleo-ui: Add i18n strings to plan components https://review.openstack.org/416564 | 16:36 |
openstackgerrit | Merged openstack/tripleo-ui: Add i18n strings to deployment components https://review.openstack.org/413657 | 16:36 |
openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo: Add initial profiles for rest of Octavia services https://review.openstack.org/411422 | 16:36 |
*** links has joined #tripleo | 16:37 | |
trown | sshnaidm: we no longer need to skip the ci projects with that? | 16:37 |
*** lblanchard has quit IRC | 16:37 | |
sshnaidm | trown, no, it's actually not related, the skipped projects now are in defaults of build role | 16:37 |
sshnaidm | trown, I should have written this in commit, sorry | 16:38 |
openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras: Bind docker-registry to port 8787 https://review.openstack.org/422749 | 16:38 |
adarazs | sshnaidm: another question, as far as I see the artg_repos_dir is used as being on the same host as where the package building is happening. what copies them there? | 16:38 |
sshnaidm | adarazs, I had an addition to build role: https://review.openstack.org/#/c/405369/ | 16:39 |
openstackgerrit | Merged openstack/tripleo-ui: Add i18n strings to validations components https://review.openstack.org/418967 | 16:40 |
adarazs | sshnaidm: I know that. but the directory is supposed to be on the host where the playbook is running | 16:40 |
adarazs | sshnaidm: are these sources copied over somewhere? | 16:40 |
sshnaidm | adarazs, but they are | 16:41 |
sshnaidm | adarazs, they are cloned by zuul there | 16:41 |
adarazs | oh, okay. zuul clones them on the undercloud? oh... the undercloud is the node running quickstart in this case, right? | 16:42 |
sshnaidm | adarazs, and everything is on the same host | 16:42 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common: Add a delete stack workflow https://review.openstack.org/422658 | 16:42 |
sshnaidm | adarazs, yep | 16:42 |
adarazs | sshnaidm: ah, okay. | 16:42 |
*** ohamada_ has quit IRC | 16:43 | |
adarazs | sshnaidm: reviewed | 16:45 |
openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras: Broaden the scope of max_nested_stack_depth regex https://review.openstack.org/422752 | 16:47 |
*** absubram has quit IRC | 16:47 | |
jaosorior | shardy: to be honest I still don't see how I could do https://review.openstack.org/#/c/411340/23 by passing all the stuff to the hook | 16:48 |
*** ccamacho has quit IRC | 16:48 | |
jaosorior | shardy: that pretty much kills off the dynamic generation that I was doing and I would need to hardcode everything, as far as I can see | 16:48 |
trown | sshnaidm: that patch is not actually running DLRN (makes sense it only touches tripleo-ci)... could we depends on a patch somewhere else to make sure it works? http://logs.openstack.org/91/419491/2/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq-nv/2ea3b61/console.html#_2017-01-19_07_47_25_609007 | 16:48 |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations: Create the neutron-sanity-check validations https://review.openstack.org/381118 | 16:48 |
*** absubram has joined #tripleo | 16:49 | |
shardy | jaosorior: Ok I'll try to take a closer look later and explain if/how it might be done | 16:50 |
sshnaidm | trown, sure, it was: https://review.openstack.org/#/c/422428 | 16:50 |
*** david-lyle has quit IRC | 16:55 | |
*** absubram has quit IRC | 16:55 | |
*** yprokule has quit IRC | 16:55 | |
trown | sshnaidm: oh whoops, didnt look close enough thanks | 16:56 |
openstackgerrit | Merged openstack/tripleo-ui: Add js-yaml dependency https://review.openstack.org/419964 | 16:56 |
*** jistr is now known as jistr|afk | 16:57 | |
*** absubram has joined #tripleo | 16:59 | |
EmilienM | shardy: thanks for the glance registry thing on the overcloud & also swift upgrades, nice work | 17:02 |
jidar | bnemec and trown it was you guys :P you're the ones who removed epel later last year! https://git.openstack.org/cgit/openstack/diskimage-builder/commit/elements?id=49baaa4114eda954b9bd497d4813e89ff16130b9 Thanks for the help yesterday bnemec I was able to solve it by adding one line, everything works swimmingly now. I might recommend to reverse that commit though | 17:03 |
*** beagles is now known as beagles-brb | 17:03 | |
trown | jidar: we dont want epel as a requirement | 17:03 |
*** rbrady has quit IRC | 17:03 | |
jidar | I feel that, but unless jq/puppet is going into main, I don't see how that's possible? | 17:04 |
*** liverpooler has quit IRC | 17:04 | |
trown | we build images in various CI jobs without epel... missing context on what your issue was | 17:04 |
bnemec | jidar: It's not a hard requirement, so it shouldn't be written as such. We use RDO to provide those packages. | 17:04 |
jidar | then why isn't there a rdo repo with those packages included by default? | 17:04 |
dtrainor | shadower, i think your email re: validations was what i was looking for. i deleted the default plan, and then re-created it, but the validation states stayed the same | 17:04 |
shardy | EmilienM: np, I'll hopefully get the nova patch fully working tomorrow, and am rebasing the other services e.g sahara now | 17:05 |
bnemec | Documenting in the centos element that you may need epel or rdo repos would be good though. | 17:05 |
shardy | thanks for the reviews | 17:05 |
bnemec | jidar: Because RDO is also not a hard dependency. | 17:05 |
bnemec | You can use either. | 17:05 |
jidar | trown: basically I can't build a centos image without including epel to do OS::Heat::Softwaredeployments | 17:05 |
*** liverpooler has joined #tripleo | 17:05 | |
shadower | dtrainor: yeah sounds like a bug. Though I wonder if it's because both plans had the same name? | 17:05 |
EmilienM | shardy: good luck with nova, and the cellv2 thing | 17:05 |
shadower | dtrainor: did they? | 17:05 |
dtrainor | they did have the same name. i can test. | 17:06 |
shadower | yea it'd be useful to know if that's it | 17:06 |
*** ccamacho has joined #tripleo | 17:06 | |
*** absubram has quit IRC | 17:08 | |
*** cylopez1 has quit IRC | 17:11 | |
*** links has quit IRC | 17:11 | |
*** liverpooler has quit IRC | 17:12 | |
*** liverpooler has joined #tripleo | 17:12 | |
bnemec | real 29m0.977s <- Wow, the undercloud install has gotten slow | 17:15 |
*** sanagikoki has quit IRC | 17:15 | |
*** rbrady has joined #tripleo | 17:15 | |
*** liverpooler has quit IRC | 17:16 | |
*** yamahata has quit IRC | 17:16 | |
*** liverpooler has joined #tripleo | 17:17 | |
amoralej | EmilienM, let me know when you have a chance to discuss about tripleo-promotions after rc1, once we move to centos-ocata delorean builder | 17:17 |
*** sanagikoki has joined #tripleo | 17:18 | |
openstackgerrit | Martin André proposed openstack/tripleo-common: Add pull-puppet-modules script to binaries https://review.openstack.org/422772 | 17:18 |
EmilienM | amoralej: what needs to be discussed? | 17:18 |
amoralej | currently there is promotion only for master, iiuc, that means that there will not be promotions on ocata repos once we get stable/ocata branches | 17:19 |
amoralej | is that what we want? | 17:19 |
amoralej | EmilienM ^ | 17:20 |
amoralej | or will we move promotion to ocata builder until GA? | 17:21 |
*** bana_k has joined #tripleo | 17:21 | |
openstackgerrit | Merged openstack/tripleo-image-elements: Remove vim configuration in source file https://review.openstack.org/400137 | 17:22 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add sahara service support for composable upgrades https://review.openstack.org/405247 | 17:23 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add swift service support for composable upgrades https://review.openstack.org/405245 | 17:23 |
EmilienM | amoralej: what changes from newton? | 17:24 |
EmilienM | we keep same model as we do with newton, no? | 17:24 |
*** zoli is now known as zoli|gone | 17:26 | |
*** psahoo has quit IRC | 17:28 | |
*** david-lyle has joined #tripleo | 17:28 | |
openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Add Swift to the major upgrade CI https://review.openstack.org/420100 | 17:29 |
openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Add sahara support to major upgrade CI https://review.openstack.org/422776 | 17:29 |
*** shardy has quit IRC | 17:29 | |
openstackgerrit | Andrey Shestakov proposed openstack/diskimage-builder: Fix dhcp-all-interfaces for ubuntu-minimal xenial https://review.openstack.org/407725 | 17:29 |
sshnaidm | bnemec, shouldn't we change this too? not sure if this is applied: https://github.com/openstack-infra/tripleo-ci/blob/a8b0bc490ed9423b1609034681fa1e748e5fa344/scripts/rh1.env#L12-L12 | 17:29 |
openstackgerrit | Andrey Shestakov proposed openstack/diskimage-builder: Add DIB_IPA_COMPRESS_CMD option https://review.openstack.org/416593 | 17:29 |
bnemec | sshnaidm: No need. 80 still leaves us plenty of wiggle room at 65 concurrent jobs. | 17:30 |
sshnaidm | ok | 17:30 |
bnemec | If we manage to get back up to something like 75 testenvs then we might have to revisit that value. | 17:31 |
bnemec | But we also need to do something with the fip quota in that case tooo. | 17:31 |
EmilienM | amoralej: I need to be afk now for lunch break, bbl | 17:31 |
bnemec | This is why I'm only bumping to 65 for now. Increasing slowly is less likely to run us into these limits unexpectedly. | 17:31 |
amoralej | ok EmilienM, this time will be different that newton, i'll explain it later | 17:31 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Don't assume default network names in net_ip*map https://review.openstack.org/413626 | 17:32 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Make ServiceNetMap support custom network names https://review.openstack.org/413625 | 17:32 |
*** bana_k has quit IRC | 17:38 | |
*** jbcraig has quit IRC | 17:39 | |
*** karimb has quit IRC | 17:42 | |
jaosorior | Any +A for this https://review.openstack.org/#/c/422280/ ? | 17:44 |
*** karimb has joined #tripleo | 17:45 | |
*** sdake_ has joined #tripleo | 17:47 | |
*** flepied has quit IRC | 17:47 | |
*** sdake has quit IRC | 17:50 | |
*** beagles-brb is now known as beagles | 17:50 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Remove redundant CLI arguments for neutron-db-manage https://review.openstack.org/407957 | 17:51 |
*** rbrady has quit IRC | 17:52 | |
*** radeks has joined #tripleo | 17:52 | |
*** radeksmg has joined #tripleo | 17:52 | |
*** nyechiel has quit IRC | 17:55 | |
*** absubram has joined #tripleo | 17:56 | |
openstackgerrit | Koki Sanagi proposed openstack/tripleo-heat-templates: Add THT for fossw ML2 plugin in networking-fujitsu https://review.openstack.org/413778 | 17:56 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Configure cron parameters for Cinder Heat Keystone and Nova https://review.openstack.org/412454 | 17:57 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Disable optional undercloud features in all but nonha https://review.openstack.org/422785 | 17:58 |
* bnemec continues his crusade to eliminate the ovb ci queue | 17:59 | |
*** owalsh has quit IRC | 17:59 | |
jaosorior | bnemec: ??? | 17:59 |
bnemec | jaosorior: https://review.openstack.org/422785 | 17:59 |
jaosorior | bnemec: that makes sense | 18:00 |
bnemec | I thought so. | 18:00 |
bnemec | Especially since we're up to 30 minutes to install the undercloud with default settings these days. | 18:00 |
jaosorior | bnemec: how the hell did we start taking so long? O_O | 18:00 |
bnemec | jaosorior: We kept adding services without ever removing anything. | 18:01 |
*** jistr|afk is now known as jistr | 18:01 | |
* bnemec remembers fondly the days when he could install an undercloud from scratch in 10 minutes | 18:02 | |
jaosorior | long gone are those days | 18:02 |
*** derekh has quit IRC | 18:03 | |
*** yamahata has joined #tripleo | 18:03 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Disable glance registry during upgrade https://review.openstack.org/422620 | 18:03 |
*** jdennis has quit IRC | 18:03 | |
*** athomas has quit IRC | 18:04 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: virtualbmc setup is not working in devmode.sh https://review.openstack.org/421571 | 18:04 |
jaosorior | bnemec: can you check this one out as well https://review.openstack.org/#/c/422281/ ? | 18:09 |
jaosorior | beagles: ^ | 18:09 |
beagles | jaosorior: yup | 18:09 |
openstackgerrit | Ana Krivokapic proposed openstack/tripleo-common: WIP plan export https://review.openstack.org/422789 | 18:10 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use disable_contraints in custom roles data in CI https://review.openstack.org/410392 | 18:10 |
beagles | jaosorior: pretty straightforward ... think it's alright for me to +A that, don't you? | 18:11 |
*** crenguta has joined #tripleo | 18:11 | |
jaosorior | beagles: sure | 18:11 |
*** hjensas has quit IRC | 18:11 | |
jaosorior | beagles: thanks | 18:12 |
beagles | jaosorior: np | 18:12 |
*** gfidente has quit IRC | 18:12 | |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Only install tempest if it's going to be used https://review.openstack.org/422795 | 18:13 |
* bnemec disables all the things | 18:13 | |
*** jpena is now known as jpena|off | 18:13 | |
jpich | jaosorior: Thank you for your comment on that CI review, it wasn't clear to me which jobs were affected :) | 18:14 |
jaosorior | bnemec: seems that the undercloud features one needs a change | 18:14 |
*** abehl has quit IRC | 18:14 | |
*** lucasagomes is now known as lucas-afk | 18:15 | |
jaosorior | jpich: uh... by the way, was this patch actually working https://review.openstack.org/#/c/390845/6/scripts/tripleo.sh ? as far as I can see that URL is incorrect, as we shouldn't be using that range anymore | 18:16 |
*** trown is now known as trown|lunch | 18:16 | |
jpich | jaosorior: It was merged before the range change :) | 18:16 |
jaosorior | jpich: I see it changed to the new range | 18:17 |
jaosorior | it's all good then | 18:17 |
*** david-lyle has quit IRC | 18:18 | |
jpich | Hopefully so. I'd love to expand it a bit in the future | 18:18 |
*** derekh has joined #tripleo | 18:20 | |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Only install tempest if it's going to be used https://review.openstack.org/422795 | 18:21 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Disable optional undercloud features in all but nonha https://review.openstack.org/422785 | 18:21 |
*** dtantsur is now known as dtantsur|afk | 18:21 | |
bnemec | Crap, I should have updated the commit message on that one. | 18:22 |
*** jpich has quit IRC | 18:22 | |
*** rasca has quit IRC | 18:22 | |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Only install tempest if it's going to be used https://review.openstack.org/422795 | 18:24 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Disable optional undercloud features in longer jobs https://review.openstack.org/422785 | 18:24 |
*** sdake has joined #tripleo | 18:24 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Don't start all services during upgrade steps https://review.openstack.org/422621 | 18:27 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Limit heat and nova workers https://review.openstack.org/368220 | 18:27 |
*** sdake_ has quit IRC | 18:28 | |
*** flepied has joined #tripleo | 18:28 | |
openstackgerrit | Andy Smith proposed openstack/puppet-tripleo: Use transport_url(s) for oslo_messaging rpc and notify backends https://review.openstack.org/422801 | 18:28 |
beagles | bnemec, EmilienM: any reason not to +A https://review.openstack.org/#/c/310725/ ? | 18:29 |
* beagles notes it's a whackload of patchsets beautifully pared down to something very simple | 18:29 | |
openstackgerrit | John Eckersberg proposed openstack/tripleo-heat-templates: WIP: add configurable timeouts for DB sync https://review.openstack.org/416298 | 18:31 |
*** weshay is now known as weshay_afk | 18:31 | |
ansiwen | isn't that wrong, that in this file https is combined with the http ports? environments/tls-everywhere-endpoints-dns.yaml | 18:31 |
*** hafe has joined #tripleo | 18:32 | |
jaosorior | ansiwen: no | 18:32 |
*** lblanchard has joined #tripleo | 18:32 | |
jaosorior | ansiwen: there really isn't any sense in changing the ports | 18:33 |
jaosorior | ansiwen: the whole "port changing" comes from "legacy" in tripleo, ideally we shouldn't even be changing them | 18:33 |
*** bana_k has joined #tripleo | 18:33 | |
*** crenguta has quit IRC | 18:34 | |
*** paramite has quit IRC | 18:34 | |
*** derekh has quit IRC | 18:35 | |
openstackgerrit | Ben Nemec proposed openstack/instack-undercloud: Remove enable_(mistral|zaqar) options https://review.openstack.org/422802 | 18:35 |
*** absubram has quit IRC | 18:36 | |
hafe | using composable roles; is it possible to add an additional service to the controller role? | 18:37 |
hafe | similar to openstack services with db, keystone, vip etc | 18:38 |
hafe | without touching the tripleo core templates | 18:38 |
jaosorior | hafe: yes | 18:38 |
hafe | I have started that path | 18:38 |
openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient: Migrate overcloud delete to full workflow https://review.openstack.org/422806 | 18:39 |
jaosorior | hafe: would be a matter of adding it to this list, which defines the defaults https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data.yaml | 18:39 |
hafe | jaosorior: aware of any description/blog/wiki? | 18:39 |
*** sdake_ has joined #tripleo | 18:39 | |
jaosorior | hafe: https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data.yaml#L24 | 18:39 |
hafe | jaosorior: done that part | 18:40 |
*** hrybacki|afkish is now known as hrybacki|sick | 18:40 | |
jaosorior | hafe: and making sure that resource is available through the resource registry https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml | 18:40 |
hafe | got the db and keystone setup | 18:40 |
jaosorior | hafe: I'm not aware of any blog or wiki. I know they exist; just haven't seen them :/ | 18:40 |
hafe | currently looking at adding haproxy support for a vip | 18:40 |
*** nyechiel has joined #tripleo | 18:41 | |
*** dsneddon has joined #tripleo | 18:41 | |
jaosorior | hafe: that unfortunately is not as dynamic as the rest :/ | 18:41 |
jaosorior | hafe: you need to modify the haproxy puppet manifest | 18:41 |
hafe | jaosorior: I am a afraid of that | 18:41 |
ansiwen | dearest friends, could you do me a belated christmas present and +2 my changes, which are finally passing CI? https://review.openstack.org/#/c/336562/ and https://review.openstack.org/#/c/398634/ | 18:41 |
EmilienM | beagles: I was waiting for CI on THT patch | 18:41 |
beagles | EmilienM: ack | 18:42 |
ansiwen | pretty pretty please, I'm working on this since months >_< :-) | 18:42 |
*** sdake has quit IRC | 18:42 | |
EmilienM | beagles: it seems to work | 18:42 |
*** apetrich has joined #tripleo | 18:42 | |
EmilienM | beagles: so lt's go | 18:42 |
beagles | go go patch-merging! | 18:42 |
*** hafe has quit IRC | 18:44 | |
*** rbrady has joined #tripleo | 18:44 | |
*** hafe has joined #tripleo | 18:44 | |
jaosorior | ansiwen: can you pass a link to the ec2 puppet manifests? | 18:44 |
ansiwen | jaosorior: puppet-tripleo? the first link | 18:45 |
*** tosky has quit IRC | 18:45 | |
bnemec | Oh for crying out loud. I forgot to run unit tests on the enable_mistral change. | 18:45 |
*** salmankhan has quit IRC | 18:46 | |
jaosorior | ansiwen: no, puppet-ec2 or whatever we're using (tried finding it myself but failed) | 18:46 |
hafe | jaosorior: can I in step 2 create a ::tripleo::haproxy::endpoint resource ? | 18:46 |
mwhahaha | undercloud experts, would be nice to get some reviews on https://review.openstack.org/#/c/400364/ | 18:47 |
jaosorior | hafe: in your own manifest? | 18:47 |
hafe | jaosorior: yes outside the core haproxy | 18:47 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Move nova placement hiera to nova-base https://review.openstack.org/422746 | 18:47 |
jaosorior | hafe: I have never thought about that. Maybe you actually can. EmilienM ^^ | 18:48 |
ansiwen | jaosorior: so I just remove the members_options line? I asked before here, but didn't get an answer | 18:48 |
openstackgerrit | Ben Nemec proposed openstack/instack-undercloud: Remove enable_(mistral|zaqar) options https://review.openstack.org/422802 | 18:48 |
jaosorior | ansiwen: I didn't see the question :/ | 18:49 |
bnemec | Hmm, actually not the python unit tests that failed. | 18:49 |
bnemec | Which is somewhat disturbing. | 18:49 |
jaosorior | ansiwen: anyway, please do. I'll check on adding it another time | 18:49 |
ansiwen | jaosorior: just removing it you mean? | 18:49 |
jaosorior | ansiwen: I'll point it out in the CR | 18:50 |
ansiwen | jaosorior: that's the manifests, they are already tempest tested in puppet ci, https://github.com/openstack/puppet-ec2api/ | 18:50 |
jaosorior | ansiwen: the ec2 metadata endpoint needs no public VIP, right? | 18:50 |
ansiwen | jaosorior: I assume that, because the nova metadata also doesn't. I just mimiced whatever nova metadata did | 18:51 |
jaosorior | ansiwen: ok, makes sense | 18:51 |
*** sdake has joined #tripleo | 18:51 | |
ansiwen | jaosorior: this will change anyway, when we split nova end ec2 metadata from the normal api service | 18:52 |
hafe | jaosorior: I can't hook into step1, so can doing it in step2 cause problems? | 18:53 |
*** pkovar has quit IRC | 18:53 | |
jaosorior | hafe: I don't think so, however, you might need to refresh the haproxy service so it takes the change into account | 18:53 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Enabling until_complete to be configured dynamically https://review.openstack.org/412804 | 18:54 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 18:54 |
*** florianf has quit IRC | 18:54 | |
*** sdake_ has quit IRC | 18:54 | |
*** flepied has quit IRC | 18:55 | |
openstackgerrit | Sven Anderson proposed openstack/puppet-tripleo: Implement Nova ec2api profile https://review.openstack.org/336562 | 18:55 |
jaosorior | ansiwen: found another small detail on the t-h-t patch. Everything else looks fine and I can +2 after it's fixed :) | 18:55 |
EmilienM | amoralej: ok no problem, email it to openstack-dev if needed with tripleo tag | 18:55 |
EmilienM | amoralej: so we can discuss it in the open, | 18:55 |
amoralej | ok | 18:55 |
EmilienM | thanks | 18:56 |
EmilienM | bnemec: should we close https://bugs.launchpad.net/tripleo/+bug/1657562 ? | 18:57 |
openstack | Launchpad bug 1657562 in tripleo "ceph deployments failing on selinux error" [High,Triaged] | 18:57 |
EmilienM | or do we still hit it? | 18:57 |
ansiwen | jaosorior: wow, you have good eyes! kudos! | 18:59 |
*** crenguta has joined #tripleo | 19:00 | |
jaosorior | ansiwen: damn, found more stuff in the puppet-tripleo patch | 19:00 |
*** nyechiel has quit IRC | 19:00 | |
ansiwen | jaosorior: well, I'm allowed to push one more time today... so that is ok ;-) | 19:01 |
*** derekh has joined #tripleo | 19:01 | |
*** b00tcat has joined #tripleo | 19:01 | |
*** b00tcat has joined #tripleo | 19:01 | |
jaosorior | EmilienM: I think it would be pretty damn cool to build the haproxy endpoint with ensure_resources and pass the the values needed for the endpoint via t-h-t. I don't have time to do it, but if you know someone with spare cycles (not saying you should do it, I know it's a pretty big effort) it would really help deployers just create services | 19:03 |
jaosorior | I might have time if I manage to cover most basic services for the TLS-everywhere work | 19:04 |
jaosorior | ansiwen: anyway, the reason we have a nova-metadata.yaml profile that doesn't deploy any puppet is so it fills up some values needed for it, such as the _vip, _node_names, and the _network entries in hiera | 19:05 |
EmilienM | jaosorior: indeed that would be cool | 19:05 |
*** trown|lunch is now known as trown | 19:05 | |
*** jbcraig has joined #tripleo | 19:05 | |
EmilienM | but you can't use define from hiera out of the box | 19:06 |
bnemec | EmilienM: Yep, closed | 19:06 |
EmilienM | bnemec: thx | 19:06 |
bnemec | Okay, starving. Time for lunch. | 19:07 |
ansiwen | jaosorior: ok, so, I can just use another default in haproxy.pp? or do I have to write a ec2api-metadata.yaml | 19:08 |
jaosorior | ansiwen: depends on what you intend to do | 19:08 |
jaosorior | ansiwen: if ec2 api will ALWAYS be deployed in the same node as nova api, then you can just default | 19:08 |
jaosorior | if that's not the case | 19:08 |
ansiwen | jaosorior: I intend to land it as quickly as possible, and then I'm happy to do refinment :-) | 19:08 |
jaosorior | I really recommend writing an ec2api-metadata.yaml | 19:08 |
ansiwen | jaosorior: I would set the default to ec2_api_network... | 19:09 |
jaosorior | ansiwen: that works for me to be honest | 19:09 |
* jaosorior is not so picky | 19:09 | |
ansiwen | jaosorior: in ocata for sure it will always run on the same nodes | 19:10 |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Adds support to create deployment plan from git repository https://review.openstack.org/417280 | 19:10 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-image-elements: Add a script to zero /etc/sysconfig/iptables at build time https://review.openstack.org/422472 | 19:10 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-common: Add the iptables element to the image building process https://review.openstack.org/422475 | 19:10 |
ansiwen | jaosorior: and I would prefer to do that work when we do a proper splitting of api and metadata | 19:10 |
bandini | EmilienM: the two reviews ^ are my take on the firewall bug at this point. I think in the end it is better we clean /etc/sysconfig/iptables as enabling purging by default might be too disruptive for existing clouds | 19:11 |
jaosorior | ansiwen: works for me | 19:11 |
jaosorior | ansiwen: lets then default the network and values for the metadata to match ec2 api | 19:11 |
*** thrash is now known as thrash|biab | 19:11 | |
EmilienM | bandini: nice, let me look | 19:12 |
ansiwen | jaosorior: just to make sure I understand correctly: I just change line 582 in haproxy.pp, or something else? | 19:12 |
jaosorior | hafe: actually, adding what you did should work in theory | 19:13 |
EmilienM | bandini: it sounds good to me. | 19:13 |
EmilienM | bandini: and then, should we enable purge by default in tripleo? | 19:13 |
jaosorior | hafe: this https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/haproxy.pp#L101 should make sure that any changes to those values make haproxy reload | 19:13 |
ansiwen | jaosorior: oh, I see, the _vip stuff... ok | 19:13 |
*** sdake has quit IRC | 19:14 | |
EmilienM | bandini: or do we keep it to False for backward compat? | 19:14 |
bandini | EmilienM: I would be a bit hesitant to enable it by default. We should probably first find out if there are folks adding iptables rules outside of pupped. if we have folks doing that then we do *not* want purge by default on | 19:14 |
bandini | If that is not the case then we could enable it I guess | 19:14 |
EmilienM | that sounds fair | 19:15 |
jaosorior | ansiwen: I can point it out better in the patch | 19:15 |
jaosorior | let me do that | 19:15 |
hafe | jaosorior: thanks I will give a try then | 19:16 |
ansiwen | jaosorior: I'll remove the ec2_api_metadata_network parameter then, ok? | 19:16 |
jaosorior | ansiwen: commented. | 19:17 |
*** zaneb has quit IRC | 19:17 | |
*** zaneb has joined #tripleo | 19:17 | |
*** sdake has joined #tripleo | 19:17 | |
jaosorior | EmilienM: holy shit | 19:19 |
jaosorior | EmilienM: the pingtest passed for the tls-everywhere job :D | 19:19 |
*** sdake_ has joined #tripleo | 19:20 | |
openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Remove Glance Registry from undercloud https://review.openstack.org/417214 | 19:20 |
jaosorior | bnemec: ^^ | 19:20 |
EmilienM | jaosorior: exit 0 works for me too | 19:20 |
EmilienM | jaosorior: :) | 19:20 |
bnemec | Remove all the things! | 19:21 |
* bandini hits the sack. night everyone | 19:21 | |
EmilienM | bandini: peace | 19:21 |
jaosorior | EmilienM: hahahaha | 19:21 |
jaosorior | anyway | 19:21 |
jaosorior | fucking passed!! yes!! | 19:21 |
EmilienM | "I don't understand how my code worked" | 19:22 |
EmilienM | Welcome to TripleO! | 19:22 |
*** sdake has quit IRC | 19:22 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Add entry in serviceNetMap for Nova Placement https://review.openstack.org/422280 | 19:23 |
jrist | rofl | 19:23 |
openstackgerrit | Merged openstack/puppet-tripleo: Use network entries for nova placement https://review.openstack.org/422281 | 19:24 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Move nova::placement to common nova manifest https://review.openstack.org/422739 | 19:25 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Move nova placement hiera to nova-base https://review.openstack.org/422746 | 19:25 |
*** absubram has joined #tripleo | 19:25 | |
EmilienM | jaosorior: please review https://review.openstack.org/#/c/422258/ | 19:25 |
jaosorior | EmilienM: can you check this out https://review.openstack.org/#/c/391738/ ? That's the commit that implements the TLs-everywhere job. It's currently in the experimental queue, but the plan is to move it tot he periodic one. This https://review.openstack.org/#/c/419529/26 is a hack I did so the TLS-everywhere job would run instead of the ovb-ha job. This is becaues the experimental queue is the last to be | 19:26 |
jaosorior | prioritized, and testing it would have been way harded. | 19:26 |
jaosorior | *way harder | 19:26 |
EmilienM | jaosorior: I swear I'll look at it today but not this afternon | 19:27 |
EmilienM | I'm currently dealing with exiting stuffs about release management | 19:27 |
jaosorior | EmilienM: alright | 19:27 |
EmilienM | jaosorior: I have a last patch ready for review, it's a quick one https://review.openstack.org/#/c/422146/ | 19:28 |
*** spredzy has quit IRC | 19:28 | |
EmilienM | ansiwen: I think I asked if we could include https://review.openstack.org/#/c/406167/ in the other patch, so we test in the same time we add the code | 19:29 |
EmilienM | ansiwen: can you do it please? | 19:29 |
*** jkilpatr has quit IRC | 19:29 | |
*** tesseract has quit IRC | 19:29 | |
ansiwen | EmilienM: I did already, just restored that to test it also in the nonha job... | 19:29 |
ansiwen | EmilienM: I added it to scenario002 in the main change | 19:30 |
crenguta | A | 19:30 |
EmilienM | ansiwen: cool | 19:30 |
jaosorior | sshnaidm: can you re-check this https://review.openstack.org/#/c/391738/ ? | 19:30 |
jaosorior | sshnaidm: it's the TLs patch, and it's working here https://review.openstack.org/#/c/419529/26 it runs there instead of the ovb-ha job (cause experimental queue takes too long) | 19:31 |
*** dprince has quit IRC | 19:32 | |
*** openstackgerrit has quit IRC | 19:33 | |
jaosorior | derekh: hey dude! Thanks for the tip on the CIDR, that did the trick :D | 19:33 |
derekh | jaosorior: cool, no prob | 19:34 |
* jaosorior is too excited... tequila shots are to come | 19:34 | |
derekh | \o/ | 19:34 |
*** openstackgerrit has joined #tripleo | 19:34 | |
openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates: Configure nova neutron parameter for L to M upgrade https://review.openstack.org/422837 | 19:34 |
jaosorior | derekh: I know it must be extremely late there, but if you get a chance, could you check this out https://review.openstack.org/#/c/391738/ ? | 19:34 |
jaosorior | derekh: this is where I triggered it to bypass the long waiting for the experimental queue https://review.openstack.org/#/c/419529/26 | 19:35 |
*** dougbtv has quit IRC | 19:37 | |
derekh | jaosorior: I'm on a train at the moment, mind if I take a look later on? | 19:37 |
openstackgerrit | Sven Anderson proposed openstack/puppet-tripleo: Implement Nova ec2api profile https://review.openstack.org/336562 | 19:38 |
openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates: Add ec2-api service https://review.openstack.org/398634 | 19:38 |
openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates: DON'T MERGE - tester for I2510fd4ed935d8423216fff9ce3adf2d69c9c804 https://review.openstack.org/406167 | 19:38 |
jaosorior | derekh: works for me | 19:39 |
*** dougbtv has joined #tripleo | 19:40 | |
derekh | jaosorior: cool, will take a look later | 19:40 |
*** derekh has quit IRC | 19:41 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-image-elements: Purge chrony package in NTP element https://review.openstack.org/422839 | 19:41 |
ansiwen | jaosorior: thanks a lot for the good review! | 19:41 |
ansiwen | jaosorior: pushed everything | 19:41 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common: overcloud: include ntp element https://review.openstack.org/422840 | 19:42 |
*** jkilpatr has joined #tripleo | 19:44 | |
jaosorior | ansiwen: sure, gonna have lunch and I'll check it out again after that | 19:45 |
*** rbrady has quit IRC | 19:46 | |
*** david-lyle has joined #tripleo | 19:48 | |
*** shinobu_ has joined #tripleo | 19:49 | |
*** karimb has quit IRC | 19:49 | |
shinobu_ | EmilienM: can i ask quick question? | 19:50 |
shinobu_ | maybe it's silly ... | 19:50 |
*** rbrady has joined #tripleo | 19:51 | |
*** rbrady has joined #tripleo | 19:51 | |
larsks | shinobu_: just ask. | 19:54 |
shinobu_ | yeah i'm just now writing... | 19:55 |
shinobu_ | EmilienM: is there any flag that existing overcloud nodes won't be affected by scaling-out or updating? | 19:55 |
shinobu_ | like `unmutable`.... | 19:57 |
shinobu_ | *immutable* | 19:57 |
*** hjensas has joined #tripleo | 19:59 | |
*** hjensas has quit IRC | 19:59 | |
*** hjensas has joined #tripleo | 19:59 | |
*** jmelvin has quit IRC | 20:02 | |
*** rbrady has quit IRC | 20:03 | |
*** absubram has quit IRC | 20:06 | |
openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui: Adds ids namespaced artifacts on plans page. https://review.openstack.org/411102 | 20:06 |
*** salmankhan has joined #tripleo | 20:07 | |
openstackgerrit | Merged openstack/puppet-tripleo: Implement NTP profile https://review.openstack.org/310725 | 20:08 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Deploy NTP with puppet-tripleo profile https://review.openstack.org/422167 | 20:08 |
*** lblanchard has quit IRC | 20:09 | |
*** jprovazn has quit IRC | 20:09 | |
*** amoralej is now known as amoralej|off | 20:09 | |
*** nyechiel has joined #tripleo | 20:11 | |
*** salmankhan has quit IRC | 20:11 | |
*** kjw3 has quit IRC | 20:14 | |
*** kjw3 has joined #tripleo | 20:14 | |
openstackgerrit | Matt Young proposed openstack/tripleo-quickstart-extras: collect logs: ignore all errors https://review.openstack.org/421316 | 20:14 |
*** karimb has joined #tripleo | 20:15 | |
*** thrash|biab is now known as thrash | 20:16 | |
*** dprince has joined #tripleo | 20:17 | |
jaosorior | ansiwen: your patches LGTM, will +2 once they pass CI | 20:17 |
*** nyechiel has quit IRC | 20:21 | |
*** panda|bbl is now known as panda | 20:24 | |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use disable_contraints in custom roles data in CI https://review.openstack.org/410392 | 20:26 |
*** jmelvin has joined #tripleo | 20:27 | |
*** trown is now known as trown|brb | 20:33 | |
openstackgerrit | Merged openstack/instack-undercloud: ntp: make sure chrony is purged before https://review.openstack.org/422164 | 20:34 |
openstackgerrit | Merged openstack-infra/tripleo-ci: enable Placement API on multinode jobs https://review.openstack.org/422258 | 20:36 |
*** milan has quit IRC | 20:40 | |
*** karimb has quit IRC | 20:41 | |
*** milan has joined #tripleo | 20:41 | |
*** trown|brb is now known as trown | 20:42 | |
jaosorior | trown: do you review tripleo-ci CRs? | 20:43 |
trown | jaosorior: CR=code-review? ... I review tripleo-ci patches ya | 20:45 |
jaosorior | trown: Change Request? dammit... I should just use the word patch, it's probably better | 20:46 |
trown | lol | 20:46 |
jaosorior | trown: anyway, could you check this out https://review.openstack.org/#/c/391738/ ? | 20:46 |
EmilienM | as long as you don't say PR | 20:46 |
trown | jaosorior: sure | 20:47 |
EmilienM | shinobu_: in that case, why would you manage the overcloud nodes with tripleo? | 20:47 |
jaosorior | trown: right now that job is on the experimental gate... which takes a VERY long time to run due to it being the lowest in priority. So to bypass that I ran it here https://review.openstack.org/#/c/419529/26 | 20:48 |
trown | jaosorior: ah, that came up on the CI squad meeting today, we didnt know what that fakeha-caserver job was | 20:48 |
jaosorior | trown: you can see the result on the ovb-ha gate | 20:48 |
jaosorior | trown: it's basically the TLS-everywhere job. Hoewver, the name came up from how we set up the jobs in CI. | 20:49 |
trown | jaosorior: is there a barrier to making that a multinode job? | 20:49 |
jaosorior | trown: yes | 20:49 |
jaosorior | trown: in the long term we want to use something called novajoin, which is a vendordata plugin that will add a script to cloud-init to do the CA enrollment. AFAIK, cloud init doesn't run on the multinode jobs | 20:50 |
jaosorior | trown: on the other hand, the multinode jobs rely on the DeployedServer resource, which doesn't handle nova-metadata setting; this is also needed by novajoin | 20:51 |
trown | jaosorior: cool, seems like a good candidate for OVB then :) | 20:51 |
*** b00tcat has quit IRC | 20:51 | |
slagle_ | you could do the CA enrollment on multinode jobs, just not using novajoin | 20:52 |
slagle_ | if all you need to do is run a script | 20:53 |
jaosorior | slagle_: yeah, however, for getting the service principals that will be used for the certificates, we really need that metadata part | 20:53 |
jaosorior | else, we will have enrolled nodes, but since the service principals will be missing, we won't be able to request the certicicates from the CA | 20:54 |
jaosorior | slagle_: I have a WIP patch to add that functionality for DeployedServer... But I didn't finish up getting the tests to pass. And considering that I don't actually have that in my backlog (did it on my free time) I don't think I'll finish that up any time soon :/ | 20:55 |
*** cmyster has quit IRC | 20:56 | |
*** cmyster has joined #tripleo | 20:56 | |
jaosorior | anyway, for now, to get everything to work, OVB is actually the best bet. I can check on moving it to multinode once it's possible | 20:56 |
*** pablo|500| has quit IRC | 20:57 | |
jaosorior | slagle_: I just uploaded my WIP without my lame attempt at tests https://review.openstack.org/#/c/422868/ | 20:58 |
*** ccamacho has quit IRC | 20:59 | |
openstackgerrit | Merged openstack/diskimage-builder: Allow disto-specific mirror settings https://review.openstack.org/408850 | 21:00 |
slagle_ | jaosorior: that might work, although i'm not sure i see where the actual deployed server might query that metadata | 21:01 |
slagle_ | jaosorior: or would you pass it in by a parameter or something? | 21:01 |
jaosorior | slagle_: DeployedServer already has the metadata proprety, which AFAIK is not actually for heat, but for nova metadata. | 21:02 |
jaosorior | slagle_: it's pretty much the same parameter from the OS::Nova::Server resource. | 21:02 |
slagle_ | there's no way for Heat to inject that metadata though b/c the server doesn't exist in nova | 21:03 |
jaosorior | slagle_: ah, doesn't it? | 21:03 |
slagle_ | nova may not even be there | 21:03 |
slagle_ | DeployedServer's do not have to be nova instances | 21:03 |
jaosorior | crap | 21:03 |
jaosorior | all this time I thought it was | 21:03 |
slagle_ | what i meant when i said it ought to be possible via multinode, was just that we can run any arbitrary script on the nodes before starting the deployment | 21:04 |
slagle_ | now, granted, i don't know how any of the CA enrollment or service principals stuff works, but maybe there's a way | 21:05 |
jaosorior | slagle_: yeah, and that part is not really the issue. The issue is filling up all the service principals, which depend on which services are installed on which nodes, and for what networks it should go. | 21:05 |
jaosorior | right now, the way the current tls-everywhere job works, it pre-creates all those entries | 21:05 |
jaosorior | but for real deployments that's quite unusable | 21:05 |
jaosorior | which is the reason novajoin is helpful here | 21:05 |
jaosorior | cause it addresses that | 21:05 |
sshnaidm | jaosorior, why don't you include log collection into the main patch? | 21:06 |
jaosorior | sshnaidm: cause the log collection for the extra node didn't actually collect the logs. I can do that in a subsequent patch. Cause it would be useful. | 21:07 |
sshnaidm | jaosorior, oh, ok | 21:07 |
jaosorior | sshnaidm: I haven't figured out why the logs were empty | 21:07 |
jaosorior | slagle_: also, the nice thing about novajoin is that it cleans up by itself when a node is deleted, and will also handle scaling. So it's a huge usability improvement compared to handling all those entries manually | 21:08 |
openstackgerrit | Merged openstack/instack-undercloud: ssh: use tripleo profile to deploy SSH https://review.openstack.org/422146 | 21:08 |
openstackgerrit | Merged openstack/puppet-tripleo: Adds etcd https://review.openstack.org/414730 | 21:08 |
openstackgerrit | Merged openstack/python-tripleoclient: Switch undercloud upgrade to use upgrade script https://review.openstack.org/419118 | 21:09 |
*** ccamacho has joined #tripleo | 21:09 | |
*** milan has quit IRC | 21:10 | |
*** jkilpatr has quit IRC | 21:10 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Enabling until_complete to be configured dynamically https://review.openstack.org/412804 | 21:10 |
*** milan has joined #tripleo | 21:11 | |
jaosorior | trown: replied | 21:11 |
openstackgerrit | Merged openstack/diskimage-builder: Fix dhcp-all-interfaces for ubuntu-minimal xenial https://review.openstack.org/407725 | 21:11 |
*** jkilpatr has joined #tripleo | 21:12 | |
panda | EmilienM: bnemec: https://bugs.launchpad.net/tripleo/+bug/1657173/comments/2 | 21:13 |
openstack | Launchpad bug 1657173 in tripleo "sshd failing to start on undercloud" [High,Triaged] | 21:13 |
mwhahaha | hmm i'm getting an introspection failure on a fresh install, do we have any open items around that? | 21:13 |
trown | jaosorior: thanks | 21:14 |
openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Semi-automatic doc generation of element dependency https://review.openstack.org/422874 | 21:14 |
EmilienM | mwhahaha: where exactly? | 21:15 |
EmilienM | do you see a mistral trace? | 21:15 |
jaosorior | trown: thanks dude :D | 21:15 |
*** absubram has joined #tripleo | 21:15 | |
mwhahaha | EmilienM: not yet, need to go looking. My local ovb deployment is currently hanging on introspection | 21:15 |
mwhahaha | EmilienM: i'm using the same process i always do (which follows our docs) | 21:15 |
EmilienM | panda: yes I think I'm fixing it with https://review.openstack.org/#/c/422146/ | 21:16 |
*** radeksmg has quit IRC | 21:16 | |
*** radeks has quit IRC | 21:16 | |
sshnaidm | jaosorior, I think get_host_info failed because "need tty", you don't have "-tt": ssh $SSH_OPTIONS centos@$EXTRA_NODE_IP sudo /tmp/get_host_info.sh | 21:16 |
EmilienM | panda: because the puppet profile in puppet-tripleo use hastatus parameter in the service resource, so it doesn't check resource "status" | 21:16 |
jaosorior | sshnaidm: I think you're right | 21:18 |
jaosorior | sshnaidm: I could submit a subsequent patch that does that log collection cleaner | 21:18 |
*** leanderthal has quit IRC | 21:18 | |
sshnaidm | jaosorior, but it doesn't explain why created archive tar.xz is broken | 21:18 |
jaosorior | sshnaidm: well, if get_host_info didn't get run cause of that issue, then the rest wold be empty | 21:19 |
jaosorior | sshnaidm: so the tar command would be trying to run against an emty tar and it would fail | 21:19 |
*** b00tcat has joined #tripleo | 21:19 | |
*** b00tcat has joined #tripleo | 21:19 | |
*** jkilpatr has quit IRC | 21:20 | |
sshnaidm | jaosorior, the tar command is independent, it runs like: ssh $SSH_OPTIONS -tt centos@$EXTRA_NODE_IP $TARCMD > .. | 21:21 |
*** crenguta has quit IRC | 21:24 | |
sshnaidm | jaosorior, ok, we can investigate it in next patches | 21:25 |
jeckersb | trown: i have something "fun" for you to be aware of | 21:26 |
jeckersb | (maybe you are already aware) | 21:26 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TESTING: Adding missing -tt https://review.openstack.org/422882 | 21:26 |
jaosorior | sshnaidm: ^^ trying it out there, if that works, I'll push that in a subsequent commit to the TLS patch | 21:26 |
jaosorior | sshnaidm: don't wanna touch the other testing patch to ease people reviewing the TLS-everywhere gate patch | 21:27 |
sshnaidm | jaosorior, sure | 21:27 |
jeckersb | trown: i consistently can't use quickstart because qemu-img is crashing out with SIGILL | 21:27 |
jeckersb | i think this is maybe a centos-only thing | 21:27 |
jeckersb | just curious if you've seen it | 21:27 |
jeckersb | well to be fair, not so much quickstart but just trying to do an overcloud deploy from the undercloud | 21:28 |
jeckersb | or if you start seeing it, come talk to me :) | 21:28 |
*** dprince has quit IRC | 21:28 | |
*** dprince has joined #tripleo | 21:28 | |
*** jayg is now known as jayg|g0n3 | 21:29 | |
*** jcoufal has quit IRC | 21:30 | |
*** jkilpatr has joined #tripleo | 21:34 | |
*** david-lyle has quit IRC | 21:35 | |
*** thrash is now known as thrash|g0ne | 21:37 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Make logs viewable with browser https://review.openstack.org/422638 | 21:39 |
trown | jeckersb: hmm, I have not seen anything like that | 21:39 |
trown | jeckersb: what is qemu-img doing? | 21:39 |
*** david-lyle has joined #tripleo | 21:39 | |
*** david-lyle has joined #tripleo | 21:39 | |
jeckersb | trown: ironic does "qemu-img convert" when trying to deploy the overcloud | 21:40 |
openstackgerrit | Merged openstack/tripleo-docs: OVS DPDK deployment documentation https://review.openstack.org/395431 | 21:40 |
jeckersb | and it just crashes out with SIGILL, something to do with intel AVX2 instructions as best as i can tell... | 21:40 |
jeckersb | even though i have that capability on both my hypervisor and undercloud | 21:40 |
*** milan has quit IRC | 21:40 | |
jeckersb | trown: this is with... qemu-img-ev-2.6.0-27.1.el7.x86_64 on the undercloud | 21:41 |
*** milan has joined #tripleo | 21:41 | |
jeckersb | i don't know if just that build is buggy or something | 21:41 |
jeckersb | i see in the changelog... http://cbs.centos.org/koji/buildinfo?buildID=13884 | 21:41 |
jeckersb | - kvm-target-i386-Add-more-Intel-AVX-512-instructions-supp.patch [bz#1372455] | 21:42 |
jeckersb | i'm thinking maybe that's when it broke | 21:42 |
jeckersb | note there is a separate qemu-ev repo that gets pulled in | 21:42 |
*** jkilpatr has quit IRC | 21:42 | |
jeckersb | in delorean-deps.repo - baseurl=http://mirror.centos.org/centos/7/virt/$basearch/kvm-common/ | 21:42 |
jeckersb | maybe this has only recently been added | 21:43 |
jeckersb | and before older versions of qemu-img were getting installed | 21:43 |
* jeckersb shrugs | 21:43 | |
jeckersb | i just don't see how i would be the only person hitting this | 21:43 |
jeckersb | so i suspect if nobody has seen it yet, maybe i'm just the first | 21:43 |
trown | jeckersb: interesting, I have definitely not seen that | 21:48 |
*** ansmith has quit IRC | 21:48 | |
*** shinobu__ has joined #tripleo | 21:50 | |
jeckersb | trown: when it happens you'll see the overcloud fail to deploy with some generic "not enough hosts" error, and in ironic-conductor.log you'll see an error that qemu-img failed with status -4 and no stdout/stderr | 21:50 |
jeckersb | trown: so be on the lookout ;) | 21:50 |
panda | jeckersb: and it happens every time ? | 21:51 |
jeckersb | panda: yep | 21:52 |
*** b00tcat` has joined #tripleo | 21:52 | |
jeckersb | panda: i can reproduce it by just running... | 21:52 |
*** iranzo has quit IRC | 21:52 | |
trown | jeckersb: hmm, we do get random generic nova errors like that in ci.centos, but it is in the 1/5 to 1/10 range not 10/10 | 21:52 |
jeckersb | [stack@undercloud ~]$ qemu-img convert -O raw overcloud-full.qcow2 overcloud-full.qcow2.converted | 21:52 |
jeckersb | Illegal instruction | 21:52 |
*** b00tcat has quit IRC | 21:52 | |
jeckersb | gdb shows it to be something with avx2 extensions | 21:53 |
jeckersb | https://paste.fedoraproject.org/531094/84862973/ | 21:56 |
jeckersb | this could maybe be a result of changing the way the vcpus get defined? | 21:59 |
jeckersb | if something has changed there recently | 21:59 |
jeckersb | although once again i wouldn't expect to be the first one to find it | 21:59 |
panda | oh, again with the wrong cpu flags ? :( | 22:00 |
jeckersb | well the weird thing is, it looks like the flags are correct | 22:00 |
jeckersb | [stack@undercloud ~]$ grep -o avx2 /proc/cpuinfo | 22:01 |
jeckersb | avx2 | 22:01 |
jeckersb | that should be sufficient iiuc | 22:01 |
panda | jeckersb: that could mean it's advertising a flag that is not really supported | 22:01 |
jeckersb | the qemu cmdline also has +avx2 | 22:02 |
jeckersb | and the hypervisor supports avx2 as well | 22:02 |
openstackgerrit | Andrey Shestakov proposed openstack/diskimage-builder: Add DIB_IPA_COMPRESS_CMD option https://review.openstack.org/416593 | 22:03 |
*** ccamacho has quit IRC | 22:05 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Adds etcd composable service https://review.openstack.org/414751 | 22:07 |
*** milan has quit IRC | 22:10 | |
*** milan has joined #tripleo | 22:11 | |
openstackgerrit | James Slagle proposed openstack/tripleo-docs: Add docs for using already deployed servers https://review.openstack.org/420369 | 22:11 |
openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates: Configure nova neutron parameter for L to M upgrade https://review.openstack.org/422837 | 22:11 |
jaosorior | bnemec: hey dude, if you get some time, this needs one more +2 https://review.openstack.org/#/c/391738/ :D | 22:17 |
*** jkilpatr has joined #tripleo | 22:17 | |
*** hafe has quit IRC | 22:18 | |
*** Goneri has quit IRC | 22:19 | |
*** jeckersb is now known as jeckersb_gone | 22:20 | |
*** ccamacho has joined #tripleo | 22:21 | |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use disable_contraints in custom roles data in CI https://review.openstack.org/410392 | 22:22 |
*** spredzy has joined #tripleo | 22:25 | |
*** trown is now known as trown|outtypewww | 22:25 | |
openstackgerrit | Feng Pan proposed openstack/tripleo-heat-templates: Allow dnsmasq_dns_servers to be configured for DHCP Agent https://review.openstack.org/422898 | 22:33 |
*** pmannidi has joined #tripleo | 22:37 | |
*** milan has quit IRC | 22:40 | |
*** milan has joined #tripleo | 22:41 | |
*** sdake_ has quit IRC | 22:44 | |
dmsimard | dprince, EmilienM: is there any job actually testing the container deployments (i.e, in https://review.openstack.org/#/c/416421/ ?) | 22:47 |
EmilienM | dmsimard: yes it's experimental now | 22:47 |
EmilienM | but it's moving to check -nv very soon | 22:47 |
EmilienM | this week | 22:47 |
dmsimard | so just "check experimental" and I'm good ? | 22:47 |
EmilienM | it should | 22:47 |
dmsimard | ok ty | 22:47 |
EmilienM | dmsimard: check zuul layout otherwise? | 22:48 |
dmsimard | EmilienM: well I saw a check experimental but | 22:48 |
dmsimard | "gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv" | 22:48 |
dmsimard | doesn't really tell me whether this is containerized or not | 22:48 |
EmilienM | it's not | 22:50 |
EmilienM | let me check, a sec | 22:50 |
EmilienM | I'm sure bkero knows more | 22:50 |
* EmilienM reading zuul layout | 22:50 | |
EmilienM | gate-tripleo-ci-centos-7-ovb-containers-oooq | 22:51 |
EmilienM | in experimental-tripleo-jobs | 22:51 |
EmilienM | so yeah, check experimental... | 22:51 |
dprince | dmsimard: I'll be working on the undercloud installer job for this soon | 22:51 |
dmsimard | EmilienM: well I ctrl+f'd the console log and there's several mentions of docker :P | 22:51 |
dprince | dmsimard: we are iterating right now to get a fully working undercloud with this setup | 22:51 |
openstackgerrit | David Moreau Simard proposed openstack/tripleo-heat-templates: Do not merge: test rdoproject docker images https://review.openstack.org/422905 | 22:52 |
dmsimard | dprince: ok, fyi ^ | 22:52 |
jaosorior | bnemec: thanks for the review dude | 22:55 |
jaosorior | and also for all the help with the stuff related to that patch | 22:55 |
bnemec | jaosorior: np. I'm just glad I didn't have to do it. :-) | 22:57 |
jaosorior | lol | 22:57 |
*** owalsh has joined #tripleo | 22:58 | |
*** jmelvin has quit IRC | 23:00 | |
*** david-lyle has quit IRC | 23:03 | |
*** absubram has quit IRC | 23:05 | |
EmilienM | dmsimard: you need to check experimental | 23:06 |
dmsimard | forgot, thanks | 23:06 |
*** absubram has joined #tripleo | 23:09 | |
*** milan has quit IRC | 23:10 | |
*** b00tcat` has quit IRC | 23:11 | |
bnemec | https://review.openstack.org/#/c/422785/ passed ci | 23:11 |
*** milan has joined #tripleo | 23:11 | |
bnemec | And will save a bunch of time in ha and updates jobs. | 23:11 |
jaosorior | bnemec: aw, it conflicts with the tls job :( | 23:12 |
*** [1]cdearborn has quit IRC | 23:12 | |
*** flepied has joined #tripleo | 23:13 | |
bnemec | Yeah, it conflicts with a bunch of my stuff too. | 23:13 |
bnemec | But on the plus side, the rebases will finish ci faster. :-) | 23:13 |
jaosorior | being in patch 103 makes one very desperate | 23:13 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras: Collect lgos for container only if docker runs https://review.openstack.org/422909 | 23:17 |
EmilienM | bnemec, slagle_: I noticed gate-tripleo-ci-centos-7-3nodes-multinode has been red for some days | 23:18 |
bnemec | Given the ugly merge conflict situation, https://review.openstack.org/#/c/422785 and https://review.openstack.org/#/c/422795 should merge together if we can manage it. | 23:18 |
bnemec | EmilienM: If it doesn't have ovb in the name I haven't been paying attention. ;-) | 23:18 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras: Collect logs for containers only if docker runs https://review.openstack.org/422909 | 23:19 |
EmilienM | bnemec: ... | 23:19 |
EmilienM | sound slike it broke 3 days ago | 23:19 |
EmilienM | bnemec: it sounds like a promotion might have broken it | 23:22 |
EmilienM | rpm diff shows a lot of diff in openstack packages | 23:22 |
*** ccamacho has quit IRC | 23:22 | |
*** absubram has quit IRC | 23:23 | |
bnemec | Yeah, we've promoted at least a couple of times since then. | 23:23 |
*** rlandy has quit IRC | 23:24 | |
EmilienM | ok I think I found why | 23:24 |
EmilienM | http://logs.openstack.org/46/422746/3/check/gate-tripleo-ci-centos-7-3nodes-multinode-nv/2706f15/logs/subnode-3/var/log/cinder/volume.txt.gz#_2017-01-19_21_55_26_729 | 23:25 |
EmilienM | it's when we removed glance registry | 23:25 |
jaosorior | bnemec: well, you have my +2s in both commits already. | 23:26 |
jaosorior | EmilienM: that's a funky error, how come we're ont seeing that on other jobs? | 23:27 |
EmilienM | jaosorior: i'm investigating :D | 23:27 |
EmilienM | but I don't see glance api logs anyuwhere | 23:27 |
bnemec | Looks like the current promote job is going to fail: http://logs.openstack.org/15/359215/40/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/c9a489e/logs/undercloud/var/log/undercloud_install.txt.gz#_2017-01-19_21_56_20_000 | 23:27 |
EmilienM | oh here http://logs.openstack.org/46/422746/3/check/gate-tripleo-ci-centos-7-3nodes-multinode-nv/2706f15/logs/subnode-2/var/log/glance/api.txt.gz | 23:27 |
bnemec | Or has failed, actually. | 23:27 |
EmilienM | bnemec: yeah puppet CI failed to promoted also | 23:27 |
EmilienM | something is broken with sahara | 23:28 |
bnemec | Oh, ours failed on gnocchi. | 23:28 |
EmilienM | pradk: ^ | 23:28 |
EmilienM | sshnaidm: btw when do we add scenarios to promotion pipeline? | 23:28 |
EmilienM | I hope sshnaidm sleep | 23:28 |
bnemec | I'm shocked that there are multiple problems at once. | 23:28 |
EmilienM | lol | 23:29 |
EmilienM | stop trolling! | 23:29 |
sshnaidm | EmilienM, it's in todo list, the sleep is too :) | 23:29 |
sshnaidm | EmilienM, will try it in Sun next week | 23:29 |
EmilienM | go sleep first | 23:29 |
EmilienM | bnemec: btw, tomorrow I'm on PTO | 23:29 |
EmilienM | bnemec: i'll redirect all the irc pings to you, I have a script | 23:30 |
bnemec | EmilienM: A likely story. :-P | 23:30 |
EmilienM | WHAT? i never take pto ! | 23:30 |
bnemec | There's a reason I've never run for PTL of any project I've ever worked on. | 23:30 |
EmilienM | I'll me 3500 feets in the air trying to not crash my cessna | 23:30 |
EmilienM | s/me/be/ | 23:31 |
bnemec | EmilienM: I think you just want to ignore IRC so you can actually get work done. ;-) | 23:31 |
EmilienM | :D | 23:31 |
EmilienM | ok I found the fix for the 3node jobs | 23:32 |
openstackgerrit | Alexander Chuzhoy proposed openstack/tripleo-docs: Reconfigure ironic in already delpoyed overcloud to erase only the metadata, instead of the entire disk. https://review.openstack.org/422033 | 23:32 |
bnemec | EmilienM: Also, I would like to formally request that you not crash. | 23:32 |
bnemec | I feel like we had that same error when we removed it in the other jobs. | 23:33 |
bnemec | The "# remove it https://review.openstack.org/#/c/417109 is merged." bit? | 23:33 |
EmilienM | bnemec: i won't, I'll be with my instructor this time | 23:33 |
EmilienM | bnemec: doing my second cross country flight | 23:33 |
*** milan has quit IRC | 23:33 | |
bnemec | EmilienM: Nice. You'll have to fly down and visit sometime. :-) | 23:34 |
EmilienM | I'll need to refuel 5 or 6 times I guess | 23:34 |
bnemec | Bah, it's not that far from Canada to Minnesota. | 23:35 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: multinode: remove 417109 workaround https://review.openstack.org/422913 | 23:36 |
EmilienM | ok this patch is not going to fix but cleanup | 23:36 |
EmilienM | I have another one to fix | 23:36 |
*** flepied has quit IRC | 23:36 | |
EmilienM | I would like to thank slagle_ | 23:37 |
EmilienM | I found a bug thanks to his CI job 3node | 23:37 |
EmilienM | slagle_: when you separate cinder-api and cinder-volume, you need glance parameters, cinder-volume use it for boot ffrom volume | 23:37 |
EmilienM | and until now we never saw it until this 3nodes job | 23:37 |
jaosorior | EmilienM: have a good flight dude! | 23:38 |
* EmilienM sends kudos | 23:38 | |
jaosorior | I gotta go | 23:38 |
EmilienM | jaosorior: peace | 23:38 |
jaosorior | good day everyone | 23:38 |
*** jaosorior has quit IRC | 23:38 | |
*** sanagikoki has quit IRC | 23:39 | |
* bnemec needs to go too | 23:41 | |
bnemec | EmilienM: Have a good long weekend. | 23:41 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: cinder: move glance params into common https://review.openstack.org/422915 | 23:41 |
EmilienM | bnemec: o/ | 23:41 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: cinder: move glance params into base https://review.openstack.org/422916 | 23:42 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: cinder: move glance params into common https://review.openstack.org/422915 | 23:43 |
*** dmacpher has quit IRC | 23:43 | |
EmilienM | ok these 2 patches should fix the 3node job | 23:43 |
*** panda is now known as panda|Zz | 23:44 | |
panda|Zz | sshnaidm: I think we're good with https://review.openstack.org/421272, tempest was running for 1 hour (remapped tempest oooq to gate-tripleo-ci-centos-7-ovb-nonha ) | 23:47 |
*** pradk has quit IRC | 23:49 | |
sshnaidm | panda|Zz, yeah, seems good | 23:49 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-puppet-elements: Remove carbonara package reference https://review.openstack.org/422920 | 23:50 |
*** pradk has joined #tripleo | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!