openstackgerrit | Radomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable all horizon plugins by default https://review.openstack.org/514421 | 00:00 |
---|---|---|
openstackgerrit | Merged openstack/tripleo-ui master: Refactor MistralApiService to thunks https://review.openstack.org/506664 | 00:03 |
*** gvrangan has joined #tripleo | 00:05 | |
*** trown is now known as trown|outtypewww | 00:05 | |
openstackgerrit | Merged openstack/tripleo-ui master: Refactor HeatApiService to thunks https://review.openstack.org/506665 | 00:05 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 00:09 |
*** ooolpbot has joined #tripleo | 00:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 00:10 |
*** ooolpbot has quit IRC | 00:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 00:10 |
*** pmannidi has joined #tripleo | 00:10 | |
*** leitan has quit IRC | 00:12 | |
*** gvrangan has quit IRC | 00:13 | |
*** bobh has joined #tripleo | 00:15 | |
*** bfournie has joined #tripleo | 00:15 | |
*** gvrangan has joined #tripleo | 00:17 | |
*** rcernin has joined #tripleo | 00:19 | |
*** rcernin has quit IRC | 00:23 | |
*** rcernin has joined #tripleo | 00:24 | |
*** bobh has quit IRC | 00:28 | |
*** chlong|lnch has quit IRC | 00:38 | |
*** newmember has quit IRC | 00:42 | |
*** chlong|lnch has joined #tripleo | 00:44 | |
*** chlong|lnch has quit IRC | 00:48 | |
*** psahoo has joined #tripleo | 00:50 | |
*** artom_ has joined #tripleo | 00:56 | |
*** pkovar has quit IRC | 00:56 | |
*** stee_3_ has quit IRC | 00:58 | |
*** bnemec has quit IRC | 00:58 | |
*** ipsecguy has quit IRC | 00:58 | |
*** ansmith has quit IRC | 00:58 | |
*** gvrangan has quit IRC | 00:58 | |
*** artom has quit IRC | 00:59 | |
*** stee_3 has joined #tripleo | 00:59 | |
*** gvrangan has joined #tripleo | 00:59 | |
*** ipsecguy has joined #tripleo | 00:59 | |
*** bnemec has joined #tripleo | 00:59 | |
*** chlong|lnch has joined #tripleo | 01:00 | |
*** ansmith has joined #tripleo | 01:00 | |
*** jpena|off has quit IRC | 01:00 | |
*** eck` has quit IRC | 01:03 | |
*** amoralej|off has quit IRC | 01:04 | |
*** radez has quit IRC | 01:04 | |
*** dalvarez has quit IRC | 01:04 | |
*** radez has joined #tripleo | 01:05 | |
*** dalvarez has joined #tripleo | 01:06 | |
*** eck`gone has joined #tripleo | 01:06 | |
*** jpena|off has joined #tripleo | 01:06 | |
*** chlong_ has joined #tripleo | 01:07 | |
*** chlong|lnch has quit IRC | 01:08 | |
*** amoralej has joined #tripleo | 01:08 | |
*** bkopilov has joined #tripleo | 01:09 | |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 01:10 |
*** jpena|off has quit IRC | 01:11 | |
*** eck`gone has quit IRC | 01:11 | |
*** radez has quit IRC | 01:12 | |
*** dalvarez has quit IRC | 01:12 | |
*** amoralej has quit IRC | 01:13 | |
*** ansiwen[q] has quit IRC | 01:13 | |
*** vkhanna has quit IRC | 01:13 | |
*** gvrangan has quit IRC | 01:17 | |
*** noslzzp has quit IRC | 01:17 | |
*** chlong_ has quit IRC | 01:18 | |
*** noslzzp has joined #tripleo | 01:18 | |
*** dalvarez has joined #tripleo | 01:20 | |
*** radez has joined #tripleo | 01:20 | |
*** eck` has joined #tripleo | 01:20 | |
*** vkhanna has joined #tripleo | 01:20 | |
*** jpena|off has joined #tripleo | 01:20 | |
*** amoralej has joined #tripleo | 01:20 | |
*** gvrangan has joined #tripleo | 01:20 | |
*** ansiwen[q] has joined #tripleo | 01:21 | |
*** bkopilov_ has joined #tripleo | 01:22 | |
*** fzdarsky_ has joined #tripleo | 01:23 | |
*** bkopilov has quit IRC | 01:24 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 01:25 |
*** fzdarsky|afk has quit IRC | 01:27 | |
*** leitan has joined #tripleo | 01:29 | |
*** rcernin has quit IRC | 01:32 | |
*** gvrangan has quit IRC | 01:32 | |
*** rcernin has joined #tripleo | 01:32 | |
*** rcernin has quit IRC | 01:33 | |
*** leitan has quit IRC | 01:33 | |
*** eck` is now known as eck`gone | 01:35 | |
*** chlong_ has joined #tripleo | 01:36 | |
*** gvrangan has joined #tripleo | 01:37 | |
*** psachin has joined #tripleo | 01:37 | |
openstackgerrit | Radomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable all horizon plugins by default https://review.openstack.org/514421 | 01:38 |
*** gvrangan_odl has joined #tripleo | 01:39 | |
*** gvrangan__odl has joined #tripleo | 01:41 | |
*** gvrangan has quit IRC | 01:42 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 01:43 |
*** gvrangan_odl has quit IRC | 01:44 | |
*** rlandy has quit IRC | 01:46 | |
*** rbrady-afk has quit IRC | 01:47 | |
*** itlinux has joined #tripleo | 01:53 | |
*** rcernin has joined #tripleo | 01:55 | |
*** gvrangan_odl has joined #tripleo | 01:59 | |
openstackgerrit | Steve Baker proposed openstack/python-tripleoclient master: Autodetect insecure registry in container image prepare https://review.openstack.org/514473 | 02:00 |
*** gvrangan__odl has quit IRC | 02:02 | |
*** rbrady-afk has joined #tripleo | 02:02 | |
*** chlong_ has quit IRC | 02:09 | |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 02:10 |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
*** bobh has joined #tripleo | 02:10 | |
*** dalvarez has quit IRC | 02:12 | |
*** eck`gone has quit IRC | 02:12 | |
*** radez has quit IRC | 02:12 | |
*** amoralej has quit IRC | 02:12 | |
*** jpena|off has quit IRC | 02:12 | |
*** itlinux has quit IRC | 02:15 | |
*** eck`gone has joined #tripleo | 02:15 | |
*** bobh has quit IRC | 02:15 | |
*** itlinux has joined #tripleo | 02:16 | |
*** bkopilov_ has quit IRC | 02:16 | |
openstackgerrit | Sai Ram Peesapati proposed openstack/tripleo-heat-templates stable/newton: Include Lbaas agent in newton https://review.openstack.org/514887 | 02:24 |
*** dalvarez has joined #tripleo | 02:30 | |
*** ramishra has joined #tripleo | 02:44 | |
*** chlong_ has joined #tripleo | 02:50 | |
*** gvrangan_odl has quit IRC | 02:52 | |
openstackgerrit | Merged openstack/instack-undercloud master: Remove Pike-only migration step https://review.openstack.org/512584 | 02:54 |
EmilienM | pabelanger: why jobs are reset in gate when one is failing on top? | 02:59 |
*** daidv has joined #tripleo | 02:59 | |
*** itlinux has quit IRC | 03:00 | |
pabelanger | EmilienM: because gate is a dependent pipeline. Which means, the jobs behind the failed job are also running that code, so zuul kicks out the failed patch, and all dependent jobs reparent and start testing again | 03:06 |
pabelanger | (minus bad patch) | 03:07 |
*** yamahata has quit IRC | 03:08 | |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 03:10 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Always pass docker-ha env when passing docker env https://review.openstack.org/509605 | 03:14 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove rsync from xinetd when upgrading to containerized deployment https://review.openstack.org/505606 | 03:14 |
*** achadha has joined #tripleo | 03:28 | |
*** achadha has quit IRC | 03:28 | |
*** achadha has joined #tripleo | 03:28 | |
*** shreshtha has joined #tripleo | 03:31 | |
EmilienM | pabelanger: ok | 03:35 |
*** fragatina has quit IRC | 03:35 | |
*** fragatina has joined #tripleo | 03:36 | |
*** bkopilov_ has joined #tripleo | 03:36 | |
*** fragatin_ has joined #tripleo | 03:37 | |
*** gkadam has joined #tripleo | 03:38 | |
*** fragatina has quit IRC | 03:40 | |
*** fragatin_ has quit IRC | 03:41 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move to a common lock-file directory https://review.openstack.org/514079 | 03:49 |
*** achadha has quit IRC | 03:51 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move to a common lock-file directory https://review.openstack.org/514079 | 03:55 |
*** mdnadeem has joined #tripleo | 03:59 | |
*** radez has joined #tripleo | 04:00 | |
*** yamahata has joined #tripleo | 04:01 | |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 04:10 |
*** ykarel|away has joined #tripleo | 04:16 | |
*** skramaja has joined #tripleo | 04:19 | |
bandini | morning | 04:20 |
*** rcernin has quit IRC | 04:21 | |
jaosorior | good morning | 04:24 |
jaosorior | bandini: daaamn you're early | 04:24 |
bandini | jaosorior: yo! yeah :) | 04:25 |
jaosorior | bandini: need any reviews? | 04:26 |
jaosorior | now that I just got my morning coffee and everything? :D | 04:26 |
*** pradk has quit IRC | 04:27 | |
bandini | jaosorior: eheh lemme check, I think I am mostly waiting on CI loving me | 04:28 |
jaosorior | bandini: CI loves no-one; it's a cruel mistress | 04:28 |
bandini | ahahah | 04:29 |
bandini | jaosorior: maybe this one https://review.openstack.org/#/c/514706/ just so that I can +A once CI passes | 04:29 |
bandini | it is needed for https://etherpad.openstack.org/p/tripleo-puppet-error-recap | 04:30 |
jaosorior | ok | 04:30 |
*** gvrangan_odl has joined #tripleo | 04:30 | |
jaosorior | bandini: aaand the gate queue is brutal :/ | 04:35 |
jaosorior | some commits were waiting for 17 hours | 04:35 |
*** rbrady-afk has quit IRC | 04:36 | |
*** rbrady-afk has joined #tripleo | 04:36 | |
openstackgerrit | Merged openstack/tripleo-common master: Adds --overcloud-user option to upgrade-non-controller.sh https://review.openstack.org/512638 | 04:37 |
openstackgerrit | Merged openstack/tripleo-common master: Get a static inventory for upgrade-non-controller ansible runs https://review.openstack.org/512999 | 04:37 |
openstackgerrit | Merged openstack/tripleo-common master: Remove references to the current task from task() in validations.yaml https://review.openstack.org/513676 | 04:37 |
Tengu | hello jaosorior . you're earlier than me today ;) | 04:42 |
Tengu | hello bandini :]. | 04:42 |
Tengu | oh. all is green \o/ https://review.openstack.org/#/c/513274/ anyone for some +2 and so on? Had to rebase against master due to some merge conflict yesterday :( | 04:43 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 04:43 |
*** rcernin has joined #tripleo | 04:45 | |
*** pradk has joined #tripleo | 04:47 | |
Tengu | thank you jaosorior :) | 04:47 |
Tengu | hopefully no merge conflict once it's at the end of the process. | 04:47 |
*** masco has joined #tripleo | 04:52 | |
*** udesale has joined #tripleo | 04:54 | |
*** tzumainn has quit IRC | 04:55 | |
*** pdeore has joined #tripleo | 04:55 | |
*** ratailor has joined #tripleo | 04:59 | |
*** dparkes has quit IRC | 05:00 | |
jaosorior | pradk: still around? | 05:03 |
*** janki has joined #tripleo | 05:05 | |
*** gvrangan_odl has quit IRC | 05:06 | |
*** ykarel|away has quit IRC | 05:06 | |
*** jaosorior has quit IRC | 05:07 | |
*** fragatina has joined #tripleo | 05:08 | |
*** chlong_ has quit IRC | 05:09 | |
*** fragatina has quit IRC | 05:09 | |
*** fragatina has joined #tripleo | 05:10 | |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 05:10 |
*** jprovazn has joined #tripleo | 05:15 | |
*** dparkes has joined #tripleo | 05:16 | |
*** dparkes has quit IRC | 05:20 | |
*** ykarel|away has joined #tripleo | 05:23 | |
*** jaosorior has joined #tripleo | 05:23 | |
jaosorior | mandre: hey! solved it! | 05:26 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for keystone containers to log to stdout/stderr https://review.openstack.org/508517 | 05:27 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Glance API containers to log to stdout/stderr https://review.openstack.org/510411 | 05:27 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova containers to log to stdout/stderr https://review.openstack.org/509157 | 05:28 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove log-dir option from neutron-dhcp execution https://review.openstack.org/510463 | 05:28 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Neutron containers to log to stdout/stderr https://review.openstack.org/510464 | 05:28 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr https://review.openstack.org/510537 | 05:28 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova https://review.openstack.org/510561 | 05:28 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova-libvirt container to log to stdout/stderr https://review.openstack.org/510562 | 05:28 |
Tengu | :] | 05:32 |
*** cshastri has joined #tripleo | 05:33 | |
*** ludovic has joined #tripleo | 05:34 | |
ludovic | Good evening everybody from Paris | 05:36 |
jaosorior | good morning! | 05:36 |
ludovic | yes it's a joke , good morning of course | 05:37 |
jaosorior | lol no worries, it was understood :P | 05:37 |
Tengu | :] | 05:39 |
ludovic | I just arrived at work, and i'm trying to debug my update deployment of tripleo :-( | 05:39 |
Tengu | ludovic: btw, if you prefer some French speaking, I'm from Switzerland. the French part. but as said yesterday, I'm affraid I can't do more, even in French :/ | 05:40 |
jaosorior | why would you want to do that to your morning? | 05:40 |
jaosorior | :P | 05:40 |
jaosorior | what's the issue? | 05:40 |
ludovic | It was running but since few days it's broken after modifications of my IP range | 05:40 |
jaosorior | uhm | 05:40 |
jaosorior | ludovic: for networking the best folks to ask are in the States unfortunately :/ might wanna poke dsneddon or beagles | 05:41 |
jaosorior | ludovic: of course, you could just write what the issue is here and maybe someone might know how to fix it. | 05:42 |
*** kbyrne has quit IRC | 05:42 | |
*** kbyrne has joined #tripleo | 05:45 | |
*** suuuper has joined #tripleo | 05:46 | |
*** achadha has joined #tripleo | 05:51 | |
*** agurenko has joined #tripleo | 05:51 | |
*** gvrangan has joined #tripleo | 05:54 | |
*** iranzo has joined #tripleo | 05:55 | |
*** iranzo has joined #tripleo | 05:55 | |
*** achadha has quit IRC | 05:56 | |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 06:00 |
*** dparkes has joined #tripleo | 06:02 | |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 06:10 |
*** yolanda_ has joined #tripleo | 06:12 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova containers to log to stdout/stderr https://review.openstack.org/509157 | 06:12 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove log-dir option from neutron-dhcp execution https://review.openstack.org/510463 | 06:12 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Neutron containers to log to stdout/stderr https://review.openstack.org/510464 | 06:12 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr https://review.openstack.org/510537 | 06:12 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova https://review.openstack.org/510561 | 06:12 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova-libvirt container to log to stdout/stderr https://review.openstack.org/510562 | 06:12 |
*** jchhatbar has joined #tripleo | 06:27 | |
*** akane has joined #tripleo | 06:29 | |
*** janki has quit IRC | 06:29 | |
openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: Allow multiple stonith declarations in one manifest https://review.openstack.org/514252 | 06:35 |
openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: Use resource collectors for ordering in stonith manifests https://review.openstack.org/514266 | 06:35 |
*** tosky has joined #tripleo | 06:36 | |
*** pcaruana has joined #tripleo | 06:39 | |
*** yolanda_ has quit IRC | 06:40 | |
*** ykarel|away is now known as ykarel | 06:40 | |
*** agurenko has quit IRC | 06:42 | |
*** rodolof has joined #tripleo | 06:43 | |
*** jchhatbar is now known as janki | 06:47 | |
*** agurenko has joined #tripleo | 06:48 | |
*** gfidente has joined #tripleo | 06:50 | |
*** gfidente has quit IRC | 06:50 | |
*** gfidente has joined #tripleo | 06:50 | |
*** cylopez has joined #tripleo | 06:51 | |
*** florianf has joined #tripleo | 06:52 | |
*** tesseract has joined #tripleo | 06:54 | |
*** abregman has joined #tripleo | 06:54 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui stable/pike: Imported Translations from Zanata https://review.openstack.org/514533 | 06:55 |
*** ebarrera has joined #tripleo | 06:59 | |
*** jlinkes has joined #tripleo | 06:59 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Update CephPools format in the docker templates to fit ceph-ansible https://review.openstack.org/508859 | 07:00 |
*** pgadiya has joined #tripleo | 07:02 | |
*** cmyster_ has joined #tripleo | 07:04 | |
*** cmyster has quit IRC | 07:05 | |
*** cmyster_ is now known as cmyster | 07:05 | |
*** cmyster has joined #tripleo | 07:05 | |
*** oidgar has joined #tripleo | 07:06 | |
*** namnh has joined #tripleo | 07:06 | |
*** rodolof has quit IRC | 07:07 | |
namnh | lyarwood: i should bring my message to this chanel | 07:07 |
namnh | lyarwood: hi lee, are you free?. could i ask you a question. i saw you have a spec in tripleo about fast-forward-upgrade. Basically, in my inderstanding, FFU in tripleo is offline-upgrade automatically (roles ansible will do this) instead of manual, is that right? | 07:07 |
*** rodolof has joined #tripleo | 07:08 | |
*** jtomasek has joined #tripleo | 07:09 | |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 07:10 |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
*** spectr has joined #tripleo | 07:13 | |
*** yprokule has joined #tripleo | 07:21 | |
janki | bcafarel, hey | 07:23 |
*** ffiore has joined #tripleo | 07:23 | |
*** athomas has joined #tripleo | 07:27 | |
*** shreshtha has quit IRC | 07:28 | |
*** marios has joined #tripleo | 07:31 | |
*** jfrancoa has joined #tripleo | 07:31 | |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Speed up deployment by reusing facts https://review.openstack.org/514945 | 07:32 |
jaosorior | d0ugal: hey, could you check this out https://review.openstack.org/#/c/514543/ ? | 07:33 |
*** anshul has joined #tripleo | 07:34 | |
*** yolanda_ has joined #tripleo | 07:42 | |
*** yolanda_ is now known as yolanda | 07:43 | |
jistr|mtgs | jaosorior: lgtm ^^. Didn't +A just yet in case d0ugal is looking too | 07:45 |
*** amoralej has joined #tripleo | 07:45 | |
*** jpena has joined #tripleo | 07:46 | |
jistr|mtgs | i want to carve out some time to review the next log patches too but they're fairly large and i only have chunks of time during this week | 07:46 |
jaosorior | jistr|mtgs: if you have a bit of time today | 07:50 |
jaosorior | I could show you the resulting deployment | 07:50 |
jaosorior | jistr|mtgs, mandre: Actually, I have a deployment now if you guys wanna take a look | 07:53 |
*** ykarel is now known as ykarel|lunch | 07:53 | |
*** ffiore has quit IRC | 07:54 | |
*** Goneri has joined #tripleo | 07:54 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for keystone containers to log to stdout/stderr https://review.openstack.org/508517 | 07:54 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Glance API containers to log to stdout/stderr https://review.openstack.org/510411 | 07:54 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova containers to log to stdout/stderr https://review.openstack.org/509157 | 07:54 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove log-dir option from neutron-dhcp execution https://review.openstack.org/510463 | 07:54 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Neutron containers to log to stdout/stderr https://review.openstack.org/510464 | 07:54 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr https://review.openstack.org/510537 | 07:54 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova https://review.openstack.org/510561 | 07:54 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova-libvirt container to log to stdout/stderr https://review.openstack.org/510562 | 07:54 |
*** ffiore has joined #tripleo | 07:54 | |
jaosorior | jistr|mtgs, mandre ^^ but anyway, there's the code. Added relevant healthchecks for the side-car containers and made them a bit more robust and fixed some descriptions. | 07:55 |
openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates master: Env files for ODL deployments https://review.openstack.org/512501 | 07:55 |
*** achadha has joined #tripleo | 07:59 | |
*** achadha has quit IRC | 07:59 | |
*** achadha has joined #tripleo | 08:00 | |
*** ccamacho has joined #tripleo | 08:00 | |
*** achadha_ has joined #tripleo | 08:04 | |
*** achadha has quit IRC | 08:05 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-common stable/pike: Adds --overcloud-user option to upgrade-non-controller.sh https://review.openstack.org/514950 | 08:07 |
lyarwood | namnh: yeah correct, APIs are down, workloads are up, driven by Ansible. | 08:07 |
ccamacho | Hey folks morning! | 08:07 |
ccamacho | quick question, we have a bug fix for puppet-glance https://review.openstack.org/#/c/513403/ failing on some jobs | 08:07 |
ccamacho | This is the current error: http://logs.openstack.org/03/513403/4/check/puppet-openstack-integration-4-scenario001-tempest-ubuntu-xenial/b55f0cc/job-output.txt.gz#_2017-10-23_12_24_54_144540 | 08:07 |
ccamacho | here: u'message': u'Unable to associate floating IP 172.24.5.19 to fixed IP 10.100.0.8 for instance 64e2ee9a-4c12-48f4-8d74-9d17238ffd5a. Error: Request to https://127.0.0.1:9696/v2.0/ports?tenant_id=7829e38698b745208f98b9a040afac23&device_id=64e2ee9a-4c12-48f4-8d74-9d17238ffd5a timed out', | 08:07 |
ccamacho | do you know anyone I can reach to check why this is failing? | 08:07 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-common stable/pike: Get a static inventory for upgrade-non-controller ansible runs https://review.openstack.org/514951 | 08:09 |
*** cmyster has quit IRC | 08:10 | |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 08:10 |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
*** morazi has joined #tripleo | 08:10 | |
*** fzdarsky_ has quit IRC | 08:13 | |
jaosorior | jistr|mtgs: soo... you available for a quick call? | 08:15 |
*** paramite has joined #tripleo | 08:17 | |
*** dbecker has joined #tripleo | 08:18 | |
*** dsariel has joined #tripleo | 08:19 | |
*** bcafarel has quit IRC | 08:20 | |
*** aufi has joined #tripleo | 08:20 | |
*** namnh_ has joined #tripleo | 08:21 | |
*** bcafarel has joined #tripleo | 08:21 | |
*** namnh has quit IRC | 08:23 | |
ccamacho | amoralej https://review.openstack.org/#/c/513403/ | 08:25 |
*** stendulker has joined #tripleo | 08:27 | |
*** mcornea has joined #tripleo | 08:27 | |
jistr|mtgs | jaosorior: not now sorry | 08:28 |
jaosorior | jistr|mtgs: it's alright | 08:28 |
jaosorior | jistr|mtgs: just did a quick demo for mandre | 08:29 |
jaosorior | mandre: by the way, I tried running run.sh from the undercloud_containers repo and am getting this http://paste.openstack.org/show/624571/ any idea what it could be? | 08:30 |
*** tosky has quit IRC | 08:31 | |
*** cmyster has joined #tripleo | 08:31 | |
*** cmyster has quit IRC | 08:31 | |
*** cmyster has joined #tripleo | 08:31 | |
mandre | jaosorior: looks like you skipped https://github.com/dprince/undercloud_containers/blob/master/doit.sh#L254 | 08:31 |
bcafarel | janki: hi | 08:32 |
jaosorior | mandre: oh | 08:32 |
jaosorior | ok, will try it out | 08:32 |
janki | bcafarel, I have question about sfc env file in tripleo. I understand you are the author | 08:32 |
jaosorior | mandre: trying it again, thanks | 08:32 |
jaosorior | mandre: tried running it again, got this now: | 08:33 |
jaosorior | Changing the local_ip is not allowed. Existing IP: 192.168.25.106/24, Configured IP: 192.168.24.0/24 | 08:33 |
jaosorior | An error occurred during configuration validation, please check your host configuration and try again. | 08:34 |
jaosorior | Error message: Changing the local_ip is not allowed. Existing IP: 192.168.25.106/24, Configured IP: 192.168.24.0/24 | 08:34 |
*** lucas-afk is now known as lucasagomes | 08:34 | |
*** bogdando has joined #tripleo | 08:34 | |
mandre | jaosorior: yeah I got the same error, haven't yet looked into it | 08:35 |
jaosorior | alrighty | 08:35 |
bcafarel | janki: indeed, with trozet. Did it set your env on fire? | 08:35 |
janki | bcafarel, not exactly. I have a question about plugin extension https://github.com/openstack/tripleo-heat-templates/blob/master/environments/neutron-opendaylight.yaml#L15 | 08:39 |
janki | bcafarel, I am moving it to docker folder https://review.openstack.org/#/c/512501/4/environments/services-docker/neutron-opendaylight-sfc.yaml and was wondering if we need any specific plugin extension? | 08:40 |
jaosorior | bogdando: hey, updated the logging patches a bit, if you have time to take a look. Basically I fixed some descriptions, added better healthchecks for the sidecar containers and made the sidecontainer script a bit more robust. | 08:42 |
bogdando | jaosorior: ok will do | 08:42 |
bogdando | jaosorior: could you review https://review.openstack.org/#/c/513774/ ? | 08:43 |
bogdando | folks, let's merge please https://review.openstack.org/#/c/514560/ | 08:44 |
jaosorior | bogdando: I think there might be a bug in the symlink bit http://logs.openstack.org/74/513774/3/check/legacy-tripleo-ci-centos-7-undercloud-containers/a1fc621/job-output.txt.gz#_2017-10-24_09_30_49_052495 | 08:45 |
bogdando | jaosorior: that's odd, worked on my env :) | 08:45 |
bogdando | ah, indeed | 08:45 |
bcafarel | janki: great, container support was an open question when sfc support got merged | 08:45 |
bogdando | idempotency | 08:45 |
bcafarel | janki: that looks good, sfc+odl is just the service plugins in neutron-server and the odl part, no other parts | 08:46 |
jaosorior | bogdando: right, so the call to os.symlink fails if it's already there, right? | 08:46 |
bogdando | seems so | 08:46 |
*** derekh has joined #tripleo | 08:46 | |
janki | bcafarel, cool, can you review it too? | 08:47 |
janki | bcafarel, its not containarising the service, but moving it under correct path | 08:47 |
openstackgerrit | Radomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable all horizon plugins by default https://review.openstack.org/514421 | 08:47 |
* Tengu needs a second +2 on this review : https://review.openstack.org/#/c/513274/ EmilienM mwhahaha or anyone else with that power ? :) | 08:49 | |
bcafarel | janki: sure, taking a look | 08:49 |
janki | bcafarel, thanks | 08:49 |
openstackgerrit | Merged openstack/tripleo-docs master: Update containerized undercloud deployment guide https://review.openstack.org/513083 | 08:50 |
*** marios has quit IRC | 08:50 | |
*** namnh has joined #tripleo | 08:51 | |
*** namnh_ has quit IRC | 08:53 | |
*** marios has joined #tripleo | 08:53 | |
*** ykarel|lunch is now known as ykarel | 08:56 | |
*** tosky has joined #tripleo | 08:57 | |
*** yamahata has quit IRC | 08:58 | |
*** pmannidi has quit IRC | 08:59 | |
*** rcernin has quit IRC | 08:59 | |
*** hewbrocca_afk is now known as hewbrocca | 09:00 | |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in ceph-ansible.yaml https://review.openstack.org/513692 | 09:02 |
*** achadha_ has quit IRC | 09:02 | |
*** achadha has joined #tripleo | 09:03 | |
*** achadha has quit IRC | 09:03 | |
*** achadha_ has joined #tripleo | 09:03 | |
*** achadha_ has quit IRC | 09:03 | |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 09:10 |
*** salmankhan has joined #tripleo | 09:11 | |
openstackgerrit | Adriano Petrich proposed openstack/tripleo-common master: Validate parameters before updating https://review.openstack.org/511249 | 09:15 |
*** anshul has quit IRC | 09:18 | |
*** jpena is now known as jpena|off | 09:20 | |
*** jpena|off is now known as jpena | 09:21 | |
*** anshul has joined #tripleo | 09:22 | |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Fix static-inventory option for minor update https://review.openstack.org/514975 | 09:23 |
jaosorior | dciabrin: what were the log files that mysql outputs? | 09:31 |
dciabrin | jaosorior, /var/log/mariadb.log, var/log/mysqld.log and rsyncd currently logs into the journal | 09:32 |
jaosorior | dciabrin: does mysql currently log anything to syslog? | 09:33 |
dciabrin | jaosorior, nope | 09:33 |
jaosorior | cool cool | 09:33 |
dciabrin | jaosorior, if you override env var WSREP_LOG_DIR in the mariadb container you might succeed diverting the rsyncd log into a log file rather than the journal | 09:34 |
dciabrin | jaosorior, look at /usr/bin/wsrep_sst_rsync for more details | 09:34 |
jaosorior | dciabrin: excellent. | 09:35 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Remove /dev/log mounting from mysql bundle resource https://review.openstack.org/514986 | 09:35 |
jaosorior | will do | 09:35 |
jaosorior | dciabrin: meanwhile I did that ^^ | 09:35 |
*** rodolof has quit IRC | 09:35 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Remove /dev/log mounting from mysql bundle resource https://review.openstack.org/514986 | 09:36 |
*** psahoo has quit IRC | 09:38 | |
jistr|mtgs | bogdando: hi, would you have some time to give another look to https://review.openstack.org/#/c/511272/ ? aside from removing the mistral tasks completely, the changes since your last vote are fairly minimal | 09:38 |
jistr|mtgs | i think the reviews have been addressed either in that patch directly, or in follow up ones | 09:39 |
jistr|mtgs | would be nice to land this so that we can start iterating on the improvements in smaller patches, to prevent reviewer (and submitter ;) ) fatigue | 09:39 |
jistr|mtgs | jaosorior: re call, i think i'd be available only next week... but regarding the logging i'm totally on board with it, both the spec and the patches i've been able to review so far. | 09:43 |
jaosorior | jistr|mtgs: next week could work too :D hopefully I'll have more services implemented by then | 09:44 |
jaosorior | jistr|mtgs: but yeah, really need reviews, mostly for the keystone patch, which would unblock everything else https://review.openstack.org/#/c/508517/22 | 09:45 |
openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Added a new role definition for SR-IOV Compute role https://review.openstack.org/501999 | 09:46 |
*** ratailor is now known as rtailor | 09:47 | |
derekh | Can somebody take a look at this to enable some missing health checks please https://review.openstack.org/#/c/506125 | 09:49 |
dciabrin | jaosorior, hmmm, oh damned I wasn't clear. mysql doesn't log in the journal but pacemaker's resource agents do. so they need /dev/log : | 09:50 |
dciabrin | :( | 09:50 |
jaosorior | oh, ok | 09:50 |
jistr|mtgs | jaosorior: the changes since my last review are small, so i reviewed, +1'd and asked about the while loop | 09:50 |
dciabrin | jaosorior, well let me double check if they also log in pacemaker files, I'll keep you posted | 09:50 |
jaosorior | jistr|mtgs: so, if we restart the main container (lets say keystone), it issues an EOF, which cat catches and then exists. using the while loop catches the exit and just keeps outputting from the fifo again, which eventually keystone will write to when it restarts. | 09:51 |
jaosorior | jistr|mtgs: it used to be that restarting keystone would result in restarting all the logging containers; with the addition of the while loop, this is not the case anymore. They just keep doing their job :) | 09:52 |
jistr|mtgs | jaosorior: right that makes sense, i just wonder if we should put `sleep 1` there to avoid the logging containers from consuming 100% CPU? I mean, the way i understand, if keystone is down, the cat would exit immediately and the logging containes would be busy waiting, right? | 09:54 |
*** fzdarsky has joined #tripleo | 09:55 | |
jaosorior | jistr|mtgs: cat wouldn't exit, opening the fifo blocks until someone starts writing on it; and vice-versa. | 09:56 |
jistr|mtgs | jaosorior: perfect, thanks, +2'd | 09:57 |
jaosorior | jistr|mtgs: yay thanks! | 10:00 |
openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Add missing puppet configuration to undercloud deploy https://review.openstack.org/513774 | 10:00 |
openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Add missing puppet configuration to undercloud deploy https://review.openstack.org/513774 | 10:01 |
openstackgerrit | Derek Higgins proposed openstack/tripleo-quickstart-extras master: WIP: Setup Ironic in Overcloud https://review.openstack.org/509728 | 10:01 |
*** stendulker is now known as stendulker_ | 10:04 | |
openstackgerrit | Derek Higgins proposed openstack/tripleo-heat-templates master: WIP: Add ironic config to scenario 004 https://review.openstack.org/485261 | 10:04 |
*** stendulker_ is now known as stendulker | 10:05 | |
*** stendulker has quit IRC | 10:06 | |
*** stendulker has joined #tripleo | 10:07 | |
namnh | lyarwood: thanks for your reply, i saw on a thread mailling-list which you created, there is a problem is that how to avoid stoping instances when upgrading nova-compute | 10:07 |
namnh | lyarwood: that is main problem we need to solve during FFU, right? | 10:09 |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 10:10 |
jistr|mtgs | bogdando: thanks for the review :) | 10:11 |
*** stendulker has quit IRC | 10:11 | |
lyarwood | namnh: well, the spec was written with the assumption that the env is using the libvirt virt driver for n-cpu | 10:11 |
*** stendulker has joined #tripleo | 10:11 | |
lyarwood | namnh: in which case instances don't need to be stopped during an n-cpu ffu upgrade | 10:11 |
lyarwood | namnh: assuming the node has been updated prior to the start of the ffu upgrade | 10:12 |
lyarwood | namnh: and obviously been rebooted if required to pull in new versions of the kernel, QEMU, OVS etc | 10:12 |
lyarwood | namnh: that's written up in the prereqs section | 10:12 |
lyarwood | namnh: stopping n-cpu and even libvirtd shouldn't impact the running instances in this case. | 10:13 |
*** udesale has quit IRC | 10:13 | |
*** fzdarsky has quit IRC | 10:16 | |
namnh | lyarwood: I got it. thank you. | 10:17 |
namnh | lyarwood: are you joining FFU section at sydney summit? | 10:18 |
lyarwood | namnh: no I'm not unfortunately | 10:23 |
*** pdeore has quit IRC | 10:23 | |
bogdando | jistr|mtgs, flaper87: thanks for contributing to Kubespray! :) | 10:24 |
*** skramaja has quit IRC | 10:25 | |
bandini | gfidente: is this one known http://logs.openstack.org/06/514706/1/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/95582b5/logs/undercloud/var/log/mistral/ceph-install-workflow.log.txt.gz#_2017-10-25_08_37_39_402 ? | 10:25 |
namnh | lyarwood: ack, i have to leave our office for now, see you later. | 10:27 |
bandini | gfidente: oh it is https://bugs.launchpad.net/tripleo/+bug/1725224 | 10:27 |
openstack | Launchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [High,In progress] - Assigned to Marius Cornea (mcornea) | 10:27 |
*** fzdarsky has joined #tripleo | 10:30 | |
*** pdeore has joined #tripleo | 10:30 | |
gfidente | bandini yean | 10:32 |
*** pcaruana has quit IRC | 10:37 | |
*** namnh has quit IRC | 10:38 | |
*** bkopilov_ has quit IRC | 10:42 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Do not rely on openstack-puppet-modules in Queens and beyond https://review.openstack.org/512783 | 10:43 |
openstackgerrit | Merged openstack/tripleo-quickstart master: Fix IP address for ssh-tunnel for UI https://review.openstack.org/511143 | 10:43 |
openstackgerrit | Radomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable all horizon plugins by default https://review.openstack.org/514421 | 10:45 |
*** chem has joined #tripleo | 10:46 | |
jaosorior | d0ugal, gfidente: How do I debug an error in resources.WorkflowTasks_Step2_Execution ? | 10:49 |
jaosorior | d0ugal, gfidente: It doesn't seem to output anything http://logs.openstack.org/57/509157/21/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/ab58ab0/logs/undercloud/var/log/postci.txt.gz | 10:49 |
d0ugal | jaosorior: I've never tried :) but I am curious to learn | 10:50 |
*** salmankhan has quit IRC | 10:50 | |
* d0ugal looks at logs | 10:50 | |
gfidente | jaosorior yeah it's https://bugs.launchpad.net/tripleo/+bug/1725224 | 10:50 |
openstack | Launchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Marius Cornea (mcornea) | 10:50 |
jaosorior | well shit | 10:50 |
gfidente | jaosorior you can check in mistral for the execution output | 10:50 |
gfidente | jaosorior or go to the mistral logs | 10:50 |
jaosorior | gfidente: I'm seeing that in master now | 10:50 |
gfidente | jaosorior yeah I know I flagged it critical but it's just that the newer version of ansible has a bug | 10:51 |
gfidente | and it doesn't use the ssh option passed with -o | 10:51 |
jaosorior | ok | 10:51 |
jaosorior | gfidente: thanks for the info | 10:51 |
gfidente | https://github.com/ansible/ansible/issues/30720 | 10:51 |
gfidente | the fix is setting the option as an env variable instead | 10:51 |
*** salmankhan has joined #tripleo | 10:51 | |
gfidente | https://review.openstack.org/#/c/513701/ | 10:52 |
gfidente | hopefully it gets merged quickly | 10:52 |
openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Add option to disable running mistral-api via wsgi https://review.openstack.org/514728 | 10:55 |
*** morazi has quit IRC | 10:57 | |
*** gfidente[m] has joined #tripleo | 10:58 | |
*** morazi has joined #tripleo | 10:59 | |
openstackgerrit | Adriano Petrich proposed openstack/tripleo-common master: Validate parameters before updating https://review.openstack.org/511249 | 11:00 |
*** ramishra has quit IRC | 11:00 | |
*** dtantsur|afk is now known as dtantsur | 11:01 | |
*** pgadiya has quit IRC | 11:02 | |
*** ramishra has joined #tripleo | 11:02 | |
openstackgerrit | Merged openstack/python-tripleoclient stable/pike: Allow containerized undercloud deploy with SELinux https://review.openstack.org/513746 | 11:06 |
yolanda | hi, can i get second +2 on https://review.openstack.org/499588 ? | 11:06 |
yolanda | EmilienM ^ | 11:07 |
ansiwen | jaosorior: hey, I wanted to finally integrate ec2-api tempest into scenario 002, and if I remember correctly we do that already for other services, but I couldn't find it quickly, can you give me a pointer? | 11:09 |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1725224 | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 11:10 |
openstack | Launchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Marius Cornea (mcornea) | 11:10 |
*** pgadiya has joined #tripleo | 11:10 | |
*** jkilpatr has quit IRC | 11:11 | |
*** rodolof has joined #tripleo | 11:12 | |
*** dbecker has quit IRC | 11:19 | |
*** yolanda has quit IRC | 11:19 | |
*** atoth has joined #tripleo | 11:19 | |
*** lucasagomes is now known as lucas-hungry | 11:20 | |
*** bobh has joined #tripleo | 11:20 | |
*** bobh has quit IRC | 11:23 | |
*** pdeore has quit IRC | 11:24 | |
jaosorior | ansiwen: chandankumar can help you :) | 11:25 |
* chandankumar is confused | 11:25 | |
jaosorior | chandankumar: ansiwen wants to add ec2-api tempest testing to scenario 002. Got any pointers? | 11:25 |
*** bfournie has quit IRC | 11:25 | |
*** bfournie has joined #tripleo | 11:26 | |
chandankumar | ansiwen: looking for example | 11:29 |
chandankumar | ansiwen: https://review.openstack.org/#/c/499928/ it would be a good example | 11:30 |
*** bfournie has quit IRC | 11:30 | |
chandankumar | ansiwen: you need to change params in featureset 6 and 17 | 11:31 |
chandankumar | ansiwen: you can use tempest_whitelist, tempest_plugins: and tempest_extra_config params for running the tests | 11:32 |
chandankumar | ansiwen: i would suggest to send a patch against tripleo-quickstart to enable ec2api tests | 11:32 |
chandankumar | for scenario 2 and see what is failing then update the patch to add config | 11:34 |
chandankumar | jaosorior: ^^ | 11:35 |
jaosorior | chandankumar: thanks | 11:35 |
*** ffiore has quit IRC | 11:38 | |
*** bobh has joined #tripleo | 11:38 | |
*** bfournie has joined #tripleo | 11:39 | |
*** bfournie has quit IRC | 11:39 | |
*** rtailor has quit IRC | 11:40 | |
*** ratailor has joined #tripleo | 11:42 | |
*** ratailor has quit IRC | 11:42 | |
*** stendulker has quit IRC | 11:42 | |
*** pcaruana has joined #tripleo | 11:43 | |
*** ebarrera has quit IRC | 11:44 | |
*** ebarrera has joined #tripleo | 11:45 | |
*** bobh has quit IRC | 11:45 | |
*** ansmith has quit IRC | 11:46 | |
ansiwen | chandankumar: i don't understand the last part. why quickstart? ec2-api is already deployed in scenario002, I just want to additionally run the tempest tests against it. | 11:47 |
ansiwen | chandankumar: and thanks! | 11:47 |
*** dciabrin has quit IRC | 11:50 | |
*** bobh has joined #tripleo | 11:52 | |
*** jkilpatr has joined #tripleo | 11:55 | |
*** leitan has joined #tripleo | 11:55 | |
*** leitan has quit IRC | 11:55 | |
*** leitan has joined #tripleo | 11:56 | |
chandankumar | ansiwen: https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset006.yml#L67 uncomment this line | 11:56 |
ansiwen | chandankumar: yes, so it looks like EmilienM already prepared everything, but there is something missing in python-tempestconf? | 11:57 |
ansiwen | I guess I have to ask EmilienM what is the status there | 11:57 |
chandankumar | ansiwen: you have to enable ec2api service in tempest.conf | 11:58 |
chandankumar | ansiwen: use tempest_extra_config for the same | 11:58 |
ansiwen | chandankumar: did you see the comment? | 11:58 |
openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates master: [WIP] Implements AIDE Intrusion Detection System https://review.openstack.org/483028 | 11:59 |
jaosorior | jistr|mtgs, mandre: If I need to configure a service with a static template, what would be the best way to do it? Adding that static configuration in puppet seems a bit overkill. | 11:59 |
*** pgadiya has quit IRC | 12:00 | |
EmilienM | ansiwen: me? | 12:01 |
*** jpena is now known as jpena|lunch | 12:01 | |
EmilienM | ansiwen: I'm not, at all. | 12:01 |
*** dmacpher has joined #tripleo | 12:02 | |
*** adarazs is now known as adarazs_brb | 12:02 | |
ansiwen | EmilienM: I need some background for this line: https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset006.yml#L66 | 12:02 |
EmilienM | ansiwen: afik tempestconf doesn't configure ec2api in tempest.conf | 12:02 |
ansiwen | EmilienM: what is missing to enable the ec2-api tempest tests? | 12:02 |
EmilienM | ansiwen: the logic isn't here | 12:02 |
*** dprince has joined #tripleo | 12:03 | |
*** pcaruana has quit IRC | 12:03 | |
EmilienM | ansiwen: for ex, we tempestconf needs logic to detect the endpoint | 12:03 |
EmilienM | ansiwen: and if found, enable ec2api service in tempest.conf. etc etc | 12:04 |
*** raildo has joined #tripleo | 12:04 | |
*** pcaruana has joined #tripleo | 12:04 | |
EmilienM | gfidente: hey, why https://review.openstack.org/#/c/514584/1 is not passing? | 12:04 |
EmilienM | gfidente: it sounds like a timeout | 12:04 |
*** iranzo has quit IRC | 12:04 | |
ansiwen | EmilienM: ok, because chandankumar just proposed to enable it with tempest_extra_config, or did I misunderstand him? | 12:05 |
EmilienM | therve: https://review.openstack.org/#/c/514777/ | 12:05 |
EmilienM | chandankumar, ansiwen: it sounds like a workaround to me. | 12:05 |
*** iranzo has joined #tripleo | 12:06 | |
*** iranzo has joined #tripleo | 12:06 | |
ansiwen | EmilienM: ok, for the stupid like me: I go to python-tempestconf and implement the ec2api parts there, correct? | 12:06 |
*** abishop has joined #tripleo | 12:06 | |
social | therve: around? | 12:07 |
EmilienM | ansiwen: yes | 12:07 |
therve | social, Hey | 12:07 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for heat containers to log to stdout/stderr https://review.openstack.org/515038 | 12:08 |
ansiwen | EmilienM: ok, thanks. chandankumar, if you don't agree please shout.... | 12:08 |
gfidente | EmilienM yeah looks unrelated to me | 12:09 |
gfidente | I am just waiting for the master version to land first | 12:09 |
*** pgadiya has joined #tripleo | 12:09 | |
EmilienM | gfidente: that's fine if the other merges first | 12:10 |
*** thrash|g0ne is now known as thrash | 12:10 | |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1725224 | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 12:10 |
openstack | Launchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Marius Cornea (mcornea) | 12:10 |
social | therve: so extended TripleOAction with get_messaging_client and I get queue and I pass that to my ansible callback, question is now that in python-tripleoclient the wait_for_messages seems to check for execution id. should I just make that id up? | 12:10 |
openstackgerrit | Radomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable horizon plugins by default in docker https://review.openstack.org/514421 | 12:10 |
EmilienM | gfidente: but yeah we need master ASAP, it's blocking promotion | 12:10 |
EmilienM | gfidente: we found it last night that it's blocking promotion with wes, can you confirm it will fix https://bugs.launchpad.net/tripleo/+bug/1725224 ? | 12:10 |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in baremetal.yaml https://review.openstack.org/513693 | 12:11 |
*** pkovar has joined #tripleo | 12:12 | |
gfidente | EmilienM yep we had the fix in place from a while as well | 12:13 |
gfidente | but it failed rechecks :( | 12:13 |
EmilienM | gfidente: ok, good to know. It's our last blocker, afik | 12:13 |
*** adarazs_brb is now known as adarazs | 12:14 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test containers update https://review.openstack.org/511175 | 12:16 |
EmilienM | gfidente: ethernal recheck don't really help, tbh. We need to understand the root causes, etc | 12:20 |
*** pgadiya has quit IRC | 12:21 | |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data https://review.openstack.org/508567 | 12:23 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow https://review.openstack.org/509419 | 12:23 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow https://review.openstack.org/513463 | 12:23 |
jaosorior | EmilienM: If I need to configure a service with a static configuration, what would be the best way to do it? Adding that static configuration in puppet seems a bit overkill. | 12:23 |
*** lucas-hungry is now known as lucasagomes | 12:24 | |
EmilienM | jaosorior: static file? | 12:25 |
*** bfournie has joined #tripleo | 12:25 | |
jaosorior | EmilienM: right, a configuration file that doesn't really need any changes. | 12:25 |
EmilienM | jaosorior: which service? | 12:25 |
therve | social, Can you show some code, it's a bit abstract as-is | 12:26 |
social | therve: maybe I should just update review with progress | 12:26 |
therve | Sure please do | 12:26 |
*** rlandy has joined #tripleo | 12:27 | |
jaosorior | EmilienM: I'm gonna introduce rsyslog as a sidecar container. The configuration would look like this: https://github.com/larsks/ooo-syslog-example/blob/master/rsyslog-stdout/rsyslog.conf | 12:27 |
*** yolanda has joined #tripleo | 12:27 | |
*** cmyster has quit IRC | 12:28 | |
EmilienM | jaosorior: in that case, puppet-tripleo I would say | 12:28 |
jaosorior | EmilienM: I could just introduce a small profile in puppet, which wouldn't really be a big deal. But I was just wondering if there's a more lightweight option. | 12:28 |
*** tzumainn has joined #tripleo | 12:29 | |
EmilienM | jaosorior: well, you could override the container in tripleo-common but it's not clean imho | 12:29 |
Tengu | EmilienM: hello! could you add the missing +2 on that (now old… -.-) review? https://review.openstack.org/#/c/513274/ - hopefully next time it will be able to merge properly. | 12:29 |
EmilienM | Tengu: sure | 12:29 |
Tengu | thanks! and sorry for the inconvenient :( | 12:29 |
EmilienM | Tengu: thanks for the work! very appreciated. | 12:29 |
Tengu | well, not a big thing. | 12:30 |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-common master: WIP - POC on callback plugin for ansible to collect result https://review.openstack.org/511254 | 12:31 |
Tengu | btw, I'm a bit stuck understanding the issue on the other review https://review.openstack.org/#/c/512978/ - I'm a bit lost with the way to (re)find logs in order to point the issue. This time it's not a 143 error code… | 12:31 |
Tengu | thus it's not a timeout. At least I know that now :) | 12:32 |
fultonj | just got here, looks like we hit an issue from https://review.openstack.org/#/c/514584 not being merged last night | 12:32 |
social | therve: still super ugly https://review.openstack.org/#/c/511254/ | 12:32 |
therve | social, Looking | 12:35 |
*** pgadiya has joined #tripleo | 12:35 | |
Tengu | oh my… apparently it's an issue with neutron-openvswitch-agent not being installed o_O | 12:35 |
jaosorior | Tengu: I thought that was a transcient issue | 12:35 |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common master: [WIP] Adds UpdateRoles Workflow https://review.openstack.org/515045 | 12:36 |
Tengu | jaosorior: well… apparently not that transient :'( | 12:36 |
Tengu | although I can run a re-check just to be sure | 12:36 |
jaosorior | uhm | 12:37 |
Tengu | but there's something fishy | 12:37 |
jaosorior | Tengu: can you show me the log? | 12:37 |
Tengu | jaosorior: http://logs.openstack.org/78/512978/4/gate/legacy-tripleo-ci-centos-7-nonha-multinode-oooq/a10d87f/logs/undercloud/home/zuul/vxlan_networking.sh.log.txt.gz#_2017-10-24_21_08_30 at least | 12:37 |
Tengu | digging in the other logs in zuul home | 12:37 |
*** trown|outtypewww is now known as trown | 12:38 | |
Tengu | ok, openmvswitch is installed at least, according to the package log | 12:38 |
Tengu | as well as neutron-client | 12:38 |
Tengu | python2-neutronclient and puppet-neutron | 12:38 |
Tengu | but apparently, something's missing in order to install… well, I guess, neutron-agent or something like that? Although that should be done at least in puppet-neutron I guess | 12:39 |
*** bobh has quit IRC | 12:39 | |
jaosorior | right... I thought it would have been there :/ | 12:39 |
Tengu | in the log I just passed you, we can see openvswitch occurrences | 12:40 |
Tengu | i.e. "Installing : 1:openvswitch-2.7.2-3.1fc27.el7.x86_64" | 12:40 |
*** rbrady-afk is now known as rbrady | 12:40 | |
*** rbrady is now known as Guest32826 | 12:41 | |
*** pgadiya has quit IRC | 12:41 | |
Tengu | neutron-openvswitch-agent package is in puppet-neutron at least. | 12:41 |
Tengu | in the params. | 12:41 |
*** Guest32826 is now known as rbrady_ | 12:41 | |
*** ansmith has joined #tripleo | 12:41 | |
*** rbrady_ has quit IRC | 12:41 | |
*** rbrady_ has joined #tripleo | 12:41 | |
Tengu | and is the name for ovs_agent_neutron - that seems pretty good. maybe it's an issue in some pre-built image, jaosorior ? | 12:42 |
jaosorior | Tengu: right... I'm honestly not sure. And it seems to fail in a really weird step too :/ | 12:42 |
therve | social, So don't make it up, pass it as an argument to your action | 12:42 |
jaosorior | Tengu: http://logs.openstack.org/78/512978/4/gate/legacy-tripleo-ci-centos-7-nonha-multinode-oooq/a10d87f/job-output.txt.gz#_2017-10-24_21_15_51_493896 wtf | 12:42 |
Tengu | jaosorior: what's that step? | 12:43 |
Tengu | delorean ? | 12:43 |
Tengu | i.e. the package repository? | 12:43 |
jaosorior | Tengu: right it's setting the repos | 12:44 |
Tengu | o_O | 12:45 |
Tengu | b-b-but if it's setting up the repos, how comes it wants to start a service that might be installed FROM those repositories? | 12:45 |
Tengu | chicken-and-egg issue somewhere in the pipe? | 12:45 |
jaosorior | I'm pretty confused | 12:46 |
Tengu | well. I should feel reassured, but in fact, I'm not :D | 12:46 |
jaosorior | Tengu: does that issue appear every time you recheck? | 12:46 |
Tengu | hmm, last rechecks were due to timeout (err 143) | 12:46 |
Tengu | I've commented the recheck reason on that purpose: know what were the causes. | 12:47 |
*** dbecker has joined #tripleo | 12:47 | |
jaosorior | I kinda think it's transcient | 12:47 |
Tengu | so maybe I can re-run a recheck in order to ensure it's a non-transient issue. | 12:47 |
Tengu | let's check that then :) | 12:47 |
*** pchavva has joined #tripleo | 12:48 | |
*** udesale has joined #tripleo | 12:48 | |
Tengu | jaosorior: ordered the recheck | 12:48 |
Tengu | we'll see. maybe the CI will explode ? :) | 12:48 |
Tengu | or we'll create some mighty black hole? :)) | 12:49 |
jaosorior | well | 12:49 |
jaosorior | we had a good run | 12:49 |
Tengu | :) | 12:49 |
*** pkovar has quit IRC | 12:50 | |
EmilienM | gfidente: I'm going to block the gate | 12:50 |
gfidente | > | 12:50 |
gfidente | ? | 12:50 |
Tengu | as long as my apache class in puppet-tripleo goes through, I'm happy. hopefully no more merge conflict. | 12:50 |
EmilienM | gfidente: so https://review.openstack.org/#/c/513701/ is on top of the queue | 12:50 |
jaosorior | EmilienM: could you not abandon https://review.openstack.org/#/c/514543/ ? really need to fix that and backport it :/ | 12:52 |
therve | social, You haven't implemented queue_post too, right? | 12:52 |
EmilienM | jaosorior: do you know we didn't have a promotion is almost 2 months? | 12:52 |
EmilienM | jaosorior: everyone wants their code merged but we really need a promotion | 12:53 |
EmilienM | jaosorior: so is more important than having a promotion? | 12:53 |
*** pgadiya has joined #tripleo | 12:53 | |
social | therve: no | 12:53 |
jaosorior | EmilienM: alright | 12:54 |
EmilienM | jaosorior: like usual, I have to be sorry etc :-) | 12:54 |
EmilienM | but really we need support from the team | 12:54 |
*** EmilienM changes topic to "CI status: RED - do not approve or recheck or rebase any patch | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 12:54 | |
*** bkopilov_ has joined #tripleo | 12:55 | |
Tengu | nooooooo | 12:55 |
Tengu | :'( | 12:55 |
Tengu | gimme a rope, please :'( | 12:55 |
jaosorior | Tengu: beer works as well | 12:55 |
adarazs | Tengu: sorry, I can't +workflow that request. | 12:55 |
*** cmyster has joined #tripleo | 12:56 | |
Tengu | jaosorior: well, tonight there's a whisky discovery. guess that'll do as well :) | 12:56 |
Tengu | adarazs: :Þ | 12:56 |
*** pgadiya has quit IRC | 12:56 | |
openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates master: Env files for ODL deployments https://review.openstack.org/512501 | 12:57 |
*** pkovar has joined #tripleo | 12:58 | |
EmilienM | all: http://lists.openstack.org/pipermail/openstack-dev/2017-October/123979.html | 13:00 |
Tengu | fair enough | 13:01 |
*** jmelvin has joined #tripleo | 13:02 | |
Tengu | EmilienM: needing some help, or is the gate/ci just dedicated for the validation/promotion of the patches? | 13:03 |
openstackgerrit | Radomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable horizon plugins by default in docker https://review.openstack.org/514421 | 13:05 |
*** jcoufal has joined #tripleo | 13:07 | |
*** jpena|lunch is now known as jpena | 13:08 | |
*** gvrangan has quit IRC | 13:09 | |
*** ooolpbot has joined #tripleo | 13:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1725224 | 13:10 |
*** ooolpbot has quit IRC | 13:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 13:10 |
trozet | mwhahaha: how do i get jenkins to recheck for https://review.openstack.org/#/c/511862/ ? | 13:10 |
openstack | Launchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Marius Cornea (mcornea) | 13:10 |
trozet | i tonly seems to recheck zuul | 13:10 |
mwhahaha | trozet: ignore Jenkins. We only care about zuul | 13:12 |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart master: Use the new containers tag name for master and pike https://review.openstack.org/515052 | 13:12 |
trozet | mwhahaha: oh well in that case it is +1 :) can you set workflow please? | 13:12 |
*** dciabrin has joined #tripleo | 13:13 | |
*** ykarel has quit IRC | 13:15 | |
*** ykarel has joined #tripleo | 13:15 | |
*** bobh has joined #tripleo | 13:17 | |
*** mrch has joined #tripleo | 13:20 | |
bandini | EmilienM: thanks! | 13:22 |
EmilienM | bnemec, therve : do you think multinode jobs (even ovb) timeouts can be related to the switch of Heat Convergence? | 13:23 |
*** cdearborn has joined #tripleo | 13:24 | |
therve | EmilienM, I don't have strong evidence, but yeah | 13:24 |
therve | It'd be surprising if it didn't have an impact | 13:24 |
*** lblanchard has joined #tripleo | 13:24 | |
EmilienM | therve: our gate is in bad status | 13:25 |
*** toure_biab is now known as toure | 13:25 | |
EmilienM | therve: we should investigate that convergence thing | 13:25 |
*** lblanchard has quit IRC | 13:25 | |
EmilienM | the last time I checked nobody seemed worried iiuc | 13:25 |
therve | I'm worried | 13:30 |
EmilienM | therve: I'm busy on clearing the gate now, if someone (you if you have time) can investigate heat convergence | 13:34 |
EmilienM | I know zaneb had numbers or at least a tool to provide them | 13:34 |
zaneb | EmilienM: not any more, all the gate jobs changed their names & I haven't rewritten it yet | 13:35 |
*** pradk has quit IRC | 13:36 | |
owalsh | EmilienM: guess we should update the nova keymgr hiera too - https://review.openstack.org/#/c/513767/2/puppet/services/barbican-api.yaml@173 | 13:37 |
*** dbecker has quit IRC | 13:37 | |
*** mdnadeem has quit IRC | 13:38 | |
thrash | trozet: in the future, if you have a patch like that, you can rebase, and it will wipe jenkins and not come back. | 13:38 |
EmilienM | zaneb: just add legacy- | 13:38 |
thrash | trozet: but I would not suggest that now. :D | 13:38 |
EmilienM | owalsh: yes, we need - can you send it? | 13:38 |
zaneb | EmilienM: I mean several months back | 13:39 |
owalsh | EmilienM: sure | 13:39 |
EmilienM | owalsh: thanks | 13:39 |
EmilienM | status: gate is cleared | 13:40 |
zaneb | EmilienM: I was using the tripleo-ci-centos-7-ovb-nonha job, but it no longer exists so historical comparisons are meaningless | 13:40 |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Fix space character for bash command https://review.openstack.org/513435 | 13:40 |
*** lblanchard has joined #tripleo | 13:41 | |
matbu | dprince: hey, one note/question about the https://review.openstack.org/#/c/511350/ , its really nice to have this transformation of the undercloud.conf to deploy command, im wondering, is it would be sane to imagine a such overcloud.conf for the overcloud deployment | 13:41 |
matbu | dprince: instead of building such crazy deploy command with a tons of -e -e -e | 13:41 |
*** mdnadeem has joined #tripleo | 13:42 | |
*** mdnadeem has quit IRC | 13:44 | |
jrist | what's Sergey's irc, does anyone know? | 13:44 |
thrash | matbu: fwiw I'd be +1 to that. :D | 13:44 |
*** yamahata has joined #tripleo | 13:44 | |
jrist | sshnaidm: ah - this might be related to the change you made and the changes Wes and I are working through https://bugs.launchpad.net/tripleo/+bug/1719490 | 13:45 |
openstack | Launchpad bug 1719490 in tripleo "UI is not browsable by default in OVB" [Medium,In progress] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 13:45 |
matbu | thrash: +2 even ?? ;) | 13:45 |
thrash | matbu: haha | 13:45 |
sshnaidm | jrist, sorry, on mtg now | 13:46 |
jrist | sshnaidm: no problem, it already has a patch | 13:46 |
*** sshnaidm is now known as sshnaidm|mtg | 13:46 | |
dprince | matbu: could do it there too. That would sort of be a new feature though and likely not cover the much larger set of Overcloud options available | 13:47 |
*** ecerquei has joined #tripleo | 13:47 | |
*** amodi has joined #tripleo | 13:48 | |
matbu | dprince: well i think that could cover all (and everything we want actually) and we could store and save the overcloud.conf in swift, then we could have a really good knowledge of what it has been deployed | 13:48 |
dprince | matbu: but sure, we could look at alternate config formats. Whatever we do we'll want to be mindful of API's around them so that that you can drive the installation on the UI and the CLI alike | 13:48 |
EmilienM | trown: https://review.openstack.org/515070 FYI - found a way to do what you asked. | 13:50 |
trown | EmilienM++ awesome! | 13:51 |
trown | EmilienM: I dont totally understand that, but guess infra folks said that will help | 13:51 |
EmilienM | trown: iiuc, it will stop to run THT / tripleo-common / oooq i nthe same queue | 13:52 |
EmilienM | trown: each project will have its own queue | 13:52 |
EmilienM | I need to verify with pabelanger that it doesn't add more problems thatn we have not | 13:52 |
EmilienM | now* | 13:52 |
trown | oh right | 13:52 |
trown | nice | 13:52 |
*** jlinkes has quit IRC | 13:52 | |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: update nova keymgr parameter for Queens https://review.openstack.org/515073 | 13:53 |
EmilienM | owalsh: thanks a lot | 13:54 |
*** rbowen has joined #tripleo | 13:55 | |
*** yamahata has quit IRC | 13:55 | |
*** jkilpatr has quit IRC | 13:56 | |
*** mrch has quit IRC | 13:57 | |
social | EmilienM: the ansible issue is ordering of generated inventory - first real hosts, than roles, than meta groups so [overcloud-controller1] <ip> [Controller] overcloud-controller1 [overcloud] Controller | 13:58 |
social | EmilienM: and overcloud misses vars | 13:58 |
EmilienM | social: woot? | 13:59 |
matbu | woot woot | 13:59 |
EmilienM | missing context here | 13:59 |
social | EmilienM: ansible 2.4 issue where it skips all hosts? matbu do we have some bug? | 14:00 |
EmilienM | https://bugs.launchpad.net/tripleo/+bug/1725224 ? | 14:00 |
openstack | Launchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Marius Cornea (mcornea) | 14:00 |
*** mdnadeem has joined #tripleo | 14:00 | |
matbu | BZ, not sure if we have something in LP | 14:00 |
social | that is different one :) | 14:00 |
matbu | EmilienM: this is not the same issue | 14:00 |
EmilienM | ok | 14:00 |
social | but it's related :) | 14:00 |
EmilienM | dang | 14:00 |
EmilienM | will it block promotion pipeline? | 14:00 |
EmilienM | why don't we pin ansible 2.3 in that case | 14:01 |
social | EmilienM: /var/run/mistral as HOME env for mistral | 14:01 |
EmilienM | I guess 2.4 is super cool and everyone wants it | 14:01 |
*** chlong_ has joined #tripleo | 14:01 | |
social | EmilienM: I don't understand why we create mistral user with home set to /home/mistral ,) | 14:01 |
EmilienM | gfidente: scenario001 failing on https://review.openstack.org/#/c/513701/ :( | 14:02 |
matbu | EmilienM: hmm | 14:02 |
EmilienM | social: I'm sorry but I don't get your context and why you ping me about that | 14:03 |
gfidente | EmilienM I see it passing? | 14:03 |
EmilienM | gfidente: watch zuul | 14:03 |
EmilienM | http://logs.openstack.org/01/513701/3/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/0dfa4e7/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-10-25_13_51_22 | 14:03 |
EmilienM | timeout | 14:03 |
therve | zaneb, EmilienM: we can always revert and compare the timings/resources | 14:03 |
*** liverpooler has quit IRC | 14:03 | |
EmilienM | therve: i'm all for it, tbh | 14:03 |
social | EmilienM: U thought you have this ansible issue, sorry | 14:03 |
therve | OK let's do that then | 14:04 |
d0ugal | social: I don't think the mistral user has the home directory for any particular reason | 14:04 |
EmilienM | social: no worries | 14:04 |
d0ugal | social: it was just done in the initial version of the rpm spec - copied from somewhere I guess? | 14:04 |
openstackgerrit | Thomas Herve proposed openstack/instack-undercloud master: Revert "Enable convergence engine on the undercloud" https://review.openstack.org/515077 | 14:05 |
EmilienM | therve: we need to rebase it ^ | 14:05 |
therve | Yeah let me abandon that one | 14:06 |
EmilienM | gfidente: damn... we have to recheck :( | 14:06 |
*** yamahata has joined #tripleo | 14:07 | |
EmilienM | gfidente: i'm going to rebase https://review.openstack.org/#/c/513701/ so it runs again in check, and hope it pass this time. | 14:08 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Use ANSIBLE_HOST_KEY_CHECKING var instead of ssh-common-args https://review.openstack.org/513701 | 14:08 |
EmilienM | gfidente: any idea why it timeouts? | 14:09 |
openstackgerrit | Thomas Herve proposed openstack/instack-undercloud master: Revert "Enable convergence engine on the undercloud" https://review.openstack.org/515078 | 14:10 |
*** masco has quit IRC | 14:10 | |
*** ooolpbot has joined #tripleo | 14:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1725224 | 14:10 |
*** ooolpbot has quit IRC | 14:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 14:10 |
openstack | Launchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 14:10 |
*** abregman is now known as abregman|mtg | 14:10 | |
trozet | thanks thrash | 14:10 |
EmilienM | gfidente: I'm abandoning a bunch of things in check as well, to have the tripleo-common patch testing again | 14:14 |
gfidente | EmilienM hmm have a link to the last run logs? | 14:14 |
trozet | thrash can you set workflow on it please? | 14:15 |
EmilienM | gfidente: a sec | 14:16 |
EmilienM | gfidente: http://logs.openstack.org/01/513701/3/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/0dfa4e7/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-10-25_13_51_22 | 14:16 |
gfidente | EmilienM looks like it didn't even get to boot the nods | 14:18 |
EmilienM | gfidente: ? | 14:18 |
EmilienM | gfidente: it's a multinode jobs, which node are you talking about | 14:18 |
gfidente | from the overcloud deploy log | 14:19 |
gfidente | it didn't even start step1 | 14:19 |
EmilienM | gfidente: ouch | 14:19 |
EmilienM | gfidente: I haven't looked deeper tbh | 14:19 |
*** dbecker has joined #tripleo | 14:20 | |
EmilienM | I'm trying to get the patch rechecked | 14:20 |
EmilienM | but still enqueued | 14:20 |
gfidente | yes so slagle is probably our guy here | 14:20 |
gfidente | slagle any clue what is happening here http://logs.openstack.org/01/513701/3/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/0dfa4e7/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-10-25_13_51_22 ? | 14:20 |
EmilienM | ok it's enqueued | 14:20 |
EmilienM | I mean, jobs are runnning again now | 14:20 |
EmilienM | therve: thx, +2 | 14:23 |
EmilienM | therve: hopefully we can get bnemec / slagle feedbacks as well | 14:23 |
owalsh | gfidente, EmilienM: AFAIK slagle is on PTO | 14:24 |
*** pblaho has quit IRC | 14:24 | |
EmilienM | ah right, I always forgot about PTOs | 14:24 |
bnemec | EmilienM: I will note that the timeouts started happening before we turned on convergence, so that's likely not a silver bullet here. | 14:24 |
*** yamahata has quit IRC | 14:25 | |
bnemec | It may have no effect whatsoever, but I'm okay with trying it. | 14:25 |
therve | EmilienM, Yeah I'd like to get some timings first | 14:25 |
* bnemec hopes nobody is CD'ing TripleO | 14:25 | |
ansiwen | EmilienM: another question, why did you choose "ec2api.tests.functional.api.test_key_pairs.KeyPairTest". Is it the idea, that we don't do full tempest tests, but just a few functional tests, that prove that the service is running? | 14:25 |
gfidente | therve so from http://logs.openstack.org/01/513701/3/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/0dfa4e7/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-10-25_13_51_22 | 14:25 |
bnemec | Although I guess if they already deployed a convergence stack successfully that's okay. | 14:25 |
EmilienM | ansiwen: randomly | 14:26 |
EmilienM | ansiwen: just to test API | 14:26 |
openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 14:26 |
*** udesale has quit IRC | 14:26 | |
*** rbowen has quit IRC | 14:26 | |
EmilienM | bnemec: I'll repeat what I commented in therve's review: anything that is "suspect" today is imho something we should consider, even if at the end it was not that. | 14:26 |
EmilienM | bnemec: we're in a stage where we consider any option that can help or not | 14:27 |
EmilienM | disabling convergence is one of them | 14:27 |
*** pradk has joined #tripleo | 14:27 | |
bnemec | EmilienM: That's fine, but randomly reverting stuff without any evidence may just confuse things further. | 14:27 |
bnemec | Does anybody have numbers on how long overcloud deploys are taking with convergence vs. without? | 14:28 |
*** yolanda has quit IRC | 14:28 | |
*** pblaho has joined #tripleo | 14:29 | |
ansiwen | EmilienM: I see | 14:29 |
EmilienM | bnemec: we probably lost the data | 14:29 |
*** udesale has joined #tripleo | 14:30 | |
ykarel | #tripleo is featureset021 running somewhere, i need to verify something | 14:30 |
EmilienM | ykarel: not sure what jobname it is. | 14:31 |
*** liverpooler has joined #tripleo | 14:32 | |
ykarel | EmilienM, i mean is featureset021 running in any job? | 14:32 |
* EmilienM doesn't know | 14:32 | |
* ykarel Ok | 14:33 | |
*** dhill_ has quit IRC | 14:33 | |
*** dhill_ has joined #tripleo | 14:38 | |
zaneb | bnemec: afaik there isn't a job running without convergence against which to compare | 14:40 |
*** ykarel_ has joined #tripleo | 14:40 | |
zaneb | bnemec: but I agree that we should look at the CI results from the revert patch before just merging it | 14:41 |
*** ykarel has quit IRC | 14:41 | |
bnemec | zaneb: Yeah, I've been trying to go back and find some old jobs from before we turned it on. | 14:41 |
bnemec | But even then, a lot has changed in the past month or so. | 14:41 |
*** abregman|mtg is now known as abregman | 14:42 | |
zaneb | bnemec, EmilienM: maybe we should have a periodic job that runs with convergence disabled for the rest of Queens, so that we don't have to speculate? | 14:44 |
EmilienM | zaneb: go for it | 14:44 |
ykarel_ | EmilienM, i found it featureset001 recently added as an experimental job: https://review.rdoproject.org/r/#/c/10248/ | 14:45 |
ykarel_ | s/featureset001/featureset021 | 14:46 |
*** dbecker has quit IRC | 14:50 | |
*** akane has quit IRC | 14:50 | |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data https://review.openstack.org/508567 | 14:52 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow https://review.openstack.org/509419 | 14:52 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow https://review.openstack.org/513463 | 14:52 |
*** eggmaster has joined #tripleo | 14:53 | |
*** oidgar has quit IRC | 14:54 | |
*** yamahata has joined #tripleo | 14:54 | |
*** ramishra has quit IRC | 14:56 | |
*** raissa has joined #tripleo | 14:56 | |
*** ykarel_ has quit IRC | 14:57 | |
*** ykarel_ has joined #tripleo | 14:59 | |
*** dmarlin has joined #tripleo | 15:00 | |
*** ykarel_ is now known as ykarel | 15:01 | |
*** dsariel has quit IRC | 15:03 | |
*** cshastri has quit IRC | 15:04 | |
*** sri_ has quit IRC | 15:07 | |
Tengu | EmilienM: small question: one of my review was flagged as abandonned - is there a way to reactive it once the CI is free? | 15:08 |
*** psachin has quit IRC | 15:08 | |
*** suuuper has quit IRC | 15:08 | |
Tengu | EmilienM: ah, ok, you'll do it yourself. fine for me :). | 15:09 |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 15:10 |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1725224 | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
openstack | Launchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 15:10 |
gregwork | does anyone have a working heat example of where br-ex (External bridge)'s northbound port is a vlan tagged interface ? | 15:10 |
EmilienM | Tengu: I'll take care of all of them | 15:14 |
gregwork | ive tried doing this but i believe its not sending tagged frames, doing an ip -d link show vlan200 doesnt report it is a vlan device , ive tried to use this to deploy https://paste.fedoraproject.org/paste/iHEYHcrFEwPt46shNmpTsQ | 15:15 |
*** achadha has joined #tripleo | 15:16 | |
*** achadha has quit IRC | 15:16 | |
*** dsariel has joined #tripleo | 15:18 | |
Tengu | EmilienM: good luck :). | 15:18 |
*** achadha has joined #tripleo | 15:20 | |
openstackgerrit | Radomir Dopieralski proposed openstack/tripleo-heat-templates stable/pike: Fix /etc/openstack-dashboard/ permissions for access to *policy.json https://review.openstack.org/515105 | 15:20 |
ludovic | Hello, is someone know what means when a overcloud deploy with the message "The Resource ControllerConfig requires replacement" | 15:21 |
*** artom_ is now known as artom | 15:22 | |
rook | EmilienM isn't there a way to disable validations? | 15:24 |
rook | I remember shardy mentioning it... | 15:24 |
rook | but I cannot remember how to do that. | 15:24 |
*** achadha has quit IRC | 15:24 | |
EmilienM | echo 'enable_validations = False' >> ~/undercloud.conf | 15:24 |
rook | EmilienM++ | 15:25 |
rook | thanks | 15:25 |
*** achadha has joined #tripleo | 15:25 | |
rook | akrzos: ^ | 15:26 |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common master: Adds Workflow to List Available Roles https://review.openstack.org/509832 | 15:29 |
akrzos | EmilienM: no way to disable after install? | 15:30 |
*** chem has quit IRC | 15:32 | |
*** hewbrocca is now known as hewbrocca_afk | 15:34 | |
*** rodolof has quit IRC | 15:34 | |
d0ugal | thrash: Should we do something like this? or can I just use mistralclient from tempest tests? https://github.com/openstack/mistral/blob/master/mistral_tempest_tests/services/v2/mistral_client.py | 15:36 |
thrash | d0ugal: We probably want to do it ourself. You wouldn't want to start having dependencies for tests. | 15:37 |
d0ugal | thrash: I guess - althought we already depend on it normally and we have other test deps (test-requirements.txt) | 15:38 |
thrash | d0ugal: I'm thinking more from an RPM perspective | 15:38 |
d0ugal | but I think it might be needed for tempest anyway | 15:39 |
thrash | Ideally tempest plugins should be self-contained, IMHO | 15:39 |
d0ugal | k | 15:40 |
tosky | thrash: well, it depends | 15:41 |
tosky | thrash: if you want to write a (let's say) a mistral test that use sahara, the sahara client for tempest is in the Sahara tempest plugin | 15:42 |
tosky | so plugins could have dependencies on other plugins | 15:42 |
tosky | tempest plugins, in this context | 15:42 |
thrash | tosky: is that dependency captured in the packaging? | 15:42 |
tosky | thrash: it can be captured in the requirements.txt, why can't it be captured in the packaging? | 15:42 |
bnemec | gregwork: I'm not a vlan expert, but that looks right to me. Is it possible that traffic isn't getting routed properly because the external interface doesn't have a default route configuration? | 15:44 |
thrash | tosky: I'm not saying it's not possible... Just saying that it's not ideally. | 15:44 |
thrash | *ideal | 15:44 |
tosky | thrash: why not? | 15:44 |
tosky | it's like any other dependency on a library or a component | 15:45 |
thrash | but like I said, not a strong opinion. Just my opinion. | 15:45 |
tosky | that's why I'd like to understand why it's not ideal; which complications do you foresee? | 15:45 |
*** pcaruana has quit IRC | 15:49 | |
thrash | tosky: Just not having to touch any other component. | 15:49 |
thrash | and i include the packaging in that. | 15:50 |
thrash | And it's not really that big of a deal to use a rest api. | 15:50 |
tosky | as I mentioned, I don't see how it is different from the usual scenario of "program which depends on a set of libraries which depends on other libraries" | 15:51 |
*** yamahata has quit IRC | 15:51 | |
tosky | thrash: although, rereading your discussion, it looks like a slightly different issue; you were assessing whether use the mistralclient or use the native tempest client in the Mistral Tempest plugin | 15:53 |
d0ugal | tosky: well, that was my initial confusion :) | 15:54 |
tosky | in that case, it is correct to *not* use the mistralclient; tempest tests should not use the official python clients | 15:54 |
*** bcafarel has quit IRC | 15:54 | |
tosky | I was talking in general about possible dependencies between tempest plugins | 15:54 |
tosky | which is a different use case | 15:54 |
d0ugal | tosky: yeah, I figured that bit out eventually | 15:54 |
tosky | ok, so sorry for the confusion on my side | 15:54 |
*** bcafarel has joined #tripleo | 15:54 | |
thrash | tosky: no worries. You input is valued. | 15:54 |
thrash | *Your | 15:55 |
d0ugal | and at least a bit on my side :) | 15:55 |
*** abregman has quit IRC | 15:58 | |
EmilienM | trown, adarazs: do we need https://review.openstack.org/#/c/515052/ urgently for getting promotion as well? | 15:59 |
*** dparkes has quit IRC | 15:59 | |
*** thrash is now known as thrash|eatz | 16:00 | |
*** itlinux has joined #tripleo | 16:01 | |
*** achadha has quit IRC | 16:01 | |
*** mcornea has quit IRC | 16:02 | |
EmilienM | panda|rover|off: do you know ^ | 16:02 |
*** benone has quit IRC | 16:04 | |
adarazs | EmilienM: for getting promotion: no. for using fresh images after a successful master promotion: yes | 16:04 |
adarazs | *container images | 16:04 |
EmilienM | ok so the answer is yes we need it asap | 16:05 |
EmilienM | but I guess it can wait a few more hours since we need to actually promote first | 16:06 |
adarazs | EmilienM: but after somebody makes the "current-tripleo" tags on images like https://hub.docker.com/r/tripleomaster/centos-binary-nova-scheduler/tags/ -- otherwise container jobs will break. | 16:06 |
adarazs | for master. | 16:06 |
*** benone has joined #tripleo | 16:06 | |
*** iranzo has quit IRC | 16:07 | |
EmilienM | adarazs: who is "somebody"? we need to identify who and when now | 16:07 |
EmilienM | so we're ready to take this action. | 16:07 |
adarazs | panda|rover|off: said he will do it, but we're after a marathon meeting (still on it) and I'm not sure he'll be able to do it today. | 16:08 |
*** janki has quit IRC | 16:09 | |
adarazs | EmilienM: I'd wait until we get a master promotion and then submit https://review.openstack.org/#/c/515052/ -- probably easier. | 16:10 |
*** ooolpbot has joined #tripleo | 16:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1725224 | 16:10 |
*** ooolpbot has quit IRC | 16:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 16:10 |
openstack | Launchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 16:10 |
ansiwen | EmilienM: so puppet-tempest is not involved there right? so whatever I implemented there to create the right testing environment, I would have to reimplement in ansible/python/whatever again, right? | 16:10 |
EmilienM | ansiwen: it's not. | 16:10 |
EmilienM | adarazs: ok | 16:11 |
ansiwen | EmilienM: because I implemented providers there for credentials and stuff... I wonder how to realize that in quickstart now | 16:11 |
*** benone has quit IRC | 16:13 | |
itlinux | hello all... any tips about ControllerDeployment_Step3 failed? | 16:14 |
panda|rover|off | I'll do it this evening | 16:15 |
*** panda|rover|off is now known as panda|ruck | 16:15 | |
itlinux | it gives me this code status_reason | deploy_status_code : Deployment exited with non-zero status code: 1 | 16:15 |
*** benone has joined #tripleo | 16:15 | |
*** ebarrera has quit IRC | 16:16 | |
*** ebarrera has joined #tripleo | 16:16 | |
openstackgerrit | Thomas Herve proposed openstack/instack-undercloud master: Set notification_bind on zaqar websocket https://review.openstack.org/515123 | 16:18 |
therve | EmilienM, ^^^should fix the zaqar issue | 16:18 |
EmilienM | therve: thank you | 16:19 |
therve | I found that was indeed a source of timeout, though relatively (?) rare, ie ipv6 only envs that are out there | 16:19 |
* adarazs logs off for today, see ya | 16:20 | |
EmilienM | therve: I agree it was rare, when we investigate with Alex, we had 10 hits per week on average | 16:20 |
EmilienM | therve: a weird race | 16:20 |
EmilienM | therve: I'm glad you found the fix, thx again | 16:20 |
therve | EmilienM, Yeah not race, just host sets as IPv6 | 16:21 |
therve | See http://logs.openstack.org/11/510411/16/check/legacy-tripleo-ci-centos-7-scenario003-multinode-oooq/71794dd/logs/undercloud/etc/hosts.txt.gz for example | 16:21 |
therve | centos-7-vexxhost-ca-ymq-1-0000443478 will only resolve as IPv6 | 16:21 |
therve | That confuses zaqar unfortunately | 16:21 |
EmilienM | therve: oh,you mean when infra providers have ipv6 ok | 16:21 |
EmilienM | so we have ipv6 jobs :D | 16:21 |
EmilienM | (in some sort) | 16:22 |
therve | Yeah... | 16:22 |
therve | That don't work :D | 16:22 |
*** aufi has quit IRC | 16:22 | |
*** ykarel has quit IRC | 16:23 | |
*** tesseract has quit IRC | 16:25 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first https://review.openstack.org/513530 | 16:27 |
*** trown is now known as trown|lunch | 16:27 | |
*** anshul has quit IRC | 16:30 | |
*** daidv has quit IRC | 16:32 | |
*** Goneri has quit IRC | 16:33 | |
*** jpena is now known as jpena|brb | 16:34 | |
*** udesale has quit IRC | 16:35 | |
*** chlong_ has quit IRC | 16:37 | |
*** lucasagomes is now known as lucas-afk | 16:38 | |
*** sshnaidm|mtg is now known as sshnaidm | 16:40 | |
*** yprokule has quit IRC | 16:42 | |
*** Goneri has joined #tripleo | 16:44 | |
EmilienM | therve: https://review.openstack.org/515123 is backportable I think (to pike at least?) | 16:50 |
EmilienM | but maybe ocata as well | 16:51 |
pabelanger | EmilienM: you are no longer sharing a queue with openstack/mistral, possible something you may or may not want to fix. In v2 you did | 16:53 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/newton: Prepare puppet-tripleo 5.6.5 https://review.openstack.org/515132 | 16:54 |
EmilienM | pabelanger: we don't want. | 16:54 |
*** marios has quit IRC | 16:55 | |
pabelanger | EmilienM: okay, they look to be running tripleo jobs, keep in mind they could land code that break you now | 16:55 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/ocata: Prepare puppet-tripleo 6.5.4 https://review.openstack.org/515134 | 16:56 |
*** derekh has quit IRC | 16:56 | |
*** ccamacho has quit IRC | 16:57 | |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/pike: Prepare puppet-tripleo 7.4.3 https://review.openstack.org/515135 | 16:57 |
EmilienM | paok | 16:57 |
EmilienM | pabelanger: ok | 16:57 |
*** panda|ruck is now known as panda|ruck|bbl | 16:58 | |
*** dmacpher has quit IRC | 16:58 | |
*** jfrancoa has quit IRC | 17:00 | |
*** sri_ has joined #tripleo | 17:00 | |
*** gfidente is now known as gfidente|afk | 17:00 | |
*** amodi has quit IRC | 17:00 | |
*** dtantsur is now known as dtantsur|afk | 17:01 | |
*** morazi has quit IRC | 17:01 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ui stable/pike: Prepare tripleo-ui 7.4.3 https://review.openstack.org/515137 | 17:02 |
*** benone has quit IRC | 17:05 | |
*** fragatina has quit IRC | 17:05 | |
*** salmankhan has quit IRC | 17:06 | |
*** achadha has joined #tripleo | 17:08 | |
*** benone has joined #tripleo | 17:09 | |
*** salmankhan has joined #tripleo | 17:09 | |
openstackgerrit | Sven Anderson proposed openstack/tripleo-quickstart master: TEST DON'T MERGE - Enabling EC2-API Tempest tests. https://review.openstack.org/515139 | 17:10 |
*** ooolpbot has joined #tripleo | 17:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1725224 | 17:10 |
*** ooolpbot has quit IRC | 17:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 17:10 |
openstack | Launchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 17:10 |
*** achadha_ has joined #tripleo | 17:12 | |
*** achadha has quit IRC | 17:12 | |
honza | dprince: I was able to create a containerized undercloud with containers-rdo.yaml. Otherwise, I'd get 'docker pull' errors (connection refused) | 17:13 |
honza | dprince: Is there any downside to using rdo? | 17:13 |
*** achadha_ has quit IRC | 17:13 | |
*** achadha has joined #tripleo | 17:13 | |
*** achadha has quit IRC | 17:15 | |
*** achadha has joined #tripleo | 17:15 | |
*** achadha has quit IRC | 17:16 | |
EmilienM | I need to step up for 40min, if someone can monitor 513701 in zuul and notify pabelanger if it failed again, so we retry. Or keep looking why it failed. We need this patch merged asap. Thanks | 17:20 |
*** achadha has joined #tripleo | 17:23 | |
*** achadha has quit IRC | 17:23 | |
*** achadha has joined #tripleo | 17:23 | |
*** dmsimard is now known as dmsimard|afk | 17:23 | |
*** cylopez has quit IRC | 17:24 | |
*** ebarrera has quit IRC | 17:24 | |
openstackgerrit | Merged openstack/instack-undercloud stable/pike: Provide LOCAL_IP_WRAPPED as a instack env variable https://review.openstack.org/513758 | 17:26 |
*** rmascena has joined #tripleo | 17:28 | |
*** fragatina has joined #tripleo | 17:30 | |
*** bobh has quit IRC | 17:30 | |
*** raildo has quit IRC | 17:30 | |
*** trown|lunch is now known as trown | 17:34 | |
*** thrash|eatz is now known as thrash | 17:36 | |
*** Goneri has quit IRC | 17:38 | |
*** rwsu has quit IRC | 17:40 | |
amoralej | ovb jobs are failing because overcloudrd is using keystone v2, is that known issue https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/260/console? | 17:41 |
*** mdnadeem has quit IRC | 17:41 | |
*** Goneri has joined #tripleo | 17:43 | |
dprince | honza: no downside to using RDO. we should perhaps make it the default I think | 17:44 |
*** dsariel has quit IRC | 17:45 | |
*** dparkes has joined #tripleo | 17:47 | |
*** jpena|brb is now known as jpena | 17:48 | |
*** tosky has quit IRC | 17:50 | |
*** amodi has joined #tripleo | 17:51 | |
*** gkadam has quit IRC | 17:54 | |
EmilienM | amoralej: it should be fixed | 17:54 |
EmilienM | amoralej: let me check the failure | 17:54 |
amoralej | https://bugs.launchpad.net/tripleo/+bug/1727454 | 17:54 |
openstack | Launchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Undecided,Triaged] | 17:54 |
amoralej | EmilienM, ^ | 17:54 |
amoralej | i filled a LP | 17:54 |
amoralej | jobs are failing as we talk and i couldn't fine a review for that | 17:54 |
amoralej | maybe i didn't look for it in the right project | 17:55 |
EmilienM | let me check, I thought we fixed all blockers on that regard | 17:55 |
EmilienM | https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/3042841/undercloud/home/jenkins/overcloud_deploy_post.log.txt.gz#_2017-10-25_17_32_52 | 17:56 |
EmilienM | is it the pingtest? | 17:56 |
amoralej | it's before ping test | 17:57 |
EmilienM | amoralej: we need to patch https://git.openstack.org/cgit/openstack/tripleo-common/tree/tripleo_common/utils/overcloudrc.py maybe | 17:57 |
amoralej | but for some reason is not happening in multinode | 17:57 |
amoralej | only ovb | 17:57 |
EmilienM | ok | 17:57 |
*** ludovic has quit IRC | 17:58 | |
EmilienM | instead of sourcing /home/jenkins/overcloudrc we should source overcloudrcv3 | 17:58 |
EmilienM | and also remove /home/jenkins/overcloudrc | 17:58 |
openstackgerrit | Toure Dunnon proposed openstack/python-tripleoclient master: Tripleoclient unified queue name. https://review.openstack.org/509902 | 17:59 |
fultonj | it looks like https://review.openstack.org/#/c/513701 is blocked by rdo-kolla-build-integration, which failed because ERROR:kolla.image.build:opendaylight Failed : https://review.rdoproject.org/jenkins/job/rdo-kolla-build-integration/858/console | 17:59 |
amoralej | we are keeping separated overcloudrc for v2 and v3 ? | 17:59 |
amoralej | that's tricky imho | 17:59 |
EmilienM | yeah | 17:59 |
EmilienM | I want to first see where we source overcloudrc | 17:59 |
EmilienM | I think it's in quickstart-extras: roles/validate-sanity-checks/templates/validate-sanity-checks.sh.j2: | 18:00 |
amoralej | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-deploy/templates/overcloud-deploy-post.sh.j2#L41 | 18:00 |
amoralej | EmilienM, ^ | 18:00 |
EmilienM | nice | 18:01 |
EmilienM | amoralej: well not nice | 18:01 |
amoralej | wouldn't be easier to have a valid overcloudrc ? | 18:01 |
EmilienM | amoralej: I'm afraid we source overcloudrc somewhere else | 18:01 |
EmilienM | amoralej: yes | 18:01 |
EmilienM | amoralej: I'm looking at tripleo-common now | 18:02 |
*** artom has quit IRC | 18:04 | |
EmilienM | amoralej: the change in tripleo-common isn't as easy and might require some work | 18:05 |
amoralej | EmilienM, i'm leaving, so multinode jobs are passing, ovb are failing because of this | 18:05 |
amoralej | and container build is still running, but looks in good shape | 18:06 |
EmilienM | but we need to change tripleo.deployment.overcloudrc | 18:06 |
*** jpena is now known as jpena|off | 18:06 | |
EmilienM | ok | 18:06 |
EmilienM | amoralej: thx.. | 18:06 |
*** pkovar has quit IRC | 18:07 | |
fultonj | EmilienM: regarding https://review.openstack.org/#/c/513701, do you think my assesment ^ is correct? | 18:08 |
EmilienM | fultonj: rdo-kolla-build-integration isn't voting | 18:09 |
EmilienM | fultonj: I don't know much about this job | 18:09 |
EmilienM | fultonj: dmsimard|afk knows and can maybe help on this one | 18:09 |
fultonj | it doesn't have non-voting next to it | 18:09 |
EmilienM | it's third party right? | 18:09 |
EmilienM | so it's not voting | 18:09 |
fultonj | ok | 18:09 |
*** amoralej is now known as amoralej|off | 18:09 | |
fultonj | so we're still waiting for the rest of the test since you workflowed it then | 18:10 |
*** ooolpbot has joined #tripleo | 18:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1725224 | 18:10 |
*** ooolpbot has quit IRC | 18:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 18:10 |
openstack | Launchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 18:10 |
EmilienM | fultonj: yeah i'm watching it in gate | 18:10 |
fultonj | ok, thanks | 18:10 |
EmilienM | d0ugal, thrash, rbrady_ : you guys can help on https://bugs.launchpad.net/tripleo/+bug/1727454 ? Otherwise I'll take a look | 18:11 |
openstack | Launchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] | 18:11 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Set metric procssing delay for metricd https://review.openstack.org/511236 | 18:12 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test playbook with ansible debug https://review.openstack.org/515157 | 18:13 |
therve | EmilienM, Would need to check puppet-zaqar for the backport | 18:13 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test playbook with ansible debug https://review.openstack.org/515157 | 18:14 |
*** paramite has quit IRC | 18:14 | |
EmilienM | therve: let me know, I'll approve it in puppet | 18:15 |
*** jprovazn has quit IRC | 18:16 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Provide a quick workaround for 1727454 https://review.openstack.org/515161 | 18:16 |
EmilienM | amoralej|off: ^ | 18:17 |
*** artom has joined #tripleo | 18:17 | |
rbrady_ | Emilien: I'm about to go afk, but is it a timing issue between lines 109-112 and 114-119 in https://github.com/openstack/tripleo-common/blob/master/tripleo_common/utils/overcloudrc.py | 18:18 |
*** bogdando has quit IRC | 18:19 | |
rbrady_ | Emilien: disregard, it sets v3 a little further below those lines | 18:19 |
*** tosky has joined #tripleo | 18:22 | |
trown | EmilienM: just one job left ... | 18:24 |
itlinux | does anyone know how I can implement Mistral? | 18:24 |
itlinux | thanks.. | 18:24 |
*** Goneri has quit IRC | 18:25 | |
d0ugal | EmilienM: I can look tomorrow if you don't have any luck. | 18:28 |
d0ugal | itlinux: what do you mean by implement Mistral? | 18:28 |
*** rbrady_ is now known as rbrady-afk | 18:30 | |
itlinux | the dev team wants to use Mistral on the project.. so I wonder on how they can consume that service.. | 18:34 |
itlinux | I trying to understand on how they want to use it.. looks like AWS has something similar.. so I am trying to move them to OS on premis.. | 18:35 |
*** catintheroof has joined #tripleo | 18:35 | |
d0ugal | itlinux: so you want to know how to deploy Mistral? | 18:35 |
*** Goneri has joined #tripleo | 18:36 | |
*** fzdarsky is now known as fzdarsky|afk | 18:39 | |
*** yolanda has joined #tripleo | 18:40 | |
itlinux | yes | 18:40 |
itlinux | for the overcloud not under.. | 18:40 |
*** catintheroof has quit IRC | 18:41 | |
*** catintheroof has joined #tripleo | 18:41 | |
*** rlandy is now known as rlandy|brb | 18:44 | |
*** atoth has quit IRC | 18:46 | |
*** brian83 has quit IRC | 18:48 | |
EmilienM | trown: yeah i'm also watching it like a movie | 18:48 |
EmilienM | d0ugal: ok thank you very much | 18:48 |
EmilienM | d0ugal: in the meantime, https://review.openstack.org/#/c/515161/ | 18:49 |
EmilienM | trown: if you can take a look at ^ when you have 2 min | 18:49 |
trown | EmilienM: not exactly a fall blockbuster | 18:49 |
*** catintheroof has quit IRC | 18:49 | |
EmilienM | trown: sorry what? | 18:49 |
*** catintheroof has joined #tripleo | 18:50 | |
*** newmember has joined #tripleo | 18:50 | |
* EmilienM google that | 18:50 | |
trown | EmilienM: just continuing your movie joke :P | 18:50 |
EmilienM | ok I google it :D | 18:50 |
trown | zuul console is not going to win an academy award is all I was saying | 18:50 |
EmilienM | trown: I feel like it's going to timeout :( | 18:51 |
trown | though at least we have a web console again... thats pretty nice | 18:51 |
EmilienM | but i don't want to be pessimist | 18:51 |
EmilienM | trown: it failed | 18:54 |
EmilienM | 143, it's timeout... | 18:54 |
* EmilienM takes lunch break... | 18:54 | |
EmilienM | trown: maybe we could investigate where it failed and ask pabelanger to promote again in the gate | 18:54 |
EmilienM | I'm out 15 min | 18:54 |
openstackgerrit | Vincent S. Cojot proposed openstack/tripleo-heat-templates master: Adds checking proxy server before using it. https://review.openstack.org/515172 | 18:56 |
openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates master: Fix networking settings for ObjectStorage role https://review.openstack.org/515175 | 18:58 |
itlinux | what's the best way to set fernet as a token provider since ocata has UUID as default.. | 18:59 |
itlinux | I have this now http://paste.openstack.org/show/624639/ | 19:00 |
*** benone has quit IRC | 19:06 | |
* EmilienM back | 19:08 | |
trown | EmilienM: not much to go on :( | 19:08 |
trown | EmilienM: http://logs.openstack.org/01/513701/4/gate/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq/f1261a0/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 19:09 |
EmilienM | pabelanger: could we please recheck https://review.openstack.org/#/c/513701 a last time and promote in the gate. Next step if that fails again is disabling voting. | 19:09 |
EmilienM | trown: yeah it's odd | 19:09 |
*** benone has joined #tripleo | 19:09 | |
* trown goes to catch the bus, brb | 19:09 | |
*** trown is now known as trown|brb | 19:09 | |
*** ooolpbot has joined #tripleo | 19:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1725224 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1727454 | 19:10 |
*** ooolpbot has quit IRC | 19:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 19:10 |
fultonj | https://review.openstack.org/#/c/513701 just failed scenario001-multinode-oooq | 19:10 |
openstack | Launchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 19:10 |
openstack | Launchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] | 19:10 |
EmilienM | fultonj: yeah that's what we said with trown|brb :( | 19:11 |
EmilienM | fultonj: I'm looking at logs now | 19:11 |
*** cdearborn has quit IRC | 19:13 | |
EmilienM | bnemec: I confirm your comment about convergence, I haven't seen any improvement by disabling it | 19:13 |
EmilienM | bnemec: I looked at multinode-container | 19:13 |
EmilienM | the timeout could be related to http://logs.openstack.org/01/513701/4/gate/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq/f1261a0/logs/undercloud/var/log/zaqar/zaqar.log.txt.gz#_2017-10-25_17_14_48_335 | 19:14 |
EmilienM | what therve is fixing right now | 19:14 |
fultonj | i'm in ara looking at that failed task http://logs.openstack.org/01/513701/4/gate/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq/f1261a0/ara/ | 19:14 |
EmilienM | https://review.openstack.org/#/c/515123/ might help | 19:14 |
EmilienM | fultonj: you want to look at ara-oooq then | 19:15 |
EmilienM | ara is ansible from zuul v3 iiuc | 19:15 |
EmilienM | and ara-oooq is from tripleo quickstart (the actual tripleo things) | 19:15 |
fultonj | thanks EmilienM | 19:17 |
*** dtrainor has quit IRC | 19:19 | |
*** cdearborn has joined #tripleo | 19:19 | |
*** trown|brb is now known as trown | 19:20 | |
*** dtrainor has joined #tripleo | 19:21 | |
EmilienM | can someone review https://review.openstack.org/#/c/515161/1 please | 19:24 |
EmilienM | trown, fultonj: 513701 was enqueued in the gate (thanks pabelanger) - we said that if that fails again, we'll disable voting on the 2 jobs that timeout. Unless we have a better solution. | 19:26 |
trown | panda|ruck|bbl: sshnaidm could you look at https://review.openstack.org/#/c/515161/1 | 19:28 |
trown | EmilienM: cool, it is always the same jobs? | 19:28 |
EmilienM | trown: sounds like scenario001 yeah | 19:28 |
trown | odd | 19:28 |
fultonj | EmilienM: ack, thanks | 19:28 |
EmilienM | let me look cistatus | 19:28 |
EmilienM | legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container has 92% of failure today !!!!!!!!!! | 19:29 |
EmilienM | sorry for the !!! but well | 19:29 |
EmilienM | legacy-tripleo-ci-centos-7-containers-multinode has 86% | 19:29 |
EmilienM | trown, fultonj : I'm preparing a patch to disable voting on this job. So we're ready | 19:30 |
fultonj | EmilienM: would you want to use the same strategy for the pike backport https://review.openstack.org/#/c/514584 ? | 19:30 |
EmilienM | legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container doesn't timeout on pike | 19:31 |
EmilienM | right? | 19:31 |
EmilienM | legacy-tripleo-ci-centos-7-scenario004-multinode-oooq-container did though | 19:32 |
fultonj | i see, so the same strategy, even if you did it would have no effect | 19:33 |
EmilienM | i'm disabling voting on both | 19:33 |
*** benone has quit IRC | 19:34 | |
EmilienM | https://review.openstack.org/515183 | 19:35 |
*** benone has joined #tripleo | 19:38 | |
*** cylopez has joined #tripleo | 19:38 | |
*** rwsu has joined #tripleo | 19:38 | |
*** thrash is now known as thrash|bbl | 19:39 | |
*** rlandy|brb is now known as rlandy | 19:40 | |
*** atoth has joined #tripleo | 19:41 | |
trown | EmilienM: https://review.openstack.org/#/c/513701/ timed out on the non-container one | 19:42 |
EmilienM | true | 19:43 |
fultonj | is the goal here to get 513701 in or reduce the high demand to get it in by making it non-voting until 513701 gets in? | 19:43 |
EmilienM | should we disable voting on scenario001 and 004 on both container and non container? | 19:43 |
EmilienM | fultonj: goal is to get 513701 | 19:43 |
EmilienM | and the backport at some point | 19:44 |
EmilienM | but I'm more concerned by master now | 19:44 |
EmilienM | we got pike promotion 1 day ago | 19:44 |
trown | EmilienM: seems safest to do both, so we can get what we need for promotion (before something else breaks) | 19:45 |
fultonj | so to get 513701 in, by unvoting the jobs blocking it, it should be scenario001-multinode-oooq which is diabled, right? | 19:45 |
*** Goneri has quit IRC | 19:46 | |
EmilienM | I'm looking at http://cistatus.tripleo.org/ | 19:46 |
EmilienM | legacy-tripleo-ci-centos-7-scenario001-multinode-oooq is pretty solid | 19:46 |
EmilienM | legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-puppet a bit less | 19:47 |
EmilienM | but still good | 19:47 |
EmilienM | though legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container is killing us | 19:47 |
EmilienM | legacy-tripleo-ci-centos-7-scenario004-multinode-oooq-container is bad as well | 19:47 |
EmilienM | for now, i'll just disable on non containers | 19:48 |
EmilienM | based on numbers from http://cistatus.tripleo.org/ | 19:48 |
EmilienM | suggestions are welcome | 19:48 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Create root ssh folder if not existing https://review.openstack.org/515185 | 19:48 |
fultonj | i figured scenario001-multinode-oooq-container would stop killing us once 513701 was in | 19:48 |
sshnaidm | trown, I think this will solve your issue with rdo cloud and playbook, try to depend on it: https://review.openstack.org/515185 | 19:49 |
*** jmelvin has quit IRC | 19:49 | |
fultonj | i mispoke | 19:50 |
trown | sshnaidm: k I moved that in my patch series... I will make the same change though in the patch that moves it | 19:50 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Add steps needed when using OVB with a testenv broker https://review.openstack.org/512798 | 19:51 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test playbook with ansible debug https://review.openstack.org/515157 | 19:51 |
EmilienM | fultonj: why? | 19:52 |
EmilienM | fultonj: oh ok | 19:52 |
*** Goneri has joined #tripleo | 19:53 | |
*** ecerquei_ has joined #tripleo | 19:54 | |
*** dciabrin has quit IRC | 19:54 | |
*** ecerquei has quit IRC | 19:54 | |
EmilienM | https://review.openstack.org/515188 | 19:55 |
trown | sshnaidm: made that change here https://review.openstack.org/#/c/512798/7/playbooks/prepare-slave.yml lots of the patches are abandoned now to get promote patches through, will hopefully check it tommorrow | 19:55 |
stevebaker | dprince: hey! | 19:55 |
dprince | stevebaker: hey | 19:55 |
stevebaker | dprince: I'm just thinking of whether we should do auto detection of insecure registry https://bugs.launchpad.net/tripleo/+bug/1722632 | 19:57 |
openstack | Launchpad bug 1722632 in tripleo "Prepare command to detect need to set DockerInsecureRegistryAddress" [High,In progress] - Assigned to Steve Baker (steve-stevebaker) | 19:57 |
stevebaker | dprince: https://review.openstack.org/#/c/514473/ | 19:57 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test https://review.openstack.org/515189 | 19:58 |
dprince | stevebaker: looking now | 19:58 |
*** achadha has quit IRC | 19:58 | |
*** achadha has joined #tripleo | 19:58 | |
*** achadha has quit IRC | 19:59 | |
*** achadha has joined #tripleo | 20:00 | |
*** Goneri has quit IRC | 20:01 | |
fultonj | EmilienM: regarding https://review.openstack.org/#/c/515188 | 20:04 |
fultonj | We see scenario001-multinode-oooq-container failing and I think it's beacuse the ansible 2.4 upgrade, and the fix to deal with it is 513701, right? | 20:04 |
EmilienM | we don't have ansible 2.4 in gate or do we? | 20:04 |
EmilienM | let me check | 20:04 |
EmilienM | we do have | 20:05 |
trown | ya in packages we have ansible 2.4 | 20:05 |
EmilienM | so 513701 is needed anyway, right | 20:05 |
fultonj | yes | 20:05 |
trown | quickstart uses older version via virtualenv, but for actual deploy ansible we have 2.4 | 20:05 |
fultonj | legacy-tripleo-ci-centos-7-scenario001-multinode-oooq, without container, passed for 513701, but failed for it at the gate. | 20:06 |
EmilienM | yeah things like mistral and stuff use 2.4 I guess | 20:06 |
dprince | stevebaker: commented on the patch. In general I think what you are doing is a nice workflow improvement. | 20:07 |
fultonj | i guess 515188 can be used to take the pressure off | 20:07 |
*** toure is now known as toure_biab | 20:07 | |
EmilienM | fultonj: yes, unless non container jobs also faile | 20:07 |
EmilienM | fail* | 20:08 |
dprince | stevebaker: aside from my -1, my question would be should we make it explicit, similar to disabling certificate checks for SSL with some CLI tools like curl/wget | 20:08 |
*** dciabrin has joined #tripleo | 20:09 | |
fultonj | but w.r.t. getting 513701 in, do we just recheck since legacy-tripleo-ci-centos-7-scenario001-multinode-oooq passed earlier, but just failed at the gate on its way to merge? | 20:09 |
stevebaker | dprince: I think once the undercloud registry is tls we should make it explicit | 20:09 |
dprince | stevebaker: okay, I can go for that | 20:09 |
dprince | stevebaker: what do you think of my comment regarding DockerInsecureRegistryAddress being a comma_delimited_list... | 20:10 |
*** ooolpbot has joined #tripleo | 20:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1725224 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1727454 | 20:10 |
*** ooolpbot has quit IRC | 20:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 20:10 |
openstack | Launchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 20:10 |
openstack | Launchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] | 20:10 |
stevebaker | dprince: damn, I didn't realise DockerInsecureRegistryAddress was already a comma_delimited_list | 20:10 |
dprince | stevebaker: like if you were to pull some containers from a local registry, and some from RDO, and some elsewhere | 20:10 |
EmilienM | fultonj, trown: project-config patch approved, non voting will be in place in ~5min I guess | 20:10 |
dprince | stevebaker: yeah, the approach you are taking looks okay I think though regarding the GET request | 20:11 |
fultonj | EmilienM: OK, I think 001 can be voting again, after 513701 merges but we'll have the tests to prove it when that time comes | 20:12 |
stevebaker | dprince: it would be good to tell the difference between an http registry and an https registry with invalid certificate. Maybe the test should do an http get instead | 20:12 |
dprince | stevebaker: yes | 20:13 |
*** jmelvin has joined #tripleo | 20:13 | |
*** salmankhan has quit IRC | 20:13 | |
fultonj | EmilienM: so recheck for https://review.openstack.org/#/c/513701 just for zuul gate scenario001-multinode-oooq ? | 20:13 |
fultonj | zuul check of same job was green | 20:14 |
fultonj | or are there other things i'm overlooking? | 20:14 |
stevebaker | dprince: ok, thanks. btw I have a local change which uses skopeo for image transfers | 20:14 |
dprince | stevebaker: nice, thats a huge space saver man | 20:15 |
EmilienM | fultonj: 513701 is in gate now | 20:15 |
fultonj | oh | 20:16 |
EmilienM | so if it fails, we'll recheck again | 20:16 |
EmilienM | and it'll apply new rules | 20:16 |
fultonj | EmilienM: thanks, i overlooked that it was already there | 20:16 |
* fultonj should have used http://zuulv3.openstack.org/ | 20:16 | |
*** pchavva has quit IRC | 20:17 | |
EmilienM | fultonj: what did you use? | 20:18 |
EmilienM | fultonj: UIs are redirected to zuul v3 | 20:18 |
fultonj | i thought it was done with the gate sitting there failed | 20:18 |
fultonj | i.e. the block buster movie was over for now | 20:19 |
fultonj | and we weren't sure if we'd watch it again | 20:19 |
EmilienM | fultonj: I asked for a recheck and enqueue | 20:20 |
EmilienM | paul did it | 20:20 |
fultonj | ack, thanks | 20:20 |
*** ansmith has quit IRC | 20:30 | |
EmilienM | bnemec: can you please review https://review.openstack.org/#/c/515123/ ? | 20:42 |
openstackgerrit | Vincent S. Cojot proposed openstack/tripleo-heat-templates master: Adds checking proxy server before using it. https://review.openstack.org/515172 | 20:42 |
*** PagliaccisCloud has quit IRC | 20:45 | |
EmilienM | I'm going to go ahead and approve https://review.openstack.org/#/c/515123 with the hope we can stabilize our CI | 20:48 |
bnemec | EmilienM: Are we just ignoring the ovb-ha job now? | 20:49 |
EmilienM | bnemec: timeouting on 2h52 | 20:49 |
EmilienM | let's look the logs | 20:49 |
EmilienM | I can still block the patch while in gate anyway | 20:49 |
bnemec | EmilienM: I guess the RDO job that I assume is ovb-ha passed. | 20:50 |
EmilienM | it fails on overcloud http://logs.openstack.org/23/515123/1/check-tripleo/legacy-tripleo-ci-centos-7-ovb-ha-oooq/c30868f/job-output.txt.gz#_2017-10-25_19_06_13_390146 | 20:51 |
*** abishop has quit IRC | 20:51 | |
EmilienM | but the overcloud was deployed : | 20:51 |
EmilienM | http://logs.openstack.org/23/515123/1/check-tripleo/legacy-tripleo-ci-centos-7-ovb-ha-oooq/c30868f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-10-25_19_09_33 | 20:51 |
*** PagliaccisCloud has joined #tripleo | 20:51 | |
openstackgerrit | Vincent S. Cojot proposed openstack/tripleo-heat-templates master: Adds checking proxy server before using it. https://review.openstack.org/515172 | 20:51 |
EmilienM | and it worked fine in RDO CI :/ | 20:52 |
openstackgerrit | Vincent S. Cojot proposed openstack/tripleo-heat-templates master: Adds checking proxy server before using it. https://review.openstack.org/515172 | 20:53 |
EmilienM | bnemec: look RDO CI jobs, 1h faster than our friends on OVB | 20:53 |
EmilienM | wth | 20:53 |
*** yolanda has quit IRC | 20:56 | |
bnemec | EmilienM: rh1 is old. :-) | 20:57 |
*** lblanchard has quit IRC | 20:57 | |
*** benone has quit IRC | 21:07 | |
larsks | Where are image name parameters (like DockerHAProxyImage) set? | 21:08 |
*** dmsimard|afk is now known as dmsimard | 21:08 | |
*** benone has joined #tripleo | 21:08 | |
*** ooolpbot has joined #tripleo | 21:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1725224 | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1727454 | 21:10 |
*** ooolpbot has quit IRC | 21:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 21:10 |
openstack | Launchpad bug 1725224 in tripleo "Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 21:10 |
openstack | Launchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal) | 21:10 |
zaneb | EmilienM, bnemec: if I were to resurrect the magic data scraping script... which job is the one we want to start tracking? | 21:14 |
*** artom_ has joined #tripleo | 21:15 | |
*** artom_ has quit IRC | 21:15 | |
*** artom_ has joined #tripleo | 21:16 | |
*** rcernin has joined #tripleo | 21:16 | |
openstackgerrit | James E. Blair proposed openstack/puppet-tripleo stable/pike: Prepare puppet-tripleo 7.4.3 https://review.openstack.org/515135 | 21:16 |
*** artom has quit IRC | 21:17 | |
*** dparkes has quit IRC | 21:17 | |
*** dparkes has joined #tripleo | 21:18 | |
*** cylopez has quit IRC | 21:21 | |
*** dprince has quit IRC | 21:23 | |
*** ecerquei_ has quit IRC | 21:26 | |
openstackgerrit | Merged openstack/tripleo-ui stable/pike: Prepare tripleo-ui 7.4.3 https://review.openstack.org/515137 | 21:30 |
openstackgerrit | Vincent S. Cojot proposed openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first https://review.openstack.org/513530 | 21:34 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 21:35 |
*** panda|ruck|bbl is now known as panda|ruck | 21:35 | |
EmilienM | zaneb: legacy-tripleo-ci-centos-7-ovb-ha-oooq I would say | 21:35 |
zaneb | ok | 21:35 |
itlinux | I assume that Pike can still be use in BM instead of Containerized version.. | 21:39 |
openstackgerrit | Vincent S. Cojot proposed openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first https://review.openstack.org/513530 | 21:41 |
*** jcoufal has quit IRC | 21:43 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first https://review.openstack.org/513530 | 21:43 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first https://review.openstack.org/513530 | 21:43 |
openstackgerrit | James E. Blair proposed openstack/puppet-tripleo stable/pike: Prepare puppet-tripleo 7.4.3 https://review.openstack.org/515135 | 21:44 |
EmilienM | itlinux: yes, although upgrades aren't tested from ocata to pike when pike is on baremetal | 21:45 |
itlinux | ok .. I want to make sure it's still ok to use BM on PIKE in case.. | 21:45 |
EmilienM | bnemec: could the ovb failures related to the number of overcloud deployed? | 21:46 |
*** cdearborn has quit IRC | 21:46 | |
EmilienM | bnemec: like, do we overcommit? | 21:46 |
*** fragatina has quit IRC | 21:50 | |
EmilienM | fultonj: tempest is about to run on legacy-tripleo-ci-centos-7-scenario001-multinode-oooq for 513701 | 21:52 |
EmilienM | which is very good | 21:52 |
fultonj | EmilienM: awesome! | 21:52 |
EmilienM | other are green | 21:52 |
EmilienM | the backport is in gate as well | 21:52 |
fultonj | so hopefuly scenario001-multinode-oooq will vote again | 21:52 |
EmilienM | yeah | 21:53 |
EmilienM | fultonj: I would ask to everyone (in the ml) to not approve patches not passing scenario001 or scenario004 unless checking with ceph team | 21:53 |
EmilienM | we need to be careful when jobs aren't voting | 21:53 |
fultonj | they can ping me anytime | 21:53 |
fultonj | or gfidente of course | 21:53 |
*** rwsu has quit IRC | 21:54 | |
*** rwsu has joined #tripleo | 21:54 | |
EmilienM | ok | 21:55 |
*** rwsu has quit IRC | 21:56 | |
fultonj | https://review.openstack.org/#/c/507526 | 21:56 |
fultonj | should be close | 21:57 |
*** owalsh has quit IRC | 22:00 | |
*** owalsh has joined #tripleo | 22:00 | |
*** jmelvin has quit IRC | 22:02 | |
EmilienM | ok it passed | 22:05 |
EmilienM | the patch in master will land \o/ | 22:05 |
EmilienM | panda|ruck: when you're back tomorrow, I updated https://etherpad.openstack.org/p/tripleo-promotion-blockers-october-2017 with the 3 patches that we need to get promotion | 22:07 |
EmilienM | panda|ruck: there is probably more? but that's what I know | 22:07 |
openstackgerrit | Merged openstack/tripleo-common master: Use ANSIBLE_HOST_KEY_CHECKING var instead of ssh-common-args https://review.openstack.org/513701 | 22:09 |
*** ooolpbot has joined #tripleo | 22:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 22:10 |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1727454 | 22:10 |
*** ooolpbot has quit IRC | 22:10 | |
openstack | Launchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal) | 22:10 |
fultonj | w00t! | 22:11 |
fultonj | thanks EmilienM ! | 22:11 |
EmilienM | woot | 22:11 |
*** itlinux has quit IRC | 22:14 | |
*** fragatina has joined #tripleo | 22:14 | |
*** amodi has quit IRC | 22:15 | |
*** catintheroof has quit IRC | 22:18 | |
panda|ruck | EmilienM: I'm pushing containers with the current-tripleo tag, I'll update you when it's finished. | 22:22 |
*** artom_ has quit IRC | 22:25 | |
EmilienM | panda|ruck: ok I'm now out for some hours, I guess i'll see you in my morning | 22:26 |
EmilienM | panda|ruck: tonight I'll come back and make sure our 2 remaining blockers are landed | 22:26 |
EmilienM | https://review.openstack.org/#/c/515161/ and https://review.openstack.org/#/c/515123/ | 22:26 |
EmilienM | panda|ruck: good night & thanks! | 22:27 |
EmilienM | panda|ruck: I'm unsure about what you mean exactly, maybe you can explain more with details I'll read later. | 22:28 |
*** dciabrin has quit IRC | 22:28 | |
panda|ruck | EmilienM: ok | 22:29 |
panda|ruck | EmilienM: I'm talinkg about https://review.openstack.org/515052 | 22:30 |
panda|ruck | EmilienM: now containers have the new tag https://hub.docker.com/r/tripleomaster/centos-binary-ceilometer-central/tags/ | 22:31 |
panda|ruck | so we can merge that | 22:31 |
panda|ruck | even if there's no new promotion, at least some work can progress | 22:32 |
*** pradk has quit IRC | 22:33 | |
*** dmarlin has quit IRC | 22:34 | |
*** panda|ruck is now known as panda|ruck|off | 22:35 | |
*** ansmith has joined #tripleo | 22:39 | |
*** rmascena has quit IRC | 22:41 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 22:45 |
*** salmankhan has joined #tripleo | 22:50 | |
*** pmannidi has joined #tripleo | 22:50 | |
openstackgerrit | Merged openstack/tripleo-common master: Action to always populate container image parameters https://review.openstack.org/503296 | 22:52 |
*** achadha has quit IRC | 22:54 | |
*** achadha has joined #tripleo | 22:55 | |
*** achadha has quit IRC | 22:57 | |
*** achadha has joined #tripleo | 22:57 | |
*** achadha has quit IRC | 22:59 | |
*** achadha has joined #tripleo | 22:59 | |
*** tosky has quit IRC | 23:02 | |
*** achadha has quit IRC | 23:02 | |
*** achadha_ has joined #tripleo | 23:03 | |
*** achadha_ has quit IRC | 23:04 | |
*** achadha has joined #tripleo | 23:04 | |
*** achadha has quit IRC | 23:05 | |
openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Set file mode permission for Ceph keyrings in containers https://review.openstack.org/508975 | 23:06 |
*** achadha has joined #tripleo | 23:06 | |
openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Set file mode permission for Ceph keyrings in containers https://review.openstack.org/508975 | 23:08 |
openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Set file mode permission for Ceph keyrings in containers https://review.openstack.org/508975 | 23:10 |
*** ooolpbot has joined #tripleo | 23:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1727454 | 23:10 |
*** ooolpbot has quit IRC | 23:10 | |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 23:10 |
openstack | Launchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal) | 23:10 |
*** achadha has quit IRC | 23:10 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 23:15 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 23:20 |
*** salmankhan has quit IRC | 23:25 | |
*** yamahata has joined #tripleo | 23:27 | |
*** yamahata has quit IRC | 23:32 | |
*** liverpooler has quit IRC | 23:47 | |
*** achadha_ has joined #tripleo | 23:50 | |
*** achadha_ has quit IRC | 23:52 | |
*** achadha_ has joined #tripleo | 23:53 | |
*** rlandy has quit IRC | 23:54 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!