*** bobh has quit IRC | 00:02 | |
openstackgerrit | Merged openstack/python-tripleoclient stable/pike: Do not return the config download path but only print it https://review.openstack.org/514609 | 00:07 |
---|---|---|
openstackgerrit | Brent Eagles proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 00:10 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-common master: Octavia post deployment mistral wrapper https://review.openstack.org/515402 | 00:10 |
*** ooolpbot has joined #tripleo | 00:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1727985 | 00:10 |
*** ooolpbot has quit IRC | 00:10 | |
openstack | Launchpad bug 1727985 in tripleo "yum-plugin-priorities is not installed in tripleo image when overcloud packages are installed" [Critical,Triaged] | 00:10 |
*** akrivoka has quit IRC | 00:16 | |
*** newmember has joined #tripleo | 00:21 | |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: persist memcached logs in /var/log/containers/memcached/memcached.log https://review.openstack.org/516271 | 00:28 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Set verbosity by default for memcached https://review.openstack.org/516270 | 00:29 |
*** akrivoka has joined #tripleo | 00:31 | |
*** newmember has quit IRC | 00:32 | |
*** newmember has joined #tripleo | 00:33 | |
*** bobh has joined #tripleo | 00:33 | |
*** owalsh_pto has quit IRC | 00:36 | |
*** noslzzp has quit IRC | 00:36 | |
openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: [ocata] Add Puppet package to bindep, for module build https://review.openstack.org/515947 | 00:38 |
openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: Prepare puppet-tripleo 6.5.4 https://review.openstack.org/515134 | 00:38 |
*** achadha has joined #tripleo | 00:39 | |
*** bobh has quit IRC | 00:42 | |
*** ecerquei_ has quit IRC | 00:43 | |
*** achadha has quit IRC | 00:45 | |
*** psahoo has joined #tripleo | 00:45 | |
*** bfournie has joined #tripleo | 00:46 | |
*** liverpooler has quit IRC | 00:47 | |
*** bfournie has quit IRC | 00:48 | |
*** owalsh_ has joined #tripleo | 00:49 | |
*** newmember has quit IRC | 00:51 | |
*** owalsh has joined #tripleo | 00:51 | |
*** newmember has joined #tripleo | 00:51 | |
*** owalsh- has joined #tripleo | 00:53 | |
*** owalsh_ has quit IRC | 00:54 | |
*** owalsh_ has joined #tripleo | 00:55 | |
*** newmember has quit IRC | 00:55 | |
*** owalsh has quit IRC | 00:56 | |
*** newmember has joined #tripleo | 00:56 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 00:58 |
*** owalsh has joined #tripleo | 00:58 | |
*** owalsh- has quit IRC | 00:59 | |
*** newmember has quit IRC | 01:01 | |
*** owalsh- has joined #tripleo | 01:01 | |
*** owalsh_ has quit IRC | 01:01 | |
*** newmember has joined #tripleo | 01:02 | |
*** yamahata has quit IRC | 01:04 | |
*** owalsh_ has joined #tripleo | 01:04 | |
*** owalsh has quit IRC | 01:04 | |
*** salmankhan has joined #tripleo | 01:05 | |
*** rhallisey has quit IRC | 01:07 | |
*** owalsh has joined #tripleo | 01:07 | |
*** owalsh- has quit IRC | 01:08 | |
*** itlinux has quit IRC | 01:09 | |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1727985 | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
openstack | Launchpad bug 1727985 in tripleo "yum-plugin-priorities is not installed in tripleo image when overcloud packages are installed" [Critical,Triaged] | 01:10 |
*** salmankhan has quit IRC | 01:10 | |
*** owalsh- has joined #tripleo | 01:10 | |
*** owalsh_ has quit IRC | 01:11 | |
EmilienM | pabelanger: hey you around? | 01:14 |
*** owalsh has quit IRC | 01:14 | |
EmilienM | maybe late | 01:14 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Fix standalone ControllerOpenstack vars https://review.openstack.org/512466 | 01:15 |
pabelanger | EmilienM: I am | 01:17 |
pabelanger | just writing emails to mgmt :) | 01:17 |
*** bobh has joined #tripleo | 01:17 | |
*** rlandy has quit IRC | 01:20 | |
EmilienM | pabelanger: wondering why https://review.openstack.org/#/c/515132/ didn't pass | 01:21 |
*** psachin has joined #tripleo | 01:21 | |
*** bfournie has joined #tripleo | 01:21 | |
EmilienM | http://logs.openstack.org/32/515132/3/check/puppet-openstack-module-build/c6bfc51/job-output.txt.gz#_2017-10-31_01_13_42_054286 | 01:21 |
*** psachin has quit IRC | 01:22 | |
EmilienM | we have bindep in place now, I'm confused | 01:22 |
*** psachin has joined #tripleo | 01:22 | |
pabelanger | looking | 01:23 |
pabelanger | http://logs.openstack.org/32/515132/3/check/puppet-openstack-module-build/c6bfc51/ara/result/12f066a7-3c20-4353-9a82-03680c52dba8/ | 01:24 |
pabelanger | sudo: no tty present and no askpass program specified | 01:24 |
pabelanger | EmilienM: ^ | 01:24 |
pabelanger | now, to see why that is | 01:24 |
pabelanger | http://logs.openstack.org/32/515132/3/check/puppet-openstack-module-build/c6bfc51/job-output.txt.gz#_2017-10-31_01_13_38_245297 | 01:25 |
pabelanger | looks like revoke-sudo is being used | 01:25 |
pabelanger | which happen just before error | 01:25 |
pabelanger | http://logs.openstack.org/32/515132/3/check/puppet-openstack-module-build/c6bfc51/job-output.txt.gz#_2017-10-31_01_13_42_054286 | 01:25 |
pabelanger | oh, hm | 01:26 |
pabelanger | that is also the old zuulv2 build job | 01:26 |
*** bobh has quit IRC | 01:26 | |
pabelanger | let me fine new shiny zuulv3 one | 01:26 |
EmilienM | yeah it's weird heh | 01:26 |
*** amodi has quit IRC | 01:33 | |
pabelanger | EmilienM: okay, we need to land https://review.openstack.org/515980/ | 01:38 |
pabelanger | then update puppet jobs to use it | 01:38 |
*** fragatina has quit IRC | 02:01 | |
*** apetrich has quit IRC | 02:03 | |
*** apetrich has joined #tripleo | 02:04 | |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1727985 | 02:10 |
openstack | Launchpad bug 1727985 in tripleo "yum-plugin-priorities is not installed in tripleo image when overcloud packages are installed" [Critical,Triaged] | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
*** threestrands has joined #tripleo | 02:11 | |
*** threestrands has joined #tripleo | 02:11 | |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/newton: Prepare puppet-tripleo 5.6.5 https://review.openstack.org/515132 | 02:14 |
*** rwsu has joined #tripleo | 02:22 | |
*** catintheroof has joined #tripleo | 02:24 | |
*** bobh has joined #tripleo | 02:30 | |
*** gvrangan has joined #tripleo | 02:31 | |
*** gvrangan has quit IRC | 02:33 | |
*** gvrangan has joined #tripleo | 02:33 | |
*** gvrangan has quit IRC | 02:38 | |
*** akrivoka has quit IRC | 02:40 | |
*** catintheroof has quit IRC | 02:43 | |
*** axisys has joined #tripleo | 02:43 | |
*** axisys has left #tripleo | 02:45 | |
*** shreshtha has joined #tripleo | 02:50 | |
*** cshastri has joined #tripleo | 02:57 | |
*** gvrangan has joined #tripleo | 03:04 | |
*** bobh has quit IRC | 03:08 | |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1727985 | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
openstack | Launchpad bug 1727985 in tripleo "yum-plugin-priorities is not installed in tripleo image when overcloud packages are installed" [Critical,Triaged] | 03:10 |
*** bkopilov has quit IRC | 03:12 | |
*** bobh has joined #tripleo | 03:14 | |
*** achadha has joined #tripleo | 03:16 | |
*** achadha_ has joined #tripleo | 03:16 | |
*** gvrangan has quit IRC | 03:18 | |
*** ramishra has joined #tripleo | 03:19 | |
*** achadha has quit IRC | 03:20 | |
*** newmember has quit IRC | 03:22 | |
*** vkmc has quit IRC | 03:29 | |
openstackgerrit | Steve Baker proposed openstack/python-tripleoclient master: Use common defaults for image prepare CLI https://review.openstack.org/516139 | 03:32 |
*** vkmc has joined #tripleo | 03:35 | |
*** shreshtha has quit IRC | 03:36 | |
*** bobh has quit IRC | 03:37 | |
tonyb | How do I work out what overcloud.AllNodesDeploySteps.ComputeDeployment_Step4 is doing and why it appears to "hang" | 03:38 |
*** fragatina has joined #tripleo | 03:49 | |
*** fragatina has quit IRC | 03:49 | |
*** fragatina has joined #tripleo | 03:50 | |
*** fragatina has quit IRC | 03:50 | |
*** fragatina has joined #tripleo | 03:51 | |
*** achadha_ has quit IRC | 03:52 | |
*** ykarel has joined #tripleo | 04:06 | |
*** udesale has joined #tripleo | 04:06 | |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1727985 | 04:10 |
openstack | Launchpad bug 1727985 in tripleo "yum-plugin-priorities is not installed in tripleo image when overcloud packages are installed" [Critical,Triaged] | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
*** tzumainn has quit IRC | 04:11 | |
*** jidar has quit IRC | 04:22 | |
*** jidar has joined #tripleo | 04:22 | |
*** fragatina has quit IRC | 04:22 | |
*** stee_3 has quit IRC | 04:23 | |
*** jpena|off has quit IRC | 04:23 | |
*** pliu has quit IRC | 04:23 | |
*** lhinds has quit IRC | 04:23 | |
*** stee_3 has joined #tripleo | 04:24 | |
*** pliu has joined #tripleo | 04:25 | |
*** lhinds has joined #tripleo | 04:25 | |
*** jpena|off has joined #tripleo | 04:25 | |
*** fragatina has joined #tripleo | 04:27 | |
*** cshastri has quit IRC | 04:31 | |
*** bkopilov has joined #tripleo | 04:38 | |
*** anilvenkata has joined #tripleo | 04:39 | |
*** skramaja has joined #tripleo | 04:45 | |
*** ratailor has joined #tripleo | 04:47 | |
*** janki has joined #tripleo | 05:06 | |
*** pdeore has joined #tripleo | 05:09 | |
jaosorior | tonyb: that runs puppet/ansible steps; but it could be doing many things | 05:20 |
jaosorior | tonyb: the best way to figure out exactly what it's doing is to go to a controller node, and check what os-collect-config is doing via journalctl | 05:21 |
*** janki has quit IRC | 05:27 | |
*** janki has joined #tripleo | 05:27 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: nova-placement: switch auth_uri to keystone versionless endpoint https://review.openstack.org/514739 | 05:28 |
*** iranzo has joined #tripleo | 05:32 | |
*** yamahata has joined #tripleo | 05:35 | |
*** threestrands has quit IRC | 05:46 | |
*** fragatina has quit IRC | 05:47 | |
*** achadha has joined #tripleo | 05:48 | |
*** achadha has quit IRC | 05:53 | |
*** achadha has joined #tripleo | 05:56 | |
*** achadha_ has joined #tripleo | 05:57 | |
*** gkadam has joined #tripleo | 05:57 | |
*** cshastri has joined #tripleo | 05:58 | |
*** threestrands has joined #tripleo | 05:58 | |
*** threestrands has quit IRC | 05:58 | |
*** threestrands has joined #tripleo | 05:58 | |
*** jfrancoa has joined #tripleo | 05:59 | |
*** achadha has quit IRC | 06:00 | |
*** threestrands has quit IRC | 06:03 | |
*** dparkes has quit IRC | 06:14 | |
*** abregman has joined #tripleo | 06:16 | |
*** yprokule has joined #tripleo | 06:26 | |
*** agurenko has quit IRC | 06:27 | |
*** suuuper has joined #tripleo | 06:28 | |
*** iranzo has quit IRC | 06:42 | |
*** moshele has joined #tripleo | 06:49 | |
ratailor | jaosorior, you around ? | 06:52 |
jaosorior | yeah, sup? | 06:52 |
*** tosky has joined #tripleo | 06:53 | |
*** achadha_ has quit IRC | 06:54 | |
*** iranzo has joined #tripleo | 06:55 | |
*** iranzo has quit IRC | 06:55 | |
*** iranzo has joined #tripleo | 06:55 | |
*** jtomasek has joined #tripleo | 06:58 | |
tonyb | jaosorior: Okay, do you mean the undercloud or the node I tagged control and then deployed? | 06:58 |
*** rcernin has quit IRC | 06:59 | |
jaosorior | tonyb: the node you tagged control (which is a node in the overcloud) | 06:59 |
tonyb | jaosorior: Thanks | 07:00 |
jaosorior | tonyb: so, the undercloud has no idea what's actually going on in the overcloud; all it gets is heat events (which is the steps that you see) and further you can see some logs once a certain step completes. | 07:00 |
*** jtomasek has quit IRC | 07:00 | |
jaosorior | tonyb: however, if you want to see what's going on in real time in a certain node | 07:00 |
tonyb | jaosorior: it eventually tied out so I'll delete the stack and try again tomorrow | 07:00 |
jaosorior | you can ssh into that node, and check the output of journalctl | 07:00 |
ratailor | should tls_proxy be set in step4 as done here. | 07:00 |
ratailor | jaosorior, ^^ https://review.openstack.org/#/c/509392/6/manifests/profile/base/nova/ec2api.pp | 07:01 |
*** dparkes has joined #tripleo | 07:01 | |
tonyb | jaosorior: Thanks | 07:01 |
jaosorior | ratailor: I suggest you start the TLS proxy in step 3 in the bootstrap node and step 4 for every other node. | 07:01 |
ratailor | Whenever I tried to deploy overcloud with my changes for enabling TLS for ec2api, It got timed out after completing step3. | 07:01 |
jaosorior | ratailor: this avoids restarts due to the change in the httpd vhost configurations | 07:01 |
*** gkadam has quit IRC | 07:01 | |
*** brault has joined #tripleo | 07:02 | |
ratailor | jaosorior, same as done here https://review.openstack.org/#/c/494657/1/manifests/profile/base/nova/api.pp | 07:02 |
jaosorior | ratailor: something like this https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/neutron/server.pp#L116 | 07:02 |
*** marios has joined #tripleo | 07:02 | |
jaosorior | ratailor: yep | 07:02 |
ratailor | jaosorior, Thanks! | 07:02 |
jaosorior | ratailor: if you want help further help, I could take a look at your deployment to try to figure out why it's timing out | 07:03 |
ratailor | sure, | 07:03 |
ratailor | Can I try this, if it fails again, I will provide you access to my system. Does it sounds good ? | 07:04 |
jaosorior | ratailor: sure! let me know | 07:04 |
ratailor | jaosorior, sure | 07:05 |
*** spectr has joined #tripleo | 07:08 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Force memcached container log to file https://review.openstack.org/516206 | 07:08 |
jaosorior | mandre: what about this? ^^ | 07:08 |
*** agurenko has joined #tripleo | 07:09 | |
*** yamahata has quit IRC | 07:14 | |
*** anshul has joined #tripleo | 07:17 | |
*** jprovazn has joined #tripleo | 07:17 | |
*** pcaruana has joined #tripleo | 07:17 | |
mandre | jaosorior: très bien | 07:18 |
jaosorior | merci beaucoup | 07:19 |
*** tosky has quit IRC | 07:19 | |
mandre | ;-) | 07:19 |
jaosorior | mandre: who else reviews adding containers to tripleo-common ? | 07:20 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/515991 | 07:20 |
*** dsneddon has joined #tripleo | 07:20 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui stable/pike: Imported Translations from Zanata https://review.openstack.org/515990 | 07:20 |
jaosorior | mandre: so I can poke them about https://review.openstack.org/#/c/467074/ :P | 07:20 |
mandre | jaosorior: I'm not a snitch! | 07:24 |
jaosorior | lol | 07:25 |
mandre | jaosorior: you can give a try with bandini or jistr|mtgs if he's around, any tripleo core who understands well enough the containers | 07:25 |
*** paramite has joined #tripleo | 07:26 | |
jaosorior | thanks bandini ! | 07:29 |
bandini | o/ | 07:29 |
bandini | jaosorior: can I pick your brain later this morning for a) a completely weird heat issue and b) the tls pcmk upgrade stuff? | 07:30 |
jaosorior | bandini: sure | 07:31 |
jaosorior | bandini: let me know when so I start brewing coffee :P | 07:31 |
bandini | jaosorior: merci. In an hour or so? | 07:31 |
bandini | :) | 07:31 |
jaosorior | ack | 07:31 |
bandini | I am moderately sure I hit a heat bug, but before filing it I'd like to be sure I am not on crack :) | 07:32 |
*** jtomasek has joined #tripleo | 07:33 | |
*** adarazs|ruck is now known as adarazs|rover | 07:40 | |
rasca | morning everyone! | 07:41 |
jfrancoa | good morning! | 07:42 |
jfrancoa | does anybody know who's the CI ranger today? I need some help debugging one issue in the upgrade CI jobs | 07:43 |
*** rcernin has joined #tripleo | 07:44 | |
therve | bandini, Around if you need me to have a look | 07:44 |
*** shardy has joined #tripleo | 07:45 | |
*** shardy has quit IRC | 07:45 | |
bandini | therve: oh thanks! I'll write my thoughts down and then you can hit me with a cluebat ;) | 07:46 |
*** shardy has joined #tripleo | 07:49 | |
jaosorior | mandre, bandini: Could you check this out https://review.openstack.org/#/c/516378/ ? | 07:57 |
*** aufi has joined #tripleo | 07:58 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add missing less file added by latest patternfly version https://review.openstack.org/505610 | 07:59 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Use ListView from patternfly-react for NodesListView https://review.openstack.org/505611 | 07:59 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Use ListView from patternfly-react for NodeDrives list https://review.openstack.org/505612 | 08:00 |
*** ykarel is now known as ykarel|lunch | 08:03 | |
*** ebarrera has joined #tripleo | 08:04 | |
jaosorior | mandre: got 10 min? | 08:05 |
*** gkadam has joined #tripleo | 08:05 | |
*** ebarrera has quit IRC | 08:09 | |
*** ebarrera has joined #tripleo | 08:09 | |
*** tesseract has joined #tripleo | 08:16 | |
*** ccamacho has joined #tripleo | 08:17 | |
*** ffiore has joined #tripleo | 08:17 | |
jfrancoa | adarazs|rover: o/ do you have a minute to give me a hand with an issue in the stable/pike upgrades job (multinode-containers-upgrade) ? | 08:18 |
adarazs|rover | jfrancoa: hi; what's the problem? | 08:19 |
jfrancoa | adarazs|rover: it seems the script used for updating overcloud repos is not complete in stable/pike legacy-tripleo-ci-centos-7-containers-multinode-upgrades job | 08:20 |
jfrancoa | adarazs|rover: http://logs.openstack.org/46/510846/1/check/legacy-tripleo-ci-centos-7-containers-multinode-upgrades/5759822/logs/undercloud/home/zuul/overcloud-repo.yaml.txt.gz | 08:20 |
jfrancoa | adarazs|rover: so the jobs fail because the overcloud repo can't be updated : http://logs.openstack.org/46/510846/1/check/legacy-tripleo-ci-centos-7-containers-multinode-upgrades/5759822/logs/undercloud/home/zuul/failed_upgrade.log.txt.gz | 08:21 |
*** etingof has quit IRC | 08:21 | |
jfrancoa | adarazs|rover: It seems that for some reason (I could not find where), we are setting the variable upgrade_overcloud_repo_template to overcloud-repo.yaml.j2 instead of overcloud-repo-tripleo-ci.yaml.j2 | 08:22 |
* adarazs|rover looks into it in a bit. | 08:23 | |
*** gfidente has joined #tripleo | 08:24 | |
*** gfidente has quit IRC | 08:24 | |
*** gfidente has joined #tripleo | 08:24 | |
jfrancoa | adarazs|rover: thanks | 08:26 |
*** pgadiya has joined #tripleo | 08:27 | |
*** d0ugal has quit IRC | 08:29 | |
*** d0ugal has joined #tripleo | 08:29 | |
bandini | therve, jaosorior: https://etherpad.openstack.org/p/heat-tripleo-oddity-pike this is the problem I am observing (I have the live env available where this is reproduceable) | 08:32 |
*** gfidente has quit IRC | 08:32 | |
*** jpena|off is now known as jpena | 08:33 | |
*** pdeore has quit IRC | 08:34 | |
*** gfidente has joined #tripleo | 08:34 | |
*** gfidente has quit IRC | 08:34 | |
*** gfidente has joined #tripleo | 08:34 | |
openstackgerrit | Merged openstack/tripleo-validations master: Use OrderedDict to sort the hostname before the alias https://review.openstack.org/516237 | 08:36 |
jaosorior | bandini: bluejeans? | 08:36 |
*** hewbrocca_afk is now known as hewbrocca | 08:37 | |
*** ffiore has quit IRC | 08:38 | |
bandini | jaosorior: that'd be awesome. https://redhat.bluejeans.com/4884650097/ | 08:38 |
mandre | bandini: do you have a service running on BM that could overwrite the hieradata or everything runs in containers? | 08:41 |
*** etingof has joined #tripleo | 08:41 | |
*** DJ_ has joined #tripleo | 08:42 | |
mandre | bandini: IIRC the current state of things, the hieradata are global to the host, so changing it somewhere may affect all the services and containers running on the node | 08:42 |
*** ykarel|lunch is now known as ykarel | 08:42 | |
jaosorior | mandre: he doesn't | 08:42 |
jaosorior | therve: you around? | 08:43 |
DJ_ | Hi | 08:44 |
*** amoralej|off is now known as amoralej | 08:44 | |
*** pdeore has joined #tripleo | 08:44 | |
*** jpich has joined #tripleo | 08:44 | |
therve | jaosorior, Yep | 08:45 |
jaosorior | therve: wanna join the bluejeans? :D | 08:45 |
therve | Sure :) | 08:45 |
DJ_ | I want to do an upgrade on RHOSP10, with some new environment file. Is it possible ? or should I pass the exact same environment parameters that were used at deployment time. | 08:46 |
*** oidgar has joined #tripleo | 08:46 | |
openstackgerrit | mathieu bultel proposed openstack/tripleo-validations stable/pike: Use OrderedDict to sort the hostname before the alias https://review.openstack.org/516559 | 08:46 |
*** ffiore has joined #tripleo | 08:48 | |
*** bogdando has joined #tripleo | 08:48 | |
*** gfidente has quit IRC | 08:49 | |
*** achadha has joined #tripleo | 08:54 | |
*** pdeore_ has joined #tripleo | 08:54 | |
*** pdeore has quit IRC | 08:55 | |
adarazs|rover | jfrancoa: I have no clue about the upgrades role so it takes a while to unravel how that is used... | 08:58 |
*** achadha has quit IRC | 08:58 | |
adarazs|rover | jfrancoa: FWIW it looks to me that the correct template is used: http://logs.openstack.org/46/510846/1/check/legacy-tripleo-ci-centos-7-containers-multinode-upgrades/5759822/job-output.txt.gz#_2017-10-24_05_09_32_004742 | 08:59 |
adarazs|rover | 'src': u'overcloud-repo-tripleo-ci.yaml.j2' | 09:00 |
jfrancoa | adarazs|rover: yes, I saw it exactly after I wrote you before...but I can't understand then why it is so short | 09:01 |
jfrancoa | adarazs|rover: it's seems like the openstack-tripleo-quickstart-extras package its using didn't have this patch https://github.com/openstack/tripleo-quickstart-extras/commit/cf15dafa4b3752b56b76767db175c800e31266a5 | 09:04 |
* jfrancoa is going to check tripleo-quickstart-extras version used | 09:04 | |
adarazs|rover | it should be used from master... | 09:05 |
adarazs|rover | not packaged | 09:05 |
*** akane has joined #tripleo | 09:08 | |
jfrancoa | adarazs|rover: http://logs.openstack.org/46/510846/1/check/legacy-tripleo-ci-centos-7-containers-multinode-upgrades/5759822/job-output.txt.gz#_2017-10-24_04_05_03_078224 do you know the way to know what does this version (tripleo-quickstart-extras-2.1.1.dev204) include? | 09:11 |
*** gfidente has joined #tripleo | 09:13 | |
*** mcornea has joined #tripleo | 09:14 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Enable keystone db sync to log to stdout https://review.openstack.org/516564 | 09:19 |
*** lucas-afk is now known as lucasagomes | 09:19 | |
*** aufi has quit IRC | 09:20 | |
jfrancoa | adarazs|rover: ok...this is strange...I took a job from master to compare to and the content in overcloud-repo.yaml is the same. But the job passed this time: http://logs.openstack.org/95/506595/4/check/legacy-tripleo-ci-centos-7-containers-multinode-upgrades/5272b87/logs/undercloud/home/zuul/overcloud-repo.yaml.txt.gz | 09:20 |
jfrancoa | adarazs|rover: do you think it's worth to open a launchpad bug? | 09:22 |
jaosorior | bogdando: does kolla have docs per container? | 09:25 |
jaosorior | bogdando: not sure where I would add these docs :/ | 09:25 |
bogdando | jaosorior: I'm not sure what docs it has | 09:25 |
jaosorior | mandre: ^^ | 09:25 |
openstackgerrit | Juan Badia Payno proposed openstack/puppet-tripleo master: [WIP] logging: support service_config_settings configuration mechanism https://review.openstack.org/500935 | 09:26 |
bogdando | jaosorior: https://docs.openstack.org/kolla/latest/ seems like there is no docs for env vars | 09:26 |
*** ffiore has quit IRC | 09:28 | |
*** jistr|mtgs is now known as jistr | 09:29 | |
*** ffiore has joined #tripleo | 09:29 | |
jaosorior | bogdando, mandre: When you get some time, can you also check this one https://review.openstack.org/#/c/516378/ ? | 09:29 |
mandre | bogdando, jaosorior: right, there is no such thing for now... I got a local change that added some of them that's been sitting on my drive for way too long | 09:30 |
bogdando | no worries | 09:30 |
openstackgerrit | yatin proposed openstack/tripleo-quickstart master: Fix delorean_hash for newton and ocata promotion https://review.openstack.org/516567 | 09:32 |
ykarel | adarazs|rover, ^^ | 09:32 |
adarazs|rover | jfrancoa: I don't see what connection does https://github.com/openstack/tripleo-quickstart-extras/commit/cf15dafa4b3752b56b76767db175c800e31266a5 have with your problem. | 09:33 |
adarazs|rover | jfrancoa: also -- quickstart-extras is *not* from any package, it get cloned from source from master during the job run. | 09:33 |
bogdando | jaosorior: yay, it's all green, good to go | 09:33 |
adarazs|rover | unless the upgrades jobs do something different | 09:33 |
*** aufi has joined #tripleo | 09:34 | |
*** psahoo has quit IRC | 09:35 | |
jaosorior | bogdando, mandre: thanks | 09:35 |
jfrancoa | adarazs|rover: if you see the patch, there was a conditional before in line 6. If target_upgrade_version was not master (which is this case, as the target_upgrade_version in stable/pike is 'pike') then we would end up having only this exact content in overcloud-repo.yaml http://logs.openstack.org/46/510846/1/check/legacy-tripleo-ci-centos-7-containers-multinode-upgrades/5759822/logs/undercloud/home/zuul/overcloud-repo.yaml.txt.gz | 09:37 |
jfrancoa | ng all content from lines 6 to 105 | 09:37 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Extract all errors from tripleo deployment https://review.openstack.org/516402 | 09:38 |
*** shardy has quit IRC | 09:42 | |
*** shardy has joined #tripleo | 09:42 | |
ccamacho | folks mind to do a quick review here https://review.openstack.org/#/c/513405/ ?? | 09:42 |
ccamacho | already +2 and passing CI | 09:43 |
*** dsariel__ has joined #tripleo | 09:44 | |
adarazs|rover | jfrancoa: which change are these logs from? | 09:45 |
*** owalsh- is now known as owalsh | 09:47 | |
jfrancoa | adarazs|rover: this one: https://review.openstack.org/#/c/510846/ | 09:49 |
jfrancoa | adarazs|rover: and the same job (multinode-containers-upgrade) does fail for the same reason in this other stable/pike change https://review.openstack.org/#/c/512466/ (which does not modify anything related to upgrades). | 09:51 |
*** pgadiya has quit IRC | 09:52 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor Register nodes dialog to use redux-form https://review.openstack.org/504903 | 09:53 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add NetIpMap to hieradata for *ExtraConfig overrides https://review.openstack.org/514707 | 09:54 |
*** mandre has quit IRC | 09:55 | |
*** mandre_ has joined #tripleo | 09:56 | |
*** mandre_ is now known as mandre | 09:56 | |
*** brault has quit IRC | 09:56 | |
adarazs|rover | jfrancoa: so yeah, please open a but, not sure what's going on. | 09:56 |
*** salmankhan has joined #tripleo | 09:57 | |
therve | bandini, Found it! | 09:57 |
therve | bandini, https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/pacemaker/clustercheck.yaml#L62 | 09:57 |
jfrancoa | adarazs|rover: ok, thanks for the help. I'll try to dig up a little bit more, this overcloud-upgrade role it's a bit painful | 09:57 |
adarazs|rover | yep. | 09:58 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Remove str_replace for bootstrap_server_id in deploy_steps.j2 https://review.openstack.org/513449 | 09:58 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Select first node as bootstrap node not using name https://review.openstack.org/513450 | 09:58 |
bandini | therve: holy crap, batman! not sure why I don't see it in my upstream envs, but I'll investigate more | 09:59 |
bandini | thanks! | 09:59 |
therve | bandini, I think there is a catch, it depends on the service order | 10:00 |
bandini | therve: aah that would explain it, yes! | 10:00 |
*** leseb_ has joined #tripleo | 10:00 | |
therve | I don't think it's stable? It seems to be a dictionary | 10:00 |
*** rickflare has joined #tripleo | 10:00 | |
bandini | ah righto | 10:00 |
bandini | yeah this would explain this issue quite well | 10:00 |
bandini | I'll experiment a bit | 10:00 |
*** jistr_ has joined #tripleo | 10:00 | |
*** agurenko_ has joined #tripleo | 10:00 | |
*** isq_ has joined #tripleo | 10:01 | |
*** leseb has quit IRC | 10:01 | |
*** jistr has quit IRC | 10:01 | |
*** jschlueter has quit IRC | 10:01 | |
*** agurenko has quit IRC | 10:01 | |
*** thrash|g0ne has quit IRC | 10:01 | |
*** rwsu has quit IRC | 10:01 | |
*** migi has quit IRC | 10:01 | |
*** rickflare2 has quit IRC | 10:01 | |
*** rwsu has joined #tripleo | 10:02 | |
*** migi has joined #tripleo | 10:02 | |
*** isq has quit IRC | 10:03 | |
lvdombrkr | hello folks, i use controllers HA and have problems with galera cluster..after i restarted all controllers, mariadb ar down on all controllers and in logs i see: 2017-10-31 9:58:32 139730676390080 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | 10:03 |
lvdombrkr | at gcomm/src/pc.cpp:connect():162 | 10:03 |
lvdombrkr | 10:03 | |
lvdombrkr | 017-10-31 9:58:32 139730676390080 [ERROR] Aborting | 10:03 |
*** thrash has joined #tripleo | 10:03 | |
*** thrash has quit IRC | 10:03 | |
*** thrash has joined #tripleo | 10:03 | |
lvdombrkr | any ideas? | 10:03 |
*** zoli has quit IRC | 10:04 | |
*** gfidente has quit IRC | 10:05 | |
*** pgadiya has joined #tripleo | 10:06 | |
*** pblaho has joined #tripleo | 10:06 | |
*** zoli has joined #tripleo | 10:06 | |
*** iranzo has quit IRC | 10:08 | |
*** gfidente has joined #tripleo | 10:08 | |
*** gfidente has quit IRC | 10:08 | |
*** gfidente has joined #tripleo | 10:08 | |
*** pblaho has quit IRC | 10:09 | |
*** brault has joined #tripleo | 10:09 | |
*** pblaho has joined #tripleo | 10:09 | |
*** agurenko_ is now known as agurenko | 10:10 | |
*** ratailor has quit IRC | 10:11 | |
*** ipsecguy has quit IRC | 10:12 | |
*** gfidente has quit IRC | 10:13 | |
*** gfidente has joined #tripleo | 10:16 | |
*** gfidente has quit IRC | 10:16 | |
*** gfidente has joined #tripleo | 10:16 | |
*** ipsecguy has joined #tripleo | 10:18 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: DNM - WIP testing OVB job speed improvements https://review.openstack.org/500942 | 10:21 |
*** akane has quit IRC | 10:21 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: DNM - WIP testing OVB job speed improvements https://review.openstack.org/500942 | 10:23 |
*** pgadiya has quit IRC | 10:24 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: DNM - WIP testing OVB job speed improvements https://review.openstack.org/500942 | 10:24 |
*** brault has quit IRC | 10:24 | |
*** udesale has quit IRC | 10:26 | |
ccamacho | jaosorior thanks man! how are you doing? | 10:27 |
*** iranzo has joined #tripleo | 10:27 | |
*** gfidente has quit IRC | 10:29 | |
*** gfidente has joined #tripleo | 10:32 | |
*** gfidente has quit IRC | 10:32 | |
*** gfidente has joined #tripleo | 10:32 | |
*** aufi has quit IRC | 10:32 | |
*** jschlueter|znc has joined #tripleo | 10:35 | |
*** brault has joined #tripleo | 10:38 | |
*** pgadiya has joined #tripleo | 10:38 | |
*** brault has quit IRC | 10:43 | |
openstackgerrit | Carlos Camacho proposed openstack/python-tripleoclient master: Add openstack undercloud backup https://review.openstack.org/466213 | 10:44 |
*** aufi has joined #tripleo | 10:46 | |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Tripleoclient unified queue name. https://review.openstack.org/509902 | 10:53 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-specs master: Fix link in Queens major upgrade spec https://review.openstack.org/516611 | 10:59 |
d0ugal | jpich: Hey, since you opened the bug - would you mind taking a look at https://review.openstack.org/#/c/511249/ ? | 10:59 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Neutron] https://review.openstack.org/516612 | 10:59 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Heat] https://review.openstack.org/516613 | 11:00 |
*** pdeore_ has quit IRC | 11:00 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: os-net-config not run when conf is empty and re-introduce exception. https://review.openstack.org/516614 | 11:01 |
*** pdeore_ has joined #tripleo | 11:01 | |
jpich | d0ugal: Sure, thanks for the heads-up! | 11:07 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Aodh] https://review.openstack.org/516616 | 11:07 |
d0ugal | jpich: thank you! | 11:08 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Gnocchi] https://review.openstack.org/516617 | 11:08 |
*** atoth has joined #tripleo | 11:08 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Mistral] https://review.openstack.org/516618 | 11:08 |
gfidente | shardy back to ceph multiple clusters, do you have pointers to the code which implements the spine/leaf scenario to push different configs on different nodes with same role? | 11:11 |
shardy | gfidente: Hey, sure it's https://review.openstack.org/#/c/514707/ but it really only works if you can use hiera interpolation to set the per-node bind IPs for the different leaf networks | 11:12 |
gfidente | shardy ah yeah okay | 11:13 |
gfidente | I saw that one | 11:13 |
gfidente | well no in ceph scenario it's not just the binding ip | 11:14 |
*** ansmith has quit IRC | 11:14 | |
shardy | gfidente: I don't think we have a general solution to this yet, other than using RoleNameExtraConfig to override specfic settings per role | 11:14 |
shardy | gfidente: yeah I figured it'd be more difficult in the ceph case, happy to try to figure out a solution but I don't have one right now | 11:14 |
gfidente | shardy yeah I don't have one either | 11:14 |
gfidente | was trying to figure how to approach it | 11:15 |
*** salmankhan has quit IRC | 11:15 | |
shardy | gfidente: can we put the per-node data needed into the dynamic inventory, then map that into the vars needed for ceph-ansible? | 11:15 |
shardy | gfidente: any examples of the data we need? | 11:15 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: os-net-config not run when conf is empty and re-introduce exception. https://review.openstack.org/516614 | 11:15 |
gfidente | shardy so I think we'll have to run ceph-ansible multiple times with a different set of IPs for each role | 11:17 |
gfidente | it is literally deploying multiple clusters | 11:18 |
*** rcernin has quit IRC | 11:18 | |
gfidente | it's not a customization for some of the nodes | 11:18 |
shardy | gfidente: would it be easier to deploy the clusters first and wire in multiple external clusters to the openstack environment? | 11:18 |
gfidente | shardy oh they aren't external | 11:18 |
shardy | or are there requirements around hyperconvergence/co-location with the openstack stuff? | 11:18 |
*** salmankhan has joined #tripleo | 11:18 | |
gfidente | yeah the ultimate goal is to have an independent ceph cluster with each openstack AZ | 11:19 |
gfidente | so the name of the AZ could be the scaling factor for the entire set of settings | 11:19 |
gfidente | including service name so that we trigger ceph-ansible multiple times with a different inventoryu | 11:20 |
shardy | gfidente: Hum, Ok so the idea is to have a custom role per az? | 11:20 |
gfidente | well it's the only thing I could think of at leat | 11:20 |
*** pdeore has joined #tripleo | 11:20 | |
shardy | yeah we don't really have a strong abstraction for az's in tripleo yet | 11:20 |
fultonj | bugzy: regarding http://paste.openstack.org/show/625022/, please check if you have this patch https://review.openstack.org/#/c/514584 | 11:20 |
openstackgerrit | Merged openstack/tripleo-validations stable/pike: Use OrderedDict to sort the hostname before the alias https://review.openstack.org/516559 | 11:21 |
shardy | gfidente: so custom roles seems reasonable, but we're missing a way to associate the different groups of osd/mon services I guess | 11:22 |
openstackgerrit | Merged openstack/tripleo-specs master: Fix link in Queens major upgrade spec https://review.openstack.org/516611 | 11:22 |
gfidente | shardy right unless with mixin that with actual roles_data ? | 11:22 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: os-net-config not run when conf is empty and re-introduce exception. https://review.openstack.org/516614 | 11:22 |
*** pdeore_ has quit IRC | 11:22 | |
shardy | gfidente: well we do have the concept of tags in roles_data, maybe we could use that | 11:22 |
shardy | gfidente: we'd need to expose those tags from heat I guess (j2 render them into some outputs) then we could set per role tags that ansible could use to group things in the inventory? | 11:24 |
shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data.yaml#L13 | 11:24 |
*** panda|ruck|off is now known as panda|ruck | 11:24 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: DO NOT MERGE - Testing specific DLRN hash tag https://review.openstack.org/516624 | 11:24 |
*** agurenko is now known as agurenko_ | 11:25 | |
*** ratailor has joined #tripleo | 11:27 | |
fultonj | shardy gfidente so assuming you had tags like ceph-cluster1 and ceph-cluster2, for different custom roles and had assigned diff hosts to those roles, then the ceph-ansible workflow in tripleo-common could make different sets of nodes and the workflow could run more than once per group? | 11:27 |
*** gfidente has quit IRC | 11:27 | |
shardy | fultonj: yes that's what I was thinking | 11:27 |
fultonj | so some yaql in heat just needs to get the tags into the mistral environment so it can act that way | 11:28 |
fultonj | seems good in theory | 11:28 |
fultonj | it's my first time seeing the tags in roles_data | 11:29 |
shardy | fultonj: I think we just need to dump the data via j2 when the template is rendered, sec I'll push a patch | 11:29 |
*** gfidente has joined #tripleo | 11:30 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Expose role tags via heat RoleTags output https://review.openstack.org/516626 | 11:32 |
shardy | fultonj, gfidente: ^^ I guess you may need to pass the same data into the workflows | 11:33 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Mixed-1] https://review.openstack.org/516627 | 11:33 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Nova] https://review.openstack.org/516628 | 11:34 |
*** noslzzp has joined #tripleo | 11:38 | |
fultonj | shardy: thanks. how the data is passed isn't clear to me, but i see it getting collected per role in your patch. | 11:38 |
fultonj | gfidente probably knows (but i shouldn't speak for him :) | 11:39 |
shardy | fultonj: we'd do the same trick e.g here: | 11:40 |
shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/common/deploy-steps.j2#L166 | 11:40 |
shardy | fultonj: the output I added would enable the data to be added to the dynamic tripleo-ansible-inventory though, which is the main way I personally drive ansible things with tripleo | 11:40 |
*** agurenko_ is now known as agurenko | 11:41 | |
shardy | and I know that's the direction we're headed e.g the "split stack" model, but I'm not quite clear how that relates to the worflow steps for ceph atm | 11:41 |
shardy | I assume at some point we'll rework the ceph integration to use external_workflow_tasks? | 11:41 |
gfidente | shardy yep | 11:42 |
gfidente | that was the idea from ptg | 11:42 |
shardy | gfidente: ack, Ok thanks for confirming | 11:42 |
shardy | that's working quite well for driving the kubespray ansible installer | 11:42 |
openstackgerrit | Merged openstack/python-tripleoclient stable/pike: Autodetect insecure registry in container image prepare https://review.openstack.org/516452 | 11:45 |
openstackgerrit | John Fulton proposed openstack/tripleo-docs master: DockerCephDaemonImage is now optional for Ceph deployments https://review.openstack.org/515446 | 11:46 |
openstackgerrit | Alexey Morlang proposed openstack/tripleo-heat-templates master: Merge from from Juniper THT for opencontrail https://review.openstack.org/516630 | 11:48 |
*** iranzo has quit IRC | 11:48 | |
*** brault has joined #tripleo | 11:49 | |
*** pchavva has joined #tripleo | 11:49 | |
*** iranzo has joined #tripleo | 11:50 | |
*** iranzo has quit IRC | 11:50 | |
*** iranzo has joined #tripleo | 11:50 | |
*** ratailor has quit IRC | 11:50 | |
*** pgadiya has quit IRC | 11:51 | |
*** liverpooler has joined #tripleo | 11:52 | |
*** jprovazn has quit IRC | 11:52 | |
*** brault has quit IRC | 11:53 | |
*** udesale has joined #tripleo | 11:54 | |
*** jprovazn has joined #tripleo | 11:55 | |
beagles | gfidente, fultonj: can you give https://review.openstack.org/#/c/508195/ a quick once over to see if there is something major off-track there. I figure I'll might need a couple of revisions to adapt to functional changes on the patches it depends on but I'd like to get an early check for general correctness in approach | 11:58 |
fultonj | beagles: sure, i'll look at it this morning | 11:59 |
beagles | fultonj, thanks! | 11:59 |
*** dougbtv has joined #tripleo | 12:00 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update roles listing https://review.openstack.org/509415 | 12:01 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor ImportPlanCard into ActionCard https://review.openstack.org/512265 | 12:01 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: [WIP] Select Roles feature https://review.openstack.org/512266 | 12:01 |
beagles | shardy, jaosorior: I addressed your feedback on https://review.openstack.org/#/c/490082/ but missed you on the question of whether the server_names line should have the default value for the hiera lookup removed as well | 12:02 |
*** abregman has quit IRC | 12:03 | |
beagles | shardy, jaosorior: I updated as if it should be since it seemed a similar thing | 12:03 |
shardy | beagles: ack thanks for the update - lgtm! | 12:07 |
beagles | shardy, thx! | 12:07 |
*** shardy is now known as shardy_lunch | 12:07 | |
sri_ | beagles: Hi, I am getting this ssl error while creating lb with Octavia any ideas ? worker.log Could not connect to instance. Retrying.: SSLError: [SSL] PEM lib (_ssl.c:2535) | 12:07 |
*** pdeore has quit IRC | 12:08 | |
sri_ | beagles: amphora vm logs , amphora-agent.log Invalid request from ip=::ffff:192.168.199.62: [SSL: SSL_HANDSHAKE_FAILURE] ssl handshake failure (_ssl.c:1783) | 12:10 |
beagles | sri_, 1s | 12:11 |
*** raildo has joined #tripleo | 12:11 | |
sri_ | beagles: ok, amphora vm messages logs : ERROR octavia.amphorae.backends.health_daemon.health_sender [-] No controller address found. Unable to send heartbeat.: Empty | 12:13 |
*** dprince has joined #tripleo | 12:13 | |
beagles | sri_, so something happened with the post deployment where the controller_ip_list wasn't updated properly | 12:14 |
*** leitan has joined #tripleo | 12:15 | |
*** agurenko is now known as agurenko_ | 12:17 | |
*** akrivoka has joined #tripleo | 12:18 | |
sri_ | beagles: ok, so i can debug the post deployment script to see if it's getting correct IP address of controllers | 12:21 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart-extras master: Include 'queens' as target version for upgrade. https://review.openstack.org/516647 | 12:23 |
*** DJ_ has quit IRC | 12:23 | |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Fix iptables rules override bug in clustercheck docker service https://review.openstack.org/516649 | 12:25 |
*** masco has joined #tripleo | 12:26 | |
*** rhallisey has joined #tripleo | 12:28 | |
openstackgerrit | Alexey Morlang proposed openstack/puppet-tripleo master: Merge from from Juniper repo for opencontrail https://review.openstack.org/516651 | 12:30 |
*** pdeore has joined #tripleo | 12:30 | |
sri_ | beagles: it seems script get the controller ip address right ! http://paste.openstack.org/show/625085/ | 12:31 |
*** catintheroof has joined #tripleo | 12:31 | |
bandini | jaosorior, therve, mandre: ^ is the tested fix for this morning's oddity (therve++) | 12:31 |
*** catintheroof has quit IRC | 12:32 | |
*** catintheroof has joined #tripleo | 12:32 | |
*** bfournie has quit IRC | 12:32 | |
*** bfournie has joined #tripleo | 12:32 | |
*** morazi has joined #tripleo | 12:32 | |
*** ansmith has joined #tripleo | 12:34 | |
*** rlandy has joined #tripleo | 12:34 | |
*** trown|outtypewww is now known as trown | 12:34 | |
*** bfournie has quit IRC | 12:36 | |
*** gkadam has quit IRC | 12:37 | |
*** ecerquei_ has joined #tripleo | 12:38 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Run Octavia configuration on the overcloud https://review.openstack.org/508195 | 12:39 |
*** jcoufal has joined #tripleo | 12:39 | |
*** tosky has joined #tripleo | 12:44 | |
*** jmelvin has joined #tripleo | 12:45 | |
mandre | bandini: have you ever consider a career in book publishing? you're commit messages read like novels :) | 12:46 |
*** lucasagomes is now known as lucas-hungry | 12:47 | |
*** rbowen has joined #tripleo | 12:47 | |
*** toure_biab is now known as toure | 12:47 | |
*** Dinesh_Bhor has quit IRC | 12:47 | |
*** udesale has quit IRC | 12:49 | |
bandini | mandre: ahahah it is because I am going senile. So I can look at an older commit and know wth is going on ;) | 12:49 |
*** udesale has joined #tripleo | 12:49 | |
*** shardy_lunch is now known as shardy | 12:49 | |
*** jpena is now known as jpena|lunch | 12:51 | |
*** lblanchard has joined #tripleo | 12:52 | |
*** ecerquei_ has quit IRC | 12:56 | |
*** udesale has quit IRC | 12:56 | |
*** ecerquei has joined #tripleo | 12:56 | |
*** udesale has joined #tripleo | 12:56 | |
*** gfidente has quit IRC | 12:56 | |
*** mandre is now known as mandre_afk | 12:56 | |
*** bkopilov has quit IRC | 12:57 | |
*** janki has quit IRC | 12:58 | |
*** ffiore has quit IRC | 13:02 | |
*** gfidente has joined #tripleo | 13:04 | |
jaosorior | ccamacho: all good here. you? | 13:04 |
jaosorior | bandini: looking | 13:05 |
jaosorior | beagles: what was the question again? | 13:06 |
*** bfournie has joined #tripleo | 13:07 | |
beagles | jaosorior, the feedback on https://review.openstack.org/#/c/490082/4/manifests/haproxy.pp was that the $controller_hosts_real wasn't needed any longer | 13:08 |
jaosorior | right | 13:08 |
beagles | jaosorior, I was checking to see if the same applied to the following line - ie. that $controller_hosts_names_real was also no longer necessary | 13:09 |
jaosorior | yep | 13:09 |
jaosorior | it does | 13:09 |
beagles | jaosorior, ok.. I removed it also anyways assuming that was the case | 13:09 |
*** tzumainn has joined #tripleo | 13:10 | |
*** jprovazn has quit IRC | 13:11 | |
*** aputtur_ has joined #tripleo | 13:11 | |
*** jprovazn has joined #tripleo | 13:12 | |
jaosorior | shardy: what about the controller_virtual_ip? | 13:12 |
*** pkovar has joined #tripleo | 13:14 | |
*** ffiore has joined #tripleo | 13:15 | |
shardy | jaosorior: yeah that has a similar problem but it's not such a bad default, because it'll point to the ctlplane e.g internal connectivity would still work | 13:16 |
shardy | jaosorior: so I didn't block on it | 13:16 |
shardy | jaosorior: the issue with *_ips is the list of ips would potentially be completely wrong | 13:16 |
*** jcoufal_ has joined #tripleo | 13:16 | |
jaosorior | right | 13:18 |
*** jcoufal has quit IRC | 13:18 | |
jaosorior | beagles: well, should octavia be always listening on both the octavia VIP (e.g. the internal api network) and the ctlplane network? | 13:18 |
*** aputtur_ has quit IRC | 13:19 | |
*** newmember has joined #tripleo | 13:19 | |
*** aputtur_ has joined #tripleo | 13:20 | |
*** bobh has joined #tripleo | 13:23 | |
jtomasek | d0ugal: hi, I am trying to test new workflow so I pulled the patch and updated workbook using mistral workbook-update but the new workflow is not in workflow-list, any Idea what I might be doing wrong? https://review.openstack.org/#/c/509832/7/workbooks/plan_management.yaml | 13:23 |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Improve node count indicator in roles step https://review.openstack.org/516674 | 13:27 |
EmilienM | hello | 13:28 |
EmilienM | panda|ruck, adarazs|rover: what's up? | 13:28 |
abishop | matbu: pls take another look at https://review.openstack.org/513202 (gfidente and I commented) | 13:28 |
adarazs|rover | EmilienM: if you have a few minutes we're on https://bluejeans.com/u/gcerami/ discussing the things that are up. | 13:28 |
EmilienM | adarazs|rover: on my way | 13:29 |
beagles | jaosorior, I don't think it would run on the ctrlplane as I understand it | 13:30 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: [Newton only] Fix double sed backup during upgrade. https://review.openstack.org/516676 | 13:31 |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: DO NOT MERGE - Testing specific DLRN hash tag https://review.openstack.org/516624 | 13:32 |
jaosorior | beagles: alright, could you change the hiera to not include the ctlplane vip in the unique statement? only leave the hiera call and the default value | 13:33 |
jaosorior | brb | 13:33 |
beagles | jaosorior, yup | 13:33 |
*** jaosorior has quit IRC | 13:33 | |
*** skramaja has quit IRC | 13:34 | |
jpich | jtomasek: Perhaps you found a new bug, I wonder if the indentation should only be two spaces before the new workflow name | 13:37 |
openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud stable/pike: heat-dbsync: increase timeout to 15 minutes https://review.openstack.org/516680 | 13:37 |
*** abregman_ has joined #tripleo | 13:38 | |
openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud stable/ocata: heat-dbsync: increase timeout to 15 minutes https://review.openstack.org/516682 | 13:40 |
*** lucas-hungry is now known as lucasagomes | 13:41 | |
openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud stable/newton: heat-dbsync: increase timeout to 15 minutes https://review.openstack.org/516683 | 13:41 |
jtomasek | jpich: hmm good point | 13:42 |
openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo master: Add Octavia API endpoint to haproxy https://review.openstack.org/490082 | 13:42 |
openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud stable/ocata: heat-dbsync: increase timeout to 15 minutes https://review.openstack.org/516682 | 13:42 |
*** lvdombrkr has quit IRC | 13:43 | |
*** lvdombrkr has joined #tripleo | 13:43 | |
*** ratailor has joined #tripleo | 13:45 | |
d0ugal | jtomasek, jpich - looking. | 13:46 |
jtomasek | d0ugal, jpich: the indentation on line 983 seems to be off | 13:47 |
d0ugal | jtomasek: I don't even have that line number :) | 13:47 |
jtomasek | *893 | 13:47 |
jtomasek | d0ugal: it's in that patch https://review.openstack.org/#/c/509832/7/workbooks/plan_management.yaml | 13:47 |
d0ugal | jtomasek: got it, I do see a 893 :) | 13:48 |
d0ugal | jtomasek, jpich - it was totally broken when I reviewed it the time before last, so I guess it still hasn't been tested at all | 13:48 |
*** amoralej is now known as amoralej|lunch | 13:48 | |
jpich | hm workbook-update seems to say "invalid DSL" for me here, maybe a couple more things to fix up yeah | 13:49 |
jtomasek | d0ugal: I see, thing is that when I try to update the same workbook on master, I still see only 5 plan_management workflows, but that workbook contains much more, I have no idea what am I missing here | 13:49 |
*** ratailor is now known as rtailor | 13:49 | |
d0ugal | jtomasek: after that indentation change it still failed? | 13:50 |
d0ugal | I can try updating it. | 13:50 |
EmilienM | tripleo meeting in 10 min, feel free to add topics on https://etherpad.openstack.org/p/tripleo-meeting-items | 13:50 |
jtomasek | d0ugal: It 'failed' on master too | 13:51 |
matbu | abishop: yep i saw your comment | 13:51 |
d0ugal | jtomasek: oh, that is interesting. No errors? | 13:51 |
*** brault has joined #tripleo | 13:51 | |
*** jpena|lunch is now known as jpena | 13:52 | |
jtomasek | d0ugal: none, passes just fine | 13:52 |
d0ugal | jtomasek: ooft, that patch has a nasty conflict. | 13:53 |
rtailor | shardy, you around ? | 13:53 |
openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Refactor undercloud deploy to use Ansible. https://review.openstack.org/515967 | 13:54 |
rtailor | shardy, I am working on enabling TLS for ec2api and I have made changes available here https://review.openstack.org/#/c/509392/ and https://review.openstack.org/#/c/509393/ | 13:55 |
d0ugal | jtomasek: What do you use to load the workbooks? | 13:55 |
d0ugal | jtomasek: I have 8 on my fairly recent quickstart env | 13:56 |
gfidente | EmilienM are you running the tripleo meeting today/ | 13:56 |
gfidente | ? | 13:56 |
rtailor | shardy, To test it, I want to have those changes in my overcloud, for that I am re-deploying my overcloud with above changes on overcloud. | 13:56 |
jtomasek | d0ugal: 'openstack workbook update workbooks/plan_management.yaml' | 13:56 |
gfidente | EmilienM or mwhahaha? | 13:56 |
EmilienM | gfidente: nope, mwhahaha is back | 13:56 |
gfidente | ack | 13:56 |
EmilienM | gfidente: good reminder though | 13:56 |
EmilienM | gfidente: please don't tell mwhahaha I ran it late last week :P | 13:56 |
jtomasek | d0ugal: can you 'openstack workflow list | grep plan_management' please? | 13:56 |
rtailor | shardy, For t-h-t related chagnes, I have done at /usr/share/opentack-tripleo-heat-templates and for puppet-tripleo, I have followed http://hardysteven.blogspot.in/2016/08/tripleo-deploy-artifacts-and-puppet.html | 13:57 |
*** oanson has quit IRC | 13:57 | |
d0ugal | jtomasek: http://paste.openstack.org/show/625110/ | 13:57 |
d0ugal | jtomasek: my env is 11 days old | 13:57 |
*** oanson has joined #tripleo | 13:57 | |
rtailor | shardy, I am getting Timedout everytime, for overcloud.AllNodesDeploySteps.ComputeDeployment_Step4.0: resource creation. | 13:58 |
*** pdeore has quit IRC | 13:58 | |
jtomasek | d0ugal: ok, those are exactly the ones I am missing | 13:58 |
jtomasek | d0ugal: and I see only the newly added ones (already on master) | 13:58 |
rtailor | shardy, I cant see any service running on overcloud-controller. | 13:58 |
d0ugal | jtomasek: oh, that is strange. I guess I'll try updating to the version in master. | 13:59 |
jtomasek | d0ugal: that would help, yeah | 13:59 |
mwhahaha | #startmeeting tripleo | 14:00 |
mwhahaha | #topic agenda | 14:00 |
mwhahaha | * Review past action items | 14:00 |
mwhahaha | * One off agenda items | 14:00 |
mwhahaha | * Squad status | 14:00 |
mwhahaha | * Bugs & Blueprints | 14:00 |
openstack | Meeting started Tue Oct 31 14:00:11 2017 UTC and is due to finish in 60 minutes. The chair is mwhahaha. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
mwhahaha | * Projects releases or stable backports | 14:00 |
mwhahaha | * Specs | 14:00 |
mwhahaha | * open discussion | 14:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
mwhahaha | Anyone can use the #link, #action and #info commands, not just the moderatorǃ | 14:00 |
mwhahaha | Hi everyone! who is around today? | 14:00 |
*** openstack changes topic to " (Meeting topic: tripleo)" | 14:00 | |
openstack | The meeting name has been set to 'tripleo' | 14:00 |
*** agurenko_ is now known as agurenko | 14:00 | |
*** openstack changes topic to "agenda (Meeting topic: tripleo)" | 14:00 | |
fultonj | o/ | 14:00 |
akrivoka | o/ | 14:00 |
ccamacho | \o/ | 14:00 |
rtailor | shardy, even rabbitmq is also not running. | 14:00 |
*** jokke_ has joined #tripleo | 14:00 | |
jtomasek | o/ | 14:00 |
beagles | o- | 14:00 |
atoth | o/ | 14:00 |
EmilienM | o/ | 14:01 |
dpeacock | o/ | 14:01 |
jfrancoa | o/ | 14:01 |
d0ugal | o/ | 14:01 |
panda|ruck | o/ | 14:01 |
owalsh | o/ | 14:01 |
trown | o/ | 14:01 |
*** janki has joined #tripleo | 14:01 | |
matbu | o/ | 14:01 |
gfidente | o/ | 14:01 |
chem | o/ | 14:02 |
jpich | o/ | 14:02 |
saneax | o/ | 14:02 |
mwhahaha | #topic review past action items | 14:02 |
*** openstack changes topic to "review past action items (Meeting topic: tripleo)" | 14:02 | |
mwhahaha | EmilienM to prepare an etherpad for tripleo onboarding session in Sydney | 14:03 |
EmilienM | oops | 14:03 |
EmilienM | let me prepare it today | 14:03 |
mwhahaha | #action EmilienM to prepare an etherpad for tripleo onboarding session in Sydney | 14:03 |
sshnaidm | o/ | 14:03 |
mwhahaha | (postponed) merge https://review.openstack.org/#/c/512569 (gfidente) | 14:03 |
jrist | o/ | 14:03 |
mwhahaha | not merged yet | 14:03 |
EmilienM | #link https://etherpad.openstack.org/p/SYD-forum-tripleo-onboarding | 14:03 |
mwhahaha | but +A so it should merge today, i'll keep an eye on it | 14:03 |
gfidente | mwhahaha thanks | 14:03 |
gfidente | me too | 14:04 |
mwhahaha | team to review https://review.openstack.org/#/c/511509/ asap | 14:04 |
mwhahaha | is pending merge | 14:04 |
mwhahaha | (still) | 14:04 |
mwhahaha | ugh the ci gate queue is 20 hours+ | 14:04 |
* mwhahaha makes note for later | 14:04 | |
rtailor | owalsh, you around ? | 14:04 |
mwhahaha | (postponed) marios and matbu to provide an upgrade workflow status | 14:04 |
mwhahaha | marios, matbu: update? | 14:05 |
shardy | o/ sorry late | 14:05 |
*** mandre_afk is now known as mandre | 14:05 | |
marios | mwhahaha: o/ no, we discussed the overall workflow last week | 14:05 |
matbu | mwhahaha: hey, so we have been in a upgrade meetup last week | 14:05 |
owalsh | rtailor: yea, what's up? | 14:06 |
matbu | mwhahaha: we have a lot of action items to adressed, i think the next week we can have some good input to share with the team | 14:06 |
marios | mwhahaha: to be honest i'm not sure what the task is for.. is this for tracking major upgrade workflow tasks (in which case this is a good start https://bugs.launchpad.net/tripleo/+bug/1728905 ) | 14:06 |
openstack | Launchpad bug 1728905 in tripleo "RFE: Feature parity for CLI and UI via mistral/tripleo-common for Queens major upgrade" [High,Triaged] - Assigned to Marios Andreou (marios-b) | 14:06 |
*** ykarel has quit IRC | 14:06 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Gate test - do not merged https://review.openstack.org/494593 | 14:06 |
mwhahaha | marios: the original ask was to provide current status of workflow since we wanted to make sure that it's established for folks to start helping out with ASAP | 14:06 |
rtailor | owalsh, The tls stuff, I couldn't deploy overcloud with my changes, its failing everytime due to timeout issue, And I couldn't even get any service running on overcloud-controller | 14:07 |
chem | mwhahaha: we have some documentation comming about the expected workflow, a dev doc kind of thing | 14:07 |
rtailor | owalsh, the rabbitmq is also not running and on overcloud compute, I could see rabbitmq not reachable error messages. | 14:07 |
mwhahaha | k so maybe next week provide a summary for everyone | 14:07 |
marios | mwhahaha: ack ok this makes sense... and as others are pointing out it was one of the main things that came up last week too so we'll have action on it soon. will likely be combination of things, docs for starters | 14:07 |
chem | mwhahaha: how to for main course | 14:08 |
chem | mwhahaha: and ci for desert | 14:08 |
mwhahaha | #action marios, matbu, chem provide doc/status of upgrade workflow | 14:08 |
marios | chem: :D | 14:08 |
rtailor | owalsh, If you want to look at my setup, which I tried to deploy today. | 14:08 |
mwhahaha | k we'll revisit next week :) | 14:08 |
matbu | mwhahaha: thx :) | 14:08 |
mwhahaha | (postponed) document that upgrades on baremetal aren't tested in Pike and Queens - I think done in https://review.openstack.org/#/c/496223/ | 14:08 |
owalsh | rtailor: yea, I can take a look | 14:08 |
mwhahaha | ok that's all on the past action items | 14:09 |
mwhahaha | #topic one off agenda items | 14:09 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-meeting-items | 14:09 |
*** openstack changes topic to "one off agenda items (Meeting topic: tripleo)" | 14:09 | |
mwhahaha | (gfidente) is anybody else interested into deploying multiple instances of a service configured differently on different nodes? | 14:09 |
*** amodi has joined #tripleo | 14:09 | |
mwhahaha | #link https://blueprints.launchpad.net/tripleo/+spec/deploy-multiple-ceph-clusters | 14:09 |
gfidente | mwhahaha so let me introduce a bit better the topic | 14:09 |
shardy | we discussed this earlier, and there are similarities to the requirements for spine/leaf deployments | 14:10 |
EmilienM | ah, we had this discussion when we started containers | 14:10 |
mwhahaha | I ran across a similar request for multiple rabbitmq clusters | 14:10 |
gfidente | for ceph this ends up being a way of deploying multiple instances of the ceph services, with different configurations | 14:10 |
mwhahaha | ie for notification/mesaging | 14:10 |
shardy | Yeah, also e.g per service DB instances to enable scaling beyond a single DB cluster | 14:11 |
gfidente | I would like to team up with somebody else so that we can come up with a better implementation and idea | 14:11 |
EmilienM | can ceph run configuration from something else than a config file? (etcd, etc) | 14:11 |
shardy | there are a few use-cases I think | 14:11 |
gfidente | EmilienM I don't think | 14:11 |
EmilienM | I also think we can pass multiple --config-file arguments to the OpenStack services | 14:11 |
EmilienM | and there must be some sort of override | 14:11 |
EmilienM | but that's kind of an hack | 14:12 |
gfidente | EmilienM yah that's possible with ceph as well | 14:12 |
shardy | well I think role specific parameters already solves part of this | 14:12 |
*** catintheroof has quit IRC | 14:12 | |
shardy | but we're missing part for overriding per-node parameters (e.g things like the bind IPs) | 14:12 |
gfidente | shardy and also we make up the list of monitors or osds out of the service name | 14:12 |
gfidente | but in this case, for each cluster, the list should be made up from the node with a given role | 14:12 |
gfidente | not just those hosting the service | 14:13 |
shardy | gfidente: yup, but I think we agreed roles_data tags could be used to subcategorize where a service spans multiple roles? | 14:13 |
*** noslzzp has quit IRC | 14:13 | |
gfidente | shardy yeah I haven't looked into how to use those yet, but yes, tags are a good idea | 14:13 |
shardy | but yeah there's a few things we'll need to address, probably need a spec or at least some more prototyping | 14:13 |
shardy | I like the idea of using the dynamic inventory to group the nodes | 14:14 |
gfidente | so I wonder if it might be useful organize a weekly call with interested people? | 14:14 |
*** catintheroof has joined #tripleo | 14:14 | |
shardy | which should be possible if we go ahead with the split stack model and drive all configuration via ansible | 14:14 |
EmilienM | ++ | 14:15 |
shardy | gfidente: should we start with an etherpad to enumerate the issues, and then set up a call when we know what there is to discuss? | 14:15 |
shardy | also we can link WIP patches etc for each issue | 14:15 |
gfidente | shardy ok great yes, will do | 14:15 |
EmilienM | shardy: good idea | 14:15 |
fultonj | +1 | 14:16 |
gfidente | maybe I can share that during next meeting with some dradts | 14:16 |
gfidente | *drafts | 14:16 |
mwhahaha | gfidente: do you want an action item reminder or will you do another one-off agenda item? | 14:17 |
gfidente | action item | 14:17 |
mwhahaha | #action gfidente put together issues around multiple service instances | 14:18 |
mwhahaha | k done | 14:18 |
owalsh | gfidente: /me interested too | 14:18 |
mwhahaha | any other one off items anyone want to bring up? | 14:18 |
gfidente | owalsh great | 14:18 |
mwhahaha | moving on to status | 14:19 |
mwhahaha | #topic Squad status | 14:19 |
mwhahaha | ci | 14:19 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-ci-squad-scrum | 14:19 |
mwhahaha | upgrade | 14:19 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status | 14:19 |
mwhahaha | containers | 14:19 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-containers-squad-status | 14:19 |
mwhahaha | integration | 14:19 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-integration-squad-status | 14:19 |
*** openstack changes topic to "Squad status (Meeting topic: tripleo)" | 14:19 | |
mwhahaha | ui/cli | 14:19 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status | 14:19 |
mwhahaha | validations | 14:19 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-validations-squad-status | 14:19 |
mwhahaha | networking | 14:19 |
mwhahaha | #link https://etherpad.openstack.org/p/tripleo-networking-squad-status | 14:19 |
mwhahaha | mandre, dprince: looks like contatiners status is not updated for this week | 14:20 |
*** jaosorior has joined #tripleo | 14:20 | |
mwhahaha | gfidente: integration status is also stale | 14:20 |
EmilienM | to which squad is the config-download work being assigned? | 14:20 |
mandre | jeez, screw the DST | 14:20 |
gfidente | mwhahaha yeah we didn't do much work this week | 14:20 |
mandre | mwhahaha: will do it ASAP | 14:20 |
mwhahaha | gfidente: k | 14:20 |
mwhahaha | mandre: thanks | 14:20 |
mwhahaha | workflows: thrash any pressing issues or status related items? | 14:21 |
gfidente | (we converted scenario004 to ceph-ansible though) | 14:21 |
dprince | mwhahaha: I can send an update to the list today | 14:21 |
dprince | would that work? | 14:21 |
gfidente | (so we now have rgw and mds via ceph-ansible tested in CI) | 14:21 |
mwhahaha | dprince: that or just update the etherpad | 14:21 |
mwhahaha | dprince: your preference :) | 14:22 |
dprince | mwhahaha: ack, perhaps both | 14:22 |
openstackgerrit | Merged openstack/tripleo-docs master: Stop using deprecated options for the prepare cmd https://review.openstack.org/516388 | 14:23 |
mwhahaha | ok moving on | 14:23 |
mwhahaha | #topic bugs & blueprints | 14:23 |
mwhahaha | #link https://launchpad.net/tripleo/+milestone/queens-2 | 14:23 |
mwhahaha | For Queens we currently have 69 (+0) blueprints and about 497 (+0) open bugs. 490 queens-2 and 7 queens-3. | 14:23 |
*** openstack changes topic to "bugs & blueprints (Meeting topic: tripleo)" | 14:23 | |
mwhahaha | #action mwhahaha to move medium bugs to queens-3 | 14:24 |
mwhahaha | forgot to do that before i went on pto, i'll get to that today | 14:24 |
EmilienM | (I'll follow-up with my unanswered question later) | 14:24 |
*** fzdarsky has joined #tripleo | 14:24 | |
EmilienM | mwhahaha: I moved all blueprints to queens-2 FYI (last week) | 14:24 |
mwhahaha | EmilienM: oh that's probably integration | 14:24 |
EmilienM | sounds good | 14:24 |
mwhahaha | any bugs/blueprints that people would like to talk about or highlight? | 14:25 |
mwhahaha | sounds like nope | 14:26 |
mwhahaha | #topic projects releases or stable backports | 14:26 |
*** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)" | 14:26 | |
EmilienM | so | 14:26 |
EmilienM | we were (and still are?) stuck by some zuul v3 jobs | 14:26 |
EmilienM | to produce tarballs | 14:26 |
EmilienM | it should be sorted out today or tomorrow | 14:26 |
EmilienM | once we have that, I'll re-propose a release for newton/ocata/pike | 14:27 |
EmilienM | queens-1 has been sorted out, and pushed | 14:27 |
*** amoralej|lunch is now known as amoralej | 14:27 | |
EmilienM | so we hope to have new stable releases by end of this week | 14:27 |
EmilienM | second update: | 14:27 |
EmilienM | the topic we've discuss about extending the stable-policy for installers in paused now, we'll discuss about that during the Summit and try to make progress in person | 14:28 |
EmilienM | I'll keep everyone posted on the mailing list | 14:28 |
EmilienM | mwhahaha: done | 14:28 |
mwhahaha | EmilienM: thanks | 14:28 |
mwhahaha | #topic specs | 14:28 |
mwhahaha | #link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open | 14:28 |
*** openstack changes topic to "specs (Meeting topic: tripleo)" | 14:28 | |
mwhahaha | reminder, we should try and get all the specs merged by the end of queens-2 | 14:29 |
mwhahaha | I sent a ML note about that a while back | 14:29 |
mwhahaha | please take some time to review the open specs | 14:29 |
mwhahaha | besides that, does anyone want to talk about a specific spec? | 14:29 |
mwhahaha | sounds like nope | 14:30 |
mwhahaha | #topic open discussion | 14:30 |
*** openstack changes topic to "open discussion (Meeting topic: tripleo)" | 14:30 | |
mwhahaha | soooo where are we at on master promotions | 14:30 |
jrist | thanks everyone with your hard work on ci and promotions | 14:30 |
*** catintheroof has quit IRC | 14:30 | |
EmilienM | afiu we have some issues with the build container job | 14:30 |
EmilienM | (in RDO CI) | 14:30 |
EmilienM | but other than that, all jobs seem to pass well | 14:30 |
mwhahaha | do we have bugs created for the container build failures? | 14:31 |
EmilienM | adarazs|rover, panda|ruck can give more details | 14:31 |
EmilienM | amoralej and mandre as well | 14:31 |
amoralej | EmilienM, https://bugs.launchpad.net/kolla/+bug/1728915 | 14:32 |
openstack | Launchpad bug 1728915 in kolla "kolla tries to install python2-cffi but latest version is python-cffi in base" [Undecided,In progress] - Assigned to Alfredo Moralejo (amoralej) | 14:32 |
mandre | review at https://review.openstack.org/#/c/516643/ | 14:32 |
mandre | it's about to merge | 14:32 |
amoralej | mandre, oracle jobs timed out, i had to recheck | 14:32 |
jfrancoa | EmilienM: I just wanted to raise a concern, as the upgrade jobs seem to be passing but that's because they are not running the upgrade step https://bugs.launchpad.net/tripleo/+bug/1728917 | 14:32 |
openstack | Launchpad bug 1728917 in tripleo "Upgrades CI jobs in master not performing upgrade" [Undecided,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 14:32 |
EmilienM | mandre: nice. Is that the only known blocker? | 14:32 |
EmilienM | jfrancoa: on master? | 14:32 |
jfrancoa | EmilienM: yes | 14:32 |
EmilienM | jfrancoa: I wouldn't look at them now | 14:32 |
amoralej | EmilienM, yes, the only known one | 14:33 |
EmilienM | jfrancoa: containers are from Pike | 14:33 |
EmilienM | jfrancoa: we don't even have QUeens containers yet | 14:33 |
amoralej | but one of the ovb jobs in last periodic run seems hang in deploy overcloud | 14:33 |
EmilienM | jfrancoa: I would wait until we have a promotion and then try out the upgrades again | 14:33 |
jfrancoa | EmilienM: ok, so it's not so worrying then | 14:33 |
EmilienM | jfrancoa: nope. | 14:33 |
EmilienM | amoralej: any logs? | 14:33 |
amoralej | EmilienM, still running https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/282/console | 14:33 |
amoralej | it's more that 3hr in that step | 14:34 |
EmilienM | mhh ok | 14:34 |
amoralej | the other two ovb passed | 14:34 |
EmilienM | could it be i/o in the VM? | 14:34 |
amoralej | which looks like a good signal | 14:34 |
amoralej | and there is an intermitent issue with pushing containers | 14:35 |
amoralej | last containers build job in pike failed with it, and we've hit it in master in previous runs also | 14:35 |
*** catintheroof has joined #tripleo | 14:35 | |
*** ykarel has joined #tripleo | 14:36 | |
mwhahaha | ok so sounds like we're just waiting on some CI and we'll keep an eye on that | 14:36 |
EmilienM | amoralej: the one where it fails to push on localhost? | 14:36 |
amoralej | yeah | 14:37 |
*** spectr has quit IRC | 14:37 | |
EmilienM | have we checked i/o on the machine? | 14:37 |
EmilienM | pushing on a container on localhost shouldn't be a problem really | 14:37 |
EmilienM | unless the VM is just dying | 14:37 |
amoralej | let me check if we have metrics | 14:38 |
EmilienM | we can check that offline | 14:38 |
EmilienM | on #rdo probably | 14:39 |
mwhahaha | so the other thing to talk about, what is the current status of the gate pipeline? do we know why we consistenly keep resetting the gate? | 14:39 |
*** spectr has joined #tripleo | 14:39 | |
* EmilienM hasn't checked yet this morning - looks at adarazs|rover / panda|ruck | 14:39 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Gate test - do not merge https://review.openstack.org/516700 | 14:40 |
adarazs|rover | mwhahaha: I was wondering about that too, I was looking at one gate yesterday and it doesn't make much sense what zuul does with the gate jobs, killing them after 2 hours and starting them again. | 14:40 |
mwhahaha | it was 20hours earlier in the meeting now everything says 0 so i wonder if they reset zuul | 14:40 |
mwhahaha | adarazs|rover: usually that happens if a job fails in teh queue, the reset get reset | 14:40 |
EmilienM | adarazs|rover: yes it does make sense, we talked about it last week | 14:40 |
mwhahaha | do we have a way to track & research all gate failures? | 14:40 |
EmilienM | zuul makes sure patches about to merge don't break another patch also about to merge | 14:40 |
EmilienM | that's why we have the shared queue | 14:41 |
EmilienM | and that's why we need to look at every failure | 14:41 |
EmilienM | 1) make sure they are reported in Launchpad | 14:41 |
mwhahaha | i've asked infra and they don't have anything, but do we have that information available to us via the ci status pages or the extend status tool? | 14:41 |
EmilienM | 2) make sure they are in elastic recheck | 14:41 |
adarazs|rover | EmilienM: ah, okay, I didn't follow that discussion. | 14:41 |
EmilienM | we should really do 1) and 2) before any recheck | 14:41 |
EmilienM | adarazs|rover: it's how zuul works | 14:42 |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add pre-deployment negative tests for validations https://review.openstack.org/488495 | 14:42 |
EmilienM | adarazs|rover: I can find the doc if you need | 14:42 |
EmilienM | adarazs|rover: https://docs.openstack.org/infra/zuul/user/gating.html | 14:43 |
mwhahaha | adarazs|rover, panda|ruck: so one of the things I would like to see from the CI squad is the review/metrics around these gate failures. Do you think you folks can look into getting this info | 14:43 |
adarazs|rover | EmilienM: I think I just haven't looked closely at how it works until now. :) | 14:44 |
adarazs|rover | EmilienM: thanks for the docs. | 14:44 |
EmilienM | cool! | 14:44 |
*** cshastri has quit IRC | 14:44 | |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add post-deployment negative tests for validations https://review.openstack.org/504014 | 14:45 |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add timestamper_cmd for tripleo-validations https://review.openstack.org/490013 | 14:46 |
adarazs|rover | mwhahaha: hm, so you want some stats on why gate jobs fail; I don't think we have anything like that as they are the same jobs as the check jobs, so I think their stats gets merged in the rest of the jobs on SOVA. | 14:46 |
adarazs|rover | mwhahaha: we would need to name them differently to discern the failures of gates vs. check jobs. | 14:46 |
mwhahaha | adarazs|rover: I assume this info is in SOVA but yes we need to surface the gate failures | 14:47 |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Fix ansible-lint.sh to check playbooks https://review.openstack.org/446525 | 14:47 |
*** udesale has quit IRC | 14:47 | |
EmilienM | adarazs|rover: I think what is really needed *now* is to track failures in *gate* and report them correctly in Launchpad and elastic recheck (queries) | 14:47 |
mwhahaha | adarazs|rover: it's very important that we actively look at those immediately | 14:47 |
mwhahaha | #action ci squad to start gathering gate failure metrics and information | 14:47 |
*** psachin has quit IRC | 14:48 | |
*** noslzzp has joined #tripleo | 14:49 | |
mwhahaha | any other topics or things folks would like to discuss? | 14:49 |
mwhahaha | sounds like nope | 14:50 |
mwhahaha | thanks everyone | 14:50 |
mwhahaha | #endmeeting | 14:50 |
*** openstack changes topic to "CI status: Orange - gate unstable - promotion 51 days | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 14:50 | |
openstack | Meeting ended Tue Oct 31 14:50:31 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:50 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-10-31-14.00.html | 14:50 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-10-31-14.00.txt | 14:50 |
openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-10-31-14.00.log.html | 14:50 |
jrist | thanks mwhahaha | 14:50 |
*** achadha has joined #tripleo | 14:51 | |
bnemec | Oof, zuul restart. Guess we'll find out how rh1 is really performing now... | 14:53 |
*** achadha has quit IRC | 14:55 | |
*** abregman_ is now known as abregman|mtg | 14:58 | |
*** dtantsur|afk is now known as dtantsur | 14:58 | |
*** dmarlin has joined #tripleo | 15:00 | |
*** stendulker has joined #tripleo | 15:00 | |
marios | mandre: /win 16 | 15:00 |
marios | mandre: sorry | 15:00 |
*** abregman|mtg has quit IRC | 15:04 | |
openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 15:05 |
*** agurenko is now known as agurenko_ | 15:07 | |
*** oidgar has quit IRC | 15:09 | |
*** achadha has joined #tripleo | 15:11 | |
*** ykarel has quit IRC | 15:11 | |
openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo master: Drop the old skip-metering-database flag https://review.openstack.org/515796 | 15:12 |
*** achadha has quit IRC | 15:12 | |
*** achadha has joined #tripleo | 15:12 | |
bnemec | And zuul restart #2 for the day. | 15:12 |
mwhahaha | it's going to be like that i guess | 15:13 |
*** achadha has quit IRC | 15:13 | |
*** jprovazn has quit IRC | 15:14 | |
*** achadha has joined #tripleo | 15:14 | |
*** anshul has quit IRC | 15:15 | |
*** dtantsur is now known as dtantsur|afk | 15:15 | |
*** newmember has quit IRC | 15:16 | |
*** jbadiapa has quit IRC | 15:18 | |
*** achadha has quit IRC | 15:19 | |
*** jcoufal_ has quit IRC | 15:19 | |
*** jcoufal has joined #tripleo | 15:20 | |
*** achadha has joined #tripleo | 15:20 | |
*** stendulker has quit IRC | 15:21 | |
*** stendulker has joined #tripleo | 15:22 | |
mandre | EmilienM: the backport for the DockerInsecureRegistry param autodetect merged, I'll let you do the honor of pushing the button for https://review.openstack.org/#/c/514477/ | 15:23 |
EmilienM | mandre: what honor :P | 15:24 |
mandre | EmilienM: really nice catch BTW, I always forget that we don't do branches in oooq | 15:24 |
EmilienM | cool! | 15:24 |
mandre | thx ;-) | 15:24 |
*** noslzzp has quit IRC | 15:25 | |
*** noslzzp has joined #tripleo | 15:26 | |
openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Add missing puppet configuration to undercloud deploy https://review.openstack.org/513774 | 15:26 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart master: WIP: Use tripleo-upgrade role in CI https://review.openstack.org/513382 | 15:27 |
*** spectr has quit IRC | 15:29 | |
openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Upgrade UC and OC using tripleo-upgrade role https://review.openstack.org/515643 | 15:30 |
*** akrivoka has quit IRC | 15:31 | |
*** akrivoka has joined #tripleo | 15:31 | |
*** catintheroof has quit IRC | 15:34 | |
*** PhilSliderS has quit IRC | 15:37 | |
*** brault has quit IRC | 15:38 | |
*** brault has joined #tripleo | 15:38 | |
*** bogdando has quit IRC | 15:39 | |
*** itlinux has joined #tripleo | 15:39 | |
*** pblaho has quit IRC | 15:40 | |
*** catintheroof has joined #tripleo | 15:40 | |
*** pblaho has joined #tripleo | 15:40 | |
*** spectr has joined #tripleo | 15:41 | |
*** brault has quit IRC | 15:41 | |
openstackgerrit | Julie Pichon proposed openstack/tripleo-common master: Remove Pike-only migration steps https://review.openstack.org/512585 | 15:41 |
openstackgerrit | Julie Pichon proposed openstack/tripleo-common master: Fix typos in container_images_prepare failure task names https://review.openstack.org/516720 | 15:41 |
*** catintheroof has quit IRC | 15:42 | |
openstackgerrit | Merged openstack/tripleo-docs master: DockerCephDaemonImage is now optional for Ceph deployments https://review.openstack.org/515446 | 15:42 |
*** PhilSliderS has joined #tripleo | 15:43 | |
*** moshele has quit IRC | 15:43 | |
*** suuuper has quit IRC | 15:46 | |
*** ffiore has quit IRC | 15:48 | |
*** bkopilov has joined #tripleo | 15:50 | |
mcornea | shardy: hi o/ I'm trying to upgrade an env and major upgrade composable step fails with The Resource Type (OS::TripleO::Network::Management) could not be found; as a side note OS::TripleO::Network::Management: OS::Heat::None is set in an environment file. | 15:51 |
sshnaidm | please, can somebody help with nested heat templates? I create this stack with 3 files: http://paste.openstack.org/show/625126/ but I get error: "ERROR: The Resource Type (/tmp/subnode.yml) could not be found" | 15:52 |
mcornea | shardy: any hint on what I can do to move forward? | 15:52 |
*** jbadiapa has joined #tripleo | 15:55 | |
*** rtailor has quit IRC | 15:55 | |
*** brault has joined #tripleo | 15:56 | |
*** salmankhan has quit IRC | 15:57 | |
*** aputtur_ has quit IRC | 15:58 | |
*** aputtur_ has joined #tripleo | 15:58 | |
shardy | mcornea: Hmm, do you have the fix from https://review.openstack.org/#/c/506806/ ? | 15:59 |
mcornea | shardy: checking | 15:59 |
*** janki has quit IRC | 16:00 | |
*** bnemec has quit IRC | 16:00 | |
mcornea | shardy: yep, it's there | 16:00 |
*** salmankhan has joined #tripleo | 16:01 | |
*** stendulker has quit IRC | 16:02 | |
*** jaosorior has quit IRC | 16:03 | |
shardy | sshnaidm: I suspect the error may be misleading, /tmp/subnode has invalid syntax because there aren't any parameters defined to match the various get_param calls | 16:05 |
shardy | sshnaidm: maybe try creating just that stack first to test | 16:05 |
*** salmankhan has quit IRC | 16:05 | |
shardy | mcornea: Ok could you pls raise a bug with more details? | 16:06 |
mcornea | shardy: sure, in a minute | 16:07 |
*** anilvenkata has quit IRC | 16:07 | |
*** salmankhan has joined #tripleo | 16:11 | |
*** ffiore has joined #tripleo | 16:14 | |
*** bnemec has joined #tripleo | 16:15 | |
bnemec | Woo, only one failure so far in spite of the fact that we had 32 stacks creating at once. | 16:16 |
*** trown is now known as trown|lunch | 16:16 | |
bnemec | Not bad for a creaky old cloud that is due to be retired. | 16:16 |
openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add option for barbican API container to log to stdout/stderr https://review.openstack.org/516730 | 16:17 |
*** masco has quit IRC | 16:17 | |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DO NOT MERGE - Testing specific DLRN hash tag Also testing dlrn_hash_tag_newest set to specific hash. https://review.openstack.org/516624 | 16:17 |
*** panda|ruck is now known as panda|ruck|bbl | 16:18 | |
openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add ability to specify KEK for simple crypto plugin https://review.openstack.org/516732 | 16:20 |
openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add ability to specify multiple barbican backends https://review.openstack.org/516733 | 16:20 |
*** fragatina has joined #tripleo | 16:20 | |
*** fragatina has quit IRC | 16:21 | |
*** fragatina has joined #tripleo | 16:22 | |
*** gkadam has joined #tripleo | 16:22 | |
*** shardy is now known as shardy_afk | 16:24 | |
*** aufi has quit IRC | 16:25 | |
*** brault has quit IRC | 16:26 | |
*** brault has joined #tripleo | 16:26 | |
*** brault has quit IRC | 16:27 | |
*** brault has joined #tripleo | 16:28 | |
*** iranzo has quit IRC | 16:30 | |
mcornea | shardy_afk: https://bugs.launchpad.net/tripleo/+bug/1729039 | 16:32 |
openstack | Launchpad bug 1729039 in tripleo "Ocata -> Pike overcloud upgrade: major-upgrade-composable-steps-docker fails with The Resource Type (OS::TripleO::Network::Management) could not be found." [Undecided,New] | 16:32 |
*** ramishra has quit IRC | 16:33 | |
*** anilvenkata has joined #tripleo | 16:34 | |
*** rbowen has quit IRC | 16:36 | |
*** oidgar has joined #tripleo | 16:39 | |
*** catintheroof has joined #tripleo | 16:40 | |
*** ebarrera_ has joined #tripleo | 16:41 | |
*** anilvenkata has quit IRC | 16:44 | |
*** marios has quit IRC | 16:45 | |
*** catintheroof has quit IRC | 16:45 | |
*** ffiore has quit IRC | 16:46 | |
mwhahaha | we just had a dlrn failure in the gate, http://logs.openstack.org/78/498978/2/gate/legacy-tripleo-ci-centos-7-nonha-multinode-oooq/e219437/job-output.txt.gz#_2017-10-31_16_41_32_669604 | 16:47 |
mwhahaha | looks like it couldn't find openstack-macros | 16:47 |
*** yamahata has joined #tripleo | 16:47 | |
mwhahaha | http://logs.openstack.org/78/498978/2/gate/legacy-tripleo-ci-centos-7-nonha-multinode-oooq/e219437/logs/delorean_logs/df/45/df45125423b6368026d393bb3f166946c501ad18_dev/root.log.txt.gz | 16:48 |
mwhahaha | adarazs|rover, -^ | 16:48 |
*** iranzo has joined #tripleo | 16:49 | |
*** dparkes has quit IRC | 16:49 | |
*** iranzo has quit IRC | 16:49 | |
*** iranzo has joined #tripleo | 16:49 | |
adarazs|rover | mwhahaha: looking. | 16:51 |
*** mcornea has quit IRC | 16:52 | |
hamzy | I tried a small change and still received a hang... do you know what I might be doing wrong? http://paste.openstack.org/show/625006/ | 16:53 |
adarazs|rover | jpena, amoralej: you might have a faster time figuring out why this DLRN build failed. I don't think it's related to the "build-test-packages" role directly. | 16:53 |
adarazs|rover | ^ | 16:53 |
adarazs|rover | jpena, amoralej: can you take a look at the logs mwhahaha linked? | 16:53 |
* jpena checks | 16:53 | |
*** rbowen has joined #tripleo | 16:54 | |
*** gkadam has quit IRC | 16:54 | |
amoralej | DEBUG util.py:417: Error: No Package found for openstack-macros ? | 16:54 |
*** ebarrera_ has quit IRC | 16:54 | |
adarazs|rover | amoralej: hm, so that's not a real package I suppose. | 16:54 |
*** iranzo has quit IRC | 16:54 | |
amoralej | it is | 16:54 |
adarazs|rover | I see, it's in rdoinfo... so it's not that we need to add it to https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/build-test-packages/defaults/main.yml#L12-L20 | 16:56 |
jpena | amoralej: we have an interesting situation. It's not in the new deps repo, but also not in the current-passed-ci one (because it's quite old) | 16:57 |
jpena | we need it in the deps repo | 16:57 |
amoralej | oh | 16:57 |
*** bnemec has quit IRC | 16:57 | |
*** moshele has joined #tripleo | 16:58 | |
adarazs|rover | mwhahaha: great idea w/ looking at the failing gate job. | 16:58 |
adarazs|rover | mwhahaha++ | 16:58 |
adarazs|rover | probably we hit this a couple of times. | 16:59 |
amoralej | this should be happening in other jobs | 16:59 |
*** rbowen has quit IRC | 17:00 | |
adarazs|rover | amoralej: maybe, but I think the gate job puts together a bunch of changes to be merged so it makes it more probably we hit it. | 17:00 |
*** jcoufal has quit IRC | 17:01 | |
adarazs|rover | then again I might not know what I'm talking about ;) | 17:02 |
adarazs|rover | which happens quite often around DLRN :) | 17:02 |
mwhahaha | that failure is not part of the zuul info | 17:02 |
mwhahaha | that's part of the dlrn setup | 17:02 |
*** jcoufal has joined #tripleo | 17:03 | |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Remove 'Refresh results' button on the nodes page https://review.openstack.org/515474 | 17:03 |
mwhahaha | https://github.com/softwarefactory-project/DLRN/blob/9a8529f75f3b1496475be615b37751ae64101b60/scripts/centos.cfg#L4 | 17:04 |
mwhahaha | so maybe repo problems? | 17:04 |
*** raildo has quit IRC | 17:05 | |
*** raildo has joined #tripleo | 17:05 | |
amoralej | adarazs|rover, mwhahaha jpena it should be fixed now | 17:05 |
amoralej | metadata may take a while to be refreshed in the proxy cache | 17:06 |
*** moshele has quit IRC | 17:06 | |
mwhahaha | so i guess the quesiton I have is what happened? | 17:06 |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Improve node count indicator in roles step https://review.openstack.org/516674 | 17:06 |
mwhahaha | this is old code so i'm assuming env changed? | 17:06 |
* adarazs|rover doesn't understand. if this is part of the chroot setup, I assume it should have failed every single time. | 17:07 | |
amoralej | mwhahaha, today we switched to new dependencies repo | 17:07 |
amoralej | which is *almost* the same content | 17:07 |
mwhahaha | amoralej: did you announce it or test it? | 17:07 |
amoralej | mwhahaha, yes | 17:07 |
jpena | adarazs|rover: when the chroot setup is done, missing packages are ignored (that's why it doesn't complain about a missing python3-pbr) | 17:07 |
jpena | adarazs|rover: but for some other packages, openstack-macros was a proper build requirement | 17:08 |
amoralej | but we missed some issues | 17:08 |
amoralej | as one in kolla and this one | 17:08 |
mwhahaha | amoralej: is this tracked somewhere for RCA later? | 17:08 |
adarazs|rover | jpena: I see. | 17:08 |
amoralej | problem is that some time ago we switched openstack-macros from deps repo to delorean one | 17:08 |
amoralej | but | 17:08 |
adarazs|rover | so that's why this just appeared now. | 17:08 |
amoralej | as we haven't promoted the repo in last 50 days | 17:08 |
amoralej | and you use current-passed-ci to build packages | 17:09 |
amoralej | openstack-macros is not in delorean repo | 17:09 |
amoralej | so, short version. it'll be fixed by next promotion | 17:09 |
openstackgerrit | Luke Hinds proposed openstack/puppet-tripleo master: [WIP] Implements AIDE Intrusion Detection System https://review.openstack.org/483025 | 17:09 |
mwhahaha | if we ever get a promotion at this rate | 17:09 |
amoralej | i've applied a workaround by adding it to deps repo | 17:09 |
adarazs|rover | thanks for the explanation. | 17:10 |
openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates master: [WIP] Implements AIDE Intrusion Detection System https://review.openstack.org/483028 | 17:10 |
*** tosky has quit IRC | 17:11 | |
*** lucasagomes is now known as lucas-afk | 17:12 | |
*** catintheroof has joined #tripleo | 17:12 | |
hamzy | if I make a change to tripleo_common/actions/validations.py what do I need to do to get mistral to reload that class? "sudo mistral-db-manage --config-file /etc/mistral/mistral.conf populate" doesn't seem to do it | 17:12 |
*** bnemec has joined #tripleo | 17:12 | |
sshnaidm | can anybody say what I do wrong in this template http://paste.openstack.org/show/625140/ , when I get error: ERROR: Failed to validate: Failed to validate: resources[0]: The specified reference "private_subnet" (in subnode_port.Properties.fixed_ips[0].subnet) is incorrect. | 17:14 |
openstackgerrit | Or Idgar proposed openstack/puppet-tripleo stable/pike: Remove erroneous octavia code related to sync_db https://review.openstack.org/513376 | 17:15 |
*** jprovazn has joined #tripleo | 17:15 | |
bnemec | sshnaidm: There's no private_subnet resource in that template. | 17:17 |
bnemec | Did you mean get_param? | 17:17 |
sshnaidm | bnemec, I pass it from parent template | 17:18 |
sshnaidm | bnemec, at least I intent to do... | 17:18 |
bnemec | sshnaidm: You don't pass resources, you pass parameters. Try get_param. | 17:18 |
sshnaidm | bnemec, thanks! seems like started to work *phew* | 17:20 |
sshnaidm | seems like I understand why we move from heat to ansible | 17:20 |
bnemec | Referencing something that doesn't exist in Ansible isn't going to work any better. ;-) | 17:22 |
* adarazs|rover going to log off for today, maybe checks back later on the promotions. | 17:23 | |
adarazs|rover | see ya! | 17:23 |
sshnaidm | bnemec, yeah, I'm kidding.. | 17:24 |
*** fragatina has quit IRC | 17:24 | |
sshnaidm | bnemec, but this stack was completed and nothing was created.. | 17:25 |
*** fragatina has joined #tripleo | 17:25 | |
sshnaidm | bnemec, could be my problem is with output? http://paste.openstack.org/show/625141/ | 17:25 |
bnemec | sshnaidm: It does look like there's a problem with that output. | 17:27 |
sshnaidm | bnemec, do you know maybe how do I output all IPs of resource group? | 17:28 |
*** rmascena has joined #tripleo | 17:28 | |
*** jpich has quit IRC | 17:29 | |
*** pcaruana has quit IRC | 17:29 | |
*** fragatina has quit IRC | 17:29 | |
*** trown|lunch is now known as trown | 17:30 | |
*** raildo has quit IRC | 17:31 | |
bnemec | sshnaidm: I'm not positive how it works with a resource group, but you have no outputs defined on the subnode template so there's nothing for the parent template to return. | 17:36 |
*** tesseract has quit IRC | 17:36 | |
bnemec | I expect that's what the current error is saying. | 17:36 |
bnemec | So the first step will be to add outputs to subnode.yaml with whatever data you want exposed. | 17:37 |
sshnaidm | bnemec, thanks, trying.. | 17:37 |
openstackgerrit | Merged openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/515991 | 17:39 |
*** d0ugal has quit IRC | 17:43 | |
*** salmankhan has quit IRC | 17:43 | |
sshnaidm | bnemec, I did like that, and still have "null" in output.. http://paste.openstack.org/show/625146/ | 17:49 |
*** fragatina has joined #tripleo | 17:50 | |
EmilienM | mwhahaha: https://review.openstack.org/#/c/516683/ | 17:50 |
EmilienM | mwhahaha: where is multinode-oooq | 17:50 |
mwhahaha | EmilienM: click Toggle CI | 17:51 |
mwhahaha | legacy-tripleo-ci-centos-7-nonha-multinode-oooq legacy-tripleo-ci-centos-7-nonha-multinode-oooq : ERROR Project openstack/requirements does not have the default branch master | 17:51 |
EmilienM | mwhahaha: perfect | 17:51 |
*** ccamacho has quit IRC | 17:53 | |
*** mcornea has joined #tripleo | 17:53 | |
*** jfrancoa has quit IRC | 17:54 | |
*** itlinux has quit IRC | 17:56 | |
*** fzdarsky has quit IRC | 18:02 | |
*** panda|ruck|bbl is now known as panda|ruck | 18:02 | |
*** d0ugal has joined #tripleo | 18:03 | |
*** itlinux has joined #tripleo | 18:06 | |
*** dsariel__ has quit IRC | 18:09 | |
*** zzzeek has quit IRC | 18:10 | |
sshnaidm | trown, do you know maybe - how can I get outputs of resource group? I have "null"s with this configuration: http://paste.openstack.org/show/625148/ | 18:10 |
*** jpena is now known as jpena|off | 18:10 | |
sshnaidm | any heat expert ^^ | 18:10 |
Tengu | EmilienM mwhahaha darn, that might explain the CI failures I have on some review… didn't check further the error | 18:11 |
*** zzzeek has joined #tripleo | 18:12 | |
trown | sshnaidm: I am far from heat expert, but looking | 18:12 |
sshnaidm | trown, you have a magic look :) just worked now :D | 18:13 |
trown | sshnaidm: nicest thing anyone said to me all month :) | 18:15 |
*** moshele has joined #tripleo | 18:15 | |
*** agurenko_ has quit IRC | 18:16 | |
*** oidgar has quit IRC | 18:17 | |
*** zzzeek has quit IRC | 18:17 | |
*** zzzeek has joined #tripleo | 18:18 | |
*** dparkes has joined #tripleo | 18:19 | |
*** zzzeek has quit IRC | 18:20 | |
*** pchavva has quit IRC | 18:21 | |
*** d0ugal_ has joined #tripleo | 18:22 | |
*** d0ugal has quit IRC | 18:23 | |
*** zzzeek has joined #tripleo | 18:25 | |
*** hewbrocca is now known as hewbrocca_afk | 18:26 | |
*** yprokule has quit IRC | 18:27 | |
*** zzzeek_ has joined #tripleo | 18:27 | |
*** anshul has joined #tripleo | 18:27 | |
*** dparkes has quit IRC | 18:29 | |
*** chlong has joined #tripleo | 18:30 | |
*** zzzeek has quit IRC | 18:30 | |
fpan | dsneddon: ping. Could you take a look at https://review.openstack.org/#/c/513972/ when you get a chance, thanks | 18:31 |
*** zzzeek_ has quit IRC | 18:31 | |
*** toure is now known as toure_biab | 18:37 | |
*** bnemec has quit IRC | 18:38 | |
openstackgerrit | James Slagle proposed openstack/tripleo-validations master: Specify vars after children sections https://review.openstack.org/516764 | 18:38 |
*** zzzeek has joined #tripleo | 18:39 | |
openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: fs10: deploy steps with ansible https://review.openstack.org/508307 | 18:40 |
slagle | EmilienM: i think i have a more proper fix for the inventory issue ^^ | 18:41 |
* EmilienM clicks | 18:41 | |
*** newmember has joined #tripleo | 18:42 | |
EmilienM | slagle: wow, well done | 18:42 |
*** zzzeek has quit IRC | 18:42 | |
openstackgerrit | Alfredo Moralejo proposed openstack/tripleo-puppet-elements master: Install yum-plugin-priorities in pre-install phase https://review.openstack.org/516765 | 18:43 |
EmilienM | slagle: probably not urgent at this point but if you can take a look at https://review.openstack.org/#/c/514745/ and https://review.openstack.org/#/c/514736/ when you have time, and give feedback. I haven't followed config-download work over the last 7 days I think | 18:43 |
*** oidgar has joined #tripleo | 18:44 | |
slagle | EmilienM: yea i'll have a look. i need to update the workflows as well based on some comments | 18:44 |
*** zzzeek has joined #tripleo | 18:44 | |
EmilienM | slagle: ok | 18:45 |
*** dprince has quit IRC | 18:49 | |
*** achadha_ has joined #tripleo | 18:53 | |
*** achadha has quit IRC | 18:56 | |
*** achadha_ has quit IRC | 18:58 | |
*** dparkes has joined #tripleo | 18:59 | |
*** yamahata has quit IRC | 18:59 | |
panda|ruck | all master OVB passed again. | 18:59 |
*** rbowen has joined #tripleo | 19:01 | |
*** oidgar has quit IRC | 19:01 | |
*** yamahata has joined #tripleo | 19:07 | |
*** ebarrera_ has joined #tripleo | 19:07 | |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Default $NODEPOOL_PROVIDER https://review.openstack.org/490037 | 19:08 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 19:08 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-common master: Octavia post deployment mistral wrapper https://review.openstack.org/515402 | 19:08 |
*** dparkes has quit IRC | 19:10 | |
*** salmankhan has joined #tripleo | 19:12 | |
*** ipsecguy_ has joined #tripleo | 19:13 | |
*** catintheroof has quit IRC | 19:14 | |
*** yamahata has quit IRC | 19:14 | |
*** ebarrera has quit IRC | 19:14 | |
*** pcaruana has joined #tripleo | 19:15 | |
*** dprince has joined #tripleo | 19:15 | |
*** ipsecguy has quit IRC | 19:15 | |
*** rbowen has quit IRC | 19:15 | |
*** moshele has quit IRC | 19:15 | |
*** yamahata has joined #tripleo | 19:17 | |
*** moshele has joined #tripleo | 19:17 | |
*** oidgar has joined #tripleo | 19:18 | |
*** newmember has quit IRC | 19:23 | |
*** dparkes has joined #tripleo | 19:24 | |
*** pkovar has quit IRC | 19:25 | |
*** cylopez has joined #tripleo | 19:26 | |
*** adac has joined #tripleo | 19:26 | |
adac | Hi there! With tripleo, can I setup a single node that contains all the openstack components? | 19:27 |
mwhahaha | adac: well tripleo still requires 2 nodes. One for the undercloud and one for the overcloud, but yea we do it in CI | 19:28 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Increase the size of the Mistral output limit https://review.openstack.org/516771 | 19:29 |
*** mcornea has quit IRC | 19:32 | |
adac | mwhahaha, hmm ok I see. No clue yet what under and overcloud is, but will look it up thank! | 19:33 |
adac | *thanks! | 19:33 |
*** cylopez has quit IRC | 19:34 | |
adac | mwhahaha, is there a good video tutorial that shows on how to setup tripleo/openstack btw? | 19:34 |
*** cylopez has joined #tripleo | 19:35 | |
mwhahaha | adac: I think we have some older ones. http://tripleo.org/index.html is a good set of resources/documentation | 19:35 |
adac | mwhahaha, ok thanks I will have a look at it thanks | 19:38 |
adac | mwhahaha, how long do you think I need to get familiar with all this from scratch? :) | 19:38 |
*** myoung is now known as myoung|afk | 19:39 | |
panda|ruck | containers build passed | 19:39 |
mwhahaha | adac: a while :D it's a big learning curve | 19:39 |
adac | mwhahaha, oh yes it looks like that :) | 19:40 |
*** oidgar has quit IRC | 19:42 | |
homeski | curious if anyone knows what effect increasing api_workers parameter would have in ironic.conf | 19:44 |
*** salmankhan has quit IRC | 19:44 | |
*** moshele has quit IRC | 19:46 | |
*** amoralej is now known as amoralej|off | 19:48 | |
*** pcaruana has quit IRC | 19:49 | |
*** rbowen has joined #tripleo | 19:51 | |
*** catintheroof has joined #tripleo | 19:55 | |
*** rbowen has quit IRC | 19:56 | |
*** rbowen has joined #tripleo | 19:56 | |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Add undercloud cinder roles and environment files https://review.openstack.org/514809 | 19:56 |
*** bfournie has quit IRC | 19:57 | |
*** cylopez has quit IRC | 20:05 | |
*** ccamacho has joined #tripleo | 20:10 | |
*** gfidente is now known as gfidente|afk | 20:12 | |
*** achadha has joined #tripleo | 20:13 | |
panda|ruck | I can almost smell the promotion | 20:15 |
*** jtomasek has quit IRC | 20:17 | |
*** achadha has quit IRC | 20:17 | |
*** mrunge has quit IRC | 20:18 | |
*** etingof has quit IRC | 20:21 | |
*** mrunge has joined #tripleo | 20:22 | |
*** jmelvin has quit IRC | 20:23 | |
*** ebarrera_ has quit IRC | 20:31 | |
*** achadha has joined #tripleo | 20:35 | |
*** achadha has quit IRC | 20:35 | |
*** bfournie has joined #tripleo | 20:36 | |
*** achadha has joined #tripleo | 20:36 | |
*** bfournie has quit IRC | 20:37 | |
*** sshnaidm is now known as sshnaidm|afk | 20:39 | |
*** aputtur_ has quit IRC | 20:39 | |
*** etingof has joined #tripleo | 20:42 | |
openstackgerrit | Steve Baker proposed openstack/tripleo-docs master: Document skopeo as the tool used for image uploads https://review.openstack.org/516457 | 20:44 |
*** trown is now known as trown|outtypewww | 20:45 | |
openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci master: Don't replace /root/.ssh/authorized_keys, append to it https://review.openstack.org/516785 | 20:45 |
panda|ruck | omg | 20:49 |
panda|ruck | omg | 20:49 |
*** ansmith has quit IRC | 20:49 | |
EmilienM | only https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/119/console remains | 20:50 |
dmsimard | you'll jinx it | 20:51 |
panda|ruck | dmsimard: the only thing left to do was staring at it | 20:53 |
EmilienM | no timeout please | 20:56 |
panda|ruck | .... | 20:56 |
panda|ruck | I think I'm going to tableflip | 20:57 |
panda|ruck | I can't believe it | 20:58 |
EmilienM | it passed | 21:02 |
panda|ruck | \o/ | 21:02 |
*** leitan has quit IRC | 21:02 | |
panda|ruck | nobody moves | 21:02 |
panda|ruck | stay exaclty where you are | 21:02 |
*** jcoufal_ has joined #tripleo | 21:02 | |
panda|ruck | I'll monitor the promotion part | 21:03 |
*** jcoufal has quit IRC | 21:05 | |
*** toure_biab is now known as toure | 21:05 | |
*** toure is now known as toure_biab | 21:05 | |
EmilienM | panda|ruck: is it a post job? | 21:06 |
panda|ruck | EmilienM: no, it's in a different server | 21:07 |
EmilienM | panda|ruck: where can we follow that? | 21:08 |
panda|ruck | dmsimard: another periodic triggered right after this one | 21:08 |
panda|ruck | EmilienM: http://38.145.33.13/master.log it's a bit unreadable at the moment | 21:08 |
*** catintheroof has quit IRC | 21:09 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Get DLRN hash before setting up repos and images https://review.openstack.org/512855 | 21:09 |
*** rhallisey has quit IRC | 21:10 | |
panda|ruck | EmilienM: next run is in 1 minute | 21:10 |
panda|ruck | dmsimard: why another pipeline triggered right after the last one ? | 21:11 |
panda|ruck | promotion is failing, because the tripleo-ci-testing link has already changed | 21:12 |
*** rbowen has quit IRC | 21:13 | |
bugzy | fultonj: I did not have that patch, just applied it and attempted deploy again, but it failed with the same error. I will delete the failed environment along with the nodes and start afresh with the patch to see if it works | 21:14 |
EmilienM | panda|ruck: not sure what that means, tbh | 21:14 |
panda|ruck | EmilienM: no, it's another thing | 21:18 |
panda|ruck | EmilienM: we are missing reports from two jobs | 21:18 |
panda|ruck | periodic-ovb-3ctlr_1comp-featureset002 and periodic-ovb-1ctlr_1comp-featureset020 | 21:19 |
panda|ruck | checiing if they reported correctly | 21:19 |
panda|ruck | success to DLRN | 21:19 |
EmilienM | :-/ | 21:20 |
adac | what happens if the undercloud node fails? | 21:21 |
panda|ruck | EmilienM: no it's first problem I mentioned | 21:24 |
panda|ruck | EmilienM: so, every periodic pieline trigger starts with the promotion of the latest consistent to tripleo-ci-testing | 21:24 |
dmsimard | panda|ruck: I don't know ? I think the one that just finished was triggered manually by amoralej|off | 21:25 |
dmsimard | maybe it was due to run according to schedule | 21:26 |
panda|ruck | the second trigger changed the tripleo-ci-testing link, so the promoter script says it has not passed, because now it refers to a different hash | 21:27 |
panda|ruck | I'll try to run with a fixed hash | 21:27 |
*** jmelvin has joined #tripleo | 21:27 | |
EmilienM | tbh, I have no idea what you're talking about, all of this area is unclear to me | 21:27 |
EmilienM | where is this code? | 21:27 |
panda|ruck | EmilienM: https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/dlrnapi_promoter.py | 21:30 |
amoralej|off | it should promote now | 21:31 |
amoralej|off | panda|ruck, i think not all jobs passed with the same hash | 21:31 |
amoralej|off | when the promoter scripts run? | 21:31 |
*** mrunge has quit IRC | 21:31 | |
amoralej|off | periodically? | 21:32 |
*** rcernin has joined #tripleo | 21:32 | |
panda|ruck | amoralej|off: yes | 21:33 |
*** anshul has quit IRC | 21:34 | |
panda|ruck | amoralej|off: it will not promote because tripleo-ci-testing changed in the meantime | 21:34 |
*** amoralej|off is now known as amoralej | 21:34 | |
panda|ruck | I'm hardocidng the hash values and running manually | 21:34 |
amoralej | panda|ruck, but in current execution missing jobs already passed | 21:34 |
panda|ruck | If not all jobs passed with the same hash we won't promote | 21:34 |
amoralej | so, in first execution, last for jobs passed with second hash | 21:35 |
*** leitan has joined #tripleo | 21:35 | |
amoralej | and in current execution all but those four passed already | 21:35 |
*** threestrands has joined #tripleo | 21:36 | |
amoralej | panda|ruck, EmilienM it has promoted \o/ | 21:36 |
amoralej | it's just the dashboard didn't refresh yet | 21:36 |
slagle | EmilienM: boom. https://review.openstack.org/#/c/508307/ | 21:37 |
slagle | EmilienM: we better merge it before ansible does another release! | 21:37 |
EmilienM | slagle: lol | 21:37 |
EmilienM | amoralej: cool! | 21:37 |
panda|ruck | why did we have two periodic runs at the same time ? | 21:38 |
panda|ruck | amoralej: | 21:38 |
panda|ruck | no no, this is bad | 21:38 |
amoralej | overlaping | 21:38 |
panda|ruck | I don't know what promoted | 21:38 |
panda|ruck | this is not good, should never have happened | 21:38 |
*** mrunge has joined #tripleo | 21:39 | |
panda|ruck | containers images upload failed | 21:39 |
amoralej | it didn't | 21:39 |
*** akrivoka has quit IRC | 21:41 | |
panda|ruck | I don't know what promoted | 21:41 |
*** bobh has quit IRC | 21:41 | |
EmilienM | slagle: we'll approve when https://review.openstack.org/#/c/516764/1 get +A :D good work | 21:42 |
panda|ruck | half the jobs on the first trigger were working on 3b718f3fecc866332ec0663fa77e758f8346ab93 | 21:44 |
panda|ruck | the other half on 3b718f3fecc866332ec0663fa77e758f8346ab93 | 21:44 |
*** rmascena has quit IRC | 21:45 | |
panda|ruck | and we don't have container images in dockerhub | 21:45 |
*** jprovazn has quit IRC | 21:45 | |
*** dprince has quit IRC | 21:46 | |
panda|ruck | I meant the other half on 94ad4df4585c86761c4eb4406080d2ede5e13e48 | 21:47 |
panda|ruck | this is what promoted in the end 94ad4df4585c86761c4eb4406080d2ede5e13e48 | 21:48 |
panda|ruck | but we're missing the container images | 21:48 |
*** dmarlin has quit IRC | 21:48 | |
*** ansmith has joined #tripleo | 21:48 | |
amoralej | panda|ruck, yeah | 21:48 |
*** jcoufal has joined #tripleo | 21:49 | |
panda|ruck | failed: [localhost] (item=aodh-api) => {"failed": true, "item": "aodh-api", "msg": "Error pulling trunk.registry.rdoproject.org/master/centos-binary-aodh-api - code: None message: Error: image master/centos-binary-aodh-api:94ad4df4585c86761c4eb4406080d2ede5e13e48_b1259967 not found" | 21:49 |
panda|ruck | are the images even there ? | 21:49 |
amoralej | panda|ruck, where do you see that? | 21:49 |
amoralej | i see it's still running in https://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-master-containers-build/247/console | 21:49 |
amoralej | for the promoted hash | 21:50 |
panda|ruck | amoralej: the promoter script, the part that is supposed to reaupload the images to dockerhub | 21:50 |
amoralej | oh | 21:50 |
*** jcoufal_ has quit IRC | 21:50 | |
amoralej | the container-build job is not in the list of jobs to promote | 21:51 |
panda|ruck | no, because the test on that hash count | 21:51 |
panda|ruck | not the build itself | 21:51 |
panda|ruck | and the test run only when the build succeded | 21:52 |
amoralej | but it seems the child jobs doesn't force to use the same hash | 21:52 |
amoralej | do they pull hash tag for containers? | 21:52 |
amoralej | or something like tripleo-ci-testing? | 21:52 |
dsneddon | fpan, It took me a while with distractions, but I reviewed https://review.openstack.org/#/c/513972/1 | 21:52 |
amoralej | panda|ruck, so, i'm not concerned about the content of the repo | 21:53 |
dmsimard | amoralej, panda|ruck: periodic jobs typically don't overlap, maybe the fact that this one was triggered manually didn't prevent the overlap | 21:53 |
panda|ruck | amoralej: it uses tripleo-ci-testing, because the jobs are supposed to run one at a time | 21:53 |
amoralej | the difference between the two hashes is just a commit | 21:53 |
amoralej | but we need to fix the containers thing | 21:53 |
panda|ruck | dmsimard: that's what I suspect | 21:53 |
*** amodi has quit IRC | 21:53 | |
fpan | dsneddon: thanks! | 21:53 |
amoralej | dmsimard, yes, that's my guess too | 21:53 |
dmsimard | amoralej: now, to tell if that's a bug or not... I have no clue | 21:54 |
amoralej | panda|ruck, can we manually upload containers if https://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-master-containers-build/247/console finishes ok? | 21:54 |
panda|ruck | amoralej: yes | 21:54 |
dsneddon | fpan, Have you tested this change with actual hardware? | 21:54 |
amoralej | ok, then i think it's not that bad, just let's hope we don't hit any issue in the job | 21:54 |
dsneddon | fpan, I would, but I don't have access to the right hardware. | 21:55 |
amoralej | ok it failed | 21:55 |
amoralej | :( | 21:55 |
fpan | dsneddon: yeah, I did test it on my server, and had cisco test it too | 21:55 |
*** bnemec has joined #tripleo | 21:55 | |
dsneddon | fpan, Yeah, all the functional bits looked good to me, just a couple of questions about unit tests and sanity checking. | 21:55 |
panda|ruck | we have to revert the promotion | 21:56 |
amoralej | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-centos-7-master-containers-build/14bf5a5/kolla/logs/opendaylight.log | 21:56 |
amoralej | dmsimard, could we re-run only that job with sfmanager ? | 21:56 |
dmsimard | amoralej: re-run that periodic job ? I'd rather stay away from enqueuing periodic jobs now :) | 21:57 |
fpan | dsneddon: yeah good catch, I used members[0] for both of the interfaces, that's why it passed with the wrong names eth1, will fix | 21:58 |
amoralej | dmsimard, panda|ruck i need to leave now | 21:59 |
*** paramite has quit IRC | 21:59 | |
amoralej | what if we promote 3b718f3fecc866332ec0663fa77e758f8346ab93 | 21:59 |
amoralej | panda|ruck, ^ | 21:59 |
amoralej | we have containers for that | 21:59 |
amoralej | in fact that's the hash actually used for the jobs that passed | 22:00 |
dmsimard | I have to leave soon too, need to go out with the kids for halloween | 22:00 |
panda|ruck | amoralej: because half of the jobs did not test that hash | 22:00 |
amoralej | which ones? | 22:01 |
dsneddon | fpan, As far as I'm concerned, it's a +2 with that fixed. | 22:01 |
amoralej | panda|ruck, look at https://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-master-containers-build/246/ | 22:01 |
dmsimard | panda|ruck, amoralej: if the jobs passed without too much of a hiccup, we can likely expect the next run to pass | 22:01 |
fpan | dsneddon: great, thanks again for the review | 22:01 |
dsneddon | fpan, And thanks for the patch | 22:01 |
dmsimard | if the jobs running right now are likely to fail, we should abort them to make sure the next run starts clean | 22:01 |
*** jcoufal has quit IRC | 22:02 | |
amoralej | dmsimard, yeah, hopefully but containers-build job is unreliable | 22:02 |
dmsimard | regarding reverting the promotion.. I can help with that later if need be | 22:02 |
panda|ruck | amoralej: featureset016-018 tested the other hash | 22:02 |
dmsimard | not sure what's that imply, but I have to go dress up as pikachu now | 22:02 |
amoralej | panda|ruck, those jobs are based on containers? | 22:02 |
* dmsimard afk | 22:02 | |
panda|ruck | amoralej: yes | 22:03 |
amoralej | then they used 3b718f3fecc866332ec0663fa77e758f8346ab93 although reported to the other one | 22:03 |
amoralej | in fact, there are not containers for 94ad4df4585c86761c4eb4406080d2ede5e13e48_b1259967, so they couldn't use that hash | 22:03 |
panda|ruck | amoralej: probably the used the containers from 3b718f3fecc866332ec0663fa77e758f8346ab93 but tested inside overcloud based on the other | 22:04 |
amoralej | panda|ruck, in any case, the different between the two is not tested | 22:04 |
amoralej | it's just a commit in tripleo-ui | 22:04 |
amoralej | so i'd say it's pretty safe to promote 3b7... | 22:05 |
amoralej | but anyway | 22:05 |
amoralej | we can wait | 22:05 |
amoralej | for next run | 22:05 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Multinode provision role https://review.openstack.org/516795 | 22:05 |
amoralej | i'm leaving | 22:05 |
*** jmelvin has quit IRC | 22:05 | |
*** amoralej is now known as amoralej|off | 22:05 | |
panda|ruck | all the gates are going to use the the images, and the containers jobs are going to fail without images | 22:05 |
panda|ruck | I think I'll revert | 22:06 |
*** leitan has quit IRC | 22:08 | |
*** bobh has joined #tripleo | 22:13 | |
*** chlong has quit IRC | 22:14 | |
*** moshele has joined #tripleo | 22:17 | |
*** gfidente|afk has quit IRC | 22:19 | |
*** bobh has quit IRC | 22:20 | |
openstackgerrit | Merged openstack/tripleo-validations master: Specify vars after children sections https://review.openstack.org/516764 | 22:27 |
*** itlinux has quit IRC | 22:41 | |
*** moshele has quit IRC | 22:42 | |
*** cylopez has joined #tripleo | 22:45 | |
*** cylopez has quit IRC | 22:46 | |
*** rlandy has quit IRC | 22:49 | |
panda|ruck | the dashboard did not reset | 22:52 |
*** jlabarre has quit IRC | 22:57 | |
*** adac has quit IRC | 22:57 | |
mwhahaha | shardy_afk, dsneddon: when you guys get a chance cna you re-review https://review.openstack.org/#/c/512395/ It had fallen into merge conflict and i cleaned it up since trozet isn't around | 23:16 |
dsneddon | mwhahaha, Is the rdo-kolla-build-integration job broken, or did that patch not pass the test? | 23:17 |
mwhahaha | dsneddon: i don't think i've ever seen that pass. | 23:17 |
*** brault_ has joined #tripleo | 23:18 | |
*** brault has quit IRC | 23:18 | |
mwhahaha | dsneddon: seems broken on opendaylight | 23:18 |
*** leitan has joined #tripleo | 23:19 | |
dsneddon | mwhahaha, OK, I attempted to merge it. | 23:20 |
dsneddon | mwhahaha, Thanks | 23:20 |
dsneddon | mwhahaha, Since it had already received the necessary +2s and I tried to workflow +1 once already. | 23:20 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: Bump fs.inotify.max_user_instances for scale https://review.openstack.org/509521 | 23:20 |
*** yamahata has quit IRC | 23:21 | |
*** yamahata has joined #tripleo | 23:21 | |
openstackgerrit | Merged openstack/instack-undercloud master: Remove legacy ceilometer api from undercloud https://review.openstack.org/507936 | 23:22 |
*** moshele has joined #tripleo | 23:23 | |
*** chem has quit IRC | 23:25 | |
mwhahaha | dsneddon: ok thanks | 23:27 |
mwhahaha | Hey look things are finally merging | 23:27 |
*** leitan has quit IRC | 23:29 | |
*** leitan has joined #tripleo | 23:30 | |
*** daidv has quit IRC | 23:35 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Don't open unused nova ports in iptables https://review.openstack.org/514330 | 23:35 |
openstackgerrit | Merged openstack/tripleo-quickstart master: Update images location to new ones https://review.openstack.org/510363 | 23:35 |
*** daidv has joined #tripleo | 23:35 | |
*** moshele has quit IRC | 23:40 | |
*** leitan has quit IRC | 23:40 | |
*** moshele has joined #tripleo | 23:40 | |
*** leitan has joined #tripleo | 23:44 | |
*** bfournie has joined #tripleo | 23:47 | |
openstackgerrit | James Slagle proposed openstack/tripleo-common master: Additional tests for config-download https://review.openstack.org/511506 | 23:49 |
openstackgerrit | James Slagle proposed openstack/tripleo-common master: Skip hidden files in test_tags_are_set https://review.openstack.org/512875 | 23:49 |
openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add workflow for deployment via config-download https://review.openstack.org/512876 | 23:49 |
openstackgerrit | James Slagle proposed openstack/tripleo-common master: Log Ansible actions to ansible.log https://review.openstack.org/514783 | 23:49 |
openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add work_dir for some actions https://review.openstack.org/514784 | 23:50 |
*** moshele has quit IRC | 23:50 | |
openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Add --config-download https://review.openstack.org/514701 | 23:50 |
*** moshele has joined #tripleo | 23:54 | |
*** achadha has quit IRC | 23:56 | |
*** achadha has joined #tripleo | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!