| *** chem has quit IRC | 00:07 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Get DLRN hash before setting up respos and images https://review.openstack.org/512855 | 00:08 |
|---|---|---|
| *** gvrangan_ has joined #tripleo | 00:09 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724347 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 00:10 |
| openstack | Launchpad bug 1724347 in tripleo "scenario001 failing as docker.io is seen twice in the ceph/daemon image url" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 00:10 |
| *** bobh has joined #tripleo | 00:13 | |
| *** jlabarre has quit IRC | 00:19 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Get DLRN hash before setting up respos and images https://review.openstack.org/512855 | 00:25 |
| *** psachin has joined #tripleo | 00:32 | |
| -openstackstatus- NOTICE: due to unscheduled restart of zuulv3.o.o you will need to 'recheck' your jobs that were last running. Sorry for the inconvenience. | 00:33 | |
| *** bobh has quit IRC | 00:33 | |
| *** isq has quit IRC | 00:45 | |
| *** isq has joined #tripleo | 00:45 | |
| *** limao has joined #tripleo | 00:48 | |
| *** gvrangan_ has quit IRC | 00:50 | |
| *** gvrangan has joined #tripleo | 00:55 | |
| *** tongl has joined #tripleo | 00:55 | |
| *** gvrangan has quit IRC | 01:06 | |
| *** gvrangan has joined #tripleo | 01:08 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724347 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 01:10 |
| openstack | Launchpad bug 1724347 in tripleo "scenario001 failing as docker.io is seen twice in the ceph/daemon image url" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 01:10 |
| *** tongl has quit IRC | 01:11 | |
| *** yamahata has quit IRC | 01:27 | |
| *** gvrangan has quit IRC | 01:36 | |
| *** bobh has joined #tripleo | 01:36 | |
| *** bobh has quit IRC | 01:37 | |
| *** tongl has joined #tripleo | 01:47 | |
| *** dsariel has quit IRC | 01:53 | |
| *** dpawar has joined #tripleo | 02:01 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 02:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724347 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 02:10 |
| openstack | Launchpad bug 1724347 in tripleo "scenario001 failing as docker.io is seen twice in the ceph/daemon image url" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 02:10 |
| *** limao has quit IRC | 02:14 | |
| *** limao_ has joined #tripleo | 02:14 | |
| *** rlandy has quit IRC | 02:17 | |
| *** dpawar has quit IRC | 02:30 | |
| *** ecerquei has joined #tripleo | 02:35 | |
| *** chlong has quit IRC | 02:47 | |
| *** yamahata has joined #tripleo | 02:47 | |
| *** jcoufal has quit IRC | 02:47 | |
| *** limao_ has quit IRC | 03:03 | |
| *** limao has joined #tripleo | 03:05 | |
| *** limao has quit IRC | 03:06 | |
| *** limao_ has joined #tripleo | 03:06 | |
| *** limao has joined #tripleo | 03:09 | |
| *** limao has quit IRC | 03:09 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724347 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 03:10 |
| openstack | Launchpad bug 1724347 in tripleo "scenario001 failing as docker.io is seen twice in the ceph/daemon image url" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 03:10 |
| *** limao has joined #tripleo | 03:10 | |
| *** limao_ has quit IRC | 03:11 | |
| *** limao has quit IRC | 03:12 | |
| *** limao has joined #tripleo | 03:12 | |
| *** limao has quit IRC | 03:16 | |
| *** limao has joined #tripleo | 03:17 | |
| *** limao has quit IRC | 03:21 | |
| *** openstackgerrit has quit IRC | 03:22 | |
| *** limao has joined #tripleo | 03:22 | |
| *** limao has quit IRC | 03:22 | |
| *** sri_ has quit IRC | 03:31 | |
| *** mdnadeem has joined #tripleo | 03:36 | |
| *** shreshtha has joined #tripleo | 03:39 | |
| *** dhill_ has quit IRC | 03:41 | |
| *** links has joined #tripleo | 03:45 | |
| *** gkadam has joined #tripleo | 03:55 | |
| *** dhill_ has joined #tripleo | 03:59 | |
| *** fabbione has quit IRC | 04:04 | |
| *** udesale has joined #tripleo | 04:09 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724347 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 04:10 |
| openstack | Launchpad bug 1724347 in tripleo "scenario001 failing as docker.io is seen twice in the ceph/daemon image url" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 04:10 |
| *** ykarel|away has joined #tripleo | 04:10 | |
| *** fabbione has joined #tripleo | 04:12 | |
| *** ecerquei has quit IRC | 04:14 | |
| *** udesale has quit IRC | 04:14 | |
| *** udesale has joined #tripleo | 04:15 | |
| *** dbecker has quit IRC | 04:20 | |
| *** tzumainn has quit IRC | 04:25 | |
| *** gvrangan has joined #tripleo | 04:31 | |
| *** dbecker has joined #tripleo | 04:34 | |
| *** janki has joined #tripleo | 04:36 | |
| *** abregman has joined #tripleo | 04:39 | |
| *** limao has joined #tripleo | 04:47 | |
| *** vpickard has quit IRC | 04:50 | |
| *** dhill_ has quit IRC | 04:52 | |
| *** dhill_ has joined #tripleo | 04:58 | |
| *** vpickard has joined #tripleo | 05:02 | |
| *** dhill_ has quit IRC | 05:04 | |
| *** dhill_ has joined #tripleo | 05:09 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724347 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 05:10 |
| openstack | Launchpad bug 1724347 in tripleo "scenario001 failing as docker.io is seen twice in the ceph/daemon image url" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 05:10 |
| *** shreshtha is now known as shreshtha|wfh | 05:11 | |
| *** shreshtha|wfh is now known as shreshtha|wfh-af | 05:12 | |
| *** pmannidi has quit IRC | 05:15 | |
| *** yolanda has quit IRC | 05:15 | |
| *** shardy has quit IRC | 05:23 | |
| *** limao has quit IRC | 05:23 | |
| *** limao has joined #tripleo | 05:24 | |
| *** shardy has joined #tripleo | 05:25 | |
| *** janki has quit IRC | 05:25 | |
| *** limao has quit IRC | 05:29 | |
| *** gvrangan has quit IRC | 05:36 | |
| *** dsariel has joined #tripleo | 05:48 | |
| *** iranzo has joined #tripleo | 05:52 | |
| *** aufi has joined #tripleo | 05:54 | |
| *** marios has joined #tripleo | 05:55 | |
| *** agurenko has joined #tripleo | 05:56 | |
| *** mcornea has joined #tripleo | 05:59 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724347 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 06:10 |
| openstack | Launchpad bug 1724347 in tripleo "scenario001 failing as docker.io is seen twice in the ceph/daemon image url" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 06:10 |
| *** gvrangan has joined #tripleo | 06:10 | |
| *** gvrangan has quit IRC | 06:14 | |
| *** gvrangan has joined #tripleo | 06:14 | |
| *** nyechiel has joined #tripleo | 06:15 | |
| *** jprovazn has joined #tripleo | 06:18 | |
| *** janki has joined #tripleo | 06:24 | |
| *** shreshtha|wfh-af is now known as shreshtha|wfh | 06:24 | |
| *** jfrancoa has joined #tripleo | 06:33 | |
| *** hjensas has joined #tripleo | 06:36 | |
| *** hjensas has quit IRC | 06:36 | |
| *** hjensas has joined #tripleo | 06:36 | |
| *** iranzo has quit IRC | 06:36 | |
| *** chem has joined #tripleo | 06:39 | |
| *** ykarel|away is now known as ykarel | 06:40 | |
| *** jtomasek has joined #tripleo | 06:41 | |
| *** iranzo has joined #tripleo | 06:42 | |
| *** tongl has quit IRC | 06:44 | |
| *** jtomasek has quit IRC | 06:44 | |
| *** jtomasek has joined #tripleo | 06:45 | |
| *** pcaruana has joined #tripleo | 06:45 | |
| lvdombrkr | morning folks, how understood which of controllors are master at the moment? pcs status shows : Masters: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ] | 06:52 |
| lvdombrkr | they cant be all masters at same time | 06:52 |
| *** gvrangan has quit IRC | 06:56 | |
| *** ykarel_ has joined #tripleo | 06:57 | |
| *** gvrangan has joined #tripleo | 06:58 | |
| *** ykarel has quit IRC | 06:59 | |
| *** jpich has joined #tripleo | 07:05 | |
| *** jlinkes has joined #tripleo | 07:06 | |
| Tengu | lvdombrkr: it depends on the service you want. | 07:07 |
| Tengu | lvdombrkr: for instance, you have copied the gallera part - it's a multi-master :). | 07:07 |
| Tengu | lvdombrkr: but, if you want to know which server answers for the API, check the IP attachements | 07:08 |
| Tengu | lvdombrkr: i.e. ip-<your public ip> (ocf::heartbeat:IPaddr2): Started controller-1 | 07:08 |
| Tengu | in my case | 07:08 |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724347 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 07:10 |
| openstack | Launchpad bug 1724347 in tripleo "scenario001 failing as docker.io is seen twice in the ceph/daemon image url" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 07:10 |
| Tengu | lvdombrkr: does it answer you concerns? | 07:10 |
| lvdombrkr | Tengu: hi, so in my case its controller-2, if public api ip is 85.31.103.14http://paste.openstack.org/raw/623918/ | 07:10 |
| Tengu | lvdombrkr: yep. although I don't know what are the other IPs, possibly some internal API endpoints. | 07:11 |
| Tengu | also, you have the master set for redis, on controller-2 | 07:11 |
| Tengu | but redis is not attached to the public IP, so it can be master on another one. one of the IPs is for redis, btw. | 07:12 |
| lvdombrkr | Tengu: thanks now its clear..do you have any issues with controller HA in your env? errors, failed states etc? | 07:15 |
| lvdombrkr | or its works well? | 07:15 |
| lvdombrkr | im right now on testing it | 07:15 |
| Tengu | lvdombrkr: I had some after a major reboot of the whole servers, they weren't able to rejoin the HA, but after a second reboot of one node it was OK. | 07:15 |
| *** pgadiya has joined #tripleo | 07:16 | |
| Tengu | lvdombrkr: there's only one issue: the time for the public IP to be attached to a new controller is really long. | 07:16 |
| Tengu | more than a minute. It could be shorter. | 07:16 |
| shardy | Tengu: you mean time to fail over the vips? | 07:17 |
| Tengu | shardy: yep | 07:17 |
| Tengu | (hello btw :)) | 07:17 |
| *** tesseract has joined #tripleo | 07:17 | |
| shardy | Yeah that doesn't sound right, care to raise a bug with more details? | 07:18 |
| shardy | and hello, good morning all :) | 07:18 |
| lvdombrkr | Tengu: mhmm...and there is no way how to decrease time? | 07:18 |
| Tengu | shardy: hmm ok. I'll check a bit more in order to get some more information with logs and timers. Not sure I'll be able to do that right now as some colleagues are actively using the openstack through its API, they won't really like a timeout with terraform ;) | 07:19 |
| lvdombrkr | Tengu: i dont have issues with adding floating ip.. as far as i tested | 07:19 |
| shardy | Tengu: ack, well let us know when you have more details and hopefully we can debug it | 07:19 |
| Tengu | lvdombrkr: ah, adding floating IP isn't an issue for me neither. it's the public API endpoint failover that takes ages. | 07:19 |
| Tengu | shardy: np. Probably this weekend, it's a matter of rebooting a server in fact :). | 07:20 |
| jfrancoa | hi, good morning! Is there anybody having a look at the failing CI upgrades job scenario001-multinode-oooq-container-upgrades. It's failing due to this: "Could not find the requested service openstack-ceilometer-central" | 07:20 |
| shardy | bandini: ^^ Is that something you've tested lately by any chance? | 07:20 |
| shardy | (time for vip failover when rebooting a controller) | 07:21 |
| jfrancoa | I did not find any related bug in launchpad or BZ, but to avoid checking it in case anybody is already having a look at it | 07:21 |
| Tengu | shardy: ah, maybe you can help me: I've activated neutron-lbaasv2, it's activated (I can see the network agents), but apparently there isn't any entry in Horizon interface. Is there anything to do in order to activate it? I've included the following env file: environments/services/neutron-lbaasv2.yaml | 07:22 |
| *** ebarrera has joined #tripleo | 07:24 | |
| bandini | shardy: erm not lately no | 07:24 |
| *** yprokule has joined #tripleo | 07:24 | |
| Tengu | ah :) | 07:25 |
| shardy | Tengu: Hmm, not a horizon expert but do you have a /etc/openstack-dashboard/local_settings you can share? | 07:25 |
| shardy | I don't see where we configure OPENSTACK_NEUTRON_NETWORK = {'enable_lb': True in puppet atm | 07:26 |
| shardy | so it may be a bug | 07:26 |
| * shardy brb school run | 07:26 | |
| *** shardy is now known as shardy_afk | 07:26 | |
| Tengu | shardy_afk: hmm ok. | 07:26 |
| Tengu | shardy_afk: indeed, enable_lb is set to false. | 07:27 |
| Tengu | shardy_afk: http://paste.openstack.org/show/623920/ (for your backlog ;)) | 07:28 |
| *** ipsecguy_ has joined #tripleo | 07:28 | |
| *** openstackgerrit has joined #tripleo | 07:29 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-heat-templates master: Adding multinode-3nodes-registry.yaml https://review.openstack.org/512595 | 07:29 |
| *** ipsecguy has quit IRC | 07:31 | |
| Tengu | hmm. apparently, we might be missing the entry in hiera key "horizon::neutron_options". | 07:32 |
| Tengu | I might enable it using the ControllerExtraParams, shardy_afk - but I'll open a bug first. | 07:33 |
| *** Vhisker has joined #tripleo | 07:34 | |
| *** ccamacho has joined #tripleo | 07:34 | |
| Vhisker | Hi. I was trying to install tripleo, following the documentation at http://tripleo.org/install/installation/installing.html and it fails at installing the tripleo CLI with an error that is clearly a repo conflict issue. https://pastebin.com/hLHU3Jij Any ideas? I'm on CentOS 7. | 07:38 |
| Vhisker | The procedure with multiple repos looks quite involved. | 07:38 |
| Tengu | shardy_afk: https://bugs.launchpad.net/tripleo/+bug/1724471 I think I'm pretty close to the cause. But I don't know templates enough in order to correct it myself. | 07:38 |
| openstack | Launchpad bug 1724471 in tripleo "[Pike] lbaas activation doesn't enable_lb in horizon" [Undecided,New] | 07:38 |
| *** rodolof has joined #tripleo | 07:40 | |
| *** jpena|off is now known as jpena | 07:42 | |
| arxcruz | EmilienM: hey, which jobs you want for python-tempestconf ? | 07:45 |
| *** egonzalez has joined #tripleo | 07:46 | |
| *** ykarel_ is now known as ykarel | 07:46 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui stable/pike: Fix ParameterInput component https://review.openstack.org/512955 | 07:48 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui stable/pike: Add notification message to nodes tagging dialog https://review.openstack.org/512956 | 07:48 |
| *** iranzo has quit IRC | 07:48 | |
| *** shreshtha|wfh has quit IRC | 07:50 | |
| *** iranzo has joined #tripleo | 07:50 | |
| *** iranzo has joined #tripleo | 07:50 | |
| marios | jfrancoa: did you see this one https://review.openstack.org/#/c/509645/ might be relevant to the issue you were looking at ? | 07:51 |
| *** paramite has joined #tripleo | 07:52 | |
| *** amoralej|off is now known as amoralej | 07:53 | |
| lyarwood | EmilienM: ah onderful, thanks re the fast-forward upgrade spec! :) | 07:53 |
| lyarwood | wonderful* | 07:53 |
| jfrancoa | marios: thanks, that's helpful! although it has not been merged yet...so there must be something related that landed recently. | 07:54 |
| *** udesale has quit IRC | 07:55 | |
| lvdombrkr | folks, how many ms its normal loading pages in horizon dashboard ? | 07:57 |
| lvdombrkr | for me seems dashboard is too slow | 07:57 |
| *** sshnaidm|off is now known as sshnaidm | 07:59 | |
| shardy_afk | Vhisker: Hi can you share the output of yum repolist and the /etc/yum.repos.d files please? | 07:59 |
| *** shardy_afk is now known as shardy | 08:00 | |
| shardy | Tengu: can you please add the ControllerExtraConfig hieradata you use to enable it, then I can show how we might add that to the templates/puppet-tripleo | 08:01 |
| shardy | thanks :) | 08:01 |
| Tengu | shardy: ah, I didn't enable it for now. will test and try and validate - it was "only" a supposition. My sentence was a bit too "it works" I guess. | 08:01 |
| shardy | Tengu: ack, understood - I just didn't want us both to spend time looking at the same puppet modules to figure it out :) | 08:02 |
| shardy | if you're able to take a look that would be very helpful | 08:02 |
| Tengu | shardy: will do it now. | 08:02 |
| shardy | thanks! | 08:02 |
| *** jidar has quit IRC | 08:03 | |
| Tengu | shardy: but, according to https://github.com/openstack/puppet-tripleo/blob/f7d34f038d7d5ff1d4fd05955e2f444ffd44b023/manifests/profile/base/horizon.pp#L53 I think I'll just push "horizon::neutron_options: { 'enable_lb': True}" | 08:04 |
| *** fpan has quit IRC | 08:04 | |
| *** fpan has joined #tripleo | 08:05 | |
| Tengu | shardy: although… hmmm. apparently there no "neutron_option" in any hiera file on the controller. | 08:05 |
| Tengu | ah. there's a merge L94 in the very same file. | 08:05 |
| Tengu | ok, so it should work. | 08:05 |
| *** eck` has quit IRC | 08:07 | |
| shardy | Tengu: ack, so we'll have to add it, thanks for looking into it | 08:07 |
| *** lucas-afk has quit IRC | 08:07 | |
| *** jmelvin_ has joined #tripleo | 08:07 | |
| *** eck` has joined #tripleo | 08:07 | |
| *** akrzos has quit IRC | 08:07 | |
| *** arxcruz has quit IRC | 08:07 | |
| *** rook has quit IRC | 08:07 | |
| shardy | Tengu: the template fix will be to add a horizon entry to service_config_settings in the lbaas service template, like this: | 08:07 |
| *** lebauce_ has joined #tripleo | 08:07 | |
| *** pliu has quit IRC | 08:07 | |
| *** weshay|ruck has quit IRC | 08:07 | |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/heat-engine.yaml#L146 | 08:07 |
| *** vkhanna has quit IRC | 08:07 | |
| *** jpena has quit IRC | 08:07 | |
| Tengu | shardy: although… apparently, we're missing a package on the controller, or in the repository. | 08:07 |
| *** ansiwen has quit IRC | 08:08 | |
| *** jmelvin has quit IRC | 08:08 | |
| Tengu | shardy: ah, sooo… horizon:\n neutron_options: {} ? | 08:08 |
| *** pliu has joined #tripleo | 08:08 | |
| *** rook has joined #tripleo | 08:08 | |
| Tengu | (with enable_lb: True, of course) | 08:08 |
| *** jpena has joined #tripleo | 08:08 | |
| *** vkhanna has joined #tripleo | 08:09 | |
| *** rook is now known as Guest83828 | 08:09 | |
| shardy | Tengu: nearly, service_config_settings: \n horizon:\n horizon::neutron_options: ... | 08:09 |
| Tengu | shardy: ah :). So I can do the correction on my own. | 08:09 |
| shardy | Tengu: the first "horizon" just say to wire the hieradata into whatever role/nodes are running horizon | 08:09 |
| *** akrzos has joined #tripleo | 08:09 | |
| *** weshay has joined #tripleo | 08:09 | |
| shardy | as it might not be the same ones running neutron | 08:09 |
| *** lucasagomes has joined #tripleo | 08:09 | |
| shardy | s/say/says | 08:09 |
| *** arxcruz has joined #tripleo | 08:10 | |
| Tengu | shardy: just have to validate a thing: on horizon channel, they are talking about some package, and I think it might be missing. | 08:10 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724347 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 08:10 |
| openstack | Launchpad bug 1724347 in tripleo "scenario001 failing as docker.io is seen twice in the ceph/daemon image url" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 08:10 |
| *** lebauce_ has quit IRC | 08:10 | |
| Tengu | shardy: "you need the neutron-lbaas-dashboard-plugin" | 08:10 |
| shardy | Tengu: ack, Ok well I guess we can do the hieradata fix as a first step | 08:10 |
| *** ansiwen has joined #tripleo | 08:10 | |
| Tengu | Warning: No matches found for: neutron-lbaas-dashboard-plugin | 08:10 |
| Tengu | bingo. | 08:11 |
| Tengu | shardy: that will most probably break horizon if we activate the lbaas dashboard withtout its plugin. bad idea. | 08:11 |
| Tengu | shardy: I'll update the issue. | 08:11 |
| shardy | Tengu: Hmm, I see openstack-neutron-lbaas-ui but not sure if that's horizon or something else | 08:11 |
| Tengu | hmmm. | 08:11 |
| shardy | Tengu: yeah sure I'm just saying we'll need two dependent patches | 08:12 |
| Tengu | shardy: checking if the -ui is the same. | 08:12 |
| *** benone has quit IRC | 08:13 | |
| shardy | Tengu: https://paste.fedoraproject.org/paste/an2vrbikB5gwRC1HzaoFHg/ | 08:13 |
| Tengu | apparently, it's not installed nor installable on my pike deploy :/ | 08:14 |
| shardy | https://trunk.rdoproject.org/centos7-pike/current-tripleo/openstack-neutron-lbaas-ui-3.0.2-0.20170914192224.9a1f551.el7.centos.noarch.rpm | 08:14 |
| *** cylopez has joined #tripleo | 08:14 | |
| Tengu | shardy: I only have two packages maching neutron-lbaas: openstack-neutron-lbaas.noarch python-neutron-lbaas.noarch | 08:14 |
| Tengu | o_O | 08:15 |
| Tengu | that's… weird ? | 08:15 |
| shardy | contains https://trunk.rdoproject.org/centos7-pike/current-tripleo/openstack-neutron-lbaas-ui-3.0.2-0.20170914192224.9a1f551.el7.centos.noarch.rpm | 08:15 |
| shardy | I mean /usr/share/openstack-dashboard/openstack_dashboard/local/enabled/_1481_project_ng_loadbalancersv2_panel.py | 08:15 |
| shardy | which I'm guessing is what you need? | 08:15 |
| *** lebauce has quit IRC | 08:15 | |
| Tengu | yup, that's what I need indeed. | 08:15 |
| * shardy reiterates he's not a horizon expert ;) | 08:15 | |
| Tengu | now, why isn't the package available on my freshly installed centos7 pike… ? | 08:15 |
| shardy | Tengu: I'd check the repos enabled and their priorities, the repo I just linked is the latest promoted packages used in TripleO pike CI | 08:16 |
| Tengu | hmm. | 08:16 |
| *** benone has joined #tripleo | 08:17 | |
| Tengu | interesting… | 08:17 |
| Tengu | apaprently, I'm missing the rdo repo. although our own puppet should not purge present repositories. | 08:18 |
| *** lebauce has joined #tripleo | 08:19 | |
| Tengu | shardy: ok, it seems the overcloud image doesn't have the delorea repos. Is it right? | 08:21 |
| shardy | Tengu: yes we don't install the repos by default as the hash is constantly changing | 08:21 |
| *** ykarel_ has joined #tripleo | 08:22 | |
| Tengu | shardy: oook. and tripleo deploy doesn't add them neither. | 08:22 |
| openstackgerrit | Michele Baldessari proposed openstack-infra/tripleo-ci master: Switch info links to /home/zuul https://review.openstack.org/512963 | 08:22 |
| Tengu | meaning no way to install the openstack-neutron-lbaas-ui | 08:22 |
| shardy | Tengu: There are several ways to add the repo files, but how you do it depends on preferences we can't really predict | 08:24 |
| shardy | In environments where you want a pre-validated image, you would inject the packages via libguesfs tools, e.g virt-customize or similar | 08:24 |
| *** Vhisker has quit IRC | 08:24 | |
| *** ipsecguy has joined #tripleo | 08:24 | |
| shardy | you could also add repo files via the same method, e.g virt-copy-in | 08:24 |
| Tengu | shardy: any way to add it from some "ExtraConfig" ? and, also, how may I install that package? I guess it's something to do in the puppet lbaas thingy? | 08:25 |
| shardy | or if you're OK with mutating the image on deployment, you can enable repos via UpgradeInitCommand | 08:25 |
| *** ykarel__ has joined #tripleo | 08:25 | |
| shardy | or install RPMs (which could configure repos) via deploy artifacts | 08:25 |
| *** pblaho1 has joined #tripleo | 08:25 | |
| shardy | to enable puppet to install packages on deploy you need to set EnablePackageInstall: true | 08:25 |
| Tengu | we already edit the image in order to inject firmwares for network support :). | 08:25 |
| *** aufi_ has joined #tripleo | 08:26 | |
| shardy | by default it's disabled due to assumptions around not mutating the golden image by default | 08:26 |
| Tengu | that's a good point. | 08:26 |
| Tengu | so a possible way would be to add that package in the image provided by rdo ? | 08:26 |
| Tengu | or I can push an artifact that will hold the openstack-neutron-lbaas-ui RPM | 08:27 |
| shardy | Tengu: yes, you can also add the repos then do virt-customize --update to ensure you have all the same package versions | 08:27 |
| *** ykarel_ has quit IRC | 08:27 | |
| *** benone_ has joined #tripleo | 08:27 | |
| shardy | Tengu: yup either approach is valid, although the artifact approach will only work if there aren't dependencies required from the repos | 08:27 |
| Tengu | shardy: I think the artifact way is the best in my case. | 08:27 |
| shardy | (otherwise you'll need the repos configured) | 08:27 |
| Tengu | I'll check that in some docker in order to see what it will install in addition. | 08:28 |
| *** ykarel has quit IRC | 08:28 | |
| *** ipsecguy_ has quit IRC | 08:28 | |
| *** benone has quit IRC | 08:28 | |
| *** pblaho has quit IRC | 08:28 | |
| *** dciabrin has quit IRC | 08:28 | |
| *** aufi has quit IRC | 08:28 | |
| *** leseb has quit IRC | 08:28 | |
| *** dciabrin has joined #tripleo | 08:28 | |
| *** leseb has joined #tripleo | 08:28 | |
| *** jrist has quit IRC | 08:30 | |
| shardy | Tengu: https://github.com/openstack/tripleo-puppet-elements/blob/master/elements/overcloud-controller/install.d/package-installs-overcloud-controller#L59 | 08:30 |
| *** fragatina has joined #tripleo | 08:30 | |
| shardy | you might consider just adding it to the default image element | 08:30 |
| shardy | then future images will contain it | 08:30 |
| Tengu | shardy: cool :). | 08:30 |
| *** mnaser has quit IRC | 08:30 | |
| Tengu | but I won't re-deploy right now… | 08:30 |
| *** fragatina has quit IRC | 08:31 | |
| Tengu | so I have to find a way to do it without risking breaking anything. | 08:31 |
| Tengu | shardy: I add this info to the issue. | 08:31 |
| *** fragatina has joined #tripleo | 08:31 | |
| *** yprokule_ has joined #tripleo | 08:32 | |
| Tengu | shardy: I figure out how to do that in my already-running infra, then I'll push two patches for this issue. I assign it to me. | 08:33 |
| *** panda|rover|off has quit IRC | 08:34 | |
| *** yprokule has quit IRC | 08:35 | |
| *** yprokule_ is now known as yprokule | 08:35 | |
| shardy | Tengu: ack, thanks :) | 08:35 |
| Tengu | shardy: thank you for the pointers and help :) | 08:37 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Ceilometer] https://review.openstack.org/507796 | 08:37 |
| *** suuuper has joined #tripleo | 08:39 | |
| *** benone_ has quit IRC | 08:40 | |
| *** dtantsur|afk is now known as dtantsur | 08:40 | |
| *** florianf has quit IRC | 08:40 | |
| *** hewbrocca_afk is now known as hewbrocca | 08:42 | |
| *** mnaser has joined #tripleo | 08:44 | |
| *** derekh has joined #tripleo | 08:45 | |
| *** benone has joined #tripleo | 08:45 | |
| *** gvrangan has quit IRC | 08:45 | |
| *** yprokule_ has joined #tripleo | 08:46 | |
| *** bogdando has joined #tripleo | 08:46 | |
| shardy | Small review at https://review.openstack.org/#/c/512704 if anyone has a moment | 08:47 |
| *** yprokule has quit IRC | 08:48 | |
| *** yprokule_ is now known as yprokule | 08:48 | |
| *** jtomasek has quit IRC | 08:48 | |
| *** jtomasek has joined #tripleo | 08:49 | |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras master: Stop using deprecated --pull-source option https://review.openstack.org/512971 | 08:49 |
| *** panda has joined #tripleo | 08:53 | |
| *** karthiks has joined #tripleo | 08:55 | |
| *** yamahata has quit IRC | 08:55 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test containers update https://review.openstack.org/511175 | 08:55 |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-puppet-elements master: Added missing package for lbaas UI https://review.openstack.org/512977 | 08:55 |
| Tengu | shardy: -^ first one. | 08:56 |
| shardy | Tengu: thanks! small fix needed I think | 08:57 |
| Tengu | shardy: yup. Doing the second one for the service_config_settings in the puppet heat template for lbaas. | 08:57 |
| *** cmyster has quit IRC | 08:58 | |
| *** ykarel__ is now known as ykarel | 08:59 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Enable neutron-lbaasv2 UI in Horizon https://review.openstack.org/512978 | 08:59 |
| Tengu | shardy: -^ guess we're good. | 08:59 |
| Tengu | shardy: ah. I should have asked for the package name. sorry. | 09:03 |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-puppet-elements master: Added missing package for lbaas UI https://review.openstack.org/512977 | 09:04 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Switch scenario004-containers to use ceph-ansible https://review.openstack.org/507526 | 09:05 |
| *** gvrangan has joined #tripleo | 09:05 | |
| Tengu | hmmm. I think I'll need some quotations for the boolean. | 09:08 |
| *** Vhisker has joined #tripleo | 09:09 | |
| *** pmannidi has joined #tripleo | 09:09 | |
| *** tosky has joined #tripleo | 09:10 | |
| Vhisker | shardy: https://pastebin.com/2y4x1A7F that's a repolist and my files in /etc/yum.repos.d | 09:10 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724347 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 09:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 09:10 |
| openstack | Launchpad bug 1724347 in tripleo "scenario001 failing as docker.io is seen twice in the ceph/daemon image url" [Critical,In progress] - Assigned to Martin André (mandre) | 09:10 |
| Tengu | ah, small question: why are some wsgi services running standalone while others are included in httpd? I think the "right" way is standalone, as this allows to restart only one service when mandatory, but… | 09:11 |
| *** tosky has quit IRC | 09:12 | |
| *** tosky has joined #tripleo | 09:13 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Let users customise the node timeout for introspection https://review.openstack.org/494254 | 09:13 |
| shardy | Vhisker: it looks like you're mixing ocata/pike repos? | 09:19 |
| shardy | Tengu: historically most API services supported standalone mode but over time more of them have been moving to run under httpd | 09:20 |
| shardy | Tengu: so right now there is a bit of a mix depending on the support status ref httpd for the individual projects | 09:21 |
| Tengu | shardy: hmm. I think it's a bad practice to move them into httpd :/ | 09:21 |
| Tengu | i.e. in order to restart keystone for some new setting, it will bring down the whole things under httpd. | 09:21 |
| Tengu | and for containers, it's maybe not the best thing as well | 09:22 |
| shardy | Tengu: well you can reload httpd, and in containers the services are isolated anyway as there's not a common httpd | 09:22 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Let users customise the node timeout for introspection https://review.openstack.org/494254 | 09:23 |
| shardy | IIRC there were reasons e.g support for internal tls which motivated aligning with httpd | 09:23 |
| Tengu | shardy: ah. containers are better then. OOk. | 09:23 |
| * shardy looks for jasorior | 09:23 | |
| Tengu | shardy: hmmm. weird. haproxy does the TLS endpoint… | 09:23 |
| Tengu | shardy: he's off until tomorrow :) | 09:24 |
| shardy | Tengu: yes, but we also support tls everywhere, e.g behind the LB over the controlplane between services | 09:24 |
| Tengu | hmmm ok. | 09:24 |
| Vhisker | shardy: It does indeed. But this makes me wonder about the installation instructions at http://tripleo.org/install/installation/installing.html as I followed them slavishly. I know way to little about this to try to sort out what's wrong. Do you guys deploy using another method, as those instructions does not seem to work? | 09:24 |
| Tengu | anyway, the reason "why are there some in httpd and others not" is clear now. | 09:24 |
| Tengu | Vhisker: I've made some ansible stuff in order to ensure all is set up correctly with the right version. | 09:25 |
| mandre | anyone knows if we're allowed to make changes to zuul-legacy-project-templates.yaml file in openstack-zuul-jobs other than removing legacy jobs? | 09:25 |
| shardy | Vhisker: well it does say " | 09:25 |
| shardy | Enable the appropriate repos for the desired release, as indicated below. Do not enable any other repos not explicitly marked for that release." | 09:25 |
| Tengu | Vhisker: until now, it worked pretty well for the undercloud part. | 09:25 |
| *** pgadiya has quit IRC | 09:26 | |
| Vhisker | Tengu: That sounds more like I would do it. Do you have a playbook to share? | 09:26 |
| *** milan has joined #tripleo | 09:26 | |
| shardy | Vhisker: there is a tool called tripleo-repos which aims to make this easier but it's not landed yet | 09:26 |
| shardy | Vhisker: there is also this script which we use in some CI jobs: | 09:26 |
| shardy | https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh | 09:27 |
| Tengu | Vhisker: unfortunately not, as there are many non-var things in there. plus some secrets, and specific parts. | 09:27 |
| shardy | tripleo.sh --repo-setup | 09:27 |
| shardy | you need to export STABLE_RELEASE if you want a stable branch | 09:27 |
| Vhisker | Tengu: Understandable | 09:27 |
| Vhisker | shardy: I'll try that one then, as I am pretty sure I followed the instructions to the letter, and still got a pike repo. I tried to just remove all references to pike and only have ocata, and it still went bonkers. | 09:28 |
| shardy | Vhisker: Ok, possibly we have some error in the docs, but from a quick look it seems perhaps you followed the sections for both pike and ocata at some point | 09:29 |
| *** panda is now known as panda|rover | 09:29 | |
| shardy | if you can spot the error I'll gladly push a patch tho | 09:29 |
| *** fzdarsky has joined #tripleo | 09:29 | |
| Vhisker | shardy: I'll see if I can isolate it. | 09:29 |
| Tengu | hmm. at least I could get a working thing following the same doc. | 09:30 |
| *** egonzalez has quit IRC | 09:31 | |
| lvdombrkr | Vhisker: i also follow same doc. works for me | 09:31 |
| *** shreshtha has joined #tripleo | 09:33 | |
| shardy | mandre: not sure, probably a question for #openstack-infra | 09:34 |
| *** shreshtha has quit IRC | 09:34 | |
| *** shreshtha has joined #tripleo | 09:34 | |
| *** salmankhan has joined #tripleo | 09:35 | |
| Vhisker | Tengu: Hmm. Odd. I must be interpreting some of the indentation differently than you then. | 09:36 |
| Vhisker | lvdombrkr: Thanks. Another reality check that I'm seeing something you are not. | 09:36 |
| * Tengu sees True for the enable_lb thing in horizon configuration | 09:37 | |
| Tengu | that seems pretty good. Waiting for the deploy to end, and will check if it's OK. I suspect horizon won't be reloaded during the process. | 09:37 |
| Vhisker | These are the steps that I do: https://pastebin.com/UbTwxNY8 | 09:37 |
| Tengu | at least, changes to keystone don't reload httpd. | 09:37 |
| shardy | Tengu: that sounds like a bug in the puppet modules to me | 09:38 |
| Tengu | shardy: possible. I'll dig into that. | 09:38 |
| Tengu | Vhisker: line 5 and 6 I'd say | 09:38 |
| lvdombrkr | Vhisker: i think you need just http://paste.openstack.org/raw/623932/ | 09:38 |
| Vhisker | sudo curl -L -o /etc/yum.repos.d/delorean-deps.repo https://trunk.rdoproject.org/centos7/delorean-deps.repo Seems to be the source of pike | 09:38 |
| Tengu | Vhisker: indeed. | 09:38 |
| Tengu | Vhisker: check what lvdombrkr sent, it's seems pretty right. | 09:39 |
| shardy | jistr: Hey, thanks for the latest kubespray patch update, it works well for me now | 09:40 |
| Vhisker | Tengu: Yeah, that seems to make the tripleo-client install go through fine. | 09:41 |
| shardy | jistr, flaper87: question - how should we expose the k8s endpoint so the apb can be deployed via external_deploy_tasks? | 09:41 |
| shardy | are there any patches protyping that yet? | 09:41 |
| Vhisker | lvdombrkr: That checks out fine | 09:41 |
| shardy | I was thinking it should probably go in the endpoint map, or at least be exposed via a stack output so we can discover it via tripleo-ansible-inventory? | 09:42 |
| flaper87 | shardy: I have patches in my laptop that I still have to push | 09:42 |
| chandankumar | sshnaidm: arxcruz please have a look at this review https://review.openstack.org/#/c/499928/ how to make it passing | 09:42 |
| flaper87 | actually, I've pushed one of them | 09:42 |
| flaper87 | 2s | 09:42 |
| flaper87 | shardy: you should be able to access it from the endpoint_map and it should actually be in the inventory already | 09:42 |
| flaper87 | assuming you're using tripleo-inventory | 09:43 |
| flaper87 | the patch I have is for the undercloud deploy command | 09:43 |
| arxcruz | chandankumar: sorry, didn't understood... | 09:43 |
| shardy | flaper87: Ah, I was looking at https://review.openstack.org/#/c/471759 and https://review.openstack.org/#/c/511272/ - we also need a way to discover the overcloud k8s cluster before we can deploy the services on it | 09:44 |
| chandankumar | arxcruz: scenario 2 container jobs are failing with that review, i am not sure how to make it passing | 09:44 |
| flaper87 | shardy: https://review.openstack.org/#/c/511857/ | 09:44 |
| Vhisker | Huh, so the "Enable last known good RDO Trunk Delorean repository for core openstack packages" and "Enable latest RDO Trunk Delorean repository only for the TripleO packages" steps are superfluous? | 09:44 |
| flaper87 | shardy: jistr worked on that, it's one of the tripleo-common patches he has | 09:44 |
| * flaper87 tries to find it | 09:44 | |
| flaper87 | I might be confuse | 09:45 |
| shardy | I'm not certain we want the control-plane k8s to the tenant facing endpoints but we'll need some way for ansible on the undercloud to discover it | 09:45 |
| flaper87 | thing is, if you're using tripleo-inventory, you should have kubernetes_master in your naisble inventory | 09:45 |
| *** fandrieu_ has joined #tripleo | 09:45 | |
| *** fandrieu has quit IRC | 09:45 | |
| *** fandrieu_ is now known as fandrieu | 09:45 | |
| shardy | flaper87: well we have the ips for the masters, but there may be more than 1, so we need to bind a vip to the cluster via haproxy, no? | 09:45 |
| shardy | e.g we'll want a multi-master HA cluster pretty soon, with some way to connect via a vip | 09:46 |
| flaper87 | shardy: sure but, it doesn't really matter what master you talk to | 09:46 |
| flaper87 | I agree we'll need a vip | 09:46 |
| shardy | flaper87: hmm, I assumed we'd want to load balance it | 09:46 |
| shardy | or that kubespray would configure that for us when multiple masters are selected | 09:47 |
| * shardy not tried that yet | 09:47 | |
| flaper87 | shardy: or that, that's still an open question | 09:47 |
| flaper87 | whether to VIP or load balance it | 09:47 |
| lvdombrkr | Vhisker: yes for you | 09:47 |
| shardy | well we need both I think | 09:47 |
| Vhisker | lvdombrkr: So, what are those steps for? | 09:48 |
| flaper87 | shardy: I should be able to push patches to have tripleo deploy the APBs | 09:48 |
| * shardy looks more closely at what kubespray does around this | 09:48 | |
| flaper87 | shardy: I have them in my fork on github | 09:48 |
| shardy | flaper87: ack, thanks anything you have would be helpful, still getting up to speed with this :) | 09:48 |
| flaper87 | but I want to clean them up, the APBs still need some love | 09:48 |
| flaper87 | shardy: sure thing! FWIW, I'm taking care of the integration between the APB and tripleo | 09:48 |
| flaper87 | right now I'm playing with external_task and calling the roles directly instead of using the APB | 09:49 |
| shardy | I'd like to see how deploying a single apb via external_deploy_tasks will look, as I think we have the configuration of at least a single node k8s cluster working now | 09:49 |
| shardy | flaper87: ack, sounds good, if you can push what you have I'll take a look | 09:49 |
| shardy | we'll need that as a precursor to working out upgrades I think | 09:50 |
| shardy | I'll deploy a 3-master setup with kubespray and see what happens ;) | 09:50 |
| *** egonzalez has joined #tripleo | 09:50 | |
| * shardy crosses fingers :D | 09:50 | |
| flaper87 | shardy: yeah, that's why I'm mentioning to avoid duplicating efforts on this. | 09:51 |
| shardy | flaper87: ack, yup thanks I won't spend more time on the tripleo->apb part and will wait for your patches, thanks for confirming | 09:51 |
| shardy | I'll poke at the vip/haproxy part unless anyone is already doing that, and we can revisit upgrades when the apb patches are posted | 09:51 |
| flaper87 | shardy: do poke on that, no one is working on it :) | 09:53 |
| shardy | flaper87: ack :) | 09:53 |
| *** rhallisey has joined #tripleo | 09:54 | |
| flaper87 | shardy: just pushed what I have to GH, should ocme up here: https://github.com/flaper87/tripleo-heat-templates/tree/kubernetes/kubernetes | 09:56 |
| flaper87 | as soon as GH gets their *#$#@$(@*#$@ together | 09:57 |
| Vhisker | lvdombrkr: Many thanks for your help. Now it seems like I need a newer kernel, but that's territory I am familiar with. | 09:57 |
| flaper87 | shardy: I should work on a cleaner commit and push it this week | 09:57 |
| Vhisker | Tengu: Many thanks for your help. I think I have forward motion again. :) | 09:57 |
| shardy | flaper87: ack, would be good to start working up a series in gerrit soon so we can etherpad steps to test and start thinking about experimental CI | 09:57 |
| *** iranzo has quit IRC | 09:57 | |
| shardy | flaper87: ack sounds good | 09:57 |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient stable/pike: Implement minor update workflow with config download https://review.openstack.org/512991 | 09:58 |
| *** iranzo has joined #tripleo | 09:59 | |
| *** iranzo has joined #tripleo | 09:59 | |
| *** fzdarsky has quit IRC | 10:01 | |
| *** ebarrera has quit IRC | 10:02 | |
| *** pmannidi has quit IRC | 10:02 | |
| *** ebarrera has joined #tripleo | 10:02 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Make sure tuned package is installed before calling tuned-adm https://review.openstack.org/512993 | 10:03 |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 10:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724347 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 10:10 |
| openstack | Launchpad bug 1724347 in tripleo "scenario001 failing as docker.io is seen twice in the ceph/daemon image url" [Critical,In progress] - Assigned to Martin André (mandre) | 10:10 |
| *** hjensas has quit IRC | 10:14 | |
| *** Guest83828 is now known as rook | 10:18 | |
| jistr | shardy, flaper87: would be nice to start landing some patches. Any preference whether we want the service_tasks landed and then removed by a subsequent commit (to preserve some history of how things were done) or do we want to drop the service_tasks approach entirely now that we have the external_deploy_tasks working? | 10:19 |
| *** gvrangan has quit IRC | 10:20 | |
| Tengu | shardy: I can confirm: installing the package and adding the ControllerExtraConfig (simulating the output I've added in the puppet/service/neutron-lbaas) actually works. So I think we can move forward with my two patches :). | 10:20 |
| *** gvrangan has joined #tripleo | 10:20 | |
| shardy | jistr: No strong preference, but as posted https://review.openstack.org/#/c/471759/ no longer works, so I'd rather squash it with your patch or remove it - I guess we still want the environment files? | 10:23 |
| shardy | jistr: agree we can start landing things as this works quite well for me locally now :) | 10:23 |
| shardy | jistr: now trying with 3 masters and a single worker node, will let you know how it goes ;) | 10:24 |
| *** fandrieu_ has joined #tripleo | 10:25 | |
| *** fandrieu has quit IRC | 10:26 | |
| *** fandrieu_ is now known as fandrieu | 10:26 | |
| *** fzdarsky has joined #tripleo | 10:30 | |
| *** chem has quit IRC | 10:32 | |
| *** Vhisker has quit IRC | 10:32 | |
| *** chem has joined #tripleo | 10:36 | |
| *** egonzalez has quit IRC | 10:39 | |
| Tengu | bnemec: hello! Are you available for some questions regarding "openstack virtual baremetal"? | 10:43 |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Set file mode permission for Ceph keyrings in containers https://review.openstack.org/508975 | 10:44 |
| *** adarazs is now known as adarazs_lunch | 10:44 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-common master: Get a static inventory for upgrade-non-controller ansible runs https://review.openstack.org/512999 | 10:44 |
| *** mrunge has quit IRC | 10:45 | |
| *** mrunge has joined #tripleo | 10:48 | |
| *** dbecker has quit IRC | 10:49 | |
| *** chlong has joined #tripleo | 11:01 | |
| *** gfidente has joined #tripleo | 11:03 | |
| *** gfidente has quit IRC | 11:03 | |
| *** gfidente has joined #tripleo | 11:03 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Kubespray installation via config download mechanism https://review.openstack.org/511272 | 11:08 |
| *** jrist has joined #tripleo | 11:09 | |
| *** nyechiel_ has joined #tripleo | 11:09 | |
| *** nyechiel has quit IRC | 11:09 | |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724347 | 11:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 11:10 |
| openstack | Launchpad bug 1724347 in tripleo "scenario001 failing as docker.io is seen twice in the ceph/daemon image url" [Critical,In progress] - Assigned to Martin André (mandre) | 11:10 |
| jistr | shardy: ^ i rebased away from the original patch. I've switched the quotes there and i'll address the slightly more disruptive things (local kubectl, artifacts_dir, removing special docker config etc.) in a separate patch so that we can keep moving. | 11:10 |
| *** zzzeek has quit IRC | 11:10 | |
| *** atoth has joined #tripleo | 11:12 | |
| *** fandrieu has quit IRC | 11:14 | |
| *** zzzeek has joined #tripleo | 11:14 | |
| *** fandrieu has joined #tripleo | 11:14 | |
| *** fandrieu has quit IRC | 11:15 | |
| *** fandrieu has joined #tripleo | 11:15 | |
| *** thrash|g0ne is now known as thrash | 11:15 | |
| *** fandrieu has quit IRC | 11:15 | |
| *** fandrieu has joined #tripleo | 11:16 | |
| *** fandrieu has quit IRC | 11:16 | |
| *** fandrieu has joined #tripleo | 11:17 | |
| *** fandrieu has quit IRC | 11:17 | |
| *** hjensas has joined #tripleo | 11:20 | |
| *** hjensas has quit IRC | 11:20 | |
| *** hjensas has joined #tripleo | 11:20 | |
| shardy | jistr: ack sounds good, thanks | 11:23 |
| jistr | shardy: btw i guess adding kubectl to undercloud would mean that we need to run the overcloud deployment playbook with sudo | 11:24 |
| jistr | so that's somewhat of a downside | 11:24 |
| jistr | shardy: actually no, i can probably just use priv escalation as stack user already has passwordless. Sorry for the false alarm :) | 11:25 |
| *** nyechiel_ has quit IRC | 11:26 | |
| *** nyechiel has joined #tripleo | 11:26 | |
| Tengu | anyone can send those two review to the CI? would be great :) https://review.openstack.org/#/c/512977/ https://review.openstack.org/#/c/512978/ thank you! | 11:29 |
| *** ramishra has quit IRC | 11:31 | |
| *** gvrangan has quit IRC | 11:34 | |
| *** gvrangan has joined #tripleo | 11:35 | |
| *** rodolof has quit IRC | 11:36 | |
| *** lucasagomes is now known as lucas-hungry | 11:38 | |
| *** ramishra has joined #tripleo | 11:39 | |
| *** shreshtha has quit IRC | 11:40 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-common master: Adds --overcloud-user option to upgrade-non-controller.sh https://review.openstack.org/512638 | 11:40 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-common master: Get a static inventory for upgrade-non-controller ansible runs https://review.openstack.org/512999 | 11:41 |
| *** liverpooler has quit IRC | 11:43 | |
| openstackgerrit | AndrewToth proposed openstack/tripleo-quickstart master: Adding LBaaSv2 testing https://review.openstack.org/513005 | 11:46 |
| *** ansmith has quit IRC | 11:46 | |
| *** dsariel has quit IRC | 11:49 | |
| openstackgerrit | AndrewToth proposed openstack/tripleo-quickstart master: Adding LBaaSv2 testing https://review.openstack.org/513005 | 11:50 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: DO NOT MERGE testing containerized scenarios https://review.openstack.org/510040 | 11:53 |
| *** abishop has joined #tripleo | 11:54 | |
| *** fandrieu has joined #tripleo | 11:54 | |
| atoth | mwhahaha, I've finally gotten back to the quickstart scenario patch we discussed for lbaasv2 (see above), I recall (possibly mis-recall) you saying it should be then linked to https://review.openstack.org/#/c/485213/ in some way. If I am recalling correctly, how would I link the 2 updates? | 11:56 |
| EmilienM | hi | 11:58 |
| EmilienM | arxcruz: all multinode-container jobs (so 5) | 11:59 |
| EmilienM | arxcruz: they run tempest | 11:59 |
| *** amoralej is now known as amoralej|lunch | 12:00 | |
| *** dtantsur is now known as dtantsur|brb | 12:01 | |
| *** pkovar has joined #tripleo | 12:01 | |
| Tengu | atoth: you're working on lbaasv2 integration? care to validate my (small) reviews ? https://review.openstack.org/#/c/512977/ https://review.openstack.org/#/c/512978/ (yep, that's self-promotion ;)) | 12:02 |
| slagle | EmilienM: plz review https://review.openstack.org/#/c/512704/ | 12:02 |
| arxcruz | EmilienM: what's the name of those jobs ? | 12:03 |
| *** adarazs_lunch is now known as adarazs | 12:03 | |
| *** gvrangan has quit IRC | 12:03 | |
| atoth | Tengu, I'll help if I can, I have very narrow knowledge right now :-) | 12:03 |
| *** gvrangan has joined #tripleo | 12:03 | |
| Tengu | atoth: ah, ok. was asking in case you could +2 :D | 12:03 |
| atoth | Tengu, nope, not that powerful....yet | 12:04 |
| Tengu | anyway, not that urgent for me as I could manage to workaround the issue I had with the UI not being activated. | 12:04 |
| Tengu | atoth: :] | 12:04 |
| EmilienM | arxcruz: tripleo-ci-centos-7-containers-multinode gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container gate-tripleo-ci-centos-7-scenario003-multinode-oooq-container gate-tripleo-ci-centos-7-scenario004-multinode-oooq-container | 12:04 |
| EmilienM | slagle: done | 12:04 |
| *** jcoufal has joined #tripleo | 12:05 | |
| *** trown|outtypewww is now known as trown | 12:05 | |
| Tengu | hmmm. | 12:05 |
| *** jpena is now known as jpena|lunch | 12:06 | |
| Tengu | a weird failure on https://review.openstack.org/#/c/512977/ // legacy-tripleo-ci-centos-7-ovb-ha-oooq is it normal? apparently a broken pipe o_O | 12:06 |
| gfidente | mandre does https://review.openstack.org/512971 need to be backported to stable/pike as well? | 12:07 |
| *** oidgar has joined #tripleo | 12:07 | |
| *** Dinesh_Bhor has quit IRC | 12:09 | |
| Tengu | duh.. seems to be a non-related error. | 12:09 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724347 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 12:10 |
| openstack | Launchpad bug 1724347 in tripleo "scenario001 failing as docker.io is seen twice in the ceph/daemon image url" [Critical,In progress] - Assigned to Martin André (mandre) | 12:10 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Don't doube kill heat_all https://review.openstack.org/491787 | 12:10 |
| Tengu | shardy: ah, didn't know we could cross-link commits in gerrit. Will amend. | 12:10 |
| EmilienM | mandre, jistr: I made progress on the upgrade | 12:10 |
| EmilienM | mandre, jistr: from ocata to pike - now it fails at step1 "Error: Evaluation Error: Error while evaluating a Resource Statement, Class[Rabbitmq]: parameter 'file_limit' expects a value of type Integer[-1, default] or Enum['infinity', 'unlimited'], got String at /etc/puppet/modules/tripleo/manifests/profile/base/rabbitmq.pp:144:7 on node centos-7-inap-mtl01-0000282707.localdomain", | 12:11 |
| EmilienM | http://logs.openstack.org/25/500625/14/check/legacy-tripleo-ci-centos-7-containers-multinode-upgrades/c7c44f5/logs/undercloud/home/zuul/overcloud_upgrade_console.log.txt.gz#_2017-10-18_06_25_47 | 12:11 |
| mandre | gfidente: no need, there is no branch in oooq | 12:11 |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Enable neutron-lbaasv2 UI in Horizon https://review.openstack.org/512978 | 12:11 |
| EmilienM | mandre, jistr: we shouldn't have this error (it was fixed in pike) - I'll investigate, just fyi | 12:11 |
| mandre | EmilienM: ack, could it be that we first deploy ocata? | 12:12 |
| *** dprince has joined #tripleo | 12:12 | |
| *** jlabarre has joined #tripleo | 12:12 | |
| *** ecerquei has joined #tripleo | 12:13 | |
| *** gvrangan has quit IRC | 12:14 | |
| EmilienM | mandre: could be a wrong version of some packages. | 12:15 |
| flaper87 | jistr: shardy yeah, I'd squash them and just go with the final version | 12:16 |
| EmilienM | mandre: yeah, I just found something is wrong with the repos | 12:17 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Add steps needed when using OVB with a testenv broker https://review.openstack.org/512798 | 12:22 |
| *** ecerquei has quit IRC | 12:23 | |
| atoth | Tengu, not sure if my comment on your update is valid, but I gave one :-) | 12:24 |
| *** morazi has joined #tripleo | 12:24 | |
| Tengu | atoth: already answered :) | 12:24 |
| Tengu | (yes, I keep a close eye to my merge requests ;)) | 12:25 |
| atoth | :-) | 12:25 |
| atoth | Tengu, my comments are also a means for me to learn more stuff :-) | 12:25 |
| Tengu | atoth: same for me. don't think I'm some "old timer" ;) | 12:26 |
| Tengu | I'm just good at git grep-ing things :Þ | 12:26 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-common master: WIP Add Octavia post deployment steps to tripleo workflows https://review.openstack.org/487450 | 12:26 |
| atoth | :-) | 12:26 |
| Tengu | and shardy helps me a lot understanding things in order to provide patches. | 12:26 |
| *** raildo has joined #tripleo | 12:26 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: WIP Calling Octavia post deploy from overcloud stack https://review.openstack.org/508195 | 12:27 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Override target_upgrade_version to the right version https://review.openstack.org/512886 | 12:27 |
| atoth | Tengu, yeah, shardy, beagles, EmilienM, and mwhahaha have guided my hand as I muddle trough making a mess of things :-) | 12:27 |
| Tengu | :) | 12:27 |
| EmilienM | mandre: I think we'll need https://review.openstack.org/#/c/500671 | 12:28 |
| * atoth warns the above that there is more mess on the way | 12:28 | |
| *** tzumainn has joined #tripleo | 12:28 | |
| EmilienM | sshnaidm: ^ see https://review.openstack.org/#/c/500671/8 again (and my previous chat with mandre, which is why I think we need to deploy the pike repo) | 12:29 |
| EmilienM | sshnaidm: we are missing the current-pike repo when upgrading ocata jobs to pike | 12:29 |
| fultonj | https://review.openstack.org/#/c/507526/ is green thanks jistr mandre gfidente ! | 12:29 |
| EmilienM | mandre: I would love your review on https://review.openstack.org/#/c/512886/ & sshnaidm as well probably | 12:29 |
| *** pblaho1 has quit IRC | 12:29 | |
| EmilienM | sshnaidm: also https://review.openstack.org/#/c/512708/ | 12:30 |
| EmilienM | mandre: ^ | 12:30 |
| *** pblaho1 has joined #tripleo | 12:30 | |
| * EmilienM stops spamming | 12:30 | |
| *** lucas-hungry is now known as lucasagomes | 12:30 | |
| * atoth doesn't believe that will happen | 12:31 | |
| *** pblaho1 has quit IRC | 12:31 | |
| *** ecerquei has joined #tripleo | 12:31 | |
| *** MVenesio has joined #tripleo | 12:32 | |
| fultonj | should i recheck https://review.openstack.org/#/c/509673 ? it's got like +8 at this point | 12:33 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Implement minor update workflow with config download https://review.openstack.org/487488 | 12:33 |
| *** rlandy has joined #tripleo | 12:33 | |
| fultonj | or do we workflow it and have the gate verify? | 12:33 |
| *** pblaho has joined #tripleo | 12:33 | |
| *** gkadam has quit IRC | 12:34 | |
| EmilienM | pradk: fyi https://bugs.launchpad.net/tripleo/+bug/1724478 | 12:34 |
| openstack | Launchpad bug 1724478 in tripleo "Upgrades CI job failing due to service openstack-ceilometer-central not found" [High,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 12:34 |
| *** liverpooler has joined #tripleo | 12:34 | |
| fultonj | jistr gfidente : recheck or workflow https://review.openstack.org/#/c/509673 ? | 12:36 |
| *** ykarel is now known as ykarel|afk | 12:36 | |
| *** dsariel has joined #tripleo | 12:37 | |
| jistr | fultonj: +workflow won't send it to gate until all voting jobs are green | 12:38 |
| * jistr looking what went wrong | 12:38 | |
| jistr | logs.openstack.org/73/509673/3/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/5f323ae/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz | 12:38 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/pike: Correct template names from ocata to pike. https://review.openstack.org/513018 | 12:38 |
| jistr | http://logs.openstack.org/73/509673/3/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/5f323ae/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz | 12:39 |
| fultonj | jistr: it needs https://review.openstack.org/#/c/512971/1 | 12:40 |
| *** ansmith has joined #tripleo | 12:41 | |
| fultonj | gfidente: jistr : should i add 509673 depends on 512971? | 12:41 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: swift_rsync: don't bind mount /run https://review.openstack.org/513020 | 12:41 |
| jistr | fultonj: yea either that or we can recheck after 512971 merges | 12:42 |
| fultonj | jistr: thanks, i'll do that now | 12:43 |
| *** links has quit IRC | 12:44 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-common master: Default DockerCephDaemonImage to stable, not master, tag https://review.openstack.org/509673 | 12:44 |
| *** cdearborn has joined #tripleo | 12:44 | |
| sshnaidm | EmilienM, looking again on https://review.openstack.org/#/c/500671/8 - so you want to use promoted repo for all packages and newest "consistent" for tripleo packages, right? | 12:46 |
| EmilienM | sshnaidm: or even current-pike? | 12:47 |
| EmilienM | sshnaidm: one of both, but we need something from pike | 12:47 |
| sshnaidm | EmilienM, afaiu current-pike is the same as consistent | 12:47 |
| EmilienM | right now it's deploying puppet-* from master | 12:47 |
| sshnaidm | EmilienM, and why do we need newest packages from current/consistent for upgrades? | 12:48 |
| mandre | EmilienM: just to make sure I understand, https://review.openstack.org/#/c/512886/ is a dirty hack to force the expected release repos? | 12:49 |
| pradk | EmilienM, hmm weird | 12:49 |
| EmilienM | mandre: it's not a dirty hack, it's to override the default, set to master | 12:49 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-common master: Fix step_config output which is str not list https://review.openstack.org/510131 | 12:49 |
| EmilienM | mandre: unless there is a better way to do it | 12:49 |
| mandre | EmilienM: idk, I'd have to dive into the files see what they do, this is still a part of oooq I haven't explored | 12:51 |
| *** rhallisey has quit IRC | 12:52 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Set file mode permission for Ceph keyrings in containers https://review.openstack.org/508975 | 12:53 |
| openstackgerrit | Nir Magnezi proposed openstack/puppet-tripleo master: Add Octavia API endpoint to haproxy https://review.openstack.org/490082 | 12:53 |
| *** rhallisey has joined #tripleo | 12:53 | |
| EmilienM | sshnaidm: this is the repo used after the upgrade: http://logs.openstack.org/25/500625/14/check/legacy-tripleo-ci-centos-7-containers-multinode-upgrades/c7c44f5/logs/subnode-2/etc/yum.repos.d/delorean-current.repo.txt.gz | 12:53 |
| EmilienM | sshnaidm: it contains puppet modules from master, not from stable/pike or the commit in rdoinfo | 12:54 |
| jrist | jpichon: were you able to get these to render? https://review.openstack.org/#/c/506702/ | 12:55 |
| jpich | jrist: Yeah, looking good on the docs job link? | 12:55 |
| *** toure_biab is now known as toure | 12:56 | |
| EmilienM | sshnaidm: I also checked nova for example and it's not pike, it's master (queens at this point) | 12:56 |
| *** rodolof has joined #tripleo | 12:56 | |
| EmilienM | sshnaidm: note, the CI job is on stable/pike (not in master), so it should deploy ocata and upgrade to pike | 12:57 |
| sshnaidm | EmilienM, yep, the repo you pasted above is master repo | 12:57 |
| sshnaidm | EmilienM, well.. I don't think current upgrades role is capable to do it.. if you remember it configures repos in 4 different places and everything there is hardcoded.. | 12:58 |
| jrist | jpich: ah | 12:58 |
| jrist | jpich: duh :( | 12:58 |
| jpich | jrist: Is it failing for you? | 12:58 |
| *** shardy has quit IRC | 13:00 | |
| EmilienM | sshnaidm: some work has been done by mandre and jistr - maybe we could take short time to take a look together | 13:00 |
| jrist | jpich: nope | 13:00 |
| *** shardy has joined #tripleo | 13:00 | |
| jpich | :-) | 13:00 |
| sshnaidm | EmilienM, maybe, but not in repos: https://github.com/openstack/tripleo-quickstart-extras/blob/5d3c2b82ffb7c45269680b9b93aa5f77a363580e/roles/overcloud-upgrade/templates/overcloud-repo-tripleo-ci.yaml.j2#L19 | 13:01 |
| sshnaidm | EmilienM, https://github.com/openstack/tripleo-quickstart-extras/blob/a07e92ba9444066aee55805d95e0f55392495c06/roles/overcloud-upgrade/templates/upgrade-repo-tripleo-ci.sh.j2#L19 | 13:01 |
| sshnaidm | EmilienM, these files configure repo of upgrade | 13:01 |
| sshnaidm | EmilienM, both of them are master | 13:01 |
| EmilienM | sshnaidm: https://review.openstack.org/#/c/512708/ | 13:02 |
| EmilienM | sshnaidm: it was in depends-on | 13:02 |
| *** oidgar has quit IRC | 13:02 | |
| *** jpena|lunch is now known as jpena | 13:03 | |
| *** ebarrera has quit IRC | 13:03 | |
| lvdombrkr | folks, underlcoud cpu usage can be realated somehow with horizon dashboard performance? im trying to investigate why my dashboard is too slow, and found that undercloud cpu 90-95proc used by gnochi | 13:05 |
| lvdombrkr | im tryng to find any clue | 13:06 |
| *** nyechiel_ has joined #tripleo | 13:07 | |
| *** nyechiel has quit IRC | 13:07 | |
| *** ebarrera has joined #tripleo | 13:07 | |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 13:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724347 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 13:10 |
| openstack | Launchpad bug 1724347 in tripleo "scenario001 failing as docker.io is seen twice in the ceph/daemon image url" [Critical,In progress] - Assigned to Martin André (mandre) | 13:10 |
| *** shardy has quit IRC | 13:11 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: upgrades: manage quickstart-centos-base repository https://review.openstack.org/512708 | 13:12 |
| jrist | rbrady, d0ugal I added you to https://review.openstack.org/#/c/506702/ - I wonder if we should link to mistral workflow creation docs? | 13:12 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Override target_upgrade_version to the right version https://review.openstack.org/512886 | 13:12 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Upgrade CI test on stable/pike https://review.openstack.org/500625 | 13:13 |
| *** shardy has joined #tripleo | 13:13 | |
| *** agurenko has quit IRC | 13:14 | |
| trozet | shardy, dsneddon: can you guys review https://review.openstack.org/#/c/512395/ when you get a chance? | 13:15 |
| EmilienM | mandre: sshnaidm and I pushed a new patchset, will let you know :D | 13:16 |
| bandini | mandre, bogdando: I think https://review.openstack.org/#/c/512993/ is good to go? WDYT? | 13:17 |
| *** oidgar has joined #tripleo | 13:18 | |
| *** bfournie has joined #tripleo | 13:20 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Mirror images from RDO server https://review.openstack.org/510362 | 13:21 |
| *** sri_ has joined #tripleo | 13:21 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Create short lived ssh key for enable-ssh-admin.sh https://review.openstack.org/513031 | 13:21 |
| sshnaidm | panda|rover, can we merge it? https://review.openstack.org/#/c/510362/ | 13:21 |
| panda|rover | sshnaidm: I'd wait just a bit more, until promotions + upload are know to work well upstream | 13:23 |
| *** leitan has joined #tripleo | 13:23 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo master: Remove collector classes https://review.openstack.org/512339 | 13:25 |
| trown | sshnaidm: why are we only running those every 2 hours? seems free if there are not new images, and if there are new images we want them asap after promote | 13:25 |
| sshnaidm | trown, it's once a day at 2.00 am | 13:25 |
| EmilienM | trown, sshnaidm: when you have time for a review: https://review.openstack.org/#/c/490032/ - thanks! | 13:26 |
| trown | sshnaidm: oh... so worse than I though | 13:26 |
| sshnaidm | trown, so that running jobs won't be broken when image changes | 13:26 |
| lvdombrkr | folks, underlcoud cpu usage can be realated somehow with horizon dashboard performance? im trying to investigate why my dashboard is too slow, and found that undercloud cpu 90-95proc used by gnochi | 13:26 |
| sshnaidm | trown, it's not repo, just a image, it will be updated anyway during the job, I don't see any reason to update it often | 13:27 |
| trown | sshnaidm: ok that is reasonable... but then we will be testing with old images for a whole day if we promote after 2am | 13:27 |
| trown | ah true | 13:27 |
| trown | sshnaidm: k that makes sense then | 13:27 |
| *** oidgar has quit IRC | 13:27 | |
| pabelanger | panda|rover: sshnaidm: trown: why don't you propose a patch to openstack-infra/system-config and add images.rdoproject.org to our reverse proxy cache? Then you don't even need to run a mirror server in rh1 | 13:29 |
| pabelanger | like we do today with trunk.rdoproject.org | 13:30 |
| *** lblanchard has joined #tripleo | 13:30 | |
| sshnaidm | pabelanger, it will go anyway during a few weeks, doesn't worth an effort | 13:30 |
| d0ugal | jrist: the Mistral docs rarely help anyone :-D | 13:30 |
| pabelanger | sshnaidm: k, so just ovb uses this? | 13:30 |
| trown | pabelanger: ya it is only needed for OVB jobs, which we are moving off | 13:30 |
| jrist | d0ugal: :( | 13:31 |
| pabelanger | k | 13:31 |
| sshnaidm | pabelanger, yep | 13:31 |
| pabelanger | how is that moving going btw? | 13:31 |
| pabelanger | getting close to stopping jobs on tripleo-test-cloud-rh1? | 13:31 |
| trown | it is the focus of our current sprint for the ci squad | 13:31 |
| sshnaidm | pabelanger, not atm :) | 13:31 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data https://review.openstack.org/508567 | 13:31 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow https://review.openstack.org/509419 | 13:31 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-common master: WIP Add Octavia post deployment steps to tripleo workflows https://review.openstack.org/487450 | 13:31 |
| d0ugal | jrist: but this looks good! I'll review it today | 13:31 |
| trown | but ya... still quite a bit to be done before turning off RH1 | 13:32 |
| *** dbecker has joined #tripleo | 13:32 | |
| *** rmascena has joined #tripleo | 13:32 | |
| *** raildo has quit IRC | 13:35 | |
| *** oidgar has joined #tripleo | 13:37 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Create short lived ssh key for enable-ssh-admin.sh https://review.openstack.org/513031 | 13:38 |
| *** rmascena is now known as raildo | 13:40 | |
| *** limao has joined #tripleo | 13:41 | |
| trozet | trown, weshay: i see a new folder current-tripleo-rdo but no undercloud? https://images.rdoproject.org/pike/delorean/current-tripleo-rdo/ | 13:43 |
| *** hjensas has quit IRC | 13:44 | |
| *** milan has quit IRC | 13:47 | |
| *** pchavva has joined #tripleo | 13:47 | |
| *** limao_ has joined #tripleo | 13:48 | |
| *** limao has quit IRC | 13:49 | |
| *** cdearborn has quit IRC | 13:50 | |
| *** dbecker has quit IRC | 13:52 | |
| hamzy | does anyone have deep understanding of dnsmasq? I see first DHCP succeed but second DHCP fail for the same client http://paste.openstack.org/show/623982/ | 13:56 |
| *** cdearborn has joined #tripleo | 13:56 | |
| *** amodi has joined #tripleo | 13:57 | |
| mwhahaha | atoth: you use depends-on: <changeid> to link them together | 14:00 |
| atoth | mwhahaha, in the commit msg? | 14:00 |
| mwhahaha | atoth: yea i'll comment | 14:00 |
| atoth | cool, thanks | 14:00 |
| numans | mwhahaha, hi, is it possible to approve this one ? - https://review.openstack.org/#/c/510900/ | 14:01 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add the option to run the container-check script https://review.openstack.org/501028 | 14:01 |
| mwhahaha | numans: i'll take a look | 14:01 |
| numans | mwhahaha, thanks. and this one if possible - https://review.openstack.org/#/c/511199/ | 14:02 |
| *** tongl has joined #tripleo | 14:04 | |
| *** psachin has quit IRC | 14:05 | |
| *** amoralej|lunch is now known as amoralej | 14:06 | |
| *** fzdarsky has quit IRC | 14:07 | |
| weshay | trozet, here's a recent one https://images.rdoproject.org/pike/rdo_trunk/ac72f686bb05d4cbed059e7cc2b7d2b6233edaec_1eb373fc/ | 14:08 |
| *** oidgar has quit IRC | 14:09 | |
| trozet | weshay: so cant we just always copy the latest to a latest folder or something? | 14:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Default pre_deployments/post_deployments to empty lists https://review.openstack.org/512704 | 14:09 |
| weshay | trozet, that will all fall into place yes | 14:09 |
| trozet | weshay: ok i'll check again tmrw | 14:10 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 14:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724347 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 14:10 |
| openstack | Launchpad bug 1724347 in tripleo "scenario001 failing as docker.io is seen twice in the ceph/daemon image url" [Critical,In progress] - Assigned to Martin André (mandre) | 14:10 |
| weshay | trozet, waiting on a patch to merge upstream which is difficult atm | 14:10 |
| *** agurenko has joined #tripleo | 14:13 | |
| *** yolanda has joined #tripleo | 14:16 | |
| *** dbecker has joined #tripleo | 14:18 | |
| *** rmascena has joined #tripleo | 14:18 | |
| *** raildo has quit IRC | 14:20 | |
| *** tongl has quit IRC | 14:23 | |
| *** janki has quit IRC | 14:25 | |
| *** limao_ has quit IRC | 14:25 | |
| *** limao has joined #tripleo | 14:25 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-quickstart-extras master: Autofencing support https://review.openstack.org/502297 | 14:28 |
| *** cdearborn has quit IRC | 14:31 | |
| openstackgerrit | Merged openstack/tripleo-ui stable/pike: Fix ParameterInput component https://review.openstack.org/512955 | 14:37 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Stop using deprecated --pull-source option https://review.openstack.org/512971 | 14:41 |
| openstackgerrit | Merged openstack/tripleo-ui stable/pike: Add notification message to nodes tagging dialog https://review.openstack.org/512956 | 14:41 |
| *** jcoufal_ has joined #tripleo | 14:42 | |
| *** jcoufal_ has quit IRC | 14:42 | |
| *** nyechiel has joined #tripleo | 14:43 | |
| *** nyechiel_ has quit IRC | 14:43 | |
| EmilienM | weshay: /me catching up, what's the latest blocker now to promote? | 14:43 |
| weshay | EmilienM, one of them is https://review.openstack.org/#/c/512590/ can't get it through the gate.. I saw it run 5-6 times in the gate yesterday. Let me take some time and I'll have a master review in a bit | 14:45 |
| *** jcoufal has quit IRC | 14:45 | |
| *** jcoufal has joined #tripleo | 14:46 | |
| *** yprokule has quit IRC | 14:47 | |
| EmilienM | weshay: "master review"? for what bug? | 14:48 |
| abishop | anyone know where to see if my CI job is in a queue? I did a recheck last night and never got a response | 14:49 |
| *** dbecker has quit IRC | 14:49 | |
| mwhahaha | abishop: http://zuulv3.openstack.org/ | 14:49 |
| mwhahaha | there was a restart yesterday so some stuff got lost | 14:49 |
| weshay | EmilienM, so we have three issues atm blocking master.. tempest, overcloud_ip's (the patch you and alex wrote) and the above review | 14:50 |
| weshay | I think we have reviews up on all of them.. but double checking | 14:50 |
| abishop | mwhahaha: thx, I checked there ; but sounds like my job simply got lost in the restart | 14:50 |
| weshay | https://review.openstack.org/#/c/512379/ | 14:51 |
| *** dmarlin has joined #tripleo | 14:51 | |
| mwhahaha | abishop: likely, feeel free to recheck it if it's not listed | 14:51 |
| weshay | trown, adarazs, sshnaidm https://review.openstack.org/#/c/512379/ | 14:51 |
| mandre | bandini: CI came back on https://review.openstack.org/#/c/510040/, scenario002 and 003 are failing due to puppet errors, which one you want to have a look at? I'll take the other one | 14:52 |
| weshay | EmilienM, mwhahaha I need to write this up https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset006-master/8a1792a/undercloud/home/jenkins/tempest_output.log.txt.gz#_2017-10-18_09_26_50 | 14:52 |
| bandini | mandre: only two? that makes a total of six. SAD! | 14:52 |
| bandini | ;) | 14:52 |
| *** chlong has quit IRC | 14:52 | |
| weshay | hrybacki, ^ fyi | 14:52 |
| EmilienM | weshay: which patch from alex and I? sorry | 14:52 |
| mwhahaha | EmilienM: the quickstart one i think | 14:53 |
| weshay | EmilienM, https://review.openstack.org/#/c/512379/ | 14:53 |
| *** chlong has joined #tripleo | 14:53 | |
| mwhahaha | the one i'm trying to get through CI | 14:53 |
| mwhahaha | stupid ci | 14:53 |
| mandre | bandini: well... possibly scenario001 fails on puppet too, but we couldn't verify because it failed even earlier on the container prepare command | 14:53 |
| bandini | mandre: so we can still hit our double-digit goal! | 14:54 |
| bandini | woohoo | 14:54 |
| EmilienM | ah ok this one | 14:54 |
| yolanda | hi, can i get second +2 for https://review.openstack.org/508068, https://review.openstack.org/508069, https://review.openstack.org/508072, https://review.openstack.org/512001 ? | 14:54 |
| mandre | bandini: and who knows what other error we'll find when we fixed those... the jobs stopped on the first error | 14:54 |
| bandini | mandre: right :D | 14:54 |
| EmilienM | please can anyone +2 https://review.openstack.org/#/c/512379/ - master promotion blocker | 14:54 |
| openstackgerrit | yatin proposed openstack/tripleo-heat-templates stable/pike: Also match config volumes for /var/lib/config-data/puppet-generated/ https://review.openstack.org/511765 | 14:54 |
| mandre | bandini: so you're onto scenario002, and I'm on scenario003? | 14:54 |
| *** cdearborn_ has joined #tripleo | 14:55 | |
| *** rbowen has joined #tripleo | 14:55 | |
| bandini | mandre: ack! | 14:55 |
| *** dsariel has quit IRC | 14:55 | |
| *** eck` is now known as eck`gone | 14:55 | |
| EmilienM | sshnaidm: thx | 14:56 |
| *** rmascena is now known as raildo | 14:56 | |
| weshay | EmilienM, mwhahaha ok.. I'll start driving this https://bugs.launchpad.net/tripleo/+bug/1724599 | 14:58 |
| openstack | Launchpad bug 1724599 in tripleo "tripleo master: gnocchi.tempest.scenario.GnocchiGabbiTest.test_search_resource is using keystone v2" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 14:58 |
| weshay | hrybacki, ^ | 14:58 |
| EmilienM | weshay: we could just ignore the test now, we already have autoscaling test | 14:59 |
| EmilienM | which is imho good enough | 14:59 |
| weshay | EmilienM, ya.. discussing that now | 14:59 |
| *** _milan_ has joined #tripleo | 15:00 | |
| *** cdearborn__ has joined #tripleo | 15:01 | |
| EmilienM | just a quick reminder about zuul v3 transition, dmsimard sent a nice email about a Q/A session so we can migrate in the near future, please take some time to pick a date https://beta.doodle.com/poll/hfkcgrahwskm2ggv | 15:03 |
| *** mdnadeem has quit IRC | 15:03 | |
| hrybacki | weshay: ack, I see it | 15:06 |
| *** cdearborn has joined #tripleo | 15:07 | |
| *** ramishra has quit IRC | 15:07 | |
| hrybacki | weshay: I see you're assigned (default behavior?), are you working on the fix? | 15:07 |
| shardy | jistr: Hey wanted to share http://paste.openstack.org/show/623995/ with you - I've tried a few combinations and I think we have more work to do re kubespray with multiple nodes | 15:08 |
| shardy | jistr: the master status is NotReady and the worker node is running services but hasn't joined the cluster | 15:09 |
| *** limao has quit IRC | 15:09 | |
| shardy | jistr: attempting multiple masters for HA the kubespray run hangs so I'm guessing we need additional LB configuration settings | 15:09 |
| shardy | it'd be good to debug the master/node + node case as a first step I guess, will start digging | 15:10 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| jistr | shardy: ok thanks for the info. Btw i replied on the review. | 15:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 15:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 15:10 |
| *** ykarel|afk is now known as ykarel | 15:10 | |
| *** cdearborn_ has quit IRC | 15:11 | |
| *** trown is now known as trown|brb | 15:11 | |
| jistr | shardy: had to focus short term on https://review.openstack.org/#/c/513031/ but i'm getting back to kubespray, will try to address all the feedback. E.g. for ConfigDebug we probably want something to make the value available everywhere in Ansible, not just in the kubernetes-master service, so i'll look into that. | 15:11 |
| *** catintheroof has joined #tripleo | 15:13 | |
| shardy | jistr: ack sounds good, I'm just trying to figure out the next steps and help out where possible | 15:13 |
| *** trown|brb is now known as trown | 15:15 | |
| *** cdearborn__ has quit IRC | 15:17 | |
| jistr | shardy: btw a review here would be great if you can find the time https://review.openstack.org/#/c/510781/ it's a dependency of one of the patch in t-h-t you already reviewed | 15:17 |
| *** agurenko has quit IRC | 15:18 | |
| *** agurenko has joined #tripleo | 15:19 | |
| *** pcaruana has quit IRC | 15:19 | |
| shardy | jistr: ack looking | 15:19 |
| *** cdearborn_ has joined #tripleo | 15:20 | |
| *** tesseract has quit IRC | 15:20 | |
| slagle | d0ugal: hi, any tips on how I can get nicely formatted output from the tripleo.ansible-playbook action? | 15:20 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-common master: Implement upgrade workflow in mistral https://review.openstack.org/463765 | 15:21 |
| slagle | d0ugal: the stdout of the action when using the mistral client is one big line, and the newlines look escaped | 15:21 |
| slagle | so you can't printf or something | 15:21 |
| d0ugal | slagle: yeah, that's because it is json encoded. | 15:21 |
| EmilienM | sshnaidm: if you can review https://review.openstack.org/#/c/512874/ | 15:21 |
| d0ugal | slagle: maybe use jq to extract the value? | 15:21 |
| slagle | d0ugal: well, i juse jq to extract the "result" key | 15:22 |
| slagle | but that value is the munged single line, which is not json | 15:22 |
| *** agurenko has quit IRC | 15:22 | |
| d0ugal | oh | 15:22 |
| *** cdearborn_ has quit IRC | 15:22 | |
| *** achadha has joined #tripleo | 15:23 | |
| d0ugal | slagle: I don't know of a trick for this. gfidente or fultonj might. | 15:23 |
| jpich | There's a bug open about this downstream, not sure if it's been upstreamed yet though - I meant to look first if it's an OSC issue or a mistral client issue but haven't had a chance yet | 15:23 |
| fultonj | mistral task-get-result $TASK_ID | jq . | sed -e 's/\\n/\n/g' -e 's/\\"/"/g' | 15:25 |
| d0ugal | lol | 15:25 |
| d0ugal | slagle: ^ | 15:25 |
| fultonj | slagle: i used that until we got the ceph-install log | 15:25 |
| slagle | thanks fultonj | 15:26 |
| fultonj | it's awful but i hope it quickly stops your eyes from bleeding | 15:26 |
| *** MVenesio has quit IRC | 15:28 | |
| sshnaidm | EmilienM, I'm not sure I understand https://review.openstack.org/#/c/512874/ - scenarios there are like featureset files, "real" scenario files are in tht repo, not quickstart | 15:28 |
| EmilienM | sshnaidm: but we already have featuresets in quickstart no? | 15:29 |
| EmilienM | why would we need these files? | 15:29 |
| *** aufi_ has quit IRC | 15:29 | |
| sshnaidm | EmilienM, seems like it's leftovers | 15:30 |
| EmilienM | sshnaidm: that's why i'm proposing to clean it up | 15:30 |
| EmilienM | sshnaidm: if I missed some, let me know or push over | 15:30 |
| sshnaidm | EmilienM, it's fine | 15:30 |
| *** cdearborn has quit IRC | 15:32 | |
| *** nyechiel has quit IRC | 15:33 | |
| *** nyechiel_ has joined #tripleo | 15:33 | |
| EmilienM | dprince: what are our plans to make undercloud-container job voting? | 15:34 |
| *** eck`gone is now known as eck` | 15:34 | |
| *** lvdombrkr has quit IRC | 15:36 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-common master: Allow processing external_deploy_steps_tasks https://review.openstack.org/510781 | 15:36 |
| weshay | that's been queued up to be added to quickstart for a while | 15:36 |
| *** dtantsur|brb is now known as dtantsur | 15:36 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Fix standalone ControllerOpenstack vars https://review.openstack.org/512466 | 15:37 |
| EmilienM | weshay: oh ok, so it's the blocker before moving it to the gate? | 15:37 |
| EmilienM | weshay: we could have it voting now, without quickstart isn't? so we avoid regressions | 15:38 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Sync deployed-server-roles-data and roles-data https://review.openstack.org/512298 | 15:38 |
| weshay | EmilienM, seems like a hacky way to do it :) | 15:39 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Support for Satellite Capsule in rhel-registration https://review.openstack.org/503387 | 15:39 |
| * weshay runs | 15:39 | |
| *** nyechiel_ has quit IRC | 15:39 | |
| *** nyechiel has joined #tripleo | 15:39 | |
| *** fragatina has quit IRC | 15:42 | |
| *** fragatina has joined #tripleo | 15:42 | |
| dprince | EmilienM: lets do it | 15:44 |
| dprince | EmilienM: would you be up for pushing this? | 15:45 |
| EmilienM | dprince: not sure now. Btw, I pushed for paunch yesterday already. | 15:45 |
| EmilienM | dprince: not right now I meant. But let me know if you need help | 15:46 |
| *** ebarrera has quit IRC | 15:46 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-common master: Get a static inventory for upgrade-non-controller ansible runs https://review.openstack.org/512999 | 15:46 |
| *** ebarrera has joined #tripleo | 15:48 | |
| *** links has joined #tripleo | 15:54 | |
| dprince | EmilienM: is there a quick example you can show me? | 15:56 |
| *** jpich has quit IRC | 15:59 | |
| EmilienM | dprince: to enable voting on a job in project-config? | 16:00 |
| EmilienM | let me look | 16:00 |
| mwhahaha | it's been moved to the new zuul jobs | 16:00 |
| mwhahaha | i think | 16:00 |
| mwhahaha | https://review.openstack.org/#/c/510637/ | 16:01 |
| EmilienM | dprince: I think we want to revert https://review.openstack.org/493669 | 16:01 |
| mwhahaha | example of switching to nv | 16:01 |
| EmilienM | yeah revert won't work since migration | 16:01 |
| EmilienM | dprince: but https://review.openstack.org/#/c/510637/ is perfect example | 16:01 |
| mwhahaha | it would be the opposite of that, you have to copy-pasta the check jobs to the gate section | 16:02 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Add --detailed-exitcodes when running puppet via ansible https://review.openstack.org/511509 | 16:02 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: DO NOT MERGE testing containerized scenarios https://review.openstack.org/510040 | 16:02 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Run containerized mistral-api eventlet https://review.openstack.org/513082 | 16:02 |
| *** gkadam has joined #tripleo | 16:02 | |
| *** nyechiel has quit IRC | 16:02 | |
| *** nyechiel_ has joined #tripleo | 16:02 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add workflow for deployment via config-download https://review.openstack.org/512876 | 16:03 |
| *** marios has quit IRC | 16:03 | |
| *** ebarrera has quit IRC | 16:05 | |
| *** tongl has joined #tripleo | 16:07 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-docs master: Update containerized undercloud deployment guide https://review.openstack.org/513083 | 16:07 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 16:10 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Ceilometer] https://review.openstack.org/507796 | 16:10 |
| *** lucasagomes is now known as lucas-afk | 16:15 | |
| *** amodi has quit IRC | 16:17 | |
| *** abregman has quit IRC | 16:20 | |
| *** trown is now known as trown|lunch | 16:21 | |
| *** gkadam has quit IRC | 16:22 | |
| *** hewbrocca is now known as hewbrocca_afk | 16:22 | |
| *** cylopez has quit IRC | 16:22 | |
| *** rbowen has quit IRC | 16:23 | |
| *** rbowen has joined #tripleo | 16:24 | |
| mwhahaha | weshay: is there a bug for the rdo featureset001 failures on master? | 16:25 |
| chandankumar | weshay: arxcruz https://review.openstack.org/#/c/506751/5 it will disable keystone v2 api by default | 16:26 |
| mwhahaha | weshay: it's failing for the same thing i saw when i tried to run quickstart where it can't pull down the current-tripleo images | 16:26 |
| weshay | oh jeez | 16:27 |
| weshay | trown|lunch, sshnaidm here we go | 16:27 |
| mwhahaha | example https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master-nv/152/console | 16:27 |
| weshay | mwhahaha, looking | 16:28 |
| weshay | master has never promoted so that shouldn't be an issue.. they all should fail if that was missing | 16:28 |
| *** links has quit IRC | 16:28 | |
| mwhahaha | weshay: right, but did we ever create a bug for that | 16:28 |
| weshay | mwhahaha, I don't have access to the image server on rh1, so hard for me to check | 16:28 |
| mwhahaha | weshay: cause techincally failing job :D | 16:28 |
| mwhahaha | i know why it's failing, but did we ever properly document it | 16:29 |
| weshay | I have a bug on the images | 16:29 |
| mwhahaha | k | 16:29 |
| weshay | mwhahaha, we've been working that on two fronts | 16:29 |
| mwhahaha | yea i know | 16:29 |
| Tengu | hmmm, anyone can help me finding the reason zuul fails for https://review.openstack.org/#/c/512977/ on the legacy-tripleo-ci-centos-7-ovb-ha-oooq test ? | 16:33 |
| Tengu | weird thing, the overcloud image was built as expected, but I don't realy find the cause of the failure. still strugling with those logs. | 16:34 |
| weshay | mwhahaha, FYI.. related changes https://review.openstack.org/#/c/510362/ https://review.openstack.org/#/c/510363/ | 16:35 |
| mwhahaha | k | 16:36 |
| *** thrash is now known as thrash|biab | 16:38 | |
| *** bogdando has quit IRC | 16:40 | |
| *** derekh has quit IRC | 16:42 | |
| Tengu | mwhahaha: do you have any idea why zuul is failing on https://review.openstack.org/#/c/512977/ ? all the logs in the "undercloud" subdir are clean, image was built and deployed without any issue :/. | 16:47 |
| Tengu | or maybe it's not important and it will go to gate even with that, as it state "+1 zuul"? not really clear | 16:48 |
| *** iranzo has quit IRC | 16:48 | |
| openstackgerrit | Andy Smith proposed openstack/tripleo-heat-templates master: WIP Separate rpc and notify messaging backends https://review.openstack.org/507963 | 16:49 |
| mwhahaha | Tengu: job timeout | 16:50 |
| Tengu | mwhahaha: erf. so not my fault I guess? | 16:50 |
| mwhahaha | Tengu: also the UI is misleading the vorting passed fine | 16:51 |
| mwhahaha | Tengu: the ovb-ha job timed out | 16:51 |
| Tengu | mwhahaha: ah, even with the CI comment? | 16:51 |
| mwhahaha | Tengu: if you click Toggle CI you can see the two Zuul responses | 16:51 |
| mwhahaha | Patch Set 2: Verified+1 is the one that mattered | 16:51 |
| Tengu | the last one is a failed | 16:51 |
| Tengu | ah, ok | 16:51 |
| mwhahaha | in terms of voting | 16:51 |
| Tengu | sooo basically they will be merged ? | 16:52 |
| Tengu | or is there any more steps? | 16:52 |
| mwhahaha | no more steps fo ryou | 16:52 |
| Tengu | cool, then two more patches in master. | 16:52 |
| Tengu | although I'd like to cherry-pick them in pike. would that be possible? | 16:52 |
| mwhahaha | Tengu: I think so | 16:53 |
| Tengu | hmm. wondering if they are already in master in fact. | 16:53 |
| Tengu | nope, not yet merged. | 16:54 |
| Tengu | mwhahaha: I'll do the cherry-pick tomorrow, once it's present in master. Else I suspect it might create some issues. | 16:55 |
| Tengu | mwhahaha: care to add a workflow +1 on that one as well? https://review.openstack.org/#/c/512978/ that would be great :) | 16:57 |
| Tengu | as they are related. | 16:57 |
| mwhahaha | Tengu: i'll take a look | 16:59 |
| Tengu | thank you! | 16:59 |
| openstackgerrit | Andy Smith proposed openstack/puppet-tripleo master: WIP: Updates to separate messaging backends alternative https://review.openstack.org/510684 | 17:06 |
| *** thrash|biab is now known as thrash | 17:08 | |
| *** jlinkes has quit IRC | 17:08 | |
| *** ykarel is now known as ykarel|away | 17:09 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 17:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 17:10 |
| *** ykarel|off has joined #tripleo | 17:10 | |
| *** jpena is now known as jpena|off | 17:11 | |
| *** suuuper has quit IRC | 17:13 | |
| mwhahaha | weshay: for https://bugs.launchpad.net/tripleo/+bug/1724599 can't we fix it outselves by just setting the v2 config in tempest to false? | 17:22 |
| openstack | Launchpad bug 1724599 in tripleo "tripleo master: gnocchi.tempest.scenario.GnocchiGabbiTest.test_search_resource is using keystone v2" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 17:22 |
| weshay | mwhahaha, let's double check w/ arxcruz | 17:23 |
| *** dtantsur is now known as dtantsur|afk | 17:24 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Disable keystone v2 for Queens https://review.openstack.org/513145 | 17:26 |
| mwhahaha | weshay: arxcruz -^ | 17:26 |
| *** amoralej is now known as amoralej|off | 17:27 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Disable keystone v2 for Queens https://review.openstack.org/513145 | 17:27 |
| weshay | mwhahaha, worth a shot | 17:29 |
| weshay | :) | 17:29 |
| weshay | thanks | 17:29 |
| mwhahaha | i mean that's all that tempest is doing and if we just leave the defaults but use latest tempest we don't properly testing stuff :D | 17:29 |
| * mwhahaha will check results later | 17:29 | |
| ykarel|off | weshay, i don't remember exactly: in the environment that i saw the failure had identity.api_v2=False, identity.api_v3=False so not sure if https://review.openstack.org/513145 will fix the bug, but lets wait for the result | 17:31 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data https://review.openstack.org/508567 | 17:32 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow https://review.openstack.org/509419 | 17:32 |
| *** mcornea has quit IRC | 17:33 | |
| *** amodi has joined #tripleo | 17:34 | |
| *** achadha has quit IRC | 17:34 | |
| *** _milan_ has quit IRC | 17:34 | |
| *** bobh has joined #tripleo | 17:35 | |
| EmilienM | sshnaidm: re: upgrades - it failed but sounds like it went further :-) | 17:35 |
| EmilienM | sshnaidm: I'm debugging now | 17:35 |
| ykarel|off | weshay, in my environment it was dentity-feature-enabled.api_v2 not identity.api_v2 | 17:35 |
| ykarel|off | i had featureset008 deployed, so similar to: https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset008-master/9405f6e/undercloud/home/jenkins/tempest/etc/tempest.conf.txt.gz | 17:36 |
| *** trown|lunch is now known as trown | 17:37 | |
| weshay | ykarel|off, please comment on the review and bug | 17:38 |
| ykarel|off | weshay, Ok | 17:38 |
| *** nyechiel_ has quit IRC | 17:38 | |
| EmilienM | sshnaidm: ok so this time upgrade job fails at step3 | 17:40 |
| EmilienM | during db-sync | 17:40 |
| EmilienM | http://logs.openstack.org/25/500625/15/check/legacy-tripleo-ci-centos-7-containers-multinode-upgrades/2a547a7/logs/subnode-2/var/log/cinder/cinder-manage.log.txt.gz#_2017-10-18_15_45_50_862 | 17:40 |
| *** achadha has joined #tripleo | 17:40 | |
| EmilienM | matbu, chem ^ does it ring a bell ? | 17:40 |
| *** tosky has quit IRC | 17:41 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Remove deprecated Telemetry services from roles data https://review.openstack.org/509645 | 17:44 |
| chem | EmilienM: never seen ... by the look of it, maybe a data dir mounted without the z options (super wild guess, didn't look closely) | 17:45 |
| *** achadha has quit IRC | 17:47 | |
| *** fandrieu has quit IRC | 17:48 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Disable keystone v2 for Queens https://review.openstack.org/513145 | 17:48 |
| *** ykarel|away has quit IRC | 17:50 | |
| *** ykarel|off has quit IRC | 17:50 | |
| *** jlinkes has joined #tripleo | 17:52 | |
| EmilienM | chem: https://bugs.launchpad.net/tripleo/+bug/1724636 | 17:52 |
| openstack | Launchpad bug 1724636 in tripleo "[ocata to pike] upgrade failing at step3 during dbsync" [Critical,Triaged] | 17:52 |
| *** catinthe_ has joined #tripleo | 17:53 | |
| jlabarre | the thing I'm trying to figure with the basic TripleO-quickstart setup; how am I supposed to get to Horizon? If I'm connected to the host containing the TripleO cluster by SSH, I presume I will have to tunnel the port needed to bring up the GUI in a browser, | 17:53 |
| *** catintheroof has quit IRC | 17:53 | |
| chem | EmilienM: thanks, will look my tomorrow morning, I can't right now | 17:54 |
| *** rodolof has quit IRC | 17:54 | |
| EmilienM | chem: who from upgrade team is up ? | 17:54 |
| *** rodolof has joined #tripleo | 17:55 | |
| chem | EmilienM: would say nobody, everybody's ~europe tz | 17:55 |
| EmilienM | ok :( | 17:56 |
| *** MVenesio has joined #tripleo | 17:56 | |
| *** jmelvin_ has quit IRC | 17:56 | |
| mwhahaha | pffft sleep | 17:57 |
| *** sri_ has quit IRC | 17:57 | |
| *** catintheroof has joined #tripleo | 17:59 | |
| *** catinthe_ has quit IRC | 18:01 | |
| *** rbowen has quit IRC | 18:01 | |
| *** catinthe_ has joined #tripleo | 18:05 | |
| *** catintheroof has quit IRC | 18:07 | |
| *** achadha has joined #tripleo | 18:08 | |
| weshay | Slower, ping need to chat when you have moment | 18:09 |
| openstackgerrit | Merged openstack/tripleo-docs master: New Developer Docs https://review.openstack.org/506702 | 18:09 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 18:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 18:10 |
| *** tosky has joined #tripleo | 18:10 | |
| Slower | weshay: sup? | 18:12 |
| EmilienM | dprince: could you propose a patch? | 18:12 |
| EmilienM | dprince: by using https://review.openstack.org/#/c/510637/ as an example | 18:12 |
| *** catintheroof has joined #tripleo | 18:14 | |
| *** catinthe_ has quit IRC | 18:15 | |
| EmilienM | bandini: taking it here | 18:16 |
| EmilienM | bandini: are you waiting for container promotion on pike or queens or both? | 18:16 |
| bandini | EmilienM: I know that when we merged https://review.openstack.org/#/c/497766/ it broke some container job because redis/rabbit/mariadb containers had old pcmk/resource-agents packages inside. So I believe I am waiting for master CI promotion so I can resubmit that review | 18:17 |
| EmilienM | bandini: why master? | 18:18 |
| EmilienM | bandini: oh because fix needs to be done in master | 18:18 |
| EmilienM | and then backported | 18:18 |
| EmilienM | and then promoted, right? | 18:18 |
| bandini | EmilienM: yes | 18:18 |
| *** pkovar has quit IRC | 18:18 | |
| EmilienM | it makes total sense | 18:18 |
| * EmilienM shuts up | 18:18 | |
| bandini | :) | 18:18 |
| *** jmelvin_ has joined #tripleo | 18:20 | |
| *** ykarel|away has joined #tripleo | 18:23 | |
| *** ykarel|off has joined #tripleo | 18:23 | |
| *** rwsu has quit IRC | 18:25 | |
| *** paramite has quit IRC | 18:25 | |
| *** rbrady is now known as rbrady-afk | 18:29 | |
| *** raildo has quit IRC | 18:29 | |
| *** newmember has joined #tripleo | 18:30 | |
| *** weshay is now known as weshay|ruck|brb | 18:30 | |
| EmilienM | dprince: maybe you can review https://review.openstack.org/#/c/512783 | 18:32 |
| *** raildo has joined #tripleo | 18:32 | |
| *** ykarel|away has quit IRC | 18:34 | |
| *** ykarel|off has quit IRC | 18:35 | |
| *** achadha_ has joined #tripleo | 18:39 | |
| *** achadha has quit IRC | 18:41 | |
| *** eck` is now known as eck`gone | 18:43 | |
| *** achadha_ has quit IRC | 18:44 | |
| *** raildo has quit IRC | 18:44 | |
| *** jidar has joined #tripleo | 18:45 | |
| openstackgerrit | Andy Smith proposed openstack/tripleo-heat-templates master: WIP Separate rpc and notify messaging backends https://review.openstack.org/507963 | 18:48 |
| *** MrRoot has joined #tripleo | 18:52 | |
| *** ccamacho has quit IRC | 18:52 | |
| *** MrRoot has left #tripleo | 18:52 | |
| *** achadha has joined #tripleo | 18:54 | |
| *** achadha has quit IRC | 18:57 | |
| *** jidar has quit IRC | 18:59 | |
| *** jidar has joined #tripleo | 19:00 | |
| dprince | https://review.openstack.org/513163 Make tripleo undercloud-containers voting | 19:00 |
| dprince | EmilienM: ^^ | 19:00 |
| EmilienM | dprince: thanks! | 19:00 |
| EmilienM | sounds good | 19:01 |
| *** dprince has quit IRC | 19:08 | |
| *** salmankhan has quit IRC | 19:09 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 19:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 19:10 |
| *** colonwq has quit IRC | 19:11 | |
| *** abregman has joined #tripleo | 19:12 | |
| arxcruz | mwhahaha: weshay|ruck|brb looks good, but this will also fix in tempest https://review.openstack.org/#/c/506751 | 19:12 |
| mwhahaha | arxcruz: that's not the fix | 19:13 |
| mwhahaha | arxcruz: https://github.com/openstack/tempest/blob/master/tempest/cmd/cleanup.py#L190 | 19:13 |
| mwhahaha | that's the problem | 19:13 |
| mwhahaha | the cleanup command uses v2 creds | 19:13 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-quickstart-extras master: Switch vbmc to Systemd's instantiated services and open up corresponding firewall https://review.openstack.org/510331 | 19:13 |
| mwhahaha | no domain,e tc | 19:13 |
| arxcruz | mwhahaha: if you check https://review.openstack.org/#/c/506751/5/tempest/config.py it's setting v2 to False by default | 19:14 |
| mwhahaha | arxcruz: review teh comments on my review, the config is alrady false but the failure is in the cleanup command | 19:15 |
| mwhahaha | arxcruz: which that setting does not appear to affect | 19:15 |
| mwhahaha | er wait | 19:16 |
| mwhahaha | that bug is right | 19:16 |
| mwhahaha | there's another issue that gets uncovered | 19:16 |
| *** jcoufal has quit IRC | 19:16 | |
| mwhahaha | weshay|ruck|brb: do we have a bug for https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset005-master/6c565fd/undercloud/home/jenkins/tempest_output.log.txt.gz#_2017-10-18_09_23_34 | 19:16 |
| * mwhahaha shakes his fist at keystone | 19:17 | |
| *** achadha has joined #tripleo | 19:17 | |
| *** weshay|ruck|brb is now known as weshay|ruck | 19:18 | |
| arxcruz | mwhahaha: got it, the fix should be something like this: https://github.com/openstack/python-tempestconf/blob/master/config_tempest/config_tempest.py#L364 | 19:18 |
| weshay|ruck | mwhahaha, ya | 19:18 |
| arxcruz | mwhahaha: change the list_tenants() method for list_projects() method using the v3 api | 19:18 |
| weshay|ruck | arxcruz, thanks | 19:19 |
| mwhahaha | yea the cleanup command needs to get fixed | 19:19 |
| arxcruz | mwhahaha: for now, to unblock I would recomend remove the cleanup command, this is useless for us, because we don't keep the system up for debug | 19:21 |
| arxcruz | that's usefull only when you're going to debug something, and even I usually, do it manually | 19:21 |
| *** pkovar has joined #tripleo | 19:22 | |
| EmilienM | let's disable cleanup in our CI | 19:22 |
| EmilienM | or give me a good reason to NOT cleanup in CI | 19:22 |
| EmilienM | we're loosing time here | 19:22 |
| EmilienM | tempest_track_resources must be set to false | 19:25 |
| *** achadha has quit IRC | 19:25 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder master: Dont install python-virtualenv for py3k in deb https://review.openstack.org/513168 | 19:25 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder master: Dont install python-virtualenv for py3k in deb https://review.openstack.org/513168 | 19:26 |
| fpan | dsneddon: could you +workflow for https://review.openstack.org/#/c/509329/ | 19:26 |
| dsneddon | fpan, Done, thanks. | 19:27 |
| EmilienM | :q! | 19:27 |
| EmilienM | dman | 19:27 |
| fpan | dsneddon: thanks | 19:27 |
| mwhahaha | arxcruz: EmilienM https://bugs.launchpad.net/tempest/+bug/1659065 | 19:28 |
| openstack | Launchpad bug 1659065 in tempest "cleanup not working when not using Default domain" [Medium,Triaged] | 19:28 |
| mwhahaha | i think that's the bug for keystone v2/v3 maybe? | 19:28 |
| *** atoth has quit IRC | 19:28 | |
| mwhahaha | weshay|ruck: trown: is there a quickstart config file that is always include only in tripleo ci jobs | 19:29 |
| mwhahaha | (single file) | 19:29 |
| weshay|ruck | mwhahaha, these configs here are only in tripleo ci jobs https://github.com/openstack-infra/tripleo-ci/tree/master/toci-quickstart | 19:30 |
| mwhahaha | ok thanks | 19:30 |
| *** eck`gone is now known as eck` | 19:30 | |
| *** achadha has joined #tripleo | 19:31 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Don't cleanup TripleO CI Tempest resources https://review.openstack.org/513169 | 19:34 |
| *** nyechiel_ has joined #tripleo | 19:35 | |
| *** hjensas has joined #tripleo | 19:35 | |
| *** hjensas has quit IRC | 19:35 | |
| *** hjensas has joined #tripleo | 19:35 | |
| *** yolanda has quit IRC | 19:36 | |
| *** rwsu has joined #tripleo | 19:37 | |
| arxcruz | mwhahaha: it seems that's the bug, yes | 19:37 |
| mwhahaha | arxcruz: i'm looking at fixing it in tempest now | 19:38 |
| *** achadha has quit IRC | 19:39 | |
| *** jprovazn has quit IRC | 19:40 | |
| *** jfrancoa has quit IRC | 19:40 | |
| *** panda|rover is now known as panda|rover|off | 19:43 | |
| arxcruz | mwhahaha: I have a pretty much idea where to change | 19:45 |
| weshay|ruck | hrm.. I hope https://review.openstack.org/#/c/512971/ works w/ osp containers | 19:45 |
| mwhahaha | arxcruz: it looks like the cleanup.py has some old code in there | 19:46 |
| arxcruz | mwhahaha: https://github.com/openstack/tempest/blob/master/tempest/clients.py#L146 you need to add projects_client from identity_v3 | 19:46 |
| arxcruz | oh, actually, it's already there | 19:46 |
| arxcruz | https://github.com/openstack/tempest/blob/master/tempest/clients.py#L180 | 19:46 |
| openstackgerrit | Arie Bregman proposed openstack/tripleo-quickstart-extras master: Add abregman to tempest notifications https://review.openstack.org/512530 | 19:47 |
| arxcruz | mwhahaha: so you have to add a class ProjectsService like here https://github.com/openstack/tempest/blob/master/tempest/cmd/cleanup_service.py#L875 | 19:47 |
| arxcruz | pointing to projects_client | 19:47 |
| EmilienM | weshay|ruck: alex and I are creating an etherpad etherpad.openstack.org/p/tripleo-promotion-blockers-october-2017 | 19:47 |
| *** abregman is now known as abregman|afk | 19:47 | |
| weshay|ruck | EmilienM, I hope you guys get published :) | 19:48 |
| arxcruz | mwhahaha: like we did in python tempestconf https://github.com/openstack/python-tempestconf/blob/master/config_tempest/config_tempest.py#L355-L379 | 19:48 |
| * weshay|ruck looks | 19:48 | |
| weshay|ruck | EmilienM, do you want all of the keyston related issues that were fixed? | 19:48 |
| mwhahaha | arxcruz: yea i think the credential bits need to be pulled from something like run.py | 19:48 |
| arxcruz | mwhahaha: it's already 10pm here, and I'm pretty tired, tomorrow morning, I can get the code to fix this in tempest upstream, if you want | 19:49 |
| mwhahaha | arxcruz: yea i'll poke you with a patch if i get to it, if not it needs to get fixed in upstream in the near future | 19:50 |
| mwhahaha | arxcruz: we've got a patch to skip using it in CI for now which will work for us | 19:50 |
| arxcruz | mwhahaha: well, EmilienM patch solve the problem for now | 19:50 |
| arxcruz | yes | 19:50 |
| openstackgerrit | Justin Kilpatrick proposed openstack/tripleo-quickstart-extras master: Collect entire Browbeat folder https://review.openstack.org/478200 | 19:51 |
| *** raildo has joined #tripleo | 19:52 | |
| EmilienM | weshay|ruck: do you know if there is anything else in progress that I didn't write in the first section of the etherpad? | 19:52 |
| weshay|ruck | EmilienM, does slowly going insane count as in progress? | 19:53 |
| * weshay|ruck looks | 19:53 | |
| weshay|ruck | EmilienM, ya.. I need to look into why the containers are not building for master | 19:55 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart master: Update documentation around tripleo-inventory https://review.openstack.org/513175 | 19:56 |
| EmilienM | weshay|ruck: please paste the logs, maybe we can take a look | 19:56 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Do not rely on openstack-puppet-modules https://review.openstack.org/512781 | 20:01 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Make sure tuned package is installed before calling tuned-adm https://review.openstack.org/512993 | 20:01 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Remove erroneous octavia code related to sync_db https://review.openstack.org/502522 | 20:01 |
| weshay|ruck | EmilienM, in ether | 20:01 |
| *** abregman|afk has quit IRC | 20:03 | |
| *** toure is now known as toure_biab | 20:03 | |
| *** ipsecguy_ has joined #tripleo | 20:04 | |
| *** yamahata has joined #tripleo | 20:05 | |
| *** achadha has joined #tripleo | 20:07 | |
| *** ipsecguy has quit IRC | 20:08 | |
| *** jkilpatr has quit IRC | 20:10 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 20:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 20:10 |
| *** MVenesio has quit IRC | 20:12 | |
| *** pchavva has quit IRC | 20:12 | |
| *** ansmith has quit IRC | 20:17 | |
| *** openstackgerrit has quit IRC | 20:17 | |
| *** dsneddon has quit IRC | 20:19 | |
| *** jlinkes has quit IRC | 20:20 | |
| *** liverpooler has quit IRC | 20:22 | |
| jlabarre | any idea on how to fix a SSL_ERROR_RX_RECORD_TOO_LONG error with Horizon? (presuming it's wiith Horizon, I have yet to be able to connect to it) | 20:23 |
| *** jkilpatr has joined #tripleo | 20:26 | |
| *** openstackgerrit has joined #tripleo | 20:26 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Adding multinode-3nodes-registry.yaml https://review.openstack.org/512595 | 20:26 |
| EmilienM | weshay|ruck: ERROR:kolla.image.build.cinder-scheduler:unauthorized: authentication required | 20:29 |
| EmilienM | is it it can't push to a registry? | 20:29 |
| weshay|ruck | EmilienM, ya.. just a blip | 20:30 |
| EmilienM | k | 20:32 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-image-elements stable/newton: Fix tr syntax in 51-hosts https://review.openstack.org/513180 | 20:33 |
| *** PagliaccisCloud has quit IRC | 20:39 | |
| *** achadha has quit IRC | 20:40 | |
| *** ecerquei has quit IRC | 20:41 | |
| thrash | mwhahaha: learn me something... why am I not getting the latest mistral here? https://review.openstack.org/#/c/508567/12 | 20:43 |
| *** PagliaccisCloud has joined #tripleo | 20:45 | |
| EmilienM | thrash: he's afk a little bit, let me look | 20:46 |
| thrash | EmilienM: thanks | 20:46 |
| EmilienM | thrash: FYI we hadn't got a promotion since ... a lot | 20:46 |
| EmilienM | https://dashboards.rdoproject.org/rdo-dev | 20:46 |
| thrash | EmilienM: Is that the issue? | 20:46 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add the option to run the container-check script https://review.openstack.org/501028 | 20:46 |
| EmilienM | the version of Mistral is probably 39 days old | 20:46 |
| thrash | EmilienM: gak | 20:46 |
| EmilienM | well, since you have depends-on, it should work | 20:47 |
| EmilienM | weshay|ruck: is depends-on works for container jobs? | 20:47 |
| thrash | EmilienM: even if it already landed? | 20:47 |
| EmilienM | I don't think we build containers on the fly when using depends-on an openstack project | 20:47 |
| EmilienM | thrash: probably not. | 20:47 |
| EmilienM | thrash: you could confirm that in the delorean logs | 20:47 |
| EmilienM | gimme a few | 20:48 |
| thrash | EmilienM: nonha isn't containers, right? | 20:48 |
| EmilienM | legacy-tripleo-ci-centos-7-nonha-multinode-oooq isn't container | 20:49 |
| EmilienM | right | 20:49 |
| EmilienM | I don't see mistral being built by delorean with the depends-on | 20:49 |
| thrash | neither do i | 20:49 |
| EmilienM | also, (and this is a bigger problem IMHO), we don't build containers on the fly when using Depends-On | 20:50 |
| thrash | EmilienM: zuul didn't think so either... http://logs.openstack.org/67/508567/12/check/legacy-tripleo-ci-centos-7-nonha-multinode-oooq/1f27341/zuul-info/inventory.yaml | 20:50 |
| EmilienM | which was a nice feature, that we've lost with containers, unless I missed something (ping weshay|ruck again) | 20:50 |
| EmilienM | thrash: I would ask pabelanger or dmsimard for that specific question: is zuul taking in account Depends-On, when the patch in dependency is merged? | 20:51 |
| EmilienM | thrash: hth | 20:51 |
| thrash | EmilienM: I wonder if that would change with using zuulv3 properly? | 20:51 |
| EmilienM | I don't think it's related | 20:51 |
| EmilienM | it's more in our way to deploy containers | 20:51 |
| EmilienM | right now we have a local registry | 20:51 |
| *** lblanchard has quit IRC | 20:52 | |
| thrash | EmilienM: I'm still talking about even the nonha job... | 20:52 |
| *** raildo has quit IRC | 20:52 | |
| EmilienM | and we should change our workflow to build containers on the fly when depends-on nova for example | 20:52 |
| EmilienM | ah ok | 20:52 |
| thrash | EmilienM: for sure | 20:52 |
| EmilienM | well, we're going to switch on containers by default very soon | 20:52 |
| thrash | EmilienM: probably two sides of the same coin... | 20:52 |
| EmilienM | so... | 20:52 |
| EmilienM | yea | 20:52 |
| thrash | EmilienM: true | 20:52 |
| thrash | EmilienM: thanks for looking... | 20:52 |
| *** catintheroof has quit IRC | 20:53 | |
| *** leitan has quit IRC | 20:53 | |
| *** catintheroof has joined #tripleo | 20:54 | |
| *** raildo has joined #tripleo | 20:54 | |
| *** dparkes has joined #tripleo | 20:57 | |
| *** catintheroof has quit IRC | 20:58 | |
| *** raildo has quit IRC | 20:58 | |
| *** rmascena has joined #tripleo | 20:58 | |
| *** jlabarre has quit IRC | 20:59 | |
| *** raildo has joined #tripleo | 21:02 | |
| *** rmascena has quit IRC | 21:02 | |
| weshay|ruck | EmilienM, it does for everything but the containers atm | 21:08 |
| weshay|ruck | EmilienM, rlandy and Slower are fixing that as we speak | 21:08 |
| EmilienM | ok | 21:09 |
| rlandy | weshay|ruck: Slower: yep - successful overcloud deploy on the current run with containers update | 21:10 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 21:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 21:10 |
| *** trown is now known as trown|outtypewww | 21:10 | |
| *** tongl has quit IRC | 21:11 | |
| EmilienM | rlandy, weshay|ruck : not sure we talk about the exact same thing here | 21:11 |
| weshay|ruck | EmilienM, the depends-on needs to be built into a rpm | 21:12 |
| weshay|ruck | so atm, that works but none of the containers get the update atm | 21:13 |
| weshay|ruck | but they will soon | 21:13 |
| EmilienM | cool | 21:13 |
| *** jlinkes has joined #tripleo | 21:15 | |
| *** sri_ has joined #tripleo | 21:16 | |
| EmilienM | can we get review on https://review.openstack.org/#/c/513169/ please? | 21:18 |
| EmilienM | weshay|ruck: I went ahead and approved ^ | 21:19 |
| EmilienM | weshay|ruck: so all patches are in gate now | 21:19 |
| EmilienM | weshay|ruck: ping me if new problem please | 21:19 |
| sri_ | @EmilienM: hi, is Octavia working in pike/stable release ? | 21:19 |
| weshay|ruck | EmilienM, meh.. they are in check | 21:20 |
| weshay|ruck | EmilienM, in three days they'll be in gate | 21:20 |
| EmilienM | lol | 21:20 |
| *** yolanda has joined #tripleo | 21:20 | |
| EmilienM | sri_: I don't know, it's a question for beagles probably. Some work has been done, but we don't test it in the gate | 21:21 |
| sri_ | @EmilienM: ok, I will ask beagles thanks | 21:22 |
| *** eck` is now known as eck`gone | 21:24 | |
| *** newmember has quit IRC | 21:27 | |
| *** newmember has joined #tripleo | 21:27 | |
| *** abishop has quit IRC | 21:29 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Create default settings for environment types https://review.openstack.org/495407 | 21:30 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Change devmode to deploy containerized services by default https://review.openstack.org/472412 | 21:31 |
| *** jlinkes has quit IRC | 21:31 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Get DLRN hash before setting up repos and images https://review.openstack.org/512855 | 21:37 |
| *** dparkes has quit IRC | 21:37 | |
| *** sri_ has quit IRC | 21:38 | |
| *** jtomasek has quit IRC | 21:40 | |
| *** paramite has joined #tripleo | 21:44 | |
| *** rmascena has joined #tripleo | 21:45 | |
| *** raildo has quit IRC | 21:47 | |
| *** openstackgerrit has quit IRC | 21:48 | |
| *** morazi has quit IRC | 21:50 | |
| *** rmascena has quit IRC | 21:51 | |
| *** jmelvin_ has quit IRC | 21:57 | |
| *** openstackgerrit has joined #tripleo | 22:00 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 22:00 |
| *** bobh has quit IRC | 22:00 | |
| *** leitan has joined #tripleo | 22:04 | |
| *** fandrieu has joined #tripleo | 22:05 | |
| *** rwsu has quit IRC | 22:05 | |
| *** ipsecguy_ has quit IRC | 22:06 | |
| *** leitan has quit IRC | 22:08 | |
| openstackgerrit | Merged openstack/os-net-config master: Add retry and timeout for VPP interface discovery https://review.openstack.org/509329 | 22:08 |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 22:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 22:10 |
| *** rhallisey has quit IRC | 22:11 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Sync deployed-server-roles-data and roles-data https://review.openstack.org/512298 | 22:20 |
| *** raildo has joined #tripleo | 22:20 | |
| *** achadha has joined #tripleo | 22:25 | |
| *** ipsecguy has joined #tripleo | 22:29 | |
| *** achadha has quit IRC | 22:30 | |
| *** amodi has quit IRC | 22:32 | |
| *** ansmith has joined #tripleo | 22:35 | |
| *** dmarlin has quit IRC | 22:41 | |
| *** colonwq has joined #tripleo | 22:43 | |
| *** rodolof has quit IRC | 22:45 | |
| *** raildo has quit IRC | 22:54 | |
| *** nyechiel_ has quit IRC | 23:00 | |
| *** rwsu has joined #tripleo | 23:01 | |
| openstackgerrit | Alan Bishop proposed openstack/puppet-tripleo stable/pike: Allow 'cinder' as a backend for Glance https://review.openstack.org/513202 | 23:03 |
| *** tosky has quit IRC | 23:03 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 23:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 23:10 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder master: Dont install python-virtualenv for py3k in deb https://review.openstack.org/513168 | 23:12 |
| *** leseb has quit IRC | 23:21 | |
| *** pkovar has quit IRC | 23:55 | |
| *** rlandy is now known as rlandy|bbl | 23:56 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!