| *** apetrich has quit IRC | 00:05 | |
| *** apetrich has joined #tripleo | 00:06 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: Set DLRN hash when release file contains dlrn_hash variable https://review.openstack.org/513478 | 00:09 |
|---|---|---|
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 00:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 00:10 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: Set DLRN hash when release file contains dlrn_hash variable https://review.openstack.org/513478 | 00:16 |
| *** dmacpher has joined #tripleo | 00:16 | |
| *** limao has joined #tripleo | 00:26 | |
| *** limao_ has joined #tripleo | 00:29 | |
| *** limao has quit IRC | 00:31 | |
| *** limao_ has quit IRC | 00:33 | |
| *** psahoo has joined #tripleo | 00:39 | |
| *** limao has joined #tripleo | 00:40 | |
| *** yamahata has quit IRC | 01:03 | |
| *** Goneri has quit IRC | 01:09 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 01:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 01:10 |
| *** rhallisey has quit IRC | 01:24 | |
| *** Goneri has joined #tripleo | 01:24 | |
| *** limao has quit IRC | 01:27 | |
| *** limao has joined #tripleo | 01:29 | |
| *** bfournie has joined #tripleo | 01:47 | |
| *** bfournie has quit IRC | 01:49 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first https://review.openstack.org/513530 | 01:53 |
| *** toure_biab is now known as toure | 01:59 | |
| *** toure is now known as toure_biab | 01:59 | |
| *** panda|rover is now known as panda|rover|off | 02:01 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 02:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 02:10 |
| *** ecerquei has quit IRC | 02:17 | |
| *** marrusl has quit IRC | 02:30 | |
| *** psachin has joined #tripleo | 02:31 | |
| *** chem has quit IRC | 02:34 | |
| EmilienM | weshay|ruck: you remember the stupid url to reach undercloud home ? | 02:35 |
| EmilienM | weshay|ruck: it's fixed now, see http://logs.openstack.org/07/508307/24/check/legacy-tripleo-ci-centos-7-containers-multinode/d416405/logs/ | 02:35 |
| EmilienM | it links to zuul finally | 02:35 |
| *** ykarel|off has joined #tripleo | 02:43 | |
| *** ykarel|away has joined #tripleo | 02:43 | |
| *** marrusl has joined #tripleo | 02:44 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/pike: Ensure ssh key is active before returning from create_admin_via_nova https://review.openstack.org/510970 | 02:46 |
| *** ykarel|off has quit IRC | 02:52 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Don't cleanup TripleO CI Tempest resources https://review.openstack.org/513169 | 02:52 |
| EmilienM | YEAH | 02:52 |
| *** ykarel|away has quit IRC | 02:52 | |
| EmilienM | weshay|ruck: https://review.openstack.org/512055 should land in 2h if everything works. Once it's merged, we should see progress in promotion jobs | 02:53 |
| *** marrusl has quit IRC | 02:55 | |
| *** ramishra has joined #tripleo | 03:03 | |
| *** gvrangan has joined #tripleo | 03:09 | |
| openstackgerrit | Merged openstack/instack-undercloud master: Generate a standalone stackrc https://review.openstack.org/508593 | 03:10 |
| openstackgerrit | Merged openstack/instack-undercloud master: Handle relative hieradata_override https://review.openstack.org/510813 | 03:10 |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 03:10 |
| *** marrusl has joined #tripleo | 03:13 | |
| *** gkadam-away has joined #tripleo | 03:15 | |
| *** gkadam-away is now known as gkadam | 03:19 | |
| *** dmacpher has quit IRC | 03:41 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Set DLRN hash when release file contains dlrn_hash variable https://review.openstack.org/513478 | 03:42 |
| *** dmacpher has joined #tripleo | 03:43 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Set DLRN hash when release file contains dlrn_hash variable https://review.openstack.org/513478 | 03:46 |
| *** mdnadeem has joined #tripleo | 03:57 | |
| *** dmacpher has quit IRC | 04:00 | |
| *** amodi has joined #tripleo | 04:06 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 04:10 |
| *** ykarel|away has joined #tripleo | 04:17 | |
| *** ykarel|off has joined #tripleo | 04:17 | |
| *** dmacpher has joined #tripleo | 04:24 | |
| *** bobh has joined #tripleo | 04:29 | |
| *** limao has quit IRC | 04:34 | |
| *** bobh has quit IRC | 04:35 | |
| *** karthiks has joined #tripleo | 04:39 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-puppet-elements stable/pike: Added missing package for lbaas UI https://review.openstack.org/513602 | 04:45 |
| *** jaosorior has joined #tripleo | 04:49 | |
| *** limao has joined #tripleo | 04:50 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Create dedicated "apache" base profile https://review.openstack.org/513274 | 04:51 |
| Tengu | now that I know the 143 error is for timeout, it really helps speeding up the log comprehension :). | 04:51 |
| *** jfrancoa has joined #tripleo | 04:53 | |
| *** limao has quit IRC | 04:54 | |
| *** ykarel|away has quit IRC | 04:56 | |
| *** ykarel|off has quit IRC | 04:56 | |
| *** limao has joined #tripleo | 04:59 | |
| *** marios has joined #tripleo | 04:59 | |
| *** marios has quit IRC | 05:01 | |
| *** amodi has quit IRC | 05:01 | |
| Tengu | jaosorior: hello :) | 05:05 |
| jaosorior | yoo, what's up? | 05:05 |
| Tengu | will be faster to discuss my patch in there and put a summary in the review ;) | 05:05 |
| jaosorior | ok | 05:05 |
| *** marios has joined #tripleo | 05:06 | |
| *** marios has quit IRC | 05:06 | |
| Tengu | basically, we need the localhost listener in order to access the server-status page | 05:06 |
| *** Guest48163 has joined #tripleo | 05:06 | |
| Tengu | i.e. apache::mod::status was included in horizon.pp before my patch, but it was not usable, because the module config wants a local access only. And, until my patch, httpd wasn't listening on localhost. | 05:06 |
| Tengu | -> meaning curl http://localhost/server-status couldn't work (connection refused) | 05:07 |
| Tengu | and curl http://<some IP>/server-status returned a 403 due to the module configuration | 05:07 |
| jaosorior | right | 05:07 |
| jaosorior | how would this work in containerized environments? | 05:08 |
| Tengu | good question. | 05:08 |
| jaosorior | I guess to be able to use it we would need to expose a container. | 05:08 |
| jaosorior | or.. it would need to be dnoe for each container running with httpd actually | 05:09 |
| jaosorior | uhm | 05:09 |
| Tengu | the new version indeed activate the module for each API using httpd. | 05:09 |
| jaosorior | but right | 05:09 |
| Tengu | that's the purpose of this new class. | 05:09 |
| jaosorior | I see how this would work for BM | 05:09 |
| jaosorior | it's fine by me, since it's only listening on localhost, that's also not a biggie. | 05:10 |
| Tengu | we can replace the port by a parameter if you want. | 05:10 |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 05:10 |
| Tengu | i.e. that would allow each container to get their own port for the http server-status access | 05:10 |
| Tengu | would prevent possible issues with port exposition | 05:10 |
| jaosorior | Tengu: lets keep it simple for now, and if we need to enable it per-container, then we can expose that port. | 05:11 |
| Tengu | jaosorior: fine for me :) | 05:11 |
| Tengu | feel free to ask for changes if you see anything - although if any, it would be rather simple for anyone to edit that. | 05:11 |
| Tengu | thanks jaosorior and EmilienM for the +2 :) | 05:11 |
| EmilienM | Tengu: +2 on your patch, good work | 05:11 |
| *** tzumainn has quit IRC | 05:11 | |
| Tengu | well, that was easy ;) | 05:11 |
| openstackgerrit | Keith Schincke proposed openstack/tripleo-heat-templates master: WIP: Set file ACLs for Ceph keyrings for non-containerized deployment https://review.openstack.org/509020 | 05:12 |
| Tengu | just a small question: is the copyright OK for you? I didn't pu RedHat, Inc, as I'm not part of that orga :) | 05:12 |
| Tengu | *put | 05:12 |
| jaosorior | That's actually a pretty good question | 05:12 |
| *** karthiks has quit IRC | 05:13 | |
| jaosorior | wasn't it the case that we shouldn't even be putting Red Hat there? as we sign a CLA for the OpenStack foundation? | 05:13 |
| Tengu | duh, right, I signed it. some months before :) | 05:13 |
| Tengu | I can re-amend it in order to drop the copyright. I copied some header from aodh.pp | 05:14 |
| Tengu | as puppet lint wasn't happy there was no doc :Þ | 05:14 |
| jaosorior | Tengu: to be honest, I have no clue how that should work | 05:14 |
| Tengu | oh well. let's just let it as is. | 05:15 |
| Tengu | (is it even English??) | 05:15 |
| *** dparkes has quit IRC | 05:15 | |
| *** jbadiapa has joined #tripleo | 05:16 | |
| *** newmember has joined #tripleo | 05:16 | |
| jaosorior | Tengu: how is the configuration mod_status configuration done? Thinking about the container case, I think it won't be as straight forward as making that apache base profile configurable. | 05:17 |
| jaosorior | Tengu: that's because the container configuration is shared. so any configuration done on apache is replicated to all containers. | 05:18 |
| jaosorior | we would need something custom, probably coming as a puppet "define" resource. That takes parameters and is configured per-service. | 05:18 |
| Tengu | jaosorior: the configuration is set in the apache::mod::status directly. | 05:19 |
| Tengu | 2s | 05:19 |
| Tengu | https://github.com/puppetlabs/puppetlabs-apache/blob/master/manifests/mod/status.pp | 05:20 |
| Tengu | jaosorior: we actually might put something in heat/hiera, like apache::mod::status::allow_from | 05:20 |
| Tengu | jaosorior: this might obsolet the new Listen directive, but only for containers. | 05:20 |
| Tengu | for BM, it still makes sens to get that listener. in container, not really though. | 05:21 |
| Tengu | we might want to put some parameter in order to activate, or not, the listener. | 05:21 |
| Tengu | but that means hitting as well the tripleo-heat-templates in order to add that parameter in… err… no idea. Default to True I guess, hence in the "docker" environment files? | 05:22 |
| Tengu | I can still amend the patch in order to simplify future integration with containers ;). Just lemme know. | 05:22 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Run containerized mistral-api eventlet https://review.openstack.org/513082 | 05:25 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Add --detailed-exitcodes when running puppet via ansible https://review.openstack.org/511509 | 05:25 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: DO NOT MERGE testing containerized scenarios https://review.openstack.org/510040 | 05:25 |
| jaosorior | Tengu: lets do that. Lets have a parameter that optionally enables the listener (defaulting to true) and in containerized configuration the default would be to not have it. In further commits we can try to add support for the status per-contianer. | 05:26 |
| jaosorior | mandre: could we merge this https://review.openstack.org/#/c/509698/ ? :D | 05:26 |
| *** Guest48163 has quit IRC | 05:28 | |
| EmilienM | jaosorior: please monitor https://review.openstack.org/512055 and recheck if failing. We need it asap to have a promotion. Thanks | 05:29 |
| * EmilienM out to bed | 05:30 | |
| Tengu | jaosorior: in order to add status per-container, the easiest way would be to provide the apache::mod::status::allow_from for each containers I think. | 05:30 |
| EmilienM | jaosorior: it should merge in ~2h max | 05:30 |
| Tengu | jaosorior: I'll amend in a few minutes. | 05:30 |
| Tengu | EmilienM: gn then :). | 05:30 |
| EmilienM | Tengu: thx | 05:30 |
| jaosorior | EmilienM: will do | 05:30 |
| EmilienM | jaosorior, mandre : also fyi the gate issue, see alex's email | 05:30 |
| EmilienM | be careful when recheck or rebase | 05:30 |
| * EmilienM really out | 05:30 | |
| *** marios has joined #tripleo | 05:31 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Remove scenarios from config/general_config https://review.openstack.org/512874 | 05:34 |
| Tengu | so. back to patching :). | 05:37 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add abregman to tempest notifications https://review.openstack.org/512530 | 05:39 |
| *** iranzo has joined #tripleo | 05:40 | |
| *** iranzo has quit IRC | 05:40 | |
| *** iranzo has joined #tripleo | 05:40 | |
| Tengu | jaosorior: I also add a new parameter: $status_listener that would allow to do some nice things without having to edit this class :) | 05:41 |
| Tengu | I'm pretty sure you'll accept that change as well. | 05:41 |
| *** apetrich has quit IRC | 05:44 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Create dedicated "apache" base profile https://review.openstack.org/513274 | 05:44 |
| Tengu | jaosorior: -^ | 05:44 |
| Tengu | EmilienM: sorry, you'll need to +2 again the change when you wake up ;) | 05:45 |
| Tengu | hmm | 05:45 |
| openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Create dedicated "apache" base profile https://review.openstack.org/513274 | 05:45 |
| Tengu | better. | 05:45 |
| Tengu | let's use variable type. | 05:46 |
| *** apetrich has joined #tripleo | 05:46 | |
| openstackgerrit | Merged openstack/tripleo-common master: Default DockerCephDaemonImage to stable, not master, tag https://review.openstack.org/509673 | 05:46 |
| *** suuuper has joined #tripleo | 05:51 | |
| Tengu | hmm. | 05:52 |
| Tengu | unit tests. hmm. might be good now as we have class parameters. | 05:52 |
| jaosorior | right | 05:52 |
| jaosorior | that would be nice | 05:52 |
| *** spectr has joined #tripleo | 05:54 | |
| mandre | jaosorior: yep, let's merge it | 05:54 |
| mandre | EmilienM: that's just for the patches that are in the gate, right? or Alex' comment also applies for the check queue? | 05:56 |
| Tengu | jaosorior: doing some right now. | 05:57 |
| *** dparkes has joined #tripleo | 05:57 | |
| *** dsariel has joined #tripleo | 05:57 | |
| *** ggillies has quit IRC | 05:57 | |
| *** yprokule has joined #tripleo | 05:58 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 06:00 |
| Tengu | jaosorior: found out a better way to do my puppet code. unit tests are cool for that. | 06:04 |
| jaosorior | ?? | 06:05 |
| Tengu | you'll see :). | 06:05 |
| jaosorior | coffee coffee coffee | 06:07 |
| Tengu | just setting up my rspec env in order to ensure my units are actually working | 06:07 |
| openstackgerrit | Martin André proposed openstack/tripleo-common stable/pike: Default DockerCephDaemonImage to stable, not master, tag https://review.openstack.org/511418 | 06:08 |
| *** dmacpher has quit IRC | 06:09 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 06:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 06:10 |
| *** jprovazn has joined #tripleo | 06:11 | |
| Tengu | gahhh | 06:15 |
| Tengu | how do we run puppet-rspec in puppet-tripleo ?! apparently, `bundle exec rake spec SPEC=spec/classes/tripleo_profile_base_apache_spec.rb' does a lot of things. Like, A LOT :/ | 06:15 |
| *** mandre is now known as mandre_afk | 06:21 | |
| *** marios has quit IRC | 06:22 | |
| *** marios has joined #tripleo | 06:22 | |
| jaosorior | Tengu: no idea. I tried for a while and eventually gave up. Ending up in me wasting a lot of resources cause I unit test it in CI. | 06:23 |
| Tengu | ook | 06:25 |
| Tengu | jaosorior: ah, apparently the command I issued work, it just takes ages. | 06:28 |
| Tengu | anyway, better testing locally in that cas, as the unit tests arent the same I'm used to. | 06:28 |
| *** psachin has quit IRC | 06:33 | |
| bandini | jaosorior: https://review.openstack.org/#/c/513270/ if you have a bit of time | 06:39 |
| jaosorior | therve: could you also take a look at this https://review.openstack.org/#/c/513270/ ? | 06:40 |
| *** florianf has joined #tripleo | 06:47 | |
| *** jlinkes has joined #tripleo | 06:49 | |
| Tengu | Finished in 6.94 seconds (files took 1.03 seconds to load) | 06:53 |
| Tengu | 8 examples, 0 failures | 06:53 |
| Tengu | good for review | 06:53 |
| Tengu | \o/ | 06:53 |
| openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Create dedicated "apache" base profile https://review.openstack.org/513274 | 06:54 |
| Tengu | jaosorior EmilienM -^ with working unit tests. Sorry for the "darn we need to re+2 for that patch set" :) | 06:56 |
| *** yolanda has joined #tripleo | 07:00 | |
| *** psahoo has quit IRC | 07:01 | |
| *** tesseract has joined #tripleo | 07:03 | |
| *** psahoo has joined #tripleo | 07:04 | |
| *** ebarrera has joined #tripleo | 07:05 | |
| *** ebarrera has quit IRC | 07:05 | |
| *** ebarrera has joined #tripleo | 07:06 | |
| *** jpich has joined #tripleo | 07:09 | |
| *** ffiore has joined #tripleo | 07:09 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 07:10 |
| *** chem has joined #tripleo | 07:10 | |
| jaosorior | Tengu: commented on the patch. | 07:12 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor Ironic and Ironic Inspector services https://review.openstack.org/506662 | 07:21 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor ZaqarWebSocketService functions into thunks https://review.openstack.org/506667 | 07:21 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor KeystoneApiService into thunks https://review.openstack.org/506663 | 07:21 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor MistralApiService to thunks https://review.openstack.org/506664 | 07:21 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor HeatApiService to thunks https://review.openstack.org/506665 | 07:21 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor SwiftApiService into thunks https://review.openstack.org/506666 | 07:21 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Delete services/utils https://review.openstack.org/508466 | 07:21 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Remove unnecessary store imports from tests https://review.openstack.org/508467 | 07:21 |
| Tengu | jaosorior: ahhh. that's the to_not that I was looking for. | 07:21 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Disable Tempest cleanup till Tempest moves to Keystone V3 https://review.openstack.org/513633 | 07:22 |
| openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Create dedicated "apache" base profile https://review.openstack.org/513274 | 07:24 |
| Tengu | jaosorior: -^ | 07:24 |
| jaosorior | ack | 07:28 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Fix clouds.yaml generation https://review.openstack.org/512055 | 07:28 |
| Tengu | thank you :) | 07:29 |
| *** ccamacho has joined #tripleo | 07:31 | |
| *** gfidente has joined #tripleo | 07:38 | |
| *** gfidente has quit IRC | 07:38 | |
| *** gfidente has joined #tripleo | 07:38 | |
| *** jpena|off is now known as jpena | 07:41 | |
| *** achadha has joined #tripleo | 07:42 | |
| *** amoralej|off is now known as amoralej | 07:45 | |
| *** ffiore has quit IRC | 07:45 | |
| *** achadha has quit IRC | 07:46 | |
| *** gvrangan has quit IRC | 07:49 | |
| *** mrch has joined #tripleo | 07:50 | |
| *** mcornea has joined #tripleo | 07:52 | |
| *** bogdando has joined #tripleo | 07:53 | |
| *** ffiore has joined #tripleo | 07:53 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Allow the configuration of image_member_quota from THT https://review.openstack.org/513405 | 07:54 |
| jaosorior | bogdando: checked out the blueprint. Daaamn there seems to be a lot of conversation in there. | 07:56 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Allow the configuration of image_member_quota from THT https://review.openstack.org/513405 | 07:57 |
| *** bogdando has quit IRC | 08:00 | |
| *** cylopez has joined #tripleo | 08:01 | |
| *** paramite has joined #tripleo | 08:02 | |
| *** tosky has joined #tripleo | 08:02 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Add new SELinux validation check https://review.openstack.org/511211 | 08:07 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 08:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 08:10 |
| *** rodolof has joined #tripleo | 08:15 | |
| *** chem has quit IRC | 08:18 | |
| *** bogdando has joined #tripleo | 08:19 | |
| *** dtantsur|afk is now known as dtantsur | 08:23 | |
| *** newmember has quit IRC | 08:23 | |
| *** newmember has joined #tripleo | 08:23 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates master: Do not set cluster in maintenance mode during split stack upgrade https://review.openstack.org/513654 | 08:24 |
| jaosorior | marios, mcornea: any idea what's up with this http://logs.openstack.org/17/508517/15/check/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container-upgrades/b36d3e7/logs/undercloud/home/zuul/overcloud_upgrade_console.log.txt.gz#_2017-10-19_18_06_02 ? | 08:25 |
| *** mandre_afk is now known as mandre | 08:25 | |
| mcornea | jaosorior: I think jfrancoa was looking into that | 08:26 |
| jfrancoa | jaosorior: yep, i had a look at it. it seems that as we are deploying now pike, some ceilometer services are not available anymore but we still have them in our resource registry | 08:27 |
| jaosorior | funky | 08:28 |
| jaosorior | jfrancoa: wait so... what doi you mean by deploying now pike? shouldn't we be deplying queens? | 08:28 |
| jfrancoa | jaosorior: I added some "temporary" solution that avoids the task failing (it checks first if available, if not available then it won't try to stop the service) but the good thing would be to move those services to the "disabled box" as marios did with heat-api-cloudwatch https://review.openstack.org/#/c/510101/ | 08:29 |
| marios | jaosorior: jfrancoa o/ | 08:30 |
| jfrancoa | jaosorior: I mean, in upgrades jobs, first we deploy pike to upgrade to queens. Most upgrade jobs are using the env file master-undercloud-pike-overcloud.yml | 08:31 |
| *** bogdando has quit IRC | 08:31 | |
| marios | jaosorior: yeah its not clear what the story is with that one. the services are enabled, so it is legigimate that the upgrade_tasks are running there (which is what fails). the failure is though that the service isn't installed which doesn't make sense | 08:31 |
| *** bogdando has joined #tripleo | 08:31 | |
| *** lucas-afk is now known as lucasagomes | 08:31 | |
| marios | jaosorior: so jfrancoa can guard it for now by adding a when there (https://review.openstack.org/#/c/507796/6/docker/services/ceilometer-agent-central.yaml ) | 08:32 |
| jaosorior | ack | 08:33 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Allow containerized undercloud deploy with SELinux https://review.openstack.org/513357 | 08:37 |
| *** rodolof has quit IRC | 08:38 | |
| *** rodolof has joined #tripleo | 08:39 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Ceilometer] https://review.openstack.org/507796 | 08:39 |
| jaosorior | bogdando: nice addition | 08:39 |
| bogdando | jaosorior: thanks! I'm going to follow up those Zz to docker-puppet.py as well | 08:40 |
| bogdando | cuz this seems is the next blocker for that bug reporter | 08:40 |
| *** derekh has joined #tripleo | 08:42 | |
| *** _milan_ has joined #tripleo | 08:43 | |
| *** newmember has quit IRC | 08:45 | |
| *** newmember has joined #tripleo | 08:45 | |
| jaosorior | bogdando: hey, if you have time could you review https://review.openstack.org/#/c/508517/ ? | 08:46 |
| bogdando | jaosorior: will do | 08:48 |
| jaosorior | bandini: I didn't +W the patch, to wait for therve to check out the Zaqar config. Just in case. | 08:52 |
| therve | Hi | 08:53 |
| bandini | jaosorior: ack yeah I asked emilien and alex as well just to be sure | 08:53 |
| jaosorior | therve: could you check this out https://review.openstack.org/#/c/513270/ ? | 08:53 |
| therve | Sure | 08:53 |
| therve | jaosorior, Should be fine, hopefully https://review.openstack.org/506071 will land soon | 08:54 |
| therve | And then I'll change to redis | 08:54 |
| jaosorior | bandini: so... should I merge? :D | 08:55 |
| *** salmankhan has joined #tripleo | 08:56 | |
| *** artom_ has joined #tripleo | 08:57 | |
| *** artom has quit IRC | 08:57 | |
| *** sanjayu has quit IRC | 08:57 | |
| bandini | jaosorior: let's wait a couple of hours for mwhahaha/emilienm comments there just to be sure :) | 08:57 |
| jaosorior | ok | 08:58 |
| *** salmankhan has quit IRC | 09:01 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Allow containerized undercloud deploy with SELinux https://review.openstack.org/513669 | 09:01 |
| *** iranzo has quit IRC | 09:03 | |
| *** iranzo has joined #tripleo | 09:05 | |
| *** salmankhan has joined #tripleo | 09:05 | |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-image-elements master: Use volumes for security hardened images https://review.openstack.org/499588 | 09:05 |
| jaosorior | bogdando, jistr: thanks for the reviews. Responded. | 09:05 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Run containerized mistral-api eventlet https://review.openstack.org/513082 | 09:06 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Add --detailed-exitcodes when running puppet via ansible https://review.openstack.org/511509 | 09:06 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: DO NOT MERGE testing containerized scenarios https://review.openstack.org/510040 | 09:06 |
| jistr | jaosorior: replied again, +1 on how you want to merge the steps. Nice work on both the spec and the implementation! | 09:09 |
| jaosorior | bogdando: so, what do you suggest? to use multiple docker volumes? | 09:09 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 09:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 09:10 |
| bogdando | jaosorior: that's the option #1. Another is only bind mount a list of the non-overlapping destinations in /var/log/ subdirs | 09:10 |
| jaosorior | bogdando: they are writing to different files. | 09:10 |
| bogdando | but there are other things logging | 09:10 |
| bogdando | at least httpd | 09:10 |
| bogdando | oh well, not sure, this should be checked | 09:11 |
| bogdando | just with lsof in side car containers | 09:11 |
| *** sanjayu has joined #tripleo | 09:11 | |
| bogdando | if it only writes to a single log file, that's ok | 09:11 |
| *** sanjayu is now known as Guest88264 | 09:11 | |
| *** rcernin has joined #tripleo | 09:12 | |
| Tengu | hello! small question: is there a way to enable versionned objects in swift through tripleO ? Apparently there's a specific configuration to enable: https://docs.openstack.org/swift/latest/overview_object_versioning.html#how-to-enable-object-versioning-in-a-swift-cluster | 09:13 |
| jaosorior | bogdando: I'm honestly not sure what you're suggesting. you can see what the sidecar container is doing. Each sidecar container deals with only one file. | 09:14 |
| Tengu | and, even if git grep actually shows it as active, I can't manage to find where it might be set on the overcloud cluster :/ | 09:14 |
| bogdando | jaosorior: then it's all-right | 09:15 |
| *** hewbrocca_afk is now known as hewbrocca | 09:16 | |
| bogdando | I thought there is other processes writing things, like dumb-init et al | 09:16 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add pre-deployment negative tests for validations https://review.openstack.org/488495 | 09:16 |
| bogdando | what else is there by Kolla? | 09:16 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Fix ansible-lint.sh to check playbooks https://review.openstack.org/446525 | 09:17 |
| lvdombrkr | folks, how can i see api timestamp how long its takes to get token from keystone? | 09:17 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add post-deployment negative tests for validations https://review.openstack.org/504014 | 09:19 |
| jaosorior | bogdando: I think only other thing that writes to the keystone log (/var/log/keystone/keystone.log) would be the db_sync container. Which is ran as a task | 09:19 |
| bogdando | jaosorior: ack. I think it should be fine if there is only a single process running in a side car | 09:20 |
| bogdando | not counting the pid 1 | 09:20 |
| bogdando | kolla dumb-init or whatever, I hope it doesn't clobber each other logs | 09:20 |
| Tengu | cschwede: hello! I have a small question regarding swift configuration through tripleo, specifically regarding the object versionning: I'm unable to find on the overcloud nodes if it's active or not, and I'm unable to find how to activate it… Care to help a bit? :) | 09:21 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in validations.yaml https://review.openstack.org/513676 | 09:22 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in stack.yaml https://review.openstack.org/513677 | 09:22 |
| d0ugal | jpich, florianf ^ some characters. | 09:22 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in validations.yaml https://review.openstack.org/513676 | 09:23 |
| florianf | d0ugal: you win! | 09:23 |
| *** limao has quit IRC | 09:24 | |
| *** limao has joined #tripleo | 09:25 | |
| jpich | wow | 09:26 |
| * d0ugal is doing the other files | 09:26 | |
| *** shardy has joined #tripleo | 09:26 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for keystone containers to log to stdout/stderr https://review.openstack.org/508517 | 09:27 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Glance API containers to log to stdout/stderr https://review.openstack.org/510411 | 09:27 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova containers to log to stdout/stderr https://review.openstack.org/509157 | 09:27 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove log-dir option from neutron-dhcp execution https://review.openstack.org/510463 | 09:27 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Neutron containers to log to stdout/stderr https://review.openstack.org/510464 | 09:27 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr https://review.openstack.org/510537 | 09:27 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova https://review.openstack.org/510561 | 09:27 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova-libvirt container to log to stdout/stderr https://review.openstack.org/510562 | 09:27 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for keystone containers to log to stdout/stderr https://review.openstack.org/508517 | 09:29 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Glance API containers to log to stdout/stderr https://review.openstack.org/510411 | 09:29 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova containers to log to stdout/stderr https://review.openstack.org/509157 | 09:29 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove log-dir option from neutron-dhcp execution https://review.openstack.org/510463 | 09:29 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Neutron containers to log to stdout/stderr https://review.openstack.org/510464 | 09:29 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr https://review.openstack.org/510537 | 09:29 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova https://review.openstack.org/510561 | 09:29 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova-libvirt container to log to stdout/stderr https://review.openstack.org/510562 | 09:29 |
| jaosorior | jistr: what about something like this? https://review.openstack.org/#/c/508517/17/docker/services/keystone.yaml | 09:29 |
| Tengu | jaosorior: you're wanting to burn down the CI again? :) | 09:29 |
| *** salmankhan has quit IRC | 09:29 | |
| jaosorior | Tengu: carrying this many patches in a single queue is brutal X_x | 09:30 |
| *** gvrangan has joined #tripleo | 09:31 | |
| jistr | jaosorior: yea looks good! | 09:31 |
| jaosorior | jistr: great, testing it out again with both implementations | 09:31 |
| *** salmankhan has joined #tripleo | 09:33 | |
| *** yolanda has quit IRC | 09:36 | |
| *** newmember has quit IRC | 09:40 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in validations.yaml https://review.openstack.org/513676 | 09:41 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in stack.yaml https://review.openstack.org/513677 | 09:41 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in plan_management.yaml https://review.openstack.org/513689 | 09:41 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in package_update.yaml https://review.openstack.org/513690 | 09:41 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in deployment.yaml https://review.openstack.org/513691 | 09:41 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in ceph-ansible.yaml https://review.openstack.org/513692 | 09:41 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in baremetal.yaml https://review.openstack.org/513693 | 09:41 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in access.yaml https://review.openstack.org/513694 | 09:41 |
| *** newmember has joined #tripleo | 09:41 | |
| *** chem has joined #tripleo | 09:42 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in stack.yaml https://review.openstack.org/513677 | 09:43 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in plan_management.yaml https://review.openstack.org/513689 | 09:43 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in package_update.yaml https://review.openstack.org/513690 | 09:43 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in deployment.yaml https://review.openstack.org/513691 | 09:43 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in ceph-ansible.yaml https://review.openstack.org/513692 | 09:43 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in baremetal.yaml https://review.openstack.org/513693 | 09:43 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in access.yaml https://review.openstack.org/513694 | 09:43 |
| *** pcaruana has joined #tripleo | 09:46 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-common master: Make validation inputs configurable via Mistral https://review.openstack.org/383763 | 09:47 |
| Tengu | uhuhu | 09:48 |
| Tengu | poor CI | 09:48 |
| bogdando | folks, I'm trying to deploy with the undercloud containers guide (Pike, there it is experimental), and my current blocker is that UpgradeInitDeployment and HostsEntryDeployment configs/deployments just hang | 09:50 |
| bogdando | https://bugs.launchpad.net/tripleo/+bug/1723003 | 09:50 |
| openstack | Launchpad bug 1723003 in tripleo "Containers based Undercloud deploy failed" [High,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 09:50 |
| bogdando | any help with that? | 09:50 |
| bogdando | nested stacks just hang in IN_PROGRESS | 09:51 |
| jaosorior | bogdando: anything in the logs? I think you might see what's going on in journald | 09:52 |
| bogdando | jaosorior: not really! | 09:52 |
| bogdando | I'll try with debug ON | 09:54 |
| *** arxcruz is now known as arxcruz|off | 09:54 | |
| bogdando | got it, jaosorior it's selinux again | 09:55 |
| chandankumar | EmilienM: mwhahaha https://review.openstack.org/#/c/513633/ | 09:55 |
| bogdando | more fixes needed :? | 09:55 |
| bogdando | :> | 09:55 |
| openstackgerrit | Merged openstack/tripleo-docs master: Cleanup remaining pointers to storage-environment.yaml https://review.openstack.org/512616 | 09:55 |
| d0ugal | dtantsur: good spot! | 09:55 |
| dtantsur | :) | 09:56 |
| d0ugal | The risks of semi-automation | 09:56 |
| bogdando | jaosorior: oh well, may be not, it shows res=success | 09:56 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in baremetal.yaml https://review.openstack.org/513693 | 09:57 |
| *** itlinux has joined #tripleo | 09:58 | |
| *** ffiore has quit IRC | 09:58 | |
| Tengu | jaosorior (and anyone with a +2 for code-review or even worflow) care to check that? https://review.openstack.org/#/c/513602/ it's a cherry-pick from master in order to get lbaas-UI in horizon. | 09:59 |
| *** abregman|afk is now known as abregman | 09:59 | |
| openstackgerrit | Martin André proposed openstack/python-tripleoclient master: Rename options to the prepare command for clarity https://review.openstack.org/511514 | 10:02 |
| openstackgerrit | Martin André proposed openstack/python-tripleoclient master: Add --environment-directory to the prepare command https://review.openstack.org/511521 | 10:02 |
| *** abregman is now known as abregman|afk | 10:04 | |
| *** Lokesh_Jain__ has quit IRC | 10:05 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-common master: Use ANSIBLE_HOST_KEY_CHECKING var instead of ssh-common-args https://review.openstack.org/513701 | 10:05 |
| openstackgerrit | Merged openstack/tripleo-image-elements stable/pike: Update ironic-agent-multipath element https://review.openstack.org/508068 | 10:05 |
| openstackgerrit | Merged openstack/tripleo-image-elements stable/ocata: Update ironic-agent-multipath element https://review.openstack.org/508069 | 10:05 |
| openstackgerrit | Merged openstack/tripleo-image-elements stable/newton: Update ironic-agent-multipath element https://review.openstack.org/508072 | 10:05 |
| openstackgerrit | Merged openstack/tripleo-image-elements master: Add missing target_core_mod to iscsi modules https://review.openstack.org/512001 | 10:05 |
| *** ckyriakidou has joined #tripleo | 10:06 | |
| *** ffiore has joined #tripleo | 10:08 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 10:10 |
| Tengu | thank you shardy :) | 10:11 |
| shardy | Tengu: np :) | 10:12 |
| Tengu | and thank you jaosorior :)) | 10:13 |
| *** rodolof has quit IRC | 10:14 | |
| Tengu | hmmm, where am I supposed to find the logs in order to debug this CI error? http://logs.openstack.org/74/513274/7/check-tripleo/legacy-tripleo-ci-centos-7-ovb-containers-oooq/4b12d04/job-output.txt.gz#_2017-10-20_09_43_36_144945 | 10:16 |
| *** leseb has quit IRC | 10:19 | |
| *** leseb has joined #tripleo | 10:20 | |
| shardy | Tengu: yeah we lost the console log in the move to zuul v3 so it's not as clear as it was, but I think quickstart failed deploying the overcloud, log here: | 10:21 |
| shardy | http://logs.openstack.org/74/513274/7/check-tripleo/legacy-tripleo-ci-centos-7-ovb-containers-oooq/4b12d04/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 10:21 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-common master: Use ANSIBLE_HOST_KEY_CHECKING var instead of ssh-common-args https://review.openstack.org/513701 | 10:21 |
| shardy | http://logs.openstack.org/74/513274/7/check-tripleo/legacy-tripleo-ci-centos-7-ovb-containers-oooq/4b12d04/logs/undercloud/home/zuul/failed_deployments.log.txt.gz | 10:22 |
| shardy | Tengu: I think that has the actual error | 10:22 |
| Tengu | ah, thank you! | 10:22 |
| shardy | "stderr: Unable to find image '192.168.24.1:8787/tripleomaster/centos-binary-swift-account:passed-ci' locally\ | 10:22 |
| Tengu | I'll check that after lunch :) | 10:22 |
| bogdando | shardy: could you please lead me with why HostsEntryConfig and UpgradeInitConfig deployments stucks undercloud?.. | 10:23 |
| bogdando | there is nothing in the journald or messages | 10:24 |
| Tengu | shardy: hmm but that error isn't due to my code… right ? | 10:24 |
| bogdando | trying the guide https://bugs.launchpad.net/tripleo/+bug/1723003 for pike | 10:24 |
| openstack | Launchpad bug 1723003 in tripleo "Containers based Undercloud deploy failed" [High,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 10:24 |
| shardy | Tengu: No but it looks like we're missing that image somehow, looking to see if there's a bug already | 10:24 |
| Tengu | shardy: ok, thank you :) | 10:24 |
| shardy | bogdando: what is in UpgradeInitConfig? Can you run the same script manually on the node? | 10:25 |
| bogdando | shardy: It's in tht deployed-server templates | 10:26 |
| bogdando | maybe the issue is related to the os-collect-config on my openstack hosted VM | 10:27 |
| shardy | bogdando: Ok so you're not setting UpgradeInitCommand | 10:27 |
| shardy | bogdando: possibly, can you run it manually and see it collect the metadata from heat? | 10:27 |
| bogdando | shardy: https://pastebin.com/2VJY2WrB | 10:29 |
| bogdando | and the config is cat /var/lib/os-collect-config/local-data/00-os-collect-config | 10:30 |
| bogdando | { "os-collect-config": { "collectors": ["heat", "request", "local"], "command": "os-refresh-config" } } | 10:30 |
| shardy | bogdando: what's in /etc/os-collect-config.conf? | 10:31 |
| shardy | it doesn't seem to have a collector configured to poll the temporary heat? | 10:31 |
| bogdando | shardy: it seems I messed with the disconnect from the host cloud steps | 10:31 |
| bogdando | once I redone os-apply-config -m /var/lib/os-collect-config/local-data/00-os-collect-config, the os-collect-config service can be started and keeps running | 10:32 |
| bogdando | before that it was inactive | 10:32 |
| bogdando | cat /etc/os-collect-config.conf | 10:33 |
| bogdando | [DEFAULT] | 10:33 |
| bogdando | command = os-refresh-config | 10:33 |
| bogdando | collectors = heat | 10:33 |
| bogdando | collectors = request | 10:33 |
| bogdando | collectors = local | 10:33 |
| bogdando | so I hope it's gonna be all-right now, shardy, thanks | 10:35 |
| shardy | bogdando: well is that all there is in the config, e.g the list of collectors but none are actually configured? | 10:36 |
| *** mcornea has quit IRC | 10:39 | |
| bogdando | shardy: FWIW, it works now | 10:39 |
| bogdando | those disconnect from heat dances are tricky, good for us not needed in Queens with configs download changes | 10:40 |
| bogdando | although, I'm fixing the Pike guide, so... | 10:40 |
| *** chem has quit IRC | 10:40 | |
| bogdando | and trying to make undercloud containers deploy to work with selinux enforcing on centos as well | 10:41 |
| *** mcornea has joined #tripleo | 10:43 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-common master: Use ANSIBLE_HOST_KEY_CHECKING var instead of ssh-common-args https://review.openstack.org/513701 | 10:43 |
| *** chem has joined #tripleo | 10:43 | |
| *** itlinux has quit IRC | 10:47 | |
| jaosorior | jistr, bogdando: Just tried out this one https://review.openstack.org/#/c/508517/ with logging to stdout enabled and disabled. It's good to go :D | 10:50 |
| bogdando | jaosorior: well done! | 10:50 |
| *** newmember has quit IRC | 10:50 | |
| *** newmember has joined #tripleo | 10:51 | |
| Tengu | amenophis | 10:58 |
| Tengu | hmm. wrong channel. | 10:58 |
| *** pkovar has joined #tripleo | 10:58 | |
| *** akrivoka has joined #tripleo | 10:59 | |
| *** daidv_ has quit IRC | 10:59 | |
| *** lucasagomes is now known as lucas-hungry | 11:03 | |
| Tengu | shardy: sorry to bother you - apparently, this one isn't going any further: https://review.openstack.org/#/c/512978/ - should I rebase it against master maybe? | 11:07 |
| Tengu | as it was depending on another change that's now merged in master | 11:08 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 11:10 |
| *** mcornea has quit IRC | 11:11 | |
| *** mcornea has joined #tripleo | 11:12 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Glance API containers to log to stdout/stderr https://review.openstack.org/510411 | 11:19 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova containers to log to stdout/stderr https://review.openstack.org/509157 | 11:19 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove log-dir option from neutron-dhcp execution https://review.openstack.org/510463 | 11:19 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Neutron containers to log to stdout/stderr https://review.openstack.org/510464 | 11:19 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr https://review.openstack.org/510537 | 11:19 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova https://review.openstack.org/510561 | 11:19 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova-libvirt container to log to stdout/stderr https://review.openstack.org/510562 | 11:19 |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Enable neutron-lbaasv2 UI in Horizon https://review.openstack.org/512978 | 11:22 |
| *** artom_ is now known as artom | 11:22 | |
| *** gvrangan has quit IRC | 11:23 | |
| Tengu | jaosorior: ah, was it missing some vote in order to get merged ? maybe the worflow in fact ? Well, anyway, I rebased it in order to ensure it will merge correctly. | 11:27 |
| jaosorior | Tengu: it's missing a workflow. I'll wait for the CI result before scoring it. | 11:29 |
| Tengu | jaosorior: ok, thanks! I'm still a bit confused with the vote thing. | 11:30 |
| Tengu | but I will learn it ;) | 11:30 |
| *** ckyriakidou has quit IRC | 11:34 | |
| *** adarazs is now known as adarazs_lunch | 11:34 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Allow containerized undercloud deploy with SELinux https://review.openstack.org/513669 | 11:37 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Allow containerized undercloud deploy with SELinux https://review.openstack.org/513669 | 11:40 |
| jaosorior | bogdando, jistr: Tested Glance as well if you guys have time https://review.openstack.org/#/c/510411/ | 11:43 |
| *** pkovar has quit IRC | 11:44 | |
| *** hjensas has quit IRC | 11:45 | |
| slagle | mcornea: marios : this patch https://review.openstack.org/#/c/513654/ just effectively does nothing if already using docker-ha.yaml | 11:46 |
| slagle | mcornea: marios : i guess you can just not pass the deployed-server-pacemaker-environment.yaml at all | 11:46 |
| *** bfournie has joined #tripleo | 11:49 | |
| *** nyechiel_ has joined #tripleo | 11:49 | |
| mcornea | slagle: we include docker-ha by default. ok, I'll try removing deployed-server-pacemaker-environment.yaml during upgrade and see how it goes | 11:49 |
| marios | slagle: yeah in which case the order matters, i mean if you pass the deployed-server one first then the docker-ha you wouldn't hit it | 11:51 |
| marios | mcornea: ^ I guess the deployed-server one was after docker-ha? | 11:51 |
| mcornea | marios: in downstream we include docker-ha by default so I couldn't tell if it was before or after | 11:52 |
| *** abishop has joined #tripleo | 11:55 | |
| slagle | i guess it's mostly a docs issue to just no longer use that environment | 11:56 |
| *** jpena is now known as jpena|lunch | 11:57 | |
| *** dprince has joined #tripleo | 12:00 | |
| *** rhallisey has joined #tripleo | 12:00 | |
| *** gkadam has quit IRC | 12:00 | |
| *** jlabarre has joined #tripleo | 12:02 | |
| *** bobh has joined #tripleo | 12:04 | |
| *** bobh has quit IRC | 12:06 | |
| social | d0ugal: why mistral has home /home/mistral instead of /var/run/mistral? | 12:06 |
| social | would simplify all the /tmp operations as it all should happen there | 12:07 |
| *** raildo has joined #tripleo | 12:07 | |
| *** dbecker has joined #tripleo | 12:09 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 12:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 12:10 |
| *** bobh has joined #tripleo | 12:11 | |
| *** bfournie has quit IRC | 12:17 | |
| *** bfournie has joined #tripleo | 12:18 | |
| *** salmankhan has quit IRC | 12:18 | |
| openstackgerrit | Merged openstack/tripleo-puppet-elements stable/pike: Added missing package for lbaas UI https://review.openstack.org/513602 | 12:18 |
| *** dougbtv_ has joined #tripleo | 12:20 | |
| *** rcernin has quit IRC | 12:20 | |
| *** sri_ has joined #tripleo | 12:21 | |
| *** liverpooler has joined #tripleo | 12:22 | |
| *** bfournie has quit IRC | 12:22 | |
| *** adarazs_lunch is now known as adarazs | 12:23 | |
| *** ffiore has quit IRC | 12:28 | |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-common master: WIP - POC on callback plugin for ansible to collect result https://review.openstack.org/511254 | 12:30 |
| *** lblanchard has joined #tripleo | 12:30 | |
| *** akrivoka has quit IRC | 12:30 | |
| *** lucas-hungry is now known as lucasagomes | 12:30 | |
| *** ecerquei has joined #tripleo | 12:30 | |
| *** pcaruana has quit IRC | 12:31 | |
| Tengu | ah! seems my patch made it to pike for the lbaas-ui package. now the activation of this ui in horizon, and we're good. | 12:31 |
| *** pkovar has joined #tripleo | 12:35 | |
| *** psahoo has quit IRC | 12:35 | |
| sri_ | beagles: Hi, I've enable octavia service and run the octavi-post-deploy scripts. when I am triing to create a loadbalancer its going to error state with this error : ComputeWaitTimeoutException: Waiting for compute to go active timeout | 12:35 |
| beagles | sri_, can you look into the compute logs where the amphora is trying to launch and see what is happening? | 12:36 |
| *** ecerquei_ has joined #tripleo | 12:37 | |
| sri_ | beagles: ok, | 12:37 |
| Tengu | hmm, I heard octavia integration with tripleo isn't that stable… ? | 12:37 |
| *** bobh has quit IRC | 12:38 | |
| *** mdnadeem has quit IRC | 12:38 | |
| *** ecerquei has quit IRC | 12:38 | |
| beagles | Tengu, it's not fully integrated, isn't being verified by CI, etc. so issues aren't exactly surprising | 12:40 |
| Tengu | beagles: that's why I was advised to go with neutron-lbaasv2 :] | 12:41 |
| Tengu | at least it's better for a productive deploy | 12:42 |
| beagles | Tengu, even once we include all of the automation required for dealing with the "as a service" aspect, I'm sure we'll discover more things going forward | 12:42 |
| *** ramishra has quit IRC | 12:42 | |
| Tengu | oh, well, of course | 12:42 |
| Tengu | it's not a simple toy with 3 lines of python | 12:42 |
| Tengu | anyway, that confort me in my safe choice at work :). | 12:42 |
| Tengu | so. afk for a while. | 12:43 |
| *** akrivoka has joined #tripleo | 12:43 | |
| beagles | Tengu, :) well, it's not the problem with the service necessarily - it's the fact that we have to configure things *in* the overcloud - something that is relatively new to tripleo (the storage devs lead the way here) | 12:43 |
| sri_ | Tengu: I was looking to lbaas ha !! I think it's only possible with octavia right ? | 12:43 |
| shardy | slagle: Hey I was looking for where to add bootstrap_server_id for undercloud deploy, but it looks like it's overridden here: https://review.openstack.org/#/c/509586/4/tripleoclient/v1/undercloud_deploy.py | 12:46 |
| shardy | slagle: Am I missing somewhere else or is that sufficient to remove it from t-h-t? | 12:46 |
| shardy | (line 168) | 12:47 |
| *** hewbrocca is now known as hewbrocca_afk | 12:47 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Set DLRN hash when release file contains dlrn_hash variable https://review.openstack.org/513478 | 12:47 |
| slagle | shardy: hmm. if that works for them...then it's probably sufficient :) | 12:47 |
| shardy | slagle: ack OK I'll link to it from my review then, thanks for confirming | 12:48 |
| sri_ | beagles: http://paste.openstack.org/show/624172/ /var/log/nova/nova-compute.log /var/log/octavia/worker.log , | 12:48 |
| slagle | shardy: when i was working on this with dprince / Slower they asked I add it to the genereated playbook, but maybe they worked around that | 12:48 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Remove workaround for LP#1701239 bug https://review.openstack.org/511242 | 12:48 |
| shardy | slagle: ack cool, I wasn't aware of the history here, mainly looking to fix the hard-coded "0" issue but it'd be good to clean this up if we can | 12:48 |
| slagle | sure, makes sense | 12:49 |
| dprince | slagle, shardy: whatever patch you are talking about... it is working for us :) | 12:49 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow https://review.openstack.org/513463 | 12:50 |
| shardy | dprince: Hey, it's https://review.openstack.org/#/c/513449 - I was going to remove the vars for bootstrap_server_id from the generated playbook | 12:50 |
| shardy | as for the overcloud it's not needed, but there was some discussion over if the ansible driven undercloud deploy needs it | 12:50 |
| shardy | dprince: if you have a moment to test/review that would be great :) | 12:51 |
| dprince | shardy: we could try cherry-picking it into doit.sh later today | 12:51 |
| beagles | sri_, mmmm.. looks like it could be a general octavia issue - try asking in #openstack-lbaas. They can give you better debugging tips | 12:51 |
| dprince | shardy: I'll add it to my queue | 12:51 |
| dprince | and comment on the review | 12:51 |
| *** bfournie has joined #tripleo | 12:51 | |
| shardy | dprince: sounds good, my local vm_doit.sh isn't working today, but I probably need to update all-the-things as I've not used that env in a while | 12:51 |
| shardy | dprince: thanks! | 12:51 |
| sri_ | beagles: ok , thanks | 12:52 |
| *** abregman|afk is now known as abregman | 12:52 | |
| weshay|ruck | mwhahaha, we're starting to get tempest results from master, updating https://etherpad.openstack.org/p/tripleo-promotion-blockers-october-2017 | 12:53 |
| openstackgerrit | Luigi Toscano proposed openstack/tripleo-quickstart-extras master: Tempest notifications for Storage components https://review.openstack.org/511907 | 12:54 |
| openstackgerrit | Luigi Toscano proposed openstack/tripleo-quickstart-extras master: Tempest notifications for Storage components https://review.openstack.org/511907 | 12:55 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Make playbook includes dynamic https://review.openstack.org/513732 | 12:56 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Use playbook from tripleo-quickstart-extras for OVB https://review.openstack.org/513508 | 12:57 |
| *** ffiore has joined #tripleo | 12:57 | |
| *** morazi has joined #tripleo | 12:57 | |
| *** morazi has quit IRC | 12:59 | |
| *** pchavva has joined #tripleo | 13:00 | |
| *** morazi has joined #tripleo | 13:00 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Set DLRN hash when release file contains dlrn_hash variable https://review.openstack.org/513478 | 13:00 |
| *** jpena|lunch is now known as jpena | 13:01 | |
| *** trown|outtypewww is now known as trown | 13:02 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Create default settings for environment types https://review.openstack.org/495407 | 13:02 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Change devmode to deploy containerized services by default https://review.openstack.org/472412 | 13:02 |
| *** spectr has quit IRC | 13:03 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Allow containerized undercloud deploy with SELinux https://review.openstack.org/513669 | 13:07 |
| *** bobh has joined #tripleo | 13:08 | |
| *** tzumainn has joined #tripleo | 13:09 | |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 13:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 13:10 |
| *** panda|rover|off is now known as panda|rover | 13:10 | |
| *** ebarrera has quit IRC | 13:11 | |
| *** vpickard_ is now known as vpickard | 13:12 | |
| *** yamahata has joined #tripleo | 13:12 | |
| honza | Can you recommend a good ansible tutorial? For a total n00b (zero assumed knowledge) | 13:14 |
| shardy | slagle, dprince: Hey I've been looking at some more refactoring to move the host_prep tasks (including writing all the json files) out of deploy-steps.j2 into a standalone task include/playbook like deploy-steps-tasks | 13:15 |
| *** cdearborn has joined #tripleo | 13:16 | |
| shardy | if we do that, it means exposing the role_data from tripleo-dynamic-inventory, which I also have working locally modulo the nested j2 issues I discussed with sdoran yesterday | 13:16 |
| shardy | slagle, dprince: my question is, can we just add a tripleo-ansible-inventory --static-inventory call to the undercloud deploy when using config download? | 13:16 |
| shardy | to ensure the data available is exactly the same in both cases? | 13:17 |
| dprince | shardy: I'm not using tripleo-ansible-inventory yet for the undercloud though | 13:17 |
| shardy | dprince: yeah I'm saying can we/should we add it | 13:17 |
| dprince | shardy: it has an extra service dependency | 13:17 |
| shardy | dprince: well it's just a script that reads heat outputs? | 13:17 |
| shardy | and we already depend on heat? | 13:18 |
| openstackgerrit | Merged openstack/paunch master: Add log_tag option to container definition https://review.openstack.org/509698 | 13:18 |
| *** spectr has joined #tripleo | 13:19 | |
| *** nyechiel_ has quit IRC | 13:19 | |
| shardy | dprince: basically I want to add more data here https://github.com/openstack/tripleo-validations/blob/master/tripleo_validations/inventory.py#L170 | 13:19 |
| dprince | shardy: let me look at it again, I think there was another reason it didn't work | 13:19 |
| shardy | dprince: and if we don't use that same code for undercloud deploy we'll end up having to construct a duplicate vars map which seems like it could be fragile | 13:20 |
| *** tosky has quit IRC | 13:20 | |
| shardy | dprince: ack, thanks - happy to look at other ideas, but this could be a good way to ensure symmetry between the split stack overcloud and undercloud deploy | 13:20 |
| *** ebarrera has joined #tripleo | 13:20 | |
| * shardy tries to fix his doit undercloud deploy env | 13:21 | |
| slagle | shardy: so host prep tasks would be stack output like deploy steps? | 13:21 |
| *** tosky has joined #tripleo | 13:21 | |
| slagle | and config-download would use the stack output instead of what it does now? | 13:21 |
| mwhahaha | weshay|ruck: well at least we're running tempest now. Looks like storage and ec2api related issues. We should ping the storage and compute guys ASAP | 13:21 |
| shardy | slagle: yes, we already expose the per-role host_prep_tasks, so we'd just output the common ones as well | 13:21 |
| weshay|ruck | mwhahaha, yup | 13:21 |
| mwhahaha | weshay|ruck: heads up i need to take today off. so i'll most likely be responding to irc ping only | 13:22 |
| weshay|ruck | mwhahaha, taking the day off means not responding | 13:23 |
| weshay|ruck | :) | 13:23 |
| slagle | shardy: ok, it sounds fine. only thing we have to watch out for is make sure that config-download preserves the right order | 13:24 |
| mwhahaha | weshay|ruck: if only it was that easy :D | 13:24 |
| *** noslzzp has quit IRC | 13:24 | |
| slagle | shardy: e.g., similar to how I had to split the pre/post deployments around deploy-steps | 13:24 |
| *** jmelvin has joined #tripleo | 13:24 | |
| *** amodi has joined #tripleo | 13:24 | |
| *** jcoufal has joined #tripleo | 13:25 | |
| *** salmankhan has joined #tripleo | 13:25 | |
| shardy | slagle: ack, yeah I was thinking we'd include the tasks explicitly inside deploy_steps_playbook like you did for */deployments.yaml | 13:25 |
| shardy | and it'd be another increment towards a pure ansible setup | 13:25 |
| *** migi has quit IRC | 13:25 | |
| shardy | I'll finish up the patches and push them if it sounds reasonable, thanks for the feedback | 13:26 |
| *** noslzzp has joined #tripleo | 13:26 | |
| *** migi has joined #tripleo | 13:27 | |
| *** amoralej is now known as amoralej|lunch | 13:27 | |
| slagle | shardy: yea, i'll have a look when you push the patch. but generally it sounds fine | 13:27 |
| *** chlong has joined #tripleo | 13:27 | |
| *** jcoufal has quit IRC | 13:27 | |
| *** jcoufal has joined #tripleo | 13:28 | |
| *** jcoufal has quit IRC | 13:28 | |
| *** lifeless has quit IRC | 13:28 | |
| *** jcoufal has joined #tripleo | 13:29 | |
| *** lifeless has joined #tripleo | 13:29 | |
| *** abregman is now known as abregman|afk | 13:30 | |
| *** mrunge has quit IRC | 13:36 | |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-common master: Adds detection for legacy API network resource https://review.openstack.org/512395 | 13:36 |
| *** mrunge has joined #tripleo | 13:37 | |
| *** jlinkes has quit IRC | 13:38 | |
| *** dmarlin has joined #tripleo | 13:39 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova containers to log to stdout/stderr https://review.openstack.org/509157 | 13:40 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove log-dir option from neutron-dhcp execution https://review.openstack.org/510463 | 13:40 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Neutron containers to log to stdout/stderr https://review.openstack.org/510464 | 13:40 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr https://review.openstack.org/510537 | 13:40 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova https://review.openstack.org/510561 | 13:40 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova-libvirt container to log to stdout/stderr https://review.openstack.org/510562 | 13:40 |
| *** dmarlin has quit IRC | 13:41 | |
| *** yolanda has joined #tripleo | 13:42 | |
| *** rodolof has joined #tripleo | 13:44 | |
| EmilienM | hello | 13:48 |
| bogdando | hi | 13:48 |
| bogdando | folks, PTAL https://review.openstack.org/#/c/513357/ | 13:48 |
| EmilienM | bandini: what's up | 13:49 |
| bandini | EmilienM: yo! | 13:49 |
| EmilienM | chandankumar: https://review.openstack.org/#/c/513633/1 I don't get it | 13:51 |
| EmilienM | chandankumar: I disabled it in tripleo-ci already | 13:51 |
| dtantsur | folks, can I please get a 2nd +2 on a patch fixing links in the docs? https://review.openstack.org/#/c/512279/ | 13:51 |
| bandini | EmilienM: was wonering if you're okay with merging this https://review.openstack.org/#/c/513270/ | 13:51 |
| bandini | *wondering even | 13:51 |
| *** dansmith is now known as superdan | 13:53 | |
| EmilienM | chandankumar: we did https://review.openstack.org/#/c/513169/, can you explain your patch? | 13:54 |
| *** dsariel has quit IRC | 13:55 | |
| openstackgerrit | Merged openstack/tripleo-validations master: Add Ansible specific files to .gitignore https://review.openstack.org/510078 | 13:55 |
| EmilienM | bandini: looking asap | 13:55 |
| shardy | Anyone else having issues running unit tests locally? for tripleo-validations tox keeps resetting the pip version in the venv to 1.4.1, even if I manually upgrade it, then tox -e py27 fails as that's too old to support the -c flag for upper constraints.. | 13:55 |
| bandini | thank you, sir! | 13:56 |
| shardy | suspect it's something outdated on the host but not quite sure what atm | 13:56 |
| EmilienM | bandini: sure, we don't support mongodb in production anymore right? | 13:56 |
| bandini | EmilienM: I believe so, yes | 13:57 |
| EmilienM | bandini: approving | 13:57 |
| bandini | awesome, thanks | 13:57 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-docs master: ironic: restructure the guide for clarity https://review.openstack.org/512287 | 13:57 |
| openstackgerrit | Merged openstack/tripleo-docs master: ironic: fix links after documentation migration https://review.openstack.org/512279 | 13:58 |
| bandini | EmilienM: I'll need to backport it to pike as well, right? otherwise once we fix puppet erroring out correctly in pike scenario002 will still be broken in pike? | 13:58 |
| EmilienM | gfidente: lgtm, approving | 13:58 |
| jaosorior | jistr, bogdando: Can you check this out as well? https://review.openstack.org/#/c/509157/ | 13:58 |
| *** d0ugal_ has joined #tripleo | 13:59 | |
| *** d0ugal has quit IRC | 13:59 | |
| *** fzdarsky has joined #tripleo | 13:59 | |
| lvdombrkr | hello folks, i have deployed overcloud with external ceph already, but now if i want add new pool in ceph and want assign it as NovaRbdPool, can i just customize puppet-ceph-external.yaml and update existing overcloud? (i have test lab, there is no running instances already etc) | 14:00 |
| *** d0ugal_ has quit IRC | 14:01 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Allow containerized undercloud deploy with SELinux https://review.openstack.org/513669 | 14:01 |
| *** d0ugal has joined #tripleo | 14:01 | |
| bogdando | PTAL ^^ I hope that is ok as those containers that docker-puppet.py launches have nothing to hide from each over | 14:02 |
| bogdando | shardy: ^^ mandre jistr dprince | 14:02 |
| *** chlong has quit IRC | 14:02 | |
| bogdando | I think the final move would be adapt docker/services for those :z flags | 14:03 |
| bogdando | not sure about paunch | 14:06 |
| *** spectr has quit IRC | 14:06 | |
| jaosorior | sounds about right. that should probably be done in the services | 14:07 |
| EmilienM | weshay|ruck: we now have this failure in the promotion pipeline: https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset008-master/3bedb64/undercloud/home/jenkins/tempest_output.log.txt.gz#_2017-10-20_13_55_54 | 14:07 |
| EmilienM | we aren't done yet | 14:07 |
| jaosorior | paunch merely takes what it gets from the templates. | 14:07 |
| weshay|ruck | EmilienM, check the lp bugs | 14:07 |
| weshay|ruck | EmilienM, I'm getting the tempest failures doc'd now | 14:08 |
| EmilienM | weshay|ruck: sorry I didn't read my emails yet | 14:08 |
| weshay|ruck | np | 14:08 |
| *** limao has quit IRC | 14:08 | |
| *** jcoufal has quit IRC | 14:09 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient stable/pike: Allow containerized undercloud deploy with SELinux https://review.openstack.org/513746 | 14:09 |
| *** pradk has joined #tripleo | 14:10 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 14:10 |
| *** jcoufal has joined #tripleo | 14:11 | |
| EmilienM | also, ovb-ha is really timeouting a lot | 14:12 |
| *** jaosorior has quit IRC | 14:12 | |
| EmilienM | shardy: have we tried to reduce the # of services at minimum on ovb-ha? | 14:13 |
| shardy | EmilienM: not yet, I started testing via https://review.openstack.org/#/c/500942 but then other things improved the job times so I deprioritized it | 14:15 |
| shardy | EmilienM: I can rebase that if we have ovb things working again? | 14:15 |
| weshay|ruck | EmilienM, updated https://etherpad.openstack.org/p/tripleo-promotion-blockers-october-2017 | 14:16 |
| EmilienM | shardy: instead of overriding roles_data.yaml - shouldn't we have a roles_data for ovb jobs in CI? maybe painful to maintain though | 14:16 |
| EmilienM | weshay|ruck: yeah I'll look aasap | 14:16 |
| EmilienM | shardy: situation is pretty bad, I'm working on getting numbers but I see a lot of timeouts | 14:17 |
| shardy | EmilienM: we could maintain a custom roles_data, or I was thinking it'd be better to create a new role e.g ControllerHAMinimal in tht/roles | 14:17 |
| *** chlong has joined #tripleo | 14:17 | |
| shardy | then add logic to generate the roles_data via openstack overcloud roles generate to quickstart | 14:17 |
| EmilienM | shardy: ++ | 14:17 |
| shardy | EmilienM: I just hacked up roles_data.yaml as a way to test, let me rebase it | 14:18 |
| EmilienM | shardy: my number say we had 608 failures this week due to timeout or infra | 14:18 |
| EmilienM | shardy: ok, good way to see if that helps | 14:18 |
| shardy | if we can figure out the right subset of services I'll propose the ControllerHaMinimal role and update quickstart | 14:18 |
| EmilienM | shardy: and if yes, maybe we can do what you said | 14:18 |
| *** spectr has joined #tripleo | 14:18 | |
| EmilienM | I'll review your patch asap to give feedback on what you removed | 14:18 |
| shardy | EmilienM: ack sure, I'll rebase that now thanks for the reminder | 14:19 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates stable/newton: Make UpdateDeployment depend on NetworkDeployment https://review.openstack.org/513755 | 14:21 |
| weshay|ruck | EmilienM, shardy mwhahaha no need to respond atm, but my plan is to get all the tempest errors reported, escalated and then added to a skip list so that we can get a promotion | 14:21 |
| weshay|ruck | if you have questions concerns please let me know | 14:21 |
| mwhahaha | wfm | 14:22 |
| EmilienM | shardy: I've let a comment - I know some services are disabled by default | 14:22 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Get DLRN hash before setting up repos and images https://review.openstack.org/512855 | 14:22 |
| EmilienM | weshay|ruck: I'm looking at your bugs in a short moment, I'll tell if we cna ignore these failures. | 14:22 |
| mwhahaha | we should promote and then revert the ignores | 14:23 |
| EmilienM | mwhahaha: wait, I just don't want to make sure we're not missing something obvious | 14:23 |
| EmilienM | gime 5 min | 14:23 |
| mwhahaha | EmilienM: well it takes several hours to land something :D | 14:24 |
| mwhahaha | EmilienM: so take your time | 14:24 |
| EmilienM | weshay|ruck: you can already prepare the patch that ignore what you need to ignore | 14:24 |
| EmilienM | weshay|ruck: at least we save time in case | 14:24 |
| weshay|ruck | EmilienM, ya.. mission is to get master promoted but with accurate reporting | 14:25 |
| mwhahaha | weshay|ruck: EmilienM: but yea we don't want to promote something that would block the CI tempest runs in scenarios | 14:25 |
| mwhahaha | so we need to make sure those aren't on the list | 14:25 |
| weshay|ruck | mwhahaha, that is what the skip list is for | 14:25 |
| weshay|ruck | mwhahaha, ya.. that is what I'm doing now | 14:25 |
| openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 14:26 |
| weshay|ruck | the promotion jobs will run exactly as the check / gate | 14:26 |
| EmilienM | so yeah cinder is broken | 14:26 |
| EmilienM | we don't want to ignore that, do we? :) | 14:26 |
| mwhahaha | not particularly | 14:26 |
| EmilienM | I think I know why | 14:26 |
| mwhahaha | nobody likes cinder anyway | 14:26 |
| *** amoralej|lunch is now known as amoralej | 14:26 | |
| *** jprovazn has quit IRC | 14:27 | |
| EmilienM | weshay|ruck, mwhahaha : https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/17e7aa9/subnode-2/var/log/cinder/volume.log.txt.gz#_2017-10-20_07_07_52_009 FYI I'm looking at it now, but give me some time | 14:27 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-validations master: Warn if there are not enough node IPs in pools https://review.openstack.org/511304 | 14:28 |
| weshay|ruck | EmilienM, ya.. so you'll have time bro.. that is how this is designed | 14:28 |
| weshay|ruck | :) | 14:28 |
| mwhahaha | EmilienM: probably https://review.openstack.org/#/c/507567/ | 14:28 |
| mwhahaha | we need to do that for tripleo | 14:29 |
| mwhahaha | basically just look at p-o-i for the fixes :D | 14:29 |
| EmilienM | yeah | 14:29 |
| EmilienM | or devstack | 14:29 |
| EmilienM | heh it's friday we can say that | 14:29 |
| mwhahaha | pfft devstack | 14:29 |
| EmilienM | mwhahaha: I'm sending a patch | 14:29 |
| mwhahaha | good to see the cinder patch to fix it is in merge conflict, https://review.openstack.org/#/c/468252 | 14:30 |
| EmilienM | mwhahaha: wait but do we have barbican enabled in weshay|ruck's jobs? | 14:30 |
| * mwhahaha shrugs | 14:31 | |
| EmilienM | there is no barbican in featureset016 | 14:31 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-validations master: ctlplane-ip-range: Verify lower IP bound is smaller than upper https://review.openstack.org/510082 | 14:31 |
| *** jcoufal has quit IRC | 14:31 | |
| mwhahaha | yea but i think the problem is you have to define it always | 14:31 |
| mwhahaha | https://review.openstack.org/#/c/505752 | 14:31 |
| * mwhahaha shrugs | 14:32 | |
| EmilienM | mwhahaha: so why p-o-i doesn't fail ? | 14:32 |
| mwhahaha | if only we had cinder experts | 14:32 |
| EmilienM | ok I'll change it I just try to understand | 14:32 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: DNM - WIP testing OVB job speed improvements https://review.openstack.org/500942 | 14:32 |
| openstackgerrit | Merged openstack/tripleo-docs master: Do not rely on openstack-puppet-modules https://review.openstack.org/512777 | 14:32 |
| EmilienM | mwhahaha: let's look in devstack :P | 14:33 |
| mwhahaha | they probably deploy barbican | 14:34 |
| EmilienM | not everywhere | 14:34 |
| EmilienM | I took a job where they don't | 14:34 |
| EmilienM | see http://logs.openstack.org/64/508064/5/check/gate-tempest-dsvm-full-drbd-devstack-ubuntu-xenial-nv/77f10fb/logs/etc/cinder/cinder.conf.txt.gz | 14:34 |
| EmilienM | backend = cinder.keymgr.conf_key_mgr.ConfKeyManager | 14:35 |
| openstackgerrit | Merged openstack/tripleo-docs master: Update upgrade documentation with non-container support plans https://review.openstack.org/512782 | 14:35 |
| *** suuuper has quit IRC | 14:35 | |
| EmilienM | mwhahaha: ok, in p-o-i, we always load castellan.key_manager.barbican_key_manager.BarbicanKeyManager | 14:35 |
| EmilienM | mwhahaha: it's probably fine, since we don't test encryption on the other scenarios (test plugin isn't deployed) | 14:36 |
| mwhahaha | it's probably something that neds to be configurable | 14:36 |
| EmilienM | mwhahaha: but it would fail otherwise, since barbican isn't here. I'll fix p-o-i (cleanup) and tripleo | 14:36 |
| mwhahaha | and we should probably be using that oither one | 14:36 |
| *** yprokule has quit IRC | 14:39 | |
| *** rodolof has quit IRC | 14:41 | |
| *** rodolof has joined #tripleo | 14:42 | |
| *** spectr has quit IRC | 14:42 | |
| *** jcoufal has joined #tripleo | 14:42 | |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud stable/pike: Wrap IPv6 addresses in square brackets https://review.openstack.org/513757 | 14:44 |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud stable/pike: Provide LOCAL_IP_WRAPPED as a instack env variable https://review.openstack.org/513758 | 14:46 |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud stable/pike: Wrap IPv6 addresses in square brackets https://review.openstack.org/513757 | 14:46 |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud stable/pike: Handle relative hieradata_override https://review.openstack.org/513759 | 14:47 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Change devmode to deploy containerized services by default https://review.openstack.org/472412 | 14:48 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-validations master: Add role_data* keys to inventory https://review.openstack.org/513761 | 14:48 |
| shardy | mwhahaha: Hey could you pls check https://review.openstack.org/#/c/513022/ when you get a moment? | 14:50 |
| shardy | need PTL +1 to move forward the ansible-role-k8s repos | 14:50 |
| *** jcoufal has quit IRC | 14:50 | |
| mwhahaha | shardy: k | 14:50 |
| shardy | thanks! | 14:50 |
| dprince | shardy: which patch adds StackAction? | 14:51 |
| dprince | shardy: that looks new, and I'll need to default it for the UC | 14:52 |
| shardy | dprince: hrm I thought we added that a while ago, sec looking for the patch | 14:52 |
| dprince | shardy: yeah, weird I just now hit this | 14:52 |
| EmilienM | weshay|ruck: ok so https://bugs.launchpad.net/tripleo/+bug/1725298 should be good (see comment) | 14:52 |
| openstack | Launchpad bug 1725298 in tripleo "tripleo tracker bug: tempest.scenario.test_shelve_instance.TestShelveInstance.test_shelve_volume_backed_instance test are failing in queens" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 14:52 |
| shardy | dprince: it's already set in environments/undercloud.yaml, what issues are you seeing? | 14:54 |
| dprince | shardy: yeah :) I think I see my issue | 14:54 |
| *** jcoufal has joined #tripleo | 14:54 | |
| dprince | shardy: sorry, I thought there was a new change here | 14:54 |
| dprince | shardy: thanks :) | 14:55 |
| shardy | dprince: no worries, glad you found the problem :) | 14:55 |
| honza | jrist: nice bug report on that secure_access | 14:55 |
| *** fzdarsky has quit IRC | 14:55 | |
| EmilienM | weshay|ruck: https://bugs.launchpad.net/tripleo/+bug/1725296 closed (dup) | 14:56 |
| openstack | Launchpad bug 1725298 in tripleo "duplicate for #1725296 tripleo tracker bug: tempest.scenario.test_shelve_instance.TestShelveInstance.test_shelve_volume_backed_instance test are failing in queens" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 14:56 |
| weshay|ruck | EmilienM, don't close them yet.. I use these bugs to add them to the skip list | 14:56 |
| EmilienM | weshay|ruck: well, they are pointless | 14:56 |
| jrist | honza: is it? | 14:56 |
| weshay|ruck | just note it in the bug for now please | 14:56 |
| EmilienM | weshay|ruck: don't skip them | 14:56 |
| EmilienM | weshay|ruck: let's fix cinder first | 14:57 |
| jrist | honza: took me way too long to figure out | 14:57 |
| weshay|ruck | EmilienM, ok | 14:57 |
| EmilienM | weshay|ruck: we can't skip cinder tests, everytime almost use cinder in scenarios. | 14:57 |
| weshay|ruck | EmilienM, I'll probably need to chat w/ you for 5min.. but I have an interview now.. so a little later | 14:57 |
| EmilienM | weshay|ruck: closed all the bugs except one | 14:59 |
| EmilienM | weshay|ruck: and I'll rename it. | 14:59 |
| *** marios has quit IRC | 15:00 | |
| derekh | mwhahaha: I just noticed you submitted backports of some of the IPv6 undercloud patches, are you hoping to support IPv6 undercloud in pike or where they just needed for some other reason? | 15:02 |
| mwhahaha | derekh: well we're getting rid of instack-undercloud during queens (possibly) | 15:02 |
| mwhahaha | derekh: also i wanted to backport something else cleanly so i needed those patches | 15:02 |
| bogdando | folks, with the WIP patches I submitted, https://bugs.launchpad.net/tripleo/+bug/1723003 is now failing with "Could not find class ::tripleo::packages". Any ideas what could be wrong? | 15:02 |
| openstack | Launchpad bug 1723003 in tripleo "Containers based Undercloud deploy failed" [High,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 15:02 |
| bogdando | there is nothing in the /etc/puppet/modules/ but I think that's expected | 15:03 |
| bogdando | and modules live in the /usr/share/openstack-puppet/modules | 15:03 |
| mwhahaha | bogdando: that's not to be expected | 15:03 |
| mwhahaha | bogdando: we symlink them | 15:03 |
| bogdando | mwhahaha: I've failed to track down that place :( | 15:03 |
| mwhahaha | bogdando: that's handled in instack-undercloud | 15:03 |
| bogdando | in docker-puppet.py specifically | 15:03 |
| bogdando | um, it doesn't use instack undercloud AFAIK?.. | 15:04 |
| derekh | mwhahaha: ack, ok makes sense, just wanted to make sure you we'rn't expecting IPv6 to work with just those patches as there were others | 15:04 |
| bogdando | this is undercloud containers deploy experimental thing | 15:04 |
| bogdando | oh, I think I got it | 15:04 |
| mwhahaha | derekh: no we weren't but it was more to get the clean backport | 15:04 |
| jrist | honza: also I'm not sure that is the only bug | 15:04 |
| *** cdearborn has quit IRC | 15:04 | |
| bogdando | https://github.com/dprince/undercloud_containers/blob/master/doit.sh#L60 mwhahaha :) | 15:05 |
| mwhahaha | bogdando: the containerized undercloud is not properly configuring the puppet modules (like instack did) | 15:05 |
| derekh | mwhahaha: ok, cool | 15:05 |
| mwhahaha | bogdando: yea we actually symlink each module in instack | 15:05 |
| bogdando | that doit.sh magic, I'll put the missing steps to the guide | 15:05 |
| mwhahaha | bogdando: that should be handled by code not docs | 15:05 |
| bogdando | mwhahaha: good point | 15:05 |
| mwhahaha | bogdando: i'd rather see that done in the deploy/install command | 15:05 |
| mwhahaha | bogdando: basically most of doit.sh needs to be moved into python or as package deps | 15:06 |
| bogdando | yeah | 15:06 |
| bogdando | I've moved some package installation bits in Pike | 15:06 |
| bogdando | but some things still not there, right | 15:06 |
| mwhahaha | bogdando: we should probably create a tripleo-undercloud package that's empty but pulls in all those install components | 15:07 |
| mwhahaha | bogdando: that way it can just be yum install tripleo-undercloud | 15:07 |
| mwhahaha | like we used to use python-tripleoclient do the same right now | 15:07 |
| mwhahaha | but eventually we'll want tripleoclient to not be the entrypoint | 15:07 |
| bogdando | that a nice summary mwhahaha, thanks! I'll create a bug | 15:08 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 15:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 15:10 |
| *** _milan_ has quit IRC | 15:11 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Make provision/remote role safe to include statically https://review.openstack.org/513765 | 15:12 |
| * mwhahaha wanders off | 15:12 | |
| bogdando | https://bugs.launchpad.net/tripleo/+bug/1725329 | 15:12 |
| openstack | Launchpad bug 1725329 in tripleo "Manage undercloud containers prepare steps in the tripleo client" [Undecided,New] | 15:12 |
| *** brault has quit IRC | 15:12 | |
| *** jpich has quit IRC | 15:13 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Use playbook from tripleo-quickstart-extras for OVB https://review.openstack.org/513508 | 15:14 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: update cinder kmgr parameter for Queens https://review.openstack.org/513767 | 15:14 |
| *** dparkes has quit IRC | 15:14 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Allow containerized undercloud deploy with SELinux https://review.openstack.org/513669 | 15:15 |
| *** achadha has joined #tripleo | 15:17 | |
| *** achadha has quit IRC | 15:17 | |
| *** achadha has joined #tripleo | 15:17 | |
| Tengu | Could anyone workflow+1 this review so that it gets merged in master (and, later, in pike once I cherry-pick it)? https://review.openstack.org/#/c/512978/ thanks a lot ! | 15:24 |
| Tengu | mayb EmilienM or mwhahaha ? -^ :)) | 15:25 |
| EmilienM | I can't right now, i'm on the gate issue & promotion pipeline | 15:25 |
| *** limao has joined #tripleo | 15:25 | |
| EmilienM | Tengu: your change lgtm | 15:26 |
| Tengu | oh, ok. good luck with that then :). I don't think I can be of any help on that | 15:26 |
| EmilienM | approved | 15:26 |
| Tengu | EmilienM: thanks :) | 15:26 |
| Tengu | oh, and thank you shardy as well :) | 15:26 |
| EmilienM | weshay|ruck: commented on https://bugs.launchpad.net/tripleo/+bug/1725305 | 15:27 |
| openstack | Launchpad bug 1725305 in tripleo "tripleo tracker bug: ec2api.tests.functional tests are failing in queens" [Medium,Triaged] - Assigned to wes hayutin (weshayutin) | 15:27 |
| *** mrch has quit IRC | 15:32 | |
| therve | matbu, Reported https://bugs.launchpad.net/tripleo/+bug/1725338 wrt minor updates | 15:33 |
| openstack | Launchpad bug 1725338 in tripleo "update_nodes workflow doesn't report errors properly" [Undecided,New] | 15:33 |
| therve | Maybe not critical, but can become on customer sites :) | 15:33 |
| EmilienM | mwhahaha: if you can help - I updated https://etherpad.openstack.org/p/tripleo-promotion-blockers-october-2017 (see bottom) with current failures. The one with my names, please don't look I'm already on it | 15:33 |
| EmilienM | actually, if anyone can help ^ | 15:34 |
| mwhahaha | EmilienM: btw there was a reference to ec2api in the keystone v2 ML post so it might be that it doesn't actually support v3 | 15:34 |
| mwhahaha | so we might just need to disable it | 15:34 |
| mwhahaha | or something | 15:34 |
| shardy | last time I looked it did work via v3 | 15:35 |
| EmilienM | mwhahaha: tbh I haven't read emails since yesterday | 15:35 |
| mwhahaha | EmilienM: and nothing of value was missed :D | 15:35 |
| shardy | because we need it for ec2tokens validation in heat, pretty sure we tested that with v3 | 15:35 |
| mwhahaha | or maybe ec2api supports v2 or something | 15:35 |
| * mwhahaha shrugs | 15:35 | |
| *** paramite has quit IRC | 15:36 | |
| EmilienM | cschwede: if you're around, can you help with https://bugs.launchpad.net/tripleo/+bug/1725311 please? | 15:36 |
| openstack | Launchpad bug 1725311 in tripleo "tripleo tracker bug: tempest.api.object_storage are failing in queens " [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 15:36 |
| EmilienM | Goneri: why did you abandon https://review.openstack.org/#/c/508316/ ? | 15:37 |
| *** ebarrera has quit IRC | 15:38 | |
| EmilienM | No "SwiftOperator" role found | 15:39 |
| EmilienM | is this role deprecated or something? | 15:39 |
| EmilienM | maybe our tempest config | 15:39 |
| EmilienM | operator_role = SwiftOperator | 15:39 |
| EmilienM | we might need to change that | 15:39 |
| * EmilienM looks at devstack | 15:40 | |
| EmilienM | tdasilva: ^ if you can help | 15:40 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Add missing puppet configuration to undercloud deploy https://review.openstack.org/513774 | 15:41 |
| chandankumar | EmilienM: regarding this review https://review.openstack.org/#/c/513633/ | 15:43 |
| EmilienM | chandankumar: yeah I don't get it | 15:43 |
| chandankumar | EmilienM: tripleo-ci code is used in upstream CI but it is not used in downstream Ci there they use plain oooq-extras | 15:44 |
| EmilienM | chandankumar: so...? | 15:44 |
| EmilienM | chandankumar: change the parameter to false in your environment | 15:44 |
| chandankumar | EmilienM: disabling there it fixes the upstream tripleo-ci issue, but the RDO Phase jobs will hit this issue leads to esclations cards | 15:44 |
| chandankumar | EmilienM: so it is better to disable that params in oooq-extras itself | 15:45 |
| EmilienM | chandankumar: RDO CI uses tripleo-ci fix | 15:45 |
| EmilienM | chandankumar: I patched rdo cloud files | 15:45 |
| *** limao_ has joined #tripleo | 15:45 | |
| chandankumar | EmilienM: ack, then it is not needed | 15:45 |
| EmilienM | https://review.openstack.org/#/c/513169/1/toci-quickstart/config/testenv/ovb-rdocloud.yml | 15:45 |
| EmilienM | yes this is what i'm saying. | 15:45 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Add missing puppet configuration to undercloud deploy https://review.openstack.org/513774 | 15:45 |
| EmilienM | https://review.openstack.org/#/c/513169/1/toci-quickstart/config/testenv/multinode-rdocloud.yml | 15:45 |
| EmilienM | chandankumar: ^ please take a look | 15:45 |
| *** limao has quit IRC | 15:46 | |
| chandankumar | EmilienM: sure | 15:46 |
| EmilienM | chandankumar: can you help on tempest issues, please? | 15:46 |
| chandankumar | EmilienM: where | 15:46 |
| EmilienM | chandankumar: if yes, look at the bottom: https://etherpad.openstack.org/p/tripleo-promotion-blockers-october-2017 | 15:46 |
| EmilienM | chandankumar: the ones in bold | 15:47 |
| EmilienM | chandankumar: for ex: | 15:47 |
| EmilienM | https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset008-master/3bedb64/undercloud/home/jenkins/tempest/etc/tempest.conf.txt.gz | 15:47 |
| EmilienM | do you know where we set operator_role = SwiftOperator ? | 15:47 |
| *** ebarrera has joined #tripleo | 15:47 | |
| chandankumar | EmilienM: it is used to set in tempest.conf | 15:48 |
| chandankumar | EmilienM: one min | 15:48 |
| EmilienM | chandankumar: we don't manage the role anymore | 15:48 |
| EmilienM | and afik we don't need it | 15:48 |
| EmilienM | well, we have it in p-o-i :/ | 15:49 |
| gregwork | maybe i am thinking about this the wrong way, but when I deploy my overcloud and i define my ExternalNetworkVlan/Subnet/Interface/DefaultROute on my controller nodes .. if i want a tenant to be able to use this network, how do i associate this interface with networks created with --external ? | 15:49 |
| tdasilva | EmilienM: i'm not aware of that role being deprecated | 15:50 |
| gregwork | like on all my controllers i have a vlan101@enpwhatever and my dashboard vip sits there .. however when i try and openstack network create public --external --provider-network-type flat --provider-physical-network datacentre / subnet commands my guests dont seem to have their traffic go out that interface | 15:50 |
| *** ffiore has quit IRC | 15:50 | |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-image-elements master: Use volumes for security hardened images https://review.openstack.org/499588 | 15:50 |
| EmilienM | tdasilva: ok so we still need it? | 15:50 |
| chandankumar | EmilienM: object-storage.operator_role swiftoperator | 15:51 |
| tdasilva | EmilienM: afaik yes | 15:51 |
| chandankumar | EmilienM: if we use member also it is work | 15:51 |
| EmilienM | tdasilva: k thx | 15:51 |
| chandankumar | EmilienM: object-storage.operator_role Member | 15:51 |
| EmilienM | chandankumar: I'll fix in THT, to manage the role. | 15:51 |
| chandankumar | EmilienM: ack. | 15:51 |
| EmilienM | chandankumar: I haven't found where in the code this parameter is set | 15:52 |
| EmilienM | chandankumar: can you link it? | 15:52 |
| EmilienM | chandankumar: in tempest.conf | 15:52 |
| *** lucasagomes is now known as lucas-afk | 15:52 | |
| chandankumar | EmilienM: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-tempest/templates/configure-tempest.sh.j2#L182 | 15:52 |
| EmilienM | tdasilva: is it case sensitive? | 15:52 |
| chandankumar | put the value it is pick it | 15:52 |
| EmilienM | tdasilva: we have swiftoperator alraedy | 15:53 |
| tosky | EmilienM: is it | 15:53 |
| tosky | argh | 15:53 |
| tosky | it is | 15:53 |
| EmilienM | damn... | 15:53 |
| chandankumar | EmilienM: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-tempest/templates/configure-tempest.sh.j2#L64 | 15:53 |
| chandankumar | tosky: ^^ | 15:53 |
| *** iranzo has quit IRC | 15:53 | |
| chandankumar | tosky: we just need a role and pass the role name with swiftoperator it will work | 15:53 |
| EmilienM | chandankumar: the role has to be managed by THT, not quickstart | 15:54 |
| EmilienM | managing the role in quickstart is a workaround | 15:54 |
| tosky | but what did it change? | 15:54 |
| chandankumar | no idea, when it got changed | 15:54 |
| tosky | I remember that we don't set that anymore in tempest.conf (or better, in the deployer-input file) because the role may not exist | 15:55 |
| *** newmember has quit IRC | 15:55 | |
| tosky | arxcruz|off and afazekas remember the story (but it's late for them) | 15:55 |
| EmilienM | chandankumar: where should we pass this parameter? | 15:56 |
| EmilienM | also | 15:56 |
| EmilienM | why devstack doesn't pass it? | 15:56 |
| EmilienM | http://logs.openstack.org/04/513404/1/check/legacy-tempest-dsvm-neutron-full/196a315/logs/tempest_conf.txt.gz | 15:56 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Use Member role for object-storage.operator_role in tempest.conf https://review.openstack.org/513782 | 15:57 |
| tosky | the default value for tempest is 'Member' | 15:58 |
| EmilienM | chandankumar: before doing that | 15:58 |
| EmilienM | why do we need this parameter? | 15:58 |
| EmilienM | swift gate doesn't use it | 15:58 |
| chandankumar | EmilienM: it is needed for object storage tests | 15:58 |
| tosky | chandankumar: if I remember the reason why it was removed, that's not going to work | 15:58 |
| Slower | undercloud validator: https://github.com/openstack/instack-undercloud/blob/master/instack_undercloud/validator.py | 15:59 |
| EmilienM | chandankumar: why swift gate doesn't configure it? | 15:59 |
| EmilienM | chandankumar: http://logs.openstack.org/04/513404/1/check/legacy-tempest-dsvm-neutron-full/196a315/logs/tempest_conf.txt.gz | 15:59 |
| tosky | EmilienM: the default is Member | 15:59 |
| EmilienM | and they run tempest http://logs.openstack.org/04/513404/1/check/legacy-tempest-dsvm-neutron-full/196a315/logs/testr_results.html.gz | 15:59 |
| EmilienM | tosky: ok so if the default is member why are we overriding to SwiftOperator? | 16:00 |
| trozet | dtantsur: i'm seeing this error message during introspection " Could not find node for attributes {'bmc_address': None, 'mac': []}. It looks similar to this: https://bugzilla.redhat.com/show_bug.cgi?id=1322892 | 16:00 |
| openstack | bugzilla.redhat.com bug 1322892 in openstack-ironic-discoverd "No valid interfaces found during introspection" [Unspecified,Closed: errata] - Assigned to dtantsur | 16:01 |
| EmilienM | let's remove the thing which override it and we use default (Member) from tempest | 16:01 |
| trozet | dtantsur: with ocata | 16:01 |
| tosky | EmilienM: probably from some complicated reason why we have regionOne and not RegionOne, or the other way | 16:01 |
| tosky | EmilienM: and if you change it, remember to account for upgrades | 16:01 |
| EmilienM | tosky, chandankumar: where in TripleO do we override the operator_role to SwiftOperator? | 16:01 |
| *** chlong has quit IRC | 16:01 | |
| tosky | as I said, afazekas and arxcruz|off remember more the story | 16:01 |
| chandankumar | EmilienM: we used to over that value till last release | 16:01 |
| *** yamahata has quit IRC | 16:01 | |
| chandankumar | *override | 16:01 |
| EmilienM | chandankumar: but where?? that's my question | 16:01 |
| EmilienM | can we reply to this one? | 16:01 |
| honza | jrist: wait, what? oooq isn't bugfree? | 16:02 |
| * jrist snark detector alert | 16:02 | |
| EmilienM | honza: it is, except Fridays. | 16:02 |
| jrist | BEEP BEEP BEEP BEEP | 16:02 |
| honza | :) | 16:02 |
| EmilienM | chandankumar: before doing https://review.openstack.org/#/c/513782/1/roles/validate-tempest/templates/configure-tempest.sh.j2 I want to understand WHERE we override it. | 16:03 |
| tdasilva | EmilienM: do we know what changed recently to have caused this issue to arise now? | 16:03 |
| dtantsur | trozet: it may mean anything, you need to fetch ramdisk logs | 16:03 |
| chandankumar | EmilienM: tempest config tool will override the value if present or it will add the value in tempest.conf | 16:03 |
| EmilienM | tdasilva: you tell me | 16:04 |
| EmilienM | chandankumar: again... please show me code | 16:04 |
| chandankumar | let me look for examples | 16:04 |
| EmilienM | https://github.com/openstack/python-tempestconf/blob/bc7250eb9af4f641170b4f69c8014733b40ed8a1/etc/default-overrides.conf#L85 | 16:04 |
| EmilienM | this? | 16:04 |
| tdasilva | EmilienM: nothing in swift afaik, plus like you mentioned, the swift gate is not failing | 16:04 |
| EmilienM | this file is really bad. | 16:04 |
| *** ebarrera has quit IRC | 16:05 | |
| EmilienM | we should rely on tempest defaults | 16:05 |
| EmilienM | and not override defaults with another defaults file | 16:05 |
| trozet | dtantsur: ok, is this normal? no ipa-api-url configured, heartbeat and lookup skipped? | 16:05 |
| EmilienM | look now, it's breaking us | 16:05 |
| tosky | EmilienM: it's swiftoperator | 16:05 |
| EmilienM | chandankumar: the properfix is to remove this one | 16:05 |
| dtantsur | trozet: yes | 16:05 |
| EmilienM | no, it's operator_role=SwiftOperator | 16:05 |
| EmilienM | and we don't have this role in TripleO. | 16:06 |
| tosky | http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/puppet/services/external-swift-proxy.yaml#n80 | 16:06 |
| EmilienM | let's remove this line: https://github.com/openstack/python-tempestconf/blob/bc7250eb9af4f641170b4f69c8014733b40ed8a1/etc/default-overrides.conf#L85 | 16:06 |
| trozet | dtantsur: how do you pull the ramdisk logs? | 16:06 |
| EmilienM | and rely on default Tempest: Member | 16:06 |
| EmilienM | chandankumar: ^ | 16:06 |
| chandankumar | EmilienM: https://review.gerrithub.io/#/c/360100/ there is a review in the past for the same | 16:07 |
| chandankumar | EmilienM: one more this default-overrides is only used when we do not pass --deployer-input-file with tempest config tool | 16:08 |
| tosky | chandankumar: that's unrelated | 16:08 |
| tosky | or maybe not | 16:08 |
| tosky | it could be the result of https://review.openstack.org/#/c/486742/ | 16:09 |
| EmilienM | we don't want https://review.gerrithub.io/#/c/360100/ | 16:09 |
| EmilienM | ok i'm proposing a patch | 16:09 |
| chandankumar | EmilienM: https://review.openstack.org/#/c/486742/ | 16:09 |
| tosky | https://review.openstack.org/#/c/486742/ was required because in some cases the role was not defined (like when ceph is used, if I remember correctly) | 16:09 |
| EmilienM | chandankumar: yes, we shouldn't rely on this role, swift gate doesn't use it. They use Member. | 16:10 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 16:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 16:10 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Add modulepath for docker-puppet.py https://review.openstack.org/513789 | 16:12 |
| tdasilva | EmilienM: so the Member role can't be used for certain functionality in swift... | 16:12 |
| tdasilva | EmilienM: you need either admin or swiftoperator to create containers | 16:13 |
| EmilienM | tdasilva: ok that is something we didn't know | 16:14 |
| EmilienM | and it changes the game | 16:14 |
| chandankumar | tdasilva: you need a role which is created by admin user na? | 16:14 |
| EmilienM | tdasilva: so why swift gate doesn't configure it? and use Member? | 16:14 |
| chandankumar | tdasilva: it's name should be anything | 16:14 |
| tosky | chandankumar: please override that role not in configure-tempest.sh.j2, but only in scenarios where swift is used | 16:15 |
| EmilienM | tdasilva: see http://logs.openstack.org/04/513404/1/check/legacy-tempest-dsvm-neutron-full/196a315/logs/tempest_conf.txt.gz | 16:15 |
| tdasilva | EmilienM: that is what I'm trying to understand :/ | 16:15 |
| EmilienM | tdasilva: that's from devstack | 16:15 |
| EmilienM | chandankumar: https://review.openstack.org/#/c/513790/ | 16:15 |
| tosky | maybe devstack also change the permission of Member | 16:15 |
| tosky | EmilienM: that will break the usage of tempestconf used after a packstack deployment | 16:16 |
| *** tesseract has quit IRC | 16:17 | |
| EmilienM | tosky: then change packstack? | 16:17 |
| tosky | EmilienM: also in ocata and pike | 16:17 |
| tosky | legacy, you can't kill in one shot | 16:17 |
| *** gkadam has joined #tripleo | 16:17 | |
| tosky | EmilienM: the solution for now is: override the role in tempest.conf in scenarios when swift is used (and ceph is not) | 16:18 |
| jistr | slagle: your patch is cursed https://review.openstack.org/#/c/508189. It will fail again even though all the patches on top of it repeatedly succeed... | 16:18 |
| EmilienM | probably | 16:18 |
| chandankumar | EmilienM: How to find when swift is usedf? | 16:19 |
| EmilienM | chandankumar: don't we have this logic in tempestconf, | 16:19 |
| EmilienM | ? | 16:19 |
| tdasilva | EmilienM: sorry, catching up slowly here, so you can see in the swift gate proxy config that swift has either Member or admin configured as operator | 16:19 |
| tdasilva | http://logs.openstack.org/23/336323/22/check/legacy-tempest-dsvm-neutron-full/ab106e3/logs/etc/swift/proxy-server.conf.txt.gz | 16:19 |
| tosky | EmilienM: I think that he is asking swift vs ceph-as-swift | 16:19 |
| chandankumar | EmilienM: i am taking about override the value based on deployment | 16:20 |
| tdasilva | EmilienM: how do I find the proxy-server.conf file for the tripleo job that is failing | 16:20 |
| chandankumar | EmilienM: tempestconf look for enable or disbaled and configures them | 16:20 |
| EmilienM | tdasilva: in etc of subnode-2 | 16:20 |
| EmilienM | tdasilva: a sec... | 16:21 |
| EmilienM | tdasilva: trying to find it | 16:21 |
| tdasilva | EmilienM: found this https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/cb5e483/undercloud/etc/swift/proxy-server.conf.txt.gz | 16:21 |
| tdasilva | and it lists operator_roles = admin, SwiftOperator | 16:22 |
| tdasilva | so we should be assigning users that are going to be creating containers one of those two roles | 16:22 |
| *** dtantsur is now known as dtantsur|afk | 16:22 | |
| EmilienM | tdasilva, tosky, chandankumar: I think I found it | 16:23 |
| *** akrivoka has quit IRC | 16:23 | |
| EmilienM | tempestconf enabled swift in tempest because it found the endpoint but in fact it's Ceph RW endpoint and swift isn't deployed | 16:23 |
| EmilienM | https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/cb5e483/subnode-2/etc/ there is no swift | 16:23 |
| EmilienM | but if you look, ceph rgw is configured | 16:23 |
| EmilienM | one solution is to use healthcheck API in tempestconf to check if swift is actually here | 16:24 |
| *** akrivoka has joined #tripleo | 16:25 | |
| tosky | is the healthcheck API only exposed by Swift and not by Ceph RGW? | 16:25 |
| EmilienM | tosky: exactly | 16:26 |
| EmilienM | tosky: the only downside I see is that you need the middleware enabled | 16:26 |
| EmilienM | but all deployements I know have it | 16:26 |
| tosky | so that test should be skipped for ceph, uhm, but then isn't it also a missing feature in Ceph RGW compared to Swift? | 16:27 |
| tosky | I mean, why should the test be disabled vs its config tuned? | 16:27 |
| EmilienM | tosky: I think, iirc, tempestconf sees a, 'object' endpoint / service | 16:28 |
| EmilienM | so thinks Swift is enable | 16:28 |
| tosky | and it is, and Swift tests should pass | 16:28 |
| EmilienM | nope | 16:28 |
| tosky | unless Ceph RGW does not implement some feature | 16:28 |
| EmilienM | you can't test Swift API if you don't have Swift | 16:28 |
| EmilienM | chandankumar: can we work on a patch in tempestconf now? | 16:29 |
| tosky | EmilienM: doesn't Ceph RGW expose the Swift API? | 16:29 |
| EmilienM | not exactly | 16:29 |
| EmilienM | anyway | 16:29 |
| EmilienM | we can't run swift tempest tests against Ceph RGW | 16:29 |
| tosky | no, no, please explain | 16:29 |
| tosky | why not? | 16:29 |
| tosky | I think that the outcome on some past discussion was different | 16:30 |
| tdasilva | tosky: i'm not sure they support | 16:30 |
| *** dbecker has quit IRC | 16:30 | |
| EmilienM | of course they don't | 16:30 |
| tosky | tdasilva: all the APIs, or just some? | 16:30 |
| tdasilva | maybe...i'm mistaken, but from what i have seen they try to only support as far as the refstack tests | 16:30 |
| tdasilva | but not all of the tempest tests...idk | 16:30 |
| EmilienM | yes | 16:30 |
| tosky | ok, so it's not about all tests, but some specific tests | 16:31 |
| EmilienM | tbh we shouldn't run tempest swift against ceph rgw, this is out of scope | 16:31 |
| tosky | for now | 16:31 |
| *** Goneri has quit IRC | 16:31 | |
| tosky | not running it in the long term means not catching some error | 16:32 |
| *** trown is now known as trown|lunch | 16:33 | |
| EmilienM | tosky: I guess for now we just want to get RDO promotion | 16:34 |
| EmilienM | tosky: none in 41 days, the situation is really bad | 16:34 |
| *** eck` is now known as eck`gone | 16:34 | |
| EmilienM | chandankumar: can we force to disable swift tests in scenario004 with some tempestconf parameters? | 16:34 |
| tosky | EmilienM: totally correct | 16:35 |
| tosky | a promotion for Queens-1 would be good | 16:36 |
| *** eck`gone is now known as eck` | 16:36 | |
| tosky | I'd just like to have a workaround that can be easily forgotten or that makes things complicated when someone will try to remove it | 16:36 |
| EmilienM | agreed | 16:37 |
| EmilienM | chandankumar seems afk, I'm taking a look now | 16:37 |
| *** yamahata has joined #tripleo | 16:37 | |
| tosky | it's technically an day of holiday for chandankumar | 16:38 |
| tosky | (and late too) | 16:38 |
| EmilienM | oh :( | 16:39 |
| EmilienM | I didn't know. I'm working on a fix now | 16:39 |
| EmilienM | weshay|ruck: we need some folks looking at the 3 in bold: https://etherpad.openstack.org/p/tripleo-promotion-blockers-october-2017 | 16:39 |
| EmilienM | (see bottom) | 16:39 |
| weshay|ruck | k | 16:40 |
| tdasilva | EmilienM, tosky, chandankumar where do I find that doc that lists what projects are tested in which scenario? | 16:40 |
| EmilienM | a sec, we have that documented | 16:42 |
| tosky | tbarron: a combination of https://docs.openstack.org/tripleo-quickstart/latest/feature-configuration.html | 16:42 |
| tosky | and https://github.com/openstack/tripleo-heat-templates/blob/master/README.rst#service-testing-matrix | 16:42 |
| EmilienM | tdasilva: https://github.com/openstack/tripleo-heat-templates#service-testing-matrix | 16:42 |
| EmilienM | tosky was faster !! HA | 16:42 |
| *** limao_ has quit IRC | 16:42 | |
| tosky | but it does not say when RGW is configured | 16:43 |
| tosky | or maybe it's with some other label | 16:43 |
| tosky | or is it always configured? | 16:43 |
| tdasilva | tosky: cephrgw ? | 16:43 |
| tosky | yep | 16:43 |
| tosky | ah | 16:44 |
| tosky | ok, yes | 16:44 |
| tdasilva | EmilienM, tosky I'm actually more confused about scenario 2 than scenario 4 | 16:44 |
| tdasilva | scenario 2 says both swift and rgw are configured, and that should not be possible | 16:44 |
| EmilienM | it's probably an error indeed | 16:44 |
| radez | EmilienM: re: https://review.openstack.org/#/c/512393 could you gimme a quick once over for unit tests for it: https://paste.fedoraproject.org/paste/CLK9Eu7GCENQA5wSCj~2kA | 16:44 |
| tosky | uh, weird | 16:44 |
| radez | is that on the right track? | 16:45 |
| *** amoralej is now known as amoralej|off | 16:45 | |
| chandankumar | EmilienM: i am here | 16:45 |
| tosky | we can really override the tempest configuration for the scenario when RGW is enabled saying that swift is disabled | 16:45 |
| EmilienM | radez: will look aftet this thing | 16:45 |
| EmilienM | tosky: let's do that | 16:45 |
| radez | EmilienM: np, no rush, thx | 16:45 |
| tosky | but I agree with tdasilva that it should be clear whether swift or rgw is enabled in 2 | 16:45 |
| EmilienM | tosky: I don't know how tbh | 16:45 |
| EmilienM | tosky: it's not | 16:45 |
| EmilienM | only scenario004 AFIK | 16:45 |
| EmilienM | (rgw) | 16:46 |
| EmilienM | I'll update doc | 16:46 |
| tosky | how to check completely? The scenario file? | 16:46 |
| tosky | ok | 16:46 |
| chandankumar | EmilienM: use tempest_extra_config and set service_available.swift to false | 16:46 |
| chandankumar | EmilienM: it will disable swift service | 16:46 |
| tdasilva | it would be really nice if scenario002 is really using swift as we are planning on adding integration with barbican and scenario2 lists barbican | 16:47 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Update scenarios doc for Ceph RGW https://review.openstack.org/513805 | 16:47 |
| EmilienM | tosky, tdasilva ^ done | 16:47 |
| tbarron | tosky: I think you meant tdasilva? "tbarron: a combination of https://docs.openstack.org/tripleo-quickstart/latest/feature-configuration.html" | 16:47 |
| tosky | tbarron: ups, sorry | 16:47 |
| tbarron | tosky: np! | 16:48 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: swift_rsync: don't bind mount /run https://review.openstack.org/513020 | 16:48 |
| tdasilva | tbarron: join the party :) | 16:48 |
| EmilienM | chandankumar: ok I'm working on a patch | 16:48 |
| chandankumar | tosky: EmilienM tdasilva use tempest_extra_config params to pass additional config or override it | 16:48 |
| *** jfrancoa has quit IRC | 16:48 | |
| tbarron | tdasilva: just replace swift with rgw and everything will be alright! | 16:48 |
| tdasilva | heh | 16:49 |
| * tbarron goes and drinks more ceph koolaide | 16:49 | |
| tdasilva | lol | 16:49 |
| EmilienM | chandankumar: tempest_extra_config is an array? | 16:49 |
| EmilienM | or an hash? | 16:49 |
| tosky | EmilienM: hash, it's iterated with 'for key, value in tempest_extra_config.iteritems() ' | 16:49 |
| *** bogdando has quit IRC | 16:50 | |
| chandankumar | tempest_extra_config: {'compute-feature-enabled.attach_encrypted_volume': 'True', | 16:50 |
| chandankumar | 'auth.tempest_roles': '"Member, creator"'} | 16:50 |
| tosky | I would extend it to two lines | 16:50 |
| EmilienM | chandankumar: ok thx | 16:50 |
| tosky | otherwise it becomese messy when more than options are added | 16:51 |
| chandankumar | if someone is looking at barbican please have a look at this review https://review.openstack.org/#/c/499928/16 also since volume encryption tests are screwing on containers | 16:51 |
| tosky | of course not auth.tempest_roles, but add service_available.swift | 16:51 |
| chandankumar | tosky: that was an example copied from the review | 16:51 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Disable tempest swift on scenario004 https://review.openstack.org/513808 | 16:53 |
| EmilienM | chandankumar, tosky ^ would it be ok for you? | 16:53 |
| chandankumar | tosky: once Queens will be over i am going to write a unified tempest role for all which will be consumed upstream to downstream | 16:53 |
| chandankumar | EmilienM: looks good. | 16:55 |
| trozet | weshay|ruck: hey if i were to just grab regular rdo delorean pike repo, and add that to overcloud to then install the undercloud stuff, would that be reasonable? Or is there a chance that what is in that repo wont match what was used in the last tripleo image build? | 16:55 |
| weshay|ruck | everything other than the delorean repo itself can shift a bit | 16:55 |
| weshay|ruck | trozet, I would suggest using the convert script that's in jina in the convert-image role | 16:56 |
| weshay|ruck | and just passing the same vars we do | 16:56 |
| weshay|ruck | trozet, just write a little python :) | 16:56 |
| *** cylopez has quit IRC | 16:56 | |
| *** jpena is now known as jpena|off | 16:57 | |
| *** achadha has quit IRC | 16:57 | |
| trozet | weshay|ruck: yeah i mean that is fine. But remember the issue is i dont have the exact rdo repo that was used to build those images. Remember you said you would add the repo to the overcloud image | 16:57 |
| trozet | weshay|ruck: so im wondering until that happens... is it good enough to juse use the latest rdo delorean | 16:58 |
| tosky | EmilienM: doesn't featureset008.yml also use scenario004? | 16:58 |
| *** gfidente is now known as gfidente|afk | 16:58 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Allow containerized undercloud deploy with SELinux https://review.openstack.org/513357 | 17:00 |
| tosky | nevermind, it was 015, and 015 has no tempest | 17:00 |
| EmilienM | tosky: it doesn't run tempest | 17:00 |
| tosky | noticed afterwards | 17:00 |
| EmilienM | tosky: YET! | 17:00 |
| EmilienM | but will work on it one day :) | 17:01 |
| tosky | maybe could be put there just in case, but I guess that anyone who will change it to enable tempest will notice | 17:01 |
| *** mcornea has quit IRC | 17:03 | |
| EmilienM | tosky: CI will fail if you don't have it, I guess | 17:04 |
| tosky | and if it's not fixed elsewhere before; exactly | 17:04 |
| * tosky relocates while the tests are running | 17:04 | |
| *** tosky has quit IRC | 17:04 | |
| *** gkadam has quit IRC | 17:05 | |
| *** sri_ has quit IRC | 17:05 | |
| *** dbecker has joined #tripleo | 17:06 | |
| EmilienM | chandankumar: can we work on tempestconf to test healthcheck endpoint to determine if swift is actually running? | 17:06 |
| EmilienM | chandankumar: I'll work on the code, just asking for feedback | 17:07 |
| bfournie | hi florianf | 17:07 |
| EmilienM | tos^ | 17:07 |
| *** yolanda has left #tripleo | 17:07 | |
| EmilienM | an he left | 17:07 |
| *** yolanda has joined #tripleo | 17:07 | |
| chandankumar | EmilienM: sure | 17:07 |
| chandankumar | EmilienM: i need to rewrite the complete tempest config tool | 17:07 |
| chandankumar | EmilienM: it is full of workaround | 17:07 |
| EmilienM | the only problem I see is if healthcheck middleware is off | 17:08 |
| EmilienM | chandankumar: oh yes it is | 17:08 |
| chandankumar | EmilienM: i also need to update the blueprint in refstack so that we can integration with them | 17:08 |
| EmilienM | chandankumar: http://192.168.24.1:8080/healthcheck (doing a curl) will tell you OK or not | 17:09 |
| *** myoung|remote has joined #tripleo | 17:09 | |
| *** myoung|remote has quit IRC | 17:09 | |
| EmilienM | chandankumar: look http://paste.openstack.org/show/624207/ | 17:09 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 17:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 17:10 |
| *** achadha has joined #tripleo | 17:10 | |
| EmilienM | cores: need review on https://review.openstack.org/#/c/513808/ | 17:11 |
| EmilienM | chandankumar: can you please create a bug in launchpad following-up https://bugs.launchpad.net/tripleo/+bug/1725311 to track the work in tempestconf regarding what we just said? | 17:12 |
| openstack | Launchpad bug 1725311 in tripleo "Tempest Swift tests run on scenario004 (with Ceph RGW, not Swift)" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 17:12 |
| pradk | mwhahaha, can we merge this https://review.openstack.org/#/c/511236/ | 17:13 |
| chandankumar | EmilienM: sure | 17:14 |
| EmilienM | pradk: approving | 17:14 |
| pradk | thx | 17:14 |
| *** chlong has joined #tripleo | 17:14 | |
| *** achadha has quit IRC | 17:15 | |
| EmilienM | chandankumar: and add the link in 1725311 - so we can keep track | 17:15 |
| EmilienM | chandankumar: thanks | 17:15 |
| *** thrash is now known as thrash|biab | 17:16 | |
| openstackgerrit | Merged openstack/tripleo-ui master: Refactor Ironic and Ironic Inspector services https://review.openstack.org/506662 | 17:18 |
| chandankumar | EmilienM: https://storyboard.openstack.org/#!/story/2001253 | 17:18 |
| EmilienM | chandankumar: thx | 17:20 |
| EmilienM | chandankumar: added to the lp | 17:20 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Explicitly list Apache License as 2.0 https://review.openstack.org/510598 | 17:21 |
| *** dbecker has quit IRC | 17:27 | |
| openstackgerrit | Merged openstack/tripleo-ui master: Refactor ZaqarWebSocketService functions into thunks https://review.openstack.org/506667 | 17:28 |
| trozet | weshay|ruck, trown|lunch: with the pike ramdisk and kernel, when I try to start undercloud: qemu: linux kernel too old to load a ram disk. If I simply use he ocata ones it works fine. My host is centos 7.4 with latest packages | 17:30 |
| *** fragatina has quit IRC | 17:33 | |
| trozet | EmilienM: have you ever seen that^ | 17:35 |
| EmilienM | trozet: no | 17:35 |
| EmilienM | chandankumar: are you still around? | 17:41 |
| chandankumar | EmilienM: yes | 17:41 |
| EmilienM | chandankumar: with weshay|ruck, we're trying to figure out why ec2api tempest tests ran, while not being included | 17:41 |
| EmilienM | https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/1a931e6/undercloud/home/jenkins/tempest_output.log.txt.gz | 17:41 |
| EmilienM | it's because we have the plugin? | 17:41 |
| chandankumar | EmilienM: is ec2api service enabled? | 17:42 |
| chandankumar | in tempest.conf | 17:42 |
| EmilienM | chandankumar: not in whitelist: https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/1a931e6/undercloud/home/jenkins/whitelist_file.conf.txt.gz | 17:42 |
| *** tosky has joined #tripleo | 17:42 | |
| EmilienM | whitelist isn't working well | 17:42 |
| EmilienM | chandankumar: I don't think it's enabled in tempest.conf | 17:42 |
| EmilienM | https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/1a931e6/undercloud/home/jenkins/tempest/etc/tempest.conf.txt.gz | 17:43 |
| EmilienM | and no, service isn't enabled | 17:43 |
| *** amodi has quit IRC | 17:43 | |
| chandankumar | EmilienM: looking for correct service name in code | 17:44 |
| *** jcoufal has quit IRC | 17:45 | |
| *** salmankhan has quit IRC | 17:46 | |
| chandankumar | EmilienM: we also need additional config for ec2api https://github.com/openstack/ec2-api/blob/master/devstack/create_config#L273 | 17:47 |
| EmilienM | chandankumar: yeah but this is a separated issue | 17:48 |
| EmilienM | chandankumar: the bug is that whitelist isn't working well | 17:48 |
| chandankumar | EmilienM: sorry i am little confused | 17:50 |
| chandankumar | EmilienM: you mean to say whitelist tests are not running ? | 17:50 |
| EmilienM | chandankumar: yes, see https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/1a931e6/undercloud/home/jenkins/tempest_output.log.txt.gz | 17:50 |
| EmilienM | ec2 tests isn't in the whitelist, but tests are run | 17:51 |
| EmilienM | can you explain? | 17:51 |
| chandankumar | EmilienM: weired | 17:53 |
| chandankumar | EmilienM: looking into it | 17:53 |
| EmilienM | yes | 17:53 |
| EmilienM | I'm afk 15 min | 17:53 |
| *** weshay|ruck is now known as weshay|ruck|afk5 | 17:53 | |
| *** weshay|ruck|afk5 is now known as weshay|afk50min | 17:54 | |
| tosky | as long as ec2-api is installed, it sets that ec2api is available in tempest configuration | 17:54 |
| tosky | http://git.openstack.org/cgit/openstack/ec2-api/tree/ec2api/tests/functional/config_opts.py#n22 | 17:54 |
| *** pkovar has quit IRC | 17:55 | |
| chandankumar | tosky: but the thing is ostestr should run only those tests which are in whitelist file | 17:56 |
| chandankumar | but it is invoking ec2 tests | 17:56 |
| chandankumar | and other plugins tests also | 17:56 |
| *** trown|lunch is now known as trown | 17:58 | |
| *** gvrangan has joined #tripleo | 17:58 | |
| tosky | I see | 17:58 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: update the master tempest skip list for ec2 and zaqar https://review.openstack.org/513820 | 17:58 |
| *** achadha has joined #tripleo | 17:59 | |
| weshay|afk50min | chandankumar, tosky EmilienM https://review.openstack.org/513820 | 17:59 |
| weshay|afk50min | now afk | 17:59 |
| *** achadha has quit IRC | 18:00 | |
| *** achadha has joined #tripleo | 18:00 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Set file mode permission for Ceph keyrings in containers https://review.openstack.org/508975 | 18:02 |
| *** achadha has quit IRC | 18:02 | |
| chandankumar | tosky: it might happens that due to stestr whitelist bug | 18:04 |
| tosky | chandankumar: shouldn't there be a overcloud-validate.sh here? https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/1a931e6/undercloud/home/jenkins/ | 18:04 |
| chandankumar | tosky: ostestr-1.0.0 is used which is based on stestr | 18:04 |
| *** achadha has joined #tripleo | 18:04 | |
| *** rlandy is now known as rlandy|brb | 18:04 | |
| chandankumar | tosky: it should be https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/1a931e6/undercloud/home/jenkins/tempest-setup.sh.txt.gz | 18:04 |
| chandankumar | it should be tempest-setup.sh | 18:04 |
| EmilienM | tosky: even if the service is enabled by default in the plugin, testr should not execute the test because it's not in the whitelist, right? | 18:05 |
| tosky | chandankumar: oh, right | 18:05 |
| chandankumar | tosky: https://github.com/mtreinish/stestr/commit/218af443076e8409f7bf1f8b5b299395ff19da37 | 18:06 |
| chandankumar | tosky: i am not sure it is related to this | 18:06 |
| EmilienM | chandankumar: maybe you can ping him on #openstack-qa | 18:07 |
| tosky | chandankumar: do we have stestr 1.1 already? | 18:07 |
| chandankumar | EmilienM: https://review.rdoproject.org/r/#/c/10175/ | 18:07 |
| chandankumar | tosky: ^^ | 18:07 |
| chandankumar | it might fix it | 18:08 |
| chandankumar | time to go home i will take a look tomorrow | 18:09 |
| tosky | did you also send the patch for upper-constraints.txt on requirements.git? | 18:09 |
| chandankumar | tosky: https://review.openstack.org/#/c/513772/ | 18:09 |
| EmilienM | chandankumar: ok approving it | 18:09 |
| chandankumar | requirements patch | 18:10 |
| EmilienM | tosky: https://review.openstack.org/#/c/513772/ | 18:10 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 18:10 |
| EmilienM | chandankumar: thanks for staying late | 18:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 18:10 |
| tosky | noticed | 18:10 |
| chandankumar | EmilienM: tosky Good night, happy weekend see ya on monday :-) | 18:10 |
| tosky | see you! | 18:10 |
| EmilienM | weshay|afk50min: i'm going to close zaqar/ec2/barbican bugs, they are all related | 18:11 |
| EmilienM | tosky: thx as wel | 18:11 |
| EmilienM | well* | 18:11 |
| *** gvrangan has quit IRC | 18:14 | |
| *** gvrangan has joined #tripleo | 18:15 | |
| *** chlong has quit IRC | 18:15 | |
| EmilienM | mwhahaha: quick update - all promotion blockers are addressed & patches waiting to be reviewed or in gate, https://etherpad.openstack.org/p/tripleo-promotion-blockers-october-2017 is updated | 18:17 |
| mwhahaha | K | 18:18 |
| *** cylopez has joined #tripleo | 18:18 | |
| *** cylopez has quit IRC | 18:21 | |
| *** yolanda has quit IRC | 18:24 | |
| fultonj | does scenario001-multinode-oooq-container intentionally not use the cinder-volume service as it's not containerized? | 18:30 |
| EmilienM | no idea, I know it was disabled for some reasons | 18:30 |
| EmilienM | in queens, we should enable it | 18:30 |
| *** chlong has joined #tripleo | 18:31 | |
| fultonj | abishop was the cinder volume service or just other cinder services recently containerized ? | 18:31 |
| abishop | fultonj, EmilienM: it was re-containered in https://review.openstack.org/479001 | 18:33 |
| fultonj | no logs http://logs.openstack.org/75/508975/12/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/a77892d/logs/subnode-2/var/log/containers/cinder/ | 18:34 |
| fultonj | i guess there would be no logs if we know it was disabled | 18:34 |
| *** pradk has quit IRC | 18:35 | |
| abishop | and I don't see mention of DockerCinderVolumeImage in http://logs.openstack.org/75/508975/12/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/a77892d/logs/undercloud/home/zuul/containers-default-parameters.yaml.txt.gz | 18:36 |
| *** thrash|biab is now known as thrash | 18:39 | |
| abishop | fultonj: think I found it, one moment... | 18:39 |
| abishop | fultonj, EmilienM: https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/scenario001-multinode-containers.yaml#L20 | 18:41 |
| abishop | looks like cinder-volume container isn't enable in ci job | 18:41 |
| abishop | not sure why the baremetal service isn't running, though | 18:42 |
| fultonj | https://github.com/openstack/tripleo-heat-templates/blob/45f58ce1b0c1843025fc1930cf1facb8c009e88e/ci/environments/scenario001-multinode-containers.yaml#L24 | 18:44 |
| fultonj | the non-container version looks like it's enabed ^ | 18:45 |
| fultonj | unless my change broke it | 18:46 |
| fultonj | so looking in logs from my review could be misleading | 18:46 |
| openstackgerrit | Merged openstack/tripleo-specs master: Add "ux" tag in Launchpad https://review.openstack.org/513499 | 18:46 |
| fultonj | w.r.t ps | 18:46 |
| fultonj | but you'd think there would be a log | 18:46 |
| fultonj | abishop: ps it in http://logs.openstack.org/96/511996/1/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container/896f2d2/logs/subnode-2/ps.txt.gz | 18:47 |
| fultonj | abishop: and http://logs.openstack.org/96/511996/1/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container/896f2d2/logs/subnode-2/var/log/cinder/ | 18:48 |
| fultonj | so... it's probably my fault | 18:48 |
| *** weshay|afk50min is now known as weshay|ruck | 18:51 | |
| weshay|ruck | EmilienM, related to which bug? | 18:52 |
| * weshay|ruck checks etherpd | 18:52 | |
| EmilienM | weshay|ruck: etherpad updated | 18:54 |
| EmilienM | all under control | 18:54 |
| EmilienM | there is one new thing tho | 18:54 |
| EmilienM | look on infra chan | 18:54 |
| weshay|ruck | EmilienM, that was pretty quick work man | 18:55 |
| EmilienM | I'm in mtg now, brb | 18:55 |
| EmilienM | we need to file a bug and a query | 18:56 |
| EmilienM | but I'm on a call now | 18:56 |
| EmilienM | see the vxlan tunnel issue | 18:57 |
| *** rlandy|brb is now known as rlandy | 18:57 | |
| abishop | fultonj: nothing leaps out as a problem in https://review.openstack.org/508975, but maybe you need to rebase | 19:05 |
| fultonj | abishop: ok, thanks | 19:06 |
| *** athomas has quit IRC | 19:07 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 19:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 19:10 |
| weshay|ruck | EmilienM, ya.. I see three recent jobs failing on the tunnel | 19:14 |
| EmilienM | more | 19:16 |
| EmilienM | I'm trying to build a query to see when it appeared | 19:16 |
| EmilienM | but it sounds like on multinode | 19:16 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Make provision/remote role safe to include statically https://review.openstack.org/513765 | 19:20 |
| *** salmankhan has joined #tripleo | 19:26 | |
| openstackgerrit | Dan Prince proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 19:30 |
| *** salmankhan has quit IRC | 19:31 | |
| *** iranzo has joined #tripleo | 19:34 | |
| *** amodi has joined #tripleo | 19:38 | |
| *** tzumainn has quit IRC | 19:51 | |
| *** iranzo has quit IRC | 19:54 | |
| *** myoung is now known as myoung|biab | 19:55 | |
| *** myoung|biab is now known as myoung|biaf | 19:55 | |
| EmilienM | mwhahaha: all multinodes jobs on centos now fail | 19:57 |
| EmilienM | https://bugs.launchpad.net/tripleo/+bug/1725451 | 19:57 |
| openstack | Launchpad bug 1725451 in tripleo "CI: new centos7 image contains a regression that prevents multinode networking setup to work" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 19:57 |
| EmilienM | debugging on infra channel | 19:57 |
| *** tzumainn has joined #tripleo | 20:03 | |
| *** jtomasek has quit IRC | 20:07 | |
| *** jfrancoa has joined #tripleo | 20:09 | |
| *** yolanda has joined #tripleo | 20:10 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1725451 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 20:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 20:10 |
| openstack | Launchpad bug 1725451 in tripleo "CI: new centos7 image contains a regression that prevents multinode networking setup to work" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 20:10 |
| *** dougbtv_ has quit IRC | 20:13 | |
| dprince | EmilienM: can we recheck now? https://review.openstack.org/#/c/510212/ | 20:15 |
| EmilienM | dprince: everything is broken, recheck is useless | 20:18 |
| EmilienM | dprince: all multinode jobs are failing | 20:18 |
| EmilienM | see alert... | 20:18 |
| dprince | EmilienM: ack, okay | 20:18 |
| *** dprince has quit IRC | 20:19 | |
| *** itlinux has joined #tripleo | 20:19 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: log the vxlan setup ping test for multinode https://review.openstack.org/513842 | 20:20 |
| *** chlong has quit IRC | 20:22 | |
| *** bfournie has quit IRC | 20:23 | |
| EmilienM | abishop: see alerts | 20:26 |
| *** aputtur_ has joined #tripleo | 20:26 | |
| *** EmilienM changes topic to "CI status: RED - do not recheck - all multinode jobs red | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 20:26 | |
| *** aputtur_ has quit IRC | 20:27 | |
| *** fragatina has joined #tripleo | 20:27 | |
| abishop | EmilienM: sorry, I don't understand | 20:28 |
| EmilienM | abishop: alerts CI problems, and they are displayed here ^ every 30 min | 20:28 |
| EmilienM | URGENT TRIPLEO TASKS NEED ATTENTION | 20:28 |
| EmilienM | can't make it more obvious | 20:29 |
| fultonj | abishop: i think he's referring to us looking at the CI logs earlier | 20:29 |
| fultonj | and that we shouldn't drop in changes at the moment | 20:30 |
| EmilienM | I spent my whole day on these CI issues, I give up for now, if someone can take over that would help but I'm not continuing. | 20:30 |
| abishop | fultonj: ack, I haven't submitted anything in >24 hours | 20:30 |
| fultonj | i will not submit any more changes until it's fixed | 20:31 |
| EmilienM | well if nobody helps nothing is fixed ^_^ | 20:31 |
| *** pchavva has quit IRC | 20:31 | |
| EmilienM | we can wait a lot :D | 20:31 |
| *** trown is now known as trown|outtypewww | 20:46 | |
| *** itlinux has quit IRC | 20:47 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Make provision/remote role safe to include statically https://review.openstack.org/513765 | 20:49 |
| *** raildo has quit IRC | 20:49 | |
| *** panda|rover is now known as panda|rover|off | 20:49 | |
| *** abishop has quit IRC | 20:54 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: CI/DEBUG: see if newest IPtables broke multinode/centos https://review.openstack.org/513848 | 20:55 |
| *** bobh has quit IRC | 20:56 | |
| *** ecerquei__ has joined #tripleo | 21:01 | |
| *** ecerquei_ has quit IRC | 21:05 | |
| *** ecerquei__ has quit IRC | 21:09 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1725451 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 21:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 21:10 |
| openstack | Launchpad bug 1725451 in tripleo "CI: new centos7 image contains a regression that prevents multinode networking setup to work" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 21:10 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: CI/DEBUG: see if newest IPtables broke multinode/centos https://review.openstack.org/513848 | 21:16 |
| EmilienM | weshay|ruck: fixing ansible syntax | 21:16 |
| EmilienM | it didn't like the DEBUG: | 21:16 |
| weshay|ruck | heh | 21:19 |
| *** jmelvin has quit IRC | 21:23 | |
| *** gvrangan has quit IRC | 21:26 | |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: WIP: Pre-run validations and verifications for the undercloud https://review.openstack.org/513856 | 21:27 |
| *** gvrangan has joined #tripleo | 21:27 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: update the master tempest skip list, remove old bugs https://review.openstack.org/513820 | 21:28 |
| *** myoung|biaf is now known as myoung | 21:28 | |
| *** rodolof has quit IRC | 21:38 | |
| *** rodolof has joined #tripleo | 21:38 | |
| *** rodolof has quit IRC | 21:42 | |
| *** derekh has quit IRC | 21:42 | |
| *** rodolof has joined #tripleo | 21:42 | |
| *** gfidente|afk has quit IRC | 21:43 | |
| *** marrusl has quit IRC | 21:45 | |
| *** shardy has quit IRC | 21:45 | |
| *** lblanchard has quit IRC | 21:46 | |
| *** tvignaud has quit IRC | 21:48 | |
| *** chem has quit IRC | 21:49 | |
| *** amodi has quit IRC | 21:53 | |
| *** thrash is now known as thrash|g0ne | 21:55 | |
| EmilienM | weshay|ruck: it failed :/ | 22:01 |
| *** gvrangan has quit IRC | 22:01 | |
| EmilienM | 2017-10-20 22:01:04.555814 | primary | fatal: [undercloud]: FAILED! => {"changed": true, "cmd": "wget http://mirror.centos.org/centos/7/os/x86_64/Packages/iptables-1.4.21-18.0.1.el7.centos.x86_64.rpm wget http://mirror.centos.org/centos/7/os/x86_64/Packages/iptables-services-1.4.21-18.0.1.el7.centos.x86_64.rpm sudo yum downgrade -y iptables-1.4.21-18.0.1.el7.centos.x86_64.rpm | 22:02 |
| EmilienM | iptables-services-1.4.21-18.0.1.el7.centos.x86_64.rpm", "delta": "0:00:00.010588", "end": "2017-10-20 22:01:04.524228", "failed": true, "rc": 2, "start": "2017-10-20 22:01:04.513640", "stderr": "wget: invalid option -- 'y'\nUsage: wget [OPTION]... [URL]...\n\nTry `wget --help' for more options.", "stdout": "", "stdout_lines": [], "warnings": ["Consider using get_url or uri module rather than running wget"]} | 22:02 |
| * weshay|ruck picks up the review | 22:02 | |
| EmilienM | ah | 22:02 |
| EmilienM | I need to add && or ; | 22:02 |
| EmilienM | x! | 22:03 |
| EmilienM | x | 22:03 |
| EmilienM | gi treit review | 22:03 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: CI/DEBUG: see if newest IPtables broke multinode/centos https://review.openstack.org/513848 | 22:03 |
| EmilienM | oops | 22:03 |
| EmilienM | weshay|ruck: this time should be good ^ | 22:03 |
| EmilienM | j extr | 22:04 |
| EmilienM | git review | 22:04 |
| weshay|ruck | EmilienM, replace > w/ | | 22:04 |
| EmilienM | wth | 22:04 |
| weshay|ruck | heh.. or && lolz | 22:04 |
| EmilienM | a little bug in my terminal, sorry | 22:04 |
| EmilienM | weshay|ruck: ok, thx | 22:04 |
| *** ccamacho has quit IRC | 22:05 | |
| *** jmelvin has joined #tripleo | 22:07 | |
| *** jfrancoa has quit IRC | 22:09 | |
| *** jmelvin has quit IRC | 22:09 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1725451 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 22:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 22:10 |
| openstack | Launchpad bug 1725451 in tripleo "CI: new centos7 image contains a regression that prevents multinode networking setup to work" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 22:10 |
| *** rlandy has quit IRC | 22:13 | |
| *** achadha has quit IRC | 22:21 | |
| *** achadha has joined #tripleo | 22:21 | |
| *** achadha has quit IRC | 22:21 | |
| *** rodolof has quit IRC | 22:25 | |
| *** akrivoka has quit IRC | 22:25 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: refactor cellv2 host discovery logic to avoid races https://review.openstack.org/513867 | 22:28 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: refactor cellv2 host discovery logic to avoid races https://review.openstack.org/513867 | 22:33 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Add ability to build images to baremetal playbook https://review.openstack.org/513503 | 22:34 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Make roles safe to include statically https://review.openstack.org/513871 | 22:34 |
| *** jlabarre has quit IRC | 22:39 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: refactor cellv2 host discovery logic to avoid races https://review.openstack.org/513867 | 22:42 |
| *** bfournie has joined #tripleo | 22:52 | |
| *** achadha has joined #tripleo | 22:52 | |
| EmilienM | weshay|ruck: downgrading didn't help, probably because subnode2 wasn't downgraded | 22:53 |
| *** bfournie has quit IRC | 22:53 | |
| *** bfournie has joined #tripleo | 22:53 | |
| EmilienM | weshay|ruck: we need to run this task on all hosts | 22:53 |
| EmilienM | I know where we can do it, let me send a patch | 22:54 |
| EmilienM | in tripleo-ci | 22:56 |
| *** yamahata has quit IRC | 22:56 | |
| weshay|ruck | EmilienM, my patch didn't hit the issue http://zuulv3.openstack.org/static/stream.html?uuid=2984454c6657440b8883c00097ad6f2b&logfile=console.log | 22:56 |
| weshay|ruck | EmilienM, why would iptables be a $random isuse | 22:56 |
| weshay|ruck | issue | 22:56 |
| EmilienM | weshay|ruck: which patch? | 22:56 |
| EmilienM | weshay|ruck: check iptables version | 22:57 |
| weshay|ruck | http://zuulv3.openstack.org/static/stream.html?uuid=2984454c6657440b8883c00097ad6f2b&logfile=console.log | 22:57 |
| weshay|ruck | it's not done yet | 22:57 |
| EmilienM | I'm sure you don't have the new version | 22:57 |
| *** achadha has quit IRC | 22:57 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: refactor cellv2 host discovery logic to avoid races https://review.openstack.org/513867 | 22:58 |
| weshay|ruck | EmilienM, ok.. so different clouds have different cache? | 22:59 |
| EmilienM | weshay|ruck: different images yeah | 23:00 |
| EmilienM | weshay|ruck: they should have the same | 23:00 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: DEBUG: downgrade iptables https://review.openstack.org/513873 | 23:00 |
| EmilienM | but some clouds lag | 23:00 |
| EmilienM | weshay|ruck: can you look that ^ ? would hosts: all work? | 23:00 |
| EmilienM | http://my1.fr/files/emilien-right-now.jpg | 23:00 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: log the vxlan setup ping test for multinode https://review.openstack.org/513842 | 23:00 |
| weshay|ruck | EmilienM, k.. I put my patch on top of yours https://review.openstack.org/#/c/513842/ | 23:01 |
| EmilienM | sure | 23:01 |
| EmilienM | weshay|ruck: does hosts: all would run it on the undercloud + subnodes? | 23:01 |
| weshay|ruck | EmilienM, yup | 23:01 |
| EmilienM | ok | 23:02 |
| EmilienM | weshay|ruck: I have to be afk a little now, I'll watch the jobs on this one, but I hope ^ can work | 23:02 |
| EmilienM | weshay|ruck: I want to make sure both undercloud & overcloud have previous version of iptables | 23:02 |
| weshay|ruck | aye.. l84s | 23:02 |
| weshay|ruck | k k | 23:02 |
| EmilienM | weshay|ruck: also, I'm not sure if there is any service to restart | 23:02 |
| EmilienM | since there is a iptables-services pkg | 23:03 |
| weshay|ruck | EmilienM, it gets restarted at the ping test | 23:03 |
| EmilienM | yeah? | 23:03 |
| weshay|ruck | ya | 23:03 |
| weshay|ruck | line 38 | 23:03 |
| weshay|ruck | oh wait.. that's openvswitch | 23:04 |
| weshay|ruck | sry | 23:04 |
| EmilienM | yeah | 23:04 |
| EmilienM | anyway, we'll see | 23:04 |
| weshay|ruck | you patchin | 23:04 |
| weshay|ruck | ? | 23:04 |
| EmilienM | I think it's firewalld | 23:04 |
| EmilienM | weshay|ruck: patch what? | 23:04 |
| weshay|ruck | uploading a new version? | 23:05 |
| EmilienM | yeah | 23:05 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: DEBUG: downgrade iptables https://review.openstack.org/513873 | 23:06 |
| EmilienM | weshay|ruck: see^ I restart firewalld | 23:06 |
| EmilienM | we'll see, bbl | 23:07 |
| EmilienM | https://review.openstack.org/#/c/513873/2/toci-quickstart/playbooks/multinode.yml should tell us if yes/no it's iptables causing an issue | 23:07 |
| *** beagles has left #tripleo | 23:07 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 23:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1725451 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 23:10 |
| openstack | Launchpad bug 1725451 in tripleo "CI: new centos7 image contains a regression that prevents multinode networking setup to work" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 23:10 |
| *** fragatina has quit IRC | 23:30 | |
| *** tosky has quit IRC | 23:34 | |
| *** fragatina has joined #tripleo | 23:36 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: refactor cellv2 host discovery logic to avoid races https://review.openstack.org/513867 | 23:46 |
| EmilienM | weshay|ruck: it sounds like my patch isn't good | 23:46 |
| EmilienM | weshay|ruck: probably because the undercloud tasks aren't run on the overcloud before | 23:47 |
| EmilienM | weshay|ruck: ok, downgrade was done on the overcloud: http://logs.openstack.org/73/513873/2/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-puppet/fd6150b/job-output.txt.gz#_2017-10-20_23_27_33_952614 | 23:55 |
| EmilienM | so maybe it's not iptables | 23:55 |
| EmilienM | I'll debug over the weekend, I'm off now a bit | 23:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
