| *** iurygregory has quit IRC | 00:04 | |
| *** lblanchard has quit IRC | 00:08 | |
| *** dmacpher_ has joined #tripleo | 00:09 | |
| *** dmacpher has quit IRC | 00:10 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
|---|---|---|
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 00:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797167 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 00:10 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 00:10 |
| *** jhebden has quit IRC | 00:11 | |
| *** jhebden has joined #tripleo | 00:12 | |
| *** panda has quit IRC | 00:13 | |
| *** panda has joined #tripleo | 00:16 | |
| *** lblanchard has joined #tripleo | 00:17 | |
| *** lblanchard has quit IRC | 00:17 | |
| *** artom has quit IRC | 00:19 | |
| *** artom has joined #tripleo | 00:19 | |
| *** rcernin has quit IRC | 00:29 | |
| *** mjturek has joined #tripleo | 00:57 | |
| *** mjturek has quit IRC | 00:58 | |
| *** lblanchard has joined #tripleo | 00:58 | |
| *** tzumainn has quit IRC | 00:58 | |
| *** phuongnh has joined #tripleo | 01:03 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797167 | 01:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 01:10 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 01:10 |
| itlinux | hi can someone check this out https://review.openstack.org/#/c/609036/2 | 01:14 |
| itlinux | let me know. Thanks | 01:14 |
| *** mrsoul has quit IRC | 01:34 | |
| *** mschuppert has quit IRC | 01:34 | |
| *** rcernin has joined #tripleo | 02:01 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 02:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797167 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 02:10 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 02:10 |
| *** itlinux_ has joined #tripleo | 02:28 | |
| *** itlinux has quit IRC | 02:31 | |
| *** phuongnh has quit IRC | 02:33 | |
| *** lblanchard has quit IRC | 02:40 | |
| *** rh-jelabarre has quit IRC | 02:43 | |
| *** psachin has joined #tripleo | 03:08 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 03:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797167 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 03:10 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 03:10 |
| *** ramishra has joined #tripleo | 03:16 | |
| *** shyamb has joined #tripleo | 03:57 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 04:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797167 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 04:10 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 04:10 |
| *** shyamb has quit IRC | 04:24 | |
| *** janki has joined #tripleo | 04:26 | |
| *** shyamb has joined #tripleo | 04:35 | |
| *** shyamb has quit IRC | 04:53 | |
| *** ksambor has joined #tripleo | 05:00 | |
| *** agurenko has joined #tripleo | 05:04 | |
| *** shyamb has joined #tripleo | 05:05 | |
| Tengu | hello there | 05:05 |
| jaosorior | good morning1 | 05:05 |
| Tengu | how are you today, jaosorior ? | 05:06 |
| *** ykarel has joined #tripleo | 05:07 | |
| jaosorior | all good | 05:09 |
| jaosorior | you? | 05:09 |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797167 | 05:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 05:10 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 05:10 |
| *** slaweq has joined #tripleo | 05:11 | |
| *** slaweq has quit IRC | 05:16 | |
| Tengu | jaosorior: not bad. Happy with my finding on containers - we can go forward now with overcloud deploy I think. | 05:18 |
| *** ratailor has joined #tripleo | 05:19 | |
| *** sshnaidm|afk has quit IRC | 05:19 | |
| Tengu | chkumar|off: heya! no idea for the tempest failure, but I saw it was discussed as a CIX blocker or something like that, and a patch was just merged - so maybe my run was launched just before the merge itself. I hit another issue now on the same commit, so I've launched a recheck. | 05:20 |
| *** chkumar|off is now known as chandankumar | 05:26 | |
| chandankumar | Tengu: let'see how recheck goes. | 05:37 |
| Tengu | chandankumar: yep | 05:37 |
| *** udesale has joined #tripleo | 05:39 | |
| *** quiquell|off is now known as quiquell | 05:42 | |
| quiquell | Good morning | 05:42 |
| Tengu | «o/ quiquell | 05:44 |
| *** yprokule has joined #tripleo | 05:50 | |
| *** pcaruana has joined #tripleo | 06:01 | |
| chandankumar | Tengu: quiquell \o/ | 06:04 |
| quiquell | chandankumar: o/ | 06:04 |
| quiquell | marios: I am checking timeouts, I see deploy overcloud has increase | 06:04 |
| quiquell | marios: http://dashboard-ci.tripleo.org/d/poOr-d0mk/ansible-exploration?orgId=1&var-influxdb_filter=logs_path%7C%3D~%7C%2Ftripleo-ci-centos-7-scenario001-multinode-oooq-container%2F&var-influxdb_filter=job_branch%7C%3D%7Cmaster&var-influxdb_filter=task_name%7C%3D%7Covercloud-deploy%20:%20Deploy%20the%20overcloud | 06:04 |
| *** akrivoka has joined #tripleo | 06:05 | |
| * chandankumar is still trying to recover from 5 days long pycon india 2018 conference | 06:05 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797167 | 06:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 06:10 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 06:10 |
| chandankumar | marios: hello | 06:11 |
| chandankumar | marios: https://bugs.launchpad.net/tripleo/+bug/1796710 I think we can remove alert from this bug As I am not seeing in CI just one time failure | 06:11 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 06:11 |
| *** morazi has quit IRC | 06:18 | |
| *** apetrich has quit IRC | 06:20 | |
| marios|rover | looking chandankumar | 06:22 |
| *** mschuppert has joined #tripleo | 06:23 | |
| *** shyamb has quit IRC | 06:24 | |
| marios|rover | chandankumar: indeed via cistatus.tripleo it looks green all of yesterday | 06:24 |
| marios|rover | chandankumar: updated the bug... wondering about https://review.openstack.org/#/c/608723 then. perhaps we don't need it looks like | 06:27 |
| chandankumar | marios|rover: I think the above review is not needed | 06:28 |
| marios|rover | chandankumar: yeah i set workflow -1 on it just now | 06:28 |
| marios|rover | thanks chandankumar | 06:29 |
| *** jrist has joined #tripleo | 06:33 | |
| *** janki has quit IRC | 06:34 | |
| *** jchhatba_ has joined #tripleo | 06:35 | |
| *** numans has quit IRC | 06:39 | |
| *** apetrich has joined #tripleo | 06:43 | |
| *** aufi has joined #tripleo | 06:45 | |
| *** mburned_out is now known as mburned | 06:46 | |
| *** jchhatba_ has quit IRC | 06:46 | |
| *** iurygregory has joined #tripleo | 06:46 | |
| *** janki has joined #tripleo | 06:47 | |
| *** dalvarez has quit IRC | 06:49 | |
| *** amoralej has quit IRC | 06:49 | |
| *** slaweq has joined #tripleo | 06:50 | |
| *** shyamb has joined #tripleo | 06:50 | |
| *** aufi has quit IRC | 06:52 | |
| *** radez has quit IRC | 06:52 | |
| *** kopecmartin has joined #tripleo | 06:52 | |
| *** aufi has joined #tripleo | 06:53 | |
| *** aufi has quit IRC | 06:54 | |
| *** rcernin has quit IRC | 07:01 | |
| *** slaweq has quit IRC | 07:03 | |
| *** slaweq has joined #tripleo | 07:05 | |
| quiquell | Puff puppet- projects CI is a little instable | 07:05 |
| jaosorior | marios|rover: https://review.openstack.org/608589 is in the gate. still some time to go as there's abunch of tripleo-ui patches in front | 07:06 |
| jaosorior | and a couple of t-h-t patches | 07:06 |
| quiquell | jaosorior: naif question, why we have only one queue for all those projects ? | 07:06 |
| *** shardy has joined #tripleo | 07:06 | |
| marios|rover | jaosorior: ack thanks | 07:06 |
| quiquell | jaosorior: Could be possible to have multiple queues like we have with puppet- projects ? | 07:06 |
| jaosorior | quiquell: maybe :D I have no idea how that stuff works | 07:07 |
| jaosorior | but it would be good to ask | 07:07 |
| *** jfrancoa has joined #tripleo | 07:07 | |
| iurygregory | good morning | 07:08 |
| quiquell | jaosorior: Who can know it ? | 07:08 |
| quiquell | iurygregory: o/ | 07:08 |
| jaosorior | asking, I guess :D | 07:08 |
| jaosorior | gotta ask the infra folks | 07:08 |
| jaosorior | iurygregory: welcome! | 07:08 |
| quiquell | iurygregory: puppet- ci is a little instable ? | 07:08 |
| iurygregory | jaosorior, tks o/ | 07:09 |
| iurygregory | quiquell, maybe i would say, wich patch ? | 07:09 |
| *** jrist has quit IRC | 07:09 | |
| quiquell | iurygregory: It's kind of noop change https://review.openstack.org/#/c/609300/Ã | 07:10 |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797167 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 07:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 07:10 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 07:10 |
| *** udesale has quit IRC | 07:12 | |
| *** udesale has joined #tripleo | 07:13 | |
| quiquell | marios|rover: ssl patch has infra issues now :-( http://logs.openstack.org/89/608589/5/check/tripleo-ci-centos-7-standalone/7299cae/logs/undercloud/home/zuul/install_packages.sh.log.txt.gz | 07:14 |
| *** udesale has quit IRC | 07:15 | |
| *** ssbarnea has joined #tripleo | 07:17 | |
| marios|rover | kopecmartin: o/ removed the alert/promotion-blocker at https://bugs.launchpad.net/tripleo/+bug/1797167 see comment #2 looks like it was isolated | 07:18 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 07:18 |
| marios|rover | quiquell: :/ | 07:21 |
| *** rdopiera has joined #tripleo | 07:25 | |
| *** kopecmartin is now known as kopecmartin|ruck | 07:26 | |
| kopecmartin|ruck | marios|rover, ok, thanks | 07:27 |
| *** huynq has joined #tripleo | 07:30 | |
| *** errr has joined #tripleo | 07:31 | |
| *** ssbarn___ has joined #tripleo | 07:33 | |
| quiquell | jaosorior: Looks like what makes Depends-On works out of the box for tripleo, if you have different queues you have to wait untill dependencies are merged | 07:33 |
| Tengu | chandankumar: btw, is your patch for tempest in container working now? | 07:34 |
| jaosorior | quiquell: oh, got it | 07:34 |
| quiquell | jaosorior: But maybe we prefer to add a little manual to not break gates so often ? | 07:34 |
| quiquell | jaosorior: Puff don't know | 07:35 |
| jaosorior | quiquell: I suggest you send a mail and bring it up to the wider community | 07:35 |
| quiquell | jaosorior: openstack-dev ? | 07:35 |
| jaosorior | yeah | 07:36 |
| *** shyamb has quit IRC | 07:43 | |
| *** yolanda has joined #tripleo | 07:44 | |
| yolanda | hi, good morning... i have a problem with a pair of patches, going on for some time. They don't pass RDO third party ci | 07:44 |
| yolanda | is there some problem? | 07:44 |
| jaosorior | yolanda: yes, there is currently, but it's being fixed | 07:46 |
| yolanda | ok jaosorior , do you have some estimate? this patch is important for us as the images are not working | 07:49 |
| yolanda | and thx for feedback! | 07:50 |
| *** kopecmartin|ruck has quit IRC | 07:51 | |
| *** udesale has joined #tripleo | 07:51 | |
| *** fhubik has joined #tripleo | 07:57 | |
| jaosorior | marios|rover: have all the issues with ovb been sorted out? is the TLS fix the last one needed? | 07:58 |
| *** jpich has joined #tripleo | 07:59 | |
| huynq | hi.. i'm new in tripleo. I'm tracking the status of Undercloud OS upgrade from https://etherpad.openstack.org/p/tripleo-upgrade-squad-status | 08:00 |
| jaosorior | huynq: OpenStack upgrade or Operating System upgrade? | 08:00 |
| huynq | I do not see any change from Sep 25. How's it going? | 08:00 |
| marios|rover | jaosorior: should be or at least all known issues... latest run reported at cistatus for tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master | 08:01 |
| jaosorior | marios|rover: crap... it timed out :( | 08:01 |
| *** kopecmartin has joined #tripleo | 08:01 | |
| *** kopecmartin is now known as kopecmartin|ruck | 08:01 | |
| marios|rover | jaosorior: is the ara issue http://logs.rdoproject.org/00/605200/7/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/38659d4/logs/undercloud/home/zuul/install-undercloud.log.txt.gz but that is from 2 days ago | 08:01 |
| jaosorior | marios|rover: but we disabled ara already, right? | 08:02 |
| chandankumar | Tengu: fixed some path issue | 08:02 |
| huynq | jaosorior: Operating System upgrade | 08:02 |
| marios|rover | jaosorior: right it https://bugs.launchpad.net/tripleo/+bug/1796764 and https://review.openstack.org/#/c/606986/ for that trace ^^ but the trace is from 9th | 08:02 |
| openstack | Launchpad bug 1796764 in tripleo "undercloud install failing for containers-multinode in the gate "OperationalError: (sqlite3.OperationalError) database is locked "" [Critical,Fix released] | 08:02 |
| *** amoralej has joined #tripleo | 08:04 | |
| *** cylopez has joined #tripleo | 08:05 | |
| Tengu | chandankumar: saw that. lemme know if you have issues :) | 08:08 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 08:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 08:10 |
| *** skramaja has joined #tripleo | 08:11 | |
| *** ssbarnea has quit IRC | 08:13 | |
| *** bogdando has joined #tripleo | 08:14 | |
| *** kopecmartin has joined #tripleo | 08:14 | |
| *** kopecmartin|ruck has quit IRC | 08:15 | |
| *** kopecmartin is now known as kopecmartin|ruck | 08:15 | |
| chandankumar | Tengu: I need to rewrite the container script part | 08:16 |
| chandankumar | Tengu: I am tired of workaround | 08:16 |
| Tengu | :) | 08:16 |
| Tengu | chandankumar: may I help? | 08:16 |
| chandankumar | Tengu: nana, I will update my script and let you know, but help will be needed | 08:17 |
| Tengu | chandankumar: just ping me ;) | 08:17 |
| *** cylopez has left #tripleo | 08:21 | |
| *** fhubik has left #tripleo | 08:21 | |
| *** huynq has quit IRC | 08:23 | |
| *** huynq has joined #tripleo | 08:24 | |
| *** huynq_ has joined #tripleo | 08:25 | |
| *** huynq_ has quit IRC | 08:25 | |
| *** shyamb has joined #tripleo | 08:27 | |
| *** huynq has left #tripleo | 08:28 | |
| Tengu | hmmm. | 08:29 |
| Tengu | I'm pretty sure I'll get some post_failure in the CI..... | 08:29 |
| Tengu | or timeout. | 08:29 |
| Tengu | quiquell: you were talking about time out increasing a bit earlier? | 08:29 |
| quiquell | Tengu: nah forget about it, I was not filtering by failing jobs | 08:30 |
| Tengu | ah, ok. | 08:30 |
| Tengu | well.... | 08:30 |
| *** huynq has joined #tripleo | 08:31 | |
| Tengu | ah. one last test to finish - might succeed in the end. | 08:36 |
| Tengu | \o/ | 08:36 |
| Tengu | fu... time_out | 08:37 |
| jaosorior | :( | 08:37 |
| * Tengu wants his patch for Standalone, Podman and SELinux | 08:39 | |
| *** derekh has joined #tripleo | 08:42 | |
| *** dciabrin has joined #tripleo | 08:43 | |
| *** dtantsur|afk is now known as dtantsur| | 08:44 | |
| *** dtantsur| is now known as dtantsur | 08:44 | |
| *** ssbarnea has joined #tripleo | 08:49 | |
| huynq | jaosorior: Could you give me some information or related references? | 08:52 |
| *** ssbarnea has quit IRC | 08:56 | |
| mandre | shardy: regarding your comment on https://review.openstack.org/#/c/609614/, why to stable/queens first? this is for rocky | 08:58 |
| shardy | mandre: ah sorry -enocoffee moment, will fix | 09:02 |
| *** panda is now known as panda|mtg | 09:05 | |
| *** ykarel_ has joined #tripleo | 09:06 | |
| mandre | shardy: haha no worries, thanks for the review! Do we really mandate related bugs in the commit message for the backports? | 09:06 |
| *** tosky has joined #tripleo | 09:06 | |
| shardy | mandre: we generally try to ref stable branch policy but I'm not blocking on it | 09:06 |
| * mandre should create more bugs | 09:07 | |
| *** ykarel_ is now known as ykarel|lunch | 09:07 | |
| shardy | helps keep track of things that were backported for each point release, and ensures stealth features don't get backpoted ;) | 09:07 |
| mandre | I mean more bugs in launchpad, not in the code :) | 09:07 |
| shardy | in this case we know it's all backports to make things functional | 09:07 |
| shardy | lol :D | 09:07 |
| shardy | mandre: question re https://review.openstack.org/#/c/605127/ - are we sure that would never be desired? | 09:08 |
| *** ssbarn___ has quit IRC | 09:08 | |
| shardy | punting disk cleanup to operators unconditionally seems kind of unhelpful, particularly since it'll potentially break repeated test deployments? | 09:08 |
| shardy | or do we expect ironic cleaning to clean secondary disks etc? | 09:08 |
| *** ykarel has quit IRC | 09:08 | |
| mandre | shardy: I think we expect the operators to use openshift-ansible to clean the disks prior to the deployment | 09:09 |
| mandre | there is a playbook for that | 09:09 |
| shardy | mandre: hmm really? I expected the openshift-ansible stuff to be more under the hood | 09:09 |
| shardy | e.g imagine the demo with UI etc, but no, you have to run this bunch of CLI commands first! | 09:10 |
| shardy | etc | 09:10 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 09:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 09:10 |
| shardy | mandre: not blocking but I was kinda surprised as IIRC that was needed for local redeploys | 09:10 |
| shardy | maybe we could conditionally run the osa cleanup playbook instead? | 09:11 |
| *** kopecmartin has joined #tripleo | 09:12 | |
| *** jistr is now known as jistr|call | 09:12 | |
| mandre | shardy: hmmm IIRC the cleanup step for osa is part of their "undeploy" playbook, if you pass the option to clean the disk | 09:13 |
| mandre | shardy: we could run undeploy playbook prior to re-deploying openshift bug that seems like a bit overkill to me | 09:15 |
| mandre | idk | 09:15 |
| shardy | mandre: ack - trying to remember the details but IIRC the reason we added that was because deploy, then stack delete, then deploy again failed e.g on quickstart nodes and I guess baremetal as well | 09:15 |
| shardy | flaper87: may have more details but I'm just trying to ensure this doesn't make the user/developer experience worse | 09:16 |
| *** ssbarnea has joined #tripleo | 09:20 | |
| *** gkadam has quit IRC | 09:25 | |
| mandre | shardy: it does make the developer experience worse... personally I'm reverting the patch in my environment :-/ | 09:25 |
| mandre | so I suppose it's a good reason to make it optional | 09:25 |
| shardy | mandre: Ok cool, perhaps we can just add a conditional then? | 09:28 |
| *** salmankhan has joined #tripleo | 09:28 | |
| shardy | I also wonder if it's really safer, e.g we're about to give the disks to gluster which will presumably write all over them | 09:29 |
| shardy | so cleaning things first doesn't seem *that* unreasonable to me ;) | 09:29 |
| shardy | maybe we can have a YesTrashMyDisksPlease: true parameter :) | 09:30 |
| bogdando | weshay, therve, d0ugal: https://bugs.launchpad.net/tripleo/+bug/1789680/comments/23 | 09:30 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 09:30 |
| *** shyamb has quit IRC | 09:34 | |
| *** shyamb has joined #tripleo | 09:34 | |
| d0ugal | bogdando: looking | 09:35 |
| kopecmartin|ruck | marios|rover, sorry if I missed that, is this reported somewhere? https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset050-upgrades-master/debcdb2/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-09_18_46_19 | 09:37 |
| *** mburned is now known as mburned_out | 09:38 | |
| *** shyamb has quit IRC | 09:39 | |
| d0ugal | bogdando: sounds good, fingers crossed it fixes it :) | 09:40 |
| marios|rover | kopecmartin|ruck: nope not seen that one | 09:42 |
| *** shyamb has joined #tripleo | 09:42 | |
| kopecmartin|ruck | marios|rover, hm, but if i get the config right, the job is not part of promotion for master | 09:43 |
| *** jtomasek has joined #tripleo | 09:46 | |
| *** kopecmartin|ruck has quit IRC | 09:47 | |
| *** hjensas has joined #tripleo | 09:47 | |
| *** kopecmartin is now known as kopecmartin|ruck | 09:47 | |
| jaosorior | hjensas: hey, did you ever get novajoin working with config-drive?\ | 09:56 |
| honza | jtomasek: florianf: i approved all the refactor patches related to named exports last night because i thought it would put undue stress on jirka to have to rebase everything if we found a nit sommewhere in the middle | 09:56 |
| honza | jtomasek: florianf: we can fix any issues in follow up patches | 09:57 |
| jtomasek | honza: thanks, that moves things forward a lot | 09:58 |
| *** skramaja has quit IRC | 09:58 | |
| *** skramaja_ has joined #tripleo | 09:58 | |
| mandre | shardy: what do you think should be the default for cleaning disks? do it or not? | 09:59 |
| jtomasek | honza: and I'll rebase the last one | 09:59 |
| shardy | mandre: I guess a safer default is not to do it, what was the motivation behind removing the tasks - did we get some feedback on that? | 10:02 |
| shardy | but like I said it's kind of strange since they're about to be written on by gluster so ^o^ | 10:03 |
| quiquell | iurygregory: Do you know why this is failing https://review.openstack.org/#/c/609300/ ? | 10:03 |
| shardy | perhaps this should really be an osa variable vs something we do in t-h-t | 10:04 |
| quiquell | iurygregory: Feels to me totally unrelated | 10:04 |
| iurygregory | quiquell, let me take a look | 10:04 |
| mandre | shardy: the current implementation is broken and I was about to "fix" it with a dmsetup remove_all, when said to myself "wait a minute, this is not right" | 10:04 |
| quiquell | iurygregory: verified passed, gate failed | 10:05 |
| quiquell | iurygregory: going to recheck | 10:05 |
| mandre | shardy: asked flaper87 about it who was under the same impression that wiping the disks was only convenience we made for the demo | 10:05 |
| iurygregory | quiquell, also the past failure was in integration-4-scenario004-tempest-centos-7-mimic i think | 10:05 |
| shardy | mandre: ack, well it seems like something useful outside the context of the demo to me, it's not like nobody else ever reuses hardware :) | 10:06 |
| shardy | but perhaps it should be something handled via the cns support in osa instead? | 10:07 |
| florianf | honza: thanks! | 10:08 |
| flaper87 | mandre: shardy yeah, for the demos and dev. Just cleaning and re-creating the disks every time is painful | 10:09 |
| mandre | shardy: yeah... it would be more useful to make the disk wiping optionally part of the cns install playbook (and not just uninstall) in osa | 10:09 |
| flaper87 | I'm not a fan of wiping disks ourselves, if we can move this somewhere else, that'd be awesome | 10:09 |
| mandre | then we can stop implementing it badly and we'll just have to pass a variable | 10:09 |
| flaper87 | but definitely not something we should have in the main templates | 10:09 |
| shardy | Ok sounds like a plan | 10:09 |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 10:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 10:10 |
| *** gouthamr has quit IRC | 10:14 | |
| *** stevebaker has quit IRC | 10:16 | |
| *** dmellado has quit IRC | 10:17 | |
| *** ykarel|lunch is now known as ykarel | 10:19 | |
| hjensas | jaosorior: yes | 10:19 |
| *** akrivoka has quit IRC | 10:19 | |
| *** akrivoka has joined #tripleo | 10:20 | |
| hjensas | jaosorior: with the caching fix that was merged yesterday + https://review.openstack.org/607492 I made several deployments 1 ctrl+1 cmp where nodes successfully enrolled to FreeIPA | 10:20 |
| jaosorior | hjensas: OK, I'll review your config-drive patch today. thanks! | 10:22 |
| hjensas | jaosorior: Thanks! btw, owalsh made some comments on it, wanting to move to python only etc. I agree with him, but I think that a follow up doing that would be better. | 10:24 |
| *** salmankhan has quit IRC | 10:24 | |
| *** salmankhan has joined #tripleo | 10:32 | |
| *** shyamb has quit IRC | 10:35 | |
| jaosorior | yeah | 10:44 |
| jaosorior | lets do that on a follow up instead | 10:44 |
| *** sshnaidm|afk has joined #tripleo | 10:45 | |
| *** jistr|call is now known as jistr | 11:00 | |
| *** roger2 has joined #tripleo | 11:00 | |
| *** shyamb has joined #tripleo | 11:01 | |
| *** sshnaidm|afk is now known as sshnaidm | 11:02 | |
| *** holser_ has joined #tripleo | 11:03 | |
| roger2 | I successfully got tripleo to deploy the rocky release of undercloud on a baremetal server. Then I followed instructions (https://blogs.rdoproject.org/2018/05/running-tempest-tests-against-a-tripleo-undercloud/) to run tempest tests against the undercloud. I was surprised to see "Failure 122 Skip 62". Is so much failure normal for containerized? | 11:04 |
| jaosorior | roger2: it isn't. What errors are you getting? | 11:05 |
| *** shyamb has quit IRC | 11:06 | |
| chandankumar | sshnaidm: Hello | 11:08 |
| chandankumar | sshnaidm: https://review.openstack.org/#/c/602347/ you mean commit message comment? | 11:08 |
| sshnaidm | chandankumar, I meant comment in code | 11:09 |
| chandankumar | sshnaidm: ah I can update that | 11:09 |
| roger2 | jaosorior: here is the tempest.html I saw: https://drive.google.com/file/d/1Zl1j4LTUsEAsMKsdY9-WfYw1QZh7v3by/view?usp=sharing | 11:10 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 11:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 11:10 |
| jaosorior | chandankumar: does that look familiar? ^^ | 11:10 |
| chandankumar | roger2: which openstack release is used and deployment is done using tripleo-quickstart? | 11:12 |
| chandankumar | roger2: from the error _member_ is not found | 11:12 |
| roger2 | chandankumar: It was rocky release. It was not with quickstart. | 11:12 |
| chandankumar | roger2: one thing you can do that openstack role create _member_ | 11:14 |
| *** shyamb has joined #tripleo | 11:14 | |
| chandankumar | roger2: then re-run the test it will work | 11:14 |
| roger2 | chandankumar: thank you I will do that | 11:14 |
| chandankumar | roger2: by the way we have a detailed guide here https://docs.openstack.org/tripleo-docs/latest/install/basic_deployment/tempest.html | 11:14 |
| chandankumar | roger2: thank you for trying that out from blog :-) | 11:15 |
| roger2 | chandankumar: thank you so much | 11:15 |
| roger2 | yw :) | 11:15 |
| *** ratailor has quit IRC | 11:15 | |
| *** quiquell is now known as quiquell|afk | 11:15 | |
| *** holser_ has quit IRC | 11:15 | |
| *** holser_ has joined #tripleo | 11:17 | |
| *** amoralej is now known as amoralej|lunch | 11:18 | |
| *** roger2 has quit IRC | 11:18 | |
| *** dtantsur is now known as dtantsur|brb | 11:21 | |
| *** rh-jelabarre has joined #tripleo | 11:21 | |
| *** owalsh_away has quit IRC | 11:22 | |
| *** holser_ has quit IRC | 11:25 | |
| *** holser_ has joined #tripleo | 11:25 | |
| *** holser__ has joined #tripleo | 11:26 | |
| *** mburned_out is now known as mburned | 11:27 | |
| *** owalsh has joined #tripleo | 11:28 | |
| *** holser_ has quit IRC | 11:30 | |
| *** morazi has joined #tripleo | 11:34 | |
| *** udesale has quit IRC | 11:39 | |
| *** janki has quit IRC | 11:41 | |
| *** shyamb has quit IRC | 11:45 | |
| *** shyamb has joined #tripleo | 11:45 | |
| *** ramishra has quit IRC | 11:46 | |
| *** holser__ has quit IRC | 11:49 | |
| *** mcornea has joined #tripleo | 11:50 | |
| *** janki has joined #tripleo | 11:51 | |
| weshay | jaosorior, if we don't merge https://review.openstack.org/#/c/608589/ we're never getting a promotion | 11:52 |
| weshay | I've been watching that patch for 48hrs | 11:52 |
| *** cylopez has joined #tripleo | 11:52 | |
| jaosorior | weshay: keeps timing out. Did we disable ARA already? thought that would hlep | 11:53 |
| weshay | jaosorior, timing out? | 11:53 |
| jaosorior | weshay: it was about to merge today and it timed out | 11:53 |
| weshay | dang it did.. | 11:53 |
| weshay | that's the first time I've seen it time out actually | 11:54 |
| weshay | k | 11:54 |
| weshay | ara is disabled | 11:54 |
| jaosorior | and then it was rechecked, and the package installation script failed | 11:54 |
| jaosorior | weshay: http://logs.openstack.org/89/608589/5/check/tripleo-ci-centos-7-containers-multinode/ee2de19/job-output.txt.gz#_2018-10-11_07_06_30_621328 | 11:54 |
| weshay | jaosorior, 2hrs to install the undercloud | 11:56 |
| weshay | :( | 11:56 |
| weshay | omg http://logs.openstack.org/89/608589/5/gate/tripleo-ci-centos-7-containers-multinode/aef1db7/logs/undercloud/home/zuul/install-undercloud.log.txt.gz | 11:57 |
| jaosorior | weshay: a patch to tripleo-common introducing skopeo recently merged. | 11:58 |
| weshay | this is nuts man | 11:59 |
| jaosorior | weshay: https://review.openstack.org/#/c/604664/ | 11:59 |
| jaosorior | and now this https://review.openstack.org/#/c/609586/ might be the next iteration | 11:59 |
| *** abishop has joined #tripleo | 11:59 | |
| *** derekh has quit IRC | 12:00 | |
| jaosorior | uhm... although, judging by the logs, the skopeo output only takes 2 mins | 12:00 |
| jaosorior | so, must be something else | 12:00 |
| weshay | marios|rover, http://logs.openstack.org/89/608589/5/gate/tripleo-ci-centos-7-containers-multinode/aef1db7/logs/undercloud/home/zuul/install-undercloud.log.txt.gz | 12:00 |
| *** derekh has joined #tripleo | 12:00 | |
| *** ramishra has joined #tripleo | 12:01 | |
| *** toure|gone is now known as toure | 12:01 | |
| *** jpena|off has joined #tripleo | 12:02 | |
| jaosorior | nope, all the stuff we do with the images definitely eats up most of the time there | 12:02 |
| *** dprince has joined #tripleo | 12:05 | |
| *** gouthamr has joined #tripleo | 12:05 | |
| *** roger2 has joined #tripleo | 12:06 | |
| weshay | apetrich, any update https://trello.com/c/cVtSh2HC/759-cixbz1628319osp14regressionovercloud-deployment-received-504-gateway-time-out-from-mistral | 12:10 |
| *** dmellado has joined #tripleo | 12:10 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 12:10 |
| *** cylopez has left #tripleo | 12:10 | |
| *** trown|outtypewww is now known as trown | 12:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 12:10 |
| sshnaidm | Tengu, what are reasons for using ansible-runner in tripleo? | 12:11 |
| *** quiquell|afk is now known as quiquell|lunch | 12:11 | |
| Tengu | sshnaidm: what are reasons not to use it? | 12:11 |
| apetrich | weshay, I did a bit of digging yesterday but didn't find anything obvious. I'm trying to spin an env all day but not getting there. | 12:12 |
| Tengu | sshnaidm: more seriously - it will provide a stable interface with ansible and allow to do far more than the subprocess thingy, in a python way. | 12:12 |
| apetrich | weshay, oh wait. that was for another bug | 12:12 |
| Tengu | sshnaidm: like Tower integration if needed later. | 12:12 |
| sshnaidm | Tengu, couldn't you use python interface of ansible directly? | 12:14 |
| Tengu | sshnaidm: nope | 12:14 |
| Tengu | sshnaidm: unstable API interface :(. | 12:14 |
| Tengu | sshnaidm: thought about it, and discussed that as well, apparently ansible-runner is a glue allowing to NOT change the application code in the event the ansible API changes. | 12:14 |
| sshnaidm | Tengu, I see | 12:15 |
| weshay | apetrich, k k.. please update the card w/ that info | 12:15 |
| Tengu | sshnaidm: I was disapointed about that fact, but still, runner seems to be the "right" was to handle it. It's done by the ansible team, so we can expect a nice maintenance and support. | 12:15 |
| Tengu | i.e. it's not a project coming from nowhere. | 12:15 |
| sshnaidm | Tengu, yeah, it's surprising to see another tool to cover disadvantages of original tool.. | 12:16 |
| Tengu | indeed | 12:16 |
| Tengu | but we can understand in some way. | 12:16 |
| Tengu | if the API changes in order to get a faster run or something like that, providing a stable interface with a 3rd party (call it proxy) makes sense. | 12:17 |
| Tengu | that prevents having to change all the calls in end-user apps. well, it should, at least ;). | 12:17 |
| apetrich | thrash, morning! do you know if https://review.openstack.org/#/c/605633/1 was ported downstream? | 12:17 |
| Tengu | sshnaidm: I didn't go further on that topic. When ansible guys tell you "use runner, don't use ansible public API directly", you'd better follow that advice, I think ;) | 12:18 |
| sshnaidm | Tengu, well, it'd b weird that API should change for running something fast :) | 12:18 |
| Tengu | sshnaidm: who knows ;). but indeed. | 12:18 |
| sshnaidm | Tengu, well, ya | 12:18 |
| Tengu | so.. that's the story about integrating ansible-runner. | 12:18 |
| Tengu | and not calling ansible public API directly | 12:18 |
| Tengu | also, runner offers an easier way to interface with Tower iirc | 12:19 |
| Tengu | and that would be of some use, also iirc | 12:19 |
| *** skramaja_ has quit IRC | 12:19 | |
| *** skramaja has joined #tripleo | 12:19 | |
| *** huynq has quit IRC | 12:20 | |
| sshnaidm | Tengu, ok, thanks, more clear now | 12:20 |
| Tengu | no problem :) | 12:20 |
| *** stevebaker has joined #tripleo | 12:22 | |
| *** rh-jelabarre has quit IRC | 12:23 | |
| *** ramishra has quit IRC | 12:26 | |
| *** tzumainn has joined #tripleo | 12:27 | |
| *** lblanchard has joined #tripleo | 12:28 | |
| *** ramishra has joined #tripleo | 12:29 | |
| *** fhubik has joined #tripleo | 12:29 | |
| chandankumar | Tengu: Does standalone does not support cinder volume support? | 12:29 |
| *** fhubik has quit IRC | 12:30 | |
| Tengu | chandankumar: hmm it should, according to https://github.com/openstack/tripleo-heat-templates/blob/master/environments/standalone.yaml#L15-L23 | 12:30 |
| Tengu | at least Cinder is present. | 12:30 |
| weshay | jaosorior, mwhahaha EmilienM it may make sense to discuss wtf we're doing for 2+ weeks w/o healthy ovb tests | 12:30 |
| *** rlandy has joined #tripleo | 12:32 | |
| jaosorior | weshay: there is no way to make them voting as it's third party CI, right? | 12:33 |
| *** lblanchard has quit IRC | 12:35 | |
| fungi | jaosorior: third-party ci systems can certainly vote. you just need to make sure the acl for the projects is set to allow verified -1..+1 for a group you put the accounts of your ci systems in | 12:43 |
| fungi | there are tons of third-party ci systems voting on changes at review.openstack.org | 12:44 |
| fungi | https://review.openstack.org/#/admin/groups/tripleo-ci | 12:45 |
| *** ansmith has joined #tripleo | 12:46 | |
| fungi | the "RDO Third Party CI" can currently vote on any projects which allow verified -1..+1 from that group | 12:46 |
| *** quiquell|lunch is now known as quiquell | 12:47 | |
| fungi | for example, looks like it voted verified +1 on https://review.openstack.org/609678 and another third-party ci system (SUSE CI) voted verified -1 | 12:48 |
| *** amoralej|lunch is now known as amoralej | 12:54 | |
| *** janki has quit IRC | 13:00 | |
| weshay | jaosorior, there is.. but so far the we want to see a more stable env.. like not rdo-cloud | 13:01 |
| *** shyamb has quit IRC | 13:01 | |
| weshay | rlandy, | 13:01 |
| *** sai_p has joined #tripleo | 13:04 | |
| *** ykarel has quit IRC | 13:05 | |
| *** ykarel has joined #tripleo | 13:05 | |
| *** holser_ has joined #tripleo | 13:09 | |
| *** holser_ has quit IRC | 13:09 | |
| *** holser_ has joined #tripleo | 13:10 | |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 13:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 13:10 |
| *** holser_ has quit IRC | 13:10 | |
| *** dmacpher_ has quit IRC | 13:11 | |
| *** holser_ has joined #tripleo | 13:11 | |
| *** holser__ has joined #tripleo | 13:12 | |
| *** dmacpher has joined #tripleo | 13:12 | |
| *** holser_ has quit IRC | 13:13 | |
| *** holser_ has joined #tripleo | 13:13 | |
| *** dtantsur|brb is now known as dtantsur | 13:15 | |
| *** holser__ has quit IRC | 13:16 | |
| *** ansmith has quit IRC | 13:16 | |
| trown | shardy: flaper87 could either of you help review patches in https://etherpad.openstack.org/p/tripleo-openshift-patches we really need to get that list trimmed down while CI is green(ish) | 13:19 |
| mwhahaha | weshay: that would be smart why would we do that | 13:22 |
| *** vinaykns has joined #tripleo | 13:22 | |
| *** ansmith has joined #tripleo | 13:24 | |
| *** mjturek has joined #tripleo | 13:25 | |
| shardy | trown: ack will do, started this morning but will revisit now | 13:25 |
| *** udesale has joined #tripleo | 13:28 | |
| *** dtrainor_ has quit IRC | 13:30 | |
| *** holser_ has quit IRC | 13:32 | |
| *** dtrainor has joined #tripleo | 13:33 | |
| *** jrist has joined #tripleo | 13:33 | |
| beagles | anybody know where the ::uuid fact is configured? I'm getting a "Warning: Unknown variable: '::uuid'. at /etc/puppet/modules/tripleo/manif | 13:35 |
| beagles | ests/profile/base/database/mysql/client.pp:85:8", | 13:36 |
| beagles | error when deploying undercloud | 13:36 |
| *** skramaja has quit IRC | 13:36 | |
| *** skramaja_ has joined #tripleo | 13:37 | |
| *** psachin has quit IRC | 13:38 | |
| marios | mwhahaha: EmilienM did i see an email/review from either of you this morning about the 3 node job or am i making it up | 13:39 |
| roger2 | I'm trying to remove 'rocky' so I can deploy 'queens' since 'rocky' isn't working. I ran "set -x ; sudo yum -y remove python-tripleoclient ceph-ansible ; sudo -E tripleo-repos -b queens current ceph ; sudo yum clean all ; sudo rm -rf /var/cache/yum ; sudo yum -y install python-tripleoclient ceph-ansible ; set +x". But now if I do "openstack tripleo container image prepare default --local-push-destination --output-env-file ~/containe | 13:39 |
| roger2 | ...it returns error saying it "is not an openstack command." Please advise. | 13:39 |
| mwhahaha | marios: we removed it? | 13:40 |
| shardy | roger2: python-tripleoclient provides that openstackclient plugin, and you removed it | 13:41 |
| roger2 | shardy: I removed rocky version and then tried to install queens version | 13:41 |
| shardy | roger2: ah the command is openstack overcloud image prepare... | 13:42 |
| *** mjturek has quit IRC | 13:42 | |
| shardy | sorry sec | 13:43 |
| shardy | openstack overcloud container image prepare | 13:43 |
| marios | mwhahaha: ack (I know that :)) i was looking for the email/review in my inbox couldn't find it k thanks | 13:44 |
| *** mjturek has joined #tripleo | 13:45 | |
| mwhahaha | marios: i think it all merged let me check | 13:46 |
| marios | mwhahaha: so in http://cistatus.tripleo.org/ it last ran last night so... | 13:47 |
| mwhahaha | marios: queens is in the gate, https://review.openstack.org/#/c/608324/ | 13:47 |
| marios | mwhahaha: thanks | 13:47 |
| marios|rover | kopecmartin|ruck: weshay so we can close this one out https://bugs.launchpad.net/tripleo/+bug/1786520 though its a valid bug the job no longer exists :) | 13:49 |
| openstack | Launchpad bug 1786520 in tripleo "3node jobs failing due to missing file UpgradeInitDeployment" [Critical,Triaged] | 13:49 |
| roger2 | shardy: thank you. I'm making progress, but the arguments seem different with older command. Is this fine to create local push registry? "openstack overcloud container image prepare --output-env-file ~/containers-prepare-parameter.yaml" | 13:50 |
| marios|rover | kopecmartin|ruck: i was looking into it yesterday http://logs.openstack.org/33/605033/3/check/tripleo-ci-centos-7-3nodes-multinode/f3ca3e2/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-10_08_19_41 it is/was still happening but anyway gonna comment and close the bug | 13:50 |
| weshay | marios|rover, thanks | 13:52 |
| kopecmartin|ruck | marios|rover, ok, thanks | 13:52 |
| marios|rover | weshay: mwhahaha https://review.openstack.org/#/c/609708/ | 13:53 |
| marios|rover | weshay: ah we still have it for tq | 13:54 |
| jaosorior | marios|rover: seems it needs to be removed from somewhere else too: Job tripleo-ci-centos-7-3nodes-multinode not defined | 13:54 |
| marios|rover | jaosorior: thanks posting | 13:56 |
| shardy | roger2: I think containers-prepare-parameter.yaml is the input -e option, https://review.openstack.org/#/c/599462/ may help as it shows the diff between the old/new commands | 13:56 |
| *** Vorrtex has joined #tripleo | 13:56 | |
| trown | mandre: any interest in looking at a 3.11 deploy today? I have an environment redeploying now with manually built 3.11 packages ... I was looking at it yesterday and it seems to fail because of an SSL issue | 13:56 |
| *** skramaja_ has quit IRC | 13:56 | |
| shardy | roger2: it was mentioned recently that we should probably include those details as stable branch annotations in the docs but that's not yet happened unfortunately | 13:57 |
| marios|rover | weshay: jaosorior mwhahaha: https://review.openstack.org/#/c/609710/ | 13:57 |
| weshay | jaosorior, mwhahaha fyi.. imho once https://review.openstack.org/608589 get's back into the gate queue we should prioritize and then pray | 13:58 |
| marios|rover | jaosorior: will update that other review too thanks for checking it | 13:59 |
| jaosorior | weshay: agreed. | 13:59 |
| *** quiquell is now known as quiquell|off | 13:59 | |
| *** mjturek has quit IRC | 14:00 | |
| marios|rover | jaosorior: oh i think the depends on should do it at least i cant see something else than needs removing at https://review.openstack.org/#/c/609708/2 | 14:02 |
| mandre | trown: yeah me too would like to know how bad/easy it is to switch to 3.11, this is something mfedosin started looking into | 14:02 |
| *** ssbarne__ has joined #tripleo | 14:03 | |
| marios|rover | weshay: haha 'fix released' | 14:04 |
| weshay | lol | 14:05 |
| weshay | f it | 14:05 |
| *** rh-jelabarre has joined #tripleo | 14:06 | |
| *** mjturek has joined #tripleo | 14:07 | |
| roger2 | shardy: thx for your help. unfortunately undercloud deploy failed anyway, "(os-refresh-config) [ERROR] during configure phase. [Command '['dib-run-parts', '/usr/libexec/os-refresh-config/configure.d']' returned non-zero exit status 1]". So I think I will reinstall fresh CentOS and start over. | 14:09 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 14:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 14:10 |
| *** panda|mtg has quit IRC | 14:12 | |
| *** lblanchard has joined #tripleo | 14:14 | |
| *** panda has joined #tripleo | 14:14 | |
| *** jrist has quit IRC | 14:20 | |
| *** artom has quit IRC | 14:27 | |
| weshay | ssbarnea, where is your patch to handle python virtenv across python2.7/3 | 14:32 |
| *** mcornea_ has joined #tripleo | 14:33 | |
| *** cylopez has joined #tripleo | 14:34 | |
| vinaykns | hello channel...need review for https://review.openstack.org/#/c/600843/ & https://review.rdoproject.org/r/#/c/16848/ | 14:34 |
| *** mcornea has quit IRC | 14:35 | |
| *** jtomasek has quit IRC | 14:36 | |
| *** lblanchard has quit IRC | 14:36 | |
| *** artom has joined #tripleo | 14:42 | |
| weshay | jaosorior, mwhahaha failed in check | 14:43 |
| mwhahaha | what did | 14:43 |
| weshay | https://review.openstack.org/608589 | 14:44 |
| weshay | http://logs.openstack.org/89/608589/5/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/317ee0f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-11_13_58_40 | 14:44 |
| weshay | dam it | 14:44 |
| weshay | d0ugal, toure ^ | 14:44 |
| d0ugal | weshay: Looking. | 14:45 |
| * toure looks | 14:46 | |
| weshay | toure, do we just need to bypass the promotion and get the latest client in current-tripleo? | 14:47 |
| weshay | or is this a legit timeout and we have some infra issue? | 14:47 |
| weshay | bogdando, had an update on that bug | 14:47 |
| * toure digging through logs | 14:48 | |
| bogdando | what bug | 14:48 |
| weshay | https://bugs.launchpad.net/tripleo/+bug/1789680/comments/23 | 14:48 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 14:48 |
| weshay | bogdando, you think that timeout is caused by a sighup? | 14:48 |
| weshay | marios|rover, fyi ^ | 14:49 |
| mwhahaha | no we reverted that code | 14:51 |
| marios | weshay: ack | 14:51 |
| mwhahaha | and that was in puppet-tripleo so it should be in place | 14:51 |
| *** cylopez has left #tripleo | 14:52 | |
| bogdando | weshay: aye | 14:55 |
| bogdando | mwhahaha: waat | 14:56 |
| bogdando | we did not | 14:56 |
| bogdando | it was only merged this night | 14:56 |
| toure | weshay this isn't the bug I fixed | 14:56 |
| toure | this is a timeout issue | 14:56 |
| mwhahaha | bogdando: we revered the sighup stuff didn't we? | 14:56 |
| bogdando | the copytruncate fallback, should fix those mistrals failing | 14:56 |
| bogdando | mwhahaha: ah, yes, but I basically put all links in that comment | 14:56 |
| bogdando | https://bugs.launchpad.net/tripleo/+bug/1789680/comments/23 | 14:57 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 14:57 |
| d0ugal | weshay, toure: I am seeing some strange swift errors I've not seen before... | 14:58 |
| *** ramishra has quit IRC | 14:58 | |
| d0ugal | weshay, toure: Couple of odd tracebacks in here: http://logs.openstack.org/89/608589/5/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/317ee0f/logs/undercloud/var/log/containers/mistral/executor.log.1.gz | 14:58 |
| toure | d0ugal yeah I have seen those, I originally thought there was a network latency issue | 14:59 |
| d0ugal | and in the swift logs... http://logs.openstack.org/89/608589/5/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/317ee0f/logs/undercloud/var/log/containers/swift/swift.log.txt.gz#_Oct_11_12_58_41 | 14:59 |
| *** openstackgerrit has joined #tripleo | 14:59 | |
| d0ugal | Oct 11 12:58:41 undercloud proxy-server: ERROR with Object server 192.168.24.1:6000/d1 re: Trying to get final status of PUT to /v1/AUTH_0366a5269e6c449e9837b4ffaae17fa5/overcloud-messages/tripleo.deployment.v1.config_download_deploy/2018-10-11_12%3A57%3A04.yaml: Timeout (60.0s) (txn: tx2f17ed392da640f18e432-005bbf48a0) | 14:59 |
| d0ugal | Oct 11 12:58:41 undercloud proxy-server: Object PUT returning 503 for [503] (txn: tx2f17ed392da640f18e432-005bbf48a0) (client_ip: 192.168.24.1) | 14:59 |
| weshay | d0ugal, not sure if it's related exactly, but fyi https://trello.com/c/0EO9OsKh/775-cixlp1797167tripleociproa-swift-timeout-during-undercloud-deploy | 15:00 |
| d0ugal | weshay: Yeah, that is the timeout I spotted yesterday (was it yesterday?) - I think this is different | 15:00 |
| weshay | k | 15:00 |
| d0ugal | I'm not sure what the error in the swift log means | 15:00 |
| toure | d0ugal it does state that there was a timeout hit | 15:02 |
| toure | http://logs.openstack.org/89/608589/5/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/317ee0f/logs/undercloud/var/log/containers/swift/swift.log.txt.gz#_Oct_11_12_58_41 | 15:02 |
| d0ugal | toure: oh, I thought it looked different when I seen the timeout yesterday | 15:03 |
| d0ugal | but you could well be correct, I'm not very familiar with swift logs | 15:04 |
| apetrich | d0ugal, toure Object replication complete. (1.64 minutes) seems a bit excessive | 15:04 |
| *** artom has quit IRC | 15:04 | |
| toure | d0ugal I am digging through the swift code base to see where that timeout lives | 15:04 |
| d0ugal | toure: ah, I see it is the same now | 15:05 |
| d0ugal | weshay: so yeah, this is the same as the error I found before | 15:05 |
| toure | ah | 15:05 |
| toure | so we hit the 6mins mark | 15:05 |
| weshay | why though? | 15:06 |
| *** ssbarne__ has quit IRC | 15:07 | |
| openstackgerrit | Michael Bayer proposed openstack/puppet-tripleo master: Implement Global Galera database https://review.openstack.org/609734 | 15:07 |
| d0ugal | toure: I thought it was quicker. Where do you see that? | 15:08 |
| toure | d0ugal sorry yeah it looks like 98s | 15:08 |
| toure | or somewhere around that | 15:08 |
| d0ugal | toure: also, note the end of the message "Timed out waiting for messages from Execution (ID: c5cee15a-93da-41b3-87f9-02d914ddba0a, State: ERROR). The Workflow errored and no messages were received." | 15:08 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Update docs for building libvirt images modes https://review.openstack.org/609737 | 15:08 |
| chandankumar | tbarron: Hello | 15:09 |
| openstackgerrit | Michael Bayer proposed openstack/tripleo-specs master: Global Galera Database https://review.openstack.org/600555 | 15:09 |
| tbarron | chandankumar: running upstream manila community meeting atm | 15:09 |
| tbarron | chandankumar: but go ahead, I just may be slow | 15:09 |
| d0ugal | toure: That means it gave up waiting, and then checked the API for the execution status. so it failed before the client timeout | 15:09 |
| toure | d0ugal right | 15:09 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 15:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 15:10 |
| trown | mandre: I have an 3.11 env up if you want to take a look | 15:11 |
| chandankumar | tbarron: regarding this review https://review.openstack.org/#/c/609550/ -> currently we are keeping manila related tempest config in featureset (which is used generally in ci), In order to genertae tempest.conf we have a tool python-tempestconf can we all the required code in the tool itself so that other people can get benefitted and generate tmepest.conf easily for manila and run manila tempest tests | 15:11 |
| *** artom has joined #tripleo | 15:11 | |
| gouthamr | agreed chandankumar, but i don't want to yank out the tests right away | 15:11 |
| gouthamr | i.e, can they keep running while we address the tempestconf? | 15:12 |
| chandankumar | gouthamr: since we are going to unskip the tests, we need to copy manila tempest conf on fs020 and fs021 side | 15:13 |
| chandankumar | gouthamr: as there it will also get triggered | 15:13 |
| gouthamr | chandankumar: manila isn't deployed in those featuresets | 15:13 |
| *** sai_p has quit IRC | 15:13 | |
| chandankumar | weshay: ^^ | 15:13 |
| gouthamr | chandankumar: but you're saying the plugin is installed? | 15:13 |
| openstackgerrit | Michael Bayer proposed openstack/tripleo-heat-templates master: Implement Global Galera database https://review.openstack.org/609738 | 15:14 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates master: Add sample designate environment for ha https://review.openstack.org/584026 | 15:15 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates master: Split designate envs https://review.openstack.org/584532 | 15:15 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates master: Add /v2 suffix to Designate uris https://review.openstack.org/585882 | 15:15 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates master: Set correct project name for designate-neutron integration https://review.openstack.org/585902 | 15:15 |
| chandankumar | gouthamr: we are using tempest container to run tempest tests | 15:15 |
| *** artom has quit IRC | 15:16 | |
| weshay | chandankumar, gouthamr manila is scenario04 or fs019 | 15:16 |
| chandankumar | in fso9 and fs018 | 15:16 |
| chandankumar | weshay: is manila configured on fs020? | 15:16 |
| *** jfrancoa has quit IRC | 15:16 | |
| gouthamr | weshay: +1 | 15:16 |
| weshay | http://logs.openstack.org/50/609550/1/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/35f540c/logs/tempest.html.gz | 15:17 |
| weshay | chandankumar, /me checks | 15:17 |
| chandankumar | weshay: the thing is that we have a centralized skip list and tempest is runned from container at multiple places | 15:17 |
| weshay | right..s ec | 15:18 |
| weshay | sec | 15:18 |
| chandankumar | weshay: if we unskip some tests it will start breaking at some place if proper test_regex is not passed | 15:18 |
| chandankumar | fs020 is going to affect | 15:18 |
| *** artom has joined #tripleo | 15:19 | |
| *** openstackgerrit has quit IRC | 15:22 | |
| gouthamr | fs020 doesn't deploy manila, how will it be affected? | 15:24 |
| dpeacock | is it just me or is zuul.openstack.org slow today? | 15:24 |
| weshay | chandankumar, don't think so.. just blacklist in fs20 | 15:24 |
| *** mugsie has joined #tripleo | 15:24 | |
| chandankumar | gouthamr: weshay: https://review.openstack.org/609741 | 15:25 |
| chandankumar | once this merged we are good to go with your patch | 15:25 |
| chandankumar | otherwise we will be break the stuff | 15:25 |
| *** huynq has joined #tripleo | 15:25 | |
| weshay | d0ugal, toure updates should go into https://trello.com/c/UbVy6G7k/776-overcloud-deployment-received-504-gateway-time-out-from-mistral | 15:26 |
| weshay | chandankumar, you want that on fs20 and fs21 right? | 15:26 |
| chandankumar | weshay: sorry reviiiew updated | 15:26 |
| chandankumar | weshay: fs020 only | 15:26 |
| weshay | hrm.. | 15:26 |
| weshay | sure? | 15:26 |
| toure | weshay: ack | 15:27 |
| chandankumar | weshay: fs021 a job without skip list | 15:27 |
| chandankumar | weshay: since we are working on towards full tempest, I think we need a fs where can we have all stuff tested | 15:27 |
| *** mcornea_ has quit IRC | 15:28 | |
| chandankumar | including manila +sahara not as a seperate fs | 15:28 |
| *** huynq has quit IRC | 15:28 | |
| marios | how can /#/c/608589/ not be merged yet weshay did you say your prayer yet? bandini what kinda hex did you put on that patch? | 15:29 |
| *** mcornea has joined #tripleo | 15:29 | |
| *** dprince has quit IRC | 15:31 | |
| *** chandankumar is now known as chkumar|off | 15:32 | |
| weshay | marios, it failed on the mistral issue that I'm pinging toure d0ugal and bogdando about | 15:32 |
| weshay | marios, https://trello.com/c/UbVy6G7k/776-overcloud-deployment-received-504-gateway-time-out-from-mistral | 15:32 |
| *** Chaserjim has joined #tripleo | 15:32 | |
| marios|rover | thanks weshay and :/ | 15:32 |
| bogdando | weshay: we'll need to have that https://review.openstack.org/#/c/607491/ puppet-tripleo promoted somehow, to unblock mistral things, right? | 15:33 |
| bogdando | IIUC, that failed build of /#/c/608589/ does not have that fix in puppet modules? | 15:34 |
| weshay | bogdando, puppet changes should come through automatically | 15:34 |
| bogdando | hm | 15:34 |
| weshay | bogdando, no need for promotion | 15:34 |
| bogdando | then, that means, my assertion failed and the mistral breaks in different way | 15:34 |
| bogdando | not cuz of logrotate | 15:35 |
| d0ugal | toure: I am going to add a rety to that Swift upload. Not sure if it will help... but maybe? | 15:35 |
| bogdando | I'll check the logs... | 15:35 |
| mcornea | mwhahaha: weshay do we have any gate job that deploys tripleo allinone? | 15:36 |
| mwhahaha | mcornea: the standalone? | 15:37 |
| * mwhahaha is unsure what you are refering to | 15:37 | |
| bogdando | weshay, d0ugal, therve: mmh, that http://logs.openstack.org/89/608589/5/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/317ee0f/logs/undercloud/var/log/containers/ does not have logrotate container at all, so nothing even attempts to send signals or do copytruncate | 15:37 |
| bogdando | I thought we always deploy logrotate container in CI | 15:37 |
| mcornea | mwhahaha: yeah | 15:37 |
| d0ugal | bogdando: Yeah, I don't think this most recent failure is related to logrotate. | 15:37 |
| bogdando | okay | 15:38 |
| mwhahaha | mcornea: the standalone job fs 52 or something | 15:38 |
| mwhahaha | mcornea: https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L6-L13 | 15:39 |
| d0ugal | https://review.openstack.org/609746 | 15:40 |
| d0ugal | toure: ^ That could possibly help... but ¯\_(ツ)_/¯ | 15:40 |
| *** yprokule has quit IRC | 15:44 | |
| weshay | gouthamr, update your patch w/ the depends to chkumar|off 's patch | 15:45 |
| weshay | then I can +2 | 15:46 |
| gouthamr | weshay: ack, will do | 15:46 |
| gouthamr | weshay chkumar|off: ty! | 15:46 |
| roger2 | In the undercloud.conf, should I set "masquerade" to true or to false? I was thinking "true", but I was surprised it is set to "false" by default.So I'm a little confused about it. | 15:46 |
| mwhahaha | roger2: depends on if you want the overcloud nodes to use the undercloud for internet access, you likely will want true | 15:48 |
| tbarron | chkumar|off++ | 15:49 |
| tbarron | weshay++ | 15:49 |
| tbarron | gouthamr++ | 15:49 |
| tbarron | karma happens even w/o a bot | 15:49 |
| *** jrist has joined #tripleo | 15:50 | |
| *** mjturek has quit IRC | 15:51 | |
| weshay | 2018-10-11 12:07:27 | time="2018-10-11T12:07:27Z" level=fatal msg="pinging docker registry returned: Get https://registry-1.docker.io/v2/: dial tcp: lookup registry-1.docker.io on 127.0.0.1:53: server misbehaving" | 15:51 |
| weshay | http://logs.openstack.org/49/585649/15/check/tripleo-ci-centos-7-standalone/81f644c/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2018-10-11_12_07_27 | 15:51 |
| roger2 | mwhahaha: yeah, I don't have a separate gateway, so "true" it is then. thank you. | 15:52 |
| *** bogdando has quit IRC | 15:53 | |
| *** rh-jelabarre has quit IRC | 15:55 | |
| *** jrist has quit IRC | 15:59 | |
| *** dtantsur is now known as dtantsur|afk | 16:00 | |
| chem` | Tengu: hey, I've found this issue during ansible-lint of the generated ansible-playbook https://bugs.launchpad.net/tripleo/+bug/1797412 and I've upload that associated review https://review.openstack.org/#/c/609754/ | 16:03 |
| openstack | Launchpad bug 1797412 in tripleo "Wrong syntax for import_role in the ansible part of the templates." [Critical,In progress] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 16:03 |
| chem` | Tengu: I've noticed that you've made that import_role change so I though I tell you as I may have missed something here | 16:04 |
| trozet | can someone please help review https://review.openstack.org/#/c/609438/ ? thanks | 16:04 |
| gouthamr | weshay: done wrt https://review.openstack.org/#/c/609550 , ty again for the quick feedback! | 16:09 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 16:10 |
| *** rpioso has joined #tripleo | 16:11 | |
| *** ksambor has quit IRC | 16:14 | |
| *** mburned is now known as mburned_out | 16:14 | |
| *** morazi has quit IRC | 16:16 | |
| *** panda has quit IRC | 16:20 | |
| *** sri_ has quit IRC | 16:21 | |
| *** panda has joined #tripleo | 16:21 | |
| *** agopi is now known as agopi|brb | 16:22 | |
| *** vinaykns has quit IRC | 16:24 | |
| *** trown is now known as trown|lunch | 16:34 | |
| *** gouthamr has quit IRC | 16:34 | |
| *** stevebaker has quit IRC | 16:34 | |
| *** dmellado has quit IRC | 16:34 | |
| *** abregman has joined #tripleo | 16:36 | |
| *** jpich has quit IRC | 16:38 | |
| *** mjturek has joined #tripleo | 16:42 | |
| *** gouthamr has joined #tripleo | 16:43 | |
| *** agopi|brb is now known as agopi | 16:57 | |
| *** derekh has quit IRC | 16:59 | |
| *** rdopiera has quit IRC | 16:59 | |
| *** mjturek has quit IRC | 17:01 | |
| *** ykarel_ has joined #tripleo | 17:06 | |
| *** ykarel has quit IRC | 17:07 | |
| *** salmankhan1 has joined #tripleo | 17:07 | |
| *** salmankhan1 has quit IRC | 17:09 | |
| *** salmankhan has quit IRC | 17:09 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 17:10 |
| *** udesale has quit IRC | 17:11 | |
| Tengu | chem`: hu? how could it pass the CI ?? | 17:11 |
| *** russellb has joined #tripleo | 17:12 | |
| russellb | is there a simple way to clean up a standalone containers deployment? | 17:12 |
| Tengu | chem`: that's.... strange, to say the less :/. | 17:13 |
| Tengu | so now I have to find back why I used "role" (or "roles"), I didn't invent that param :/. | 17:13 |
| shardy | russellb: you can docker kill/docker rm all containers, but if you update the images and re-run it should restart them all anyway | 17:14 |
| russellb | shardy: OK, that's what i did, and the new deployment failed in the middle, so was wondering if i just didn't clean up fully | 17:14 |
| shardy | russellb: ack, yeah we don't really have any automated cleanup atm, the idea is you can always modify the config and re-apply it to move forward/update | 17:15 |
| russellb | ok | 17:15 |
| toure | d0ugal will check it out | 17:15 |
| shardy | russellb: some state like the DB is mounted from the host so killing the containers might not be enough | 17:15 |
| russellb | shardy: do the images get updated automatically? | 17:15 |
| toure | d0ugal so you think we are dropping the client connection or I should say letting it timeout? | 17:16 |
| toure | d0ugal I will c | 17:17 |
| toure | d0ugal I will cherry pick the patch and run another deployment, as I think I have a local reproducer | 17:17 |
| roger2 | My baremetal containerized undercloud installed successfully. So, ‘queens’ wins my vote for stable release. | 17:17 |
| Tengu | chem`: ahhh, ok, so it's ansible lint failing while apparently "role" is working, probably backward compat with a really old version... Can't see other reason :/. Anyway, good catch. | 17:18 |
| shardy | russellb: we set tag_from_label: rdo_version in containers-prepare-parameters.yaml so I think so, but the standalone workflow is a bit different to the overcloud one now | 17:19 |
| shardy | tbh I got my env working and didn't dare touch it but I can try if needed :) | 17:19 |
| russellb | no no, don't break it! :) | 17:20 |
| *** rh-jelabarre has joined #tripleo | 17:20 | |
| *** trown|lunch is now known as trown | 17:34 | |
| *** vinaykns has joined #tripleo | 17:41 | |
| *** shardy has quit IRC | 17:47 | |
| *** amoralej is now known as amoralej|off | 17:57 | |
| *** ansmith has quit IRC | 18:04 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 18:10 |
| *** lblanchard has joined #tripleo | 18:16 | |
| *** ansmith has joined #tripleo | 18:20 | |
| *** gouthamr_ has joined #tripleo | 18:25 | |
| *** dmellado has joined #tripleo | 18:27 | |
| *** openstackstatus has quit IRC | 18:28 | |
| *** Chaserjim has quit IRC | 18:30 | |
| *** openstackstatus has joined #tripleo | 18:31 | |
| *** ChanServ sets mode: +v openstackstatus | 18:31 | |
| *** dprince has joined #tripleo | 18:31 | |
| *** panda has quit IRC | 18:35 | |
| *** panda has joined #tripleo | 18:38 | |
| *** agurenko has quit IRC | 18:38 | |
| *** stevebaker has joined #tripleo | 18:42 | |
| *** openstackgerrit has joined #tripleo | 18:44 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: WIP: make sure octavia flavor gets configured if composable octavia https://review.openstack.org/609696 | 18:44 |
| *** gouthamr has quit IRC | 18:45 | |
| *** chem` has quit IRC | 18:52 | |
| *** ykarel_ has quit IRC | 18:54 | |
| *** ykarel_ has joined #tripleo | 18:55 | |
| *** rh-jelabarre has quit IRC | 19:02 | |
| *** ansmith has quit IRC | 19:05 | |
| roger2 | Do you know to fix "Cannot validate PXE bootloader"? I just did "openstack overcloud node introspect --all-manageable --provide" and introspection completed, but because I have "clean_nodes = true" in my undercloud.conf, it hit this error. | 19:06 |
| roger2 | [{u'result': u'Node 6ec17ca3-9eea-438b-888c-8bc9c85ef40f did not reach state "available", the state is "clean failed", error: Failed to prepare node 6ec17ca3-9eea-438b-888c-8bc9c85ef40f for cleaning: Cannot validate PXE bootloader. Some parameters were missing in node\'s driver_info. Missing are: [\'deploy_ramdisk\', \'deploy_kernel\']'},... | 19:06 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 19:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| roger2 | How do I change undercloud to "clean_nodes = false"? | 19:23 |
| roger2 | I assume redeploy undercloud with setting, but if there is better way, I'm listening. | 19:24 |
| *** rdopiera has joined #tripleo | 19:31 | |
| *** dciabrin has quit IRC | 19:32 | |
| roger2 | too late. already redeploying undercloud. | 19:35 |
| *** salmankhan has joined #tripleo | 19:36 | |
| *** salmankhan has quit IRC | 19:38 | |
| *** salmankhan1 has joined #tripleo | 19:38 | |
| mwhahaha | roger2: you should have been able to just rerun the undercloud install (or upgrade) and it would have applied the config change | 19:38 |
| *** salmankhan1 is now known as salmankhan | 19:40 | |
| roger2 | mwhahaha: thank you. So I removed clean_nodes setting from undercloud.conf and now I'm running openstack undercloud install again. I think that's what you just said. So... yay. | 19:43 |
| mwhahaha | yea that should work | 19:44 |
| roger2 | kthx | 19:44 |
| roger2 | I have to go away now for several days. Thanks to everyone. Bye! | 19:45 |
| *** roger2 has quit IRC | 19:47 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM - Testing changes to https://review.openstack.org/#/c/591652 https://review.openstack.org/609798 | 19:53 |
| *** ansmith has joined #tripleo | 20:09 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 20:10 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Switch the undercloud to deploy Podman by default starting from Stein https://review.openstack.org/608452 | 20:13 |
| *** tosky__ has joined #tripleo | 20:16 | |
| *** tosky has quit IRC | 20:17 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM - Testing changes to https://review.openstack.org/#/c/591652 https://review.openstack.org/609798 | 20:19 |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Replace RabbitMQ with OsloMessaging(Rpc|Notify) https://review.openstack.org/608637 | 20:20 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: [Ocata/Pike] Pass DeployIdentifier in upgrade tasks. https://review.openstack.org/606089 | 20:20 |
| openstackgerrit | Merged openstack/paunch master: Set standard mode for systemd generated unit files https://review.openstack.org/608644 | 20:20 |
| *** tosky__ is now known as tosky | 20:23 | |
| openstackgerrit | Nicolas Hicher proposed openstack-infra/tripleo-ci master: provider: Add vexxhost https://review.openstack.org/596432 | 20:23 |
| *** rdopiera has quit IRC | 20:26 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM - Testing changes to https://review.openstack.org/#/c/591652 https://review.openstack.org/609798 | 20:34 |
| *** pcaruana has quit IRC | 20:40 | |
| *** ansmith has quit IRC | 20:41 | |
| weshay | oh HI openstackgerrit | 20:44 |
| weshay | welcome back | 20:44 |
| *** dprince has quit IRC | 20:45 | |
| mwhahaha | yea they merged a fix for the auth problems causing openstackgerrit's absense | 20:47 |
| mwhahaha | so hopefully it will not leave again :D | 20:47 |
| *** akrivoka has quit IRC | 20:53 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: WIP replace skopeo inspect with python https://review.openstack.org/609586 | 20:54 |
| mwhahaha | weshay: sooo what's the outstanding bugs for the OVB jobs? | 20:55 |
| mwhahaha | weshay: is it just the tls thing or is there more | 20:55 |
| weshay | mwhahaha, I'm sure there are more by now.. but it's hard to tell w/o https://review.openstack.org/#/c/608589/ | 20:55 |
| mwhahaha | k | 20:55 |
| weshay | mwhahaha, atm we're only getting the undercloud logs in ovb | 20:56 |
| weshay | due to $cloud | 20:56 |
| weshay | mwhahaha, either infra or ironic https://review.rdoproject.org/zuul/stream/8a92e66d7c754242b98675358d4fd9c9?logfile=console.log | 20:57 |
| weshay | dang.. we lost the console logs | 20:59 |
| weshay | https://review.openstack.org/#/c/588488/5/scripts/te-broker/destroy-env | 21:00 |
| *** mcornea has quit IRC | 21:01 | |
| weshay | mwhahaha, so I think ovb ipv6 is working | 21:05 |
| weshay | ipv4 is hitting something | 21:05 |
| weshay | but I don't have logs :( | 21:05 |
| mwhahaha | odd | 21:05 |
| weshay | https://review.rdoproject.org/zuul/stream/e06a5aeaa5e248d1a4811591adb42b7d?logfile=console.log | 21:06 |
| weshay | ipv6 | 21:06 |
| *** fpan has quit IRC | 21:06 | |
| *** ykarel__ has joined #tripleo | 21:06 | |
| weshay | queens fs001 https://logs.rdoproject.org/89/608589/6/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch/e6d6cb4/logs/undercloud/home/zuul/overcloud_prep_images.log.txt.gz | 21:07 |
| *** fpan has joined #tripleo | 21:07 | |
| *** ykarel_ has quit IRC | 21:09 | |
| mwhahaha | weshay: https://logs.rdoproject.org/89/608589/6/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch/e6d6cb4/logs/undercloud/var/log/ironic/ironic-conductor.log.txt.gz#_2018-10-11_19_44_12_419 | 21:09 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM - Testing changes to https://review.openstack.org/#/c/591652 https://review.openstack.org/609798 | 21:09 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 21:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| weshay | mwhahaha, vbmc issues ? | 21:10 |
| mwhahaha | possibly? | 21:10 |
| weshay | toure, sorry.. I'm back | 21:10 |
| mwhahaha | we have any stuck stacks? | 21:10 |
| * weshay tries to bring it up | 21:10 | |
| * weshay looks | 21:10 | |
| weshay | mwhahaha, I have the console logs on the server | 21:11 |
| weshay | they are just not being served | 21:11 |
| * weshay tries to fix | 21:17 | |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates master: Improve support for deploying ceph on standalone system https://review.openstack.org/607558 | 21:17 |
| *** ade_lee has quit IRC | 21:18 | |
| *** abishop has quit IRC | 21:22 | |
| *** ykarel__ has quit IRC | 21:29 | |
| *** panda has quit IRC | 21:34 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM - Testing changes to https://review.openstack.org/#/c/591652 https://review.openstack.org/609798 | 21:37 |
| *** panda has joined #tripleo | 21:37 | |
| weshay | ERROR /var/log/extra/docker/containers/ironic_pxe_http/log/ironic/ironic-conductor.log: 7 ERROR oslo.service.loopingcall [-] Dynamic backoff interval looping call 'ironic.conductor.utils._wait' failed: LoopingCallTimeOut: Looping call timed out after 20.98 seconds | 21:37 |
| weshay | https://logs.rdoproject.org/89/608589/6/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/8a92e66/logs/undercloud/var/log/extra/errors.txt.gz | 21:38 |
| weshay | mwhahaha, https://logs.rdoproject.org/89/608589/6/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/8a92e66/logs/undercloud/var/log/containers/ironic/ironic-conductor.log.txt.gz#_2018-10-11_19_49_32_128 | 21:42 |
| weshay | ? | 21:42 |
| weshay | doesn't tell me much | 21:42 |
| weshay | https://logs.rdoproject.org/89/608589/6/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/8a92e66/logs/undercloud/var/log/containers/ironic/ironic-conductor.log.txt.gz#_2018-10-11_20_55_39_396 | 21:43 |
| mwhahaha | yea not sure, i actually just saw the same thing on a queens ovb introspectiojn | 21:43 |
| mwhahaha | IMHO it would point to connectivity problems or something between the undercloud and the bmc | 21:43 |
| mwhahaha | or the bmc hanging on the openstack calls | 21:43 |
| mwhahaha | weshay: you can see from the bmc logs that the power thing was called repeatedly | 21:44 |
| weshay | yes | 21:44 |
| weshay | baremetal-11662_1-co..>2018-10-11 20:5020 | 21:46 |
| weshay | [ ]baremetal-11662_2-co..>2018-10-11 20:50206 | 21:46 |
| weshay | [ ]baremetal-11662_0-co..>2018-10-11 20:50206 | 21:46 |
| weshay | [ ]baremetal-11662_3-co..>2018-10-11 20:5020 | 21:46 |
| weshay | so files w/ 206kb have some indication they are booting | 21:47 |
| weshay | but 20kb is an empty file | 21:47 |
| weshay | so maybe _0 and _2 booted and _1 and _3 did not | 21:47 |
| *** rbrady has quit IRC | 21:50 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-quickstart-extras master: OVB job's need to masquerade 10.0.0.0/24 https://review.openstack.org/609830 | 21:51 |
| *** trozet has quit IRC | 21:52 | |
| mwhahaha | hrm that seems like the wrong way to do that masquerade | 21:52 |
| *** gouthamr_ is now known as gouthamr | 21:53 | |
| hjensas | mwhahaha: I am open to suggestions. :) | 21:54 |
| mwhahaha | can't we reflect that in undercloud.conf? or fix teh networking? | 21:54 |
| hjensas | mwhahaha: enabling/disabling masquerading for ctlplane network became a bool in queens. So we cannot just say masquerade_network: <ctlplane-network>,10.0.0.0/24 anymore. | 21:56 |
| hjensas | mwhahaha: to be honest, I'm a bit confused why the rule was not needed in instack-undercloud. | 22:05 |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 22:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| *** lblanchard has quit IRC | 22:13 | |
| mwhahaha | hjensas: yeah not sure either I'll look into it later. It seems like there is something g else going on | 22:13 |
| *** salmankhan has quit IRC | 22:15 | |
| hjensas | mwhahaha: oh, it's not the masquerading we want - we want the RETURN rule. -A POSTROUTING -s 10.0.0.0/24 -d 10.0.0.0/24 -m state --state NEW,RELATED,ESTABLISHED -m comment --comment "137 routed_network return 10.0.0.0/24 ipv4" -j RETURN | 22:16 |
| hjensas | mwhahaha: i.e we do not want to masqurade, we just want to route. | 22:16 |
| hjensas | mwhahaha: no, actually not that either ... it's just weird. I'll abandone and write up something there. | 22:17 |
| mwhahaha | Ha | 22:17 |
| mwhahaha | Ok | 22:17 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-upgrade master: Set container_cli for undercloud https://review.openstack.org/608462 | 22:18 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-upgrade master: Set container_cli for undercloud https://review.openstack.org/608462 | 22:18 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs050: upgrade the undercloud to Podman containers https://review.openstack.org/608463 | 22:18 |
| *** openstackgerrit has quit IRC | 22:19 | |
| *** openstackgerrit has joined #tripleo | 22:20 | |
| *** boazel has quit IRC | 22:22 | |
| *** rcernin has joined #tripleo | 22:23 | |
| *** rpioso is now known as rpioso|afk | 22:26 | |
| *** vinaykns has quit IRC | 22:26 | |
| *** boazel has joined #tripleo | 22:28 | |
| *** openstackstatus has quit IRC | 22:28 | |
| *** openstackstatus has joined #tripleo | 22:30 | |
| *** ChanServ sets mode: +v openstackstatus | 22:30 | |
| *** Vorrtex has quit IRC | 22:32 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Remove defaults from masquerade-networks service env https://review.openstack.org/609845 | 22:42 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: NODES_FILE definition is missing https://review.openstack.org/609846 | 22:50 |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 23:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Minor documentation updates https://review.openstack.org/609636 | 23:13 |
| *** owalsh has quit IRC | 23:15 | |
| *** tosky has quit IRC | 23:15 | |
| *** spotz has quit IRC | 23:17 | |
| *** mcarden has quit IRC | 23:18 | |
| *** owalsh has joined #tripleo | 23:30 | |
| openstackgerrit | Harald Jensås proposed openstack/puppet-tripleo master: Fix Undercloud masquerading firewall rules https://review.openstack.org/609858 | 23:39 |
| *** rlandy is now known as rlandy|bbl | 23:46 | |
| *** radez has joined #tripleo | 23:54 | |
| *** spotz has joined #tripleo | 23:55 | |
| itlinux_ | hello guys, I am trying this on pike openstack tripleo container image prepare default --local-push-destination --output-env-file containers-prepare-parameter.yaml | 23:55 |
| itlinux_ | but I gett an error openstack: 'tripleo container image prepare default --local-push-destination --output-env-file containers-prepare-parameter.yaml' is not an openstack command. | 23:56 |
| itlinux_ | I got it.. | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!