| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates stable/queens: Treat enable_debug in Ansible as a bool https://review.openstack.org/582423 | 00:04 |
|---|---|---|
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates stable/queens: Support SshKnownHostsDeployment with config-download https://review.openstack.org/582424 | 00:04 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates stable/queens: Add spacing for readability https://review.openstack.org/582425 | 00:04 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates stable/queens: Don't log set_fact tasks for role_data https://review.openstack.org/582426 | 00:04 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates stable/queens: Run tasks on primary role first https://review.openstack.org/582427 | 00:04 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates stable/queens: deploy-steps: switch to tripleo_role_name https://review.openstack.org/582428 | 00:04 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates stable/queens: Optimized Ansible tasks in deplay-steps-tasks.yaml https://review.openstack.org/582429 | 00:04 |
| *** khyr0n has quit IRC | 00:04 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Parallelize server pre and post steps https://review.openstack.org/574474 | 00:07 |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 00:10 |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| *** rpioso is now known as rpioso|afk | 00:10 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add FFU upgrade steps to Sahara services https://review.openstack.org/580212 | 00:13 |
| *** rlandy has quit IRC | 00:17 | |
| *** medberry has joined #tripleo | 00:18 | |
| *** medberry has quit IRC | 00:18 | |
| *** medberry has joined #tripleo | 00:18 | |
| *** agopi is now known as agopi|off | 00:19 | |
| *** agopi|off has quit IRC | 00:24 | |
| *** yrabl has joined #tripleo | 00:47 | |
| *** yrabl has quit IRC | 00:52 | |
| weshay | EmilienM, aight.. thanks | 00:55 |
| *** agopi has joined #tripleo | 00:59 | |
| openstackgerrit | Van Hung Pham proposed openstack/puppet-tripleo master: Fix OS versions in metadata https://review.openstack.org/582095 | 01:08 |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 01:10 |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| *** Petersingh has joined #tripleo | 01:15 | |
| *** dmacpher has quit IRC | 01:21 | |
| *** mrsoul has joined #tripleo | 01:28 | |
| *** mrsoul`` has joined #tripleo | 01:28 | |
| *** mschuppert has quit IRC | 01:31 | |
| *** mrsoul` has quit IRC | 01:31 | |
| *** yamahata has quit IRC | 01:38 | |
| *** atoth has quit IRC | 01:52 | |
| *** Petersingh is now known as Petersingh|afk | 01:58 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates master: teach tripleo-wirewall about the DefaultFirewallRules parameter https://review.openstack.org/582436 | 02:01 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/puppet-tripleo master: remove ssh from tripleo::firewall::pre https://review.openstack.org/582437 | 02:01 |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 02:10 |
| *** Petersingh|afk is now known as Petersingh | 02:22 | |
| *** medberry has quit IRC | 02:28 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: Do undercloud container prepare in external_deploy_tasks https://review.openstack.org/581917 | 02:29 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: Break out image prepare into its own "service" https://review.openstack.org/581918 | 02:29 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: WIP Always enable prepare service for docker clouds https://review.openstack.org/581919 | 02:29 |
| *** vinaykns has quit IRC | 02:38 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/puppet-tripleo master: remove ssh from tripleo::firewall::pre https://review.openstack.org/582437 | 02:56 |
| *** ykarel|away has joined #tripleo | 02:59 | |
| weshay | EmilienM, about to have a merge party yo | 03:00 |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: [WIP] Take deploy_type out of TOCI_JOBTYPE https://review.openstack.org/582385 | 03:00 |
| EmilienM | weshay: well | 03:01 |
| EmilienM | weshay: the one we want is about to fail | 03:01 |
| EmilienM | so it's not good | 03:01 |
| weshay | EmilienM, yup on scenario003 | 03:01 |
| weshay | undercloud install error | 03:01 |
| EmilienM | I killed some jobs | 03:02 |
| EmilienM | let's see how things merge now | 03:02 |
| EmilienM | boom | 03:06 |
| EmilienM | wait for it | 03:06 |
| weshay | something odd just happened | 03:09 |
| weshay | https://review.openstack.org/#/c/581180/ | 03:09 |
| weshay | EmilienM, it was a bad boom | 03:10 |
| weshay | something w/ inra | 03:10 |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 03:10 |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| EmilienM | weshay: it's called a reset :/ | 03:10 |
| EmilienM | anyway I'm out now | 03:10 |
| weshay | EmilienM, however the gate did not report | 03:11 |
| EmilienM | I've purged some patches from gate again | 03:11 |
| weshay | and it was passing in the console | 03:11 |
| EmilienM | with scenario002 | 03:11 |
| weshay | bah | 03:11 |
| weshay | EmilienM++ | 03:11 |
| weshay | k | 03:11 |
| weshay | thanks | 03:11 |
| EmilienM | I suspect things will still be in the gate when I wake up :D | 03:12 |
| weshay | EmilienM, things were so good yesterday | 03:12 |
| EmilienM | https://review.openstack.org/#/c/581183/ : still close to timeout... :( | 03:12 |
| *** holser_ has joined #tripleo | 03:12 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Switch to workflow driven image prepare https://review.openstack.org/573476 | 03:15 |
| *** skramaja has joined #tripleo | 03:20 | |
| *** athomas_ has joined #tripleo | 03:21 | |
| *** apetrich has quit IRC | 03:23 | |
| *** athomas has quit IRC | 03:23 | |
| *** apetrich has joined #tripleo | 03:24 | |
| *** mdnadeem has joined #tripleo | 03:32 | |
| *** udesale has joined #tripleo | 03:35 | |
| *** Petersingh is now known as Petersingh|afk | 03:40 | |
| *** tzumainn has quit IRC | 03:48 | |
| *** ykarel|away has quit IRC | 03:50 | |
| *** jaganathan has joined #tripleo | 03:56 | |
| *** ramishra has joined #tripleo | 03:57 | |
| *** zaneb has joined #tripleo | 03:57 | |
| *** jaganathan has quit IRC | 03:58 | |
| *** jaganathan has joined #tripleo | 03:58 | |
| *** spsurya_ has joined #tripleo | 03:59 | |
| *** links has joined #tripleo | 04:02 | |
| *** pdeore has joined #tripleo | 04:03 | |
| *** shreshtha has joined #tripleo | 04:04 | |
| *** shreshtha has quit IRC | 04:04 | |
| *** shreshtha has joined #tripleo | 04:05 | |
| *** dmacpher has joined #tripleo | 04:08 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 04:10 |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| *** Petersingh|afk is now known as Petersingh | 04:17 | |
| *** janki has joined #tripleo | 04:23 | |
| *** ykarel has joined #tripleo | 04:28 | |
| *** holser_ has quit IRC | 04:30 | |
| *** khyr0n has joined #tripleo | 04:40 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Adding missing space in octavia-worker.yaml https://review.openstack.org/557353 | 04:42 |
| *** holser_ has joined #tripleo | 04:48 | |
| *** holser_ has quit IRC | 05:05 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 05:10 |
| Tengu | hello there | 05:20 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Adding missing space in octavia-worker.yaml https://review.openstack.org/557347 | 05:30 |
| openstackgerrit | Merged openstack/tripleo-common master: Increase gb_per_osd from 3 to 5 in derive_params_formulas https://review.openstack.org/579675 | 05:30 |
| *** rfolco has quit IRC | 05:30 | |
| *** ksambor has joined #tripleo | 05:35 | |
| *** khyr0n has quit IRC | 05:36 | |
| *** ratailor has joined #tripleo | 05:42 | |
| *** cshastri has joined #tripleo | 05:49 | |
| *** yprokule has joined #tripleo | 05:49 | |
| *** dparkes has joined #tripleo | 05:50 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Enforce proper ordering when applying firewall rules https://review.openstack.org/581634 | 05:51 |
| *** mrsoul is now known as mschuppert | 05:55 | |
| *** bogdando has joined #tripleo | 05:56 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Align roles file to become a normalized path https://review.openstack.org/572404 | 06:00 |
| *** rfolco has joined #tripleo | 06:04 | |
| *** holser_ has joined #tripleo | 06:04 | |
| *** quiquell|off is now known as quiquell | 06:05 | |
| *** aufi has joined #tripleo | 06:06 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Unify custom t-h-t install steps for UC/OC/upgrade https://review.openstack.org/465047 | 06:07 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Avoid hard-coded settings in Manila HA containers https://review.openstack.org/545060 | 06:09 |
| openstackgerrit | Merged openstack/tripleo-common master: Updates OpenDaylight healthcheck URI https://review.openstack.org/579017 | 06:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add blankline for readability https://review.openstack.org/572378 | 06:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix variables interpolation for included roles https://review.openstack.org/581612 | 06:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Generate and mount wrappers for haproxy in OVN metadata agent https://review.openstack.org/571130 | 06:09 |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Retry inspect of container images https://review.openstack.org/582297 | 06:09 |
| openstackgerrit | Merged openstack/tripleo-common master: Update heat container healthchecks https://review.openstack.org/581904 | 06:09 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Generate ansible.cfg for UC/standalone deployments https://review.openstack.org/580171 | 06:09 |
| openstackgerrit | Dan Macpherson proposed openstack/tripleo-common master: Adding playbooks for overcloud backup and restore https://review.openstack.org/582453 | 06:09 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Report ansible errors in json file for standalone https://review.openstack.org/581623 | 06:10 |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 06:10 |
| *** ccamacho has joined #tripleo | 06:12 | |
| *** ccamacho has quit IRC | 06:12 | |
| *** ccamacho has joined #tripleo | 06:13 | |
| *** quiquell is now known as quiquell|bbl | 06:15 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Align roles file to become a normalized path https://review.openstack.org/572404 | 06:17 |
| *** alee has quit IRC | 06:17 | |
| *** Petersingh is now known as Petersingh|afk | 06:18 | |
| *** jfrancoa has joined #tripleo | 06:24 | |
| *** dr_gogeta86 has joined #tripleo | 06:24 | |
| *** dr_gogeta86 has joined #tripleo | 06:24 | |
| *** Haresh has joined #tripleo | 06:31 | |
| Tengu | bogdando: uhu, too many people are pusing stuff in python-tripleoclient ;) | 06:37 |
| Tengu | *pushing | 06:37 |
| bogdando | Tengu: yes, it's a rockstart today | 06:37 |
| bogdando | rock star :) | 06:37 |
| Tengu | happy my thing was merged yesterday | 06:38 |
| Tengu | at least that's one conflict less ;) | 06:38 |
| bogdando | looking for yaql guru who can answer that question https://review.openstack.org/#/c/581630/11/docker/services/ceilometer-agent-central.yaml from looking into t-h-t common/ and deploy-steps.j2 magic | 06:39 |
| bogdando | if it really is so, that uber feature definitely worth being documented | 06:39 |
| bogdando | jistr: ^^ around? ) | 06:40 |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: DO NOT MERGE: Test boot params in the config-download https://review.openstack.org/566241 | 06:41 |
| *** ffiore has joined #tripleo | 06:44 | |
| *** gvrangan has joined #tripleo | 06:44 | |
| *** dtrainor has quit IRC | 06:46 | |
| *** dtrainor has joined #tripleo | 06:46 | |
| jaganathan | Tengu, | 06:46 |
| jaganathan | Tengu, hi | 06:46 |
| *** Petersingh|afk is now known as Petersingh | 06:46 | |
| Tengu | jaganathan: hello! got your email :) | 06:47 |
| *** ffiore has quit IRC | 06:47 | |
| jaganathan | Tengu, need to do pending items and testing. will try to complete everything in next week. (mostly before wednesday) | 06:49 |
| jaganathan | Tengu, is that fine? | 06:49 |
| Tengu | jaganathan: fine for me - I don't remember when Juan will be back | 06:49 |
| Tengu | he's the interested one in any cases ;). | 06:49 |
| *** ffiore has joined #tripleo | 06:50 | |
| jaganathan | Tengu, ok. still review is pending for fixed ip derive params. | 06:50 |
| Tengu | jaganathan: well, if it's working (I think so) you might call people to vote on it :) | 06:50 |
| jaganathan | placed patch on top of fixed ip changes. | 06:50 |
| jaganathan | Tengu, that's working fine. added people for review. | 06:51 |
| Tengu | jaganathan: cool. I don't have +2 on CR nor +1 on workflow, can't really help unfortunately :( | 06:52 |
| jaganathan | Tengu, ok. | 06:53 |
| *** holser_ has quit IRC | 06:53 | |
| Tengu | bogdando: care to have a look at https://review.openstack.org/#/c/572678/ ? | 06:53 |
| Tengu | bogdando: it won't conflict with your on-going merge :D | 06:53 |
| bogdando | Tengu: I'm affraid I'm not so good on thow workbooks | 06:54 |
| bogdando | those | 06:54 |
| Tengu | bogdando: oh. sad :(. | 06:54 |
| bogdando | they look nice, and I can say to myself like OK when doing code reviews | 06:54 |
| bogdando | not very helpful tho | 06:54 |
| Tengu | hehe | 06:54 |
| Tengu | no problem | 06:55 |
| Tengu | everyone has his own fields ;) | 06:55 |
| jaganathan | d0ugal, please look into https://review.openstack.org/#/c/572678/ | 06:56 |
| chkumar|ruck | Tengu: hello | 06:58 |
| chkumar|ruck | Tengu: https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-372/undercloud/home/stack/overcloud_deploy.log.gz | 06:59 |
| chkumar|ruck | Tengu: Failed to run action [action_ex_id=39ad2d35-0fb3-4df6-bc30-d315a8ed20f9, action_cls='<class 'mistral.actions.action_factory.DeployStackAction'>', attributes='{}', params='{u'skip_deploy_identifier': False, u'container': u'overcloud', u'timeout': 90}'] | 06:59 |
| *** radeks has joined #tripleo | 06:59 | |
| chkumar|ruck | 2018-07-13 03:50:08 | ERROR: SSLError: : resources.Controller<nested_stack>.resources.0<https://192.168.24.2:13808/v1/AUTH_a6b8e7eb0ff8412db93bc4ea291103f7/overcloud/puppet/controller-role.yaml>.resources.Controller: : SSL exception connecting to https://192.168.24.3:8774/v2.1/: ("bad handshake: Error([('SSL routines', 'SSL23_GET_SERVER_HELLO', 'unknown protocol')],)",) | 06:59 |
| chkumar|ruck | 2018-07-13 03:50:08 | + status_code=1 | 06:59 |
| chkumar|ruck | Tengu: Does it sounds familiar? | 06:59 |
| *** lvdombrkr has joined #tripleo | 06:59 | |
| Tengu | chkumar|ruck: already seen that, yes. trying to remember where/when | 07:00 |
| chkumar|ruck | Tengu: https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-372/undercloud/var/log/extra/errors.txt.gz | 07:00 |
| chkumar|ruck | Tengu: it is failing in RDO phase 1 jobs | 07:00 |
| chkumar|ruck | few more errors: http://paste.openstack.org/show/725792/ | 07:01 |
| Tengu | chkumar|ruck: I think I hit that a long time ago on my own deploy. But not sure. Had so many issues..... :( | 07:01 |
| chkumar|ruck | https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-372/undercloud/var/log/extra/errors.txt.gz | 07:01 |
| *** mdnadeem has quit IRC | 07:01 | |
| *** gkadam has joined #tripleo | 07:01 | |
| Tengu | chkumar|ruck: I was peering with jaosorior I think. | 07:01 |
| *** mdnadeem has joined #tripleo | 07:02 | |
| *** cylopez has joined #tripleo | 07:02 | |
| Tengu | chkumar|ruck: I think it was an issue with the TLS port for keystone that wasn't properly passed - but still, not 100% sure. | 07:02 |
| chkumar|ruck | Tengu: filing a bug, then | 07:02 |
| Tengu | chkumar|ruck: better yep. jaosorior is still on PTO, he might be back next week. | 07:03 |
| Tengu | but anyone in the sec-team might be interested in this issue. | 07:03 |
| chkumar|ruck | 3 consistent failures from yesterday | 07:03 |
| Tengu | chkumar|ruck: what was merged lately that could impact this service? | 07:04 |
| *** mdnadeem_ has joined #tripleo | 07:04 | |
| *** cylopez has left #tripleo | 07:06 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP Rerun the init_log for cinder/manila every time and also chown state folder https://review.openstack.org/582456 | 07:06 |
| chkumar|ruck | Tengu: https://review.openstack.org/#/q/project:openstack/tripleo-heat-templates+status:merged I am not seeing any suspecious changes here | 07:08 |
| *** mdnadeem has quit IRC | 07:08 | |
| *** alee has joined #tripleo | 07:09 | |
| Tengu | chkumar|ruck: hmm indeed. weird | 07:09 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP cinder-* bundles and manila-share to not need to be run as root https://review.openstack.org/580127 | 07:10 |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 07:10 |
| *** tesseract has joined #tripleo | 07:12 | |
| *** holser_ has joined #tripleo | 07:12 | |
| bogdando | folks, WDYT of switching defaults http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/puppet/services/neutron-plugin-ml2.yaml#n78 to 'openvswitch' ? | 07:13 |
| bogdando | there is some performance testing results, pointing out that is way better choice, bearing in mind openshift on openstack as well | 07:14 |
| bogdando | dsneddon_, bfournie: ^^ (for the context http://post-office.corp.redhat.com/archives/shiftstack-team/2018-July/msg00086.html) | 07:14 |
| *** quiquell|bbl is now known as quiquell | 07:15 | |
| *** peereb has joined #tripleo | 07:18 | |
| chkumar|ruck | sshnaidm|afk: Tengu ykarel https://bugs.launchpad.net/tripleo/+bug/1781541 | 07:18 |
| openstack | Launchpad bug 1781541 in tripleo "[master][promotion][RDO phase1] Creating overcloud Heat stack failed giving Error([('SSL routines', 'SSL23_GET_SERVER_HELLO', 'unknown protocol')]" [Critical,Triaged] | 07:18 |
| *** moshele has joined #tripleo | 07:19 | |
| ykarel | chkumar|ruck, ack | 07:21 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Iterate once in network-environment.yaml https://review.openstack.org/582136 | 07:22 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Composable networks - L3 routed networks (1/3) https://review.openstack.org/582180 | 07:22 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Composable networks - L3 routed networks (2/3) https://review.openstack.org/582181 | 07:22 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Composable networks - L3 routed networks (3/3) https://review.openstack.org/582301 | 07:22 |
| Tengu | chkumar|ruck: guess there's no way to debug this with some running instance? | 07:22 |
| Tengu | chkumar|ruck: might be interesting to check what's actually listening on the said ports (13808 and 8774), and if they are TLS, what's the certificate content (if any) | 07:23 |
| Tengu | chkumar|ruck: in fact.... it might even be due the lack of certificates. if a client wants to talk TLS to a non-TLS port, I think this kind of error might appear. | 07:25 |
| chkumar|ruck | Tengu: https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-370/undercloud/var/log/extra/netstat.txt.gz | 07:25 |
| Tengu | chkumar|ruck: ok, haproxy, of course. Will see its configuration (it's in containers right?) | 07:26 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Use toci scripts as templates for zuulv3 https://review.openstack.org/581331 | 07:26 |
| *** amoralej|off is now known as amoralej | 07:26 | |
| *** jd_ has quit IRC | 07:26 | |
| Tengu | bind 192.168.24.2:13808 transparent ssl crt /etc/pki/tls/certs/undercloud-192.168.24.2.pem according to https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-370/undercloud/etc/haproxy/haproxy.cfg.gz | 07:26 |
| *** dmacpher has quit IRC | 07:27 | |
| Tengu | chkumar|ruck: certificate is apparently valid, at least on the host. Will check if I find anything in container things. | 07:28 |
| *** waleedm has joined #tripleo | 07:28 | |
| Tengu | oh. hm. no container. | 07:28 |
| chkumar|ruck | yes no container, | 07:28 |
| chkumar|ruck | Tengu: https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/minimal.yml is used for this job | 07:31 |
| *** suuuper has joined #tripleo | 07:32 | |
| Tengu | oh yes, containerized undercloud isn't default for now, right. | 07:32 |
| Tengu | a bit too advanced in the master branch :D | 07:32 |
| chkumar|ruck | Tengu: yup no containerized undercloud | 07:33 |
| *** zshi has quit IRC | 07:33 | |
| Tengu | ok. 13808 is for swift. | 07:33 |
| openstackgerrit | yatin proposed openstack/tripleo-quickstart master: Use undercloud kernel when not overcloud_as_undercloud https://review.openstack.org/582462 | 07:33 |
| ykarel | jistr, holser_ ^^ | 07:33 |
| *** assassin has joined #tripleo | 07:34 | |
| Tengu | chkumar|ruck: https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-370/undercloud/var/log/mistral/mistral-db-manage.log.gz check near the end of the file. | 07:36 |
| Tengu | there are a LOT of 2018-07-12 17:33:41.559 20815 ERROR mistral.actions.openstack.action_generator.base AttributeError: 'NoneType' object has no attribute 'Client' | 07:36 |
| Tengu | like... really a lot. | 07:36 |
| Tengu | not sure if this is linked. | 07:36 |
| Tengu | but if this is the case, might be linked to Mistral. | 07:37 |
| Tengu | not t-h-t | 07:37 |
| chkumar|ruck | Tengu: https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-370/undercloud/var/log/extra/errors.txt.gz | 07:37 |
| chkumar|ruck | 2018-07-12 17:33:16.823 ERROR /var/log/mistral/mistral-db-manage.log: 20746 ERROR mistral.actions.openstack.action_generator.base AttributeError: 'NoneType' object has no attribute 'Client' | 07:38 |
| chkumar|ruck | lots of error | 07:38 |
| Tengu | yep | 07:38 |
| Tengu | might be a cause. | 07:38 |
| chkumar|ruck | d0ugal: ^^ please have a look at this issue https://bugs.launchpad.net/tripleo/+bug/1781541 | 07:38 |
| openstack | Launchpad bug 1781541 in tripleo "[master][promotion][RDO phase1] Creating overcloud Heat stack failed giving Error([('SSL routines', 'SSL23_GET_SERVER_HELLO', 'unknown protocol')]" [Critical,Triaged] | 07:38 |
| ykarel | chkumar|ruck, Tengu this NoneType not seem to be an issue, i have seen this earlier as well due to missing quilingclient pacakge | 07:39 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP cinder-* bundles and manila-share to not need to be run as root https://review.openstack.org/580127 | 07:39 |
| Tengu | ykarel: erf.... | 07:39 |
| Tengu | ykarel: that's bad behavior then. shouldn't fail like that. | 07:39 |
| ykarel | Tengu, yup need to find why it's redirecting to https when request is to 192.168.24.3:8774 | 07:40 |
| Tengu | ah, I think I have something for that. wait | 07:40 |
| ykarel | okk Good | 07:40 |
| Tengu | https://review.openstack.org/#/c/579777/ ? | 07:41 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Add toci_jobtype as individual variables https://review.openstack.org/582465 | 07:41 |
| *** jpich has joined #tripleo | 07:42 | |
| chkumar|ruck | https://github.com/openstack/mistral/commit/b45fe9cb42352808c64bc7e9c3ea687ef607e0fc this commit is used there | 07:43 |
| chkumar|ruck | https://review.openstack.org/#/c/579777/ -> is already used there | 07:43 |
| chkumar|ruck | https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-370/undercloud/var/log/extra/rpm-list.txt.gz -> http://openstack-mistral-api-7.0.0-0.20180710104442.b45fe9c.el7.noarch/ | 07:44 |
| ykarel | chkumar|ruck, Tengu seems the issue is seen after that patch, need to find why it's affecting only some fsets | 07:45 |
| chkumar|ruck | ykarel: tripleo-ci-centos-7-scenario003-multinode-oooq-container in this job why it is not detected | 07:46 |
| Tengu | maybe some calls are done without TLS, or something like that? | 07:47 |
| Tengu | can't really help more unfortunately. | 07:47 |
| ykarel | chkumar|ruck, no idea, havent' looked much on it | 07:47 |
| chkumar|ruck | may be something else something is happening | 07:47 |
| *** ykarel is now known as ykarel|lunch | 07:47 | |
| *** Petersingh is now known as Petersingh|lunch | 07:49 | |
| bogdando | owalsh: hi, http://lists.openstack.org/pipermail/openstack-dev/2018-July/132191.html :) | 07:54 |
| bogdando | PTAL | 07:54 |
| bogdando | mwhahaha: ^^ | 07:55 |
| *** jangutter has quit IRC | 07:56 | |
| *** kopecmartin has joined #tripleo | 07:57 | |
| *** holser_ has quit IRC | 07:58 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/ocata: GATE CHECK for TripleO https://review.openstack.org/564291 | 08:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO https://review.openstack.org/564285 | 08:00 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Read 'undercloud' from a yaml file https://review.openstack.org/582466 | 08:04 |
| *** tosky has joined #tripleo | 08:06 | |
| *** jangutter has joined #tripleo | 08:06 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Read 'undercloud' from a yaml file https://review.openstack.org/582466 | 08:07 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Read 'undercloud' from a yaml file https://review.openstack.org/582466 | 08:08 |
| *** zshi has joined #tripleo | 08:09 | |
| *** jd_ has joined #tripleo | 08:09 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Read 'undercloud' from a yaml file https://review.openstack.org/582466 | 08:09 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1781541 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 08:10 |
| openstack | Launchpad bug 1781541 in tripleo "[master][promotion][RDO phase1] Creating overcloud Heat stack failed giving Error([('SSL routines', 'SSL23_GET_SERVER_HELLO', 'unknown protocol')]" [Critical,Triaged] | 08:10 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Use toci scripts as templates for zuulv3 https://review.openstack.org/581331 | 08:10 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Use toci scripts as templates for zuulv3 https://review.openstack.org/581331 | 08:11 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-heat-templates master: [DNM] test new jobs configuration https://review.openstack.org/579653 | 08:11 |
| *** shardy has joined #tripleo | 08:18 | |
| Tengu | damn. on a 6-core + 16G ram, on SSD, the undercloud is slow as hell even for a simple "openstack stack delete overcloud" (previous deploy just failed without deploying anything due to some error on my side) | 08:21 |
| shardy | Tengu: are you running VMs on that 16G box, or is that the actual undercloud? | 08:24 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Add --platform support when uploading images https://review.openstack.org/535619 | 08:25 |
| Tengu | shardy: a VM with 16G on a hardware with 64G, all on SSD | 08:25 |
| Tengu | shardy: the VM is the undercloud | 08:25 |
| shardy | Tengu: ack, that should be plenty | 08:25 |
| *** holser_ has joined #tripleo | 08:25 | |
| shardy | so something must be wrong | 08:25 |
| Tengu | shardy: yep. | 08:25 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP Rerun the init_log for cinder/manila every time and also chown state folder https://review.openstack.org/582456 | 08:26 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP cinder-* bundles and manila-share to not need to be run as root https://review.openstack.org/580127 | 08:29 |
| shardy | d0ugal: Hey could you pls check https://review.openstack.org/#/q/topic:wf_object_exists2+status:open when you get time? | 08:31 |
| shardy | I think those two are ready to merge, I'll add the description requested by rbrady in a follow-up if that's OK, since they've both passed CI | 08:31 |
| d0ugal | shardy: sure | 08:31 |
| *** ykarel|lunch is now known as ykarel | 08:32 | |
| *** moshele has quit IRC | 08:33 | |
| *** gvrangan has quit IRC | 08:33 | |
| *** sileht has quit IRC | 08:36 | |
| *** sileht has joined #tripleo | 08:36 | |
| *** sileht has quit IRC | 08:37 | |
| *** sileht has joined #tripleo | 08:38 | |
| *** ksambor has quit IRC | 08:40 | |
| *** florianf has joined #tripleo | 08:41 | |
| *** moshele has joined #tripleo | 08:41 | |
| *** rcernin has quit IRC | 08:46 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Fix ssl warnings on tempest containerized https://review.openstack.org/580384 | 08:49 |
| *** Haresh has quit IRC | 08:50 | |
| d0ugal | shardy: LGTM! | 08:50 |
| *** Haresh has joined #tripleo | 08:50 | |
| shardy | d0ugal: thanks! | 08:52 |
| chkumar|ruck | sshnaidm|afk: panda|off https://review.openstack.org/#/c/581695/1 please have a look when you have time | 08:52 |
| owalsh | mschuppert: see the msg from bogdando earlier? | 08:53 |
| *** gvrangan has joined #tripleo | 08:53 | |
| bogdando | nice topic, really nice | 08:54 |
| bogdando | loved it) | 08:54 |
| *** waleedm has quit IRC | 08:55 | |
| mschuppert | owalsh: no, checking | 08:56 |
| *** Petersingh|lunch is now known as Petersingh | 08:56 | |
| *** ksambor has joined #tripleo | 08:56 | |
| openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Fix stackviz data https://review.openstack.org/582468 | 08:59 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Fix stackviz installation https://review.openstack.org/580361 | 09:00 |
| *** sshnaidm|afk is now known as sshnaidm|off | 09:00 | |
| *** psachin has joined #tripleo | 09:02 | |
| *** sshnaidm|off has quit IRC | 09:05 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Read 'undercloud' from a yaml file https://review.openstack.org/582466 | 09:07 |
| openstackgerrit | Luigi Toscano proposed openstack/tripleo-heat-templates stable/queens: Add FFU upgrade steps to Sahara services https://review.openstack.org/582472 | 09:08 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-common master: Update user plan with env and settings informations https://review.openstack.org/582473 | 09:08 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add Network Topology diagram https://review.openstack.org/569125 | 09:09 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Warn when some network resources are not available https://review.openstack.org/576113 | 09:09 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update to React 16.4.1 https://review.openstack.org/576844 | 09:09 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Highlight assigned networks and roles on hover https://review.openstack.org/576845 | 09:09 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1781541 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 09:10 |
| openstack | Launchpad bug 1781541 in tripleo "[master][promotion][RDO phase1] Creating overcloud Heat stack failed giving Error([('SSL routines', 'SSL23_GET_SERVER_HELLO', 'unknown protocol')]" [Critical,Triaged] | 09:10 |
| *** slaweq has joined #tripleo | 09:10 | |
| openstackgerrit | Kamil Sambor proposed openstack/python-tripleoclient master: Add fixtures instead mock https://review.openstack.org/579538 | 09:10 |
| numans | bandini, for this patch - https://review.openstack.org/#/c/580127/ | 09:13 |
| * bandini looks | 09:13 | |
| bandini | numans: ack yes? (there is some extra explanationin the depends-on commit message fwiw) | 09:14 |
| numans | bandini, for ovn i was thinking to submit the patch and remove ---user=root | 09:14 |
| numans | bandini, the present status is that, kolla image for ovn-northd, doesn't set any user. | 09:15 |
| openstackgerrit | yatin proposed openstack/tripleo-quickstart master: Use undercloud kernel when not overcloud_as_undercloud https://review.openstack.org/582462 | 09:15 |
| ykarel | holser_, done ^^ | 09:15 |
| bandini | numans: ack, where does ovn log and does it keep on-disk state? | 09:15 |
| numans | so even if we remove --user=root, it will still run as root | 09:15 |
| bandini | ah | 09:15 |
| bandini | ok then yeah it is the simple case | 09:15 |
| numans | bandini, i will submit 2 more patches - one in kolla and add the user openvswitch | 09:15 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Fix HostnameMap lookup - replace str_replace with yaql https://review.openstack.org/582475 | 09:16 |
| numans | bandini, 2. in t-h-t to give proper permissions for the log folder - /var/log/openvswitch/ovn | 09:16 |
| numans | bandini, does that sound good ? | 09:16 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Revert "Removing test from skip list" https://review.openstack.org/582339 | 09:16 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Create classic undercloud hieradata overrides with any cli arg https://review.openstack.org/581180 | 09:16 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Actually use the arch and platform to select appropriate images https://review.openstack.org/535620 | 09:16 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Enforce use-heat=False on 3 jobs https://review.openstack.org/581468 | 09:16 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Reconfigure undercloud args for scenarios https://review.openstack.org/575330 | 09:16 |
| bandini | numans: ack works for me. just mimick something like https://review.openstack.org/#/c/582456 before switching to the user | 09:16 |
| numans | bandini, this would require some testing. but i think there is no harm in removng --user=root from puppet-tripleo. | 09:16 |
| numans | bandini, ack. | 09:17 |
| bandini | numans: yeah, it should be fine. we need to be careful when we change that user | 09:17 |
| numans | bandini, regarding the sysctl value which i raised yesterday. There seems to be a problem :) | 09:17 |
| numans | bandini, i see this error when i added the tag "sysctl::value" | 09:18 |
| numans | Execution of '/usr/sbin/sysctl net.ipv4.ip_nonlocal_bind=1' returned 255: sysctl: setting key \\\"net.ipv4.ip_nonlocal_bind\\\": Read-only file system\", | 09:18 |
| bandini | numans: let me see | 09:18 |
| numans | bandini, so basically we cannot modify the proc sys values from within the container. | 09:18 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP Make sure we chown on-disk state folders for cinder/manila via kolla_start https://review.openstack.org/582456 | 09:18 |
| bandini | numans: we just need to open up the permissions a bit. let me see | 09:19 |
| numans | bandini, i tried that. by running a simple container with -v /proc/sys:/proc/sys:rw but it didn't work | 09:19 |
| bandini | numans: you probably need 'privileged: true' | 09:19 |
| numans | bandini, oh right. i missed that. let me test it out | 09:20 |
| bandini | numans: ack. let me know | 09:20 |
| sri_ | shardy, hi quick question I've three network's in my overcloud External (with default gateway), internal and storage, so I wanted to share tenant network with internal, storage with storage_management, and horizon dashboard on external, is this ServiceNetMap make any sense? http://paste.openstack.org/show/725801/ | 09:21 |
| numans | bandini, http://paste.openstack.org/show/725802/ | 09:22 |
| bandini | oh wow | 09:22 |
| bandini | sec | 09:23 |
| chkumar|ruck | RDO cloud scheduled maintaince is coming | 09:23 |
| bandini | numans: you do not need the -v /proc/sys thing | 09:24 |
| bandini | mmmh let me check | 09:25 |
| numans | bandini, http://paste.openstack.org/show/725803/ | 09:25 |
| numans | bandini, can you chekc the paste again | 09:26 |
| numans | bandini, the thing is that i can modify the proc values but they don't get reflected across the systen | 09:26 |
| *** udesale has quit IRC | 09:27 | |
| bandini | I see, yeah | 09:27 |
| *** udesale has joined #tripleo | 09:27 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Read 'undercloud' from a yaml file https://review.openstack.org/582466 | 09:29 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Run undeploy_plan workflow to delete deployment https://review.openstack.org/566366 | 09:29 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add Recover deployment status button and actions https://review.openstack.org/569092 | 09:29 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: [WIP] List deployment failures on deployment failure https://review.openstack.org/578712 | 09:29 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update patternfly and patternfly-react to latest version https://review.openstack.org/582484 | 09:29 |
| shardy | sri_: you probably don't want to mix neutron tenant traffic with internal api traffic? | 09:30 |
| shardy | and most services already have an external/public endpoint | 09:31 |
| shardy | e.g if tenants need api access they should probably use that, not internal_api? | 09:31 |
| bandini | numans: http://paste.openstack.org/show/725804/ (courtesy of dciabrin) | 09:33 |
| bandini | numans: need --net=host as well (which we normally use already) | 09:33 |
| numans | bandini, oh damn :) | 09:33 |
| bandini | numans: at least we have a solution ;) | 09:34 |
| sri_ | shardy, understood, that was just for testing, i only have three vlans setup in my switch and i don't have access to the switch to crate vlan for tenant network | 09:35 |
| numans | bandini, cool. you think its better to run as a separate container before starting ovn_dbs_init_bundle ? | 09:37 |
| sri_ | shardy, thanks :) | 09:37 |
| numans | bandini, otherwise we have to give privilege permission to ovn-dbs-bundle container | 09:37 |
| numans | bandini, ok. let me test it out and i submit the patch :) | 09:38 |
| numans | bandini, thanks | 09:38 |
| numans | and thanks yo dciabrin_ | 09:38 |
| bandini | numans: I would just switch the ovn_bundle init container to privileged (we already do so haproxy) to keep things a bit simpler | 09:38 |
| bandini | dciabrin_: ^ | 09:38 |
| dciabrin_ | numans, o/ :) | 09:38 |
| numans | bandini, ack. let me do that way | 09:39 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-quickstart master: WIP: Move to openshift-ansible 3.10 https://review.openstack.org/582493 | 09:46 |
| numans | bandini, just one more question - instead of setting the sysctl value from with in the init_bundle, can't we set (or run /usr/bin/sysctl net.ipv4.ip_nonlocal_bind=1) in the 'host_prep_tasks' section in the docker/services/pacemaker/ovn_dbs.yaml file ? (disclaimer - I don't know much about 'host_prep_tasks') | 09:47 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Move to openshift-ansible 3.10 https://review.openstack.org/582495 | 09:47 |
| bandini | numans: yes that works too, ideally you'd remove the sysctl call from puppet-tripleo then | 09:49 |
| numans | bandini, ack. thanks. do you have any preference :) | 09:50 |
| bandini | numans: I am tempted to say the host_prep_tasks is a bit simpler and does not need privileged: true in the init_bundle | 09:52 |
| numans | bandini, i agree. even i feel the same. i would go this way then | 09:52 |
| numans | thanks :) | 09:52 |
| bandini | awesome! | 09:53 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Give neutron ports names: $HOSTNAME_$NETWORKNAME https://review.openstack.org/580776 | 09:54 |
| *** sshnaidm|off has joined #tripleo | 09:55 | |
| *** Haresh has quit IRC | 09:56 | |
| *** panda|off is now known as panda | 10:06 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 10:10 |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1781541 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1781541 in tripleo "[master][promotion][RDO phase1] Creating overcloud Heat stack failed giving Error([('SSL routines', 'SSL23_GET_SERVER_HELLO', 'unknown protocol')]" [Critical,Triaged] | 10:10 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Enable decoupled deployment plans e.g for OpenShift, DPDK etc https://review.openstack.org/574753 | 10:10 |
| bogdando | folks, let's merge please https://review.openstack.org/#/c/581630/ shardy jistr ? | 10:13 |
| *** pdeore_ has joined #tripleo | 10:14 | |
| *** pdeore has quit IRC | 10:14 | |
| *** Petersingh has quit IRC | 10:16 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Read 'undercloud' from a yaml file https://review.openstack.org/582466 | 10:19 |
| lvdombrkr | hello folks | 10:25 |
| holser_ | thanks shardy bogdando | 10:26 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/queens: Increase the step for gnocchi_db_sync https://review.openstack.org/582499 | 10:28 |
| *** slaweq has quit IRC | 10:31 | |
| lvdombrkr | i have 2 nodes deployment on my test env : controller + compute node. my controller server has died and i remove it from lab some time ago. now i want to deploy new overcloud, and question is, can i delete properly old one without controller? | 10:32 |
| lvdombrkr | ? | 10:32 |
| openstackgerrit | Numan Siddique proposed openstack/puppet-tripleo master: Remove setting root user for ovn dbs pacemaker bundle https://review.openstack.org/582500 | 10:34 |
| *** waleedm has joined #tripleo | 10:35 | |
| *** numans_ has joined #tripleo | 10:36 | |
| bogdando | PTAL https://review.openstack.org/#/c/581623/ | 10:36 |
| bogdando | also https://review.openstack.org/#/c/581231/ | 10:37 |
| *** numans has quit IRC | 10:38 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: include error info on resize failures https://review.openstack.org/582501 | 10:38 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Add toci_jobtype as individual variables https://review.openstack.org/582465 | 10:38 |
| *** moshele has quit IRC | 10:39 | |
| Tengu | mandre or florianf - is one of you available for a quick chat about validation ? :) | 10:47 |
| *** waleedm has quit IRC | 10:48 | |
| florianf | Tengu: yup | 10:49 |
| Tengu | florianf: shall we fire up some bluejean? | 10:49 |
| *** waleedm has joined #tripleo | 10:50 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Read 'undercloud' from a yaml file https://review.openstack.org/582466 | 10:50 |
| florianf | Tengu: just sent you the link off-channel | 10:52 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Read 'undercloud' from a yaml file https://review.openstack.org/582466 | 10:52 |
| *** janki has quit IRC | 10:52 | |
| *** jchhatbar has joined #tripleo | 10:52 | |
| *** dtrainor_ has joined #tripleo | 10:55 | |
| *** dtrainor has quit IRC | 10:56 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP: Add pre-upgrade validation step for containerized services. https://review.openstack.org/582502 | 10:57 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Use tmux instead of screen https://review.openstack.org/582503 | 10:58 |
| chkumar|ruck | quiquell: panda arxcruz ^^ | 11:01 |
| quiquell | chkumar|ruck: Nice, will try it !!! | 11:02 |
| chkumar|ruck | quiquell: not sure it is complete perfect | 11:02 |
| quiquell | chkumar|ruck: At least we can try it and debug it | 11:03 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP: Add pre-upgrade validation step for containerized services. https://review.openstack.org/582502 | 11:04 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart-extras master: WIP - Adds new bootstrap-subnodes role instead of tripleo.sh https://review.openstack.org/581026 | 11:06 |
| lvdombrkr | folks can i delete overcloud properly, if one of the nodes are died and not aviable at all at the moment? | 11:08 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 11:10 |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1781541 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1781541 in tripleo "[master][promotion][RDO phase1] Creating overcloud Heat stack failed giving Error([('SSL routines', 'SSL23_GET_SERVER_HELLO', 'unknown protocol')]" [Critical,Triaged] | 11:10 |
| *** janki has joined #tripleo | 11:12 | |
| *** jchhatbar has quit IRC | 11:12 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Read 'undercloud' from a yaml file https://review.openstack.org/582466 | 11:12 |
| *** arxcruz is now known as arxcruz|brb | 11:13 | |
| *** udesale has quit IRC | 11:22 | |
| *** nenad has joined #tripleo | 11:23 | |
| lvdombrkr | anyone around? | 11:26 |
| shardy | lvdombrkr: yes provided you don't have any on-delete configuration, e.g unregistering from a satellite then it should work, but it depends what state the nova/ironic resources are in | 11:28 |
| shardy | if the node isn't responsive via ipmi you might need to manually set the state in ironic | 11:29 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Fix network config conflicts for containerized UC https://review.openstack.org/582508 | 11:29 |
| *** jcoufal has joined #tripleo | 11:30 | |
| *** waleedm has quit IRC | 11:30 | |
| bogdando | mwhahaha, EmilienM: let's merge please https://review.openstack.org/#/c/572404/ | 11:31 |
| bogdando | it runs into new merge conflicts faster than I blink | 11:31 |
| *** edmondsw has joined #tripleo | 11:33 | |
| bogdando | PTAL https://review.openstack.org/#/q/topic:verbose-prepare+(status:open+OR+status:merged) | 11:35 |
| lvdombrkr | shardy: i remove node some time ago, but now i need again my test lab up and running, so need to rebuild overcloud | 11:35 |
| openstackgerrit | Karthik S proposed openstack/os-net-config master: Add sriov_vf type as member of ovs_dpdk_port https://review.openstack.org/582509 | 11:36 |
| lvdombrkr | shardy: what u mean by satellite? | 11:36 |
| shardy | lvdombrkr: I mean unregistering from RHN or a satellite server | 11:37 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/pre_deploy/rhel-registration/rhel-registration.yaml#L62 | 11:37 |
| shardy | sounds like you're not doing that so you just need to ensure the nova resources can be deleted | 11:37 |
| lvdombrkr | shardy: yes i can skip satellite part | 11:38 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Log more details for container images prepare https://review.openstack.org/580959 | 11:39 |
| openstackgerrit | Karthik S proposed openstack/os-net-config master: Add sriov_vf type as member of ovs_dpdk_port https://review.openstack.org/582509 | 11:41 |
| *** rh-jelabarre has joined #tripleo | 11:42 | |
| lvdombrkr | shardy: so i just can run heat stack-delete overcloud ? | 11:43 |
| *** bfournie has quit IRC | 11:44 | |
| shardy | lvdombrkr: you can try, but if the nodes are physically removed you may have to set the ironic power state manually | 11:44 |
| lvdombrkr | shardy: so firstly set power state manually and than run overcloud delete? | 11:45 |
| *** ansmith has quit IRC | 11:51 | |
| *** atoth has joined #tripleo | 11:51 | |
| *** dhill_ has quit IRC | 11:54 | |
| *** jaganathan has quit IRC | 11:56 | |
| *** janki has quit IRC | 11:57 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-common stable/queens: Increase gb_per_osd from 3 to 5 in derive_params_formulas https://review.openstack.org/582515 | 11:58 |
| openstackgerrit | John Fulton proposed openstack/tripleo-common stable/pike: Increase gb_per_osd from 3 to 5 in derive_params_formulas https://review.openstack.org/582516 | 11:58 |
| *** asbishop has joined #tripleo | 11:58 | |
| openstackgerrit | yolanda.robla proposed openstack/python-tripleoclient master: Allow to specify the image type to upload https://review.openstack.org/577799 | 11:59 |
| *** brault has joined #tripleo | 12:03 | |
| *** brault has quit IRC | 12:03 | |
| *** brault has joined #tripleo | 12:04 | |
| *** agopi is now known as agopi|brb | 12:08 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1781541 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 12:10 |
| openstack | Launchpad bug 1781541 in tripleo "[master][promotion][RDO phase1] Creating overcloud Heat stack failed giving Error([('SSL routines', 'SSL23_GET_SERVER_HELLO', 'unknown protocol')]" [Critical,Triaged] | 12:10 |
| *** ratailor has quit IRC | 12:10 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: Initial support for adding cluster nodes to an existing cluster https://review.openstack.org/567537 | 12:11 |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: [WIP] Take featureset out of TOCI_JOBTYPE https://review.openstack.org/582384 | 12:12 |
| *** agopi|brb has quit IRC | 12:13 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Enable decoupled deployment plans e.g for OpenShift, DPDK etc https://review.openstack.org/574753 | 12:13 |
| *** leanderthal has joined #tripleo | 12:13 | |
| *** pdeore_ has quit IRC | 12:14 | |
| ykarel | chkumar|ruck, Tengu i think issue(https://bugs.launchpad.net/tripleo/+bug/1781541) is comming after https://review.openstack.org/#/q/topic:microversion_mixin+(status:open+OR+status:merged), afaic it's affecting ssl + not containerized undercloud deploying overcloud | 12:16 |
| openstack | Launchpad bug 1781541 in tripleo "[master][promotion][RDO phase1] Creating overcloud Heat stack failed giving Error([('SSL routines', 'SSL23_GET_SERVER_HELLO', 'unknown protocol')]" [Critical,Triaged] | 12:16 |
| ykarel | ramishra, ^^ | 12:16 |
| *** brault has quit IRC | 12:16 | |
| ykarel | ramishra, can u check if those creating issue | 12:16 |
| *** brault has joined #tripleo | 12:17 | |
| EmilienM | hi | 12:17 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Update and upgrade tasks for services deployed via external deploy tasks https://review.openstack.org/579170 | 12:17 |
| *** morazi has joined #tripleo | 12:18 | |
| *** panda is now known as panda|lunch | 12:18 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Update and upgrade tasks for services deployed via external deploy tasks https://review.openstack.org/579170 | 12:20 |
| Tengu | ykarel: wow. long reach if this is the case. | 12:20 |
| *** bfournie has joined #tripleo | 12:22 | |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates master: OVN Dbs HA: Set sysctl value 'net.ipv4.ip_nonlocal_bind' to 1 https://review.openstack.org/582520 | 12:22 |
| *** waleedm has joined #tripleo | 12:23 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-common master: Update user plan with env and settings informations https://review.openstack.org/582473 | 12:24 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Enabling cont/uc on scenario001/002 https://review.openstack.org/581183 | 12:25 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP Make sure that stonith state is enforced before attempting a scaleup https://review.openstack.org/582521 | 12:26 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Remove --use-heat usage, as it's deprecated https://review.openstack.org/581534 | 12:26 |
| *** tzumainn has joined #tripleo | 12:26 | |
| nenad | Hi all, I am (still) having issues deploying OSP13, and well now I ran into an error which I cannot find any details on. Any hints on debugging this would be great: resources.WorkflowTasks_Step2_Execution: ERROR resource_type: OS::TripleO::WorkflowSteps. Running openstack stack failures list overcloud does not give any extra info unfortunately... | 12:27 |
| nenad | Oh and yeah trying to deploy with external ceph, without it - the deployment worked. | 12:27 |
| openstackgerrit | Numan Siddique proposed openstack/puppet-tripleo master: Remove unused code in ovn dbs bundle to set the sysctl value https://review.openstack.org/582523 | 12:29 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: update the minimal config for master https://review.openstack.org/582405 | 12:30 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Update yaml files for Dell EMC VNX, Unity drivers https://review.openstack.org/572260 | 12:30 |
| openstackgerrit | Merged openstack/tripleo-common master: Add workflow to select sample plan https://review.openstack.org/577840 | 12:30 |
| openstackgerrit | Merged openstack/tripleo-common master: Select default "openstack" plan when no plan-environment.yaml found https://review.openstack.org/579892 | 12:30 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Fix tempestmail regex https://review.openstack.org/581695 | 12:30 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Add environment/services-baremetal/*. https://review.openstack.org/567797 | 12:30 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Add compute node L3 agent container for DVR https://review.openstack.org/568602 | 12:30 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Switch to using assert_has_calls() instead of assertEqual() https://review.openstack.org/535621 | 12:30 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Add support for configuring additional architectures for heat-based installs https://review.openstack.org/580827 | 12:30 |
| *** medberry has joined #tripleo | 12:31 | |
| *** medberry has quit IRC | 12:31 | |
| *** medberry has joined #tripleo | 12:31 | |
| *** radeks has quit IRC | 12:32 | |
| shardy | nenad: sounds like ceph-ansible failed when running via a mistral workflow, is there a log at /var/log/mistral/ceph-install-workflow.log ? | 12:32 |
| shardy | on the undercloud | 12:32 |
| nenad | shardy I do not think I have that file at all, let me double-check | 12:33 |
| *** dprince has joined #tripleo | 12:33 | |
| EmilienM | folks I've restored things I removed from the gate, sorry for having to do that but the gate was super busy. Now it's fine. Let me know if I missed a patch | 12:33 |
| EmilienM | gate is clear now, weshay | 12:33 |
| shardy | nenad: Ok, OS::TripleO::WorkflowSteps is supposed to run ceph-ansible ref https://github.com/openstack/tripleo-common/blob/master/workbooks/ceph-ansible.yaml#L18 | 12:34 |
| weshay | EmilienM, ha.. was just about to ping you | 12:34 |
| shardy | nenad: if there's no log, I'd check the mistral logs for errors to figure out why it didn't run | 12:34 |
| *** radeks has joined #tripleo | 12:34 | |
| nenad | shardy No, the only files there are api.log, engine.log, executor.log and mistral-db-manage.log (and some gz files of engine and api log...) | 12:34 |
| nenad | shardy so the engine or the executor log (or both heh)? | 12:34 |
| shardy | Yeah I'd check both | 12:34 |
| nenad | Ok, on it. Thanks a lot | 12:35 |
| nenad | Will see if I can find any error there | 12:35 |
| shardy | openstack stack failures list --long overcloud should give you the error, but if not the log is probably the next place to look | 12:35 |
| nenad | shardy that is what I did first | 12:35 |
| nenad | but.. no luck | 12:35 |
| *** moguimar has joined #tripleo | 12:35 | |
| shardy | Hmm Ok | 12:35 |
| nenad | may I paste you the output to priv message so I do not flood the channel (there are 5 or so lines) | 12:36 |
| *** sanjay__u has joined #tripleo | 12:36 | |
| shardy | nenad: you can use paste.openstack.org | 12:36 |
| nenad | oh cool | 12:36 |
| EmilienM | weshay: once we merge https://review.openstack.org/576218 - there is a chance to break something | 12:36 |
| nenad | shardy, http://paste.openstack.org/show/725821/ | 12:37 |
| EmilienM | weshay: in the promotion pipeline or somewhere in check. I might have missed something, if that's the case please ping me and I'll try to fix it or revert | 12:37 |
| bogdando | no way | 12:37 |
| bogdando | :) | 12:37 |
| EmilienM | hehe | 12:37 |
| shardy | nenad: ack yeah that's not super helpful, hopefully the mistral logs will have more clues | 12:37 |
| *** rlandy has joined #tripleo | 12:38 | |
| nenad | shardy yeah.. was trying to dig through resources with openstack stack resource .... but no go there. i will sift through logs and see if I can find something. | 12:38 |
| shardy | nenad: you can also list the mistral workflow executions and look at the status output from those | 12:39 |
| shardy | e.g openstack workflow execution list etc | 12:39 |
| *** radeks has quit IRC | 12:40 | |
| nenad | shardy ok, reading the manpage now, never used mistral cli before. | 12:40 |
| openstackgerrit | Tom Barron proposed openstack/puppet-tripleo stable/queens: Avoid hard-coded settings in Manila HA containers https://review.openstack.org/582526 | 12:41 |
| *** waleedm has quit IRC | 12:43 | |
| *** amoralej is now known as amoralej|lunch | 12:44 | |
| openstackgerrit | Sai Sindhur Malleni proposed openstack/tripleo-heat-templates master: Change default neutron firewall driver to openvswitch https://review.openstack.org/582245 | 12:45 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/queens: healthcheck/memcached: add brackets if ipv6 https://review.openstack.org/582527 | 12:45 |
| *** trown|outtypewww is now known as trown | 12:47 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common stable/queens: ansible: enable pipelining https://review.openstack.org/582528 | 12:48 |
| ramishra | ykarel: yeah, it seems like the reason https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-370/undercloud/var/log/heat/heat-engine.log.gz, but don't know why it should as it's a normal api request from heat to nova | 12:48 |
| *** jcoufal has quit IRC | 12:48 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Fix populate templates dir for mixed UC/OC cases https://review.openstack.org/582529 | 12:51 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Unify custom t-h-t install steps for UC/OC/upgrade https://review.openstack.org/465047 | 12:51 |
| shardy | bogdando: Hi, there seems to be a problem with the vstate dropin path | 12:52 |
| shardy | bogdando: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/undercloud_config.py#L571 | 12:52 |
| shardy | bogdando: http://paste.openstack.org/show/725822/ | 12:52 |
| shardy | it's looking in /usr/share/... despite passing THT_HOME which correctly set --templates | 12:53 |
| shardy | is that a known issue? | 12:53 |
| shardy | all the other environment paths look OK | 12:53 |
| bogdando | shardy: that used to work as I was testing it, od | 12:54 |
| bogdando | odd things | 12:54 |
| shardy | '-e', '/usr/share/openstack-tripleo-heat-templates/undercloud-stack-vstate-dropin.yaml' | 12:54 |
| shardy | it fails because the packaged version is older than the --templates tree | 12:54 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/puppet-tripleo master: remove ssh from tripleo::firewall::pre https://review.openstack.org/582437 | 12:54 |
| bogdando | that file is generated in client, then paths rewritten by usual way | 12:55 |
| bogdando | seems no more rewritten? got changes? | 12:55 |
| * bogdando sigh | 12:55 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates master: teach tripleo-wirewall about the DefaultFirewallRules parameter https://review.openstack.org/582436 | 12:55 |
| shardy | https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/undercloud_config.py#L571 | 12:55 |
| shardy | bogdando: then that's wrong and it should point to the tmpdir? | 12:55 |
| *** panda|lunch is now known as panda | 12:55 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP: Add pre-upgrade validation step for containerized services. https://review.openstack.org/582502 | 12:56 |
| bogdando | shardy: basically, you had passed --templates=/home/stack/tripleo-heat-templates | 12:56 |
| verdurin | My horizon container is stuck in the restarting state, with no longs - any hints as to how to debug? | 12:56 |
| verdurin | no logs | 12:56 |
| bogdando | so that 'or' should not be your case, but you are prolly right, I didn't test if it works w/o --templates passed (it's mandatory for uc/standalone) | 12:57 |
| shardy | bogdando: yes, well I'm running undercloud deploy, but --templates is /home/stack/tripleo-heat-templates, and it's adding -e /usr/share/... | 12:57 |
| ramishra | ykarel: may be some SSL config issue and it's failing for the first request to nova, not related to the patch | 12:57 |
| ramishra | ykarel: Is this happening in all jobs? | 12:57 |
| bogdando | but need to check for the original breakage, right, why it does not rewrite | 12:57 |
| shardy | bogdando: ack, I'm using undercloud install --use-heat, so maybe that's related | 12:57 |
| bogdando | that's basically the way I'm used to test it as well | 12:58 |
| shardy | bogdando: ack, if you can try to reproduce that would be good :) | 12:58 |
| bogdando | I have old env with all logs so I'll check for the dropin path history | 12:58 |
| *** shardy is now known as shardy_mtg | 12:59 | |
| *** links has quit IRC | 12:59 | |
| ykarel | ramishra, afaic it's happening to jobs with ssl non containerized undercloud deploying overcloud | 13:00 |
| ykarel | ramishra, looks like haproxy is redirecting this to https | 13:00 |
| bogdando | shardy_mtg: no, checked that, it's ok. The trick is that path gets rewritten later | 13:00 |
| shardy_mtg | bogdando: ack, well it's failing for me as it can't find that file | 13:01 |
| ramishra | ykarel: yeah possibly, that's just a normal request from heat using novaclient, so probably nothing wrong with that patch | 13:02 |
| ykarel | ramishra, but request after that patch has changed | 13:03 |
| *** ansmith has joined #tripleo | 13:03 | |
| ykarel | like earlier it used to hit flavor request but now nova base | 13:03 |
| chkumar|ruck | ykarel: feel free to update the finding on the bug, thanks :-) | 13:04 |
| ramishra | ykarel: yes, now we create a proper microversioned client | 13:04 |
| nenad | shardy_mtg, I dug through the logs and a bit through mistral CLI and ran into an error around 'create_admin', here's a pastebin: http://paste.openstack.org/show/725828/ (maaaay be related to SSL and I will try to modify CAMap). Sorry for bothering you ona meeting, and thanks again :) | 13:04 |
| ramishra | ealier it used to be the base version for all requests unless specified, just a normal request, may need some configuration in haproxy I suppose | 13:04 |
| ykarel | ramishra, possibly | 13:05 |
| slagle | weshay: where is the grafana for tripleo? | 13:05 |
| ykarel | chkumar|ruck, have u reproduced this? | 13:05 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates master: teach tripleo-firewall about the DefaultFirewallRules parameter https://review.openstack.org/582436 | 13:06 |
| chkumar|ruck | ykarel: nope I was debugging object storage one, let me fire the reproducer | 13:06 |
| slagle | weshay: found it. i think | 13:06 |
| openstackgerrit | David Peacock proposed openstack/tripleo-validations master: add initial role for containerized undercloud validations https://review.openstack.org/577397 | 13:07 |
| ykarel | chkumar|ruck, okk, once you reproduce try revert for https://review.openstack.org/#/c/556810/ patch | 13:07 |
| ykarel | to confirm if that's the issue | 13:07 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 13:10 |
| *** mcornea has joined #tripleo | 13:11 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Increase the step for gnocchi_db_sync https://review.openstack.org/581630 | 13:11 |
| *** gvrangan has quit IRC | 13:12 | |
| weshay | matbu, https://review.openstack.org/#/c/575862/ | 13:14 |
| *** ramishra has quit IRC | 13:15 | |
| weshay | mwhahaha++ nice work on the standalone | 13:16 |
| *** agopi|brb has joined #tripleo | 13:16 | |
| *** agopi|brb is now known as agopi | 13:16 | |
| mwhahaha | weshay, matbu: https://review.openstack.org/#/c/581903/ to reduce the list of default services, just fyi | 13:16 |
| mwhahaha | you can still use -e <files> to enable them | 13:17 |
| *** medberry has quit IRC | 13:17 | |
| *** bnemec has joined #tripleo | 13:18 | |
| beagles | bogdando: re: https://bugs.launchpad.net/tripleo/+bug/1780139 can copytruncate be made to work for logrotate when it comes to neutron? | 13:19 |
| openstack | Launchpad bug 1780139 in tripleo "Sending SIGHUP to neutron-server process causes it to hang" [Critical,Triaged] | 13:19 |
| chkumar|ruck | mwhahaha: where can i look for syslogs related to swift logs? i tried finding yesterday but not able to find out for example this one http://logs.openstack.org/18/581918/5/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/3cf2734/logs/ | 13:19 |
| trown | mwhahaha: where is the stackrc ending up for the standalone deploy? | 13:19 |
| *** yrabl has joined #tripleo | 13:20 | |
| beagles | bogdando: I'm not sure we can rely on a neutron-fix to resolve this in the near term | 13:20 |
| mwhahaha | trown: there is no stackrc. clouds.yaml is used | 13:20 |
| trown | mwhahaha: hmm how does one use that to interact with the deployed cloud? ie I want to launch an instance on the standalone cloud | 13:21 |
| *** mdnadeem_ has quit IRC | 13:21 | |
| mwhahaha | trown: https://review.openstack.org/#/c/581552/ | 13:21 |
| mwhahaha | see docs update | 13:21 |
| trown | mwhahaha: awesome, thanks! | 13:21 |
| mwhahaha | trown: basically just export OS_CLOUD=standalone | 13:21 |
| mwhahaha | and start using openstack commands | 13:21 |
| trown | trying to use that as a base for tenant deployed openshift | 13:21 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Move to openshift-ansible 3.10 https://review.openstack.org/582495 | 13:22 |
| bandini | asbishop: one interesting thing I noted while working on https://review.openstack.org/#/c/580127/ is that cinder-backup aloready does the chown on kolla_start (see https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/pacemaker/cinder-backup.yaml#L142) | 13:22 |
| mwhahaha | chkumar|ruck: http://logs.openstack.org/18/581918/5/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/3cf2734/logs/subnode-2/var/log/journal.txt.gz | 13:22 |
| mwhahaha | chkumar|ruck: look for "container-server" and "object-server" | 13:23 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/pike: Increase the step for gnocchi_db_sync https://review.openstack.org/582541 | 13:23 |
| mwhahaha | chkumar|ruck: thats the swift logs | 13:23 |
| *** ramishra has joined #tripleo | 13:23 | |
| asbishop | bandini: hmm, I see, and yet c-vol file only chowns the log dir | 13:26 |
| openstackgerrit | John Fulton proposed openstack/tripleo-common master: WIP/DNM: Persist ceph-ansible fetch_directory https://review.openstack.org/567782 | 13:26 |
| bandini | asbishop: yeah, I was a bit surprised (saw it while preparing https://review.openstack.org/#/c/582456/) | 13:26 |
| *** shardy_mtg is now known as shardy | 13:26 | |
| ykarel | weshay, EmilienM any idea where 66.187.229.139 is hosted and why it's down | 13:27 |
| *** assassin has quit IRC | 13:28 | |
| *** brault has quit IRC | 13:28 | |
| fultonj | d0ugal rbrady would you mind helping me find what's wrong with my mock test between lines 108 and 121 of https://review.openstack.org/#/c/567782/10/tripleo_common/tests/actions/test_files.py | 13:28 |
| *** dparkes has quit IRC | 13:28 | |
| asbishop | bandini: non-pacemaker version of c-bak.yaml also chowns /var/lib/cinder :-/ | 13:29 |
| *** asbishop is now known as abishop | 13:29 | |
| fultonj | i inserted comments on what the issue seems to be; i mocked a return value for os.listdir but my code still behaves as if it was returning an empty list | 13:29 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Add toci_jobtype as individual variables https://review.openstack.org/582465 | 13:30 |
| EmilienM | ykarel: no idea | 13:31 |
| ykarel | ack, may be ci team know, weshay any idea? | 13:31 |
| *** assassin has joined #tripleo | 13:32 | |
| bandini | abishop: meh not sure how this inconsistency came to be. let's wait for the core guys, I am kind of inclined to think that the chown is fine? | 13:32 |
| fultonj | python is mocking me :) | 13:34 |
| *** moguimar_ has joined #tripleo | 13:34 | |
| abishop | bandini: I think all of us are hoping the chown is fine. I raised the issue in our squad mtg, and it causes them to start rubbing their chins | 13:34 |
| fultonj | any tripleo-common cores around to help w/ https://review.openstack.org/#/c/567782/10/tripleo_common/tests/actions/test_files.py | 13:35 |
| *** skramaja has quit IRC | 13:35 | |
| bandini | abishop: :) | 13:35 |
| *** moguimar_ has quit IRC | 13:35 | |
| *** moguimar has quit IRC | 13:35 | |
| *** moguimar has joined #tripleo | 13:36 | |
| d0ugal | fultonj: looking | 13:37 |
| fultonj | thanks! | 13:37 |
| abishop | bandini: but here's something else I don't understand (it's a long list). when switching from baremetal to containers, I would think the chown would *always* be necessary because cinder's UID changes inside the container | 13:37 |
| shardy | bogdando: https://bugs.launchpad.net/tripleo/+bug/1781600 raised to track the issue mentioned | 13:37 |
| openstack | Launchpad bug 1781600 in tripleo "undercloud install fails with non-default template path" [High,Triaged] | 13:37 |
| d0ugal | fultonj: I said to the creator of mock one that I should use it more often, he offered to mock me if I wanted :) | 13:37 |
| *** quiquell is now known as quiquell|lunch | 13:38 | |
| fultonj | :) | 13:38 |
| bandini | abishop: right. we probably did not hit the issue due to the fact that it runs as root (or the upgrade was not all too tested?) | 13:38 |
| *** moguimar has quit IRC | 13:39 | |
| bandini | but I presume the former is the case | 13:39 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: include domain name into clouds.yaml https://review.openstack.org/582546 | 13:39 |
| abishop | bandini: perhaps, but only when HA (in non-HA c-vol runs as cinder!) | 13:40 |
| *** assassin has quit IRC | 13:41 | |
| d0ugal | fultonj: I commented on what is likely the issue, but I've not finished reading it yet | 13:41 |
| *** assassin has joined #tripleo | 13:41 | |
| bandini | abishop: probably, yes | 13:41 |
| weshay | ykarel, panda ping.. re: 66.187.229.139 | 13:41 |
| fultonj | decorators! | 13:41 |
| fultonj | :) | 13:41 |
| weshay | ykarel, ya.. I saw that.. I think panda was in the git blame for that | 13:41 |
| weshay | maybe he knows | 13:41 |
| *** psachin has quit IRC | 13:42 | |
| panda | weshay: the image server ? | 13:42 |
| d0ugal | fultonj: indeed, I like to remember it like you are peeling an onion | 13:43 |
| weshay | panda, master-tripleo-ci.yml:22:overcloud_image_url: http://66.187.229.139/builds-master/current-tripleo/overcloud-full.tar | 13:43 |
| weshay | master-tripleo-ci.yml:23:ipa_image_url: http://66.187.229.139/builds-master/current-tripleo/ironic-python-agent.tar | 13:43 |
| fultonj | d0ugal++ | 13:43 |
| fultonj | that's what i needed | 13:43 |
| * fultonj is back on track | 13:43 | |
| fultonj | thank you | 13:43 |
| *** peereb has quit IRC | 13:44 | |
| d0ugal | np | 13:44 |
| bogdando | beagles: yea, we prolly can't, given that the sighup support for openstack bug now has a 4 years old and still incomplete for neutron :) | 13:46 |
| panda | weshay: sorry, what's the question ? that's the ip of the old images server in rh1 | 13:46 |
| bogdando | https://bugs.launchpad.net/oslo-incubator/+bug/1276694 | 13:46 |
| openstack | Launchpad bug 1276694 in Murano "Openstack services should support SIGHUP signal" [Medium,Confirmed] - Assigned to Alexander Tivelkov (ativelkov) | 13:46 |
| beagles | bogdando: yep | 13:47 |
| bogdando | I'm nost sure how to fix that, ofc we can try with copy truncate, and a separate logrotate template for neutron | 13:48 |
| *** raildo has joined #tripleo | 13:48 | |
| *** moguimar has joined #tripleo | 13:48 | |
| bogdando | but let's try to not change things for logrotate globally to all openstack services cuz of neutron | 13:48 |
| weshay | panda, ykarel AH | 13:48 |
| weshay | ykarel, I think rh1 just went down | 13:49 |
| beagles | bogdando: right | 13:49 |
| *** rmascena has joined #tripleo | 13:50 | |
| *** moguimar has quit IRC | 13:51 | |
| *** moguimar has joined #tripleo | 13:51 | |
| *** rmascena__ has joined #tripleo | 13:51 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Move to openshift-ansible 3.10 https://review.openstack.org/582495 | 13:52 |
| *** raildo has quit IRC | 13:53 | |
| *** raildo has joined #tripleo | 13:54 | |
| *** rmascena has quit IRC | 13:55 | |
| *** cshastri has quit IRC | 13:55 | |
| *** rmascena__ has quit IRC | 13:57 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-quickstart master: Move to openshift-ansible 3.10 https://review.openstack.org/582493 | 13:57 |
| openstackgerrit | yolanda.robla proposed openstack/python-tripleoclient master: Allow to specify the image type to upload https://review.openstack.org/577799 | 13:57 |
| *** raildo_ has joined #tripleo | 13:57 | |
| *** colonwq has quit IRC | 13:59 | |
| *** raildo has quit IRC | 14:00 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Composable networks - L3 routed networks (3/3) https://review.openstack.org/582301 | 14:00 |
| *** dprince has quit IRC | 14:00 | |
| *** artom has quit IRC | 14:01 | |
| ykarel | weshay, panda ack | 14:02 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Respect THT_HOME for vstate dropin file https://review.openstack.org/582580 | 14:02 |
| shardy | bogdando: ^^ that fixes the issue for me | 14:02 |
| weshay | ykarel, I'm patching now | 14:02 |
| weshay | re: 66. | 14:02 |
| ykarel | weshay, ack | 14:02 |
| *** raildo_ has quit IRC | 14:02 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Composable networks - L3 routed networks (3/3) https://review.openstack.org/582301 | 14:02 |
| *** pradk- has joined #tripleo | 14:03 | |
| mwhahaha | shardy: so i don't think we want it in the templates folder but rather our install templates? | 14:03 |
| bogdando | shardy: oh my, thanks for th quick fix! I was getting prepared to the desperate fight with that path rewriter, once again... | 14:03 |
| shardy | mwhahaha: yeah, I think the path gets rewritten later when the copy to the working dir happens | 14:03 |
| mwhahaha | shardy: hmm ok | 14:03 |
| shardy | but because it's pointing at /usr/share even when THT_HOME is set that breaks | 14:03 |
| mwhahaha | shardy: but tht_templates should be what you've changed it to | 14:04 |
| mwhahaha | so i wonder if something else is happening | 14:04 |
| mwhahaha | shardy: see block around https://review.openstack.org/#/c/582580/1/tripleoclient/v1/undercloud_config.py@326 | 14:04 |
| openstackgerrit | Sai Sindhur Malleni proposed openstack/tripleo-heat-templates master: Change default neutron firewall driver to openvswitch https://review.openstack.org/582245 | 14:05 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: update image url for tripleo builds outside of ci https://review.openstack.org/582581 | 14:05 |
| shardy | https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/undercloud_config.py#L330 | 14:05 |
| mwhahaha | shardy: oh wait sorry i had it flipped, you're right | 14:05 |
| * mwhahaha is having a backwards day | 14:05 | |
| *** rbrady has quit IRC | 14:05 | |
| *** pradk has quit IRC | 14:05 | |
| shardy | mwhahaha: I think the issue is the conf object doesn't have THT_HOME, so we need to refer to tht_templates which does consider that | 14:05 |
| *** ykarel is now known as ykarel|away | 14:05 | |
| bogdando | that path rewriter is mind blowing, so no worries | 14:05 |
| bogdando | mental, as they say :D | 14:06 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: update image url for tripleo builds outside of ci https://review.openstack.org/582581 | 14:07 |
| *** raildo has joined #tripleo | 14:07 | |
| *** jcoufal has joined #tripleo | 14:08 | |
| bogdando | shardy: will place +2 once CI passed :) | 14:09 |
| shardy | bogdando: ack, thanks | 14:09 |
| * shardy needs to check if unit tests still pass | 14:09 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 14:10 |
| *** marrusl has joined #tripleo | 14:10 | |
| *** raildo_ has joined #tripleo | 14:10 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Read 'undercloud' from a yaml file https://review.openstack.org/582466 | 14:11 |
| *** colonwq has joined #tripleo | 14:12 | |
| *** raildo has quit IRC | 14:13 | |
| *** raildo_ is now known as raildo | 14:13 | |
| bogdando | PTAL https://review.openstack.org/#/c/582508/ | 14:15 |
| bogdando | also https://review.openstack.org/#/c/582529/ please, mwhahaha - this mostly updates your initial code | 14:16 |
| *** dprince has joined #tripleo | 14:16 | |
| bogdando | folks, wanted to ask you please keep an eye on https://review.openstack.org/#/c/572404/ and merge it once rdo ci rechecked | 14:17 |
| bogdando | that patch cannot leave longer than a moment w/o running into a merge conflict | 14:18 |
| bogdando | live* | 14:18 |
| mwhahaha | well we stopped merging things it was conflicting with :D (some where yours) | 14:18 |
| bogdando | :D yeah, I know | 14:18 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-common master: Generate rndc key in password list https://review.openstack.org/582366 | 14:18 |
| *** numans_ has quit IRC | 14:19 | |
| bogdando | EmilienM, slagle: PTAL https://review.openstack.org/#/c/581623/ | 14:19 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: reproducer: fix install without virtualenv https://review.openstack.org/582599 | 14:20 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Update/upgrade commands for services with external installers https://review.openstack.org/582284 | 14:20 |
| bogdando | aaand one more https://review.openstack.org/#/c/581231/ | 14:20 |
| bogdando | stevebaker: ^^ | 14:20 |
| bogdando | and https://review.openstack.org/#/c/581049/ :) | 14:20 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: use fs config to assign standalone role, tests https://review.openstack.org/572830 | 14:20 |
| bogdando | I think that's it for today :) | 14:20 |
| bogdando | thanks! | 14:20 |
| *** quiquell|lunch is now known as quiquell | 14:21 | |
| *** dprince has quit IRC | 14:21 | |
| *** dprince has joined #tripleo | 14:21 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: make quickstart.sh more user friendly with pip errors https://review.openstack.org/581789 | 14:23 |
| *** numans has joined #tripleo | 14:24 | |
| slagle | bogdando: it's approved, left you some comments though | 14:24 |
| slagle | bogdando: it'd be nice if the output was consistent between tripleo deploy and overcloud deploy | 14:24 |
| *** bogdando has quit IRC | 14:25 | |
| *** yprokule has quit IRC | 14:26 | |
| bfournie | EmilienM, shardy: if you have a chance, these stable/queens backports could use some reviews to land - https://review.openstack.org/#/c/579346/ and https://review.openstack.org/#/c/580371/ | 14:29 |
| bfournie | thanks | 14:29 |
| *** bnemec has quit IRC | 14:29 | |
| *** zaneb has quit IRC | 14:30 | |
| EmilienM | bfournie: of course | 14:30 |
| *** artom has joined #tripleo | 14:30 | |
| EmilienM | dsneddon_: if it's a backport, you can self approve it if it's a core reviewer submitting the backport | 14:31 |
| EmilienM | https://github.com/openstack/tripleo-specs/blob/master/specs/policy/expedited-approvals.rst#single-2-approvals | 14:31 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/queens: ansible: enable pipelining https://review.openstack.org/582528 | 14:34 |
| bfournie | EmilienM: thanks! | 14:34 |
| *** ksambor has quit IRC | 14:35 | |
| EmilienM | slagle: sorry I didn't see you backported this one | 14:35 |
| bfournie | EmilienM: actually one more stable/queens tht backport, not sure dsneddon_ can self approve as I did backport - https://review.openstack.org/#/c/580464/ | 14:38 |
| *** raildo_ has joined #tripleo | 14:39 | |
| EmilienM | bfournie: approved | 14:39 |
| *** ykarel|away is now known as ykarel | 14:39 | |
| EmilienM | bfournie: the policy makes so you could have approved yourself after Dan's +2 but it's always good to ask for second pair of eyes :) | 14:39 |
| *** bnemec has joined #tripleo | 14:41 | |
| *** raildo has quit IRC | 14:41 | |
| *** shardy has quit IRC | 14:46 | |
| EmilienM | weshay: do you mind to share (again) the links of the grafana dashboard where we track the tasks from oooq please? | 14:49 |
| EmilienM | (the ara data) | 14:49 |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: Add container images for CNS https://review.openstack.org/582609 | 14:49 |
| bfournie | EmilienM: thanks, I didn't think I had the power! | 14:49 |
| weshay | EmilienM, http://38.145.34.131:3000/d/pgdr_WVmk/ruck-rover?orgId=1 ? | 14:50 |
| weshay | EmilienM, http://38.145.34.131:3000/d/2kHMNHvik/exploration?orgId=1 | 14:50 |
| EmilienM | weshay: when can we have a proper dns for this one... | 14:50 |
| Tengu | :D | 14:50 |
| weshay | EmilienM, don't know | 14:50 |
| EmilienM | weshay: now maybe | 14:51 |
| *** lvdombrkr has quit IRC | 14:51 | |
| Tengu | weshay: thank you! I'll add them to my bookmark | 14:51 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Set container images for CNS https://review.openstack.org/582610 | 14:51 |
| EmilienM | grafana.tripleo.org ? | 14:51 |
| weshay | EmilienM, need to speak to apevec about it | 14:51 |
| Tengu | EmilienM: metrics.tripleo.org in order to not stick to the application? | 14:51 |
| EmilienM | weshay: what's the exact URL for ara tasks again? | 14:51 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: ceilometer: deprecation cleanup https://review.openstack.org/577797 | 14:51 |
| *** amoralej|lunch is now known as amoralej | 14:52 | |
| weshay | EmilienM, OH | 14:52 |
| weshay | sec | 14:52 |
| EmilienM | weshay: yeah it would be great to have a dns asap, tbh... so we can easily remember how to access this, please | 14:53 |
| weshay | EmilienM, https://review.rdoproject.org/grafana/dashboard/db/tripleo-ci?orgId=1 | 14:53 |
| EmilienM | Tengu: see ^ | 14:53 |
| weshay | EmilienM, we're waiting on a sf upgrade | 14:53 |
| *** sileht has quit IRC | 14:53 | |
| Tengu | weshay: EmilienM thank you! now I have to learn how to use those dashboards :). | 14:54 |
| Tengu | weshay: sf, as in "sourceforge"? :D | 14:54 |
| EmilienM | weshay: to have DNS for 38.145.34.131 ? I don't get it | 14:54 |
| weshay | lolz | 14:54 |
| weshay | software factory | 14:54 |
| Tengu | oh. | 14:54 |
| Tengu | please, don't hurt me for the confusion | 14:54 |
| *** brault has joined #tripleo | 14:55 | |
| *** homeski has joined #tripleo | 14:56 | |
| homeski | If anyone can help ... I have a tripleo install that won't let me run updates anymore | 14:56 |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: Switch the undercloud to be containerized by default https://review.openstack.org/576218 | 14:57 |
| homeski | I was playing with custom roles and now keep getting errors right after the plan validation | 14:57 |
| homeski | 2018-07-13 14:21:11Z [overcloud]: UPDATE_FAILED The Parameter (ComputeCustomRoleServices) was not provided. | 14:57 |
| homeski | any tips on what I can try to do? It seems some existing heat/mistral service is looking for resource that doesn't exist anymore | 14:58 |
| *** avivgt has quit IRC | 14:59 | |
| *** atoth has quit IRC | 15:00 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: prohibit inlined docker_config_scripts https://review.openstack.org/582615 | 15:01 |
| *** leanderthal has quit IRC | 15:02 | |
| openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo master: Remove table 17 from OVS OF pipeline sync https://review.openstack.org/582616 | 15:03 |
| *** medberry has joined #tripleo | 15:08 | |
| *** medberry has quit IRC | 15:08 | |
| *** medberry has joined #tripleo | 15:08 | |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Drop obsolete `overcloud ceph-upgrade run` https://review.openstack.org/582619 | 15:08 |
| *** quiquell is now known as quiquell|off | 15:08 | |
| Tengu | so. have a great weekend. See you on Monday. | 15:08 |
| *** brault has quit IRC | 15:09 | |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 15:10 |
| *** brault has joined #tripleo | 15:10 | |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: [WIP] Take featureset out of TOCI_JOBTYPE https://review.openstack.org/582384 | 15:12 |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: [WIP] Take environment_type out of TOCI_JOBTYPE https://review.openstack.org/582385 | 15:12 |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: [WIP] Take nodes out of TOCI_JOBTYPE https://review.openstack.org/582386 | 15:12 |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: [WIP] Take periodic and dryrun out of TOCI_JOBTYPE https://review.openstack.org/582387 | 15:12 |
| *** ramishra has quit IRC | 15:12 | |
| *** brault has quit IRC | 15:14 | |
| *** bnemec has quit IRC | 15:15 | |
| *** yolanda__ has joined #tripleo | 15:16 | |
| *** bdodd has quit IRC | 15:17 | |
| *** bdodd has joined #tripleo | 15:18 | |
| *** EmilienM is now known as EvilienM | 15:18 | |
| *** yolanda_ has quit IRC | 15:18 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Composable networks - L3 routed networks (3/3) https://review.openstack.org/582301 | 15:19 |
| *** bnemec has joined #tripleo | 15:19 | |
| *** tesseract has quit IRC | 15:21 | |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: Switch the undercloud to be containerized by default https://review.openstack.org/576218 | 15:22 |
| *** ykarel is now known as ykarel|away | 15:23 | |
| openstackgerrit | Martin Schuppert proposed openstack/puppet-tripleo master: WIP - Move nova-metadata api to httpd wsgi https://review.openstack.org/582622 | 15:24 |
| *** yamahata has joined #tripleo | 15:25 | |
| *** rpioso|afk is now known as rpioso | 15:25 | |
| *** arxcruz|brb is now known as arxcruz | 15:26 | |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: WIP - Move nova-metadata api to httpd wsgi https://review.openstack.org/582623 | 15:26 |
| EvilienM | mschuppert: hey, would you be willing to also switch puppet-openstack-integration? | 15:27 |
| mschuppert | EvilienM: yes will look into that | 15:31 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Drop obsolete environment for `overcloud ceph-upgrade run` https://review.openstack.org/582624 | 15:32 |
| EvilienM | mschuppert: thanks a lot | 15:36 |
| EvilienM | mschuppert: ask me for help if needed | 15:36 |
| EvilienM | or review, etc | 15:36 |
| *** jfrancoa has quit IRC | 15:36 | |
| mschuppert | EvilienM: we just need the same as we have for placement in https://github.com/openstack/puppet-openstack-integration/blob/master/manifests/nova.pp#L145 , right? | 15:38 |
| EvilienM | mschuppert: yeah | 15:39 |
| EvilienM | nothing fancy I think | 15:39 |
| mschuppert | EvilienM: yes, will do that | 15:39 |
| *** agopi is now known as agopi|brb | 15:40 | |
| EvilienM | nice | 15:41 |
| *** assassin has quit IRC | 15:42 | |
| openstackgerrit | Martin Schuppert proposed openstack/puppet-tripleo master: New profile to configure libvirt-guests on compute host https://review.openstack.org/580351 | 15:42 |
| *** aufi has quit IRC | 15:42 | |
| EvilienM | mwhahaha, slagle, dprince : I had to update unit tests in the rebase, could I have a review again on https://review.openstack.org/#/c/576218/ please - and maybe we can land that today. | 15:44 |
| *** v1a4 has joined #tripleo | 15:45 | |
| *** assassin has joined #tripleo | 15:45 | |
| *** sileht has joined #tripleo | 15:46 | |
| *** assassin has quit IRC | 15:49 | |
| *** kopecmartin has quit IRC | 15:49 | |
| *** slaweq has joined #tripleo | 15:49 | |
| *** ykarel|away has quit IRC | 15:52 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Switch Cisco ML2 plugint to config-download interface https://review.openstack.org/582626 | 15:54 |
| openstackgerrit | Honza Pokorny proposed openstack/tempest-tripleo-ui master: Add basic project structure https://review.openstack.org/575730 | 15:58 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 16:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 16:00 |
| *** alee has quit IRC | 16:00 | |
| Tengu | EvilienM: for what I can see the unit tests are ok :) | 16:00 |
| EvilienM | Tengu: thx | 16:01 |
| *** jpich has quit IRC | 16:02 | |
| Tengu | that said, I think I remember a review wanting to move part of the "mock" to a fixtures thingy. | 16:02 |
| *** ccamacho has quit IRC | 16:05 | |
| *** jcoufal has quit IRC | 16:06 | |
| *** atoth has joined #tripleo | 16:07 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: Remove forgotten values from heat-api-cloudwatch https://review.openstack.org/581235 | 16:07 |
| *** mjturek has joined #tripleo | 16:07 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 16:10 |
| *** mschuppert has quit IRC | 16:10 | |
| *** homeski has quit IRC | 16:13 | |
| *** artom has quit IRC | 16:14 | |
| *** jcoufal has joined #tripleo | 16:15 | |
| *** holser_ has quit IRC | 16:24 | |
| *** _v1a4_ has joined #tripleo | 16:26 | |
| openstackgerrit | Merged openstack/tripleo-ha-utils master: Fix iptables insert command from -A to -I https://review.openstack.org/579087 | 16:29 |
| *** amoralej is now known as amoralej|off | 16:30 | |
| *** v1a4 has quit IRC | 16:30 | |
| openstackgerrit | Merged openstack/tripleo-ha-utils master: Fix custom STONITH compute names in IHA playbook https://review.openstack.org/580725 | 16:30 |
| *** v1a4 has joined #tripleo | 16:31 | |
| *** _v1a4_ has quit IRC | 16:31 | |
| *** homeski has joined #tripleo | 16:32 | |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: Remove unused clients from container images https://review.openstack.org/582637 | 16:34 |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: Remove unused clients from container images https://review.openstack.org/582637 | 16:34 |
| *** homeski has quit IRC | 16:37 | |
| *** bnemec has quit IRC | 16:37 | |
| *** athomas_ has quit IRC | 16:39 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common stable/queens: Raise ansible forks to 25 https://review.openstack.org/582364 | 16:41 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common stable/queens: Enable ControlMaster for ansible ssh https://review.openstack.org/582368 | 16:41 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common stable/queens: Improve ssh connection handling https://review.openstack.org/582369 | 16:41 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common stable/queens: Allow for more overhead in zaqar message https://review.openstack.org/582375 | 16:41 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common stable/queens: Use ansible_hostname https://review.openstack.org/582419 | 16:41 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common stable/queens: Write to /etc/ssh with super user privileges https://review.openstack.org/582420 | 16:41 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common stable/queens: Fix ssh_known_hosts format https://review.openstack.org/582421 | 16:41 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common stable/queens: ansible: enable pipelining https://review.openstack.org/582528 | 16:41 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common stable/queens: Retry previously failed deployments https://review.openstack.org/582638 | 16:41 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common stable/queens: Allow exit code of 0 only for deployments https://review.openstack.org/582639 | 16:41 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common stable/queens: Ignore errors when checking result of previous deployments https://review.openstack.org/582640 | 16:41 |
| *** mjturek has quit IRC | 16:41 | |
| *** bnemec has joined #tripleo | 16:45 | |
| *** dhill_ has joined #tripleo | 16:50 | |
| *** bnemec has quit IRC | 16:53 | |
| *** shreshtha has quit IRC | 16:55 | |
| *** gkadam has quit IRC | 16:55 | |
| *** artom has joined #tripleo | 16:57 | |
| *** moguimar has quit IRC | 16:59 | |
| EvilienM | weshay: so my patch will break upgrade job | 17:07 |
| EvilienM | https://review.openstack.org/#/c/576218/ | 17:07 |
| weshay | which patch | 17:07 |
| * weshay looks | 17:07 | |
| EvilienM | see http://logs.openstack.org/18/576218/22/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/549c009/ | 17:07 |
| weshay | EvilienM, well.. at least we have the job | 17:07 |
| EvilienM | somehow the undercloud isn't deployed | 17:08 |
| weshay | hrm | 17:08 |
| *** moguimar has joined #tripleo | 17:08 | |
| EvilienM | http://logs.openstack.org/18/576218/22/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/549c009/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-07-11_00_02_44 | 17:08 |
| weshay | EvilienM, I've seen that elsewhere | 17:08 |
| weshay | sec | 17:08 |
| EvilienM | this is the error | 17:09 |
| * weshay looking for why.. think it's a setting | 17:09 | |
| EvilienM | I think the templates generated in /home/zuul/tripleo-heat-installer-templates are not the one from master | 17:09 |
| *** jcoufal has quit IRC | 17:09 | |
| *** social has quit IRC | 17:09 | |
| EvilienM | http://logs.openstack.org/18/576218/22/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/549c009/logs/undercloud/home/zuul/tripleo-heat-installer-templates/net-config-bridge.yaml.txt.gz | 17:09 |
| EvilienM | heat_template_version: queens | 17:10 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 17:10 |
| EvilienM | yeah we deploy queens, but we should deploy rocky, afik | 17:10 |
| weshay | EvilienM, -e /usr/share/openstack-tripleo-heat-templates/environments/config-download-environment.yaml | 17:10 |
| weshay | I think fs052 is missing that | 17:10 |
| EvilienM | http://logs.openstack.org/18/576218/22/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/549c009/logs/undercloud/home/zuul/install_packages.sh.log.txt.gz#_2018-07-10_23_47_25 | 17:10 |
| EvilienM | no it's not that | 17:10 |
| EvilienM | it's the version of repos we deploy I think | 17:10 |
| weshay | guess that is default | 17:11 |
| weshay | isn't this starting at queens though | 17:11 |
| weshay | http://logs.openstack.org/18/576218/22/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/549c009/logs/undercloud/home/zuul/repo_setup.sh.txt.gz | 17:11 |
| EvilienM | the undercloud should be rocky | 17:12 |
| EvilienM | and the overcloud queens, then upgraded | 17:12 |
| weshay | EvilienM, ya. .it does say mixed_upgrade: true | 17:12 |
| weshay | so ya | 17:12 |
| EvilienM | it's deploying 9.0.0-0.20180713150301.e120a5e | 17:13 |
| EvilienM | http://logs.openstack.org/18/576218/24/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/589c1d8/logs/undercloud/home/zuul/install_packages.sh.log.txt.gz#_2018-07-13_15_46_25 | 17:13 |
| *** moguimar has quit IRC | 17:13 | |
| EvilienM | which is trunk | 17:13 |
| weshay | wtf hash is this? | 17:14 |
| weshay | baseurl=http://mirror.dfw.rax.openstack.org:8080/rdo/centos7/46/f7/46f750edae74225a4dfbcce1f70990e1122a9613_815ab44a | 17:14 |
| weshay | ah.. previous | 17:14 |
| weshay | https://trunk.rdoproject.org/centos7-master/previous-current-tripleo/delorean.repo | 17:14 |
| *** pblaho has quit IRC | 17:15 | |
| weshay | EvilienM, it's deploying rocky master | 17:15 |
| weshay | just the previous promoted hsh | 17:15 |
| weshay | EvilienM, I think you are assuming queens no? | 17:16 |
| EvilienM | we want rocky | 17:16 |
| EvilienM | and we have rocky in the logs | 17:16 |
| weshay | yes.. it's rocky | 17:16 |
| EvilienM | but in the actual files it's queens | 17:16 |
| weshay | the undercloud is rocky | 17:16 |
| weshay | EvilienM, where? | 17:16 |
| EvilienM | http://logs.openstack.org/18/576218/24/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/589c1d8/logs/undercloud/home/zuul/tripleo-heat-installer-templates/puppet/services/ | 17:16 |
| EvilienM | http://logs.openstack.org/18/576218/24/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/589c1d8/logs/undercloud/home/zuul/tripleo-heat-installer-templates/puppet/services/aodh-api.yaml.txt.gz | 17:16 |
| EvilienM | heat_template_version: queens | 17:16 |
| EvilienM | --templates=/home/zuul/tripleo-heat-templates | 17:18 |
| EvilienM | somehow this directory is queens | 17:18 |
| *** homeski has joined #tripleo | 17:21 | |
| weshay | EvilienM, hey | 17:21 |
| weshay | oh ic http://logs.openstack.org/18/576218/24/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/589c1d8/logs/undercloud/home/zuul/tripleo-heat-installer-templates/puppet/services/aodh-api.yaml.txt.gz | 17:21 |
| weshay | hrm | 17:21 |
| EvilienM | weshay: can someone from ci team take a look? the job is going to break otherwise. We aimed to merge this patch asap | 17:22 |
| weshay | http://logs.openstack.org/18/576218/24/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/589c1d8/logs/playbook_executions.log | 17:22 |
| *** panda is now known as panda|off | 17:23 | |
| *** ffiore has quit IRC | 17:24 | |
| *** homeski has quit IRC | 17:25 | |
| *** yamahata has quit IRC | 17:25 | |
| mwhahaha | why are we copying it? why aren't we using the deployed version | 17:26 |
| EvilienM | I think it was done so we can see the files in the collected logs in /home but i'm not sure | 17:27 |
| mwhahaha | if we used the package version we wouldn't have these problems | 17:36 |
| mwhahaha | cause the package would have them :D | 17:36 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Switch Cisco ML2 plugint to config-download interface https://review.openstack.org/582626 | 17:37 |
| mwhahaha | i think it might have been for upgrades specifically | 17:37 |
| mwhahaha | probably some historical version juggling problems | 17:37 |
| *** bnemec has joined #tripleo | 17:38 | |
| *** moguimar has joined #tripleo | 17:43 | |
| *** bnemec has quit IRC | 17:47 | |
| *** homeski has joined #tripleo | 17:49 | |
| *** moguimar has quit IRC | 17:50 | |
| *** moguimar has joined #tripleo | 17:52 | |
| *** abishop has quit IRC | 17:54 | |
| *** moguimar has quit IRC | 17:57 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Report ansible errors in json file for standalone https://review.openstack.org/581623 | 17:57 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Handle blank lines followed by comment in nic conversion script https://review.openstack.org/580371 | 17:57 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Add default value for name_lower in network_data.yaml to update ServiceNetMap https://review.openstack.org/579346 | 17:57 |
| *** jaganathan has joined #tripleo | 18:00 | |
| *** yamahata has joined #tripleo | 18:00 | |
| *** medberry has quit IRC | 18:00 | |
| larsks | Inside a heat template, is there a way to ask for either (a) the subnet/mask of the ctlplane network, or (b) the address of the undercloud on the ctlplane network? | 18:02 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Fix incorrect Redis VIP declaration in fixed-ip-vips-v6.yaml https://review.openstack.org/580464 | 18:03 |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Increase gb_per_osd from 3 to 5 in derive_params_formulas https://review.openstack.org/582516 | 18:03 |
| *** jaganathan has quit IRC | 18:03 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Increase the step for gnocchi_db_sync https://review.openstack.org/582499 | 18:05 |
| *** trown is now known as trown|lunch | 18:06 | |
| *** suuuper has quit IRC | 18:07 | |
| *** raildo_ is now known as raildo | 18:08 | |
| larsks | Hmmm, maybe from ServiceNetMap? | 18:08 |
| *** moguimar has joined #tripleo | 18:08 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 18:10 |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| *** jistr has quit IRC | 18:11 | |
| *** jistr has joined #tripleo | 18:11 | |
| openstackgerrit | Merged openstack/os-net-config master: Adding VLAN support and other configs for sriov_vf https://review.openstack.org/541620 | 18:13 |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Increase gb_per_osd from 3 to 5 in derive_params_formulas https://review.openstack.org/582515 | 18:13 |
| *** moguimar has quit IRC | 18:16 | |
| *** assassin has joined #tripleo | 18:17 | |
| *** moguimar has joined #tripleo | 18:18 | |
| *** moguimar has quit IRC | 18:22 | |
| *** moguimar has joined #tripleo | 18:35 | |
| *** agopi|brb is now known as agopi | 18:35 | |
| rlandy | any mistral folks around? | 18:36 |
| *** ffiore has joined #tripleo | 18:37 | |
| nenad | mwhahaha sorry to bother you again, and thanks for helping me the other day, I am still not able to deploy overcloud with ceph though. I think I tracked the latest issue down to compute nodes not knowing how to reach undercloud on public IP, or rather they are trying the DNS name but cannot resolve since they do not have external access configured for some reason. Is it possible even to attach compute nodes to external VLAN? | 18:39 |
| *** moguimar has quit IRC | 18:40 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: enable ansible-lint as pre-commit hook https://review.openstack.org/582163 | 18:41 |
| *** moguimar has joined #tripleo | 18:44 | |
| *** dprince has quit IRC | 18:45 | |
| *** avivgt has joined #tripleo | 18:46 | |
| *** abishop has joined #tripleo | 18:48 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Composable networks - L3 routed networks (3/3) https://review.openstack.org/582301 | 18:48 |
| *** moguimar has quit IRC | 18:49 | |
| mwhahaha | nenad: so the undercloud has a masquerading feature for this if you aren't configuring external connectivity on th ecompute nodes | 18:49 |
| mwhahaha | nenad: it's in the undercloud.conf where it'll forward control plane traffic tothe internet | 18:49 |
| *** gkadam has joined #tripleo | 18:50 | |
| nenad | mwhahaha I would like to configure external connectivity on the computes (I actually thought I did, since i use the same config for controller and it gets exteral access), but I am not sure why it does not get connected to the external subnet | 18:50 |
| mwhahaha | nenad: likey it's your nic config for computes | 18:50 |
| nenad | mwhahaha, they are a 1 to 1 copy from controllers, since they have completely the same hardware | 18:51 |
| * mwhahaha shrugs | 18:51 | |
| mwhahaha | check the routes? | 18:51 |
| mwhahaha | i'm not sure what you've configured | 18:51 |
| nenad | mwhahaha should there be a special way of configuring nic for computes? | 18:51 |
| *** zzzeek has quit IRC | 18:52 | |
| *** assassin has quit IRC | 18:52 | |
| nenad | yeah I did, they do not get the external IP on the vlan they should, they got the internal one | 18:52 |
| mwhahaha | nenad: https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/network_isolation.html indicates computes are not configured with external network access | 18:52 |
| mwhahaha | nenad: so you'd have to add the external network to the role | 18:52 |
| nenad | mwhahaha aha.. so maybe a different question - where do you I configure the fqdn or Ip of the undercloud which computes are using during deployment? | 18:53 |
| *** moguimar has joined #tripleo | 18:53 | |
| nenad | because they are trying to use a FQDN which they can't resolve because the DNS server is out in the external network.. so then the heat-config-notify times out | 18:54 |
| rlandy | apetrich: ping - hello | 18:55 |
| rlandy | apetrich: have mistral failure I could use some help with | 18:55 |
| nenad | mwhahaha oh and yeah, this does NOT happen when I deploy without ceph. Then everything works fine, and the overcloud deploys | 18:55 |
| rlandy | or toure: ^^ if you are around | 18:55 |
| mwhahaha | nenad: so we push an /etc/hosts update that should resolve all the hosts being used | 18:56 |
| weshay | EvilienM, the heat templates used for the overcloud deployment should be queens no? | 18:57 |
| weshay | http://logs.openstack.org/18/576218/24/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/589c1d8/logs/undercloud/home/zuul/tripleo-heat-installer-templates/puppet/services/aodh-api.yaml.txt.gz | 18:57 |
| EvilienM | weshay: yes | 18:57 |
| *** zzzeek has joined #tripleo | 18:57 | |
| weshay | ok.. so far so good | 18:57 |
| EvilienM | but not th eundercloud | 18:57 |
| nenad | mwhahaha the /etc/hosts I saw on computes do not have entries for undercloud ... I suppose I could add those manually and try to re-run the whole deployment, but ... | 18:57 |
| *** ffiore has quit IRC | 18:57 | |
| weshay | EvilienM, the undercloud is at master | 18:58 |
| nenad | mwhahaha why would overcloud deployment succeed without external ceph template, but fail with external ceph template? SHouldn't it talk back to undercloud the same way all the time? | 18:58 |
| *** moguimar has quit IRC | 18:58 | |
| nenad | :q | 18:58 |
| nenad | oops :) | 18:59 |
| weshay | EvilienM, so is the issue we need two different sets of templates? | 18:59 |
| * mwhahaha shrugs | 18:59 | |
| mwhahaha | would need logs to tell you | 18:59 |
| weshay | on mixed deployments | 18:59 |
| mwhahaha | nenad: fultonj might have more input on the dns requirement for external ceph | 18:59 |
| nenad | mwhahaha, I have the logs, and the machines are all still up. Which logs would you need (if you have the time to take a look) | 18:59 |
| EvilienM | weshay: most probably | 18:59 |
| mwhahaha | nenad: i do not today, sorry | 19:00 |
| nenad | mwhahaha aha.. no worries. Thank you. I will tru to catch John somewhere.. | 19:00 |
| nenad | try even | 19:00 |
| openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo master: WIP: Use logrotate copytruncate with neutron services https://review.openstack.org/582661 | 19:00 |
| *** moguimar has joined #tripleo | 19:02 | |
| fultonj | nenad: so you can deploy an overcloud fine but adding only -e environments/ceph-ansible/ceph-ansible-external.yaml breaks it? | 19:04 |
| nenad | fultonj yes | 19:05 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Add tempest to standalone https://review.openstack.org/575588 | 19:05 |
| nenad | fultonj I had issues firs with SSL, but I fixed that with inject-trust-anchor-hiera.yaml so that no longer is the case. Now I see in the journal only on compute nodes, that it cannot reach undercloud by FQDN | 19:06 |
| nenad | fultonj because the DNS servers are out of the network currently reachable by compute nodes (External) | 19:06 |
| *** moguimar has quit IRC | 19:07 | |
| *** zshi has quit IRC | 19:08 | |
| fultonj | "the journal" ? | 19:08 |
| fultonj | oh | 19:08 |
| fultonj | you mean the logs indicates it's failing a DNS lookup | 19:08 |
| *** zshi has joined #tripleo | 19:09 | |
| nenad | yeah | 19:09 |
| nenad | fultonj http://paste.openstack.org/show/0cbFyZ1izfH8infbfB7W/ | 19:09 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 19:10 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: enable ansible-lint as pre-commit hook https://review.openstack.org/582163 | 19:10 |
| fultonj | nenad: you really want to have working DNS service, but you can workaround it by passing things in etc hosts | 19:10 |
| fultonj | one sec, let me show you a doc... | 19:11 |
| nenad | fultonj soo, placing a DNS service somewhere on the internal network, like undercloud ? | 19:11 |
| nenad | fultonj because the DNS service is running, it is just on a network Compute nodes cannot reach :( | 19:11 |
| *** moguimar has joined #tripleo | 19:11 | |
| fultonj | nenad: one sec | 19:13 |
| *** zaneb has joined #tripleo | 19:13 | |
| nenad | ok, thanks. Waiting :) | 19:13 |
| fultonj | http://paste.openstack.org/show/725851/ | 19:14 |
| fultonj | if you deployed with a variation of ^ then you could control what ends up in /etc/hosts on your overcloud nodes | 19:15 |
| fultonj | nenad: when you use tripleo, one of the things you do is set the DNS server that you want the overcloud nodes to have | 19:15 |
| fultonj | it will then assign that DNS server | 19:16 |
| fultonj | not offering DNS service to your server doesn't seem like a good thing | 19:16 |
| fultonj | i can say, here's how to hack around it by modifying etc hosts, but it's just delyaing the inevitable, your servers will want to resolve stuff | 19:16 |
| *** moguimar has quit IRC | 19:16 | |
| fultonj | e.g. when someone just SSH's into the box as a security check | 19:16 |
| weshay | EvilienM, have a couple questions.. | 19:17 |
| *** gkadam has quit IRC | 19:17 | |
| EvilienM | where is heaven? muahahahahah | 19:17 |
| weshay | EvilienM, the containerized undercloud install.. does it use $HOME/tht by default? | 19:17 |
| nenad | fultonj I did offer 2 DNS servers but they belong to Exteral IP subnet | 19:17 |
| EvilienM | weshay: nope, it uses what is provided in --templates | 19:18 |
| nenad | fultonj and controller successfully did everything, and resolves everything. So the problem is DNS reachability. They are configured as such. | 19:18 |
| EvilienM | and in oooq we provide --templates/home/zuul/tht or something | 19:18 |
| weshay | I see templates = /home/zuul/tripleo-heat-templates | 19:19 |
| weshay | k.. thanks | 19:19 |
| nenad | fultonj and how come the deployment completes successfully when I am deploying completely the same environemnt, just without ceph? I had it running and spin up instances directly on provider netowrk it was all working. | 19:19 |
| fultonj | ceph just wanted dns | 19:20 |
| nenad | fultonj Thank you for that pastebin, I can add that it would sort of patch this hole temporarily, but as you mentioned servers without working DNS could be an issue | 19:20 |
| *** zshi has quit IRC | 19:20 | |
| nenad | fultonj what failed here was "message": "Timeout for heat deployment 'create_admin'", is that ceph-only thing? | 19:20 |
| *** moguimar has joined #tripleo | 19:21 | |
| fultonj | not exactly | 19:21 |
| nenad | that was trying to create triple-admin | 19:21 |
| *** zshi has joined #tripleo | 19:21 | |
| fultonj | yep | 19:21 |
| nenad | tripleo-admin sorry | 19:21 |
| fultonj | create_admin is a workflow that is also used by config-download and by tripleo-validations | 19:21 |
| nenad | does it do it when being deployed without ceph as well? | 19:21 |
| fultonj | ceph uses it yes | 19:21 |
| EvilienM | weshay: I can cheat in the meantime | 19:21 |
| fultonj | but in Rocky everyone will :) | 19:21 |
| fultonj | because that's using config-download | 19:21 |
| fultonj | i will explain what it does and what is happening to you | 19:22 |
| fultonj | you --> your deployment | 19:22 |
| weshay | EvilienM, hey.. cheaters gunna cheat | 19:22 |
| nenad | fultonj I am trying to get Qeens to run just to be on the same page :) | 19:22 |
| EvilienM | weshay: for the a patch (until we fix the upgrade thing), give me 2 min | 19:22 |
| fultonj | nenad: makes sense, else you'd have not gotten to the ceph part yet :) | 19:22 |
| fultonj | heat-admin user is on overcloud image by default | 19:23 |
| * nenad nods | 19:23 | |
| fultonj | some features (validation, config-download, ceph) use ansible and ansible needs to be able to ssh in | 19:23 |
| fultonj | a workflow called create tripleo-admin creates this user | 19:24 |
| fultonj | nova config data is used and it happens to be the case that this workflow needs to communicate back to the undercloud and it's doing so via DNS | 19:24 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Configure 3nodes & scenario000-upgrades underclouds https://review.openstack.org/579755 | 19:25 |
| EvilienM | weshay: ^ so we don't break the job | 19:25 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Enabling cont/uc on scenario001/002 https://review.openstack.org/581183 | 19:26 |
| nenad | fultonj Is this workflow used whenthe overcloud is deployed without ceph, so concretely I had a deployment which had only a custom network isolation set. | 19:26 |
| *** moguimar has quit IRC | 19:26 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Remove --use-heat usage, as it's deprecated https://review.openstack.org/581534 | 19:26 |
| fultonj | you are using a tripleo feature which depends on this workflow, ceph | 19:26 |
| fultonj | that's why you only hit it when you enable ceph | 19:26 |
| fultonj | if you were using tripleo-validations you'd also hit | 19:26 |
| fultonj | it | 19:26 |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: Switch the undercloud to be containerized by default https://review.openstack.org/576218 | 19:27 |
| fultonj | or config-download | 19:27 |
| EvilienM | mwhahaha, weshay ^ so we can land this one without breaking upgrade jobs, in the meantime we get to fix oooq | 19:27 |
| nenad | hmmok config-download I am not sure what that does. So I guess I am not using any of those when ceph is not involved | 19:27 |
| nenad | fultonj so in short, overcloud nodes need access to a working DNS, ie. I need to install a DNS someplace on an internal network reachable by COmpute nodes. | 19:28 |
| fultonj | it's the new default in what will be rocky | 19:28 |
| fultonj | i recommend this yes | 19:28 |
| fultonj | one sec... | 19:28 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Fix HostnameMap lookup - replace str_replace with yaql https://review.openstack.org/582475 | 19:28 |
| fultonj | nenad: https://docs.openstack.org/tripleo-docs/latest/install/basic_deployment/basic_deployment_cli.html#configure-a-nameserver-for-the-overcloud | 19:29 |
| weshay | EvilienM, hrm.. ok.. not sure how those help.. let me submit these two patches to fix this and maybe we can walk through both sets | 19:29 |
| fultonj | nenad: so when you have a working DNS server put it's IP inot the undercloud like that ^ | 19:30 |
| *** moguimar has joined #tripleo | 19:30 | |
| fultonj | in <nameserver-ip> | 19:30 |
| EvilienM | weshay: it'll help to merge my patch in tripleoclient that we really want before the end of m3 | 19:30 |
| EvilienM | it won't help to fix upgrades job but at least it won't break it. | 19:30 |
| fultonj | nenad: you could see about using a combination of etc hosts hacks and public dns servers from opendns if it's tricky for you to get your own dns server that you can access, but i still think you shoud just have a DNS server :) | 19:31 |
| nenad | fultonj I could installa DNS on the undercloud, it should not hurt, just a forwarding one | 19:31 |
| fultonj | nenad: sure | 19:31 |
| fultonj | nenad: actually, the undercloud is running dnsmasq by default | 19:31 |
| nenad | fultonj Thank you very much for clarifying "why ceph". Have been chasing ghosts for almost 4 days now.. (although first issue was SSL related so that was another story) | 19:32 |
| nenad | fultonj hmm well I could not ask undercloud to resolve anything.. Or at least it didn't. Will double-check | 19:32 |
| *** hkominos has joined #tripleo | 19:33 | |
| hkominos | Hi all. Can I ask a question. Who maintains the tripleo containers found https://hub.docker.com/r/tripleomaster/ ? I cant seem to file any docker files for them (or even better a kolla-build.conf ?) | 19:35 |
| *** moguimar has quit IRC | 19:35 | |
| mwhahaha | hkominos: there's a build process of it, sec let me see if i can find it | 19:36 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: update the templates path for the overcloud not both undercloud and overcloud https://review.openstack.org/582669 | 19:36 |
| *** waleedm has joined #tripleo | 19:36 | |
| mwhahaha | hkominos: https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/3rd_party.html#building-new-containers-with-kolla-build | 19:37 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: change the order in witch custom tht is checked out https://review.openstack.org/582670 | 19:37 |
| nenad | fultonj there's nothing listening on the undercloud on port 53, so perhaps it is not serving DNS. I can just reconfigure it perhaps to do that. Thank you very much again. I will play with this for a while now and see if I can get it to deploy | 19:37 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: update the templates path for the overcloud not both undercloud and overcloud https://review.openstack.org/582669 | 19:37 |
| fultonj | nenad: be careful with reconfiguring dnsmasql | 19:37 |
| hkominos | mwhahaha: thx! | 19:37 |
| nenad | fultonj will be, will just look for the dns part. If it is overly complicated I will just deploy bind, not a big deal | 19:38 |
| weshay | https://bugs.launchpad.net/tripleo/+bug/1781653 | 19:38 |
| openstack | Launchpad bug 1781653 in tripleo "mixed upgrades using n-1 tht for containerized undercloud deployment" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 19:38 |
| fultonj | it's managed by neutron so you don't want to disturb them | 19:38 |
| nenad | ah.. | 19:38 |
| nenad | so rather NOT touch dnsmaswq | 19:38 |
| *** moguimar has joined #tripleo | 19:39 | |
| fultonj | e.g. if you deploly a server tripleo triggers various services to make dnsmasq reserve a DHCP reservation for it etc | 19:39 |
| fultonj | better to leave that be so it doesn't get broken | 19:39 |
| *** waleedm has quit IRC | 19:40 | |
| *** sshnaidm|off has quit IRC | 19:40 | |
| *** waleedm has joined #tripleo | 19:40 | |
| nenad | fultonj sure. I don't want to mess that up definitely. bind will be a safer bet, and I will make it a forwarding DNS only.. Hopefully that will help. Will this DNS be used later for internal overcloud name resolution, or would the /etc/hosts created by the deployment be enough | 19:43 |
| fultonj | tenants can be deplolyed to use a different dns service | 19:43 |
| *** moguimar has quit IRC | 19:44 | |
| nenad | Right, I was thinking more about other overcloud services. Tenants will have their networks defined separately. Well i will just deploy and see :) | 19:44 |
| *** medberry has joined #tripleo | 19:46 | |
| *** medberry has quit IRC | 19:46 | |
| *** medberry has joined #tripleo | 19:46 | |
| fultonj | yes | 19:46 |
| fultonj | this is basically the DNS server that your overcloud nodes will use | 19:47 |
| *** moguimar has joined #tripleo | 19:48 | |
| nenad | fultonj OK. will keep that in mind then if something else goes wrong. Thank you again for the help! | 19:49 |
| fultonj | np | 19:49 |
| *** trown|lunch is now known as trown | 19:49 | |
| *** mmethot_ has quit IRC | 19:50 | |
| trown | mwhahaha: have you been able to launch an instance on a standalone deploy? | 19:50 |
| mwhahaha | trown: yea if you turn off selinux | 19:50 |
| trown | mwhahaha: ah ok | 19:50 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Set container images for CNS https://review.openstack.org/582610 | 19:50 |
| trown | I am hitting permission stuff on qemu-kvm... so that could be it | 19:50 |
| trown | mwhahaha: thanks | 19:50 |
| mwhahaha | trown: see bz1538651 | 19:51 |
| *** mcornea is now known as mcornea|afk | 19:51 | |
| *** mmethot has joined #tripleo | 19:51 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Update the undercloud install to a specific step. https://review.openstack.org/582393 | 19:52 |
| *** moguimar has quit IRC | 19:52 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: The containerized undercloud no longer uses deploy https://review.openstack.org/582399 | 19:54 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Add ability to set openshift container images https://review.openstack.org/576441 | 19:56 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Set container images for CNS https://review.openstack.org/582610 | 19:56 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Move scenario009 to the check queue https://review.openstack.org/582678 | 19:56 |
| *** moguimar has joined #tripleo | 19:57 | |
| *** nenad has quit IRC | 19:58 | |
| trown | mwhahaha: yep that is exactly the issue thanks | 19:58 |
| mwhahaha | trown: np | 19:59 |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: Move scenario009 to the check queue https://review.openstack.org/582679 | 19:59 |
| weshay | toure, ping | 20:01 |
| weshay | toure, question for you when you have minute | 20:01 |
| weshay | maybe on monday :) | 20:02 |
| *** moguimar has quit IRC | 20:03 | |
| *** avivgt has quit IRC | 20:04 | |
| *** ansmith has quit IRC | 20:06 | |
| *** moguimar has joined #tripleo | 20:08 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 20:10 |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: WIP - standalone: introduce enable_pacemaker https://review.openstack.org/582682 | 20:12 |
| *** moguimar has quit IRC | 20:12 | |
| *** artom has quit IRC | 20:13 | |
| *** bfournie has quit IRC | 20:14 | |
| *** bfournie has joined #tripleo | 20:14 | |
| *** bfournie has quit IRC | 20:14 | |
| *** medberry has quit IRC | 20:16 | |
| *** moguimar has joined #tripleo | 20:17 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: ci-scripts: avoid failure when cd prints to stdout https://review.openstack.org/582684 | 20:21 |
| *** moguimar has quit IRC | 20:22 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: ci-scripts: avoid failure when cd prints to stdout https://review.openstack.org/582684 | 20:23 |
| *** v1a4 has quit IRC | 20:26 | |
| *** moguimar has joined #tripleo | 20:27 | |
| *** abishop has quit IRC | 20:29 | |
| *** abishop has joined #tripleo | 20:31 | |
| rlandy | mwhahaha: hi - https://github.com/openstack/tripleo-common/blob/master/tripleo_common/templates/deployments.yaml#L3 - where does this pick up ansible_hostname from? | 20:32 |
| *** abishop has quit IRC | 20:32 | |
| rlandy | debugging this error - which has picked up the wrong hostname ... http://logs.openstack.org/76/581376/6/check/tripleo-ci-centos-7-3nodes-multinode/4708903/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-07-12_22_59_54 | 20:32 |
| *** moguimar has quit IRC | 20:33 | |
| *** moguimar has joined #tripleo | 20:38 | |
| *** klindgren has quit IRC | 20:41 | |
| *** moguimar has quit IRC | 20:42 | |
| rlandy | nvm - I found it | 20:44 |
| *** klindgren has joined #tripleo | 20:46 | |
| *** waleedm has quit IRC | 20:46 | |
| *** florianf has quit IRC | 20:47 | |
| *** moguimar has joined #tripleo | 20:47 | |
| *** bfournie has joined #tripleo | 20:47 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Add doc for the libvirt reproducer https://review.openstack.org/566155 | 20:49 |
| *** moguimar has quit IRC | 20:51 | |
| *** mcornea|afk is now known as mcornea | 20:53 | |
| *** moguimar has joined #tripleo | 20:56 | |
| *** moguimar has quit IRC | 21:01 | |
| *** raildo has quit IRC | 21:05 | |
| *** moguimar has joined #tripleo | 21:05 | |
| *** trown is now known as trown|outtypewww | 21:09 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 21:10 |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| *** moguimar has quit IRC | 21:10 | |
| weshay | hrm | 21:12 |
| weshay | mwhahaha, looks like logs.openstack may have went down | 21:12 |
| rlandy | weshay: ack | 21:12 |
| rlandy | been dead for a while | 21:13 |
| mwhahaha | ¯\_(ツ)_/¯ | 21:13 |
| *** wolverineav has joined #tripleo | 21:13 | |
| rlandy | but, actually ... my question above still stands ... | 21:13 |
| *** mwhahaha changes topic to "Welcome to Rocky. CI status: RED - infra problems (log.o.o/static.o.o are dead) ¯\_(ツ)_/¯ | https://docs.openstack.org/tripleo-docs/latest" | 21:14 | |
| weshay | https://bugs.launchpad.net/tripleo/+bug/1781665 | 21:14 |
| openstack | Launchpad bug 1781665 in tripleo "tracker, logs.openstack.org is down" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 21:14 |
| *** alee has joined #tripleo | 21:14 | |
| mwhahaha | rlandy: i have no idea off the top of my head, i'd have to look | 21:14 |
| *** moguimar has joined #tripleo | 21:14 | |
| mwhahaha | rlandy: i'd assume it comes from the tripleo inventory | 21:15 |
| weshay | <clarkb> Im about to get on a plane | 21:15 |
| weshay | <clarkb> if we reboot it we are probably looking at long fscks? | 21:15 |
| weshay | <corvus> i imagine so | 21:15 |
| weshay | <corvus> or i could just reformat it | 21:15 |
| weshay | <corvus> (the last time we had to fsck, we had a nice chat about re-designing this system, but i don't think the spec ever got written) | 21:15 |
| rlandy | mwhahaha: thanks - background notes in last comment on https://review.openstack.org/#/c/581376/ | 21:15 |
| weshay | rlandy, this also means all jobs fail | 21:16 |
| weshay | they not call him mwhahaha for nuttin | 21:16 |
| rlandy | oh well | 21:16 |
| mwhahaha | rlandy: yea i'd look but with logs.o.o being dead :D | 21:16 |
| weshay | whatever | 21:17 |
| rlandy | mwhahaha: understandable :) | 21:17 |
| mwhahaha | also i'm out next week, i'd recommend poking EvilienM | 21:17 |
| weshay | pretty convienent excuse | 21:17 |
| weshay | :) | 21:17 |
| rlandy | mwhahaha: sure - enjoy your vacation | 21:18 |
| * mwhahaha goes to google doc writing and avoids CI like the plague that it is | 21:18 | |
| *** moguimar has quit IRC | 21:19 | |
| *** moguimar has joined #tripleo | 21:24 | |
| *** rfolco_ has joined #tripleo | 21:27 | |
| *** rfolco has quit IRC | 21:27 | |
| *** ansmith has joined #tripleo | 21:27 | |
| *** sshnaidm|off has joined #tripleo | 21:27 | |
| *** moguimar has quit IRC | 21:29 | |
| *** medberry has joined #tripleo | 21:32 | |
| *** medberry has quit IRC | 21:32 | |
| *** medberry has joined #tripleo | 21:32 | |
| *** moguimar has joined #tripleo | 21:33 | |
| *** pradk- has quit IRC | 21:33 | |
| *** moguimar has quit IRC | 21:35 | |
| *** moguimar has joined #tripleo | 21:35 | |
| *** raildo has joined #tripleo | 21:35 | |
| *** moguimar has quit IRC | 21:39 | |
| *** agopi is now known as agopi|off | 21:41 | |
| *** homeski has quit IRC | 21:44 | |
| *** moguimar has joined #tripleo | 21:44 | |
| *** jjung has joined #tripleo | 21:45 | |
| *** raildo has quit IRC | 21:45 | |
| *** agopi|off has quit IRC | 21:45 | |
| *** moguimar has quit IRC | 21:48 | |
| *** raildo has joined #tripleo | 21:49 | |
| *** hkominos has left #tripleo | 21:53 | |
| -openstackstatus- NOTICE: logs.openstack.org is offline, causing POST_FAILURE results from Zuul. Cause and resolution timeframe currently unknown. | 21:53 | |
| *** moguimar has joined #tripleo | 21:53 | |
| *** ChanServ changes topic to "logs.openstack.org is offline, causing POST_FAILURE results from Zuul. Cause and resolution timeframe currently unknown." | 21:53 | |
| *** moguimar has quit IRC | 21:57 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-common master: Persist ceph-ansible fetch_directory https://review.openstack.org/567782 | 21:59 |
| *** itlinux_ has joined #tripleo | 22:00 | |
| itlinux_ | Hello all, I just enabled DVR, but I want to revert back what's the best way since I took of the -e in the deployment but it still set on DVR.. | 22:00 |
| *** raildo has quit IRC | 22:01 | |
| *** moguimar has joined #tripleo | 22:02 | |
| *** moguimar has quit IRC | 22:06 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add a networking check for OpenShift on OpenStack https://review.openstack.org/581644 | 22:07 |
| openstackgerrit | John Fulton proposed openstack/tripleo-common master: Persist ceph-ansible fetch_directory https://review.openstack.org/567782 | 22:08 |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1781665 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 22:10 |
| openstack | Launchpad bug 1781665 in tripleo "tracker, logs.openstack.org is down" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 22:10 |
| *** zaneb has quit IRC | 22:11 | |
| *** rlandy has quit IRC | 22:11 | |
| *** moguimar has joined #tripleo | 22:12 | |
| *** lblanchard has joined #tripleo | 22:13 | |
| *** fultonj has quit IRC | 22:16 | |
| *** moguimar has quit IRC | 22:16 | |
| *** mcornea has quit IRC | 22:17 | |
| *** moguimar has joined #tripleo | 22:21 | |
| *** moguimar has quit IRC | 22:25 | |
| *** moguimar has joined #tripleo | 22:30 | |
| *** edmondsw has quit IRC | 22:31 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add a OpenShift on OpenStack HW validation https://review.openstack.org/575749 | 22:33 |
| *** moguimar has quit IRC | 22:34 | |
| *** jjung has quit IRC | 22:36 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add a networking check for OpenShift on OpenStack https://review.openstack.org/581644 | 22:37 |
| *** moguimar has joined #tripleo | 22:39 | |
| *** moguimar has quit IRC | 22:43 | |
| *** moguimar has joined #tripleo | 22:48 | |
| *** abishop has joined #tripleo | 22:49 | |
| *** itlinux_ has quit IRC | 22:49 | |
| *** agopi has joined #tripleo | 22:50 | |
| *** moguimar has quit IRC | 22:53 | |
| *** moguimar has joined #tripleo | 22:57 | |
| *** moguimar has quit IRC | 23:02 | |
| *** slaweq has quit IRC | 23:03 | |
| *** moguimar has joined #tripleo | 23:07 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1773325 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1781665 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1773325 in tripleo "tempest.api.object_storage.test_object_services is failing on scenario002" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 23:10 |
| openstack | Launchpad bug 1781665 in tripleo "tracker, logs.openstack.org is down" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 23:10 |
| *** moguimar has quit IRC | 23:11 | |
| *** rpioso is now known as rpioso|afk | 23:14 | |
| *** lblanchard has quit IRC | 23:14 | |
| *** anderbubble has joined #tripleo | 23:15 | |
| *** moguimar has joined #tripleo | 23:16 | |
| anderbubble | rasca or mwhahaha, I see you talking in the logs about “Could not find data item oslo_messaging_rpc_password in any Hiera data file”. | 23:17 |
| anderbubble | I’ve got a student who is hitting this same problem, on both queens and pike | 23:17 |
| anderbubble | can you give any advice for getting past this error? He’s hit quite the wallk. | 23:17 |
| anderbubble | *wall | 23:17 |
| mwhahaha | Sounds like he's using an old version of tht | 23:18 |
| anderbubble | tht? | 23:18 |
| anderbubble | (Sorry; he’s been the one doing the work, so I’m not certain.) | 23:18 |
| mwhahaha | tripleo-heat-templates | 23:18 |
| mwhahaha | So they are release specific | 23:18 |
| mwhahaha | So he's not using the correct version for what's being deployed | 23:19 |
| mwhahaha | I think we added that in early Rocky so not sure why he'd hit that in Pike/queens | 23:19 |
| mwhahaha | anderbubble: you in Colorado? | 23:20 |
| anderbubble | My understanding is he’s using the documentation from https://docs.openstack.org/tripleo-docs/latest/install/post_deployment/build_single_image.html, though I think he might alternatively be using the release-specific docs. | 23:20 |
| anderbubble | Yes, in Colorado. CU Boulder. | 23:20 |
| mwhahaha | Ah I live in Denver | 23:21 |
| *** moguimar has quit IRC | 23:21 | |
| anderbubble | Mind if I go to PM for a moment? | 23:21 |
| mwhahaha | We don't have release specific docs so likely he's using the wrong stufg | 23:21 |
| mwhahaha | anderbubble: sure | 23:21 |
| *** moguimar has joined #tripleo | 23:25 | |
| *** edmondsw has joined #tripleo | 23:26 | |
| *** anderbubble has quit IRC | 23:27 | |
| *** moguimar has quit IRC | 23:30 | |
| *** edmondsw has quit IRC | 23:31 | |
| *** jtcressy has joined #tripleo | 23:33 | |
| *** moguimar has joined #tripleo | 23:34 | |
| jtcressy | mwhahaha: Hey if you're online right now, i'm the student that anderbubble was talking about. Its never been such a relief to know that I'm doing it wrong afterall. I thought for sure the tripleo-repos utility would select the right versions of all the packages but i'm excited to hear all you've got for me. | 23:37 |
| *** ChanServ changes topic to "Welcome to Rocky. CI status: RED - infra problems (log.o.o/static.o.o are dead) ¯\_(ツ)_/¯ | https://docs.openstack.org/tripleo-docs/latest" | 23:38 | |
| -openstackstatus- NOTICE: logs.openstack.org is back on-line. Changes with "POST_FAILURE" job results should be rechecked. | 23:38 | |
| *** abishop has quit IRC | 23:38 | |
| *** moguimar has quit IRC | 23:39 | |
| *** abishop has joined #tripleo | 23:39 | |
| *** abishop has quit IRC | 23:40 | |
| *** tosky has quit IRC | 23:41 | |
| *** abishop has joined #tripleo | 23:41 | |
| mwhahaha | jtcressy: so it should select the right repos | 23:42 |
| mwhahaha | jtcressy: I think might have happened is that your images have the wrong version of puppet-tripleo for the version your trying to deploy | 23:43 |
| *** moguimar has joined #tripleo | 23:44 | |
| jtcressy | Oh I see. I have no idea what versions of the images to get nor where to get them. I've just been fetching current-rdo just to get the nodes to deploy. | 23:44 |
| mwhahaha | jtcressy: if you don't have to build images you can pull ones from images.rdoproject.org, let me get you a link for queens | 23:44 |
| *** wolverineav has quit IRC | 23:44 | |
| jtcressy | mwhahaha: actually could I get a link to pike right now | 23:44 |
| jtcressy | I rebuilt my undercloud node with pike in mind and would like to get that one working first :P | 23:44 |
| mwhahaha | Sure but queen is better :D | 23:45 |
| mwhahaha | http://images.rdoproject.org/queens/rdo_trunk/current-tripleo-rdo/ | 23:45 |
| jtcressy | i'll move on to queens once I deploy openstack for the first time ever. xD | 23:45 |
| *** wolverineav has joined #tripleo | 23:45 | |
| mwhahaha | s/queens/pike | 23:45 |
| jtcressy | sweet | 23:45 |
| mwhahaha | That's what we use in ci | 23:45 |
| mwhahaha | http://images.rdoproject.org/pike/rdo_trunk/current-tripleo-rdo/ | 23:47 |
| mwhahaha | So the important part is to match that with the right tripleo-repos command | 23:48 |
| *** moguimar has quit IRC | 23:48 | |
| mwhahaha | sudo -E tripleo-repos -b pike current | 23:49 |
| jtcressy | my current undercloud was built with "sudo -E tripleo-repos -b pike current" | 23:49 |
| mwhahaha | I think that's the right one for those images | 23:49 |
| *** wolverineav has quit IRC | 23:49 | |
| mwhahaha | Oh use current-tripleo | 23:50 |
| mwhahaha | Not current | 23:50 |
| mwhahaha | Hmm maybe current will work | 23:51 |
| mwhahaha | We don't change much in like so it should be ok | 23:51 |
| *** moguimar has joined #tripleo | 23:53 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!