| openstackgerrit | Bob Fournier proposed openstack/puppet-tripleo master: Configure VIPs for all networks including composable networks https://review.openstack.org/531037 | 00:00 |
|---|---|---|
| mwhahaha | EmilienM: nifty that's handy, wonder if the dockerpuppetdebug is done yet | 00:04 |
| *** liverpooler has quit IRC | 00:18 | |
| *** Goneri has joined #tripleo | 00:22 | |
| *** daidv has quit IRC | 00:24 | |
| *** daidv has joined #tripleo | 00:25 | |
| *** etingof has quit IRC | 00:25 | |
| *** moshele has quit IRC | 00:28 | |
| *** jobewan has quit IRC | 00:32 | |
| *** akrivoka has quit IRC | 00:35 | |
| *** dhill_ has quit IRC | 00:40 | |
| *** ipsecguy has quit IRC | 00:41 | |
| *** ipsecguy has joined #tripleo | 00:42 | |
| *** moshele has joined #tripleo | 00:48 | |
| *** moshele has quit IRC | 01:07 | |
| *** remixtj has joined #tripleo | 01:12 | |
| *** remix_tj has quit IRC | 01:12 | |
| *** bandini has quit IRC | 01:14 | |
| *** bandini has joined #tripleo | 01:17 | |
| *** eck` is now known as eck`gone | 01:19 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: Collect logs in post playbook https://review.openstack.org/527844 | 01:29 |
| *** cshastri has joined #tripleo | 01:31 | |
| *** Goneri has quit IRC | 01:33 | |
| *** daidv has quit IRC | 01:40 | |
| *** daidv has joined #tripleo | 01:41 | |
| *** threestrands has joined #tripleo | 01:55 | |
| *** yamahata has quit IRC | 01:58 | |
| *** jkilpatr has quit IRC | 01:58 | |
| *** liverpooler has joined #tripleo | 02:06 | |
| *** stee_3 has quit IRC | 02:09 | |
| *** stee has joined #tripleo | 02:13 | |
| *** stee is now known as stee_ | 02:17 | |
| *** stee_ is now known as stee_3 | 02:18 | |
| *** rlandy|bbl is now known as rlandy | 02:20 | |
| *** rlandy has quit IRC | 02:23 | |
| *** tzumainn has quit IRC | 02:24 | |
| *** rfolco has quit IRC | 02:29 | |
| *** lblanchard has quit IRC | 02:36 | |
| openstackgerrit | Thiago da Silva proposed openstack/tripleo-heat-templates master: WIP: Add new encryption middleware to swift proxy https://review.openstack.org/525324 | 02:56 |
| *** anilvenkata has joined #tripleo | 03:05 | |
| *** pmannidi has quit IRC | 03:18 | |
| *** links has joined #tripleo | 03:19 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: multinode: run overcloud-post-deploy tag https://review.openstack.org/531068 | 03:22 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs016: set gnocchi_quick_policy to true https://review.openstack.org/531007 | 03:23 |
| *** pmannidi has joined #tripleo | 03:23 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data https://review.openstack.org/508567 | 03:24 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow https://review.openstack.org/509419 | 03:24 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow https://review.openstack.org/513463 | 03:24 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Adds Workflow to List Available Roles https://review.openstack.org/509832 | 03:24 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Adds UpdateRoles Workflow https://review.openstack.org/515045 | 03:24 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Select Roles Workflow https://review.openstack.org/528282 | 03:24 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs032: activate config-download https://review.openstack.org/528761 | 03:24 |
| *** pmannidi has quit IRC | 03:25 | |
| *** jkilpatr has joined #tripleo | 03:26 | |
| *** pmannidi has joined #tripleo | 03:31 | |
| *** jlabarre has quit IRC | 03:32 | |
| *** pmannidi has quit IRC | 03:37 | |
| *** pmannidi has joined #tripleo | 03:37 | |
| *** pmannidi has quit IRC | 03:42 | |
| *** pmannidi has joined #tripleo | 03:43 | |
| *** pmannidi has quit IRC | 03:43 | |
| *** pmannidi has joined #tripleo | 03:44 | |
| *** liverpooler has quit IRC | 03:47 | |
| *** psahoo has joined #tripleo | 03:50 | |
| *** chlong has joined #tripleo | 03:50 | |
| openstackgerrit | Victoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Add a StorageNFS network for use by Manila/Ganesha https://review.openstack.org/512239 | 04:06 |
| openstackgerrit | Victoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Add support for ceph-nfs manila backend https://review.openstack.org/471245 | 04:06 |
| openstackgerrit | Victoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Pass storage nfs VIP to ceph-ansible https://review.openstack.org/512240 | 04:06 |
| *** agopi has joined #tripleo | 04:11 | |
| *** shreshtha has joined #tripleo | 04:13 | |
| *** udesale has joined #tripleo | 04:37 | |
| *** ramishra has joined #tripleo | 04:37 | |
| *** jkilpatr has quit IRC | 04:37 | |
| *** ykarel has joined #tripleo | 04:42 | |
| *** pgadiya has joined #tripleo | 04:50 | |
| *** ramishra has quit IRC | 04:51 | |
| *** ramishra has joined #tripleo | 04:51 | |
| ykarel | EmilienM, hi | 05:00 |
| *** akane_ has joined #tripleo | 05:00 | |
| *** ramishra has joined #tripleo | 05:00 | |
| *** ramishra has quit IRC | 05:01 | |
| ykarel | EmilienM, i looked for not using modules from Puppetfile, there are some puppet modules which are not packaged, that's why they are installed from git | 05:01 |
| *** ramishra has joined #tripleo | 05:01 | |
| ykarel | EmilienM, https://github.com/rdo-infra/ansible-role-weirdo-puppet-openstack/blob/master/defaults/main.yml#L35-L44 | 05:02 |
| *** dpawar has joined #tripleo | 05:02 | |
| ykarel | So i have proposed the workaround patch to fix pike phase 1:- https://review.rdoproject.org/r/#/c/11146/ | 05:02 |
| *** jaganathan has joined #tripleo | 05:11 | |
| *** karthiks has quit IRC | 05:14 | |
| *** karthiks has joined #tripleo | 05:14 | |
| EmilienM | ykarel: ok, wfm | 05:17 |
| *** ratailor has joined #tripleo | 05:17 | |
| ykarel | EmilienM, Ok Thanks | 05:18 |
| *** skramaja has joined #tripleo | 05:19 | |
| *** ramishra has quit IRC | 05:20 | |
| *** diga has joined #tripleo | 05:22 | |
| *** diga has quit IRC | 05:22 | |
| *** diga has joined #tripleo | 05:23 | |
| *** diga has joined #tripleo | 05:24 | |
| *** yamahata has joined #tripleo | 05:27 | |
| *** diga has quit IRC | 05:28 | |
| *** jtomasek has joined #tripleo | 05:29 | |
| *** ramishra has joined #tripleo | 05:37 | |
| jaosorior | EmilienM: did the mistral fix get included with the promotion? | 05:38 |
| *** janki has joined #tripleo | 05:43 | |
| Tengu | hello there | 05:45 |
| jaosorior | sup dude | 05:45 |
| Tengu | jaosorior: good news, after re-checking the PTG date, it happens it's during my holidays :). So I'll be there. Just have to organize things. | 05:45 |
| EmilienM | jaosorior: yep | 05:46 |
| EmilienM | jaosorior: everything is fixed & closes | 05:46 |
| EmilienM | closed* | 05:46 |
| EmilienM | ykarel: ping apevec when he's up, he can land it, I can't | 05:55 |
| ykarel | EmilienM, Ok | 05:56 |
| *** jtomasek has quit IRC | 05:57 | |
| *** ykarel has quit IRC | 05:57 | |
| *** ykarel has joined #tripleo | 05:58 | |
| *** masco has joined #tripleo | 06:04 | |
| *** karthiks has quit IRC | 06:04 | |
| *** psachin has joined #tripleo | 06:05 | |
| *** akane_ has quit IRC | 06:06 | |
| *** akane has joined #tripleo | 06:09 | |
| EmilienM | sileht: your trick failed, policy & rule were created: http://logs.openstack.org/07/531007/4/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/43dc8ec/logs/undercloud/home/zuul/overcloud_deploy_post.log.txt.gz#_2018-01-04_05_38_47 but tempest failing: http://logs.openstack.org/07/531007/4/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/43dc8ec/logs/tempest.html.gz | 06:10 |
| openstackgerrit | Merged openstack/tripleo-docs master: Do not use -y for package install https://review.openstack.org/530711 | 06:10 |
| EmilienM | sileht: feel free to take over my patches | 06:11 |
| Tengu | jaosorior: hmm, regarding the patch for the HostnameMap - there's an interesting comment by Zane in the issue. | 06:14 |
| jaosorior | Tengu: yeah, I saw it | 06:15 |
| jaosorior | Tengu: I'll address it later in the day | 06:15 |
| Tengu | jaosorior: ok :). | 06:15 |
| jaosorior | or if you have time now :D feel free to change it too | 06:15 |
| jaosorior | I'm probably not gonna pick it up again in some hours | 06:16 |
| Tengu | hmm, not really sure how to change it in order to avoid breaking that kind of thing. | 06:16 |
| Tengu | we can't assume all ppl will put "UNUSED" :). | 06:16 |
| *** moshele has joined #tripleo | 06:16 | |
| Tengu | ~> it will probably require some regexp in order to, say, match something like [\w]-[0-9]+ in order to filter out the "unused" and other "buggy". | 06:17 |
| *** ratailor_ has joined #tripleo | 06:18 | |
| jaosorior | right | 06:18 |
| jaosorior | if only we could pass more parameters to it | 06:18 |
| Tengu | ^^ | 06:18 |
| *** ratailor_ has quit IRC | 06:19 | |
| *** ratailor has quit IRC | 06:19 | |
| Tengu | we might want to think a bit more about that. | 06:19 |
| *** ratailor has joined #tripleo | 06:19 | |
| *** karthiks has joined #tripleo | 06:21 | |
| *** agopi has quit IRC | 06:23 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs032: activate config-download https://review.openstack.org/528761 | 06:29 |
| *** dbecker has quit IRC | 06:29 | |
| *** jbadiapa has joined #tripleo | 06:34 | |
| *** pdeore has joined #tripleo | 06:38 | |
| *** yprokule has joined #tripleo | 06:42 | |
| *** dbecker has joined #tripleo | 06:44 | |
| *** ratailor has quit IRC | 06:50 | |
| *** ratailor has joined #tripleo | 06:50 | |
| *** ratailor_ has joined #tripleo | 06:51 | |
| *** ratailor_ has quit IRC | 06:53 | |
| *** ratailor has quit IRC | 06:53 | |
| *** ratailor has joined #tripleo | 06:54 | |
| *** pgadiya has quit IRC | 06:57 | |
| *** jaosorior has quit IRC | 07:01 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Remove list of tests and plugins https://review.openstack.org/531090 | 07:02 |
| *** suuuper has joined #tripleo | 07:03 | |
| *** marios has joined #tripleo | 07:03 | |
| *** ramishra has quit IRC | 07:10 | |
| *** pgadiya has joined #tripleo | 07:10 | |
| *** links has quit IRC | 07:11 | |
| *** jaosorior has joined #tripleo | 07:11 | |
| *** ramishra has joined #tripleo | 07:11 | |
| *** kristaps__ has joined #tripleo | 07:12 | |
| *** nyechiel_ has joined #tripleo | 07:12 | |
| *** jaosorior has quit IRC | 07:13 | |
| *** jaosorior has joined #tripleo | 07:14 | |
| *** jaosorior has quit IRC | 07:14 | |
| *** jaosorior has joined #tripleo | 07:14 | |
| *** kristaps_ has quit IRC | 07:15 | |
| *** agurenko has joined #tripleo | 07:19 | |
| *** links has joined #tripleo | 07:23 | |
| *** aditya_r has joined #tripleo | 07:24 | |
| *** florianf has joined #tripleo | 07:24 | |
| *** threestrands has quit IRC | 07:25 | |
| *** links has quit IRC | 07:26 | |
| *** jfrancoa has joined #tripleo | 07:27 | |
| *** cylopez has joined #tripleo | 07:27 | |
| *** jrist has quit IRC | 07:29 | |
| *** agurenko has quit IRC | 07:29 | |
| *** agurenko has joined #tripleo | 07:32 | |
| *** aditya_r has quit IRC | 07:32 | |
| *** pcaruana has joined #tripleo | 07:32 | |
| *** kristaps__ has quit IRC | 07:32 | |
| *** aditya_r has joined #tripleo | 07:33 | |
| *** lvdombrkr has joined #tripleo | 07:33 | |
| *** lvdombrkr has quit IRC | 07:36 | |
| *** lvdombrkr has joined #tripleo | 07:37 | |
| *** lvdombrkr has quit IRC | 07:37 | |
| *** lvdombrkr has joined #tripleo | 07:38 | |
| *** ffiore has joined #tripleo | 07:43 | |
| *** links has joined #tripleo | 07:44 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: telemetry: really set polling interval https://review.openstack.org/531103 | 07:47 |
| jaosorior | sileht: the Depends-On should be using the change-id hash | 07:49 |
| sileht | jaosorior, thx I need more coffree I guess | 07:49 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: telemetry: really set polling interval https://review.openstack.org/531103 | 07:49 |
| jaosorior | sileht: is ceilometer::agent::polling::manage_polling something that folks would set often? | 07:50 |
| jaosorior | sileht: might be good to expose it in t-h-t. | 07:50 |
| jaosorior | if that's the case | 07:50 |
| sileht | jaosorior, it looks like already exposed | 07:52 |
| jaosorior | oh right | 07:53 |
| jaosorior | sileht: might wanna use ManagePolling instead then | 07:53 |
| sileht | jaosorior, it's exposed only in ceilometer-base.yaml, is that sufficient ? Or should I add it in ceilometer-agent-XXX.yaml too ? | 07:55 |
| jaosorior | sileht: let me check. | 07:57 |
| jaosorior | sileht: right, the agents use the base, so it should be sufficient. | 07:57 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: telemetry: really set polling interval https://review.openstack.org/531103 | 07:58 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: telemetry: really set polling interval https://review.openstack.org/531103 | 07:59 |
| *** aufi has joined #tripleo | 07:59 | |
| jaosorior | sileht: thanks | 08:00 |
| *** karthiks has quit IRC | 08:00 | |
| *** rcernin has quit IRC | 08:04 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-common master: Always load rsyslog-base container https://review.openstack.org/521529 | 08:07 |
| openstackgerrit | yatin proposed openstack/tripleo-puppet-elements stable/pike: Install yum-plugin-priorities in pre-install phase https://review.openstack.org/531107 | 08:09 |
| *** assassin has quit IRC | 08:10 | |
| *** karthiks has joined #tripleo | 08:13 | |
| *** tesseract has joined #tripleo | 08:16 | |
| *** shardy has joined #tripleo | 08:16 | |
| *** jtomasek has joined #tripleo | 08:16 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Include security_compliance manifest in keystone https://review.openstack.org/531108 | 08:19 |
| *** ykarel is now known as ykarel|lunch | 08:19 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: Collect logs in post playbook https://review.openstack.org/527844 | 08:21 |
| lvdombrkr | hello folks, pike, two nodes deploy (controller + compute) after deploy overcloud compute node fails on nova scheduler filter , what excatly mean compute' does not match 'control' ?? http://paste.openstack.org/raw/637643/ | 08:21 |
| *** mcornea has joined #tripleo | 08:24 | |
| *** bogdando has joined #tripleo | 08:27 | |
| sshnaidm|afk | cores, please review reproducer script changes: https://review.openstack.org/#/c/530401/ | 08:28 |
| sshnaidm|afk | panda|rover, ^^ | 08:28 |
| *** sshnaidm|afk is now known as sshnaidm | 08:28 | |
| *** yprokule has quit IRC | 08:29 | |
| *** hewbrocca_afk is now known as hewbrocca | 08:32 | |
| openstackgerrit | Juan Badia Payno proposed openstack/puppet-tripleo master: [WIP] logging: teach fluentd.pp about fluentd_service_user https://review.openstack.org/502330 | 08:33 |
| *** akane has quit IRC | 08:33 | |
| *** cshastri has quit IRC | 08:36 | |
| *** links has quit IRC | 08:38 | |
| saneax | tripleo gurus, for a overcloud deployment i am getting ' error=Can not evaluate YAQL expression ' more details - http://paste.openstack.org/show/637648/ | 08:38 |
| *** ramishra has quit IRC | 08:38 | |
| saneax | how do I debug this issue? | 08:38 |
| *** ramishra has joined #tripleo | 08:40 | |
| *** ykarel|lunch has quit IRC | 08:42 | |
| *** ykarel has joined #tripleo | 08:44 | |
| *** holser__ has joined #tripleo | 08:44 | |
| *** ykarel has quit IRC | 08:44 | |
| *** ykarel has joined #tripleo | 08:45 | |
| *** cshastri has joined #tripleo | 08:47 | |
| *** dtantsur|afk is now known as dtantsur | 08:49 | |
| *** lucas-afk is now known as lucasagomes | 08:49 | |
| *** links has joined #tripleo | 08:54 | |
| *** lvdombrkr has quit IRC | 08:55 | |
| *** aditya_r has quit IRC | 08:55 | |
| *** lvdombrkr has joined #tripleo | 08:55 | |
| *** hjensas has quit IRC | 08:55 | |
| *** hjensas has joined #tripleo | 08:59 | |
| *** jpich has joined #tripleo | 09:02 | |
| *** akane has joined #tripleo | 09:03 | |
| *** cylopez has quit IRC | 09:03 | |
| jtomasek | d0ugal: hi, are you around? | 09:06 |
| shardy | saneax: there was a bug in mistral which caused a similar problem on plan creation - what mistral version do you have? | 09:07 |
| *** mdnadeem has joined #tripleo | 09:07 | |
| shardy | saneax: also please check the undercloud mistral logs for a related error | 09:07 |
| saneax | thanks shardy, mistral version is 3.1.4 and I guess I am hitting this issue https://bugs.launchpad.net/tripleo/+bug/1671783 | 09:08 |
| openstack | Launchpad bug 1671783 in tripleo "Stack delete does not delete Swift ring container" [Medium,Fix released] - Assigned to Christian Schwede (cschwede) | 09:08 |
| *** ramishra has quit IRC | 09:08 | |
| shardy | saneax: also check the version of https://github.com/openstack/tripleo-common/commits/master/workbooks/swift_rings_backup.yaml | 09:08 |
| saneax | the swift ring is not deleted and redeploy is failing | 09:08 |
| lvdombrkr | hello folks, pike, two nodes deploy (controller + compute) after deploy overcloud compute node fails on nova scheduler filter , what excatly mean compute' does not match 'control' ?? http://paste.openstack.org/raw/637643/ | 09:08 |
| shardy | saneax: there were a couple of bugfixes recently there IIRC | 09:09 |
| saneax | ok shardy thanks will look at it | 09:09 |
| shardy | saneax: are you running pike or master? Wondering if we missed a backport perhaps? | 09:09 |
| saneax | master | 09:09 |
| shardy | saneax: ack, I'd check the tripleo-common version, note you must run openstack undercloud upgrade not just yum update to reload the workbooks | 09:10 |
| jaosorior | mandre: hey, could you revisit this https://review.openstack.org/#/c/524510/ ? | 09:12 |
| *** jrist has joined #tripleo | 09:12 | |
| saneax | ok shardy | 09:13 |
| *** ramishra has joined #tripleo | 09:14 | |
| mandre | jaosorior: sure! thanks for the reminder :) | 09:15 |
| *** jfrancoa has quit IRC | 09:21 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Switch static ansible inventory to yaml format https://review.openstack.org/530477 | 09:22 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Add role_data* keys to inventory https://review.openstack.org/528354 | 09:22 |
| *** stendulker has joined #tripleo | 09:23 | |
| *** derekh has joined #tripleo | 09:24 | |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: Switch to tripleomaster registry https://review.openstack.org/526726 | 09:25 |
| *** ccamacho has joined #tripleo | 09:26 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-docs master: Document using Ironic Ansible deploy interface https://review.openstack.org/526663 | 09:26 |
| *** akane has quit IRC | 09:30 | |
| *** aditya_r has joined #tripleo | 09:32 | |
| *** akane_ has joined #tripleo | 09:33 | |
| *** dpawar has quit IRC | 09:33 | |
| *** dpawar has joined #tripleo | 09:33 | |
| *** tosky has joined #tripleo | 09:37 | |
| *** cshastri has quit IRC | 09:46 | |
| *** etingof has joined #tripleo | 09:46 | |
| *** links has quit IRC | 09:48 | |
| *** fragatina has quit IRC | 09:49 | |
| *** fragatina has joined #tripleo | 09:50 | |
| *** cshastri has joined #tripleo | 09:50 | |
| *** nyechiel_ has quit IRC | 09:55 | |
| *** nyechiel has joined #tripleo | 09:58 | |
| *** akane_ has quit IRC | 09:58 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-quickstart master: fs016: set telemetry.alarm_granularity to 60s https://review.openstack.org/531002 | 09:59 |
| *** sshnaidm is now known as sshnaidm|afk | 10:00 | |
| *** jtomasek has quit IRC | 10:00 | |
| *** links has joined #tripleo | 10:00 | |
| *** jtomasek has joined #tripleo | 10:01 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: telemetry: Decrease test_telemetry_integration time https://review.openstack.org/531103 | 10:02 |
| *** salmankhan has joined #tripleo | 10:02 | |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-heat-templates master: OvsDpdkMemoryChannels parameter default value https://review.openstack.org/531118 | 10:04 |
| tbarron | saneax: i have been hitting similar issues as what you reported, note | 10:05 |
| tbarron | saneax: that https://bugs.launchpad.net/tripleo/+bug/1671783 was fixed in master 9 months ago, but | 10:05 |
| openstack | Launchpad bug 1671783 in tripleo "Stack delete does not delete Swift ring container" [Medium,Fix released] - Assigned to Christian Schwede (cschwede) | 10:05 |
| tbarron | saneax: note that more recently https://bugs.launchpad.net/tripleo/+bug/1736998 and | 10:06 |
| openstack | Launchpad bug 1736998 in tripleo "The create_swift_rings_backup_container_plan workflow fails if the container already exists " [High,Fix released] - Assigned to Dougal Matthews (d0ugal) | 10:06 |
| tbarron | https://bugs.launchpad.net/tripleo/+bug/1738437 got fixed | 10:06 |
| openstack | Launchpad bug 1738437 in tripleo "Stack update fails with "overcloud-swift-rings already exists"" [High,Fix released] - Assigned to Mike Fedosin (mfedosin) | 10:06 |
| *** aditya_r has quit IRC | 10:06 | |
| Tengu | shardy: if you go to the PTG, we will be able to meet, and I'll be able to pay a first round of beers ;). | 10:06 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Replace deprecated packages installation https://review.openstack.org/528231 | 10:11 |
| shardy | Tengu: sounds good, I will be at the PTG in Dublin next month ;) | 10:13 |
| openstackgerrit | Juan Badia Payno proposed openstack/puppet-tripleo master: Fluentd: Transform path by service https://review.openstack.org/530780 | 10:14 |
| Tengu | shardy: great :). I should be in second and third day. Or maybe "or". I'm coming in order to meet ppl mostly, and maybe discuss some stuff if I feel I can provide some ideas ;). | 10:14 |
| shardy | Tengu: sounds good, any input you have to the TripleO sessions will be very welcome :) | 10:15 |
| Tengu | shardy: I'll check the schedule in order to ensure I'm here :). | 10:16 |
| *** gfidente has joined #tripleo | 10:16 | |
| *** yamahata has quit IRC | 10:16 | |
| *** lvdombrkr is now known as kristaps | 10:24 | |
| *** cshastri has quit IRC | 10:25 | |
| *** kristaps is now known as lvdombrkr89 | 10:32 | |
| *** lvdombrkr89 is now known as lvdombrkr | 10:32 | |
| *** lvdombrkr is now known as lvdombrkr89 | 10:44 | |
| *** social has quit IRC | 10:50 | |
| *** threestrands has joined #tripleo | 10:51 | |
| *** threestrands has quit IRC | 10:51 | |
| *** threestrands has joined #tripleo | 10:51 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: Collect logs in post playbook https://review.openstack.org/527844 | 11:04 |
| *** pkovar has joined #tripleo | 11:06 | |
| *** threestrands has quit IRC | 11:10 | |
| *** jbadiapa has quit IRC | 11:10 | |
| saneax | tbarron, thanks the issue was with deleting the swift containers, After I manually deleted the swift container the deployment is progressing fine | 11:12 |
| saneax | tbarron, I will check once again ensuring the patches are there and see | 11:12 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: WIP Enable loadbalancer for kubernetes masters https://review.openstack.org/516894 | 11:14 |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-heat-templates master: OvsDpdkMemoryChannels parameter default value https://review.openstack.org/531118 | 11:17 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: WIP Enable loadbalancer for kubernetes masters https://review.openstack.org/516894 | 11:17 |
| *** jstramka89 has joined #tripleo | 11:19 | |
| *** stendulker_ has joined #tripleo | 11:22 | |
| *** akane_ has joined #tripleo | 11:23 | |
| *** anilvenkata has quit IRC | 11:23 | |
| *** stendulker has quit IRC | 11:25 | |
| *** stendulker_ has quit IRC | 11:27 | |
| *** openstackstatus has quit IRC | 11:28 | |
| *** openstack has quit IRC | 11:28 | |
| *** openstack has joined #tripleo | 13:07 | |
| *** ChanServ sets mode: +o openstack | 13:07 | |
| *** jlabarre has joined #tripleo | 13:09 | |
| *** ramishra has joined #tripleo | 13:11 | |
| *** openstackstatus has joined #tripleo | 13:11 | |
| *** ChanServ sets mode: +v openstackstatus | 13:11 | |
| ansiwen | owalsh: you mean, together with CFG_DAEMON it might just do the static changes and exit afterwards? that would be cool. | 13:12 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-common master: Add UC backup Mistral workflow definition and actions https://review.openstack.org/517610 | 13:13 |
| *** psachin has joined #tripleo | 13:15 | |
| openstackgerrit | Bob Fournier proposed openstack/puppet-tripleo master: Configure VIPs for all networks including composable networks https://review.openstack.org/531037 | 13:16 |
| *** morazi has joined #tripleo | 13:17 | |
| *** gfidente has joined #tripleo | 13:18 | |
| *** gfidente has joined #tripleo | 13:18 | |
| *** ukalifon has joined #tripleo | 13:18 | |
| *** links has joined #tripleo | 13:19 | |
| *** trown|outtypewww is now known as trown | 13:21 | |
| *** lblanchard has joined #tripleo | 13:22 | |
| karthiks | beagles, Hi, I would like to know if there is a ifcfg config that can set the mac address /spoofchk/trust for a VF ? | 13:24 |
| *** rhallisey has joined #tripleo | 13:24 | |
| owalsh | ansiwen: don't think there is an option to apply changes and exit afterwards, but would be simple to add this I expect | 13:24 |
| mwhahaha | jaosorior: you could try "%{::os_service_default}" | 13:26 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Add docs for reloading workbooks during development https://review.openstack.org/531150 | 13:26 |
| jaosorior | mwhahaha: didn't know if it was possible as nothinig is using that in t-h-t :/ | 13:27 |
| jaosorior | was fishy, so I decided to do it with heat conditionals | 13:27 |
| jaosorior | mwhahaha: https://review.openstack.org/#/c/531143/ | 13:27 |
| *** tzumainn has joined #tripleo | 13:28 | |
| *** dsariel has joined #tripleo | 13:28 | |
| mwhahaha | jaosorior: yea heat conditionals are probably better | 13:29 |
| *** rlandy has joined #tripleo | 13:30 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Add get_session function to base action class https://review.openstack.org/531151 | 13:30 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Convert ansible action to TripleoInventory class https://review.openstack.org/531152 | 13:30 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Make plan_name configurable for config_download_deploy https://review.openstack.org/531153 | 13:30 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-common master: Add UC backup Mistral workflow definition and actions https://review.openstack.org/517610 | 13:30 |
| *** dhill_ has joined #tripleo | 13:30 | |
| *** skramaja has quit IRC | 13:31 | |
| *** lucas-hungry is now known as lucasagomes | 13:32 | |
| *** jaganathan has quit IRC | 13:34 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart-extras master: Only execute UI validations when UI is enabled https://review.openstack.org/524510 | 13:34 |
| jaosorior | mwhahaha: if you have some time could you check this out config/nodes/3ctlr_1comp.yml ? | 13:34 |
| jaosorior | mwhahaha: I mean https://review.openstack.org/#/q/topic:security-compliance+status:open | 13:35 |
| jaosorior | wrong paste :P | 13:35 |
| mwhahaha | jaosorior: k in a bit | 13:35 |
| *** tzumainn has quit IRC | 13:41 | |
| *** tzumainn has joined #tripleo | 13:41 | |
| *** mdnadeem has quit IRC | 13:42 | |
| *** pkovar has quit IRC | 13:44 | |
| *** pdeore has joined #tripleo | 13:45 | |
| *** jmelvin has joined #tripleo | 13:45 | |
| *** ecerquei has quit IRC | 13:48 | |
| *** dtantsur is now known as dtantsur|brb | 13:49 | |
| *** ecerquei has joined #tripleo | 13:50 | |
| *** dpawar has quit IRC | 13:52 | |
| *** dpawar has joined #tripleo | 13:53 | |
| *** atoth has joined #tripleo | 13:53 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates stable/pike: Update task to remove legacy ceilo service from keystone https://review.openstack.org/531155 | 13:53 |
| *** eck`gone is now known as eck` | 13:55 | |
| *** dpawar has quit IRC | 13:57 | |
| *** ecerquei has quit IRC | 13:57 | |
| *** mdnadeem has joined #tripleo | 13:58 | |
| *** ecerquei has joined #tripleo | 13:58 | |
| *** sshnaidm|afk is now known as sshnaidm|mtg | 13:58 | |
| *** pkovar has joined #tripleo | 13:58 | |
| weshay | mwhahaha, arxcruz|ruck FYI.. noting timeouts on multinode-containers in the gate | 13:59 |
| mwhahaha | Booo | 14:00 |
| *** tvignaud has quit IRC | 14:01 | |
| *** pkovar1 has joined #tripleo | 14:02 | |
| *** pkovar has quit IRC | 14:02 | |
| openstackgerrit | Pranali Deore proposed openstack/puppet-tripleo master: Add support of netapp configuration for glance https://review.openstack.org/530432 | 14:03 |
| *** psachin has quit IRC | 14:04 | |
| jaosorior | shardy, mwhahaha: Would you be opposed to getting one of the ovb jobs to start using config-download? | 14:08 |
| weshay | mwhahaha, any changes w/ newton re: eol | 14:11 |
| *** salmankhan has quit IRC | 14:11 | |
| *** Goneri has joined #tripleo | 14:12 | |
| mwhahaha | jaosorior: it doesn't work right now | 14:13 |
| mwhahaha | jaosorior: we're not opposed but there are issues, sync with slagle | 14:13 |
| jaosorior | mwhahaha: it doesn't? thought it had been fixed with the latest promotion | 14:13 |
| mwhahaha | weshay: no, we need to pick a date towards teh end of the month | 14:13 |
| mwhahaha | jaosorior: not sure, hence sync with slagle :D it was timing out for whatever reason. There's a review to test somewhere | 14:14 |
| jaosorior | mwhahaha: will do, thanks | 14:14 |
| slagle | it works as of last night :) | 14:18 |
| slagle | https://review.openstack.org/#/c/525331/ | 14:18 |
| jaosorior | slagle: nice!! | 14:19 |
| *** mdnadeem has quit IRC | 14:19 | |
| slagle | for queens, the default is still not using config-download. so we may not want to switch ovb-ha until we branch | 14:19 |
| jaosorior | slagle: oh, I actually didn't know about the --config-download flag | 14:20 |
| slagle | but we can setup an experimental job, and then switch master as soon as queens branches | 14:20 |
| jaosorior | slagle: well, there's ovb-ha-oooq and ovb-ha-oooq-ipv6 | 14:20 |
| jaosorior | slagle: I was thinking of using one of those, and switching it to use config-download | 14:20 |
| slagle | yea that's a possibility | 14:21 |
| jaosorior | slagle: is the --config-download flag equivalent to doing tripleo-config-download -s overcloud -o ~/config-download ? | 14:21 |
| *** jokke_ has quit IRC | 14:21 | |
| slagle | jaosorior: yes, more or less | 14:21 |
| jaosorior | slagle: what's the difference? | 14:21 |
| slagle | jaosorior: it's meant to do the whole thing end to end, so you can still get a full deployment with just a single "openstack overcloud deploy" command | 14:21 |
| slagle | jaosorior: the difference is that the config download pieces all run within a mistral workflow | 14:22 |
| jaosorior | slagle: what's the mistral workflow? | 14:22 |
| *** dtantsur|brb is now known as dtantsur | 14:22 | |
| jaosorior | slagle: I've been needing to pass the --become flag to the ansible playbook, so I just want to know which parameters are being used int he playbook. | 14:22 |
| slagle | jaosorior: the workflow is tripleo.deployment.v1.config_download_deploy | 14:23 |
| slagle | it uses become: true i believe | 14:23 |
| jaosorior | lets see | 14:23 |
| slagle | jaosorior: see https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ansible_config_download.html#ansible-playbook-execution | 14:23 |
| slagle | jaosorior: and https://blogslagle.wordpress.com/2017/12/13/tripleo-and-ansible-part-2/ for more of a narrative | 14:23 |
| jaosorior | excellent | 14:24 |
| jaosorior | thanks! | 14:24 |
| slagle | np. let me know how we can improve anything. i'm anxious to get more folks using this approach | 14:25 |
| *** dansmith has quit IRC | 14:25 | |
| *** liverpooler has joined #tripleo | 14:25 | |
| arxcruz|ruck | mwhahaha: EmilienM fyi zuul is having some memory issues, so we are seeing post_failure errors | 14:26 |
| jaosorior | slagle: well, so far so good, it really facilitated the IPSEC work (which now relies on the deployment using config-download) | 14:27 |
| *** dansmith has joined #tripleo | 14:28 | |
| *** dansmith is now known as Guest3856 | 14:28 | |
| jaosorior | sshnaidm|mtg: what featureset is the tripleo-ci-centos-7-ovb-ha-oooq job using? | 14:28 |
| slagle | 10 | 14:28 |
| slagle | 001 i mean | 14:29 |
| *** therve_ is now known as therve | 14:29 | |
| jaosorior | slagle: oh, so the one you modified is exactly that one? | 14:29 |
| slagle | yea | 14:29 |
| jaosorior | slagle: is any other job using that featureset? | 14:29 |
| slagle | i don't think so. i don't think the featuresets are combined anywhere | 14:30 |
| jaosorior | ok | 14:30 |
| *** jokke_ has joined #tripleo | 14:31 | |
| jaosorior | slagle: well, since you already have that patch, would you be ok to propose it with a proper commit message, and let folks vote if it's a good idea to change it to use config-download by default? | 14:31 |
| slagle | jaosorior: yea, i'll do that today. just got it working last night :) | 14:32 |
| slagle | jaosorior: my nic config templates update did not pass the stable jobs, so i need to investigate that as well | 14:33 |
| *** mdnadeem has joined #tripleo | 14:33 | |
| *** jobewan has joined #tripleo | 14:33 | |
| slagle | b/c of the heat_template_version i used i'm guessing | 14:34 |
| slagle | hopefully i can just use newton there, otherwise we will have to branch these templates | 14:34 |
| jaosorior | slagle: The template version is invalid: "heat_template_version: pike" | 14:35 |
| jaosorior | seems that way | 14:35 |
| jaosorior | well, you're not using anything fancy; merely str_replace, so it should be fine | 14:36 |
| *** liverpooler has quit IRC | 14:37 | |
| *** pdeore has quit IRC | 14:38 | |
| slagle | jaosorior: yea, it was something with the str_replace. an undocumented change between the template versions i guess | 14:41 |
| slagle | the older version was not allowing the $network_config value as a param in str_replace | 14:42 |
| slagle | something about "must be a string" | 14:42 |
| shardy | jaosorior: I'm not opposed to an ovb job w/config-download, in general I'm happy to see more coverage of that workflow, so we can work towards making it the default | 14:43 |
| shardy | slagle: it's documented I think, newer versions of str_replace take list/map values and serialize them to json | 14:44 |
| * shardy finds docs | 14:44 | |
| *** yolanda has quit IRC | 14:45 | |
| sshnaidm|mtg | jaosorior, 001 | 14:45 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Convert nic-config templates https://review.openstack.org/531016 | 14:45 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Convert ipv6 nic-config templates https://review.openstack.org/531019 | 14:45 |
| shardy | https://docs.openstack.org/heat/latest/template_guide/hot_spec.html#str-replace | 14:45 |
| shardy | slagle: see the "From HOT version 2015-10-15 you may optionally pass non-string parameter values ..." | 14:45 |
| slagle | shardy: oh, thanks! i was looking at the versions documentation, https://docs.openstack.org/heat/latest/template_guide/hot_spec.html#heat-template-version | 14:46 |
| shardy | slagle: ah, maybe we need some link there or something | 14:46 |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Add missing CephClient service to ControllerNoCeph role https://review.openstack.org/531163 | 14:46 |
| *** yolanda has joined #tripleo | 14:46 | |
| shardy | I added that to enable serializing some stuff like lists into hiera IIRC | 14:46 |
| *** bfournie1 has joined #tripleo | 14:46 | |
| slagle | so if i use version "newton", should be good | 14:47 |
| shardy | or something, I forget the exact reason | 14:47 |
| slagle | that's what i'm trying in that latest update | 14:47 |
| *** bfournie has quit IRC | 14:47 | |
| *** ykarel is now known as ykarel|away | 14:47 | |
| -openstackstatus- NOTICE: zuul has been restarted, all queues have been reset. please recheck your patches when appropriate | 14:48 | |
| shardy | slagle: yeah that should work I think | 14:49 |
| shardy | openstack orchestration template version list shows the versions/aliases | 14:49 |
| shardy | newton was the first version to have an alias by the looks of it | 14:49 |
| *** bfournie has joined #tripleo | 14:51 | |
| *** bfournie1 has quit IRC | 14:51 | |
| slagle | ok so if this all passes, i'll update https://review.openstack.org/#/c/525331/ and we can all vote | 14:52 |
| *** ykarel|away has quit IRC | 14:53 | |
| *** almondjoy has joined #tripleo | 14:55 | |
| *** links has quit IRC | 14:56 | |
| *** gfidente has quit IRC | 14:56 | |
| *** gfidente has joined #tripleo | 14:57 | |
| *** gfidente has joined #tripleo | 14:57 | |
| *** liverpooler has joined #tripleo | 14:58 | |
| EmilienM | arxcruz|ruck: ok | 14:58 |
| *** oidgar has joined #tripleo | 14:58 | |
| arxcruz|ruck | EmilienM: it seems it's working now, I already see some tripleo-ci changes running | 14:59 |
| arxcruz|ruck | EmilienM: plus, multinode still reaching a lot of timeout | 14:59 |
| EmilienM | yeah, we started some work yesterday, I'll continue today | 14:59 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Enable loadbalancer for kubernetes masters https://review.openstack.org/516894 | 15:00 |
| bogdando | jistr, shardy: ^^ | 15:00 |
| bogdando | feel free to test. Works for me | 15:00 |
| *** jkilpatr has joined #tripleo | 15:01 | |
| *** ebarrera has joined #tripleo | 15:04 | |
| *** shreshtha has joined #tripleo | 15:04 | |
| *** salmankhan has joined #tripleo | 15:05 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart master: WIP: Add fs038 for Octavia scenario testing https://review.openstack.org/531168 | 15:06 |
| *** shreshtha has quit IRC | 15:10 | |
| *** shreshtha has joined #tripleo | 15:10 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: do not dump_vars on localhost https://review.openstack.org/529664 | 15:11 |
| *** agurenko has quit IRC | 15:11 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-common master: Add scenario008 https://review.openstack.org/531173 | 15:12 |
| *** moshele has quit IRC | 15:19 | |
| *** rbrady has joined #tripleo | 15:19 | |
| *** rbrady has joined #tripleo | 15:19 | |
| weshay | mwhahaha, can this be closed? https://bugs.launchpad.net/tripleo/+bug/1738863 | 15:22 |
| openstack | Launchpad bug 1738863 in tripleo "barbican scenario002 tests fail with urllib3.exceptions.ProtocolError: ('Connection aborted.', BadStatusLine("''",))" [High,Triaged] | 15:22 |
| mwhahaha | weshay: yes i believe so | 15:22 |
| *** aputtur_ has joined #tripleo | 15:25 | |
| EmilienM | mwhahaha: fyi, https://review.openstack.org/#/c/531103/ | 15:25 |
| jrist | florianf: if you have time, can you look at some of the tripleo-ui patches that need merging? several have a bunch of +1 and +2 | 15:25 |
| EmilienM | mwhahaha: we should reduce the scenario001 by 8 min if that thing works | 15:25 |
| mwhahaha | if :D | 15:25 |
| EmilienM | mwhahaha: we need to keep looking at the provisioning part | 15:25 |
| mwhahaha | EmilienM: indeed | 15:26 |
| florianf | jrist: sure. | 15:26 |
| florianf | jrist: I'll have a look | 15:26 |
| EmilienM | mwhahaha: I guess I'll spend time on it today. Also scenario002 | 15:26 |
| *** pradk has joined #tripleo | 15:26 | |
| shardy | Are there infra issues atm? Seeing a log of POST_FAILURE and ssh errors | 15:27 |
| EmilienM | shardy: they restarted ZUUL | 15:27 |
| EmilienM | shardy: memory issue | 15:27 |
| shardy | EmilienM: ah, so it's OK to recheck then | 15:27 |
| tosky | shardy: you can recheck, yes | 15:27 |
| openstackgerrit | Sulaiman Radwan proposed openstack/puppet-tripleo master: Fix the issue with hardware offloading over Connectx4-LX https://review.openstack.org/531176 | 15:27 |
| shardy | ack thanks for confirming | 15:27 |
| EmilienM | shardy: https://twitter.com/openstackinfra/status/948929223313575942 | 15:27 |
| tosky | there was an announcement on all the channels, including this one (see around 14:48 UTC) | 15:28 |
| shardy | tosky: thanks, evidently I missed it :) | 15:28 |
| *** ukalifon has quit IRC | 15:28 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add scenario008 for testing Octavia https://review.openstack.org/518331 | 15:32 |
| ansiwen | dtantsur: ok, so it seems a separate overcloud image would be necessary, but not welcome... so it seems like we have to install the kernel during deployment and reboot. *sigh* | 15:36 |
| dtantsur | ansiwen: we can try doing subscriptions magic in ansible then | 15:39 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add scenario010 for testing Octavia https://review.openstack.org/518331 | 15:40 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs016/17: set telemetry.alarm_granularity to 60s https://review.openstack.org/531002 | 15:43 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Convert undercloud deploy to use TripleoInventory class https://review.openstack.org/529652 | 15:44 |
| *** jokke_ has quit IRC | 15:46 | |
| *** jokke_ has joined #tripleo | 15:46 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: ci/telemetry: Decrease test_telemetry_integration time https://review.openstack.org/531103 | 15:47 |
| *** jkilpatr has quit IRC | 15:49 | |
| *** jkilpatr has joined #tripleo | 15:49 | |
| *** suuuper has quit IRC | 15:51 | |
| openstackgerrit | Thiago da Silva proposed openstack/tripleo-heat-templates master: WIP: Add new encryption middleware to swift proxy https://review.openstack.org/525324 | 15:52 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs017: stop running test_volume_boot_pattern https://review.openstack.org/531182 | 15:54 |
| EmilienM | mwhahaha: another 5 min ^ | 15:54 |
| ansiwen | dtantsur: if you are a magician, please do :-) | 15:56 |
| *** jkilpatr has quit IRC | 15:56 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common master: Adds Workflow to List Available Roles https://review.openstack.org/509832 | 15:57 |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common master: Adds UpdateRoles Workflow https://review.openstack.org/515045 | 15:57 |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common master: Select Roles Workflow https://review.openstack.org/528282 | 15:57 |
| openstackgerrit | Ilya Etingof proposed openstack/tripleo-common master: UCS Ironic node driver info added https://review.openstack.org/528726 | 15:59 |
| *** udesale has joined #tripleo | 16:01 | |
| *** raildo has quit IRC | 16:04 | |
| *** bogdando has quit IRC | 16:08 | |
| openstackgerrit | Brent Eagles proposed openstack-infra/tripleo-ci master: Add scenario010 multinode container job https://review.openstack.org/531184 | 16:11 |
| *** jkilpatr has joined #tripleo | 16:11 | |
| *** udesale has quit IRC | 16:14 | |
| openstackgerrit | Julie Pichon proposed openstack/tripleo-ui master: Reenable the undercloud jobs https://review.openstack.org/526430 | 16:14 |
| openstackgerrit | Julie Pichon proposed openstack/tripleo-ui master: Reenable the undercloud jobs https://review.openstack.org/526430 | 16:17 |
| openstackgerrit | Damien Ciabrini proposed openstack/puppet-tripleo master: Enable automatic restart of memcached, apache and mongodb https://review.openstack.org/531190 | 16:18 |
| tbarron | What triggers new image builds in docker.io/tripleoupstream repository? | 16:20 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Introduce scenario010-container experimental job https://review.openstack.org/531191 | 16:20 |
| tbarron | When I deploy containerized overcloud with master today I get images from ~ Dec.6 build... | 16:21 |
| openstackgerrit | Julie Pichon proposed openstack/tripleo-ui master: Reenable the undercloud jobs https://review.openstack.org/526430 | 16:21 |
| jaosorior | slagle: when I run the ansible with the config-download, lately it's been getting REALLY slow :/ | 16:21 |
| *** mcornea has quit IRC | 16:21 | |
| jaosorior | even though my undercloud has 12G | 16:21 |
| tbarron | I'll build and push to local registry a more up-to-date image if necessary but I should understand the process for the images in the official repo. | 16:22 |
| *** nyechiel has quit IRC | 16:22 | |
| tbarron | ^^ is it a matter of RDO promoting? | 16:23 |
| *** marios has quit IRC | 16:23 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Drop redundant delay param https://review.openstack.org/531192 | 16:24 |
| *** aufi has quit IRC | 16:24 | |
| slagle | jaosorior: that could be anything really. we havent seen that in ci | 16:24 |
| slagle | jaosorior: what is the slow part? | 16:25 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Add scenario010 for testing Octavia https://review.openstack.org/518331 | 16:25 |
| jaosorior | every single step runs very slowly | 16:25 |
| jaosorior | for instance | 16:25 |
| jaosorior | it's been doing TASK [Render deployment file for SshHostPubKeyDeployment] for several minutes now | 16:25 |
| *** jkilpatr has quit IRC | 16:26 | |
| openstackgerrit | Julie Pichon proposed openstack/tripleo-ui master: Reenable the undercloud jobs https://review.openstack.org/526430 | 16:26 |
| slagle | jaosorior: ansible uses ssh. can you ssh to one of the hosts of that task? | 16:26 |
| *** rhallisey has quit IRC | 16:26 | |
| slagle | jaosorior: i'd start by trying to see what the slow down might be | 16:26 |
| jaosorior | seems that sshing into the compute is the slow part | 16:27 |
| slagle | ok | 16:27 |
| jaosorior | funky | 16:27 |
| jaosorior | hasn't even started any services | 16:27 |
| slagle | jaosorior: check dns on the compute node | 16:28 |
| slagle | ssh will try and resolve hostnames and will hang logins if you've misconfigured it | 16:28 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Add scenario010 for testing Octavia https://review.openstack.org/518331 | 16:28 |
| slagle | jaosorior: usually it lets you in after a timeout | 16:28 |
| *** jkilpatr has joined #tripleo | 16:29 | |
| *** holser__ has quit IRC | 16:30 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart master: WIP: Add fs038 for Octavia scenario testing https://review.openstack.org/531168 | 16:30 |
| jaosorior | slagle: you were right! it was a DNS issue | 16:31 |
| jaosorior | thanks! | 16:31 |
| *** jkilpatr has quit IRC | 16:32 | |
| *** jkilpatr has joined #tripleo | 16:32 | |
| slagle | jaosorior: you need to either set DnsServers parameter is using net-iso, or set a --dns-nameserver on the ctlplane-subnet in the undercloud if not using net-iso | 16:34 |
| *** mcornea has joined #tripleo | 16:34 | |
| *** rhallisey has joined #tripleo | 16:37 | |
| *** aputtur_ has quit IRC | 16:37 | |
| *** zshi has quit IRC | 16:38 | |
| *** aputtur_ has joined #tripleo | 16:40 | |
| *** zshi has joined #tripleo | 16:40 | |
| *** dtantsur is now known as dtantsur|afk | 16:41 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-common master: Add scenario010 https://review.openstack.org/531173 | 16:42 |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Add missing CephClient service to ControllerNoCeph role https://review.openstack.org/531163 | 16:42 |
| EmilienM | shardy: hey, I'm testing config-download with 3nodes scenario, and it fails on the tripleo inventory http://logs.openstack.org/61/528761/11/check/tripleo-ci-centos-7-3nodes-multinode/178b9d6/logs/undercloud/var/log/mistral/executor.log.txt.gz#_2018-01-04_07_50_57_791 | 16:44 |
| EmilienM | shardy: I was wondering if related to your work | 16:44 |
| *** ramishra has quit IRC | 16:45 | |
| *** zshi has quit IRC | 16:45 | |
| *** moshele has joined #tripleo | 16:45 | |
| *** raildo has joined #tripleo | 16:46 | |
| *** anilvenkata has quit IRC | 16:46 | |
| *** ccamacho has quit IRC | 16:47 | |
| shardy | EmilienM: hey, sec I'll take a look | 16:47 |
| openstackgerrit | Julie Pichon proposed openstack/tripleo-ui master: Reenable the undercloud jobs https://review.openstack.org/526430 | 16:48 |
| shardy | EmilienM: --static-inventory is still using the old code, but let me see if I can figure it out | 16:48 |
| openstackgerrit | Julie Pichon proposed openstack/tripleo-ui master: Reenable the undercloud jobs https://review.openstack.org/526430 | 16:50 |
| *** zshi has joined #tripleo | 16:50 | |
| shardy | EmilienM: sec I'll try to reproduce, maybe it's related to the use of a custom role | 16:50 |
| shardy | :q | 16:50 |
| *** kristaps_ has joined #tripleo | 16:51 | |
| *** pcaruana has quit IRC | 16:52 | |
| *** Guest3856 is now known as dansmith | 16:53 | |
| *** moshele has quit IRC | 16:53 | |
| *** kristaps has joined #tripleo | 16:53 | |
| *** lvdombrkr89 has quit IRC | 16:54 | |
| *** jstramka89 has quit IRC | 16:54 | |
| *** hewbrocca is now known as hewbrocca_afk | 16:54 | |
| *** mcornea has quit IRC | 16:54 | |
| *** nyechiel has joined #tripleo | 16:55 | |
| *** yamahata has joined #tripleo | 16:56 | |
| *** jpich has quit IRC | 16:56 | |
| *** ffiore has quit IRC | 16:58 | |
| *** yprokule has quit IRC | 16:58 | |
| *** liverpooler has quit IRC | 16:58 | |
| EmilienM | shardy: should I just depends-on https://review.openstack.org/#/c/531153 ? | 16:58 |
| shardy | EmilienM: I don't think that will help as the deploy isn't using a --stack option | 17:00 |
| shardy | EmilienM: I'm trying to reproduce now | 17:00 |
| EmilienM | ok | 17:00 |
| *** dsneddon has joined #tripleo | 17:01 | |
| shardy | EmilienM: if I can't reproduce we could try with Depends-On https://review.openstack.org/#/c/531152/, or work out how to get a better backtrace from the python exect of tripleo-ansible-inventory | 17:02 |
| *** nyechiel has quit IRC | 17:02 | |
| *** pchavva has quit IRC | 17:05 | |
| *** pchavva has joined #tripleo | 17:06 | |
| *** tesseract has quit IRC | 17:07 | |
| *** holser__ has joined #tripleo | 17:08 | |
| *** dhill_ has quit IRC | 17:14 | |
| *** holser__ has quit IRC | 17:14 | |
| *** salmankhan has quit IRC | 17:14 | |
| EmilienM | shardy: yeah, do we we log it somewhere? in syslog maybe? I'm finishing something and will also have a look. I was just wondering if you knew the issue | 17:19 |
| openstackgerrit | Merged openstack/tripleo-ui master: Remove trash icon from delete node modal https://review.openstack.org/525281 | 17:25 |
| openstackgerrit | Merged openstack/tripleo-ui master: Remove oslosphinx https://review.openstack.org/508588 | 17:25 |
| *** dhill_ has joined #tripleo | 17:26 | |
| shardy | EmilienM: I think we discard the stdout and stderr ref https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/ansible.py#L548 | 17:26 |
| shardy | EmilienM: https://review.openstack.org/#/c/531152/ will help with that since we'll use the class directly instead of via processutils | 17:26 |
| *** mdnadeem has quit IRC | 17:27 | |
| *** moshele has joined #tripleo | 17:27 | |
| EmilienM | shardy: indeed | 17:29 |
| *** salmankhan has joined #tripleo | 17:30 | |
| mwhahaha | jaosorior: where's ansible-tripleo-ipsec | 17:32 |
| mwhahaha | jaosorior: i'm getting a failure trying to install python-tripleoclient cause tht requires it but it's not available | 17:32 |
| *** cylopez has joined #tripleo | 17:33 | |
| *** agopi has joined #tripleo | 17:34 | |
| mwhahaha | actually might be because the current-passed-ci isn't up to date | 17:34 |
| mwhahaha | weshay: is current-passed-ci no longer updated/used? | 17:34 |
| weshay | I think only for newton | 17:34 |
| mwhahaha | well it exists and is out of date for master | 17:34 |
| mwhahaha | which is a problem | 17:34 |
| mwhahaha | what's the new proper naming scheme | 17:34 |
| weshay | hrm | 17:34 |
| mwhahaha | https://trunk.rdoproject.org/centos7-master/ | 17:35 |
| weshay | current-tripleo, current-tripleo-rdo, current-tripleo-rdo-internal | 17:35 |
| mwhahaha | which is the new 'passed-ci' | 17:35 |
| mwhahaha | current-tripleo? | 17:35 |
| * mwhahaha prefers passed-ci as it indicates it's good | 17:36 | |
| weshay | mwhahaha, you are referring to the links in delorean right? | 17:36 |
| *** cylopez has quit IRC | 17:36 | |
| mwhahaha | https://trunk.rdoproject.org/centos7-master/current-passed-ci/ | 17:36 |
| *** moshele has quit IRC | 17:36 | |
| *** shreshtha has quit IRC | 17:36 | |
| weshay | mwhahaha, ah.. current-passed-ci is still there.. but it's the same link as current-tripleo-rdo | 17:37 |
| weshay | which has not promoted in a while | 17:37 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: puppet apply: add --summarize https://review.openstack.org/531013 | 17:37 |
| weshay | current-passed-ci just doesn't indicate what level of CI has passed | 17:38 |
| weshay | but.. it's fine for rdo, rdo-community makes the rules | 17:38 |
| mwhahaha | yea it's not clear | 17:38 |
| mwhahaha | so i guess current-tripleo is what i need to use | 17:38 |
| mwhahaha | you know what would be awesome? documentation | 17:38 |
| weshay | ya.. that is what is used in upstream | 17:39 |
| *** cylopez has joined #tripleo | 17:40 | |
| mwhahaha | speaking of documentation wtf is current-tripleo-dev | 17:40 |
| mwhahaha | http://tripleo.org/install/installation/installation.html#installing-the-undercloud | 17:40 |
| shardy | Also I got confused recently because "current" isn't actually current but what's in upper constraints | 17:41 |
| *** cylopez has quit IRC | 17:41 | |
| shardy | centos-7-master-head is actually current but potentially broken apparently | 17:41 |
| *** raildo has quit IRC | 17:41 | |
| mwhahaha | looks like current-tripleo-dev is just a tripleo-repos construct | 17:41 |
| *** raildo has joined #tripleo | 17:42 | |
| *** dsariel has quit IRC | 17:42 | |
| shardy | does it setup the whitelist for tripleo things to come from "current" | 17:42 |
| shardy | ? | 17:42 |
| shardy | historically we've done that with everything else from the promoted current-tripleo | 17:42 |
| mwhahaha | yea | 17:42 |
| shardy | it's gotten kind of confusing recently tho | 17:43 |
| mwhahaha | https://github.com/openstack/tripleo-repos/blob/15e17a8035939395c66a398d885abc93df7259a7/tripleo_repos/main.py#L210 | 17:43 |
| mwhahaha | this is where it needed to be in an application of some sort | 17:43 |
| mwhahaha | so i guess time to switch my stuff to tripleo-repos :D | 17:43 |
| *** yprokule has joined #tripleo | 17:45 | |
| *** lucasagomes is now known as lucas-afk | 17:46 | |
| mwhahaha | ugh that didn't work | 17:46 |
| mwhahaha | i enjoy yak shaving every week | 17:46 |
| *** oidgar has quit IRC | 17:47 | |
| * bnemec hatches a plan to make yak wool fashionable | 17:50 | |
| *** fragatina has quit IRC | 17:50 | |
| *** holser__ has joined #tripleo | 17:50 | |
| bnemec | If I succeed we'll all be able to retire to private islands on the proceeds from all our yak shaving. :-D | 17:50 |
| *** eck` is now known as eck`gone | 17:50 | |
| shardy | EmilienM: sorry I'm unable to reproduce that tripleo-ansible-inventory error, should I push a patch we can depend on which may expose more info re the stderr from processutils? | 17:51 |
| EmilienM | shardy: of course | 17:51 |
| EmilienM | please do | 17:51 |
| *** sshnaidm|mtg is now known as sshnaidm | 17:51 | |
| *** holser__ has quit IRC | 17:55 | |
| *** pkovar1 has quit IRC | 18:02 | |
| *** Goneri has quit IRC | 18:03 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-validations master: WIP expose error creating static inventory in CI DNM https://review.openstack.org/531205 | 18:03 |
| *** derekh has quit IRC | 18:03 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-quickstart master: fs032: activate config-download https://review.openstack.org/528761 | 18:04 |
| *** Goneri has joined #tripleo | 18:05 | |
| *** eck`gone is now known as eck` | 18:06 | |
| *** bcafarel has quit IRC | 18:07 | |
| EmilienM | sshnaidm: woot https://review.openstack.org/#/c/527844/ | 18:08 |
| shardy | EmilienM: ^^ that should show us the data from tripleo-common, and the full backtrace to enable a reproduce | 18:08 |
| shardy | I'll check back later to see the results | 18:09 |
| EmilienM | shardy: I'll check results | 18:09 |
| EmilienM | shardy: thx | 18:09 |
| EmilienM | mwhahaha: look https://review.openstack.org/#/c/527844/ and how it helps | 18:09 |
| shardy | EmilienM: Ok, thanks - it's possible it's related to the move to TripleoInventory, but I can't see how atm | 18:09 |
| *** karthiks has quit IRC | 18:10 | |
| EmilienM | sshnaidm: some files are missing though | 18:12 |
| EmilienM | sshnaidm: like the tempest html | 18:12 |
| sshnaidm | EmilienM, it failed, but we are close.. | 18:12 |
| EmilienM | sshnaidm: see the errors: http://logs.openstack.org/44/527844/13/check/tripleo-ci-centos-7-containers-multinode/62c7714/job-output.txt.gz#_2018-01-04_17_58_13_657394 | 18:12 |
| sshnaidm | EmilienM, yeah, working on that | 18:13 |
| *** bcafarel has joined #tripleo | 18:16 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: Collect logs in post playbook https://review.openstack.org/527844 | 18:17 |
| abishop | hey mods, I just submitted https://bugs.launchpad.net/tripleo/+bug/1741310 and it may need more triaging | 18:18 |
| openstack | Launchpad bug 1741310 in tripleo "Undercloud heat's max_json_body_size value is too low (again)" [High,New] | 18:18 |
| abishop | ^^ this | 18:18 |
| shardy | abishop: probably need to provide all the environment files, and anything else referenced via get_file | 18:19 |
| shardy | abishop: the limit can be exceeded, but it normally takes something like a get_file referencing a huge script to do it IME | 18:19 |
| shardy | that said, I hit similar issues a while back trying to pass lots of unmerged environments in the files map, so it may be time to either increase it or look more closely at loading things directly from swift inside heat | 18:20 |
| abishop | shardy: ack, I'll add that to the bz | 18:20 |
| *** vpickard is now known as vpickard_ | 18:20 | |
| openstackgerrit | Mike Fedosin proposed openstack/tripleo-heat-templates master: Add Additional sysctl values to enhance security https://review.openstack.org/531210 | 18:22 |
| *** almondjoy has quit IRC | 18:23 | |
| *** gkadam has joined #tripleo | 18:23 | |
| *** nyechiel has joined #tripleo | 18:24 | |
| *** dhill_ has quit IRC | 18:25 | |
| *** shardy has quit IRC | 18:25 | |
| *** dhill_ has joined #tripleo | 18:26 | |
| *** yamahata has quit IRC | 18:26 | |
| *** numans_afk is now known as numans | 18:36 | |
| *** agopi has quit IRC | 18:39 | |
| slagle | EmilienM: we will have to branch the nic config templates used by ovb | 18:45 |
| EmilienM | slagle: because of releases, right? | 18:45 |
| slagle | they'll need to be different for newton vs > newton | 18:45 |
| EmilienM | yeah | 18:45 |
| EmilienM | we figured that out when working on netiso for ipv6 | 18:46 |
| slagle | EmilienM: should i move them to tripleo-heat-templates? | 18:46 |
| EmilienM | slagle: shoulw we store in THT? | 18:46 |
| slagle | i guess :) | 18:46 |
| EmilienM | branching tripleo-ci might be painful, as well as maintaining some branch logic in CI framework | 18:46 |
| EmilienM | I guess moving to THT is easier | 18:46 |
| slagle | yea i gather the same | 18:46 |
| EmilienM | maybe in ci/ directory | 18:47 |
| slagle | i'll work on some patches | 18:47 |
| EmilienM | ok | 18:47 |
| *** ebarrera has quit IRC | 18:51 | |
| *** jlabarre has quit IRC | 18:53 | |
| *** jlabarre has joined #tripleo | 18:53 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-docs master: Document ceph-ansible options used to deploy at scale https://review.openstack.org/531214 | 18:56 |
| bnemec | EmilienM: slagle: The nic-configs are already in tht: https://github.com/openstack/tripleo-heat-templates/tree/master/ci/environments/network/multiple-nics | 18:58 |
| bnemec | And ipv6: https://github.com/openstack/tripleo-heat-templates/tree/master/ci/environments/network/multiple-nics-ipv6 | 18:58 |
| slagle | there may be some nic conifgs there, but they are not used by ovb jobs in ci :) | 18:59 |
| *** vpickard_ is now known as vpickard | 19:00 | |
| *** Goneri has quit IRC | 19:00 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-docs master: Document ceph-ansible options used to deploy at scale https://review.openstack.org/531214 | 19:01 |
| *** yamahata has joined #tripleo | 19:04 | |
| openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo master: Adds TLS support for OpenDaylight https://review.openstack.org/531003 | 19:09 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Convert nic-config templates https://review.openstack.org/531219 | 19:13 |
| openstackgerrit | Merged openstack/puppet-tripleo master: gnocchi/ceilometer upgrade workflow fix https://review.openstack.org/527940 | 19:13 |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates master: Adds SSL/TLS everywhere for OpenDaylight https://review.openstack.org/531026 | 19:13 |
| *** jmelvin has quit IRC | 19:18 | |
| *** yprokule has quit IRC | 19:23 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: Activate config-download for ovb-ha https://review.openstack.org/525331 | 19:28 |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: Use network templates from tripleo-heat-templates https://review.openstack.org/531221 | 19:28 |
| EmilienM | jaosorior: https://review.openstack.org/530737 commented, no -1 | 19:39 |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: Use network templates from tripleo-heat-templates https://review.openstack.org/531224 | 19:44 |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: Use ipv6 network templates from tripleo-heat-templates https://review.openstack.org/531224 | 19:45 |
| *** gkadam has quit IRC | 19:49 | |
| EmilienM | jrist: is someone looking at https://review.rdoproject.org/r/#/c/11169/ ? | 19:50 |
| EmilienM | jrist: https://logs.rdoproject.org/69/11169/1/check/DLRN-rpmbuild/Z77c458bab37e4cf7a6a19a9192427217/console.txt.gz#_2018-01-04_17_36_37_599 | 19:51 |
| EmilienM | honza: ^ | 19:51 |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: Use ipv6 network templates from tripleo-heat-templates https://review.openstack.org/531224 | 19:52 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Delete network templates from tripleo-ci https://review.openstack.org/531227 | 19:52 |
| *** sshnaidm is now known as sshnaidm|off | 19:53 | |
| *** Goneri has joined #tripleo | 20:07 | |
| *** pkovar has joined #tripleo | 20:08 | |
| mwhahaha | EmilienM: so it appears that it's taking ~30 mins for mysql to setup | 20:08 |
| mwhahaha | EmilienM: http://logs.openstack.org/15/527515/2/check/tripleo-ci-centos-7-containers-multinode/dfe0070/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-01-04_18_21_51 | 20:08 |
| *** pkovar has quit IRC | 20:08 | |
| EmilienM | mwhahaha: is is the logs from what you activated? | 20:09 |
| EmilienM | the flag? | 20:09 |
| mwhahaha | not sure | 20:10 |
| mwhahaha | was that not previously printed? | 20:10 |
| EmilienM | not afik | 20:10 |
| EmilienM | but yeah indeed | 20:11 |
| EmilienM | 30 min :-O | 20:11 |
| EmilienM | there must be something wrong | 20:11 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Save graphite stats under "tripleo" path https://review.openstack.org/531230 | 20:11 |
| sshnaidm|off | EmilienM, ^^ | 20:11 |
| EmilienM | sshnaidm|off: nice | 20:12 |
| EmilienM | mwhahaha: looks like here: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/docker/services/pacemaker/database/mysql.yaml#n183 | 20:13 |
| EmilienM | mwhahaha: if we could add some debug | 20:13 |
| EmilienM | dciabrin: you around? ^ | 20:13 |
| mwhahaha | or at least a place to check out the mysql logs | 20:13 |
| EmilienM | yeah where are mysql logs? http://logs.openstack.org/15/527515/2/check/tripleo-ci-centos-7-containers-multinode/dfe0070/logs/subnode-2/var/log/containers/ | 20:14 |
| mwhahaha | they are under some place special | 20:14 |
| *** raildo has quit IRC | 20:14 | |
| mwhahaha | cause pacemaker bundles | 20:14 |
| dciabrin | EmilienM, hey o/ | 20:15 |
| EmilienM | dciabrin: hey, if it's not too late for you, we need your help | 20:15 |
| EmilienM | dciabrin: we're trying to figure out why starting mysql takes 30 min with kolla, see irc ^ | 20:16 |
| EmilienM | it sounds like it's logged here: http://logs.openstack.org/15/527515/2/check/tripleo-ci-centos-7-containers-multinode/dfe0070/logs/subnode-2/var/log/journal.txt.gz#_Jan_04_17_43_53 | 20:16 |
| dciabrin | EmilienM, ok | 20:16 |
| mwhahaha | dciabrin: also where are the mysql logs ending up | 20:16 |
| dciabrin | looking. | 20:16 |
| * mwhahaha can never find them | 20:16 | |
| dciabrin | mwhahaha, /var/log/pacemaker/bundles/galera-bundle-*/mysqld.log | 20:16 |
| dciabrin | mwhahaha, this has changed with containers | 20:17 |
| mwhahaha | i don't think we're capturing those in CI | 20:17 |
| mwhahaha | which would make this extra hard to debug :D | 20:17 |
| EmilienM | we should, can we add them? | 20:17 |
| *** jmelvin has joined #tripleo | 20:17 | |
| mwhahaha | yes plz | 20:17 |
| EmilienM | probably in here https://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci-quickstart/config/collect-logs.yml | 20:18 |
| EmilienM | I can send a patch, a sec | 20:18 |
| EmilienM | weshay: is that the correct place right? ^ | 20:18 |
| weshay | ya | 20:18 |
| EmilienM | is /var/log/pacemaker good? I hope it's not too much | 20:19 |
| mwhahaha | it should be fine | 20:19 |
| dciabrin | EmilienM, it's usually not big | 20:19 |
| EmilienM | ok | 20:19 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: collect-logs: add /var/log/pacemaker https://review.openstack.org/531232 | 20:20 |
| dciabrin | so from the logs, the mysql_bootstrap container finished in a fairly small amount of time. which is okay, is only create file on disk and sets permission | 20:20 |
| dciabrin | I'm checking the journal to see if the resource agent hints me at startup time | 20:21 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: collect-logs: add /var/log/(cluster|pacemaker) https://review.openstack.org/531232 | 20:22 |
| *** liverpooler has joined #tripleo | 20:22 | |
| EmilienM | dciabrin, mwhahaha : I added /var/log/cluster as well | 20:22 |
| dciabrin | EmilienM, ack thx | 20:22 |
| openstackgerrit | John Fulton proposed openstack/tripleo-docs master: Document ceph-ansible options used to deploy at scale https://review.openstack.org/531214 | 20:22 |
| openstackgerrit | Bob Fournier proposed openstack/puppet-tripleo master: Configure VIPs for all networks including composable networks https://review.openstack.org/531037 | 20:23 |
| *** raildo has joined #tripleo | 20:26 | |
| dciabrin | and 10seconds to start galera and sync to the galera cluster. so at least the startup is fast | 20:26 |
| dciabrin | mwhahaha, EmilienM from I extracted the timestamps from the journal in http://paste.openstack.org/show/638344/. from the time where pacemaker start galera up to the time the galera node is synced to the galera cluster, it takes roughly 10s | 20:28 |
| mwhahaha | dmanchad: so why is it hanging for ~30 mins | 20:29 |
| mwhahaha | dmanchad: sorry wrong tab complete | 20:29 |
| mwhahaha | dciabrin: so what is it doing as part of 2018-01-04 17:44:18 | "+ sudo -u mysql -E kolla_start", | 20:30 |
| dciabrin | mwhahaha, looking. It has to be the first transient container which is ran to create the mysql DB on disk, before pacemaker starts the server for real. let me double check | 20:31 |
| *** pchavva has quit IRC | 20:32 | |
| *** holser__ has joined #tripleo | 20:32 | |
| *** pchavva has joined #tripleo | 20:32 | |
| dciabrin | mwhahaha, hmm are you looking at http://logs.openstack.org/15/527515/2/check/tripleo-ci-centos-7-containers-multinode/dfe0070/logs/subnode-2/var/log/journal.txt.gz or another run? on that run, I see that + sudo -u mysql -E kolla_start is the transient container that creates the initial DB on disk. yours should be the same, only timestamps are slightly different | 20:35 |
| mwhahaha | dciabrin: so i'm looking at what i pasted ealier from the deploy ment log, there's a 30 min gap until the next command is run | 20:35 |
| mwhahaha | 2018-01-04 17:44:18 | "+ sudo -u mysql -E kolla_start", | 20:36 |
| mwhahaha | 2018-01-04 18:21:51 | "+ sudo -E kolla_set_configs", | 20:36 |
| mwhahaha | http://logs.openstack.org/15/527515/2/check/tripleo-ci-centos-7-containers-multinode/dfe0070/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-01-04_18_21_51 | 20:36 |
| * dciabrin looks | 20:36 | |
| mwhahaha | so kolla_start is taking ~30 mins before the next thing is run | 20:36 |
| mwhahaha | wait | 20:37 |
| mwhahaha | this might just be the way we're chunking messages | 20:37 |
| mwhahaha | i find it odd that the mysql_install_db times are older than the kolla_start | 20:39 |
| mwhahaha | in that output | 20:39 |
| dciabrin | right, that would explain. because the first thing that kolla_start does in that container is calling kolla_set_configs | 20:39 |
| dciabrin | mwhahaha, probably localtime -> gmt mismatch? | 20:40 |
| mwhahaha | "180104 17:44:11 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql", | 20:40 |
| mwhahaha | "2018-01-04 17:43:54 139874570676416 [Note] /usr/libexec/mysqld (mysqld 10.1.20-MariaDB) starting as process 46 ...", | 20:40 |
| *** liverpooler has quit IRC | 20:40 | |
| mwhahaha | this output is awful | 20:40 |
| mwhahaha | i bet it's because we're misxing stderr/stdout | 20:41 |
| mwhahaha | rather than printing both seperate | 20:41 |
| dciabrin | yes could very well be indeed | 20:41 |
| mwhahaha | so i think we're chunking the config download output via zaqar so that might explain the 30 min split | 20:42 |
| mwhahaha | so something else is taking forever | 20:43 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Remove "Add subnodes to known hosts" task https://review.openstack.org/530808 | 20:43 |
| *** kristaps has quit IRC | 20:46 | |
| *** kristaps_ has quit IRC | 20:46 | |
| *** rfolco has quit IRC | 20:47 | |
| dciabrin | mwhahaha, oh ok and that would explain why the timestamps from overcloud_deploy.log don't strictly match those from the subnode-2's journal | 20:47 |
| mwhahaha | back to the drawing board | 20:48 |
| mwhahaha | we really need times on the stderr/stdout | 20:48 |
| *** pradk has quit IRC | 20:50 | |
| *** salmankhan has quit IRC | 20:51 | |
| *** nyechiel has quit IRC | 20:51 | |
| *** liverpooler has joined #tripleo | 20:54 | |
| slagle | mwhahaha: you can look here and see timestamps: http://logs.openstack.org/15/527515/2/check/tripleo-ci-centos-7-containers-multinode/dfe0070/logs/undercloud/var/lib/mistral/666c489c-1c05-4ab8-bbf8-ba7d96e0c939/ansible.log.txt.gz | 20:56 |
| slagle | at least as far as on the individual tasks | 20:56 |
| slagle | since the stdout/stderr comes back as one chunk to ansible, that is not timestamped | 20:56 |
| *** raildo has quit IRC | 20:56 | |
| mwhahaha | it's the container starting that takes foerever | 20:56 |
| mwhahaha | which of course is censored | 20:57 |
| mwhahaha | :D | 20:57 |
| mwhahaha | http://logs.openstack.org/15/527515/2/check/tripleo-ci-centos-7-containers-multinode/dfe0070/logs/undercloud/var/lib/mistral/666c489c-1c05-4ab8-bbf8-ba7d96e0c939/ansible.log.txt.gz#_2018-01-04_17_44_41_956 | 20:57 |
| slagle | yep | 20:57 |
| slagle | darn you step 2! | 20:57 |
| mwhahaha | which is what we knew yesterday | 20:58 |
| slagle | you can see it in the next task | 20:58 |
| mwhahaha | step2 takes foooooreeeeevver | 20:58 |
| slagle | "Notice: Applied catalog in 2074.61 seconds", | 20:58 |
| *** liverpooler has quit IRC | 20:58 | |
| mwhahaha | did we merge that --summerize thing yet | 20:58 |
| mwhahaha | that'll show us exactly what's taking forever in puppet | 20:58 |
| mwhahaha | https://review.openstack.org/#/c/531013/ | 20:59 |
| mwhahaha | still running multinode | 20:59 |
| slagle | you can also see the full puppet log in http://logs.openstack.org/15/527515/2/check/tripleo-ci-centos-7-containers-multinode/dfe0070/logs/subnode-2/var/log/journal.txt.gz | 20:59 |
| slagle | with timestamps | 20:59 |
| mwhahaha | it's rabbit | 21:01 |
| mwhahaha | http://logs.openstack.org/15/527515/2/check/tripleo-ci-centos-7-containers-multinode/dfe0070/logs/subnode-2/var/log/journal.txt.gz#_Jan_04_18_19_31 | 21:01 |
| mwhahaha | i like how it errors yet we are fine | 21:01 |
| mwhahaha | the journal is totally not readable either | 21:02 |
| slagle | you want the impossible | 21:04 |
| mwhahaha | impossible in containers evidently | 21:05 |
| mwhahaha | was fine before :D | 21:05 |
| *** pchavva has quit IRC | 21:05 | |
| slagle | so i guess it's this Exec[rabbitmq-ready] that eventually times out and fails? | 21:08 |
| * mwhahaha shrugs | 21:08 | |
| slagle | except by fail, i mean, doesn't actually fail | 21:09 |
| mwhahaha | can't tell with these logs | 21:09 |
| slagle | we just keep going | 21:09 |
| mwhahaha | i'll wait until the --summerize thing finishes and maybe we can tell better | 21:09 |
| mwhahaha | would make sense given https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/pacemaker/rabbitmq_bundle.pp#L226 | 21:10 |
| mwhahaha | 180 tries with a 10 second sleep between each | 21:10 |
| mwhahaha | dciabrin: what about rabbitmq in that run? | 21:11 |
| *** fragatina has joined #tripleo | 21:11 | |
| slagle | it's odd that it doesnt fail puppet. and doesnt fail the overcloud either | 21:12 |
| slagle | we get a successful deploy | 21:12 |
| slagle | so that command is literally just for fun i guess | 21:12 |
| mwhahaha | well it's in use | 21:12 |
| mwhahaha | https://github.com/openstack/puppet-tripleo/commit/2f33d74173b79117c962146ac2c88fe1e3836403 | 21:12 |
| mwhahaha | we had to actually fix it because of ordering issues | 21:13 |
| * mwhahaha blames bandini anyway | 21:13 | |
| dciabrin | :) | 21:13 |
| eck` | yes, bandini for sure | 21:14 |
| dciabrin | yes the rabbitmq resource agent only cares about the rabbit process being started, but we need to wait until the rabbit application is clustered otherwise that break the rabbit user creating | 21:14 |
| dciabrin | breaks* | 21:14 |
| mwhahaha | but it's node size 1 | 21:14 |
| mwhahaha | soooooo there is no clustering? | 21:14 |
| eck` | news flash: in 2018, rabbit is still stupid | 21:14 |
| *** jtomasek has quit IRC | 21:14 | |
| dciabrin | mwhahaha, oh.... damned so we added the test that works for HA when nodes >1 ? | 21:15 |
| dciabrin | mwhahaha, or is that deployment a multinode HA? | 21:16 |
| eck` | so it breaks with pacemaker + single node? | 21:16 |
| mwhahaha | no it's not | 21:16 |
| * eck` is confused | 21:16 | |
| mwhahaha | so it doesn't actually break | 21:16 |
| slagle | it's pacemaker single node | 21:16 |
| mwhahaha | it just adds a really long wait | 21:16 |
| mwhahaha | it's concerning it's not actually failing | 21:16 |
| dciabrin | right, this is another concern. let's look at the container start command in t-h-t | 21:17 |
| eck` | yeah i don't really why it doesn't fail the run | 21:17 |
| * eck` forgot a word... | 21:17 | |
| dciabrin | https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/pacemaker/rabbitmq.yaml#L197 <- we don't use --detailed-exitcodes | 21:19 |
| mwhahaha | damn it | 21:19 |
| dciabrin | :( | 21:19 |
| mwhahaha | (╯°Д°）╯︵ /(.□ . \) | 21:20 |
| slagle | --always-succeed | 21:20 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: Collect logs in post playbook https://review.openstack.org/527844 | 21:21 |
| * mwhahaha continues to git blame bandini | 21:21 | |
| slagle | ensure-failure => true | 21:21 |
| mwhahaha | https://github.com/openstack/tripleo-heat-templates/commit/4d7e03be85ce8a005aceca9cd1784b7cc5ad99eb | 21:21 |
| mwhahaha | gotta have debug though :D | 21:21 |
| dciabrin | :) | 21:21 |
| dciabrin | eck so we need to come up with a test for rabbit ready which works for HA deployements where node==1 | 21:22 |
| dciabrin | mwhahaha, we have to fix that before fixing the puppet apply, otherwise all CI jobs will go red | 21:23 |
| mwhahaha | i know | 21:23 |
| eck` | uhh | 21:23 |
| eck` | so what was the deal before all of this | 21:23 |
| dciabrin | eck we need to doublecheck on a 1-node HA deployment, starting one now | 21:23 |
| eck` | you'd boot rabbit, create the user before the clustering happened, and then after clustering, things would... | 21:23 |
| * mwhahaha blames containers | 21:24 | |
| mwhahaha | now we get to re-solve already solved problems | 21:24 |
| eck` | or was it that it would try to create the user before rabbit was up at all | 21:24 |
| mwhahaha | THANKS | 21:24 |
| eck` | mwhahaha: what we really need is another three layers of indirection | 21:24 |
| eck` | that is how we will clarify things! | 21:24 |
| eck` | i guess if you stack enough windows in front of each other, eventually no light will get in :) | 21:25 |
| dciabrin | eck I seem to remember we did not want rabbit to start epmd in that bootstrap container. so the best option was to wait for rabbit to be up so epmd would run in the pacemaker-started container | 21:26 |
| *** fragatina has quit IRC | 21:27 | |
| eck` | that sounds plausible | 21:27 |
| eck` | i think i erased all memory of this with wine and beer over the holiday :) | 21:27 |
| eck` | the commit says... | 21:28 |
| eck` | "Just checking for rabbit being up is not enough because if the user gets | 21:28 |
| eck` | created before the node joins a cluster, it might not be replicated | 21:28 |
| eck` | (depending on the timing)." | 21:28 |
| eck` | so it does have something to do with users | 21:29 |
| mwhahaha | this is the veritas lost user problem | 21:29 |
| eck` | i think the epmd thing was more a side effect | 21:29 |
| mwhahaha | so a user would get created and lost | 21:29 |
| mwhahaha | there needs to be a way to check that number of nodes == number of expected nodes | 21:29 |
| mwhahaha | so for 1 or 3 it would work | 21:29 |
| mwhahaha | is this information available from heat somehow | 21:30 |
| mwhahaha | like number of instances of a service so we can pass the count in to the check | 21:30 |
| mwhahaha | or do we need to reorganize the joining of services so they don't get lost | 21:31 |
| eck` | well we have the value of $rabbit_nodes | 21:31 |
| eck` | so if len($rabbit_nodes) == 1, don't do this stuff | 21:31 |
| eck` | just conditionalize the whole exec? | 21:31 |
| dciabrin | the veritas issue was caused to the epmd process disappearing to early when the bootstrap container would die. | 21:31 |
| mwhahaha | or make the exec a noop | 21:31 |
| mwhahaha | because we still want to synchronize other puppet actions around rabbit mq being ready | 21:32 |
| dciabrin | eck: I still believe we'd need a way to get around epmd spawning in the wrong container, otherwise the veritas user creating would fail again | 21:32 |
| mwhahaha | which that exec provides | 21:32 |
| eck` | dciabrin: well we already do that by bind mounting in /bin/true for epmd in the bootstrap container | 21:33 |
| eck` | so it can't possibly run there | 21:33 |
| *** moshele has joined #tripleo | 21:33 | |
| mwhahaha | let me go file a bug about this rabbitmq stuff btw | 21:33 |
| dciabrin | eck: oh true that. so we're almost good then? we don't run that wait when len($rabbit_nodes)==1 ? | 21:33 |
| dciabrin | mwhahaha, thx | 21:34 |
| *** gfidente has quit IRC | 21:34 | |
| eck` | dciabrin: i think we're good? | 21:34 |
| eck` | i am never sure of anything anymore | 21:34 |
| eck` | i have been surprised one too many times | 21:34 |
| *** threestrands has joined #tripleo | 21:35 | |
| *** threestrands has quit IRC | 21:35 | |
| *** threestrands has joined #tripleo | 21:35 | |
| eck` | we will somehow manage to trigger a brand-new speculative execution vulnerability if we change something | 21:36 |
| eck` | then we will have the burden of coming up with a cool name for it | 21:36 |
| mwhahaha | https://bugs.launchpad.net/tripleo/+bug/1741345 | 21:38 |
| openstack | Launchpad bug 1741345 in tripleo "rabbitmq-ready fails when node size 1 and doesn't actually fail the deployment" [Critical,Triaged] | 21:38 |
| mwhahaha | EmilienM: fyi that's where our 20 mins went in deployments -^ | 21:38 |
| mwhahaha | GIMME BACK MY TIME | 21:38 |
| EmilienM | wow | 21:38 |
| EmilienM | nice | 21:39 |
| *** dhill_ has quit IRC | 21:39 | |
| *** dhill_ has joined #tripleo | 21:39 | |
| *** jcoufal has quit IRC | 21:40 | |
| *** dhill_ has quit IRC | 21:41 | |
| slagle | sshnaidm|off: you didn't look at the depends-on | 21:42 |
| slagle | sshnaidm|off: also just using the defaults from tht is not going to work. that's why that patch is failing | 21:42 |
| sshnaidm|off | slagle, can you point to link? maybe I miss something | 21:42 |
| *** dhill_ has joined #tripleo | 21:42 | |
| *** florianf has quit IRC | 21:42 | |
| sshnaidm|off | slagle, why not going to work? | 21:42 |
| slagle | sshnaidm|off: first, just look at the full depends-on: https://review.openstack.org/#/c/531224/ and the parents | 21:43 |
| slagle | sshnaidm|off: i think i've updated all the featuresets you mention | 21:43 |
| *** dmellado has quit IRC | 21:43 | |
| slagle | sshnaidm|off: second, arxcruz|ruck 's patch won't work b/c just look at the failing ci. it doesn't work :) | 21:43 |
| slagle | it's failing on the network validation b/c it wasn't configured correctly | 21:44 |
| slagle | that's why we have these templates for ci | 21:44 |
| slagle | looks like it probably configured a different nic as external or something | 21:44 |
| arxcruz|ruck | ? | 21:45 |
| slagle | arxcruz|ruck: https://review.openstack.org/#/c/512225/ | 21:45 |
| slagle | arxcruz|ruck: looks like just trying to use the default nic config templates does not work | 21:46 |
| sshnaidm|off | slagle, we copied these templates from tripleo-ci to tht to use them from tht repo, it should work actually | 21:46 |
| *** dmellado has joined #tripleo | 21:46 | |
| slagle | sshnaidm|off: no, they're different | 21:46 |
| slagle | sshnaidm|off: you don't even use the ones you copied | 21:46 |
| sshnaidm|off | slagle, well, then that's problem | 21:46 |
| slagle | sshnaidm|off: as i said :) | 21:47 |
| sshnaidm|off | arxcruz|ruck, trown can you please take a look? ^^ | 21:47 |
| arxcruz|ruck | slagle: I'm just removing the calls to tripleo-ci tht | 21:47 |
| slagle | you ought to be using the ones under ci/environments/network/multiple-nics/nic-configs/controller.yaml | 21:47 |
| *** dhill_ has quit IRC | 21:47 | |
| slagle | arxcruz|ruck: sshnaidm|off : you can't just remove network_isolation_args from the featuresets b/c then the defaults get used | 21:48 |
| slagle | arxcruz|ruck: sshnaidm|off : you need to do something like what I've done here: https://review.openstack.org/#/c/531221/ | 21:48 |
| slagle | so that the ones for *ci* that you actually copied to t-h-t get used | 21:48 |
| *** dhill_ has joined #tripleo | 21:48 | |
| openstackgerrit | Bob Fournier proposed openstack/tripleo-heat-templates master: Add composable network VIPs for puppet configuration https://review.openstack.org/531036 | 21:48 |
| arxcruz|ruck | slagle: okay, I'll update the patch, sounds good ? | 21:48 |
| arxcruz|ruck | to point to *ci* | 21:49 |
| slagle | arxcruz|ruck: sure, or i already did it in that patch. but i don't care | 21:49 |
| *** dhill_ has quit IRC | 21:49 | |
| arxcruz|ruck | slagle: I can abandon, no problem :) | 21:49 |
| sshnaidm|off | slagle, that's seems what we wanted, yes | 21:50 |
| sshnaidm|off | slagle, just need to use {{ overcloud_templates_path }} instead of /usr/share... | 21:50 |
| slagle | sshnaidm|off: ack, i can update that | 21:50 |
| sshnaidm|off | slagle, iirc the point was to use the same templates in local deployments as we have in ci, or at least as close as possible | 21:51 |
| sshnaidm|off | arxcruz|ruck, trown, right? ^^ | 21:51 |
| arxcruz|ruck | sshnaidm|off: the point was to get rid of everything related to tripleo-ci so we don't need it as dependence | 21:51 |
| sshnaidm|off | arxcruz|ruck, that's right | 21:52 |
| EmilienM | mwhahaha, sshnaidm|off : please https://review.openstack.org/#/c/531191/ | 21:52 |
| slagle | sshnaidm|off: well, it might be possible to make ci function so that it can use the default nic configs. | 21:52 |
| slagle | sshnaidm|off: but you would have to change how ovb deploys the environments | 21:53 |
| slagle | which feels like a lot of churn | 21:53 |
| *** dhill_ has joined #tripleo | 21:53 | |
| sshnaidm|off | slagle, can we just set ci configs as default? | 21:53 |
| sshnaidm|off | slagle, it seems strange that we gate configs that nobody uses | 21:53 |
| *** dhill_ has quit IRC | 21:54 | |
| slagle | sshnaidm|off: our nic configs are only examples really | 21:54 |
| slagle | sshnaidm|off: for multiple nics especially, there is no sane default | 21:55 |
| slagle | so we have a nicely orderd example, with each network | 21:55 |
| slagle | it's like that so that people can understand how to adapt it to their environment | 21:55 |
| slagle | for example, ci needs mtu 1350. we don't want that in our default example | 21:56 |
| sshnaidm|off | slagle, then why to have different configs by default in role? let's use one set | 21:57 |
| slagle | what config is different per role? | 21:57 |
| slagle | you mean controller.yaml vs compute.yaml? | 21:57 |
| sshnaidm|off | slagle, tbh, I'd like it to be wider discussion and not to be lost in irc logs, can we start a ML about that? | 21:57 |
| *** dhill_ has joined #tripleo | 21:58 | |
| slagle | sshnaidm|off: go for it | 21:58 |
| sshnaidm|off | slagle, I mean these ones: https://github.com/openstack/tripleo-quickstart-extras/blob/3c61ed652f4751932494624ad91b20b622bcf48f/roles/overcloud-deploy/tasks/pre-deploy.yml#L31-L50 | 21:58 |
| mwhahaha | EmilienM: https://review.openstack.org/#/c/531191/ don't we want to exclude pike as well or is octavia in pike? | 21:58 |
| EmilienM | mwhahaha: true | 21:59 |
| slagle | sshnaidm|off: the differences there are for ipv4 vs ipv6. those are configured differently, hence different templates | 21:59 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Introduce scenario010-container experimental job https://review.openstack.org/531191 | 21:59 |
| sshnaidm|off | slagle, ok, I'll write a mail, please feel free to comment there | 21:59 |
| EmilienM | eck`, dciabrin: can one of you take https://bugs.launchpad.net/tripleo/+bug/1741345 in launchpad and let us know? thanks | 22:00 |
| openstack | Launchpad bug 1741345 in tripleo "rabbitmq-ready fails when node size 1 and doesn't actually fail the deployment" [Critical,Triaged] | 22:00 |
| *** moshele has quit IRC | 22:02 | |
| dciabrin | EmilienM, absolutely, we're testing a fix with eck, we'll push something by tomorrow top | 22:02 |
| EmilienM | ok thanks | 22:02 |
| EmilienM | mwhahaha, sshnaidm|off : also https://review.openstack.org/#/c/531182/ is good to go imho, will help to reduce the tempest run | 22:04 |
| mwhahaha | dciabrin: i'll propose a fix for the exitcodes stuff | 22:04 |
| mwhahaha | just fyi | 22:04 |
| mwhahaha | EmilienM: why are all the rdo 3rd party jobs sad on https://review.openstack.org/#/c/531182/ | 22:05 |
| dciabrin | mwhahaha, thx! | 22:06 |
| mwhahaha | slagle: https://review.openstack.org/#/c/531013/ when you have a minute | 22:07 |
| EmilienM | mwhahaha: zuul was restarted | 22:09 |
| EmilienM | mwhahaha: on rdo infra | 22:09 |
| EmilienM | mwhahaha: they applied the new kernel (it was expected) | 22:09 |
| mwhahaha | k | 22:09 |
| *** rcernin has joined #tripleo | 22:12 | |
| mwhahaha | hrm there's may be a problem with adding --detailed-exitcodes tot he pacemaker bits | 22:13 |
| slagle | gerrit down? | 22:13 |
| slagle | or did my internet line just freeze over | 22:14 |
| mwhahaha | just you | 22:14 |
| mwhahaha | frosty mcslagle | 22:14 |
| EmilienM | lol | 22:14 |
| dciabrin | mwhahaha, why's that? | 22:15 |
| dpeacock | lol | 22:15 |
| mwhahaha | dciabrin: theses are all bash commands in the docker_config, we usually have to ignore 2 as a return code for failures | 22:15 |
| dciabrin | hmmm, oh like the "nothing changed" error code | 22:16 |
| dciabrin | damned | 22:16 |
| mwhahaha | dciabrin: so i'm not sure this has the intended affect, we might need to wrap this in a script of some sort instead of hand rolling the bash | 22:16 |
| dciabrin | mwhahaha, yes I see what you mean | 22:16 |
| mwhahaha | we really shouldn't be formulating bash execs in THT but that's another story :D | 22:16 |
| eck` | haha | 22:17 |
| eck` | you could just stop at "we really shouldn't" | 22:18 |
| eck` | that would be applicable in many cases | 22:18 |
| mwhahaha | yes | 22:18 |
| mwhahaha | oh but wait isn't there a way to include scripts in heat templates | 22:19 |
| *** holser__ has quit IRC | 22:19 | |
| mwhahaha | or maybe owalsh was just lying to me | 22:20 |
| bnemec | mwhahaha: You can do get_file | 22:20 |
| owalsh | mwhahaha: yea, get_file | 22:21 |
| mwhahaha | because that's what i think of as the name for this action | 22:21 |
| dciabrin | that would be interesting | 22:21 |
| *** ipsecguy_ has joined #tripleo | 22:21 | |
| mwhahaha | gracias | 22:21 |
| owalsh | mwhahaha: or do you mean a way to upload it for docker config? | 22:21 |
| *** Goneri has quit IRC | 22:21 | |
| mwhahaha | owalsh: we have a bunch of duplicated puppet applies in the docker_config stuff | 22:22 |
| mwhahaha | and we need to add complexity to handle detailed exit codes so it really should be a single script | 22:22 |
| mwhahaha | so i think we can reduce the copy-pasta by get_filing something like extra_config/tasks/run_puppet.sh or something | 22:22 |
| dciabrin | +1 | 22:23 |
| *** ipsecguy has quit IRC | 22:23 | |
| EmilienM | ++ | 22:24 |
| owalsh | mwhahaha: so get_file is a heat thing to include a file in the heat template... docker_config_scripts is the evilness I did to avoid quoting hell in bash one-liners | 22:24 |
| owalsh | mwhahaha: eg https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/nova-api.yaml#L125 | 22:25 |
| mwhahaha | yea it's basically https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/pacemaker/rabbitmq.yaml#L189-L205 | 22:26 |
| *** salmankhan has joined #tripleo | 22:26 | |
| mwhahaha | it's the same for all the pacemaker stuff, we jsut need to parameterize step | 22:26 |
| *** ManoX has joined #tripleo | 22:27 | |
| mwhahaha | we'll see | 22:27 |
| mwhahaha | i'll see if the docker_config_scripts would work better | 22:27 |
| ManoX | When reading this page http://tripleo.org/install/introduction/components.html#heat-templates I noticed the link under "how to contribute" https://docs.openstack.org/developer/tripleo-incubator/puppet.html is not found. Is there another link pointing to the same content? | 22:28 |
| *** jistr has quit IRC | 22:29 | |
| mwhahaha | ManoX: yea those docs seem out of date. I think new recommenation is to use tripleo quickstart to setup test evns, https://docs.openstack.org/tripleo-quickstart/latest/ | 22:30 |
| owalsh | mwhahaha: hrmm, maybe could set docker_config_script in containers_common like we do with volumes | 22:30 |
| mwhahaha | owalsh: it is quite possible | 22:31 |
| mwhahaha | owalsh: gotta write the script first :D | 22:31 |
| owalsh | yea :-) | 22:31 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-quickstart master: Enable the image signing feature in scenario 2 https://review.openstack.org/531256 | 22:31 |
| sshnaidm|off | slagle, I think you need to include ~/network-environment.yaml file in network args for net-iso jobs | 22:32 |
| slagle | sshnaidm|off: well, it's not currently in use :) | 22:34 |
| *** ihrachys has quit IRC | 22:34 | |
| *** ihrachys has joined #tripleo | 22:35 | |
| slagle | trown literally copied the tempaltes from tripleo-ci to tht, and all this does is use them from tht | 22:35 |
| slagle | and net-iso.yaml was entirely redundant | 22:35 |
| sshnaidm|off | slagle, it should contain vip for ssl certificate generation iirc | 22:37 |
| sshnaidm|off | slagle, maybe other stuff, don't remember exactly.. | 22:37 |
| EmilienM | can someone get https://review.openstack.org/#/c/531013/ please | 22:37 |
| slagle | sshnaidm|off: what should contain it? | 22:37 |
| sshnaidm|off | slagle, ~/network-environment.yaml or net-iso.yaml | 22:39 |
| slagle | sshnaidm|off: ~/network-environment.yaml is not there currently. (at least not added there). so it's not needed | 22:40 |
| *** lblanchard has quit IRC | 22:41 | |
| openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Set nova to verify glance images in scenario 2 https://review.openstack.org/527136 | 22:43 |
| slagle | sshnaidm|off: i do pass {{ working_dir }}/network-environment.yaml | 22:45 |
| slagle | for the jobs where it was passed previously | 22:45 |
| weshay | quick question, http://tripleo.org/install/advanced_deployment/custom_roles.html?highlight=hostnameformatdefault#id1 to specify the hostname format, is it required to use custom roles to ensure a custom format, or can one just override that in param_defaults? | 22:47 |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: Use network templates from tripleo-heat-templates https://review.openstack.org/531221 | 22:47 |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: Activate config-download for ovb-ha https://review.openstack.org/525331 | 22:47 |
| mwhahaha | weshay: no i think it auto figures it out | 22:48 |
| mwhahaha | weshay: let me check | 22:48 |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: Use network templates from tripleo-heat-templates https://review.openstack.org/531221 | 22:49 |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: Activate config-download for ovb-ha https://review.openstack.org/525331 | 22:49 |
| mwhahaha | weshay: it'll use the role name by default if none is provided, https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud.j2.yaml#L183-L187 | 22:49 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-quickstart master: Add image signing tests with barbican https://review.openstack.org/524064 | 22:49 |
| slagle | is --summarize new? that's some serious ansible envy if so | 22:50 |
| weshay | mwhahaha, ok.. debating between that an HostnameMap: foo-0: my-foo-0 | 22:51 |
| weshay | thanks | 22:51 |
| mwhahaha | slagle: no it's just not been documented | 22:51 |
| mwhahaha | slagle: it's been around for a long time | 22:52 |
| slagle | oh. | 22:52 |
| slagle | i'd ask why, but...puppet. why be clear about anything | 22:53 |
| mwhahaha | you have been able to get that info from the catalog summary since forever | 22:53 |
| mwhahaha | yea ruby | 22:53 |
| mwhahaha | it's self documenting duh | 22:53 |
| slagle | yea! | 22:53 |
| slagle | just like heat templates | 22:53 |
| ManoX | mwhahaha Thanx. I found a few bugs related to the quickstart when used behind a proxy. Those are already tracked. I am not using these steps instead http://tripleo.org/install/advanced_deployment/deployed_server.html with a pre-deployed server for the overcloud. | 22:55 |
| mwhahaha | ManoX: yea if you need to do some puppet module updates for your run you used to be able to use http://hardysteven.blogspot.com/2016/08/tripleo-deploy-artifacts-and-puppet.html but not sure the workflow now with containers (might still be similar) | 22:57 |
| *** zshi has quit IRC | 23:00 | |
| *** zshi has joined #tripleo | 23:01 | |
| bfournie | mwhahaha, ManoX: I just recently used this procedure again for puppet changes with containers and it worked fine (didn't use oooq though) | 23:03 |
| mwhahaha | good to know | 23:04 |
| mwhahaha | owalsh: what was the deal with bootstrap_host_exec ? | 23:05 |
| ManoX | bfournie Thx. I will give it a shot. | 23:05 |
| * mwhahaha forgets | 23:05 | |
| mwhahaha | oh yea it's for running the command only on the bootstrap node | 23:08 |
| mwhahaha | does not apply here | 23:08 |
| owalsh | mwhahaha: quoting hell, it runs eval not exec. I added an alternative the runs exec but dealing with complex logic was still horrible | 23:08 |
| owalsh | mwhahaha: oh, yea, that's what it does, looks up hiera and compare to the hostname I think | 23:09 |
| mwhahaha | yea | 23:09 |
| owalsh | also bootstrap_host_exec needs to be run as root to access hieradata, then sudo to the desired user | 23:10 |
| mwhahaha | yea in this case i'm running as root cause it's just puppet | 23:11 |
| *** bfournie1 has joined #tripleo | 23:16 | |
| *** bfournie has quit IRC | 23:17 | |
| mwhahaha | yaml yaml yaml all day long. yaml yaml yaml while i sing this song | 23:18 |
| *** jistr has joined #tripleo | 23:19 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Use docker_config_scripts for puppet apply https://review.openstack.org/531261 | 23:26 |
| mwhahaha | we'll see if that works | 23:26 |
| *** bfournie has joined #tripleo | 23:26 | |
| *** bfournie1 has quit IRC | 23:27 | |
| EmilienM | mwhahaha: there is also docker/docker-puppet.py | 23:31 |
| mwhahaha | EmilienM: what about it | 23:31 |
| EmilienM | mwhahaha: yet another place where puppet is executed | 23:32 |
| mwhahaha | EmilienM: yea i know, we've got about 8 different places | 23:32 |
| mwhahaha | trying to reduce it in just THT :D | 23:32 |
| mwhahaha | there's also the nova-api upgrade script that does it to | 23:32 |
| EmilienM | oh yeah that one too :) | 23:33 |
| mwhahaha | can't get rid of all of them, but at least killing 9 different incarnations of this :D | 23:35 |
| EmilienM | yeah nice | 23:38 |
| *** tosky has quit IRC | 23:39 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: gnocchi/ceilometer upgrade workflow fix https://review.openstack.org/528077 | 23:40 |
| EmilienM | http://logs.openstack.org/32/531232/2/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/5ca05b0/logs/overcloud-controller-0/var/log/cluster/corosync.log.txt.gz | 23:40 |
| EmilienM | http://logs.openstack.org/32/531232/2/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/5ca05b0/logs/overcloud-controller-0/var/log/pacemaker/bundles/ | 23:40 |
| EmilienM | mwhahaha: ^ logs! :) | 23:40 |
| EmilienM | "life is better with logging" | 23:40 |
| mwhahaha | yay logs | 23:41 |
| *** jlabarre has quit IRC | 23:43 | |
| *** liverpooler has joined #tripleo | 23:47 | |
| EmilienM | mwhahaha: https://review.openstack.org/#/c/525684/ | 23:48 |
| EmilienM | oh you want it in quickstart | 23:49 |
| mwhahaha | eh it's ok | 23:49 |
| mwhahaha | it's a bigger reorg thing | 23:50 |
| mwhahaha | we really need to get a handle on where we do these logic items | 23:50 |
| mwhahaha | IMHO generation of stuff for CI shouldn't be in extras. it should just get passed to these tasks | 23:51 |
| *** jistr has quit IRC | 23:54 | |
| EmilienM | mwhahaha: https://review.openstack.org/#/c/531230/ | 23:54 |
| *** jistr has joined #tripleo | 23:55 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!