| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: CI test https://review.openstack.org/380880 | 00:04 |
|---|---|---|
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: telemetry: remove coordination_url hiera settings https://review.openstack.org/380881 | 00:06 |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1629542 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1629542 in tripleo "ovb/newton jobs fail on neutron db sync" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 00:10 |
| *** akshai has quit IRC | 00:23 | |
| *** sshnaidm|afk has quit IRC | 00:28 | |
| openstackgerrit | Merged openstack/os-collect-config: Update .gitreview for stable/newton https://review.openstack.org/380388 | 00:31 |
| *** Goneri has joined #tripleo | 00:32 | |
| *** sshnaidm|afk has joined #tripleo | 00:34 | |
| EmilienM | ovb jobs are back! | 00:56 |
| *** bana_k has joined #tripleo | 01:24 | |
| *** Goneri has quit IRC | 01:27 | |
| *** fzdarsky_ has joined #tripleo | 01:48 | |
| *** bana_k has quit IRC | 01:50 | |
| *** fzdarsky__ has quit IRC | 01:52 | |
| *** tzumainn has joined #tripleo | 01:54 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 02:29 |
| *** akshai has joined #tripleo | 03:18 | |
| *** sudipto has joined #tripleo | 03:20 | |
| *** sudipto_ has joined #tripleo | 03:20 | |
| *** akshai has quit IRC | 03:21 | |
| *** coolsvap has joined #tripleo | 03:41 | |
| *** tiswanso has joined #tripleo | 03:42 | |
| *** tiswanso has quit IRC | 03:46 | |
| *** links has joined #tripleo | 03:49 | |
| *** tzumainn has quit IRC | 03:58 | |
| *** pgadiya has joined #tripleo | 04:09 | |
| *** masco has joined #tripleo | 04:50 | |
| *** skramaja has joined #tripleo | 05:03 | |
| *** masco has quit IRC | 05:03 | |
| *** jaosorior has joined #tripleo | 05:04 | |
| *** bana_k has joined #tripleo | 05:09 | |
| *** links has quit IRC | 05:31 | |
| *** jaosorior has quit IRC | 05:31 | |
| *** jaosorior has joined #tripleo | 05:32 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for gnocchi https://review.openstack.org/377645 | 05:32 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for ceilometer https://review.openstack.org/377644 | 05:32 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for aodh https://review.openstack.org/365457 | 05:32 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for keystone https://review.openstack.org/327029 | 05:32 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable internal TLS for MySQL https://review.openstack.org/378471 | 05:32 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Fetch internal certificates for HAProxy based on network https://review.openstack.org/366548 | 05:32 |
| *** ccamacho has joined #tripleo | 05:35 | |
| *** bana_k has quit IRC | 05:42 | |
| *** links has joined #tripleo | 05:44 | |
| *** numans has joined #tripleo | 05:46 | |
| *** bana_k has joined #tripleo | 05:47 | |
| *** mbozhenko has joined #tripleo | 05:52 | |
| *** rcernin has joined #tripleo | 06:04 | |
| *** masco has joined #tripleo | 06:11 | |
| openstackgerrit | Tuan Luong-Anh proposed openstack/tripleo-docs: Fix typo: remove redundant 'the' https://review.openstack.org/380931 | 06:12 |
| *** leanderthal|afk is now known as leanderthal | 06:19 | |
| *** rasca has joined #tripleo | 06:23 | |
| openstackgerrit | Tuan Luong-Anh proposed openstack/python-tripleoclient: Fix typo: remove redundant 'the' https://review.openstack.org/380936 | 06:25 |
| *** jprovazn has joined #tripleo | 06:26 | |
| openstackgerrit | Merged openstack/tripleo-docs: Fix typo: remove redundant 'the' https://review.openstack.org/380931 | 06:27 |
| openstackgerrit | Merged openstack/puppet-tripleo: Added X-Forwarded-Proto headers for horizon https://review.openstack.org/359519 | 06:30 |
| *** links has quit IRC | 06:31 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Fixed NoneType issue when logging-environment.yaml is used https://review.openstack.org/380003 | 06:35 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Move the rest of static roles resource registry entries to j2 https://review.openstack.org/380443 | 06:35 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-quickstart: Temporarily pin pycparser https://review.openstack.org/380943 | 06:36 |
| *** tobias_fiberdata has joined #tripleo | 06:36 | |
| *** tobias-fiberdata has quit IRC | 06:39 | |
| *** links has joined #tripleo | 06:44 | |
| *** jtomasek has joined #tripleo | 06:44 | |
| *** jbadiapa has joined #tripleo | 06:47 | |
| *** pcaruana has joined #tripleo | 06:53 | |
| *** hjensas has quit IRC | 06:56 | |
| *** cylopez has joined #tripleo | 06:56 | |
| *** tobias-fiberdata has joined #tripleo | 07:01 | |
| *** tesseract- has joined #tripleo | 07:03 | |
| *** snecklifter has joined #tripleo | 07:03 | |
| *** tobias_fiberdata has quit IRC | 07:04 | |
| *** sudipto_ has quit IRC | 07:06 | |
| *** sudipto has quit IRC | 07:06 | |
| *** bvandenh has quit IRC | 07:07 | |
| *** bvandenh has joined #tripleo | 07:11 | |
| *** bana_k has quit IRC | 07:11 | |
| *** jpena|off is now known as jpena | 07:20 | |
| *** amoralej|off is now known as amoralej | 07:22 | |
| *** akuznetsov has joined #tripleo | 07:26 | |
| openstackgerrit | Christopher Brown proposed openstack/tripleo-docs: Fixes network name for tempest https://review.openstack.org/380954 | 07:27 |
| *** mcornea has joined #tripleo | 07:27 | |
| *** zigo has quit IRC | 07:39 | |
| *** zigo has joined #tripleo | 07:42 | |
| *** zigo is now known as Guest24756 | 07:42 | |
| *** jpich has joined #tripleo | 07:43 | |
| *** bana_k has joined #tripleo | 07:46 | |
| *** aufi has joined #tripleo | 07:46 | |
| *** aufi has quit IRC | 07:47 | |
| *** aufi has joined #tripleo | 07:48 | |
| *** zoli_gone-proxy is now known as zoliXXL | 07:49 | |
| jaosorior | ccamacho: ping | 07:49 |
| ccamacho | jaosorior morning | 07:49 |
| *** dbecker has joined #tripleo | 07:49 | |
| *** ohamada has joined #tripleo | 07:49 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Cinder: Add iSCSI protocol parameter https://review.openstack.org/367542 | 07:49 |
| jaosorior | ccamacho: hey dude, how's it going? | 07:50 |
| *** hewbrocc` is now known as hewbrocca | 07:50 | |
| ccamacho | fighting with a tox test jaaj | 07:50 |
| ccamacho | need some help ? | 07:50 |
| jaosorior | haha happens | 07:51 |
| jaosorior | ccamacho: yeah dude, I would really use some help for the tls-via-certmonger blueprint | 07:51 |
| ccamacho | sure tell me | 07:52 |
| jaosorior | ccamacho: there are a bunch of patches out there, and I know it can get pretty complicated to review. So I'm writing a blog post to explain the design decisions regarding that. Do you have time to check it out? | 07:52 |
| zoliXXL | good morning | 07:52 |
| jaosorior | hopefully that can help the reviews | 07:52 |
| *** ohamada has quit IRC | 07:52 | |
| ccamacho | sure | 07:52 |
| jaosorior | ccamacho: alright, I'll pass you the link once I finish up writing it | 07:52 |
| jaosorior | thanks dude | 07:52 |
| ccamacho | just give the blog post :P | 07:52 |
| ccamacho | np man | 07:53 |
| *** ohamada has joined #tripleo | 07:53 | |
| *** hjensas has joined #tripleo | 07:55 | |
| *** shardy has joined #tripleo | 07:58 | |
| *** mbozhenk1 has joined #tripleo | 07:59 | |
| *** mbozhenko has quit IRC | 08:01 | |
| jaosorior | ccamacho: So here's one part of it, which covers HAProxy http://jaormx.github.io/2016/how-is-tls-powered-by-certmonger-being-done/ | 08:01 |
| ccamacho | jaosorior, nice ill finish the tox test and start reading your review | 08:02 |
| ccamacho | s/review/post/ | 08:02 |
| jaosorior | ccamacho: so after that if you could check out https://review.openstack.org/#/c/366548/ and https://review.openstack.org/#/c/356430/ that would be awesome :D | 08:04 |
| ccamacho | sure | 08:04 |
| jaosorior | bandini: We are restarting HAProxy every time there's an update, right? | 08:06 |
| *** saneax-_-|AFK is now known as saneax | 08:07 | |
| *** cylopez has quit IRC | 08:07 | |
| bandini | jaosorior: only when the conf for haproxy changes (see I6369ab0c82dbf3c8f21043f8aa9ab810744ddc12) | 08:08 |
| jaosorior | bandini: thanks | 08:13 |
| bandini | jaosorior: np ;) | 08:14 |
| *** sshnaidm|afk is now known as sshnaidm | 08:15 | |
| *** cylopez has joined #tripleo | 08:19 | |
| *** radeks has joined #tripleo | 08:19 | |
| *** akuznets_ has joined #tripleo | 08:21 | |
| *** akuznetsov has quit IRC | 08:21 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Undercloud install with tripleo-quickstart https://review.openstack.org/358919 | 08:24 |
| *** akuznetsov has joined #tripleo | 08:25 | |
| *** akuznets_ has quit IRC | 08:25 | |
| *** akuznetsov has quit IRC | 08:26 | |
| jaosorior | bandini: hey dude, when a certificate changes, we try to reload HAProxy here https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/extraconfig/tls/tls-cert-inject.yaml#L72 however, that doesn't seem to be working on HA setups | 08:26 |
| jaosorior | bandini: got any ideas? | 08:26 |
| *** paramite has joined #tripleo | 08:28 | |
| *** sudipto_ has joined #tripleo | 08:31 | |
| *** sudipto has joined #tripleo | 08:31 | |
| bandini | jaosorior: how do we change the certificate? via an overcloud deploy command? | 08:32 |
| jaosorior | bandini: yes | 08:33 |
| panda | sshnaidm: ever seen something like this ? http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-tempest/2feb92c/ no logs at all | 08:33 |
| *** abehl has joined #tripleo | 08:34 | |
| sshnaidm | panda, yep, https://bugs.launchpad.net/tripleo/+bug/1618003 | 08:34 |
| openstack | Launchpad bug 1618003 in tripleo "CI: no logs after job is killed by timeout" [Medium,Triaged] | 08:34 |
| *** tobias_fiberdata has joined #tripleo | 08:35 | |
| *** cylopez has quit IRC | 08:35 | |
| bandini | jaosorior: we probably just need to expand this here? https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/pacemaker/haproxy.pp#L48 | 08:35 |
| *** sudipto_ has quit IRC | 08:36 | |
| *** sudipto has quit IRC | 08:36 | |
| panda | sshnaidm: ah, that's what I suspected | 08:36 |
| jaosorior | bandini: puppet has no reference to that certificate file (just the path) so there is no way to tell it to refresh if the file changes. That's why that line I pointed you to exists. | 08:37 |
| *** dtantsur|afk is now known as dtantsur | 08:37 | |
| *** tobias-fiberdata has quit IRC | 08:38 | |
| *** bana_k has quit IRC | 08:38 | |
| mcornea | shardy: Hi! Re https://bugs.launchpad.net/tripleo/+bug/1629590 - is there any service that creates the ceph configuration files, it looks that the CinderVolume needs them when using ceph as storage backend | 08:38 |
| openstack | Launchpad bug 1629590 in tripleo "cinder-volume requires the ceph configurationfiles for the cinder service to come up" [Undecided,New] | 08:38 |
| sshnaidm | panda, I tried even to look at it, but didn't have a time yet :( https://trello.com/c/erAOOtWJ/50-no-logs-in-ci-after-timeout-kills-the-job | 08:38 |
| marios | bandini: hey i think we can land https://review.openstack.org/#/c/379584/3 | 08:38 |
| marios | bandini: and we need a stable/newton for it too | 08:38 |
| bandini | marios: ack will do (am finishing the testing of the upgrade path for that one). thanks for looking | 08:39 |
| marios | bandini: assuming you want it there? | 08:39 |
| bandini | marios: yeah that is what the rabbitmq overlords would like | 08:39 |
| bandini | will clone to stable/newton today | 08:39 |
| marios | shardy: heh thanks shardy was about to +A | 08:40 |
| marios | :) | 08:40 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Change rabbitmq queues HA mode from ha-all to ha-exactly https://review.openstack.org/380979 | 08:40 |
| marios | bandini: the auto pick worked ^^^ | 08:40 |
| bandini | marios: sweet ;) | 08:40 |
| marios | bandini: but it doesn't include the cherrypicked-from so i'll update | 08:40 |
| bandini | ah meh, thanks! | 08:41 |
| matbu | marios: bandini morning guys, btw this one is ready (to test at least :) ) https://review.openstack.org/379547 | 08:41 |
| matbu | i tested it this week end on M to N | 08:42 |
| bandini | matbu: sweet! let me add it to my upgrade scripts and report back | 08:42 |
| matbu | i'm checking on update N to N | 08:42 |
| shardy | mcornea: Hmm, yes - I assume it's empty because the CephMon service (running on ServiceApi) creates the config but you have CinderVolume still running on the Controller | 08:42 |
| shardy | mcornea: some unexpected coupling there to figure out, perhaps gfidente or Jokke_ can help by taking a look | 08:43 |
| mcornea | shardy: yep, looks like it. thanks, I'll ping gfidente when he gets online | 08:44 |
| shardy | mcornea: ack, thanks for spotting it | 08:45 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Change rabbitmq queues HA mode from ha-all to ha-exactly https://review.openstack.org/380979 | 08:45 |
| *** cylopez has joined #tripleo | 08:46 | |
| *** tobias-fiberdata has joined #tripleo | 08:46 | |
| marios | bandini: well it seems the auto cherrypick uses the same change id but added it for consistency anyway | 08:46 |
| *** spredzy has quit IRC | 08:47 | |
| *** derekh has joined #tripleo | 08:47 | |
| *** spredzy has joined #tripleo | 08:48 | |
| *** tobias_fiberdata has quit IRC | 08:49 | |
| bandini | marios: thank you si | 08:49 |
| bandini | r | 08:49 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: Change the rabbitmq ha policies during an M/N Upgrade https://review.openstack.org/380775 | 08:49 |
| shardy | bandini: Hey, I think you may have to abandon the newton backport in the Depends-On for https://review.openstack.org/#/c/379586/ | 08:50 |
| shardy | Depends-On isn't branch aware, so we can't land that patch until all patches with the Depends-On Change-Id land | 08:51 |
| shardy | so we may need to temporarily abandon the backports, land all-the-things to master, then restore the backports | 08:51 |
| bandini | shardy: oh I see. marios shall we abandon the backports, land the stuff and then propose them again? | 08:53 |
| marios | bandini: shardy ack thanks | 08:53 |
| shardy | The other option is to land both tht patches before approving the puppet-tripleo one | 08:54 |
| *** Guest24756 is now known as zigo | 08:54 | |
| *** spredzy has quit IRC | 08:56 | |
| shardy | https://review.openstack.org/#/c/380386/ needs some reviews if anyone has a moment | 08:56 |
| *** panda has quit IRC | 08:58 | |
| *** spredzy has joined #tripleo | 08:59 | |
| jaosorior | shadower: hey dude, how's it going? | 09:00 |
| shadower | jaosorior: hey, doing fine. How about yourself? | 09:00 |
| jaosorior | pretty good | 09:00 |
| *** cylopez has quit IRC | 09:00 | |
| jaosorior | lots of coffee :P | 09:00 |
| jaosorior | shadower: hey dude, do you have some cycles for some reviews? | 09:01 |
| shadower | sure :-) | 09:01 |
| jaosorior | shadower: so, I know the TLS stuff can be a bit overwhelming, so I wrote a blog post to try to help out explaning the approach http://jaormx.github.io/2016/how-is-tls-powered-by-certmonger-being-done/ | 09:02 |
| jaosorior | shadower: so, if you have time to check these two out https://review.openstack.org/#/c/366548/ and https://review.openstack.org/#/c/356430/ I would really appreciate it, and hopefully he blog post makes it a bit easier | 09:03 |
| *** panda has joined #tripleo | 09:03 | |
| shadower | lol so this is a sneaky request for me to read your blog :p | 09:03 |
| shadower | thanks, I'll have a look | 09:03 |
| jaosorior | shadower: hahaha dude, I can pass you a pastebin if that's better | 09:04 |
| *** panda has quit IRC | 09:04 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE TESTING https://review.openstack.org/316436 | 09:04 |
| shadower | nah this is cool | 09:04 |
| *** gchamoul has joined #tripleo | 09:05 | |
| *** anshul_ has joined #tripleo | 09:06 | |
| *** panda has joined #tripleo | 09:07 | |
| *** cylopez has joined #tripleo | 09:08 | |
| *** abehl has quit IRC | 09:08 | |
| *** zoliXXL is now known as zoli|brb | 09:10 | |
| *** flepied has quit IRC | 09:11 | |
| *** yolanda has quit IRC | 09:18 | |
| openstackgerrit | Merged openstack/python-tripleoclient: Fix typo: remove redundant 'the' https://review.openstack.org/380936 | 09:18 |
| *** spredzy has quit IRC | 09:20 | |
| *** masco is now known as masco|lunch | 09:22 | |
| *** spredzy has joined #tripleo | 09:22 | |
| *** yolanda has joined #tripleo | 09:23 | |
| *** gfidente has joined #tripleo | 09:23 | |
| *** jaosorior is now known as jaosorior_lunch | 09:25 | |
| *** zoli|brb is now known as zoli | 09:25 | |
| *** zoli is now known as zoliXXL | 09:25 | |
| *** electrofelix has joined #tripleo | 09:28 | |
| *** tobias-fiberdata has quit IRC | 09:29 | |
| marios | shardy: bandini abandoning https://review.openstack.org/#/c/380979/ then sorry i just realised perhaps i have to do that | 09:34 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add an optional timeout when waiting for websocket messages https://review.openstack.org/364252 | 09:34 |
| marios | (+got sidetracked in other chats sorry shardy ) | 09:35 |
| *** ramishra has quit IRC | 09:35 | |
| marios | shardy: or should that be -2 i mean we want them eventually right? | 09:35 |
| shardy | marios: I think you just need to abandon the backport until we merge the patch with Depends-On to master | 09:36 |
| *** athomas has joined #tripleo | 09:36 | |
| shardy | or the gate will wait forever for the backport to land | 09:36 |
| marios | shardy: oh i see yeah i read back | 09:36 |
| marios | shardy: i realised it was actually cos the depends on is not looking at branches | 09:36 |
| shardy | yup | 09:37 |
| marios | thanks shardy | 09:37 |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/379547 | 09:40 |
| *** ramishra has joined #tripleo | 09:41 | |
| *** radeks has quit IRC | 09:41 | |
| *** tiswanso has joined #tripleo | 09:42 | |
| *** flepied has joined #tripleo | 09:43 | |
| *** flepied has quit IRC | 09:43 | |
| *** flepied has joined #tripleo | 09:45 | |
| *** flepied has quit IRC | 09:45 | |
| *** radeks has joined #tripleo | 09:46 | |
| *** flepied has joined #tripleo | 09:46 | |
| *** tiswanso has quit IRC | 09:47 | |
| *** tosky has joined #tripleo | 09:48 | |
| jprovazn | dtantsur: ping | 09:49 |
| dtantsur | jprovazn, somewhere here :) hi | 09:49 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Change rabbitmq queues HA mode from ha-all to ha-exactly https://review.openstack.org/379584 | 09:50 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Balance Rabbitmq Queue Master Location on queue declaration with min-masters strategy https://review.openstack.org/379596 | 09:50 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Fixed NoneType issue when monitoring-environment.yaml https://review.openstack.org/380007 | 09:50 |
| jprovazn | dtantsur: hi, not sure how this happened (didn't notice any error), but I have instances associated with ironic nodes even if there are no instances present - http://paste.openstack.org/show/583967/ - I wonder what is preferred way to get back to the consistent state? | 09:51 |
| *** zoliXXL is now known as zoli|lunch | 09:51 | |
| dtantsur | jprovazn, gah, this starts to be annoying.. which version? | 09:52 |
| dtantsur | I *thought* we fixed it for newton.. | 09:52 |
| jprovazn | dtantsur: openstack-ironic-api-5.1.2-3.el7ost.noarch | 09:52 |
| jprovazn | dtantsur: brief steps - tried overcloud deploy, it failed because no hosts were matching - manually updated ironic nodes to include boot_option:local | 09:53 |
| dtantsur | jprovazn, nova version? | 09:54 |
| jprovazn | dtantsur: openstack-nova-scheduler-13.1.1-7.el7ost.noarch | 09:54 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Undercloud install with tripleo-quickstart https://review.openstack.org/358919 | 09:55 |
| jprovazn | dtantsur: if needed, I can give you access to the machine | 09:56 |
| dtantsur | jprovazn, I think we need to update nova to include https://github.com/openstack/nova/commit/20ba099205d8c90334d830f53ff9bec254415265 | 09:57 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: Testing undercloud install with oooq https://review.openstack.org/381012 | 09:57 |
| jprovazn | dtantsur: looks promising | 09:57 |
| dtantsur | jprovazn, or kindly ask them to do a new release, so that it propagates to packages | 09:57 |
| jprovazn | dtantsur: so according to the patch it seems I should run a node-update request which deletes instance_uuid and instance_info | 09:59 |
| * jprovazn hopes this can be done through CLI | 09:59 | |
| jprovazn | dtantsur: ha, great, manual update made the trick | 10:00 |
| *** jaosorior_lunch is now known as jaosorior | 10:01 | |
| jaosorior | bandini: hey dude, I've actually been seeing that "Could not find data item ceilometer_redis_password" in other commits | 10:01 |
| *** hewbrocca is now known as hewbrocca-afk | 10:04 | |
| dtantsur | jprovazn, yep, should work | 10:04 |
| *** mburned_out is now known as mburned | 10:04 | |
| bandini | jaosorior: iirc there was a fairly recent commit that changed things there | 10:05 |
| bandini | will look in a bit | 10:05 |
| *** tobias-fiberdata has joined #tripleo | 10:12 | |
| *** sudipto has joined #tripleo | 10:18 | |
| *** sudipto_ has joined #tripleo | 10:18 | |
| bandini | jaosorior: maybe this change? Ic6de09acf0d36ca90cc2041c0add1bc2b4a369a5 | 10:19 |
| *** sudipto has quit IRC | 10:21 | |
| *** sudipto_ has quit IRC | 10:21 | |
| *** sudipto_ has joined #tripleo | 10:21 | |
| *** sudipto has joined #tripleo | 10:21 | |
| *** sudipto has quit IRC | 10:21 | |
| *** sudipto_ has quit IRC | 10:21 | |
| *** zoli|lunch is now known as zoli | 10:21 | |
| *** zoli is now known as zoliXXL | 10:21 | |
| openstackgerrit | Merged openstack/tripleo-quickstart: Temporarily pin pycparser https://review.openstack.org/380943 | 10:23 |
| jaosorior | bandini: looks like it :/ | 10:25 |
| *** masco|lunch is now known as masco | 10:29 | |
| *** radeks has quit IRC | 10:37 | |
| *** panda has quit IRC | 10:38 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Revert "Return to using ping test in minimal jobs" https://review.openstack.org/379545 | 10:40 |
| *** tosky has quit IRC | 10:42 | |
| *** sudipto has joined #tripleo | 10:43 | |
| *** sudipto_ has joined #tripleo | 10:44 | |
| *** b00tcat has joined #tripleo | 10:46 | |
| *** openstackgerrit has quit IRC | 10:48 | |
| *** openstackgerrit has joined #tripleo | 10:48 | |
| *** ramishra has quit IRC | 10:49 | |
| *** anshul_ has quit IRC | 10:50 | |
| *** ramishra has joined #tripleo | 10:50 | |
| *** panda has joined #tripleo | 10:52 | |
| *** tzumainn has joined #tripleo | 10:54 | |
| *** masco has quit IRC | 10:59 | |
| *** anshul_ has joined #tripleo | 11:02 | |
| *** tosky has joined #tripleo | 11:07 | |
| *** akuznetsov has joined #tripleo | 11:10 | |
| *** slagle has joined #tripleo | 11:10 | |
| *** sudipto has quit IRC | 11:12 | |
| *** sudipto has joined #tripleo | 11:12 | |
| openstackgerrit | Julie Pichon proposed openstack/puppet-tripleo: Clean out UI httpd configuration file https://review.openstack.org/380152 | 11:14 |
| *** akuznetsov has quit IRC | 11:15 | |
| *** psanchez has joined #tripleo | 11:21 | |
| *** lucas-afk is now known as lucasagomes | 11:26 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: Balance Rabbitmq Queue Master Location on queue declaration with min-masters strategy https://review.openstack.org/381059 | 11:28 |
| *** jrollen has joined #tripleo | 11:36 | |
| EmilienM | hello | 11:37 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common: Implement stack update as mistral actions https://review.openstack.org/379516 | 11:43 |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/379547 | 11:43 |
| *** toure_ is now known as toure | 11:47 | |
| *** pkovar has joined #tripleo | 11:49 | |
| *** dprince has joined #tripleo | 11:56 | |
| bandini | Hi EmilienM | 12:01 |
| bandini | marios: I will try to pass ceilometer::keystone::auth::password to the ceilometer::api class see if that fixes the upgrade major step. Will report back | 12:02 |
| *** radeks has joined #tripleo | 12:02 | |
| *** rbrady has joined #tripleo | 12:04 | |
| tbarron | bandini: EmilienM marios yeah, on master I get: Error: Could not find data item ceilometer_redis_password | 12:05 |
| tbarron | bandini: EmilienM marios so I also am trying re-deploy with a -e ~/ceilometer.yaml that sets RedisPassword | 12:05 |
| *** trown|outtypewww is now known as trown | 12:07 | |
| bandini | tbarron: yeah I have seen it on a couple of CI jobs http://logs.openstack.org/65/380665/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/eae8d14/ | 12:07 |
| bandini | tbarron: is the problem that the RedisPassword parameter is not set? | 12:08 |
| * bandini hasn't looked properly yet | 12:08 | |
| *** hewbrocca-afk is now known as hewbrocca | 12:08 | |
| tbarron | bandini: well, that's my hypothesis | 12:08 |
| bandini | ack | 12:08 |
| tbarron | bandini: http://paste.fedoraproject.org/442557/75491588/ | 12:08 |
| *** chlong has joined #tripleo | 12:08 | |
| bandini | tbarron: yeah same error | 12:09 |
| tbarron | bandini: lines 94-96 ^^ | 12:09 |
| jaosorior | EmilienM: hey dude, could you review these two? https://review.openstack.org/#/c/366548/ and https://review.openstack.org/#/c/356430/ | 12:09 |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-heat-templates: GATE TEST, please ignore https://review.openstack.org/365449 | 12:10 |
| *** akuznetsov has joined #tripleo | 12:11 | |
| *** radeks has quit IRC | 12:12 | |
| EmilienM | tbarron, bandini: weird, it passed fine in CI | 12:13 |
| EmilienM | jaosorior: is it RC3? | 12:13 |
| bandini | yeah it is odd. We do set a RedisPassword in tripleoclient | 12:13 |
| jaosorior | EmilienM: no, it's not meant for newton | 12:13 |
| EmilienM | jaosorior: ok. I don't review non-rc3 this week | 12:14 |
| *** chlong has quit IRC | 12:14 | |
| EmilienM | jaosorior: we have a deadline for Thursday, trying to prioritize work here | 12:14 |
| EmilienM | bandini: could it be a depdency issue? do you have latest packages? | 12:14 |
| *** pradk has joined #tripleo | 12:14 | |
| jaosorior | EmilienM: it's in CI that the error is happening. | 12:14 |
| jaosorior | OVB is failing with that | 12:15 |
| bandini | EmilienM: I have not seen it yet locally (tbarron has). I only saw it in CI | 12:15 |
| jaosorior | *OVB jobs are failing with that | 12:15 |
| EmilienM | in master or stable/newton? | 12:15 |
| jaosorior | master | 12:15 |
| *** akuznetsov has quit IRC | 12:16 | |
| EmilienM | weird, to me CI works fine: see https://review.openstack.org/#/c/358919/ | 12:16 |
| EmilienM | or http://tripleo.org/cistatus.html | 12:16 |
| *** jprovazn has quit IRC | 12:17 | |
| EmilienM | http://logs.openstack.org/65/380665/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/eae8d14/logs/postci.txt.gz#_2016-10-03_10_56_00_000 | 12:17 |
| EmilienM | it sounds like puppet-tripleo is looking for the hiera param that doesn't exist probably because THT version is wrong, let's check in the rpm -qa | 12:18 |
| *** jrollen has quit IRC | 12:18 | |
| EmilienM | I think I know, a sec | 12:19 |
| EmilienM | yeah, CI is taking tht from stable/newton but puppet-tripleo from master | 12:19 |
| EmilienM | that's the problem | 12:19 |
| pradk | marios, bandini, re: keystone_password .. thats already set in service templates in ceilo-base.yaml .. shouldnt that get pulled in? | 12:21 |
| EmilienM | so the quick fix is to land https://review.openstack.org/#/c/380546/ (already in gate now) | 12:23 |
| openstackgerrit | Merged openstack/tripleo-quickstart: Add ssh option IdentitiesOnly. https://review.openstack.org/374769 | 12:25 |
| pradk | EmilienM, can we +A this https://review.openstack.org/#/c/371591/ | 12:25 |
| EmilienM | jpich: http://logs.openstack.org/47/380547/1/check/gate-tripleo-ci-centos-7-undercloud/83c4554/console.html#_2016-10-03_12_22_46_455185 | 12:25 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Include ceilometer in swift proxy pipeline https://review.openstack.org/371950 | 12:25 |
| EmilienM | let's take it on #rdo | 12:25 |
| *** chlong has joined #tripleo | 12:25 | |
| * jpich looks | 12:26 | |
| EmilienM | pradk: dealing with broken CI now. | 12:26 |
| pradk | ok | 12:26 |
| bandini | pradk: ceilometer::api::keystone_password was set in mitaka, but not in newton. that is the issue I believe (welcome back btw ;) | 12:26 |
| *** rbrady has quit IRC | 12:27 | |
| *** rbrady has joined #tripleo | 12:27 | |
| pradk | bandini, right we moved to authtoken in newer versions | 12:27 |
| pradk | bandini, thx :) | 12:27 |
| pradk | bandini, so the issue is we're still using mitaka puppet module at this point? | 12:28 |
| bandini | pradk: I believe so yes | 12:28 |
| pradk | bandini, couldnt we update the opm before this step? | 12:28 |
| marios | pradk: only on converge though | 12:28 |
| marios | pradk: i mean the password doesn't get pulled from the new templates until we converge | 12:29 |
| pradk | hmm ok .. i thought we would have the newer opm by the time we run this | 12:29 |
| pradk | marios, hmm i see | 12:29 |
| marios | pradk: we don't apply any puppet until that point | 12:29 |
| pradk | so we have to explicitly set the keystone_pass here .. thats already in hiera i assume? | 12:30 |
| *** jayg|g0n3 is now known as jayg | 12:30 | |
| bandini | right something like include ::ceilometer::api{ keystone_password => hiera('ceilometer::keystone::authtoken::password' }? | 12:30 |
| pradk | yea right something like that | 12:30 |
| bandini | am trying it as soon as this deploy is finished. will report back | 12:31 |
| mcornea | gfidente: hey, got few minutes? re https://bugs.launchpad.net/tripleo/+bug/1629590 - the CinderVolume services looks to be dependent on the ceph config files when using ceph as storage backend but when the cindervolume service runs on a node that doesn't have any ceph related services the ceph conf files arent' there | 12:32 |
| openstack | Launchpad bug 1629590 in tripleo "cinder-volume requires the ceph configurationfiles for the cinder service to come up" [High,Triaged] | 12:32 |
| pradk | cool, my mitaka oc is on its way as well.. will test soon | 12:32 |
| EmilienM | ok so tripleo CI is currently broken, 2 problems : | 12:32 |
| gfidente | mcornea nice | 12:33 |
| gfidente | you basically need to deploy the CephClient role | 12:33 |
| EmilienM | 1) tripleo CI master in puppet-tripleo build THT from stable/newton but puppet-tripleo from master (which makes sense until we hav ocata repos). So stable/newton CI is broken until https://review.openstack.org/#/c/380546/ will merge | 12:33 |
| gfidente | on the node where CinderVolume is | 12:33 |
| gfidente | mcornea I'll comment on the BUZ | 12:33 |
| EmilienM | 2) https://review.openstack.org/#/c/380546/ won't merge until openstack-tripleo-ui package is fixed | 12:33 |
| mcornea | gfidente: oh, I didn't know that exists | 12:33 |
| mcornea | gfidente: that's what I was looking for. thanks! | 12:33 |
| gfidente | bug, not sure if you have time for testing it too? | 12:33 |
| gfidente | mcornea we use CephClient on 'compute' by default | 12:33 |
| gfidente | which kinda behaves like cinder and needs ceph.conf | 12:33 |
| gfidente | and the keyrings even though it does not host | 12:34 |
| gfidente | any ceph service | 12:34 |
| trown | EmilienM: is there a review for tripleo-ui package fix? | 12:34 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Telemetry: add redis_password hiera parameter https://review.openstack.org/380546 | 12:34 |
| mcornea | gfidente: right, I didn't check the compute node | 12:34 |
| gfidente | mcornea fine we probably need to document they are related | 12:34 |
| EmilienM | trown: no idea what's going on | 12:34 |
| gfidente | I'll comment on bug | 12:34 |
| mcornea | gfidente: thank you sir! | 12:34 |
| gfidente | and we can test when there is a slot :) | 12:34 |
| gfidente | ty | 12:35 |
| *** pgadiya has quit IRC | 12:37 | |
| EmilienM | ok the second issue was networking | 12:38 |
| EmilienM | @all please do not approve patches in stable/newton until https://review.openstack.org/#/c/380546/ is passing CI and merged | 12:39 |
| EmilienM | jaosorior: looking your patches now... | 12:39 |
| jaosorior | EmilienM: thanks | 12:41 |
| *** jrollen has joined #tripleo | 12:41 | |
| *** panda has quit IRC | 12:43 | |
| *** jpena is now known as jpena|lunch | 12:43 | |
| *** panda has joined #tripleo | 12:43 | |
| shardy | InvalidActionException: Failed to find action [action_name=tripleo.create_plan] | 12:45 |
| *** jrollen has quit IRC | 12:45 | |
| shardy | d0ugal: Hey is there some purge command I need to run after we removed the create_plan etc naming? | 12:45 |
| openstackgerrit | Merged openstack/tripleo-quickstart: Set LANG=C in quickstart.sh https://review.openstack.org/379007 | 12:45 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 12:45 |
| *** jrollen has joined #tripleo | 12:45 | |
| shardy | I've run mistral-db-manage populate after building and installing a new tripleo-common package with only the new names | 12:46 |
| d0ugal | shardy: https://github.com/openstack/tripleo-common#action-development | 12:46 |
| d0ugal | shardy: The key bit is "sudo mistral-db-manage populate" | 12:46 |
| shardy | Yea I've run that and bounced all the services | 12:46 |
| EmilienM | jaosorior: looks cool | 12:46 |
| *** radeks has joined #tripleo | 12:46 | |
| d0ugal | shardy: oh, maybe Mistral doesn't remove old action names | 12:47 |
| jaosorior | EmilienM: thanks :D | 12:48 |
| d0ugal | shardy: so it might be a case of mistral action-list and mistral action-delete | 12:48 |
| shardy | d0ugal: ack, thanks I'll give that a try | 12:48 |
| d0ugal | shardy: It would be a good idea to have a flag that removes actions during the populate. I'll open a mistral bug. | 12:48 |
| d0ugal | Something like: sudo mistral-db-manage populate --clean-up | 12:49 |
| shardy | action-delete fails with "Attempt to delete a system action" | 12:49 |
| shardy | so I guess I may have to manually hack them out of the DB :( | 12:50 |
| openstackgerrit | Merged openstack/tripleo-quickstart: ensure the OPT_WORKDIR is set appropriately when executed from any directory https://review.openstack.org/333643 | 12:51 |
| *** sudipto has quit IRC | 12:51 | |
| *** sudipto_ has quit IRC | 12:51 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove another openstackclient import https://review.openstack.org/381098 | 12:51 |
| *** Goneri has joined #tripleo | 12:53 | |
| EmilienM | jaosorior: can you +2 only https://review.openstack.org/#/c/380881/ and not +A? I'll approve it once the dependencies are merged, I think it saves us some time in gate. Thanks | 12:53 |
| *** jroll has quit IRC | 12:53 | |
| d0ugal | I think we will want to backport this, but I'm not sure. https://review.openstack.org/#/c/381098/ | 12:54 |
| jaosorior | EmilienM: done | 12:54 |
| *** pgadiya has joined #tripleo | 12:54 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Balance Rabbitmq Queue Master Location on queue declaration with min-masters strategy https://review.openstack.org/381059 | 12:54 |
| EmilienM | bandini: ^ rebased to have it passing CI | 12:54 |
| EmilienM | jaosorior: thx dude | 12:54 |
| *** jrollen is now known as jroll | 12:55 | |
| *** fultonj has joined #tripleo | 12:55 | |
| bandini | EmilienM: thanks! | 12:56 |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/379547 | 12:56 |
| jpich | d0ugal: I was going to say 'yes' but we still reference openstackclient directly in requirements.txt so, the UT shouldn't fail, and since it's a test the annoying warnings shouldn't show on regular usage either? | 12:58 |
| d0ugal | jpich: Indeed - that is why I am not sure :) | 13:01 |
| *** akuznetsov has joined #tripleo | 13:01 | |
| jpich | d0ugal: It's a safe, UT only backport so if we're the slightest bit worried it might be bring back the warnings might as well backport it... | 13:01 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove another openstackclient import https://review.openstack.org/381098 | 13:02 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Revert "Return to using ping test in minimal jobs" https://review.openstack.org/379545 | 13:03 |
| *** zoliXXL is now known as zoli|brb | 13:06 | |
| *** dsavineau has joined #tripleo | 13:06 | |
| *** dtantsur is now known as dtantsur|brb | 13:07 | |
| *** athomas has quit IRC | 13:08 | |
| *** athomas has joined #tripleo | 13:08 | |
| *** athomas has quit IRC | 13:08 | |
| *** tiswanso has joined #tripleo | 13:10 | |
| *** panda is now known as panda|afk | 13:11 | |
| *** limao has joined #tripleo | 13:12 | |
| *** pgadiya has quit IRC | 13:12 | |
| d0ugal | Does this mean anything to anyone? http://paste.openstack.org/show/583992/ | 13:14 |
| *** athomas has joined #tripleo | 13:15 | |
| shardy | d0ugal: "Cannot allocate memory" | 13:15 |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-validations: Create the neutron-sanity-check validation https://review.openstack.org/381118 | 13:15 |
| d0ugal | shardy: on the undercloud? | 13:16 |
| shardy | d0ugal: No, it's run out of memory trying to start services via puppet on the overcloud controller | 13:16 |
| shadower | jaosorior: thanks for the clarification mate. I thought it was going to be something like that but wanted to be sure | 13:16 |
| d0ugal | shadower: oh, so I need more ram on my nodes? | 13:17 |
| d0ugal | shardy: ^ | 13:17 |
| d0ugal | shadower: Sorry | 13:17 |
| shardy | d0ugal: yup | 13:17 |
| d0ugal | shardy: dang, thanks. | 13:17 |
| shardy | d0ugal: how much do they have atm? | 13:17 |
| *** morazi has joined #tripleo | 13:17 | |
| d0ugal | shardy: The default I think | 13:17 |
| d0ugal | shardy: 4gb | 13:18 |
| shardy | yeah I think the instack-virt-setup defaults are too low now, we should fix that | 13:18 |
| shardy | I allow 8G in my environment, but you might get away with a bit less | 13:18 |
| shardy | note that with ksm enabled you can overcommit somewhat and get away with it | 13:19 |
| shardy | (enabled by default on centos7 hosts) | 13:19 |
| slagle | i updated the defaults in https://review.openstack.org/#/c/375054/ to match CI | 13:19 |
| shardy | ah, nice | 13:20 |
| d0ugal | oh, cool. | 13:20 |
| openstackgerrit | James Slagle proposed openstack/tripleo-docs: Update minimum specs for virt setup https://review.openstack.org/375057 | 13:20 |
| slagle | docs patch ^ :) | 13:21 |
| shardy | d0ugal: Just FYI I couldn't get past the create_plan error even after dropping all actions from the DB where the name matched tripleo | 13:21 |
| shardy | I ended up having to drop the entire mistral DB, so I assume I missed something | 13:22 |
| *** milan has joined #tripleo | 13:22 | |
| d0ugal | shardy: ugh, nasty. | 13:22 |
| shardy | it would be cool if mistral provided a cleaner solution :) | 13:22 |
| *** absubram has quit IRC | 13:22 | |
| *** jpeeler has left #tripleo | 13:23 | |
| *** pgadiya has joined #tripleo | 13:24 | |
| d0ugal | shardy: Yeah, I opened https://bugs.launchpad.net/mistral/+bug/1629874 | 13:24 |
| openstack | Launchpad bug 1629874 in Mistral "Provide a way to remove old actions" [Undecided,New] - Assigned to Dougal Matthews (d0ugal) | 13:24 |
| shardy | d0ugal: nice, thanks! | 13:24 |
| *** tobias_fiberdata has joined #tripleo | 13:24 | |
| *** limao has quit IRC | 13:26 | |
| *** akshai has joined #tripleo | 13:26 | |
| *** tobias-fiberdata has quit IRC | 13:27 | |
| *** limao has joined #tripleo | 13:27 | |
| *** jeckersb_gone is now known as jeckersb | 13:27 | |
| jaosorior | shadower: no problem, thanks for checking it out. | 13:28 |
| *** jrist has quit IRC | 13:28 | |
| pabelanger | beekneemech: any updates to the launch failures in triple-test-cloud-rh1? We are up to 25 already for today | 13:31 |
| *** anshul_ has quit IRC | 13:31 | |
| *** anshul has joined #tripleo | 13:31 | |
| *** jaosorior has quit IRC | 13:31 | |
| *** jaosorior has joined #tripleo | 13:32 | |
| *** lblanchard has joined #tripleo | 13:34 | |
| *** akuznetsov has quit IRC | 13:35 | |
| *** limao_ has joined #tripleo | 13:35 | |
| jaosorior | Can someone check this docs patch? https://review.openstack.org/#/c/379382/ | 13:36 |
| *** limao__ has joined #tripleo | 13:36 | |
| *** limao has quit IRC | 13:37 | |
| *** jrist has joined #tripleo | 13:38 | |
| openstackgerrit | Merged openstack/tripleo-docs: Update minimum specs for virt setup https://review.openstack.org/375057 | 13:38 |
| gregwork | Does anyone know why installing openstack-dashboard on the director node might have affected authentication ? cli tools like ironic / nova now return authentication errors "The request you have made requires authentication" despite sourcing /home/stack/stackrc | 13:38 |
| gregwork | ls | 13:39 |
| *** limao_ has quit IRC | 13:39 | |
| jtomasek | d0ugal: do you have an example of overcloudrc handy please? | 13:39 |
| d0ugal | jtomasek: not right now, I am just re-installing. | 13:40 |
| thrash | jtomasek: one sec. | 13:40 |
| d0ugal | jtomasek: I can give you one in maybe 30 mins (undercloud install is happening now) | 13:40 |
| jtomasek | d0ugal: ok, I am trying to figure out what is the ip address which is included there | 13:40 |
| d0ugal | or thrash will beat me :) | 13:40 |
| d0ugal | jtomasek: Keystone IIRC | 13:40 |
| thrash | jtomasek: http://paste.openstack.org/show/583997/ | 13:41 |
| *** trozet has joined #tripleo | 13:41 | |
| openstackgerrit | Merged openstack/tripleo-docs: Document puppet-based CA injection for the overcloud https://review.openstack.org/379382 | 13:41 |
| thrash | jtomasek: should be keystone vip | 13:41 |
| gregwork | Seeing "There is either no auth token in the request or the certificate issuer is not truested. No auth context will be set." | 13:41 |
| jpich | gregwork: Not sure, but I think Keystone also runs on httpd so perhaps check that httpd is still running ok? | 13:41 |
| jaosorior | trown: thanks | 13:42 |
| gregwork | hmmn in redhat's docs they ask to install mod_ssl , could that have dropped configs in place somewhere | 13:42 |
| gregwork | that might be making my deploy unhappy because it was configured without ssl | 13:42 |
| *** jpena|lunch is now known as jpena | 13:42 | |
| *** panda|afk is now known as panda | 13:43 | |
| jtomasek | thrash: thanks, so it is the value of PublicVirtualIp? Is it the IP where Overcloud Horizon is also supposed to be exposed at? | 13:43 |
| jtomasek | honza: ^ | 13:43 |
| *** jprovazn has joined #tripleo | 13:44 | |
| jaosorior | jtomasek: yep | 13:44 |
| EmilienM | ok the patch that bring stable/newton CI back is in the gate now | 13:44 |
| EmilienM | (380546 ftr) | 13:44 |
| jtomasek | jaosorior: ok, thanks! | 13:45 |
| *** limao has joined #tripleo | 13:47 | |
| *** limao_ has joined #tripleo | 13:48 | |
| *** limao_ has quit IRC | 13:49 | |
| *** limao_ has joined #tripleo | 13:49 | |
| *** limao__ has quit IRC | 13:50 | |
| jaosorior | bandini: hey, so returning to the SSL question. Can I just do systemctl reload haproxy in an HA case? Or do I need to do a restart of haproxy via pcs? | 13:51 |
| bandini | pradk: I added a comment to review 360004, not sure how much it helps | 13:51 |
| *** zoli|brb is now known as zoli | 13:51 | |
| *** zoli is now known as zoliXXL | 13:52 | |
| bandini | jaosorior: I *think* a reload should be fine (i.e. I can't think of a reason right now that would mess things up) | 13:52 |
| *** limao has quit IRC | 13:52 | |
| jaosorior | mcornea: for the SSL certificate issue in HA, can you report a launchpad bug? | 13:53 |
| mcornea | jaosorior: sure, give me a minute | 13:54 |
| mcornea | jaosorior: https://bugs.launchpad.net/tripleo/+bug/1629886 | 13:55 |
| openstack | Launchpad bug 1629886 in tripleo "Renewing overcloud SSL certificate fails " [Undecided,New] | 13:55 |
| pradk | bandini, the hiera data in mitaka sets ceilometer::api::keystone_password: {get_input: ceilometer_password} .. i dont see ceilometer::keystone::auth::password in mitaka hiera data | 13:55 |
| pradk | bandini, i could be missing something | 13:55 |
| jaosorior | mcornea: thanks dude | 13:56 |
| bandini | pradk: the previous init step sets the newton metadata | 13:57 |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-validations: Create the neutron-sanity-check validation https://review.openstack.org/381118 | 13:58 |
| bandini | pradk: do you have ideas as to why ceilometer-dbsync gives unauthorized errors? is it this hiera mitaka vs newton thing? | 13:58 |
| pradk | bandini, can you paste me the ceilo.conf and traceback | 13:59 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Don't fetch undercloud image when using overcloud https://review.openstack.org/381135 | 13:59 |
| pradk | bandini, sounds like the auth settings are not correct | 13:59 |
| pradk | bandini, what does the service credentials look like | 13:59 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: reload HAProxy config in HA setups when certificate is updated https://review.openstack.org/381136 | 14:00 |
| jaosorior | mcornea: when you have time, can you check if this does the trick? ^ | 14:00 |
| *** limao has joined #tripleo | 14:01 | |
| mcornea | jaosorior: yep | 14:01 |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-validations: Create the neutron-sanity-check validation https://review.openstack.org/381118 | 14:01 |
| pradk | bandini, wait why is ceilo using mysql.. it should be mongo | 14:03 |
| *** limao_ has quit IRC | 14:03 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-cloud-config: Updated from global requirements https://review.openstack.org/381141 | 14:04 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-collect-config: Updated from global requirements https://review.openstack.org/381142 | 14:04 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-refresh-config: Updated from global requirements https://review.openstack.org/381143 | 14:04 |
| jaosorior | shadower: in https://review.openstack.org/#/c/381118/3 why pass all the config files/dirs in one argument? you could take several (since you already do the join with " ") and just iterate the arguments in bash and do shift | 14:05 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates: Update $service to $resource this variable does not exist in the context https://review.openstack.org/381144 | 14:05 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/375125 | 14:05 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements https://review.openstack.org/381148 | 14:06 |
| shadower | jaosorior: oh hey good point. It's a remnant from a previous version, but yea I think you're right | 14:06 |
| *** null_ref has joined #tripleo | 14:06 | |
| *** dtrainor has joined #tripleo | 14:06 | |
| jrist | mandre: any thoughts on this guy? https://bugs.launchpad.net/tripleo/+bug/1626485 | 14:07 |
| openstack | Launchpad bug 1626485 in tripleo "Endpoints are not defined when deploying from the GUI" [Undecided,New] | 14:07 |
| jaosorior | shadower: if you plan on using shift, just remember to take off the quotes from here in line 49 https://review.openstack.org/#/c/381118/3/validations/neutron-sanity-check.yaml | 14:07 |
| bandini | marios: is this https://review.openstack.org/#/c/379586/ one okay now for you? | 14:07 |
| shadower | jaosorior: yeah. Thanks | 14:07 |
| jaosorior | jrist: I'm guessing that bug is fore deployments before newton | 14:08 |
| shadower | jaosorior: I should probably -A it for now. My env is busted so I'm testing it on teh undercloud instead of oc | 14:08 |
| jrist | jaosorior: aye. sort of. | 14:08 |
| gfidente | bandini have we asked pradk about python-cradox? | 14:10 |
| jaosorior | jrist: ?? | 14:10 |
| bandini | gfidente: nope | 14:11 |
| jrist | jaosorior: see pm | 14:11 |
| *** myoung|afk is now known as myoung | 14:11 | |
| *** saneax is now known as saneax-_-|AFK | 14:12 | |
| *** tiswanso has quit IRC | 14:12 | |
| *** lynxman has quit IRC | 14:13 | |
| gfidente | pradk can you give a look to https://bugs.launchpad.net/tripleo/mitaka/+bug/1628632 ? | 14:13 |
| openstack | Launchpad bug 1628632 in tripleo mitaka "When deploying with ceph gnocchi-statsd is in stopped mode" [High,New] | 14:13 |
| *** tiswanso has joined #tripleo | 14:13 | |
| pradk | gfidente, looking | 14:13 |
| gfidente | tks | 14:13 |
| pradk | gfidente, hmm python-cradox should already be there | 14:14 |
| pradk | lemme find the relevant commits | 14:15 |
| *** snecklifter has quit IRC | 14:15 | |
| pradk | gfidente, https://review.openstack.org/#/c/325482/ | 14:15 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/375993 | 14:16 |
| *** dtrainor has quit IRC | 14:16 | |
| gfidente | pradk but we're not pulling the pkg depds from the puppet manifests | 14:16 |
| gfidente | in RDO | 14:16 |
| gfidente | I think we might want the gnocchi RPM to pull it in? | 14:17 |
| *** pblaho has joined #tripleo | 14:17 | |
| pradk | gfidente, its not a direct dependency | 14:17 |
| pradk | gfidente, we dont know what backend is used at rpm level | 14:17 |
| pradk | gfidente, in mitaka upgrades we installed this explicitly https://review.openstack.org/#/c/347873/ | 14:18 |
| gfidente | pradk right so you think it should be installed | 14:18 |
| gfidente | in the overcloud image | 14:18 |
| *** beekneemech is now known as bnemec | 14:18 | |
| gfidente | fine though we never added it to the list of packages installed in the overcloud image! | 14:18 |
| pradk | gfidente, https://review.openstack.org/#/c/332778/ right its in pu[pet elements too | 14:18 |
| pradk | gfidente, that should be enough to get it on controller nodes? | 14:19 |
| gfidente | oh yes | 14:19 |
| gfidente | can you please point to the last submission from the LP bug? | 14:19 |
| gfidente | looks like we need to figure why this wasn't in the RDO images | 14:19 |
| gfidente | thanks! | 14:19 |
| *** numans has quit IRC | 14:19 | |
| *** dtantsur|brb is now known as dtantsur | 14:20 | |
| pradk | EmilienM, why are we using mysql for ceilo in newton https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/ceilometer-base.yaml#L81-L89 | 14:21 |
| pradk | should still be mongo for now | 14:21 |
| mandre | jrist: no idea, sorry. I don't know what's supposed to populate the overcloud service catalog | 14:21 |
| pradk | EmilienM, that will probably only change in ocata | 14:21 |
| *** absubram has joined #tripleo | 14:21 | |
| jrist | mandre: yeah, no problem. jaosorior hooked me up | 14:22 |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-validations: Create the neutron-sanity-check validation https://review.openstack.org/381118 | 14:22 |
| jaosorior | mandre: I posted a comment in the LP | 14:22 |
| mandre | jaosorior: thanks! looking | 14:23 |
| EmilienM | pradk: i don't know | 14:23 |
| pradk | EmilienM, we set this in puppet-tripleo correctly in manifest/profile/base/ceilometer/collector.pp | 14:24 |
| EmilienM | pradk: if you want to make this change, it's really the time now :-D | 14:25 |
| pradk | yea lemme see | 14:26 |
| *** rodrigods has quit IRC | 14:29 | |
| *** rodrigods has joined #tripleo | 14:29 | |
| *** rajinir has joined #tripleo | 14:29 | |
| mandre | jaosorior: something I find quite fascinating with tripleo, there is always something new to learn | 14:29 |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates: Fixes missing "opendaylight_api_node_ips" https://review.openstack.org/381160 | 14:30 |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/379547 | 14:32 |
| pradk | EmilienM, hmm that hiera param has always been mysql even in mitaka looks like.. it only gets overridden if db is mongo in manifest | 14:32 |
| trozet | jaosorior: sorry I just deleted your vote :/ | 14:32 |
| jaosorior | trozet: no biggie, re-voted. | 14:33 |
| trozet | jaosorior: thanks! | 14:33 |
| pradk | bandini, so in our upgrade case, we have to explicitly configure the mongo conn string .. lemme push a patch and we can try | 14:33 |
| jaosorior | trozet: thanks for the fix | 14:34 |
| trozet | jaosorior: yeah took me a little while to figure out the name was the root cause | 14:34 |
| trozet | jaosorior: those yaql expressions and variables split over several files are a little hard to follow heh | 14:34 |
| bandini | pradk: ack, just ping me and I will give it a shot (takes about 60mins for a whole cycle) | 14:34 |
| jaosorior | pradk: you shouldn't remove the mysql connection string, it's used in case we explicitly configure ceilo to use mysql. | 14:35 |
| jaosorior | pradk: this is wha actually configures the backend https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/ceilometer-base.yaml#L22 | 14:35 |
| pradk | jaosorior, which is when? mongo is suppose to be the default | 14:35 |
| pradk | jaosorior, yea i know | 14:35 |
| jaosorior | pradk: the "when" is when that variable is set to mysql | 14:36 |
| pradk | its just weird to have a db connection to mysql, but defaults to mongo | 14:36 |
| pradk | in upgrade case, we have a stand alone manifest which uses the hoera data | 14:36 |
| pradk | and its getting set to mysql | 14:36 |
| pradk | thats the issue | 14:36 |
| pradk | i can work around it by explicitly configuring database conn in manifest | 14:37 |
| *** pgadiya has quit IRC | 14:37 | |
| jaosorior | pradk: yeah, seems to me that we should have both connections in t-h-t. And choose in the manifest. | 14:37 |
| thrash | d0ugal: are we now making assumptions that the plan name == overcloud stack name? | 14:39 |
| pradk | yea | 14:39 |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-validations: Create the neutron-sanity-check validations https://review.openstack.org/381118 | 14:40 |
| d0ugal | thrash: Yeah, unfortunately. | 14:40 |
| d0ugal | thrash: I'd like to try and break that link in Ocata /cc rbrady shardy | 14:40 |
| thrash | d0ugal: OK. Just trying to figure out how far I need to go with this update thing. | 14:40 |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-validations: Create the neutron-sanity-check validations https://review.openstack.org/381118 | 14:41 |
| d0ugal | thrash: k, I'd like to help if I can | 14:41 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/360004 | 14:41 |
| thrash | d0ugal: if you have some cycles, I'd love the help. | 14:41 |
| d0ugal | thrash: I think I'll need similar code to make "openstack overcloud node delete" work again. | 14:41 |
| pradk | bandini, ^^ we could do something like that | 14:41 |
| d0ugal | thrash: Sure, how far have you gotten? | 14:41 |
| thrash | d0ugal: I've got some new commands "written" and am just trying to get everything linked up. | 14:41 |
| pradk | bandini, my undercloud upgrade is in progress.. will test once i get to the point | 14:42 |
| thrash | It's a bit of a yak-shaving exercise atm. | 14:42 |
| d0ugal | thrash: heh, I can imagine. | 14:42 |
| thrash | d0ugal: I can push up what I have and W-1 it. | 14:42 |
| thrash | if you want to take a look at where I am. I'd be open to many suggestions at this point. | 14:42 |
| d0ugal | thrash: Sure, is it working enough for me to try it or should I just review? | 14:43 |
| thrash | Oh, no.. It ain't working period right now. | 14:43 |
| d0ugal | :) | 14:43 |
| thrash | It's still in incubation. | 14:43 |
| thrash | that sucker ain't breathing on its own yet. :D | 14:43 |
| d0ugal | lol | 14:43 |
| thrash | d0ugal: let me put a couple more hours into it... | 14:44 |
| thrash | Hopefully I'll have something at least by the time you start your day tomorrow. | 14:44 |
| d0ugal | thrash: k, great. If there are any details you want to pass on, feel free to drop me an email. I can always try hacking on it for a bit then. | 14:45 |
| thrash | d0ugal: word. | 14:45 |
| thrash | d0ugal: did you make any progress on a ci job for updates? | 14:45 |
| thrash | d0ugal: that would go a LONG way. | 14:45 |
| *** mbozhenk1 has quit IRC | 14:47 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Telemetry: add redis_password hiera parameter https://review.openstack.org/380546 | 14:49 |
| EmilienM | ok CI should be back ^ | 14:49 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: telemetry: remove coordination_url hiera settings https://review.openstack.org/380881 | 14:50 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Add the KeystoneCredential0 and KeystoneCredential1 parameters https://review.openstack.org/381169 | 14:51 |
| *** fzdarsky_ is now known as fzdarsky|afk | 14:52 | |
| *** limao_ has joined #tripleo | 14:52 | |
| jaosorior | yay\ | 14:52 |
| EmilienM | you can do 'recheck' if your patches didn't pass OVB jobs recently | 14:53 |
| *** dhill_ has joined #tripleo | 14:54 | |
| *** limao has quit IRC | 14:55 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Fix the timeout for pacemaker systemd resources https://review.openstack.org/380665 | 14:56 |
| *** fzdarsky|afk has quit IRC | 14:57 | |
| EmilienM | bandini, gfidente ^ rebased to have latest fix in puppet-tripleo. OVB jobs should pass now | 14:57 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Add the KeystoneCredential0 and KeystoneCredential1 parameters https://review.openstack.org/381169 | 14:57 |
| dprince | shardy: hey, so I've just about got this working https://review.openstack.org/#/c/379733/3/hot/software-config/elements/heat-config-hiera/README.rst | 14:57 |
| dprince | shardy: it will require some t-h-t changes though | 14:58 |
| dprince | which I think we want because the old conversion mess was a bit cryptic | 14:58 |
| EmilienM | gfidente: about https://review.openstack.org/#/c/379410/ - why don't use re-use CinderVolume ? | 14:59 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Use Password Generation in the Mistral workflows https://review.openstack.org/375544 | 15:00 |
| bandini | EmilienM: sweet, thanks | 15:00 |
| *** limao has joined #tripleo | 15:00 | |
| gfidente | EmilienM because that could be mapped to pcmk profile | 15:01 |
| gfidente | and we want the non-pcmk profile on blockstorage nodes | 15:01 |
| shardy | dprince: Nice! | 15:01 |
| shardy | dprince: one question - with this model, how can we handle removing old hieradata files? | 15:01 |
| dprince | shardy: so I don't think we handle that with the current model either | 15:02 |
| dprince | shardy: I could put in a bit of python to remove any non-listed files in the hierarchy | 15:02 |
| shardy | dprince: Ah, for some reason I thought we were using the oac merging of things to provide a consolidated view of which files should exist | 15:02 |
| *** limao_ has quit IRC | 15:03 | |
| shardy | Yeah, maybe the hierarchy approach would be cleanest | 15:03 |
| *** r-mibu has quit IRC | 15:03 | |
| shardy | Isn't it a similar problem with the hierarchy tho? | 15:04 |
| *** links has quit IRC | 15:04 | |
| *** r-mibu has joined #tripleo | 15:04 | |
| dprince | shardy: I can add that to the patch. | 15:04 |
| *** limao_ has joined #tripleo | 15:04 | |
| shardy | maybe we should just clean that directory during every update, before any of the hiera hooks or puppet run | 15:05 |
| jaosorior | bnemec: hey dude, in this comment, what did you mean? https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/extraconfig/tls/tls-cert-inject.yaml#L66 | 15:05 |
| *** limao has quit IRC | 15:06 | |
| bnemec | jaosorior: Which part? The fact that we need to reload manually, or the pacemaker bit? | 15:06 |
| jaosorior | bnemec: the pacemaker bit | 15:07 |
| *** thrash is now known as thrash|biab | 15:08 | |
| *** dtantsur is now known as dtantsur|mtg | 15:08 | |
| jaosorior | bnemec: cause it seems that in HA setups we need that reloading to happen, so I ended up removing the pacemaker check, to always do the reload if HAProxy is active https://review.openstack.org/#/c/381136/ | 15:09 |
| jaosorior | so I just wanted to check if there's something we missed. | 15:09 |
| bnemec | jaosorior: No, we broke it. :-( | 15:11 |
| bnemec | https://github.com/openstack/tripleo-heat-templates/commit/1590edbeca31caa7c5368f636f3869dd192c19c3 | 15:11 |
| bnemec | We used to always restart the haproxy resource in the pacemaker case, and it looks like we probably don't anymore. | 15:12 |
| jaosorior | ah | 15:12 |
| jaosorior | I see | 15:12 |
| jaosorior | aw :( | 15:12 |
| jaosorior | ok, thanks dude | 15:12 |
| bnemec | np | 15:13 |
| jaosorior | bnemec: if you have some time can you check this out? https://review.openstack.org/#/c/381136/ | 15:13 |
| *** limao_ has quit IRC | 15:15 | |
| *** limao has joined #tripleo | 15:15 | |
| EmilienM | shardy: when you have some time, can you add this one in your backlog of reviews? https://review.openstack.org/#/c/379410/ | 15:16 |
| bnemec | jaosorior: I think it's technically incorrect. I'm pretty sure pacemaker doesn't like it when you mess with services directly. | 15:16 |
| bnemec | Whether it's actually a problem in this case, I don't know though. | 15:16 |
| bnemec | And since that if statement wasn't working correctly all along thanks to the missing space before the ] it's possible we were doing it anyway. :-/ | 15:17 |
| jaosorior | bnemec: well, asked bandini about it, he said he was alright. Unless I misunderstood him | 15:17 |
| shardy | EmilienM: ack, will do | 15:17 |
| jaosorior | bnemec: it's a reported bug | 15:18 |
| *** pcaruana has quit IRC | 15:18 | |
| bandini | so in general a reload of the config should be fine (if the service supports it), a restart..not so much | 15:19 |
| bnemec | jaosorior: Okay, if he says it's okay then I'm good with it. I would prefer to leave the comment about puppet there though. | 15:19 |
| bandini | because with a reload there is no window where pacemaker might monitor the service and detect it as down | 15:19 |
| bandini | with restart that is not the case | 15:19 |
| jaosorior | bnemec: will leave the comment then | 15:19 |
| *** rcernin has quit IRC | 15:19 | |
| bnemec | bandini: Okay, sounds good. | 15:20 |
| bnemec | jaosorior: Thanks | 15:20 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: reload HAProxy config in HA setups when certificate is updated https://review.openstack.org/381136 | 15:20 |
| jaosorior | bnemec: done ^ | 15:20 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: Remove usage of --control-scale from the replace controller docs https://review.openstack.org/381184 | 15:20 |
| EmilienM | bandini, marios: commented on https://review.openstack.org/#/c/379586/ | 15:21 |
| * bandini looks | 15:22 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: Remove usage of --control-scale from the scale roles docs https://review.openstack.org/381187 | 15:24 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Select per-network hostnames for service_node_names https://review.openstack.org/378764 | 15:25 |
| *** aufi has quit IRC | 15:27 | |
| *** limao_ has joined #tripleo | 15:27 | |
| bandini | EmilienM: thanks for the review, I will drop ::stdlib but I am pretty sure that calling size() failed when I did not include it. Ideas as to why that could be? | 15:27 |
| EmilienM | bandini: probably a corner case. Keep it, no worries | 15:28 |
| EmilienM | bandini: I can +2 the patch | 15:28 |
| bandini | EmilienM: ack. thanks | 15:28 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Select per-network hostnames for service_node_names https://review.openstack.org/378764 | 15:29 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates: Update $service to $resource this variable does not exist in the context https://review.openstack.org/381144 | 15:29 |
| d0ugal | thrash|biab: We have made an error. | 15:29 |
| *** limao has quit IRC | 15:30 | |
| EmilienM | bandini: done. I'll let marios review again maybe | 15:30 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Revert "Temporarily pin pycparser" https://review.openstack.org/381190 | 15:30 |
| *** saneax-_-|AFK is now known as saneax | 15:31 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: Change rabbitmq queues HA mode from ha-all to ha-exactly https://review.openstack.org/379586 | 15:31 |
| bandini | EmilienM: I ended up adding the default. It covers us from the situation where tht is not perfectly aligned with puppet-tripleo | 15:31 |
| EmilienM | bandini: ok | 15:31 |
| EmilienM | see https://forge.puppet.com/puppetlabs/stdlib#usage | 15:31 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Select per-network hostnames for service_node_names https://review.openstack.org/378764 | 15:31 |
| EmilienM | which means, in theory we don't need to include ::stdlib | 15:32 |
| EmilienM | but that's fine... | 15:32 |
| bandini | yeah it was a bit weird | 15:32 |
| pradk | EmilienM, can we +a https://review.openstack.org/#/c/371591/ | 15:32 |
| bandini | but then again apparantly none else used size() there so I took the plunge | 15:32 |
| shardy | jaosorior: Hey see ^^ - I think I've now fixed the remaining issues | 15:32 |
| EmilienM | pradk: yes if you make sure it's in stable/newton too | 15:33 |
| pradk | EmilienM, sure i'll cherrypick once this merges | 15:33 |
| mwhahaha | i think we need to make a rule that hiera lookups should only happen as parameters in puppet-tripleo | 15:33 |
| *** leanderthal is now known as leanderthal|afk | 15:34 | |
| EmilienM | pradk: where is the THT patch again? | 15:34 |
| pradk | https://review.openstack.org/#/c/371950/ | 15:34 |
| jaosorior | shardy: awesome! checking | 15:34 |
| openstackgerrit | Julie Pichon proposed openstack/tripleo-common: Mistral workflow for creating a deployment plan from JSON input https://review.openstack.org/347830 | 15:34 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 15:35 |
| EmilienM | pradk: recheck to see if it pass CI | 15:35 |
| EmilienM | pradk: same thing, please make sure it's in stable/newton by Thursday.. Really important | 15:35 |
| pradk | done | 15:35 |
| pradk | will do | 15:35 |
| jaosorior | shardy: what's up with the block that starts in line 75? https://review.openstack.org/#/c/378764/4..7/network/ports/net_ip_list_map.yaml | 15:35 |
| shardy | jaosorior: see my comment on ps5 - I adjusted them so the inner functions could be potentially shared between the two outputs | 15:36 |
| shardy | but when I tried it I hit a heat validation bug | 15:36 |
| shardy | I can back that refactoring out, but I'm hoping to fix the heat bug asap & then we can cut/paste the common code into an OS::Heat::Value resource like for the EnabledServicesValue | 15:37 |
| *** davidlenwell has quit IRC | 15:37 | |
| shardy | maybe I should back it out so folks don't get confused | 15:38 |
| rasca | hi EmilienM, do you think we can have this https://review.openstack.org/#/c/379410/ merged before today? (I've got some CI jobs based on it and would like to know if I need to change them) | 15:39 |
| EmilienM | rasca: I'm reviewing it now | 15:39 |
| rasca | EmilienM, great! Many thanks. | 15:39 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/360004 | 15:40 |
| EmilienM | gfidente: please make sure https://review.openstack.org/#/c/379410/ gets into stable/newton | 15:40 |
| *** jtomasek_ has joined #tripleo | 15:41 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Select per-network hostnames for service_node_names https://review.openstack.org/378764 | 15:41 |
| shardy | jaosorior: ^^ done | 15:41 |
| *** dprince has quit IRC | 15:42 | |
| gfidente | EmilienM sure will backport, thanks | 15:43 |
| EmilienM | cool | 15:43 |
| *** dmacpher has joined #tripleo | 15:44 | |
| marios | bandini: sorry just finishing up call - yeah thanks... so v8 just adds the 0 by default if not set? | 15:48 |
| marios | bandini: just finished calls sorry i mean for your ping wrt https://review.openstack.org/#/c/379586/7..8/manifests/profile/pacemaker/rabbitmq.pp | 15:49 |
| marios | bandini: voted thanks | 15:49 |
| *** davidlenwell has joined #tripleo | 15:50 | |
| *** ChanServ sets mode: +v davidlenwell | 15:50 | |
| *** thrash|biab is now known as thrash | 15:50 | |
| bandini | marios: yes just the hiera default (not strictly needed but a nice check) | 15:51 |
| bandini | marios: thanks | 15:51 |
| *** cylopez has quit IRC | 15:55 | |
| *** zoliXXL is now known as zoli|gone | 15:55 | |
| shardy | trozet: Hey I commented on https://review.openstack.org/#/c/381160/ - I think your patch is actually cosmetic & that the fix was landed earlier, but I'd appreciate your confirmation | 15:56 |
| shardy | we can land your patch aligning the resource_registry alias, but we should probably revise the commit message if my feedback is correct | 15:56 |
| *** tesseract- has quit IRC | 15:56 | |
| *** zoli|gone is now known as zoli_gone-proxy | 15:56 | |
| *** jtomasek_ has quit IRC | 15:58 | |
| *** shardy has quit IRC | 16:00 | |
| *** tiswanso has quit IRC | 16:01 | |
| *** tiswanso has joined #tripleo | 16:02 | |
| *** rasca has quit IRC | 16:03 | |
| *** hjensas has quit IRC | 16:03 | |
| *** dtantsur|mtg is now known as dtantsur | 16:05 | |
| *** chlong has quit IRC | 16:06 | |
| *** sudipto has joined #tripleo | 16:08 | |
| *** sudipto_ has joined #tripleo | 16:08 | |
| *** chem has quit IRC | 16:08 | |
| *** b00tcat has quit IRC | 16:10 | |
| *** dprince has joined #tripleo | 16:17 | |
| *** bana_k has joined #tripleo | 16:17 | |
| pradk | quick question.. looking at the firewall rules on overcloud http://pastebin.test.redhat.com/417548 .. i dont see few services like redis/mongo in there. Is that expected? | 16:20 |
| pradk | we do define the dports for these in service templates | 16:20 |
| pradk | for example https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/database/redis.yaml#L38 | 16:21 |
| pradk | but they dont show up in the rules | 16:21 |
| EmilienM | pradk: can you use paste.openstack.org please? | 16:21 |
| EmilienM | this etherpad is not public? | 16:21 |
| pradk | sure, one sec | 16:21 |
| pradk | https://paste.fedoraproject.org/442671/47551172/ | 16:22 |
| pradk | EmilienM, ^^ | 16:22 |
| pradk | i caqn reach that port though .. which is weird | 16:23 |
| pradk | can* | 16:23 |
| EmilienM | can you paste all outpud of iptables? | 16:23 |
| pradk | thats what i had.. i'm waiting for my new cluster to come up.. will re paste later once thats up | 16:24 |
| EmilienM | weird, I see tripleo.redis.firewall_rules | 16:24 |
| EmilienM | we can look in CI, wait | 16:24 |
| pradk | yea we definitely have it in the code | 16:25 |
| EmilienM | http://logs.openstack.org/98/381098/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/2caeff7/logs/overcloud-controller-0/var/log/host_info.txt.gz | 16:25 |
| pradk | the resource create for firewall uses the service_names and auto creates | 16:25 |
| pradk | i just want to double check | 16:25 |
| EmilienM | indeed, i don't see any iptables rule | 16:26 |
| mcornea | jaosorior: bandini re https://review.openstack.org/#/c/381136/ - is it ok to run systemctl reload haproxy while haproxy is managed by pacemaker? | 16:26 |
| EmilienM | actually I don't see any iptables rule from composable services | 16:27 |
| EmilienM | only HAproxy but they are defined in puppet-tripleo | 16:27 |
| EmilienM | dprince: FYI we might have a regression here | 16:27 |
| pradk | EmilienM, yea there are a bunch of rules missing | 16:27 |
| EmilienM | all are missing | 16:27 |
| EmilienM | except ones defined in puppet-tripleo | 16:27 |
| pradk | yea | 16:28 |
| EmilienM | pradk: can you file a bug? this is super critical | 16:28 |
| pradk | yep on it | 16:28 |
| dprince | EmilienM: ack, I will look at pradk's bug if you need me | 16:28 |
| dprince | pradk: please ping me when you file it :) | 16:28 |
| *** jpich has quit IRC | 16:28 | |
| jaosorior | mcornea: yeah, bandini said it was fine, since it's not something that introduces downtime to haproxy | 16:28 |
| EmilienM | dprince: you see the tripleo.redis.firewall_rules things in THT? | 16:28 |
| EmilienM | for all services | 16:28 |
| EmilienM | dprince: the dynamic thing to build firewall rules | 16:29 |
| dprince | EmilienM: I remember it, yes | 16:29 |
| *** ohamada has quit IRC | 16:29 | |
| EmilienM | dprince: ^ it doesn't work anymore | 16:29 |
| dprince | EmilienM: didn't see the new issue yet though | 16:29 |
| mcornea | jaosorior: ack, I'm testing it right now and provide feedback once it finishes | 16:29 |
| EmilienM | I'm trying to see when it used to work | 16:29 |
| pradk | https://bugs.launchpad.net/tripleo/+bug/1629934 | 16:30 |
| openstack | Launchpad bug 1629934 in tripleo "firewall rules defined in service templates missing" [Undecided,New] | 16:30 |
| pradk | dprince, EmilienM ^^ | 16:30 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates: Disable all repos during rhel registration https://review.openstack.org/381233 | 16:30 |
| EmilienM | pradk: thx | 16:31 |
| *** mcornea has quit IRC | 16:32 | |
| EmilienM | i'm bisecting to find when it stopped to work | 16:32 |
| EmilienM | pradk: I fail to find when it used to work | 16:34 |
| *** trown is now known as trown|lunch | 16:34 | |
| *** athomas has quit IRC | 16:36 | |
| EmilienM | the rules should be created by TripleoFirewall service | 16:38 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Change the rabbitmq ha policies during an M/N Upgrade https://review.openstack.org/380775 | 16:40 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Balance Rabbitmq Queue Master Location on queue declaration with min-masters strategy https://review.openstack.org/381059 | 16:40 |
| openstackgerrit | Merged openstack/puppet-tripleo: Add swift proxy for ceilometer middleware https://review.openstack.org/371591 | 16:40 |
| openstackgerrit | Merged openstack/puppet-tripleo: telemetry: normalize coordination_url https://review.openstack.org/380547 | 16:40 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Cinder volume service is not managed by Pacemaker on BlockStorage https://review.openstack.org/379410 | 16:40 |
| EmilienM | It might be https://review.openstack.org/#/c/344860/4/manifests/firewall.pp | 16:42 |
| EmilienM | dprince: do you remember why you put this regex? | 16:45 |
| dprince | EmilienM: you mean the reject? | 16:46 |
| jaosorior | Hey guys, what was the way to pass extra hieradata to a deployment? | 16:46 |
| dprince | EmilienM: oh, yeah I think to exclude empty services | 16:46 |
| dprince | EmilienM: at the time OS::Heat::None was showing up in that list | 16:47 |
| dprince | EmilienM: but we now exclude those (we trim them) via Heat | 16:47 |
| dprince | EmilienM: so because we've updated t-h-t we could drop the reject I think | 16:47 |
| EmilienM | dprince: do you want me to update puppet-tripleo? | 16:48 |
| *** tremble has joined #tripleo | 16:48 | |
| *** tremble has joined #tripleo | 16:48 | |
| EmilienM | though it's weird I could not see iptables rules even back in August. | 16:48 |
| EmilienM | maybe we broke it shortly after this patch in July | 16:49 |
| dprince | EmilienM: I would need to test it locally first | 16:49 |
| dprince | EmilienM: do you want to assign the ticket to me and I can look into it? | 16:49 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: [WIP] Allow for multiple undercloud nodes https://review.openstack.org/315749 | 16:50 |
| EmilienM | dprince: ok I assigned to you but i'll also look a bit | 16:50 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: [WIP] Allow for multiple undercloud nodes https://review.openstack.org/315749 | 16:50 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Provision Identity VM https://review.openstack.org/328335 | 16:50 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Cinder volume service is not managed by Pacemaker on BlockStorage https://review.openstack.org/381240 | 16:51 |
| *** tremble has quit IRC | 16:53 | |
| jaosorior | gfidente: hey dude, do you know how can pass extra hieradata to a deployment? | 16:54 |
| *** bana_k has quit IRC | 16:54 | |
| *** derekh has quit IRC | 16:55 | |
| EmilienM | matbu: approving https://review.openstack.org/#/c/381144/ (please backport it to stable/newton) | 16:55 |
| gfidente | jaosorior use | 16:55 |
| gfidente | parameter_defaults: | 16:55 |
| gfidente | ExtraConfig: | 16:55 |
| gfidente | hieradata::param: value | 16:55 |
| gfidente | in an env file | 16:55 |
| *** anshul has quit IRC | 16:55 | |
| jaosorior | gfidente: thanks dude! | 16:55 |
| *** hewbrocca is now known as hewbrocca-afk | 16:57 | |
| *** cdearborn has joined #tripleo | 17:00 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates: Disable all repos during rhel registration https://review.openstack.org/381233 | 17:01 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove another openstackclient import https://review.openstack.org/381247 | 17:02 |
| *** yamahata has joined #tripleo | 17:03 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo: Add swift proxy for ceilometer middleware https://review.openstack.org/381250 | 17:06 |
| *** saneax is now known as saneax-_-|AFK | 17:07 | |
| *** saneax-_-|AFK is now known as saneax | 17:07 | |
| *** sudipto has quit IRC | 17:07 | |
| *** sudipto_ has quit IRC | 17:07 | |
| *** sudipto_ has joined #tripleo | 17:08 | |
| *** sudipto has joined #tripleo | 17:08 | |
| EmilienM | dprince: also, I made container job working again https://review.openstack.org/#/c/288915/ | 17:09 |
| EmilienM | if you have 2 min, can you confirm it works fine in logs? I'm also looking | 17:09 |
| EmilienM | I doubt it worked actually | 17:09 |
| *** bana_k has joined #tripleo | 17:10 | |
| EmilienM | dprince: nevermind, it looks like it ran a classic multinode job | 17:10 |
| EmilienM | http://logs.openstack.org/15/288915/59/experimental/gate-tripleo-ci-centos-7-containers-multinode-nv/1c807c5/console.html#_2016-09-30_01_39_42_803861 | 17:11 |
| EmilienM | I confirm it's a false positive | 17:11 |
| *** mcornea has joined #tripleo | 17:13 | |
| pradk | bandini, is there a preferred timeout value we use for pcs commands? .. i see 600 in some places | 17:16 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common: Modify j2 templating to allow role files generation https://review.openstack.org/378750 | 17:16 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common: Modify j2 templating to allow role files generation https://review.openstack.org/378750 | 17:17 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Allow for multiple undercloud nodes https://review.openstack.org/315749 | 17:17 |
| mwhahaha | bandini: question about https://bugs.launchpad.net/tripleo/+bug/1628998 as that seems like a dangerous improvement to try and land in an RC. Are you sure this isn't going to have additional performance or HA impact? | 17:19 |
| openstack | Launchpad bug 1628998 in tripleo "Change rabbitmq queues HA mode from ha-all to ha-exactly" [High,In progress] - Assigned to Michele Baldessari (michele) | 17:19 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common: Modify j2 templating to allow role files generation https://review.openstack.org/378750 | 17:19 |
| *** flepied has quit IRC | 17:20 | |
| *** trown|lunch is now known as trown | 17:21 | |
| openstackgerrit | Merged openstack/tripleo-puppet-elements: Change puppet-pacemaker repo from github.com to openstack.org https://review.openstack.org/336539 | 17:25 |
| *** radeks has quit IRC | 17:28 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: telemetry: remove coordination_url hiera settings https://review.openstack.org/380881 | 17:28 |
| *** numans has joined #tripleo | 17:30 | |
| openstackgerrit | Merged openstack/instack-undercloud: Stop pinning Glance API version on stackrc https://review.openstack.org/376566 | 17:33 |
| bnemec | pabelanger: There was a spike of failures when the new Jenkins image got uploaded, probably due to instance taking too long to spawn while the image was copied to the compute node cache. | 17:35 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 17:36 |
| *** yamahata has quit IRC | 17:37 | |
| pabelanger | bnemec: you are forcing images to raw format on the compute nodes? | 17:37 |
| openstackgerrit | John Eckersberg proposed openstack/tripleo-puppet-elements: Add puppet-qdr module https://review.openstack.org/373488 | 17:37 |
| openstackgerrit | John Eckersberg proposed openstack/tripleo-puppet-elements: Add qpid-dispatch-router to overcloud-controller element https://review.openstack.org/373489 | 17:37 |
| bnemec | pabelanger: Not sure, but I don't think so. Unless that's the default now, which it wasn't the last time I looked. | 17:38 |
| *** tosky has quit IRC | 17:38 | |
| bnemec | I'm wondering if we should try reducing the concurrent instance builds so we don't have so many computes trying to pull the image at the same time. | 17:40 |
| bnemec | That may also help with the floating ip timeout problem. | 17:40 |
| *** electrofelix has quit IRC | 17:40 | |
| bandini | mwhahaha: so we discussed this at length with the rabbitmq folks and it should improve both performance of rabbit and failover/ha times. risk is moderately low I would say, but yeah I get your point as well | 17:43 |
| jaosorior | I'm still seeing Error: Could not find data item ceilometer_redis_password in any Hiera data file and no default supplied at /etc/puppet/modules/tripleo/manifests/profile/base/ceilometer/agent/central.pp:34 on node overcloud-controller-1.localdomain[0m | 17:43 |
| jaosorior | in CI | 17:43 |
| bandini | pradk: I think 600 is reasonable enough | 17:43 |
| pradk | k | 17:43 |
| bandini | pradk: let me check about the bootstrap_node thing because I tested your latest revision and saw that very same problem I mentioned | 17:43 |
| EmilienM | jaosorior: update your packages | 17:44 |
| EmilienM | jaosorior: it's fixed since super recently, a few hours only | 17:44 |
| bandini | i.e. another node ate the pacemaker resource and the bootstrap node complained it was not there | 17:44 |
| jaosorior | EmilienM: I saw that in CI still | 17:44 |
| bnemec | pabelanger: I still don't think nodepool is waiting long enough for the instances to get fips either. | 17:44 |
| jaosorior | after that patch merged | 17:44 |
| bnemec | pabelanger: For instance: http://paste.openstack.org/show/584054/ | 17:44 |
| EmilienM | jaosorior: probably delorean not building it yet | 17:44 |
| EmilienM | jaosorior: let me look | 17:44 |
| jaosorior | EmilienM: for instance, here https://review.openstack.org/#/c/378764/ | 17:45 |
| bnemec | pabelanger: The instance goes active, then 25 seconds later it's already gone. | 17:45 |
| jaosorior | wait | 17:45 |
| jaosorior | wrong CR | 17:45 |
| jaosorior | here https://review.openstack.org/#/c/366548/ | 17:45 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/360004 | 17:46 |
| *** jpena is now known as jpena|away | 17:46 | |
| pradk | bandini, ok, I added the check anyway ^^ | 17:46 |
| EmilienM | jaosorior: mhh | 17:46 |
| EmilienM | jaosorior: let me look a sec | 17:47 |
| EmilienM | jaosorior: THT too old | 17:47 |
| EmilienM | that's why | 17:47 |
| pabelanger | bnemec: I'll have to debug the issue, manually. How long do you expect it for a FIP to be allocated? | 17:47 |
| EmilienM | probably delorean hasn't catch up yet with commits | 17:47 |
| EmilienM | but it's a delorean lag here | 17:47 |
| EmilienM | you're testing https://github.com/openstack/tripleo-heat-templates/commit/d636e3a19fbfe997648465d24bd2231ce86373db | 17:47 |
| EmilienM | while there are some commits after | 17:48 |
| bandini | pradk: ack, rerunning the job | 17:48 |
| *** amoralej is now known as amoralej|off | 17:54 | |
| bnemec | pabelanger: Hard to say exactly, but looking through the recent instances booted it looks like most of them got a fip within one iteration of my nova list loop. | 17:55 |
| bnemec | pabelanger: Which takes around 25 seconds total. I did see a couple of instances that took two iterations, and one of them got deleted as a result. | 17:56 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Provision Identity VM https://review.openstack.org/328335 | 17:56 |
| pabelanger | bnemec: okay, it shouldn't be hard for me to reproduce the problem manually | 17:56 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: firewall: do not exclude empty services https://review.openstack.org/381266 | 17:57 |
| mwhahaha | bandini: ok just wanted to double check. Imho it seemed more like a feature improvement rather than something that had to be part of the RC but I'll defer to others who were probably more involved | 17:58 |
| bandini | mwhahaha: yeah your concern is valid. timing isn't the best, but the rabbitmq overlords pushed for it, so I think it is worth pursuing for N | 17:58 |
| mwhahaha | OK | 17:59 |
| *** penick has joined #tripleo | 18:02 | |
| *** dtantsur is now known as dtantsur|afk | 18:02 | |
| openstackgerrit | Merged openstack/python-tripleoclient: Remove another openstackclient import https://review.openstack.org/381098 | 18:04 |
| EmilienM | bandini: as long are you stay around for the next 2 weeks, I'm fine :) | 18:06 |
| bandini | EmilienM: I sure will :D | 18:07 |
| EmilienM | :) | 18:07 |
| *** jaosorior has quit IRC | 18:07 | |
| *** pkovar has quit IRC | 18:10 | |
| *** yamahata has joined #tripleo | 18:14 | |
| *** flepied has joined #tripleo | 18:15 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Update $service to $resource this variable does not exist in the context https://review.openstack.org/381144 | 18:17 |
| *** milan has quit IRC | 18:18 | |
| *** gfidente has quit IRC | 18:19 | |
| *** sudipto_ has quit IRC | 18:21 | |
| *** sudipto has quit IRC | 18:21 | |
| EmilienM | rbrady: are you still working on https://bugs.launchpad.net/tripleo/+bug/1626736 ? | 18:26 |
| openstack | Launchpad bug 1626736 in tripleo " Unable to delete overcloud node" [Critical,Triaged] - Assigned to Ryan Brady (rbrady) | 18:26 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Fix the timeout for pacemaker systemd resources https://review.openstack.org/380665 | 18:27 |
| rbrady | EmilienM: d0ugal was working on that today | 18:29 |
| EmilienM | mcornea: could we close https://bugs.launchpad.net/tripleo/+bug/1629590 ? | 18:29 |
| openstack | Launchpad bug 1629590 in tripleo "cinder-volume requires the ceph configurationfiles for the cinder service to come up" [High,Triaged] - Assigned to Giulio Fidente (gfidente) | 18:29 |
| *** yamahata has quit IRC | 18:29 | |
| EmilienM | rbrady: ack | 18:29 |
| *** pcaruana has joined #tripleo | 18:29 | |
| mcornea | EmilienM: oh, sorry, I thought I closed it. Closing it now | 18:30 |
| EmilienM | mcornea: Invalid is fine | 18:30 |
| mcornea | EmilienM: done | 18:30 |
| EmilienM | thanks | 18:31 |
| *** rcernin has joined #tripleo | 18:31 | |
| EmilienM | mcornea: are you working on https://review.openstack.org/#/c/381136/ ? (testing or something?) looks like Juan is waiting for something | 18:36 |
| mcornea | EmilienM: yes, I've got a deployment running to validate it. Will provide feedback soon | 18:36 |
| EmilienM | excellent, please -1 or +1 it when done | 18:37 |
| EmilienM | mcornea: so we know you're ok | 18:37 |
| mcornea | EmilienM: sure | 18:37 |
| *** numans has quit IRC | 18:42 | |
| EmilienM | I'm moving a lot of bugs to ocata-1 | 18:45 |
| EmilienM | some bugs are actually features | 18:45 |
| EmilienM | and don't block our newton release. | 18:45 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Clean out UI httpd configuration file https://review.openstack.org/380152 | 18:46 |
| gregwork | on average how long does an overcloud deploy with scale4 compute/control/ceph-storage take ? | 18:46 |
| gregwork | this one build i have has been cooking for an hour .. all the nodes have been provisioned, i can log into them .. but the original deploy command is still running | 18:47 |
| EmilienM | bandini: I would be a bit more conservative next release | 18:47 |
| EmilienM | bandini: for RC, please don't add anymore feature | 18:47 |
| bandini | EmilienM: what feature did I add? | 18:47 |
| EmilienM | the rabbitmq thing was the last thing really, and I'm not even sure it will merge | 18:48 |
| *** penick has quit IRC | 18:48 | |
| EmilienM | I'm already having hard time to release tripleo following upstream deadlines | 18:48 |
| EmilienM | bandini: also, please don't forget to cherry-pick your patches to stable/newton. https://review.openstack.org/#/c/380775/ is one of them | 18:49 |
| bandini | EmilienM: oh the rabbit stuff. I can recheck with the rabbit folks and we just leave it in master if you're concerned? | 18:49 |
| EmilienM | but make sure everything else is backported (re upgrades) | 18:49 |
| mcornea | EmilienM: https://review.openstack.org/#/c/381136/ looks good | 18:49 |
| EmilienM | mcornea: ok thx | 18:49 |
| bandini | EmilienM: yeah I was waiting for the last one to merge before doing the backports | 18:49 |
| EmilienM | bandini: it's good now, but for next time | 18:49 |
| bandini | ack | 18:49 |
| EmilienM | thx | 18:49 |
| *** anshul has joined #tripleo | 18:50 | |
| *** penick has joined #tripleo | 18:51 | |
| bandini | EmilienM: can +A the last one https://review.openstack.org/#/c/379586/ and then I'll go ahead and do the backports? | 18:51 |
| *** mcornea has quit IRC | 18:51 | |
| EmilienM | bandini: mwhahaha had a interesting comment, I'm not sure I can approve it | 18:53 |
| bandini | oh sec, Had not seen there were additional comments | 18:53 |
| EmilienM | bandini: when doing all backports, also set gerrit topic to tripleo/rc3 | 18:54 |
| bandini | ack | 18:55 |
| EmilienM | rbrady: I might have missed it but I don't see any patch about it from d0ugal | 18:57 |
| *** yamahata has joined #tripleo | 18:59 | |
| rbrady | EmilienM: when I sync'd up with him today, he said he was working on it. I don't know if it's in a state to push up to gerrit yet | 19:02 |
| EmilienM | rbrady: ok thanks | 19:02 |
| EmilienM | can sonemone look https://review.openstack.org/#/c/380386/ please? | 19:02 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: Change rabbitmq queues HA mode from ha-all to ha-exactly https://review.openstack.org/379586 | 19:05 |
| EmilienM | jrist: any update about https://bugs.launchpad.net/tripleo/+bug/1624390 ? | 19:09 |
| openstack | Launchpad bug 1624390 in tripleo "[ui] Assigned Node Misrepresented in Nodes Table" [High,In progress] - Assigned to Jiri Tomasek (jtomasek) | 19:09 |
| EmilienM | I'm going to move it for ocata-1 I think | 19:09 |
| openstackgerrit | Merged openstack/puppet-tripleo: Use FallbackResource instead of Rewrite for UI https://review.openstack.org/378571 | 19:16 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common: Modify j2 templating to allow role files generation https://review.openstack.org/378750 | 19:23 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Use FallbackResource instead of Rewrite for UI https://review.openstack.org/381276 | 19:24 |
| *** penick has quit IRC | 19:26 | |
| *** paramite has quit IRC | 19:32 | |
| jtomasek | EmilienM: this one fises the bug https://review.openstack.org/#/c/367562/ I am not sure what I do wrong that launchpad does not update with sending that patch up to gerrit | 19:42 |
| *** penick has joined #tripleo | 19:42 | |
| EmilienM | jtomasek: is it going to land on time? | 19:43 |
| openstackgerrit | Dougal Matthews proposed openstack-infra/tripleo-ci: Add Mistral to the CI status https://review.openstack.org/379335 | 19:45 |
| jtomasek | EmilienM: depends on the dependent tripleo-common patch, honza is working on that one. IMO it is a blocker for GUI, it causes large UX problem. I'll work with honza towards having both patches ready by the end of tomorrow | 19:45 |
| jtomasek | EmilienM: how does it sound to you? | 19:45 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add the workflow name to the starting workflow message https://review.openstack.org/375331 | 19:45 |
| EmilienM | jtomasek: i'll see :) but we release rc2 by thursday fyi | 19:45 |
| EmilienM | rc3 | 19:45 |
| jtomasek | EmilienM: yep, ok | 19:46 |
| *** jprovazn has quit IRC | 19:51 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: WIP - Testing undercloud upgrade https://review.openstack.org/381286 | 19:51 |
| *** jpena|away is now known as jpena | 20:05 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 20:10 |
| *** jtomasek is now known as jtomasek|afk | 20:12 | |
| bandini | pradk: https://paste.fedoraproject.org/442740/14755256/ does this help? | 20:13 |
| pradk | right the code sets that.. what i'm curious was if that value it getting to the apache class | 20:16 |
| *** Goneri has quit IRC | 20:16 | |
| pradk | from the conf.d you pasted that value is missing | 20:16 |
| pradk | bandini, i dont think we need to set this explicitly in manifest if its already in tht | 20:17 |
| bandini | pradk: yeah not sure why servername is empty | 20:18 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/375993 | 20:18 |
| *** anshul has quit IRC | 20:18 | |
| *** dprince has quit IRC | 20:18 | |
| *** lucasagomes is now known as lucas-afk | 20:19 | |
| *** jpena is now known as jpena|off | 20:22 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: Change rabbitmq queues HA mode from ha-all to ha-exactly https://review.openstack.org/379586 | 20:24 |
| *** jayg is now known as jayg|g0n3 | 20:27 | |
| *** myoung is now known as myoung|bbl | 20:36 | |
| *** pcaruana has quit IRC | 20:45 | |
| jrist | EmilienM: very low prio. Ocata is fine | 20:45 |
| jrist | EmilienM: thanks for checking | 20:45 |
| EmilienM | jrist: ok | 20:49 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/360004 | 20:55 |
| *** penick has quit IRC | 20:59 | |
| *** lblanchard has quit IRC | 21:01 | |
| *** penick has joined #tripleo | 21:03 | |
| *** trown is now known as trown|outtypewww | 21:06 | |
| openstackgerrit | Merged openstack/os-refresh-config: Updated from global requirements https://review.openstack.org/332334 | 21:09 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Undercloud upgrade for mitaka and newton https://review.openstack.org/381286 | 21:15 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - Test Undercloud upgrade mitaka -> newton https://review.openstack.org/381309 | 21:15 |
| *** openstackgerrit has quit IRC | 21:19 | |
| *** openstackgerrit has joined #tripleo | 21:19 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates: Update $service to $resource this variable does not exist in the context https://review.openstack.org/381311 | 21:20 |
| EmilienM | slagle: upgrade is broken | 21:23 |
| EmilienM | you'll hit this bug: https://bugs.launchpad.net/tripleo/+bug/1624727 | 21:23 |
| openstack | Launchpad bug 1624727 in tripleo "Could not fetch contents for file:///home/stack/tripleo-heat-templates/puppet/post.yaml" [Critical,In progress] - Assigned to mbu (mat-bultel) | 21:23 |
| EmilienM | just fyi | 21:23 |
| slagle | EmilienM: i'm doing undercloud upgrades | 21:24 |
| slagle | not overcloud | 21:24 |
| EmilienM | slagle: ok but if you update your undercloud and try to deploy the overcloud from scratch it won't work | 21:24 |
| EmilienM | I'm not talking about overcloud upgrade | 21:24 |
| slagle | ok, i'm just trying to make sure the job passes for now | 21:25 |
| slagle | the undercloud-upgrades one | 21:25 |
| slagle | that doesnt deploy an overcloud | 21:26 |
| EmilienM | ok | 21:27 |
| *** tiswanso has quit IRC | 21:29 | |
| *** Goneri has joined #tripleo | 21:30 | |
| *** akshai has quit IRC | 21:36 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker: Remove useless etc-pacemaker-authkey -> pcsd dependency https://review.openstack.org/381326 | 21:47 |
| *** bana_k has quit IRC | 21:49 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Use Password Generation in the Mistral workflows https://review.openstack.org/375544 | 21:54 |
| *** tiswanso has joined #tripleo | 21:58 | |
| *** tiswanso has quit IRC | 22:03 | |
| therve | EmilienM, Have you see the error "Data too long for column 'resource_properties'" from Heat? | 22:04 |
| *** bana_k has joined #tripleo | 22:06 | |
| *** panda is now known as panda|afk | 22:08 | |
| *** panda|afk is now known as panda|Zz | 22:08 | |
| gregwork | my overcloud deploy failed after exactly 4 hours, is > 4h typical for a scale 4 compute/control/ceph build ? | 22:09 |
| gregwork | the 4h failure seems to be tied to keystone token expiration | 22:09 |
| gregwork | there were no Errors during the build | 22:09 |
| gregwork | any ideas where i can start digging ? | 22:09 |
| *** akshai has joined #tripleo | 22:12 | |
| mwhahaha | gregwork: i'm not sure, but usually you need an odd number of controllers. it might have had issues trying to form a quorum with 5 nodes | 22:13 |
| mwhahaha | er 4 nodes | 22:13 |
| therve | gregwork, 4h is the stack timeout | 22:15 |
| therve | The token expiration is a side effect you see on the client side, but not the root cause | 22:15 |
| gregwork | so 4 controllers == not best practice ? | 22:16 |
| bandini | even number of nodes in a cluster is never a good idea | 22:16 |
| bandini | but that is not the issue you are seeing, I deploy just fine on 4 controllers (for testing) | 22:16 |
| gregwork | this is the whole build, theres only 1 line in the whole thing that was transiently not good .. but it went away | 22:19 |
| gregwork | http://paste.fedoraproject.org/442773/raw/ | 22:19 |
| gregwork | no other errors at all | 22:19 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: reload HAProxy config in HA setups when certificate is updated https://review.openstack.org/381136 | 22:19 |
| therve | gregwork, resources.CephStorage: Went to status ERROR due to "Message: No valid host was found. There are not enough hosts available., Code: 500" | 22:19 |
| gregwork | so that doesnt make sense either , i have 4 ceph servers, it deployed 4 ceph servers, when i did a nova list i saw 4 ceph servers | 22:20 |
| gregwork | while it was building i could log into each via heat-admin | 22:20 |
| bandini | that ceph error was transient afaict | 22:20 |
| bandini | mwhahaha: thanks for all the reviews! | 22:20 |
| mwhahaha | bandini: np | 22:21 |
| mwhahaha | gregwork: any failed actions in openstack stack resource list overcloud | 22:21 |
| bandini | gregwork: if you use more than one controller you likely want -e environments/puppet-pacemaker.yaml, I am pretty sure the non-ha scenario works only with one controller atm | 22:21 |
| gregwork | hmmn ok | 22:22 |
| bandini | or at least it used to, might be that is not the case any longer | 22:22 |
| bandini | anyhow, I need to catch some sleep now | 22:22 |
| gregwork | http://paste.fedoraproject.org/442775/raw/ | 22:22 |
| gregwork | is it crapped out on i guess | 22:22 |
| gregwork | is *what it | 22:22 |
| *** rcernin has quit IRC | 22:25 | |
| *** penick has quit IRC | 22:25 | |
| bnemec | You definitely need puppet-pacemaker.yaml for an ha deployment: http://docs.openstack.org/developer/tripleo-docs/advanced_deployment/high_availability.html | 22:30 |
| *** akshai has quit IRC | 22:36 | |
| *** bana_k has quit IRC | 22:36 | |
| *** absubram has quit IRC | 22:38 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - Test Undercloud upgrade mitaka -> newton https://review.openstack.org/381309 | 22:38 |
| gregwork | ok | 22:39 |
| gregwork | is rhn registration or satellite registration also required for the build ? | 22:40 |
| gregwork | i see a rhel-registration yaml | 22:40 |
| gregwork | i am using satellite 6.1 in my environment | 22:40 |
| *** bana_k has joined #tripleo | 22:42 | |
| *** tiswanso has joined #tripleo | 22:53 | |
| *** tiswanso has quit IRC | 22:53 | |
| *** tiswanso has joined #tripleo | 22:54 | |
| *** hjensas has joined #tripleo | 23:13 | |
| *** hjensas has quit IRC | 23:13 | |
| *** hjensas has joined #tripleo | 23:13 | |
| *** [1]cdearborn has joined #tripleo | 23:15 | |
| *** tiswanso has quit IRC | 23:18 | |
| *** pmannidi has joined #tripleo | 23:21 | |
| *** rajinir has quit IRC | 23:25 | |
| *** [1]cdearborn has quit IRC | 23:25 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Update $service to $resource this variable does not exist in the context https://review.openstack.org/381311 | 23:26 |
| *** cdearborn has quit IRC | 23:30 | |
| *** [1]cdearborn has joined #tripleo | 23:33 | |
| *** yamahata has quit IRC | 23:44 | |
| *** cdearborn has joined #tripleo | 23:45 | |
| *** [1]cdearborn has quit IRC | 23:57 | |
| *** yamahata has joined #tripleo | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!