EmilienM | trown: thx for doing 'recheck', it's the downside of 'actually' testing the modules | 00:04 |
---|---|---|
EmilienM | we rely on packaging | 00:04 |
trown | EmilienM: ya, something else failed but I will look at it tomorrow | 00:05 |
slagle | i think this is causing the ha breakage | 00:06 |
slagle | https://review.openstack.org/#/c/221750 | 00:06 |
EmilienM | https://review.openstack.org/#/c/227055/2/spec/classes/n1kv_vsm_vsmprep_spec.rb,cm | 00:06 |
EmilienM | if you look at ^ | 00:06 |
EmilienM | I exactly reproduce your manifest | 00:06 |
EmilienM | damn | 00:07 |
EmilienM | wrong window | 00:07 |
* trown was confused :p | 00:07 | |
EmilienM | I'm using weechat for some days | 00:07 |
EmilienM | and I'm not 100% used to it yet | 00:08 |
sthillma | EmilienM: :) will check it out thanks | 00:08 |
EmilienM | sthillma: you're everywhere | 00:08 |
sthillma | EmilienM: well these two channels at least :) | 00:09 |
slagle | i thought you were just layin down some hot puppet knowledge | 00:10 |
EmilienM | slagle: ahahah | 00:10 |
EmilienM | slagle: you know I'm faking :P | 00:11 |
openstackgerrit | James Slagle proposed openstack/python-tripleoclient: Use parameter_defaults everywhere https://review.openstack.org/227057 | 00:14 |
slagle | bnemec: trown : HA fix ^ maybe :) | 00:14 |
EmilienM | slagle: you're laying down your hot ooo skills? :P | 00:16 |
slagle | i dont have any. all i do is copy/paste code around | 00:16 |
EmilienM | same here | 00:16 |
EmilienM | copy/paste bugs | 00:17 |
*** Goneri has joined #tripleo | 00:18 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Exit 1 if wrong number of nodes are deployed https://review.openstack.org/226970 | 00:19 |
trown | slagle: nice one... so simple | 00:20 |
slagle | we can hope | 00:21 |
*** shadower has quit IRC | 00:23 | |
*** shadower has joined #tripleo | 00:23 | |
*** sthillma has quit IRC | 00:25 | |
*** trown is now known as trown|outttypeww | 00:33 | |
*** d0ugal has quit IRC | 00:35 | |
*** d0ugal has joined #tripleo | 00:40 | |
*** d0ugal is now known as Guest65853 | 00:40 | |
*** Goneri has quit IRC | 00:40 | |
thrash | slagle: how confident are you in that patch? :) | 00:43 |
thrash | I don't think we want to necessarily enable HA CI on the client. | 00:44 |
thrash | I'm not having much luck with my own environment. would be great if somebody else could test it in the meantime. | 00:45 |
slagle | thrash: i didnt test it. i think we definitely need ha ci on the client | 00:47 |
slagle | why wouldnt we? | 00:47 |
thrash | hmmm | 00:47 |
thrash | well.. Not sure. :) | 00:47 |
thrash | I guess that would make sense. | 00:47 |
thrash | I'll keep trying to get an environment up on this end to test it. | 00:48 |
thrash | I hadn't even gotten as far as being able to repro the original problem. | 00:48 |
slagle | i can try it tomorrow | 00:50 |
slagle | i've got that env shut down at the moment | 00:50 |
slagle | can only run so many at once :) | 00:50 |
thrash | :) | 00:50 |
thrash | I'll let you know if I have luck prior to tmrw | 00:50 |
slagle | k, sounds good. or just comment on my patch | 00:51 |
thrash | word | 00:51 |
*** panda has quit IRC | 00:53 | |
*** panda has joined #tripleo | 00:53 | |
*** sthillma has joined #tripleo | 01:03 | |
*** sdake has joined #tripleo | 01:03 | |
*** sthillma_ has joined #tripleo | 01:03 | |
*** sthillma_ has quit IRC | 01:07 | |
*** sthillma has quit IRC | 01:07 | |
*** sthillma has joined #tripleo | 01:10 | |
*** penick has quit IRC | 01:22 | |
*** rhallisey has quit IRC | 01:26 | |
*** sthillma has quit IRC | 01:28 | |
*** Marga__ has joined #tripleo | 01:29 | |
*** Marga_ has quit IRC | 01:32 | |
*** Marga__ has quit IRC | 01:33 | |
*** sthillma has joined #tripleo | 01:36 | |
*** julim has joined #tripleo | 01:51 | |
*** sthillma has quit IRC | 01:53 | |
*** w_ is now known as olaph | 01:53 | |
*** sdake has quit IRC | 02:06 | |
openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates: Ensure present/latest for puppet driven package updates https://review.openstack.org/190918 | 02:15 |
openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates: Write package names out to flat files https://review.openstack.org/194348 | 02:15 |
openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates: Make package upgrade pacemaker-aware https://review.openstack.org/225524 | 02:15 |
*** yamahata has quit IRC | 02:17 | |
*** untriaged-bot has joined #tripleo | 03:00 | |
untriaged-bot | Untriaged bugs so far: | 03:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1499017 | 03:00 |
openstack | Launchpad bug 1499017 in tripleo "[instack-undercloud] Swift Ceilometer middleware no longer exists" [Undecided,In progress] - Assigned to John Trowbridge (trown) | 03:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1498845 | 03:00 |
openstack | Launchpad bug 1498845 in tripleo "Wrong node count can be passed to heat when deleting a specific node" [High,New] - Assigned to Jan Provaznik (jan-provaznik) | 03:00 |
*** untriaged-bot has quit IRC | 03:00 | |
*** yamahata has joined #tripleo | 03:01 | |
*** shivrao has joined #tripleo | 03:17 | |
*** spzala has quit IRC | 03:19 | |
*** shivrao_ has joined #tripleo | 03:20 | |
*** shivrao has quit IRC | 03:21 | |
*** shivrao_ is now known as shivrao | 03:22 | |
*** stendulker has joined #tripleo | 03:23 | |
*** julim has quit IRC | 03:41 | |
*** masco_ has joined #tripleo | 03:57 | |
*** sthillma has joined #tripleo | 04:01 | |
*** Marga_ has joined #tripleo | 04:42 | |
*** Marga_ has quit IRC | 04:43 | |
*** Marga_ has joined #tripleo | 04:43 | |
*** sdake has joined #tripleo | 04:54 | |
*** shivrao has quit IRC | 05:05 | |
*** ifarkas has quit IRC | 05:07 | |
*** shivrao has joined #tripleo | 05:07 | |
*** tzumainn has quit IRC | 05:26 | |
*** sdake has quit IRC | 05:40 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Use --nodeps when installing fedora-release https://review.openstack.org/227123 | 06:04 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Move yum-based install into function https://review.openstack.org/227124 | 06:04 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add basic Fedora 22 support to yum-minimal https://review.openstack.org/227125 | 06:04 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Update default fedora-minimal to f22 https://review.openstack.org/227126 | 06:04 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Cleanup the fedora-minimal yum/dnf path https://review.openstack.org/227127 | 06:04 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Remove extra install of release pkgs in fedora-minimal https://review.openstack.org/227131 | 06:11 |
*** sthillma has quit IRC | 06:22 | |
*** leanderthal has joined #tripleo | 06:30 | |
*** jprovazn has joined #tripleo | 06:31 | |
*** panda has quit IRC | 06:38 | |
*** panda has joined #tripleo | 06:39 | |
*** adrianopetrich_ is now known as apetrich | 06:49 | |
openstackgerrit | Jane.zhang proposed openstack/diskimage-builder: Adds debian support to iso element https://review.openstack.org/211976 | 06:53 |
*** jrist has quit IRC | 06:56 | |
*** jrist has joined #tripleo | 06:59 | |
*** aufi has joined #tripleo | 07:10 | |
*** yog_ has joined #tripleo | 07:17 | |
*** hashar has joined #tripleo | 07:19 | |
*** akrivoka has joined #tripleo | 07:30 | |
*** shivrao_ has joined #tripleo | 07:44 | |
*** shivrao has quit IRC | 07:45 | |
*** shivrao_ is now known as shivrao | 07:45 | |
*** ifarkas has joined #tripleo | 07:46 | |
*** paramite has joined #tripleo | 08:03 | |
*** Guest65853 is now known as d0ugal | 08:08 | |
*** athomas has joined #tripleo | 08:08 | |
*** d0ugal has quit IRC | 08:08 | |
*** d0ugal has joined #tripleo | 08:08 | |
*** jaosorior has joined #tripleo | 08:09 | |
*** StevenK has quit IRC | 08:14 | |
*** shivrao has quit IRC | 08:20 | |
*** StevenK has joined #tripleo | 08:21 | |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates: Keystone domain for Heat https://review.openstack.org/180566 | 08:26 |
*** dtantsur|afk is now known as dtantsur | 08:30 | |
*** lucasagomes has joined #tripleo | 08:30 | |
*** shardy has joined #tripleo | 08:34 | |
jprovazn | shardy: good morning | 08:46 |
*** lifeless has quit IRC | 08:49 | |
*** paramite is now known as paramite|afk | 08:50 | |
*** derekh has joined #tripleo | 08:51 | |
*** athomas has quit IRC | 08:54 | |
d0ugal | derekh: the failure here is expected? https://review.openstack.org/#/c/227057/1 | 09:00 |
d0ugal | derekh: Just checking after seeing your comment before I +A | 09:00 |
*** untriaged-bot has joined #tripleo | 09:00 | |
untriaged-bot | Untriaged bugs so far: | 09:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1499017 | 09:00 |
openstack | Launchpad bug 1499017 in tripleo "[instack-undercloud] Swift Ceilometer middleware no longer exists" [Undecided,In progress] - Assigned to John Trowbridge (trown) | 09:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1498845 | 09:00 |
openstack | Launchpad bug 1498845 in tripleo "Wrong node count can be passed to heat when deleting a specific node" [High,New] - Assigned to Jan Provaznik (jan-provaznik) | 09:00 |
*** untriaged-bot has quit IRC | 09:00 | |
derekh | d0ugal: Yes, tripleoclient wasn't deploying a HA cloud (ignoreing the controlscale=3), | 09:01 |
*** paramite|afk is now known as paramite | 09:01 | |
derekh | d0ugal: as a result was passing ci (becuase it successfully deployed a non ha cloud) | 09:02 |
*** rasca has joined #tripleo | 09:02 | |
*** gfidente has joined #tripleo | 09:02 | |
d0ugal | derekh: Gotcha. Thanks, i'll +1 workflow. | 09:02 |
derekh | d0ugal: now its at least attempting to do the correct thing, something else if causeing the failure | 09:02 |
d0ugal | :) | 09:02 |
derekh | d0ugal: yup, go for it | 09:02 |
*** lifeless has joined #tripleo | 09:03 | |
*** athomas has joined #tripleo | 09:03 | |
shardy | jprovazn: hi! | 09:05 |
jprovazn | shardy: hi, I'm still struggling with the rhel-unreg issue we talked about yesterday, good news is that signalling now works with https://review.openstack.org/#/c/225537/ applied | 09:07 |
jprovazn | shardy: bad news is that rhel-unreg resource is still stuck in DELETE_IN_PROGRESS *although* nova server was already deleted | 09:08 |
jprovazn | shardy: which seems to me quite weird that nova server is deleted sooner than a SoftwareDeployment associated with it | 09:09 |
shardy | jprovazn: Yes, that should be impossible | 09:09 |
jprovazn | mmt, let my find one paste | 09:09 |
jprovazn | shardy: http://paste.openstack.org/show/473838/ | 09:10 |
openstackgerrit | Merged openstack/python-tripleoclient: Remove Debug parameter from overcloud deploy https://review.openstack.org/224058 | 09:10 |
jprovazn | shardy: in this fpaste you can see that nova server desappears sooner than rhel-unreg switches to delete_in_progress | 09:10 |
*** pelix has joined #tripleo | 09:11 | |
jprovazn | shardy: I couldn't find the part of heat code which sends signal to trigger delete software deployment, maybe you might know? | 09:12 |
shardy | jprovazn: so, working backwards from the templates: | 09:16 |
shardy | The unreg template is wired in via NodeExtraConfigPost: | 09:17 |
shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/compute-post-puppet.yaml#L39 | 09:17 |
shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-without-mergepy.yaml#L1329 | 09:17 |
shardy | which references the Compute ResourceGroup | 09:17 |
shardy | hence, ComputeNodesPostDeployment can't go DELETE_COMPLETE with the unreg still DELETE_IN_PROGRESS | 09:18 |
shardy | and because we walk the dependency graph backwards on delete, we can't delete the Compute ResourceGroup before that goes DELETE_COMPLETE | 09:18 |
shardy | In heat: | 09:18 |
openstackgerrit | Merged openstack/python-tripleoclient: Use parameter_defaults everywhere https://review.openstack.org/227057 | 09:19 |
shardy | https://github.com/openstack/heat/blob/master/heat/engine/stack.py#L1431 | 09:20 |
shardy | https://github.com/openstack/heat/blob/master/heat/engine/resource.py#L1247 | 09:21 |
shardy | jprovazn: you could put a line of debug logging self.name in resource.py destroy() | 09:21 |
shardy | If the Compute ResourceGroup gets deleted before the ComputeNodesPostDeployment then we have a very bad heat bug | 09:22 |
* jprovazn adds | 09:22 | |
shardy | I'll be quite surprised if that's happening though, this is very well tested and old code | 09:22 |
* shardy prepares to be surprised anyway ;) | 09:22 | |
jprovazn | :) | 09:24 |
jprovazn | it will take ~10 mins - need to scale up first | 09:24 |
*** rlandy has joined #tripleo | 09:29 | |
jprovazn | shardy: http://paste.openstack.org/show/473842/ | 09:43 |
jprovazn | shardy: actually list is not complete some new are being added http://paste.openstack.org/show/473843/ | 09:44 |
*** mcornea has joined #tripleo | 09:45 | |
jprovazn | hm, maybe also logging uuid would be handy too | 09:45 |
*** dtantsur is now known as dtantsur|brb | 09:50 | |
*** akrivoka has quit IRC | 10:00 | |
*** akrivoka has joined #tripleo | 10:00 | |
*** paramite is now known as paramite|afk | 10:07 | |
openstackgerrit | Merged openstack/diskimage-builder: Install ironic-agent dependencies via package-installs https://review.openstack.org/221328 | 10:10 |
openstackgerrit | Merged openstack/diskimage-builder: ironic-agent: remove python object files https://review.openstack.org/221243 | 10:13 |
shardy | jprovazn: that's odd, I don't see either the ComputeNodesPostDeployment or Compute ResourceGroup in that list | 10:19 |
jprovazn | shardy: um, I delete *single* node only, not everything | 10:19 |
jprovazn | so ResourceGroup should probably not be there? | 10:20 |
shardy | jprovazn: So you're deleting one of the nested stacks inside the ResourceGroup manually? | 10:20 |
shardy | Oh, you're scaling down, sorry | 10:21 |
jprovazn | shardy: I'm deleting a node with "openstack overcloud node delete --templates ~/tht --stack overcloud d94a5356-8dbe-4cba-ad69-4350a453a64b" which runs stack-update with decreased ComputeCount and RemovalPolicy referring the single node | 10:21 |
jprovazn | yes | 10:21 |
jprovazn | shardy: in engine.log there are also all DependencyTaskGroup logs, though this is quite a long paste, would it help? | 10:23 |
shardy | jprovazn: oh! I think I see what is happening | 10:24 |
jprovazn | that sounds like a ray of light! | 10:25 |
shardy | So, the dependencies are reversed, because from the top-level stack perspective, this is an update, not a delete | 10:25 |
shardy | So, we first update the Compute Resource Group, which deletes a NovaCompute resource (line 64) | 10:25 |
shardy | Then, we see that the servers list has changed, so we update ComputeNodesPostDeployment | 10:26 |
shardy | which proceeds to delete the deployments associated with the server that's already been deleted | 10:26 |
shardy | So, the dependencies aren't respected when a ResourceGroup is combined with a dependent resource on scale-down, unless the dependent resource is also inside the resource group | 10:27 |
jprovazn | that sounds reasonable, except the last bit - I would expect that deployments are deleted before NovaCOmpute | 10:27 |
shardy | jprovazn: they are inside the ComputeNodesPostDeployment | 10:28 |
shardy | so the sequence is always 1. Update Compute ResourceGroup 2. Do Post-deployment config | 10:28 |
shardy | which is always the same, even if you scale down | 10:28 |
shardy | only, that's not what we want in this case | 10:28 |
jprovazn | yes | 10:29 |
jprovazn | though no idea how to fix this | 10:30 |
shardy | jprovazn: the fix is to move where the registration/unregistration happens | 10:30 |
shardy | It needs to be via ComputeExtraConfigPre and not a post-deploy action | 10:30 |
shardy | so it's inside the Compute ResourceGroup | 10:31 |
shardy | Or, we need an "AllNodesExtraConfigPre" interface | 10:31 |
shardy | I suppose we do actually, as there's no *Storage ExtraConfigPre interfaces atm | 10:33 |
jprovazn | AllNodesExtraConfigPre runs before all the puppet setup? | 10:34 |
shardy | jprovazn: the fact that it's hanging is a heat bug though - we should fail if the SoftwareDeployment attempts to update the metadata on a deleted Server resource ID | 10:34 |
shardy | jprovazn: yes | 10:34 |
jprovazn | shardy: I wonder if it's safe to assume that subscription passes in that stage (e.g. if networking setup is done) | 10:35 |
shardy | jprovazn: If we need registration to happen after that, we'll have to leave registration post-deploy and unregister inside e.g compute-puppet.yaml | 10:35 |
shardy | jprovazn: I'm not sure - perhaps the safest thing is to split it so we have rhel-registration post-deploy and rhel-unregistration (DELETE only) pre-deploy | 10:37 |
shardy | which, for DELETE only SoftwareDeployment really means "pre delete" not pre-deploy | 10:37 |
jprovazn | shardy: that sounds best to me | 10:37 |
jprovazn | shardy: thanks for explanation of this | 10:38 |
shardy | jprovazn: np, sorry it took a while to figure out ;) | 10:38 |
*** panda has quit IRC | 10:38 | |
shardy | jprovazn: are you happy to hack on the template changes or do you need a hand? | 10:38 |
*** panda has joined #tripleo | 10:38 | |
jprovazn | shardy: I suspect a hand would be very helpful | 10:39 |
shardy | jprovazn: let me quickly hack out the WIP of what I think needs to happen | 10:40 |
jprovazn | shardy: awesome, thanks! | 10:40 |
shardy | My test-env is broken atm so I can't test it until later tho | 10:40 |
shardy | Lokesh_Jain: ^^ that sounds like another use-case for the AllNodesExtraConfigPre we discussed yesterday | 10:43 |
*** apetrich has quit IRC | 10:48 | |
*** dtantsur|brb is now known as dtantsur | 10:53 | |
*** julim has joined #tripleo | 10:58 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Remove extra install of release pkgs in fedora-minimal https://review.openstack.org/227131 | 11:00 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Use --nodeps when installing fedora-release https://review.openstack.org/227123 | 11:00 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add basic Fedora 22 support to yum-minimal https://review.openstack.org/227125 | 11:00 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Move yum-based install into function https://review.openstack.org/227124 | 11:00 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Cleanup the fedora-minimal yum/dnf path https://review.openstack.org/227127 | 11:00 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Update default fedora-minimal to f22 https://review.openstack.org/227126 | 11:00 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Output failing lines when dib-lint finds wrong indents https://review.openstack.org/227223 | 11:01 |
openstackgerrit | Merged openstack/diskimage-builder: Remove dnf workaround in ironic-agent https://review.openstack.org/220546 | 11:01 |
openstackgerrit | Merged openstack/diskimage-builder: Remove dnf workaround in ironic-agent https://review.openstack.org/220546 | 11:01 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Remove extra install of release pkgs in fedora-minimal https://review.openstack.org/227131 | 11:04 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Output failing lines when dib-lint finds wrong indents https://review.openstack.org/227223 | 11:04 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Use --nodeps when installing fedora-release https://review.openstack.org/227123 | 11:04 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add basic Fedora 22 support to yum-minimal https://review.openstack.org/227125 | 11:04 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Move yum-based install into function https://review.openstack.org/227124 | 11:04 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Cleanup the fedora-minimal yum/dnf path https://review.openstack.org/227127 | 11:04 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Update default fedora-minimal to f22 https://review.openstack.org/227126 | 11:04 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Wire in AllNodesExtraConfigPre interface https://review.openstack.org/227225 | 11:05 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Move RHEL unregistration to AllNodesExtraConfigPre https://review.openstack.org/227226 | 11:05 |
shardy | jprovazn: ^^ something like that (untested atm) | 11:05 |
jprovazn | shardy: thanks, /me tries | 11:06 |
*** gfidente has quit IRC | 11:08 | |
derekh | Is it just me or is heat producing way to many logs in the HA ci job ? | 11:09 |
derekh | JOBLOGS ]$ wc heat-engine.log | 11:09 |
derekh | 302099 3328855 67386843 heat-engine.log | 11:09 |
derekh | heat-engine.log | 11:09 |
derekh | -rw-r--r--. 1 derekh derekh 65M Sep 24 07:53 heat-engine.log | 11:10 |
shardy | derekh: heat is noisy in debug mode, but wow.. | 11:11 |
derekh | shardy: we got 1000's of Registering .... lines | 11:12 |
derekh | JOBLOGS ]$ grep "Registering OS::TripleO::Controller" heat-engine.log | wc | 11:12 |
derekh | 50160 522458 11091991 | 11:12 |
shardy | derekh: Yeah, we can probably optimize that - we dump that information for every stack in the tree I think, when it should only be the parent | 11:13 |
derekh | shardy: ack, going to grab some lunch, I'll open a bug for it when I get back | 11:13 |
shardy | derekh: cool, thanks, I'm doing likewise but I'll look for a quick-fix after | 11:14 |
*** hashar has quit IRC | 11:15 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Remove test of project against buildable list https://review.openstack.org/226082 | 11:19 |
openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Add os-net-config to list of delorean.current https://review.openstack.org/226061 | 11:24 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: image build: prepare for different generation methods https://review.openstack.org/222540 | 11:30 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Install bigswitch networking plugin by default https://review.openstack.org/222312 | 11:32 |
*** w_ has joined #tripleo | 11:32 | |
*** olaph has quit IRC | 11:35 | |
*** paramite|afk is now known as paramite | 11:35 | |
*** olaph has joined #tripleo | 11:37 | |
*** w_ has quit IRC | 11:38 | |
*** rhallisey has joined #tripleo | 11:38 | |
*** weshay_xchat has joined #tripleo | 11:41 | |
*** stendulker has quit IRC | 11:44 | |
openstackgerrit | Jan Provaznik proposed openstack/tripleo-common: Fix wrong node count when deleting specific nodes https://review.openstack.org/226682 | 11:44 |
*** jtomasek has quit IRC | 11:46 | |
*** adrianopetrich has joined #tripleo | 11:47 | |
*** jtomasek has joined #tripleo | 11:47 | |
*** gfidente has joined #tripleo | 11:48 | |
*** gfidente has joined #tripleo | 11:48 | |
jprovazn | shardy: my cloud is now much happier - scaledown works. Well it was happier - deletion works too. Thanks! | 11:52 |
*** adrianopetrich has quit IRC | 11:54 | |
*** adrianopetrich has joined #tripleo | 11:59 | |
thrash | derekh: did slagle's patch work for the HA CI? | 11:59 |
derekh | thrash: yup, the HA job is failing again, mission accomplished slagle | 12:00 |
thrash | haha | 12:00 |
*** adrianopetrich has quit IRC | 12:01 | |
derekh | so we still gotta find out why its failing, it was legitimately passing last week I think, | 12:01 |
*** jdob has quit IRC | 12:01 | |
*** jayg|g0n3 is now known as jayg | 12:02 | |
*** jdob has joined #tripleo | 12:02 | |
*** jdob1 has joined #tripleo | 12:02 | |
*** jdob1 has quit IRC | 12:03 | |
openstackgerrit | Merged openstack/python-tripleoclient: image build: prepare for different generation methods https://review.openstack.org/222540 | 12:04 |
jprovazn | shardy: doh, taking back - I apparently did't have unregistration SWdeployment registered, additional change is required here: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_deploy.py#L383 :( | 12:05 |
* jprovazn tries again | 12:05 | |
slagle | my only goal is to make things fail the right way! | 12:07 |
pino|work | d0ugal: thanks | 12:08 |
*** thrash has quit IRC | 12:08 | |
*** dprince has joined #tripleo | 12:09 | |
*** thrash has joined #tripleo | 12:11 | |
*** thrash has joined #tripleo | 12:11 | |
derekh | shardy: https://bugs.launchpad.net/heat/+bug/1499330 | 12:12 |
openstack | Launchpad bug 1499330 in tripleo "Heat logs too big" [High,Triaged] | 12:12 |
*** adrianopetrich has joined #tripleo | 12:23 | |
*** trown|outttypeww is now known as trown | 12:23 | |
*** tzumainn has joined #tripleo | 12:23 | |
openstackgerrit | Dan Prince proposed openstack/tripleo-docs: Add os-net-config to delorean.current list https://review.openstack.org/227255 | 12:23 |
openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Add os-net-config to delorean.current list https://review.openstack.org/226061 | 12:24 |
trown | derekh: any chance you can +A https://review.openstack.org/#/c/210436/ it had it yesterday, but ironic gate was borked and I used depends on that patch to help verify the fix | 12:26 |
derekh | trown: done | 12:33 |
derekh | trown: well it will be in a second, gerrit is slooooooooow | 12:33 |
trown | so slow | 12:33 |
trown | derekh: thanks | 12:33 |
* trown hopes that whole chain will make it through this morning | 12:34 | |
trown | it is all +A, just need the gates to cooperate | 12:34 |
* derekh crosses fingers | 12:35 | |
*** masco_ has quit IRC | 12:39 | |
openstackgerrit | Dan Prince proposed openstack/tripleo-docs: Drop genconfig from tox.ini https://review.openstack.org/227269 | 12:40 |
*** spzala has joined #tripleo | 12:43 | |
*** rasca has quit IRC | 12:43 | |
*** ccard has joined #tripleo | 12:48 | |
ccard | I have a question about diskimage-builder (http://docs.openstack.org/developer/diskimage-builder/): Can I use diskimage-builder to take an existing CentOS 6.3 image (qcow2) and add some more packages to it? | 12:51 |
trown | ccard: ya that is one thing it can do | 12:52 |
trown | ccard: although virt-customize from libguestfs-tools can also do that a bit more simply | 12:53 |
trown | ccard: http://libguestfs.org/virt-customize.1.html | 12:53 |
ccard | trown: when I try I end up with an image that doesn't boot :( | 12:55 |
*** rasca has joined #tripleo | 12:56 | |
*** rpothier has joined #tripleo | 12:56 | |
trown | ccard: with virt-customize? | 12:56 |
shardy | d0ugal: Hey FYI I raised https://bugs.launchpad.net/tripleo/+bug/1499273 | 13:05 |
openstack | Launchpad bug 1499273 in tripleo "tripleoclient fails to create endpoints unless create works first-time" [Undecided,New] | 13:05 |
d0ugal | shardy: Thanks :) | 13:05 |
shardy | d0ugal: I was debugging an issue mdbooth ran into, and the root case was that | 13:06 |
shardy | I guess we can do some smarter check, like create endpoints if they're missing, which would make it safe to run the post-deploy stuff even it's an update | 13:06 |
*** larsks has quit IRC | 13:07 | |
ccard | trown: no, with diskimage-builder | 13:07 |
trown | ccard: ah, I would try with virt-customize ... that is what I use for small things like adding packages | 13:09 |
pino|work | ccard: diskimage-builder is not really meant for just editing an existing image | 13:10 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Translate ZUUL_CHANGES into DIB_REPOREF https://review.openstack.org/227276 | 13:10 |
pino|work | ccard: just use virt-customize and/or any other libguestfs tool (eg guestfish), which are generally better (safer for your system, and less intrusive) | 13:10 |
d0ugal | shardy: Yeah, that would make sense. It looks like thrash might be looking at re-working post deploy stuff anyway | 13:11 |
shardy | d0ugal: Ok, cool, sounds good | 13:11 |
ccard | trown: thanks, I'll try virt-customize | 13:13 |
openstackgerrit | Merged openstack/diskimage-builder: ironic-agent element to output a .kernel file https://review.openstack.org/210436 | 13:14 |
openstackgerrit | Shivanand Tendulker proposed openstack/diskimage-builder: Install 'gdisk' when building ramdisk with ironic-agent https://review.openstack.org/215095 | 13:14 |
openstackgerrit | Pino Toscano proposed openstack/python-tripleoclient: image build: add support for virt-dib https://review.openstack.org/222541 | 13:15 |
openstackgerrit | Pino Toscano proposed openstack/python-tripleoclient: image build: add ImageBuilder.build_ramdisk_agent https://review.openstack.org/227283 | 13:15 |
pino|work | trown: https://review.openstack.org/227283 | 13:15 |
openstackgerrit | Zhao Lei proposed openstack/tripleo-specs: Fix some spelling typo in manual https://review.openstack.org/227287 | 13:16 |
*** morazi has joined #tripleo | 13:16 | |
*** pradk has quit IRC | 13:17 | |
trown | pino|work: cool, I will give that a go, I am not familiar with virt-dib | 13:21 |
thrash | shardy: Someone had mentioned that there is puppet code to handle that. It makes sense to do it in puppet. | 13:21 |
pino|work | trown: this one i pointed you fixes a small messup that got created when merging a review of yours and one of mine | 13:21 |
pino|work | trown: and yours was without test! | 13:22 |
pino|work | ;) | 13:22 |
openstackgerrit | Ryan Hallisey proposed openstack/tripleo-heat-templates: Docker controller role configured via Puppet https://review.openstack.org/227295 | 13:22 |
trown | pino|work: ya that was put up in a bit of a hurry to try to get inspection back to working in our gate... it just didnt all merge in much of a hurry | 13:24 |
trown | pino|work: thanks for fixing it up | 13:24 |
slagle | is gerrit being slow just for me? | 13:24 |
trown | sooooo slow | 13:25 |
pino|work | slagle: no, and iirc somebody opened a thread about it in openstack-dev | 13:25 |
trown | it is not just you | 13:25 |
slagle | i see, thx | 13:25 |
pino|work | trown: np... feel free to take a look at it (& test too), should not break it | 13:25 |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Adds initial swift integration for plans (WIP) https://review.openstack.org/227297 | 13:25 |
trown | pino|work: ya, I will test it out and do a review | 13:26 |
pino|work | trown: merci merci :) | 13:26 |
trown | I think gerrit is getting worse with the US coming online | 13:34 |
pino|work | well, "US coming online" should also bring -infra people online | 13:35 |
*** pradk has joined #tripleo | 13:37 | |
derekh | Gerrit is mad fast again | 13:39 |
slagle | gave some more memory to the jvm | 13:40 |
* slagle makes stuff up | 13:41 | |
slagle | derekh: have a look at my review on https://review.openstack.org/#/c/227276 ... i think i made sense there | 13:41 |
derekh | slagle: looking | 13:42 |
*** jprovazn has quit IRC | 13:43 | |
derekh | slagle: yup, makes sense, I think we should probably remove the DIB_REPOREF_ from cherry-pick, when it hits DIB it acts more like a pin then a cherry-pick | 13:46 |
slagle | yea, indeed | 13:46 |
*** olaph has quit IRC | 13:46 | |
derekh | slagle: either that or FAIL if we try to set REPOREF a second time for the same project and we just say we don't currently support the case | 13:46 |
*** olaph has joined #tripleo | 13:47 | |
slagle | i think to handle this properly we need to somehow point the undercloud at the git repos under /opt/stack/new on the jenkins worker | 13:48 |
derekh | slagle: we might be able to get both cases to work together if we were to cherry-pick ontop of what zuul gives us and use file://.... | 13:48 |
slagle | isnt there a DIB_REPOLOCATION_ ? | 13:48 |
*** w_ has joined #tripleo | 13:48 | |
derekh | slagle: which is what you just saying now | 13:48 |
slagle | heh, ok | 13:49 |
openstackgerrit | Zhao Lei proposed openstack/tuskar-ui: Fix a little typo in manual https://review.openstack.org/227313 | 13:49 |
derekh | slagle: scp repo to undercloud ; DIB_REPOLOCATION=file:// ; go | 13:49 |
slagle | yea that sounds reasonable | 13:50 |
dprince | slagle, derekh: haven't been fully paying attention but would building images on the jenkins slave fix our issues? | 13:51 |
dprince | slagle, derekh: that is what I do locally... and would be my prefered workflow anyways | 13:51 |
derekh | dprince: it would make it easier, probably, but we are using F21 | 13:51 |
slagle | for the images it would, but not the undercloud install | 13:51 |
derekh | slagle: good point | 13:52 |
*** olaph has quit IRC | 13:52 | |
dprince | slagle: right, I run that on the instack VM of course | 13:52 |
*** lblanchard has joined #tripleo | 13:52 | |
*** w_ is now known as olaph | 13:52 | |
slagle | we have to have a least 1 ci job that tests building images on the undercloud, otherwise we'd need to document for people how to setup an "image building" system | 13:53 |
dprince | derekh: Fedora 22 builds the centos stuff fine | 13:53 |
derekh | dprince: I'm not sating it wont work, I'm saying we should CI what we are documenting | 13:53 |
derekh | *saying | 13:53 |
dprince | slagle: I'd be game for that. An image building system is a useful thing and a bit more optimized outside of the instack VM instead for local devs I think | 13:54 |
dprince | derekh: agree w/ matching the docs | 13:54 |
slagle | ok. as long as it's doc'd | 13:54 |
pino|work | ... so we could also plug alternatives ways to build images, than diskimage-builder | 13:55 |
* pino|work thinking loud | 13:55 | |
derekh | slagle: dprince Ok, so right now all our ci that is being triggered by puppet commits are not testing the commit, what do ye thing of merging my patch to make that sisuation better now (if it works) and I'll work on the REPOLOCATION thing ASAP | 13:56 |
dprince | derekh: in a pinch the old tripleo-incubator build system works great. Just ninja in tripleclient stuff and it should give you the bits | 13:57 |
dprince | derekh: re the puppet stuff, didn't puppet.env that I did a while back fix this? | 13:57 |
derekh | dprince: nope afraid not as DIB_REPOREF isn't being set for the puppet modules, thats what my patching is doing | 13:58 |
dprince | derekh: puppet.env was meant to expose the related DIB_ variables for the puppet modules to the in-vm instacl install process | 13:58 |
*** julim has quit IRC | 13:58 | |
dprince | derekh: oh, okay | 13:58 |
dprince | derekh: lets set it then | 13:58 |
dprince | derekh: patch? | 13:59 |
slagle | derekh: yea, sounds fine to me | 13:59 |
derekh | dprince: https://review.openstack.org/#/c/227276 | 13:59 |
derekh | slagle: dprince I'll double check the logs to make sure the puppet patch got included when ci is done | 13:59 |
dprince | derekh: ++, you've got the acks. Send away when CI is happy and you've verified | 14:00 |
dprince | derekh: pushing a puppet-* change or two that we know breaks something wouldn't be horrible | 14:01 |
dprince | derekh: we need to keep EmilienM on his toes | 14:02 |
*** spzala has quit IRC | 14:02 | |
EmilienM | dprince: ? | 14:02 |
dprince | EmilienM: carry on man. :) We just might push a bad puppet commit to test our CI is working | 14:04 |
EmilienM | dprince: our CI will BLOCK IT lol | 14:05 |
derekh | challenge accepted | 14:06 |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Adds initial swift integration for plans (WIP) https://review.openstack.org/227297 | 14:07 |
*** olaph has quit IRC | 14:10 | |
*** olaph has joined #tripleo | 14:11 | |
derekh | slagle: btw, I can build images with tripleo.sh by setting priority 1,2 and 3 on the repositories, now overcloud is failing to deploy, trying to figure out why | 14:12 |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Adds initial REST API service(WIP) https://review.openstack.org/227329 | 14:15 |
gfidente | spredzy, the systemuuid needed for the per_node thing, can we get that in advance when deploying on a fully virt environment? | 14:17 |
trown | pino|work: I am trying to rebase https://review.openstack.org/#/c/225929 on your fix up of the agent ramdisk build https://review.openstack.org/#/c/227283/ but it wont let me submit to gerrit (no changes made), do you know how to do that? | 14:18 |
spredzy | gfidente, in a call. Will check right after maybe in a virsh dominfo output | 14:18 |
pino|work | trown: i guess you should download mine, eg using git-review or manually, and rebase your commit on top of it | 14:19 |
trown | pino|work: ya that is what I have... http://fpaste.org/271037/31044201/ | 14:20 |
*** tosky has joined #tripleo | 14:20 | |
trown | I think I must be doing something noobish | 14:20 |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Adds initial swift integration for plans (WIP) https://review.openstack.org/227297 | 14:21 |
pino|work | i don't know, i never used git-review for pusing reviews :/ | 14:22 |
*** hashar has joined #tripleo | 14:22 | |
trown | pino|work: what do you use? | 14:23 |
pino|work | git push | 14:23 |
*** gfidente has quit IRC | 14:25 | |
pino|work | what does adding -v say? | 14:25 |
pino|work | trown: also, did you check the content of your commit? could it be that it accidentally reverts the changes done in mine? | 14:26 |
*** Goneri has joined #tripleo | 14:28 | |
*** rasca has quit IRC | 14:30 | |
openstackgerrit | John Trowbridge proposed openstack/python-tripleoclient: Build IPA in place of discoverd ramdisk https://review.openstack.org/225929 | 14:30 |
trown | pino|work: needed to do checkout rather than cherry-pick so the commit hash didnt change | 14:30 |
pino|work | aha | 14:30 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove Tuskar support https://review.openstack.org/223535 | 14:36 |
*** julim has joined #tripleo | 14:38 | |
*** panda has quit IRC | 14:38 | |
*** panda has joined #tripleo | 14:39 | |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Adds initial swift integration for plans (WIP) https://review.openstack.org/227297 | 14:39 |
*** tiswanso has joined #tripleo | 14:46 | |
openstackgerrit | Ryan Brown proposed openstack/python-tripleoclient: Consolidate module constants. https://review.openstack.org/225245 | 14:49 |
*** spzala has joined #tripleo | 14:50 | |
openstackgerrit | Ryan Brown proposed openstack/python-tripleoclient: Move more functions to utils.py https://review.openstack.org/225246 | 14:50 |
openstackgerrit | Ryan Brown proposed openstack/python-tripleoclient: Allow running postconfig outside deploy command https://review.openstack.org/225247 | 14:51 |
*** yamahata has quit IRC | 14:53 | |
*** spzala has left #tripleo | 14:56 | |
*** larsks has joined #tripleo | 14:58 | |
openstackgerrit | Ryan Brown proposed openstack/python-tripleoclient: Allow running postconfig outside deploy command https://review.openstack.org/225247 | 14:58 |
openstackgerrit | Ryan Brown proposed openstack/python-tripleoclient: Move more functions to utils.py https://review.openstack.org/225246 | 14:58 |
openstackgerrit | Ryan Brown proposed openstack/python-tripleoclient: Consolidate module constants. https://review.openstack.org/225245 | 14:58 |
openstackgerrit | Ryan Brown proposed openstack/python-tripleoclient: Move common functions out into utils.py https://review.openstack.org/225244 | 14:58 |
*** untriaged-bot has joined #tripleo | 15:00 | |
untriaged-bot | Untriaged bugs so far: | 15:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1499017 | 15:00 |
openstack | Launchpad bug 1499017 in tripleo "[instack-undercloud] Swift Ceilometer middleware no longer exists" [Undecided,In progress] - Assigned to John Trowbridge (trown) | 15:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1499273 | 15:00 |
openstack | Launchpad bug 1499273 in tripleo "tripleoclient fails to create endpoints unless create works first-time" [Undecided,New] - Assigned to Brad P. Crochet (brad-9) | 15:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1498845 | 15:00 |
openstack | Launchpad bug 1498845 in tripleo "Wrong node count can be passed to heat when deleting a specific node" [High,New] - Assigned to Jan Provaznik (jan-provaznik) | 15:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1499298 | 15:00 |
openstack | Launchpad bug 1499298 in tripleo "Installers should use pymysql db driver as of Liberty" [Undecided,New] | 15:00 |
*** untriaged-bot has quit IRC | 15:00 | |
*** lblanchard has quit IRC | 15:07 | |
*** lblanchard has joined #tripleo | 15:08 | |
*** aufi has quit IRC | 15:18 | |
*** dtantsur is now known as dtantsur|afk | 15:31 | |
*** adrianopetrich has quit IRC | 15:31 | |
*** lsmola has quit IRC | 15:32 | |
*** larsks has quit IRC | 15:37 | |
*** larsks has joined #tripleo | 15:38 | |
*** mcornea has quit IRC | 15:40 | |
*** trown is now known as trown|lunch | 15:43 | |
*** ifarkas has quit IRC | 15:43 | |
*** nijaba_ is now known as nijaba | 15:50 | |
*** weshay_xchat is now known as weshay | 16:04 | |
*** jaosorior has quit IRC | 16:05 | |
*** jaosorior has joined #tripleo | 16:06 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Translate ZUUL_CHANGES into DIB_REPOREF https://review.openstack.org/227276 | 16:06 |
derekh | slagle: dprince verifide it used the puppet module, remove the depends on and going to merge | 16:06 |
derekh | slagle: dprince *removed ^ | 16:07 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Translate ZUUL_CHANGES into DIB_REPOREF https://review.openstack.org/227276 | 16:09 |
*** derekh has quit IRC | 16:09 | |
*** alop has joined #tripleo | 16:09 | |
*** lucasagomes has quit IRC | 16:12 | |
*** hashar has quit IRC | 16:13 | |
*** yamahata has joined #tripleo | 16:21 | |
*** larstobi has quit IRC | 16:24 | |
*** kbyrne has quit IRC | 16:24 | |
*** kbyrne has joined #tripleo | 16:24 | |
*** larstobi has joined #tripleo | 16:24 | |
*** yog_ has quit IRC | 16:33 | |
*** olaph has quit IRC | 16:35 | |
*** olaph has joined #tripleo | 16:39 | |
*** alop has quit IRC | 16:43 | |
*** paramite has quit IRC | 16:45 | |
*** trown|lunch is now known as trown | 16:45 | |
*** shivrao has joined #tripleo | 16:53 | |
*** shivrao_ has joined #tripleo | 16:56 | |
*** hewbrocca has quit IRC | 16:56 | |
*** pradk has quit IRC | 16:57 | |
*** shivrao has quit IRC | 16:57 | |
*** akrivoka has quit IRC | 16:58 | |
*** leanderthal has quit IRC | 16:59 | |
*** shivrao_ has quit IRC | 17:01 | |
*** shivrao has joined #tripleo | 17:08 | |
*** mcornea has joined #tripleo | 17:09 | |
*** penick has joined #tripleo | 17:11 | |
*** mcornea has quit IRC | 17:16 | |
*** larsks has quit IRC | 17:18 | |
*** jdob has quit IRC | 17:41 | |
*** jdob has joined #tripleo | 17:42 | |
*** tosky has quit IRC | 17:46 | |
*** jdob has quit IRC | 17:48 | |
*** jdob has joined #tripleo | 17:48 | |
*** Marga_ has quit IRC | 17:50 | |
*** adrianopetrich has joined #tripleo | 17:51 | |
*** jprovazn has joined #tripleo | 17:57 | |
*** athomas has quit IRC | 18:04 | |
*** tiswanso has quit IRC | 18:05 | |
openstackgerrit | Merged openstack/os-cloud-config: Updated from global requirements https://review.openstack.org/193997 | 18:05 |
*** penick has quit IRC | 18:10 | |
*** penick has joined #tripleo | 18:11 | |
*** jdob has quit IRC | 18:12 | |
*** jdob has joined #tripleo | 18:13 | |
*** jdob has quit IRC | 18:13 | |
*** jdob has joined #tripleo | 18:14 | |
*** pelix has quit IRC | 18:14 | |
*** tiswanso has joined #tripleo | 18:15 | |
*** trown has quit IRC | 18:23 | |
*** athomas has joined #tripleo | 18:29 | |
*** Marga_ has joined #tripleo | 18:31 | |
*** hashar has joined #tripleo | 18:32 | |
*** trown has joined #tripleo | 18:36 | |
*** bdx has joined #tripleo | 18:38 | |
bdx | hows it going everyone?? | 18:39 |
bdx | Does anyone know how to use DIB to provision initial ubuntu user pw in trusty cloudimg? | 18:39 |
*** Marga_ has quit IRC | 18:40 | |
*** Marga_ has joined #tripleo | 18:40 | |
*** athomas has quit IRC | 18:42 | |
*** alop has joined #tripleo | 18:51 | |
*** panda has quit IRC | 19:00 | |
*** panda has joined #tripleo | 19:00 | |
openstackgerrit | Merged openstack/os-net-config: os-net-config: ensure ifup is called just once https://review.openstack.org/213746 | 19:05 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: controller/ceilometer: use internalURL for os endpoint type https://review.openstack.org/225999 | 19:09 |
*** dprince has quit IRC | 19:10 | |
*** penick has quit IRC | 19:30 | |
*** jobewan has joined #tripleo | 19:30 | |
*** penick has joined #tripleo | 19:33 | |
*** bnemec has quit IRC | 19:34 | |
*** jayg is now known as jayg|g0n3 | 19:58 | |
*** weshay has quit IRC | 20:01 | |
*** weshay_xchat has joined #tripleo | 20:06 | |
*** weshay_xchat is now known as weshay | 20:08 | |
*** absubram has joined #tripleo | 20:08 | |
*** jaosorior has quit IRC | 20:10 | |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates: Add Management Network For System Administration. https://review.openstack.org/226057 | 20:10 |
*** jaosorior has joined #tripleo | 20:12 | |
absubram | hi all.. is there a way to debug the ControllerNodesPostDeployment resource? | 20:12 |
absubram | for some reason.. my overcloud control node seems to be stuck in the create_in_progress state.. | 20:13 |
absubram | I see the hieradata being created.. but it looks like puppet is not deploying.. and I’m unsure of what went wrong or how to procedd.. any thoughts? thanks! | 20:13 |
slagle | absubram: that is a nested stack, so you can keep doing a heat resource-list on the physical_resource_id shown in the resource-list output until you see the actual SoftwareDeployment resource that is failing | 20:14 |
slagle | absubram: this blog post explains it better than I can: http://hardysteven.blogspot.com/2015/04/debugging-tripleo-heat-templates.html | 20:15 |
absubram | ah.. ty siagle.. I’ve seen the blog post.. didn’t realize I could use resource-list with the physical_resource_id | 20:15 |
absubram | will try that.. ty! | 20:15 |
slagle | absubram: this script also shows to query it programatically as well: https://review.openstack.org/#/c/207863 | 20:17 |
slagle | the output from deployment-show is going to show how puppet failed (hopefully) | 20:18 |
slagle | if it doesn't, then something else failed along the way | 20:18 |
absubram | slagle: very cool! will try that also.. ty! :) | 20:19 |
absubram | [stack@merc-control-2 ~]$ heat resource-list ba36fa62-da90-47aa-b733-afcfa7f65168 | 20:21 |
absubram | +----------------------------+----------------------+--------------------------+--------------------+----------------------+ | 20:21 |
absubram | | resource_name | physical_resource_id | resource_type | resource_status | updated_time | | 20:21 |
absubram | +----------------------------+----------------------+--------------------------+--------------------+----------------------+ | 20:21 |
absubram | | ControllerPuppetConfigImpl | | OS::Heat::SoftwareConfig | CREATE_IN_PROGRESS | 2015-09-24T18:40:27Z | | 20:21 |
absubram | +----------------------------+----------------------+--------------------------+--------------------+----------------------+ | 20:21 |
absubram | that’s the last iteration of resource-list I am able to get to.. before running out of a physical_id | 20:21 |
absubram | ControllerPuppetConfigImpl | | OS::Heat::SoftwareConfig | CREATE_IN_PROGRESS | 20:21 |
absubram | that resource is presumably the one that’s having trouble? | 20:22 |
*** jprovazn has quit IRC | 20:22 | |
absubram | slagle: if I patch your diff.. I only have to redploy the overloucd yes? don’t have to change anything on the undercloud side? | 20:24 |
*** bnemec has joined #tripleo | 20:24 | |
slagle | that's just a script you'd run to help get the debug output, there's no redeploy needed | 20:26 |
slagle | if you go up one stack above ba36fa62-da90-47aa-b733-afcfa7f65168, what's the output? can you pastebin? | 20:27 |
tiswanso | absubram, slagle: I'm working with absubram... the problem is the the deployment resource isn't getting created (no physical_resource_id) | 20:27 |
tiswanso | http://paste.openstack.org/show/473947/ | 20:28 |
*** trown is now known as trown|outttypeww | 20:28 | |
absubram | thanks Tim :) | 20:28 |
absubram | http://paste.openstack.org/show/473948/ | 20:28 |
tiswanso | slagle, absubram: sorry the SoftwareConfig resource isn't getting resource ID | 20:29 |
tiswanso | ^^ ControllerPuppetConfigImpl | 20:29 |
absubram | right | 20:29 |
tiswanso | slagle: on the controller node puppet apply isn't started -- no manifest is pushed down into /var/lib/heat-config/... | 20:30 |
*** rlandy has quit IRC | 20:30 | |
* tiswanso need to run & herd a bunch of 6yr-olds around a soccer field | 20:31 | |
absubram | later Tim.. thanks! | 20:32 |
tiswanso | absubram: will ping later | 20:32 |
*** tiswanso has quit IRC | 20:32 | |
slagle | absubram: can you paste, heat resource-list 63fc3c00-be01-47a2-b6f0-485bedcb3713 | 20:33 |
absubram | slagle - it’s at http://paste.openstack.org/show/473948/ | 20:33 |
absubram | further down in the page | 20:34 |
slagle | ah, sorry missed that | 20:34 |
absubram | np :) | 20:34 |
jdob | absubram: where did you get the overcloud image from? | 20:42 |
openstackgerrit | Merged openstack/tripleo-incubator: Add undercloud-debug script https://review.openstack.org/207863 | 20:43 |
absubram | jdob: it’s an overcloud image that one of my teammates created for the rest of us.. includes rpms for Cisco plugins and such | 20:44 |
absubram | it seems to work in another testbed setup that we have | 20:44 |
jdob | have you ever successfully deployed it? | 20:44 |
jdob | gotcha | 20:44 |
jdob | reason I was asking is because the only time I've ever seen a deployment completely hang like that was when the puppet modules weren't installed on the image | 20:44 |
jdob | are you using the same templates/env as that testbed? | 20:45 |
absubram | ah | 20:45 |
absubram | yes I believe so.. but I’ll double check on that.. ty! | 20:45 |
*** lucasagomes has joined #tripleo | 20:54 | |
*** untriaged-bot has joined #tripleo | 21:00 | |
untriaged-bot | Untriaged bugs so far: | 21:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1499017 | 21:00 |
openstack | Launchpad bug 1499017 in tripleo "[instack-undercloud] Swift Ceilometer middleware no longer exists" [Undecided,In progress] - Assigned to John Trowbridge (trown) | 21:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1499273 | 21:00 |
openstack | Launchpad bug 1499273 in tripleo "tripleoclient fails to create endpoints unless create works first-time" [Undecided,New] - Assigned to Brad P. Crochet (brad-9) | 21:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1498845 | 21:00 |
openstack | Launchpad bug 1498845 in tripleo "Wrong node count can be passed to heat when deleting a specific node" [High,New] - Assigned to Jan Provaznik (jan-provaznik) | 21:00 |
untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1499298 | 21:00 |
openstack | Launchpad bug 1499298 in tripleo "Installers should use pymysql db driver as of Liberty" [Undecided,New] | 21:00 |
*** untriaged-bot has quit IRC | 21:00 | |
*** lblanchard has quit IRC | 21:00 | |
openstackgerrit | Ryan Hallisey proposed openstack/tripleo-heat-templates: Docker compute role configured via Puppet https://review.openstack.org/209505 | 21:03 |
openstackgerrit | Ryan Hallisey proposed openstack/tripleo-heat-templates: Docker controller role configured via Puppet https://review.openstack.org/227295 | 21:03 |
zaneb | absubram: I'd suggest sshing in to the controller node and tailing the puppet logs to find out why its taking forever | 21:04 |
*** rhallisey has quit IRC | 21:04 | |
absubram | zaneb: ty.. which are the puppet logs? I normally do a sudo journalctl | grep puppet | 21:06 |
absubram | is there anything else that I can look at? | 21:06 |
*** yamahata has quit IRC | 21:06 | |
absubram | haven’t been able to find anything untoward otherwise | 21:06 |
zaneb | ah, a puppet question | 21:06 |
* zaneb flees | 21:06 | |
absubram | lol | 21:06 |
*** spzala has joined #tripleo | 21:07 | |
mburned | absubram: i think it's os-apply-config logs, but EmilienM is the puppet guy... | 21:08 |
absubram | gotcha.. thanks! | 21:09 |
*** rpothier has quit IRC | 21:10 | |
*** weshay has quit IRC | 21:16 | |
*** hashar has quit IRC | 21:16 | |
*** shardy has quit IRC | 21:16 | |
EmilienM | mburned: am I ? | 21:17 |
mburned | EmilienM: last i checked... | 21:17 |
EmilienM | damn | 21:17 |
*** derekh has joined #tripleo | 21:21 | |
derekh | bnemec: mind if I rebase your fix to cherry-pick patch, I want to add puppet support untop of it | 21:22 |
bnemec | derekh: Nope, go for it. | 21:23 |
*** absubram is now known as absubram_afk | 21:23 | |
derekh | bnemec: cool, thanks | 21:26 |
*** Goneri has quit IRC | 21:32 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Remove puppet-glance cherry-pick https://review.openstack.org/222107 | 21:33 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Fix cherry-pick syntax https://review.openstack.org/225342 | 21:33 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Better repo manipulation tools https://review.openstack.org/227563 | 21:33 |
*** thrash is now known as thrash|g0ne | 21:41 | |
*** derekh has quit IRC | 21:43 | |
*** rwsu has quit IRC | 21:56 | |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates: Add Management Network For System Administration. https://review.openstack.org/226057 | 21:59 |
*** rwsu has joined #tripleo | 22:03 | |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Adds initial swift integration for plans (WIP) https://review.openstack.org/227297 | 22:06 |
openstackgerrit | Merged openstack/tripleo-docs: Add os-net-config to delorean.current list https://review.openstack.org/227255 | 22:17 |
*** absubram_afk has quit IRC | 22:32 | |
*** penick has quit IRC | 22:40 | |
*** pino|work_ has joined #tripleo | 22:45 | |
*** pino|work has quit IRC | 22:48 | |
*** Goneri has joined #tripleo | 22:51 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Better repo manipulation tools https://review.openstack.org/227563 | 22:59 |
*** morazi has quit IRC | 23:05 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Better repo manipulation tools https://review.openstack.org/227563 | 23:11 |
*** jpeeler has quit IRC | 23:16 | |
*** shivrao has quit IRC | 23:33 | |
*** shivrao has joined #tripleo | 23:35 | |
*** jobewan has quit IRC | 23:36 | |
*** sthillma has joined #tripleo | 23:38 | |
*** lucasagomes has quit IRC | 23:38 | |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates: Add Management Network For System Administration. https://review.openstack.org/226057 | 23:49 |
*** shivrao has quit IRC | 23:56 | |
*** BadCub has quit IRC | 23:56 | |
*** dsneddon has quit IRC | 23:56 | |
*** tzumainn has quit IRC | 23:57 | |
*** gus has quit IRC | 23:57 | |
*** davidlenwell has quit IRC | 23:57 | |
*** davidlenwell has joined #tripleo | 23:58 | |
*** ChanServ sets mode: +v davidlenwell | 23:58 | |
*** tzumainn has joined #tripleo | 23:58 | |
*** gus has joined #tripleo | 23:59 | |
openstackgerrit | James Slagle proposed openstack/tripleo-image-elements: Enable delorean-deps on el7 https://review.openstack.org/227600 | 23:59 |
*** dsneddon has joined #tripleo | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!