| *** dmacpher has quit IRC | 00:13 | |
| *** eil397 has quit IRC | 00:27 | |
| jidar | {get_attr: [Compute, hosts_entry]} doesn't work either | 00:33 |
|---|---|---|
| * jidar groans | 00:33 | |
| *** rpothier has quit IRC | 00:58 | |
| *** dmacpher has joined #tripleo | 01:05 | |
| *** rbrady has quit IRC | 01:09 | |
| *** rbrady has joined #tripleo | 01:10 | |
| *** weshay_xchat has joined #tripleo | 01:14 | |
| *** rbrady has quit IRC | 01:18 | |
| *** rbrady has joined #tripleo | 01:20 | |
| *** tiswanso has quit IRC | 01:38 | |
| *** weshay_xchat has quit IRC | 02:02 | |
| openstackgerrit | Colleen Murphy proposed openstack/diskimage-builder: Add --version option to disk-image-create https://review.openstack.org/277658 | 02:07 |
| *** shivrao has quit IRC | 02:11 | |
| *** tiswanso has joined #tripleo | 02:14 | |
| jidar | >Note The OS::TripleO::NodeExtraConfigPost applies configuration to all nodes, there is currently no per-role NodeExtraConfigPost interface. | 02:14 |
| jidar | :( :( :( :( | 02:14 |
| *** thrash is now known as thrash|g0ne | 02:22 | |
| *** sthillma has quit IRC | 02:30 | |
| *** Marga_ has quit IRC | 02:30 | |
| *** Marga_ has joined #tripleo | 02:34 | |
| *** Marga_ has quit IRC | 02:40 | |
| *** rhallisey has quit IRC | 02:52 | |
| *** sbalukoff has quit IRC | 03:00 | |
| *** lblanchard has quit IRC | 03:26 | |
| *** panda has quit IRC | 03:37 | |
| *** panda has joined #tripleo | 03:37 | |
| *** links has joined #tripleo | 03:41 | |
| *** cwolferh has quit IRC | 03:54 | |
| *** Marga_ has joined #tripleo | 03:54 | |
| *** cwolferh has joined #tripleo | 04:08 | |
| *** rlandy has quit IRC | 04:09 | |
| *** cwolferh has quit IRC | 04:11 | |
| *** cwolferh has joined #tripleo | 04:12 | |
| *** ayoung has quit IRC | 04:15 | |
| *** dshulyak has joined #tripleo | 04:24 | |
| *** dshulyak has quit IRC | 04:27 | |
| *** sbalukoff has joined #tripleo | 04:30 | |
| *** tiswanso has quit IRC | 04:30 | |
| *** tzumainn has quit IRC | 05:08 | |
| *** masco has joined #tripleo | 05:09 | |
| *** rbrady has quit IRC | 05:13 | |
| *** rbrady has joined #tripleo | 05:13 | |
| *** rbrady has quit IRC | 05:18 | |
| openstackgerrit | Graeme Gillies proposed openstack/instack-undercloud: Added a new element to configure ansible inventory from nova https://review.openstack.org/277688 | 05:21 |
| *** Marga_ has quit IRC | 05:24 | |
| *** cwolferh has quit IRC | 05:27 | |
| *** jtomasek has quit IRC | 05:32 | |
| *** ukalifon has joined #tripleo | 05:34 | |
| *** ukalifon has quit IRC | 05:40 | |
| *** ukalifon1 has joined #tripleo | 05:40 | |
| *** ukalifon2 has joined #tripleo | 05:41 | |
| *** ukalifon2 has quit IRC | 05:41 | |
| *** ukalifon1 has quit IRC | 05:41 | |
| *** ukalifon has joined #tripleo | 05:41 | |
| *** anande has joined #tripleo | 05:45 | |
| *** anande has quit IRC | 05:46 | |
| *** NobodyCam has quit IRC | 05:48 | |
| *** dmacpher has quit IRC | 05:50 | |
| *** NobodyCam has joined #tripleo | 05:50 | |
| *** cwolferh has joined #tripleo | 05:58 | |
| *** Marga_ has joined #tripleo | 06:06 | |
| *** dcain has quit IRC | 06:07 | |
| *** ukalifon has quit IRC | 06:21 | |
| *** cwolferh has quit IRC | 06:33 | |
| *** ukalifon has joined #tripleo | 06:48 | |
| *** jprovazn has joined #tripleo | 06:51 | |
| *** jprovazn has quit IRC | 06:52 | |
| *** jprovazn has joined #tripleo | 06:52 | |
| *** cwolferh has joined #tripleo | 06:59 | |
| *** ukalifon has quit IRC | 07:13 | |
| *** shivrao has joined #tripleo | 07:37 | |
| *** panda has quit IRC | 07:37 | |
| *** panda has joined #tripleo | 07:37 | |
| *** jtomasek__ has quit IRC | 07:38 | |
| *** athomas has joined #tripleo | 07:40 | |
| *** shivrao has quit IRC | 07:46 | |
| *** hjensas has joined #tripleo | 07:55 | |
| *** hjensas has quit IRC | 07:55 | |
| *** hjensas has joined #tripleo | 07:55 | |
| *** jcoufal has joined #tripleo | 07:59 | |
| *** liverpooler has joined #tripleo | 08:03 | |
| *** aufi has joined #tripleo | 08:06 | |
| *** fgimenez has joined #tripleo | 08:11 | |
| *** fgimenez has quit IRC | 08:11 | |
| *** fgimenez has joined #tripleo | 08:11 | |
| *** oshvartz has joined #tripleo | 08:11 | |
| *** pblaho has joined #tripleo | 08:11 | |
| *** ukalifon1 has joined #tripleo | 08:17 | |
| *** mkovacik has joined #tripleo | 08:24 | |
| *** shardy has joined #tripleo | 08:30 | |
| *** devvesa has joined #tripleo | 08:35 | |
| *** jaosorior has joined #tripleo | 08:37 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Create linux bridge vlans environments https://review.openstack.org/270205 | 08:50 |
| jaosorior | yay, I see the CI is working again! :D though there are so many jobs pending that it'll take a while to get back to business | 08:52 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Fix MidoNet errors https://review.openstack.org/270207 | 08:52 |
| shardy | jaosorior: actually those two had passes from before the most recent breakage | 08:53 |
| jaosorior | shardy: Yeah, I actually went to check | 08:53 |
| shardy | cistatus looks a bit more healthy | 08:53 |
| jaosorior | shardy: Though it seems to me that CI is broken in another way now, since a lot of the new ones have failures | 08:53 |
| shardy | jaosorior: ah, cool, yeah it looks like things are at least running again now :) | 08:53 |
| openstackgerrit | Jaume Devesa proposed openstack/tripleo-heat-templates: Create linux bridge vlans environments https://review.openstack.org/277738 | 08:53 |
| jaosorior | so there is the mongodb issue which I was trying to fix, and now another failure... :( | 08:53 |
| * shardy sighs | 08:54 | |
| jaosorior | shardy, anyway, still in Brno? | 08:54 |
| shardy | jaosorior: No, I'm back home now, and you? | 08:54 |
| jaosorior | still here | 08:54 |
| jaosorior | I leave tomorrow | 08:54 |
| *** morazi has joined #tripleo | 08:58 | |
| *** mbound has joined #tripleo | 08:59 | |
| openstackgerrit | Jaume Devesa proposed openstack/tripleo-heat-templates: Fix MidoNet errors https://review.openstack.org/277742 | 09:02 |
| *** jaosorior has quit IRC | 09:03 | |
| *** jaosorior has joined #tripleo | 09:08 | |
| *** jaosorior has quit IRC | 09:08 | |
| *** jaosorior has joined #tripleo | 09:09 | |
| *** lucas-dinner is now known as lucasagomes | 09:10 | |
| jaosorior | shardy: So the tests are failing with something like this http://logs.openstack.org/88/268288/3/check-tripleo/gate-tripleo-ci-f22-ha/2d11ca3/console.html#_2016-02-09_01_52_13_115 | 09:16 |
| jaosorior | shardy: Are we using v3 yet? It seems that the neutronclient tries to access keystone through the v3 API and gets a NotFound error there | 09:18 |
| *** ifarkas has joined #tripleo | 09:19 | |
| shardy | jaosorior: yes there have been various patches moving things over to v3, but I assume we won't have landed any without passing CI | 09:21 |
| jaosorior | shardy: Well, the CI has been out since before Friday, so it might have been something that merged from friday until today :/ | 09:22 |
| shardy | I just meant, if we've broken things I'd have never expected CI to pass | 09:25 |
| jaosorior | shardy: the puppet modules are built from git, right? | 09:26 |
| shardy | yeah, something changing there is a likely candidate | 09:27 |
| jaosorior | shardy: Can I rebuild the overcloud images with the latest puppte manifests using tripleo.sh? | 09:28 |
| shardy | jaosorior: yes, just re-run tripleo.sh --overcloud-images | 09:28 |
| jaosorior | shardy: Thanks dude | 09:28 |
| shardy | https://github.com/openstack/puppet-nova/commit/d09868a59c451932d67c66101b725182d7066a14 | 09:29 |
| shardy | that looks likely to be related | 09:29 |
| shardy | I'll propose a pin to test | 09:29 |
| shardy | EmilienM: ^^ FYI when you wake up | 09:29 |
| jaosorior | shardy: that looks like it could be it | 09:30 |
| jaosorior | shardy: Well, i rant he tripleo.sh with --overcloud-images and all I got is that the images are up to date | 09:30 |
| shardy | jaosorior: you can remove the existing image first | 09:31 |
| jaosorior | shardy: overcloud-full.qcow2? | 09:33 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-common: Pin puppet-nova https://review.openstack.org/277756 | 09:39 |
| *** derekh has joined #tripleo | 09:39 | |
| *** dtantsur|afk is now known as dtantsur | 09:42 | |
| jaosorior | shardy: Nice, hopefully that does the trick for now. Though I suspect we need to finally ditch the setting up of keystone endpoints through os-cloud-config in order to take that patch into use | 09:43 |
| dtantsur | morning folks! is "ha" job still down or should I recheck things? | 09:44 |
| shardy | dtantsur: we're waiting to see if https://review.openstack.org/277756 fixes the latest breakage from puppet-nova | 09:45 |
| jaosorior | dtantsur: The now all jobs are broken | 09:45 |
| jaosorior | dtantsur: And I think HA will be still broken | 09:45 |
| shardy | Yeah, I'd delay rechecking until we see the results of that | 09:45 |
| dtantsur | got it, thanks | 09:45 |
| jaosorior | I have a patch trying to fix the HA job, but the CI had an outage in the weekend. But aparently dprince and derekh fixed it :D | 09:46 |
| derekh | jaosorior: the cloud is back running as of last night | 09:47 |
| jaosorior | derekh: I noticed, thanks dude! | 09:47 |
| *** mbound has quit IRC | 09:47 | |
| derekh | looks like both ha and nonha are failing now though | 09:47 |
| jaosorior | derekh: and ceph too. That is what shardy is trying to address in this CR https://review.openstack.org/277756 | 09:48 |
| derekh | jaosorior: ^^ so we probably now have 2 problems | 09:48 |
| derekh | jaosorior: ack | 09:48 |
| derekh | jaosorior: will check back when the job is finished | 09:48 |
| *** fgimenez has left #tripleo | 09:49 | |
| jaosorior | derekh: would it be possible to get an overview at some point on how the CI nodes are working and such? If an outage happens like the one from this weekend, I would also like to be able to help | 09:49 |
| derekh | jaosorior: sure, I put some info in an email a while back I'll dig it up later and point you at it | 09:50 |
| jaosorior | derekh: Thanks | 09:50 |
| *** NobodyCam has quit IRC | 09:52 | |
| *** mbound has joined #tripleo | 09:55 | |
| *** tosky has joined #tripleo | 09:59 | |
| *** NobodyCam has joined #tripleo | 09:59 | |
| *** jtomasek__ has joined #tripleo | 10:10 | |
| *** jtomasek__ has quit IRC | 10:10 | |
| *** jtomasek has joined #tripleo | 10:11 | |
| *** Marga_ has quit IRC | 10:12 | |
| *** mcornea has joined #tripleo | 10:13 | |
| jaosorior | shardy: So I think I did it wrong when rebuilding the images... since the controller creation actually passed in my deployment :/ | 10:15 |
| *** gfidente has joined #tripleo | 10:15 | |
| jaosorior | damn, I think I needed to rebuild the undercloud in order to reproduce the error | 10:17 |
| *** electrofelix has joined #tripleo | 10:18 | |
| *** r-mibu has quit IRC | 10:20 | |
| *** r-mibu has joined #tripleo | 10:21 | |
| *** jaosorior has quit IRC | 10:29 | |
| *** jaosorior has joined #tripleo | 10:29 | |
| *** deva_ has joined #tripleo | 10:30 | |
| *** NobodyCa1 has joined #tripleo | 10:33 | |
| jaosorior | alright, the same error occurs for the VMs created by the overcloud | 10:36 |
| *** NobodyCa1 has quit IRC | 10:38 | |
| *** deva_ has quit IRC | 10:38 | |
| *** mgould has joined #tripleo | 10:49 | |
| *** dprince has joined #tripleo | 10:52 | |
| *** weshay_xchat has joined #tripleo | 10:55 | |
| *** ukalifon1 has quit IRC | 10:57 | |
| *** mbound has quit IRC | 11:02 | |
| *** mbound has joined #tripleo | 11:15 | |
| *** ukalifon1 has joined #tripleo | 11:22 | |
| *** shardy has quit IRC | 11:34 | |
| *** shardy has joined #tripleo | 11:36 | |
| *** panda has quit IRC | 11:37 | |
| *** panda has joined #tripleo | 11:38 | |
| *** jcoufal has quit IRC | 11:38 | |
| EmilienM | shardy: yeah I'm sorry if this patch annoys you | 11:53 |
| EmilienM | shardy: dmsimard is working on a patch in THT and we also need to patch undercloud | 11:53 |
| EmilienM | the problem is this patch is required for the recent nova in mitaka | 11:53 |
| EmilienM | it broke our CI (when running trunk) | 11:53 |
| EmilienM | shardy: we need https://review.openstack.org/#/c/276790/ | 11:54 |
| EmilienM | but CI is failing | 11:55 |
| shardy | EmilienM: Ok, np, I've proposed a temporary pin via https://review.openstack.org/#/c/277756/ | 11:57 |
| shardy | waiting on CI to prove that works around the issue | 11:57 |
| EmilienM | shardy: awesome, it will let us the time to patch tripleo | 11:57 |
| EmilienM | shardy: sorry for the breakage... the patch was supposed to be backward compatible at some point | 11:58 |
| *** trown has joined #tripleo | 11:58 | |
| EmilienM | shardy: I'll take care of this today and make sure we go back on puppet-nova master | 11:59 |
| shardy | EmilienM: great, thanks! :) | 11:59 |
| *** trown has quit IRC | 11:59 | |
| *** ukalifon1 has quit IRC | 12:00 | |
| *** trown has joined #tripleo | 12:00 | |
| *** trown is now known as trown|outtypewww | 12:02 | |
| *** lucasagomes is now known as lucas-hungry | 12:13 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Remove all 'validate_array' statements https://review.openstack.org/267474 | 12:14 |
| dprince | derekh, shardy do we know the cause of the java.io.IOException: Unexpected termination of the channel? | 12:25 |
| dprince | in CI | 12:25 |
| shardy | dprince: Not seen that one yet - I was looking at the nova/neutron NotFound error ref https://review.openstack.org/#/c/277756/ | 12:26 |
| derekh | dprince: havn't been looking, trying to reproduce something else here, normally that is an interuption in communication between jenkins and the nodes | 12:26 |
| shardy | dprince: CI jobs were broken over the weekend tho, I'm not yet sure what the solution was | 12:26 |
| dprince | shardy: there was an overcloud controller issue derekh fixed yesterday | 12:26 |
| dprince | shardy: but this java.io exception is new from the hudson/jenkins slave it appears | 12:27 |
| *** Goneri has joined #tripleo | 12:27 | |
| derekh | dprince: historically I don't think that particular problem has been a problem with the cloud, jenkins could have been rebooted or something, is it still happening? | 12:27 |
| dprince | derekh: I've seen a couple | 12:27 |
| *** dmacpher has joined #tripleo | 12:29 | |
| derekh | dprince: They mentioned yesterday something about switching links in the data center, I wonder if its still ongoing ... just a theory | 12:33 |
| dprince | derekh: not sure, we'll just have to ask | 12:35 |
| jaosorior | shardy: From what I see it seems that the nova/neutron NotFound error is due to a wrong keystone configuration | 12:36 |
| openstackgerrit | Miles Gould proposed openstack/python-tripleoclient: Use Ironic API v1.11 to support ENROLL state https://review.openstack.org/272206 | 12:36 |
| openstackgerrit | Miles Gould proposed openstack/python-tripleoclient: Remove tripleoclient.baremetal wrapper https://review.openstack.org/265336 | 12:36 |
| jaosorior | where the auth_url is set to keystone_endpoint/v2.0 while the plugin to be used is already set as v3password, which will fail | 12:37 |
| jaosorior | so I've been manually changing the configuration to see what works | 12:37 |
| EmilienM | shardy: http://logs.openstack.org/90/276790/4/check-tripleo/gate-tripleo-ci-f22-nonha/dc068b3/console.html#_2016-02-08_23_04_33_475 | 12:38 |
| EmilienM | it means your version of nova does not contain the change we had to make our CI passing | 12:38 |
| EmilienM | do you pin nova? if yes, to which commit? | 12:38 |
| *** openstackgerrit_ has joined #tripleo | 12:38 | |
| jaosorior | EmilienM: Which commit did you use to make CI pass? | 12:43 |
| *** jcoufal has joined #tripleo | 12:44 | |
| *** marcusvrn_ has joined #tripleo | 12:44 | |
| EmilienM | jaosorior: I don't know exactly but a very recent, maybe 4 or 5 days | 12:44 |
| jaosorior | EmilienM: Did you mean this one? https://github.com/openstack/puppet-nova/commit/d09868a59c451932d67c66101b725182d7066a14 | 12:45 |
| EmilienM | jaosorior: no... In Nova itself ;-) | 12:45 |
| jaosorior | EmilienM: I see | 12:46 |
| *** rlandy has joined #tripleo | 12:54 | |
| *** Marga_ has joined #tripleo | 12:55 | |
| *** thrash|g0ne is now known as thrash | 12:57 | |
| *** trown|outtypewww is now known as trown | 12:58 | |
| *** masco has quit IRC | 13:01 | |
| *** dshulyak has joined #tripleo | 13:02 | |
| *** lucas-hungry is now known as lucasagomes | 13:07 | |
| *** jayg|g0n3 is now known as jayg | 13:12 | |
| EmilienM | shardy: I need to know about nova, do you pin it? | 13:14 |
| *** dshulyak has quit IRC | 13:15 | |
| *** links has quit IRC | 13:17 | |
| EmilienM | derekh, dprince: ^ in case you know too | 13:23 |
| *** aufi has quit IRC | 13:24 | |
| *** akuznetsov has joined #tripleo | 13:24 | |
| slagle | EmilienM: we get it from http://trunk.rdoproject.org/centos7/current-tripleo/ | 13:26 |
| slagle | looks like it's from january 25th | 13:26 |
| EmilienM | ok I think we're missing a commit | 13:27 |
| EmilienM | that will break v2 auth for neutron notifs | 13:27 |
| EmilienM | we had to patch puppet-nova https://github.com/openstack/puppet-nova/commit/d09868a59c451932d67c66101b725182d7066a14 | 13:27 |
| derekh | EmilienM: is that the reason for the puppet-nova pin shardy proposed ? | 13:32 |
| EmilienM | yeah I think | 13:32 |
| derekh | EmilienM: ok | 13:32 |
| EmilienM | dmsimard has a patch in THT to fix it, but we need a recent nova to test it | 13:33 |
| derekh | the nonha job for that pin looks like its nearly finished, if it passed I'll merge it, then we can figure out the problem with HA deployments | 13:33 |
| derekh | once that is fixed we can move to a more recent current-tripleo | 13:34 |
| dprince | in order to bump Delorean we'll also need this: https://review.openstack.org/#/c/275607/ | 13:34 |
| trown | oh right we need that on the undercloud too | 13:35 |
| *** akuznetsov has quit IRC | 13:36 | |
| *** dcain has joined #tripleo | 13:39 | |
| *** bvandenh has joined #tripleo | 13:39 | |
| openstackgerrit | Derek Higgins proposed openstack/tripleo-common: Pin puppet-nova https://review.openstack.org/277756 | 13:44 |
| derekh | shardy: your patch made us successfully deploy the overcloud | 13:45 |
| derekh | shardy: but then the heat stack for the ping test failed, see update ^^ | 13:45 |
| derekh | shardy: The fact that it passed the overcloud deploy, I think is enough to prove we need the pin, I'm +1 for merging it now | 13:46 |
| derekh | dprince: slagle ^ | 13:46 |
| *** akuznetsov has joined #tripleo | 13:46 | |
| *** ukalifon has joined #tripleo | 13:52 | |
| *** openstackgerrit_ has quit IRC | 13:56 | |
| derekh | jaosorior: Now that ^^ has merged, didn't you say you had a patch to fix HA deployments ? wanna recheck it to see how it goes. | 13:57 |
| derekh | jaosorior: hold that idea, it hasn't merged yet | 13:58 |
| shardy | derekh: +1, thanks | 13:58 |
| shardy | derekh: I was wondering, should we really be setting global (overcloud/undercloud) pins at the top, e.g under "Temporary workarounds"? | 13:59 |
| shardy | that might avoid other folks making the same mistake I did | 13:59 |
| jaosorior | derekh: Will do | 14:00 |
| *** akuznetsov has quit IRC | 14:00 | |
| jaosorior | derekh: Ah, so it hasn't merged? | 14:01 |
| dprince | meeting time | 14:01 |
| jaosorior | dprince: What was the channel/ | 14:01 |
| openstackgerrit | Lucas Alvares Gomes proposed openstack/python-tripleoclient: Use the grub2 element instead of grub2-deprecated https://review.openstack.org/277842 | 14:01 |
| dprince | jaosorior: openstack-meeting2 | 14:03 |
| dprince | jaosorior: openstack-meeting-alt | 14:03 |
| *** rpothier has joined #tripleo | 14:08 | |
| *** akuznetsov has joined #tripleo | 14:08 | |
| *** jpeeler has joined #tripleo | 14:11 | |
| *** jpeeler has quit IRC | 14:11 | |
| *** jpeeler has joined #tripleo | 14:11 | |
| openstackgerrit | Merged openstack/tripleo-common: Pin puppet-nova https://review.openstack.org/277756 | 14:13 |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: WIP Mistral Experiment https://review.openstack.org/275285 | 14:15 |
| *** links has joined #tripleo | 14:16 | |
| *** lblanchard has joined #tripleo | 14:17 | |
| openstackgerrit | George Shuklin proposed openstack/diskimage-builder: Add DIB_APT_SOURCES_INLINE to apt-sources element. https://review.openstack.org/277850 | 14:20 |
| *** eggmaster has joined #tripleo | 14:20 | |
| *** yamahata has joined #tripleo | 14:21 | |
| *** NobodyCa1 has joined #tripleo | 14:22 | |
| *** tiswanso has joined #tripleo | 14:24 | |
| *** tosky_ has joined #tripleo | 14:25 | |
| *** rhallisey has joined #tripleo | 14:26 | |
| *** tosky has quit IRC | 14:26 | |
| *** tzumainn has joined #tripleo | 14:26 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Forcibly clear parameters (now passed as parameter_defaults) https://review.openstack.org/256670 | 14:26 |
| *** stendulker has joined #tripleo | 14:29 | |
| *** NobodyCa1 has quit IRC | 14:29 | |
| *** tiswanso has quit IRC | 14:30 | |
| dmsimard | dprince: made a comment on https://review.openstack.org/#/c/275607/ | 14:31 |
| *** tiswanso has joined #tripleo | 14:31 | |
| *** dshulyak has joined #tripleo | 14:32 | |
| *** mgould has quit IRC | 14:34 | |
| *** stendulker has quit IRC | 14:46 | |
| *** mgould has joined #tripleo | 14:49 | |
| *** julim_ has quit IRC | 14:49 | |
| jpeeler | dprince: could you do a quick review of https://review.openstack.org/#/c/265366/ ? | 14:50 |
| *** egafford has joined #tripleo | 14:51 | |
| *** pradk has joined #tripleo | 14:52 | |
| openstackgerrit | David Moreau Simard proposed openstack/tripleo-heat-templates: Nova now requires an api database to be created https://review.openstack.org/276790 | 14:52 |
| dmsimard | dprince: ^ new patchset with nova_api user | 14:53 |
| *** links has quit IRC | 14:54 | |
| dprince | jpeeler: +2, but the HA ci should patch I think | 14:55 |
| dprince | dmsimard: thanks | 14:55 |
| jaosorior | derekh: Sorry, I'm still in a meeting. But I'm not sure if there's a bug for the HA problem | 14:55 |
| jpeeler | dprince: you need me to recheck to get it approved? | 14:55 |
| dprince | jpeeler: CI outage right now, so I'd wait a bit | 14:55 |
| jpeeler | it all passed at one point... | 14:56 |
| jpeeler | without changes | 14:56 |
| derekh | jaosorior: I rechecked it anyways, lets wee what happens | 14:56 |
| dmsimard | EmilienM: did you figure out if tripleo was good on the nova-neutron config ? | 14:56 |
| dmsimard | nova api database patches are in review for tripleo and nova api database patch is merged in packstack, looking at nova-neutron now | 14:57 |
| *** rbrady has joined #tripleo | 14:57 | |
| EmilienM | dmsimard: no | 14:57 |
| *** hjensas has quit IRC | 14:58 | |
| trown | dmsimard: EmilienM: dprince: derekh, maybe we should revive the the etherpad to start listing all issues in tripleo preventing us from moving the tripleo-current pin to current | 14:59 |
| trown | https://etherpad.openstack.org/p/delorean_master_current_issues | 14:59 |
| dmsimard | trown: ok I'll add the current bugs/reviews that I am aware of there | 15:00 |
| trown | dmsimard: I just archived what was there, since that was for a previous promote | 15:01 |
| derekh | trown: ack, good idea, btw, our periodic job is now actually testing current so we should see it pass when things are fixed | 15:01 |
| trown | awesome | 15:01 |
| derekh | trown: finding the results of the periodic job is anothor thing | 15:02 |
| trown | lol | 15:02 |
| derekh | trown: once we merge this, I'll set up the report page, https://review.openstack.org/#/c/271370/2 | 15:02 |
| trown | shardy: can we merge that without CI ^, since it is just reporting | 15:03 |
| *** dtantsur is now known as dtantsur|brb | 15:03 | |
| shardy | trown: if derekh is happy with that then yes, I think so | 15:05 |
| dmsimard | EmilienM: does tripleo need anything for the gnocchi pipeline issue ? | 15:06 |
| EmilienM | dmsimard: no | 15:06 |
| dmsimard | thanks | 15:06 |
| *** tiswanso has quit IRC | 15:06 | |
| *** tiswanso has joined #tripleo | 15:09 | |
| *** shardy has quit IRC | 15:28 | |
| *** dshulyak has quit IRC | 15:30 | |
| openstackgerrit | Rajini Ram proposed openstack/tripleo-heat-templates: Update Dell Storage Center api port setting https://review.openstack.org/277888 | 15:31 |
| *** dcain has left #tripleo | 15:32 | |
| *** aufi has joined #tripleo | 15:33 | |
| devvesa | shardy: Sorry. I couldnt attend to today's meeting cause I had another one in the same time. Does the success of this patch https://review.openstack.org/#/c/277756/ | 15:33 |
| devvesa | mean that it can fix the stable/liberty CI errors? | 15:33 |
| *** panda has quit IRC | 15:38 | |
| *** panda has joined #tripleo | 15:38 | |
| slagle | derekh: is there a way to clear the zuul queue, and would it make sense to do so? | 15:41 |
| slagle | we know it's all going to fail, with the proposed fix being https://review.openstack.org/#/c/276701/ | 15:41 |
| slagle | which is not first in the queue :) | 15:41 |
| *** tserong has quit IRC | 15:42 | |
| *** julim has joined #tripleo | 15:45 | |
| derekh | slagle: no way to do it as far as I know, unless some people in #infra have a magic button | 15:46 |
| *** marcusvrn_ has quit IRC | 15:47 | |
| *** tserong has joined #tripleo | 15:49 | |
| slagle | ok | 15:50 |
| *** shardy has joined #tripleo | 15:51 | |
| derekh | slagle: we could sabotage the running jobs to fail quicker ;-) | 15:51 |
| *** dmacpher is now known as dmacpher-afk | 15:52 | |
| *** liverpooler has quit IRC | 15:53 | |
| *** mcornea has quit IRC | 16:02 | |
| *** stendulker has joined #tripleo | 16:05 | |
| *** aufi has quit IRC | 16:07 | |
| *** rpothier has left #tripleo | 16:07 | |
| *** oshvartz has quit IRC | 16:09 | |
| *** mbound has quit IRC | 16:14 | |
| ryansb | there needs to be some kind of a "this patch fixes the gate, kill other jobs and requeue them after this one" | 16:17 |
| ryansb | *some kind of a switch for | 16:17 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Don't regenerate the overcloud passwords if the Heat stack exists https://review.openstack.org/275661 | 16:23 |
| derekh | dprince: slagle so the overcloud looks like it still has problems, only 9 ACTIVE vms and new ones going to error state | 16:23 |
| derekh | exception.NoValidHost | 16:23 |
| *** dtantsur|brb is now known as dtantsur | 16:24 | |
| dprince | derekh: okay, I just asked clark in infra about the timeouts. He seemed to think they were on our side | 16:24 |
| derekh | dprince: http://paste.openstack.org/show/486456/ | 16:25 |
| *** ukalifon has quit IRC | 16:26 | |
| derekh | dprince: looks like its lost cound of the user resources, we're not running 308 VM's | 16:26 |
| derekh | *count | 16:26 |
| dprince | derekh: I wonder if post-reboot of the controller if we might should just spin up new overcloud compute nodes again? | 16:26 |
| d0ugal | tzumainn: ^ updated the review. | 16:27 |
| jaosorior | derekh, dprince, shardy: Has the fix in nova that EmilienM was talking about landed yet? | 16:27 |
| derekh | dprince: maybe...no sure I thought we did this reboot in the past and didn#t have to reboot the controllers | 16:29 |
| dprince | derekh: i think it has always be a bit tricky, the reboots | 16:30 |
| dprince | in theory it should be fine though | 16:30 |
| tzumainn | d0ugal, thanks, I'll take a look in a bit! | 16:30 |
| *** akuznetsov has quit IRC | 16:31 | |
| derekh | dprince: yup its always been tricky alright ;-) | 16:31 |
| derekh | dprince: now rebooting the computes, I think thats how we ended up with the arp flood the last time, I ended up having to rebuild them | 16:32 |
| derekh | dprince: how would that fix the DB of used quota | 16:32 |
| dprince | derekh: It makes me thinks the computs are communicating | 16:32 |
| dprince | derekh: should automatically refresh | 16:33 |
| *** mcornea has joined #tripleo | 16:35 | |
| derekh | dprince: sec, just checking stasts for one of the ndoes to see if they match up | 16:36 |
| *** mbound has joined #tripleo | 16:40 | |
| *** yamahata has quit IRC | 16:47 | |
| derekh | dprince: so, all of the instances currently running jenkins nodes are on the same compute node, I buch of them probably got overwhelmed yesterday when the controller got fixed and we opened the floodgate | 16:48 |
| derekh | dprince: going to bounce a few of them now | 16:50 |
| *** stendulker has quit IRC | 16:54 | |
| *** d0ugal has quit IRC | 17:02 | |
| *** dsneddon_brno has joined #tripleo | 17:03 | |
| *** jaosorior has quit IRC | 17:04 | |
| *** bvandenh has quit IRC | 17:06 | |
| *** yamahata has joined #tripleo | 17:13 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud: Enable extra hardware data collection and processing for ironic-inspector https://review.openstack.org/277974 | 17:15 |
| jidar | hey guys, is there any way at all to limit "OS::TripleO::NodeExtraConfigPost" to just controllers or compute hosts, and if not can I do something only on UPDATE that would achieve the same solution? | 17:16 |
| jidar | right now I'm looking at having the puppet component run only on if $::hostname =~ /.*controller.*/ { ... } or similar | 17:17 |
| jidar | but that's sort of pokey | 17:17 |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud: Enable extra hardware data collection and processing for ironic-inspector https://review.openstack.org/277974 | 17:18 |
| *** morazi has quit IRC | 17:19 | |
| *** jcoufal has quit IRC | 17:19 | |
| *** jprovazn has quit IRC | 17:21 | |
| *** sthillma has joined #tripleo | 17:22 | |
| *** athomas has quit IRC | 17:23 | |
| *** tiswanso has quit IRC | 17:24 | |
| -openstackstatus- NOTICE: Gerrit is restarting now, to alleviate current performance impact and WebUI errors. | 17:25 | |
| *** sthillma_ has joined #tripleo | 17:25 | |
| *** tiswanso has joined #tripleo | 17:26 | |
| *** sthillma has quit IRC | 17:27 | |
| *** sthillma_ is now known as sthillma | 17:27 | |
| *** mbound has quit IRC | 17:30 | |
| *** devvesa has quit IRC | 17:32 | |
| *** masco has joined #tripleo | 17:34 | |
| *** jaosorior has joined #tripleo | 17:39 | |
| gfidente | jidar, I think you'd have to add a role specific extraconfigpost | 17:44 |
| gfidente | in the templates | 17:44 |
| *** mkovacik has quit IRC | 17:44 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud: Enable extra hardware data collection and processing for ironic-inspector https://review.openstack.org/277974 | 17:48 |
| *** jtomasek has quit IRC | 17:48 | |
| *** eil397 has joined #tripleo | 17:50 | |
| *** jaosorior has quit IRC | 17:53 | |
| openstackgerrit | xin wu proposed openstack/tripleo-heat-templates: Include big switch puppet modules for deploying overcloud https://review.openstack.org/271940 | 17:55 |
| derekh | dprince: gotta run, all the failing compute nodes have been rebuilt, zull is now running about 30 jobs (and increasing), we were running 8 or 9 | 17:56 |
| dprince | derekh: I will watch it, thanks | 17:57 |
| *** derekh has quit IRC | 17:58 | |
| openstackgerrit | xin wu proposed openstack/tripleo-heat-templates: Include big switch puppet modules for deploying overcloud https://review.openstack.org/271953 | 17:59 |
| *** shardy has quit IRC | 18:00 | |
| *** penick has joined #tripleo | 18:00 | |
| *** gfidente has quit IRC | 18:02 | |
| *** bnemec has joined #tripleo | 18:02 | |
| *** penick has quit IRC | 18:05 | |
| *** eil397 has quit IRC | 18:07 | |
| *** electrofelix has quit IRC | 18:07 | |
| *** mgould has quit IRC | 18:08 | |
| *** eil397 has joined #tripleo | 18:08 | |
| *** tzumainn has quit IRC | 18:10 | |
| *** lucasagomes is now known as lucas-dinner | 18:11 | |
| *** tzumainn_ has joined #tripleo | 18:13 | |
| *** tzumainn_ is now known as tzumainn | 18:14 | |
| *** tosky_ has quit IRC | 18:17 | |
| *** xarses has joined #tripleo | 18:17 | |
| *** rhallisey has quit IRC | 18:18 | |
| *** rhallisey has joined #tripleo | 18:19 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Increase size of connection tracking table https://review.openstack.org/275769 | 18:20 |
| *** alop has joined #tripleo | 18:20 | |
| *** akuznetsov has joined #tripleo | 18:23 | |
| *** akuznetsov has quit IRC | 18:24 | |
| *** akuznetsov has joined #tripleo | 18:24 | |
| *** akuznetsov has quit IRC | 18:25 | |
| *** shivrao has joined #tripleo | 18:28 | |
| *** akuznetsov has joined #tripleo | 18:28 | |
| *** akuznetsov has quit IRC | 18:28 | |
| *** bvandenh has joined #tripleo | 18:30 | |
| *** bvandenh_ has joined #tripleo | 18:31 | |
| *** sthillma has quit IRC | 18:34 | |
| *** bvandenh has quit IRC | 18:35 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Install docker for tests https://review.openstack.org/278021 | 18:35 |
| *** bnemec changes topic to "TripleO | CI status: http://tripleo.org/cistatus.html | Docs: http://tripleo.org/" | 18:37 | |
| *** bvandenh_ has quit IRC | 18:37 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Fail functests if refusing to run tests https://review.openstack.org/177002 | 18:38 |
| *** akuznetsov has joined #tripleo | 18:39 | |
| *** masco has quit IRC | 18:41 | |
| *** eil397 has quit IRC | 18:41 | |
| *** mcornea has quit IRC | 18:42 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Dont pass xattrs to tar if its unsupported https://review.openstack.org/177559 | 18:42 |
| *** trown is now known as trown|lunch | 18:42 | |
| *** akuznetsov has quit IRC | 18:44 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add tests for building *-minimal images https://review.openstack.org/181162 | 18:44 |
| SlickNik | We have now moved on to: https://etherpad.openstack.org/p/trove-mitaka-sprint-future | 18:45 |
| *** rhallisey has quit IRC | 18:45 | |
| *** rhallisey has joined #tripleo | 18:48 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Dont pass xattrs to tar if its unsupported https://review.openstack.org/177559 | 18:49 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Properly fail/trap in eval_run_d https://review.openstack.org/259734 | 18:55 |
| *** tiswanso has quit IRC | 19:01 | |
| *** tiswanso has joined #tripleo | 19:02 | |
| *** bvandenh_ has joined #tripleo | 19:04 | |
| *** eil397 has joined #tripleo | 19:06 | |
| *** akuznetsov has joined #tripleo | 19:07 | |
| *** akuznetsov has quit IRC | 19:07 | |
| *** akuznetsov has joined #tripleo | 19:08 | |
| *** dtantsur is now known as dtantsur|afk | 19:09 | |
| *** akuznetsov has quit IRC | 19:09 | |
| *** akuznetsov has joined #tripleo | 19:13 | |
| *** akuznetsov has quit IRC | 19:14 | |
| xarses | dmsimard: should we get the outstanding puppet-ceph tripleo tests killed? 4h,20m and 3h,23 min are never going to finish https://jenkins07.openstack.org/job/gate-tripleo-ci-f22-nonha/639/ https://jenkins07.openstack.org/job/gate-tripleo-ci-f22-nonha/642/ | 19:16 |
| *** penick has joined #tripleo | 19:17 | |
| dmsimard | xarses: I'm not very knowledgeable about those jobs, EmilienM or trown|lunch would know | 19:17 |
| dmsimard | xarses: Can you even kill jobs that are in progress ? I've never had to do that before. | 19:18 |
| xarses | IIRC infra can | 19:18 |
| dmsimard | Surely there's an enforced timeout on the job | 19:19 |
| * dmsimard shrugs | 19:19 | |
| xarses | I would have figured 2h - 2h, 30m based on the average 1h 35m runtime | 19:19 |
| *** akuznetsov has joined #tripleo | 19:20 | |
| *** akuznetsov has quit IRC | 19:25 | |
| xarses | dmsimard: hmm, nvm they have not been running that long, they have been waiting that long | 19:29 |
| EmilienM | dmsimard, xarses: they don't slow you down | 19:29 |
| EmilienM | FYI they are not voting and you don't need them to merge any patch | 19:29 |
| *** eil397 has quit IRC | 19:30 | |
| *** eil397 has joined #tripleo | 19:31 | |
| *** jtomasek_ has joined #tripleo | 19:31 | |
| *** eil397 has quit IRC | 19:33 | |
| *** eil397 has joined #tripleo | 19:36 | |
| *** ayoung has joined #tripleo | 19:37 | |
| *** mkovacik has joined #tripleo | 19:37 | |
| *** panda has quit IRC | 19:37 | |
| *** panda has joined #tripleo | 19:38 | |
| *** akuznetsov has joined #tripleo | 19:41 | |
| *** akuznetsov has quit IRC | 19:41 | |
| *** akuznetsov has joined #tripleo | 19:42 | |
| *** akuznetsov has quit IRC | 19:43 | |
| *** trown|lunch is now known as trown | 19:44 | |
| *** akuznetsov has joined #tripleo | 19:45 | |
| *** akuznetsov has quit IRC | 19:50 | |
| *** akuznetsov has joined #tripleo | 19:54 | |
| *** akuznetsov has quit IRC | 19:55 | |
| *** akuznets_ has joined #tripleo | 19:55 | |
| *** akuznetsov has joined #tripleo | 19:57 | |
| *** dprince has quit IRC | 19:59 | |
| *** akuznets_ has quit IRC | 20:00 | |
| *** dprince has joined #tripleo | 20:00 | |
| *** akuznetsov has quit IRC | 20:01 | |
| *** ifarkas has quit IRC | 20:02 | |
| *** eil397 has quit IRC | 20:06 | |
| *** rcernin has joined #tripleo | 20:08 | |
| *** tiswanso has quit IRC | 20:14 | |
| *** tiswanso has joined #tripleo | 20:15 | |
| *** Marga_ has quit IRC | 20:23 | |
| *** NobodyCa1 has joined #tripleo | 20:34 | |
| jidar | gah, gfidente left.. anybody know what he/she meant when they suggested role specific extraconfigpost? | 20:37 |
| *** hjensas has joined #tripleo | 20:37 | |
| *** hjensas has quit IRC | 20:37 | |
| *** hjensas has joined #tripleo | 20:37 | |
| *** NobodyCa1 has quit IRC | 20:41 | |
| trown | dmsimard: does the error posted here fit with the nova-neutron keystonev3 issue, or do you think it is something else? https://etherpad.openstack.org/p/delorean_master_current_issues | 20:44 |
| dmsimard | trown: that's exactly it yeah | 20:44 |
| *** weshay_xchat has quit IRC | 20:45 | |
| dmsimard | trown: see https://review.openstack.org/#/c/276932/5/manifests/network/neutron.pp | 20:45 |
| trown | dmsimard: cool, so looks like tripleo will need both an instack-undercloud and tripleo-heat-templates patch for that too | 20:46 |
| trown | I will start hacking on the undercloud part | 20:46 |
| dmsimard | trown: the packstack patch looks fairly simple https://review.openstack.org/#/c/277867/ | 20:46 |
| dmsimard | trown: OPM was just updated explicitely to carry the puppet-nova patch but it's not built by delorean yet (last I check) | 20:46 |
| dmsimard | so keep that in mind | 20:47 |
| trown | ah, so I need that puppet-nova too? | 20:47 |
| trown | makes sense... | 20:48 |
| trown | pinche OPM | 20:48 |
| *** NobodyCa1 has joined #tripleo | 20:48 | |
| *** deva_ has joined #tripleo | 20:50 | |
| jidar | I'm looking @ https://gist.github.com/b1322dd307acd7eb7e82, and I don't see how it's possible to filter on any compute host controller host when deploying the post-config stuff? | 20:50 |
| jidar | all I see available is NodeExtraConfigPost, so how do I hook that in as a controller based deploy or a compute based deploy | 20:51 |
| jidar | I mean, I guess I could just write out a huge bash script that parses the hostname but that's piss poor design :( | 20:53 |
| *** NobodyCa1 has quit IRC | 20:53 | |
| *** dsneddon_brno has quit IRC | 20:54 | |
| *** Goneri has quit IRC | 20:54 | |
| *** deva_ has quit IRC | 20:54 | |
| dmsimard | trown: I'll let you know when opm has built | 20:58 |
| *** akuznetsov has joined #tripleo | 20:58 | |
| *** rlandy has quit IRC | 20:58 | |
| *** Marga_ has joined #tripleo | 20:59 | |
| trown | dmsimard: cool, for hacking purposes I will just use the puppet-nova module from source | 20:59 |
| trown | dmsimard: looks like the instack-undercloud patch will be fairly simple, although I should probably take the opportunity to move that config to hiera | 20:59 |
| dmsimard | trown: just don't make it too complicated so it takes a long time to merge :) | 21:00 |
| dmsimard | do a follow up patch if necessary | 21:00 |
| *** rlandy has joined #tripleo | 21:00 | |
| trown | dmsimard: lol, ya I would not even do it if I didnt think it would get -1 if I did not :) | 21:00 |
| *** eil397 has joined #tripleo | 21:01 | |
| *** akuznetsov has quit IRC | 21:03 | |
| *** eil397 has quit IRC | 21:08 | |
| *** Goneri has joined #tripleo | 21:09 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Increase size of connection tracking table https://review.openstack.org/275769 | 21:21 |
| *** weshay_xchat has joined #tripleo | 21:23 | |
| trown | is there a way to use a DIB_INSTALLTYPE variable to install a single puppet module from master? or is it all source or all OPM? | 21:23 |
| *** akuznetsov has joined #tripleo | 21:24 | |
| *** dprince has quit IRC | 21:31 | |
| *** lblanchard has quit IRC | 21:34 | |
| *** tiswanso has quit IRC | 21:37 | |
| bnemec | trown: I believe it should be possible to install single module from source. See the second Source admonition in step 5 on http://docs.openstack.org/developer/tripleo-docs/installation/installation.html#installing-the-undercloud | 21:41 |
| trown | bnemec: ah cool, I think that may not work, but good to know it is supposed to :p | 21:42 |
| *** tiswanso has joined #tripleo | 21:43 | |
| openstackgerrit | Ethan Gafford proposed openstack/tripleo-heat-templates: Trove Integration https://review.openstack.org/233240 | 21:49 |
| *** Marga_ has quit IRC | 21:49 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common: Convenience methods in base model class https://review.openstack.org/268821 | 21:50 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common: Implement ViewManager list_software_deployments https://review.openstack.org/268822 | 21:50 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common: Implement ViewManager list_stack_failures https://review.openstack.org/270546 | 21:50 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common: Implement ViewManager show_software_deployment https://review.openstack.org/270545 | 21:50 |
| *** Marga_ has joined #tripleo | 21:50 | |
| openstackgerrit | Steve Baker proposed openstack/python-tripleoclient: openstack overcloud software deployment show https://review.openstack.org/271113 | 21:51 |
| openstackgerrit | Steve Baker proposed openstack/python-tripleoclient: openstack overcloud failures https://review.openstack.org/271114 | 21:51 |
| openstackgerrit | Steve Baker proposed openstack/python-tripleoclient: openstack overcloud software deployment list https://review.openstack.org/252670 | 21:51 |
| stevebaker | hey, there has been a complete lack of reviews on these changes ^. I think they provide a huge UX improvement, but only if they, you know, land | 21:52 |
| trown | bnemec: yep... export DIB_INSTALLTYPE_puppet_nova=source did not get me puppet_nova from source :( | 21:53 |
| trown | stevebaker: ya I think we have unfortunately had some pretty major CI outages that are still be unraveled | 21:53 |
| *** akuznetsov has quit IRC | 21:54 | |
| stevebaker | trown: ok, as long as people know those changes are there. fwiw they are low risk of regression changes - they just make GET calls and format the results | 21:55 |
| trown | stevebaker: ya it has been on my list to give them a go for a while now | 21:56 |
| *** Marga_ has quit IRC | 21:57 | |
| *** Marga_ has joined #tripleo | 21:57 | |
| dmsimard | trown: is keystone v3 even setup in tripleo ? | 21:58 |
| *** jpeeler has quit IRC | 21:58 | |
| trown | dmsimard: ya | 21:58 |
| trown | bnemec: slagle, I think I found an ill effect of https://github.com/openstack/tripleo-puppet-elements/commit/4b20834b702700612c473b70940d3b69656aa63b | 21:59 |
| dmsimard | trown: okay... tried to find things v3 or domain related and didn't find them | 21:59 |
| openstackgerrit | James Slagle proposed openstack/os-cloud-config: Add []'s around ipv6 address when creating keystone clients https://review.openstack.org/278111 | 21:59 |
| trown | hmm... although without that, it is not possible to rerun undercloud install... that -f does overwrite the link from doing a single source puppet install though | 22:03 |
| trown | deleting the module you want to get from source from /usr/share/openstack-puppet/modules works though :) | 22:05 |
| *** egafford has quit IRC | 22:05 | |
| dmsimard | lol.. yeah, been there done that | 22:05 |
| dmsimard | rm -rf <module>; git clone <module> | 22:05 |
| * trown cant wait until that split is complete | 22:06 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1543810 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1543810 in tripleo "Jenkins errors killing many CI jobs" [Critical,Triaged] | 22:10 |
| dmsimard | trown: all those get_input, where are they fetched from ? https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/compute.yaml#L503 | 22:13 |
| trown | dmsimard: hehe, welcome to THT :) https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/compute.yaml#L615 | 22:15 |
| dmsimard | that doesn't exactly help me, how do I know what's the value "hidden" in get_param: [EndpointMap, KeystoneAdmin, uri] ? | 22:16 |
| trown | which comes from https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/compute.yaml#L270-L274, which points out that the EndpointMap is set via the resource registry | 22:16 |
| trown | having fun yet? :) | 22:17 |
| dmsimard | yeah okay I just found the endpoint map thing | 22:17 |
| trown | https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud.yaml is where the top level resource registry is | 22:18 |
| dmsimard | https://github.com/openstack/tripleo-heat-templates/blob/master/network/endpoints/endpoint_map.yaml#L65 | 22:18 |
| dmsimard | what did I get myself into | 22:19 |
| trown | turtles all the way down | 22:19 |
| dmsimard | looks like there's no mention of keystone v3 | 22:21 |
| dmsimard | https://github.com/openstack/tripleo-heat-templates/blob/master/network/endpoints/endpoint_map.yaml#L238-L269 | 22:22 |
| dmsimard | I probably need to create v3 UriSuffix'd endpoints ? | 22:22 |
| trown | dmsimard: what I was thinking was we could just do all of the nova-neutron stuff via hieradata like https://review.openstack.org/#/c/239109/ | 22:23 |
| dmsimard | yeah, see the comment that confirms what I was saying https://review.openstack.org/#/c/239109/4/puppet/hieradata/controller.yaml | 22:25 |
| trown | I tested that patch and it worked though... | 22:26 |
| dmsimard | okay, I'll hack something together then | 22:26 |
| trown | woot Overcloud Deployed | 22:27 |
| *** rhallisey has quit IRC | 22:27 | |
| trown | not that it will function without fixing THT, but at least that confirms the undercloud patch I made works | 22:27 |
| trown | dmsimard: thanks for delving into tripleo :) | 22:28 |
| *** julim has quit IRC | 22:32 | |
| *** trown is now known as trown|outtypewww | 22:32 | |
| *** dsneddon_brno has joined #tripleo | 22:34 | |
| openstackgerrit | David Moreau Simard proposed openstack/tripleo-heat-templates: Update nova::network::neutron variables to drop deprecated parameters https://review.openstack.org/278134 | 22:39 |
| dmsimard | EmilienM: There doesn't seem to be any keystone v3 endpoint "mapped" in tht (context: nova-neutron v3 changes). Do you think I should add keystone v3 entries in the map with an urisuffix v3 to be able to use it ? Here: https://github.com/openstack/tripleo-heat-templates/blob/master/network/endpoints/endpoint_map.yaml#L238-L269 | 22:41 |
| dmsimard | bnemec: would you have an opinion on ^ ? nova-neutron needs to be configured to use keystone v3 in mitaka | 22:46 |
| dmsimard | i.e https://github.com/openstack/puppet-nova/commit/d09868a59c451932d67c66101b725182d7066a14 | 22:46 |
| bnemec | dmsimard: I actually thought we were already talking keystone v3 for notifications: https://github.com/openstack/tripleo-heat-templates/commit/56a141cacbbc76bdd909c02e0e670a97676cb217 | 22:49 |
| *** pradk has quit IRC | 22:49 | |
| dmsimard | bnemec: Hence why I'm poking you :P trown reported the issue in point 2 https://etherpad.openstack.org/p/delorean_master_current_issues | 22:50 |
| dmsimard | (We had to fix this explicitely to point to /v3 in puppet-openstack-integration tests as well as packstack) | 22:50 |
| dmsimard | Is it expected that the default is v3 when there is no suffix to the endpoint or something ? | 22:51 |
| bnemec | dmsimard: I thought shardy had said before that in theory everyone should be using unversioned keystone endpoints and letting the client handle version selection. | 22:51 |
| bnemec | Unfortunately he's not around. :-/ | 22:52 |
| dmsimard | Do we have an unversioned endpoint in undercloud as well ? That's where trown got the trace in the etherpad | 22:52 |
| openstackgerrit | John Trowbridge proposed openstack/instack-undercloud: Update nova-neutron configuration https://review.openstack.org/278137 | 22:52 |
| dmsimard | (I'm really not familiar with tripleo, just trying to help getting CI to finally pass) | 22:53 |
| dmsimard | well, there's trown's undercloud review | 22:53 |
| *** tiswanso has quit IRC | 22:54 | |
| *** trown|outtypewww is now known as trown | 22:55 | |
| dmsimard | bnemec: this is the original bug where I reported the issue https://bugs.launchpad.net/puppet-nova/+bug/1542486 | 22:56 |
| openstack | Launchpad bug 1542486 in puppet-nova "nova-compute stack traces with BadRequest: Specifying 'tenant_id' other than authenticated tenant in request requires admin privileges" [Critical,New] - Assigned to Emilien Macchi (emilienm) | 22:56 |
| dmsimard | notice the unversioned endpoint in the config (provided by puppet-openstack-integration) that yields the error while devstack's "hardcoded" /v3 works | 22:57 |
| trown | I am actually still here for a bit :)... dmsimard I did not actually test the overcloud after I got it working, I am testing the patch above now, and will actually pingtest the overcloud this time to see if we even have anything broken | 22:57 |
| dmsimard | WELL, IT WORKED IN DEVSTACK™ | 22:57 |
| bnemec | Well, there's this: https://review.openstack.org/#/c/248500/12/elements/puppet-stack-config/puppet-stack-config.yaml.template | 22:57 |
| *** rcernin has quit IRC | 22:58 | |
| bnemec | Which is when we switched the undercloud to v3. It looks like notifications weren't previously using those hiera values though. :-/ | 22:58 |
| dmsimard | bnemec: the problem with THT is all those get_params, is there a way to feed them a /v3 without adding v3 endpoints in the map ? | 22:59 |
| bnemec | Oh hey, that's where shardy made the comment about unversioned endpoints too. | 22:59 |
| bnemec | Good to know I didn't imagine that. | 23:00 |
| trown | lol | 23:00 |
| *** dsneddon_brno has quit IRC | 23:00 | |
| bnemec | dmsimard: I think you'd have to add explicit KeystoneV3 endpoints. If you do, I'd prefer to base it on https://review.openstack.org/#/c/275437/ so we don't have a giant merge conflict waiting to happen. | 23:02 |
| dmsimard | oh man that review is nuts | 23:02 |
| dmsimard | ok :p | 23:02 |
| bnemec | dmsimard: Most of it is generated though. :-) | 23:04 |
| openstackgerrit | David Moreau Simard proposed openstack/tripleo-heat-templates: Update nova::network::neutron variables to drop deprecated parameters https://review.openstack.org/278134 | 23:05 |
| trown | whoa, that is an awesome patch | 23:05 |
| dmsimard | bnemec: how close are we to merging that realistically | 23:06 |
| dmsimard | bnemec: only concern I have with basing my patch on top of that is takes a long time to merge and I depend on it | 23:06 |
| bnemec | dmsimard: I don't know. CI appears to be completely hosed again. | 23:07 |
| dmsimard | trown: I'll try to send a patch in tomorrow morning, taking off ttyl | 23:10 |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1543810 | 23:10 |
| openstack | Launchpad bug 1543810 in tripleo "Jenkins errors killing many CI jobs" [Critical,Triaged] | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| trown | dmsimard: thanks, I will also try to dig into it tomorrow. have a good night | 23:11 |
| *** thrash is now known as thrash|g0ne | 23:12 | |
| *** jtomasek_ has quit IRC | 23:12 | |
| *** mkovacik has quit IRC | 23:13 | |
| *** penick has quit IRC | 23:18 | |
| *** mkovacik has joined #tripleo | 23:19 | |
| openstackgerrit | John Trowbridge proposed openstack/instack-undercloud: Update nova-neutron configuration https://review.openstack.org/278137 | 23:21 |
| *** hjensas has quit IRC | 23:23 | |
| *** alop has quit IRC | 23:28 | |
| *** bvandenh_ has quit IRC | 23:29 | |
| *** panda has quit IRC | 23:37 | |
| *** panda has joined #tripleo | 23:38 | |
| *** eil397 has joined #tripleo | 23:50 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!