| *** mbound has quit IRC | 00:03 | |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the continer job to run again https://review.openstack.org/288915 | 00:17 |
|---|---|---|
| *** openstackgerrit_ has quit IRC | 00:23 | |
| *** openstackgerrit_ has joined #tripleo | 00:24 | |
| *** trozet_ has quit IRC | 00:26 | |
| *** mbound has joined #tripleo | 00:28 | |
| *** dmacpher has quit IRC | 00:31 | |
| *** mbound has quit IRC | 00:33 | |
| *** openstackgerrit_ has quit IRC | 00:48 | |
| *** openstackgerrit_ has joined #tripleo | 00:49 | |
| *** rohitpagedar__ has quit IRC | 00:49 | |
| openstackgerrit | Merged openstack/instack-undercloud: keystone/wsgi: bind on local IP https://review.openstack.org/291292 | 00:50 |
| *** lblanchard has joined #tripleo | 00:52 | |
| *** chlong has joined #tripleo | 00:52 | |
| *** trown is now known as trown|outtypewww | 00:56 | |
| *** xinwu has quit IRC | 01:20 | |
| *** rbrady has quit IRC | 01:23 | |
| *** mbound has joined #tripleo | 01:29 | |
| *** dmsimard|pto has quit IRC | 01:31 | |
| *** Marga__ has joined #tripleo | 01:32 | |
| *** Marga_ has quit IRC | 01:34 | |
| *** mbound has quit IRC | 01:34 | |
| *** Marga__ has quit IRC | 01:35 | |
| *** panda has quit IRC | 01:40 | |
| *** panda has joined #tripleo | 01:41 | |
| *** lblanchard has quit IRC | 01:53 | |
| *** dmacpher has joined #tripleo | 02:09 | |
| *** dmacpher is now known as dmacpher-afk | 02:23 | |
| *** beagles has left #tripleo | 02:24 | |
| *** sthillma has left #tripleo | 02:24 | |
| *** sthillma has joined #tripleo | 02:25 | |
| *** sthillma has quit IRC | 02:28 | |
| *** Marga_ has joined #tripleo | 02:30 | |
| *** Marga_ has quit IRC | 02:31 | |
| *** Marga_ has joined #tripleo | 02:31 | |
| *** ayoung has joined #tripleo | 02:58 | |
| *** tzumainn has joined #tripleo | 03:15 | |
| *** barra204 has joined #tripleo | 03:21 | |
| *** cwolferh_ has joined #tripleo | 03:23 | |
| *** bandini_ has joined #tripleo | 03:24 | |
| *** yamahata_ has joined #tripleo | 03:24 | |
| *** rhallisey has quit IRC | 03:27 | |
| *** cwolferh has quit IRC | 03:30 | |
| *** bandini has quit IRC | 03:30 | |
| *** yamahata has quit IRC | 03:30 | |
| *** shakamunyi has quit IRC | 03:30 | |
| *** yamahata_ has quit IRC | 03:36 | |
| *** dmacpher-afk is now known as dmacpher | 03:39 | |
| *** links has joined #tripleo | 03:45 | |
| *** Nakato_ is now known as Nakato | 03:56 | |
| *** stendulker has joined #tripleo | 04:03 | |
| *** tzumainn has quit IRC | 04:13 | |
| *** jaosorior has joined #tripleo | 04:32 | |
| *** masco has joined #tripleo | 04:59 | |
| *** shivrao has quit IRC | 05:02 | |
| *** dmacpher has quit IRC | 05:06 | |
| *** Erming__ has quit IRC | 05:10 | |
| *** Erming_ has joined #tripleo | 05:10 | |
| *** Erming__ has joined #tripleo | 05:18 | |
| *** Erming_ has quit IRC | 05:20 | |
| *** dmacpher has joined #tripleo | 05:23 | |
| *** veteran has joined #tripleo | 05:49 | |
| *** rlandy has quit IRC | 05:50 | |
| *** veteran has quit IRC | 05:50 | |
| *** rlandy has joined #tripleo | 05:50 | |
| *** saneax_AFK is now known as saneax | 05:50 | |
| *** Marga_ has quit IRC | 05:50 | |
| *** Slower has quit IRC | 05:52 | |
| *** Slower has joined #tripleo | 05:52 | |
| *** jaosorior has quit IRC | 05:56 | |
| *** ayoung has quit IRC | 05:56 | |
| *** Ng has quit IRC | 05:56 | |
| *** yamahata_ has joined #tripleo | 05:58 | |
| *** Marga_ has joined #tripleo | 06:00 | |
| *** ayoung has joined #tripleo | 06:02 | |
| *** Ng has joined #tripleo | 06:02 | |
| *** wolfe.freenode.net sets mode: +v Ng | 06:02 | |
| *** barra204 has quit IRC | 06:04 | |
| *** jaosorior has joined #tripleo | 06:04 | |
| *** yamahata_ has quit IRC | 06:10 | |
| *** openstackgerrit_ has quit IRC | 06:17 | |
| *** openstackgerrit_ has joined #tripleo | 06:17 | |
| *** dmacpher has quit IRC | 06:30 | |
| *** jprovazn has joined #tripleo | 06:32 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-common: Install the upgrade-non-controller.sh script with tripleo-common https://review.openstack.org/291564 | 06:38 |
| *** xinwu has joined #tripleo | 06:41 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Add a ceph-storage node upgrade script for the upgrade workflow https://review.openstack.org/291408 | 06:42 |
| openstackgerrit | Purandhar Sairam Mannidi proposed openstack/diskimage-builder: Add support for building images capable of UEFI https://review.openstack.org/287784 | 06:42 |
| *** shivrao has joined #tripleo | 06:42 | |
| *** dmacpher has joined #tripleo | 06:43 | |
| *** shivrao_ has joined #tripleo | 06:44 | |
| openstackgerrit | Purandhar Sairam Mannidi proposed openstack/diskimage-builder: Add support for building images capable of UEFI https://review.openstack.org/287784 | 06:44 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/os-cloud-config: Replace deprecated LOG.warn with LOG.warning https://review.openstack.org/291568 | 06:45 |
| *** shivrao has quit IRC | 06:47 | |
| *** shivrao_ is now known as shivrao | 06:47 | |
| *** rcernin has joined #tripleo | 06:49 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/tripleo-common: Replace deprecated LOG.warn with LOG.warning https://review.openstack.org/291571 | 06:51 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Enable the ML2 port security extension driver by default https://review.openstack.org/287866 | 06:52 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Make External Load Balancer templates work with IPv6 https://review.openstack.org/285538 | 06:52 |
| *** aufi has joined #tripleo | 06:52 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: controller/ceilometer: use internalURL for os endpoint type https://review.openstack.org/291145 | 06:53 |
| openstackgerrit | Merged openstack/instack-undercloud: Configure nova to use custom scheduler filter https://review.openstack.org/288188 | 06:56 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Surround MongoDB IPs with braces in the connection string if IPv6 https://review.openstack.org/291429 | 06:57 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Allow the vnc server to bind on IPv6 address on computes https://review.openstack.org/291435 | 07:08 |
| *** jaosorior has quit IRC | 07:10 | |
| *** ayoung has quit IRC | 07:10 | |
| *** Ng has quit IRC | 07:10 | |
| *** rdopiera has joined #tripleo | 07:11 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Fix vncproxy_host for IPv6 https://review.openstack.org/291439 | 07:15 |
| *** rlandy has quit IRC | 07:16 | |
| *** absubram has joined #tripleo | 07:18 | |
| *** absubram_ has joined #tripleo | 07:19 | |
| *** jaosorior has joined #tripleo | 07:21 | |
| *** ayoung has joined #tripleo | 07:21 | |
| *** Ng has joined #tripleo | 07:21 | |
| *** wolfe.freenode.net sets mode: +v Ng | 07:21 | |
| *** absubram has quit IRC | 07:23 | |
| *** absubram_ is now known as absubram | 07:23 | |
| *** dmacpher has quit IRC | 07:24 | |
| *** ohamada has joined #tripleo | 07:26 | |
| *** jtomasek has joined #tripleo | 07:27 | |
| *** dshulyak has joined #tripleo | 07:31 | |
| *** mkovacik has joined #tripleo | 07:32 | |
| *** absubram has quit IRC | 07:38 | |
| *** mikelk has joined #tripleo | 07:40 | |
| *** ccamacho has joined #tripleo | 07:43 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Upgrades: initialization command/snippet https://review.openstack.org/291400 | 07:43 |
| *** jaosorior has left #tripleo | 07:47 | |
| *** jaosorior has quit IRC | 07:47 | |
| *** ayoung has quit IRC | 07:47 | |
| *** Ng has quit IRC | 07:47 | |
| *** jaosorior has joined #tripleo | 07:54 | |
| *** ayoung has joined #tripleo | 07:54 | |
| *** Ng has joined #tripleo | 07:54 | |
| *** wolfe.freenode.net sets mode: +v Ng | 07:54 | |
| *** fgimenez has joined #tripleo | 08:02 | |
| *** fgimenez has quit IRC | 08:02 | |
| *** fgimenez has joined #tripleo | 08:02 | |
| *** rwsu has joined #tripleo | 08:20 | |
| *** mbound has joined #tripleo | 08:22 | |
| *** rain has joined #tripleo | 08:24 | |
| *** rain is now known as leanderthal | 08:24 | |
| *** fgimenez has left #tripleo | 08:25 | |
| *** saibarspeis has joined #tripleo | 08:25 | |
| *** shivrao has quit IRC | 08:26 | |
| *** mbound has quit IRC | 08:31 | |
| *** snecklifter has quit IRC | 08:31 | |
| *** shardy has joined #tripleo | 08:35 | |
| *** yamahata_ has joined #tripleo | 08:35 | |
| *** pcaruana has joined #tripleo | 08:41 | |
| *** paramite has joined #tripleo | 08:47 | |
| *** chlong has quit IRC | 08:49 | |
| *** athomas has joined #tripleo | 08:51 | |
| *** ifarkas has joined #tripleo | 08:55 | |
| openstackgerrit | Richard Su proposed openstack/instack-undercloud: Enable notifications on undercloud https://review.openstack.org/289518 | 08:56 |
| *** mbound has joined #tripleo | 09:05 | |
| *** lucas-afk is now known as lucasagomes | 09:06 | |
| d0ugal | I've not looked at how the loadbalancing works with tripleo yet. Is anyone around that can help? | 09:13 |
| d0ugal | I want to be able to add a new swift node but have it excluded from any traffic | 09:14 |
| d0ugal | (as it needs some manual config after the deploy) | 09:14 |
| *** electrofelix has joined #tripleo | 09:15 | |
| *** ramishra has quit IRC | 09:19 | |
| *** jistr has joined #tripleo | 09:24 | |
| *** ramishra has joined #tripleo | 09:24 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: overcloud-odl : add new image file definition https://review.openstack.org/266881 | 09:24 |
| *** mkovacik has quit IRC | 09:25 | |
| *** yamahata_ has quit IRC | 09:26 | |
| jaosorior | d0ugal: So you want a node dedicated to swift only that isn't exposed in the loadbalancer? | 09:27 |
| d0ugal | jaosorior: I think so, sorry, I am probably not explaining it well. | 09:27 |
| *** pblaho has joined #tripleo | 09:27 | |
| d0ugal | jaosorior: There is an issue with swift scaling, some manual steps are required after doing the deploy | 09:27 |
| d0ugal | jaosorior: So I want the new swift node to be added (by increasing ObjectStorageCount) but I don't want it to be used until I have manually fixed it | 09:28 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/tripleo-image-elements: Replace deprecated LOG.warn with LOG.warning https://review.openstack.org/291627 | 09:30 |
| jaosorior | Well, swift by itself doesn't appear to be added to the loadbalancer (at least not in puppet-tripleo/manifests/loadbalancer.pp ) Only thing added is the swift_proxy, which you can enable/disable via hieradata https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/hieradata/controller.yaml#L144 | 09:32 |
| jaosorior | d0ugal ^^ | 09:32 |
| *** xinwu has quit IRC | 09:37 | |
| d0ugal | jaosorior: Thanks - looking. | 09:38 |
| d0ugal | jaosorior: stupid question - wont that enable or disable all the swift nodes? | 09:39 |
| *** derekh has joined #tripleo | 09:40 | |
| *** akrivoka has joined #tripleo | 09:40 | |
| *** panda has quit IRC | 09:40 | |
| *** panda has joined #tripleo | 09:40 | |
| jaosorior | d0ugal: that will affect the swift_proxy listeners on the controllers | 09:42 |
| *** mannidi has joined #tripleo | 09:43 | |
| jistr | marios: i reviewed the rebase you did, +2, thanks for that! Can you please vote on that too in general? It feels weird to be the only +2+A on my own patch, even if it's a backport and patch set 1 was +2'd by you anyway. https://review.openstack.org/#/c/291400 | 09:45 |
| marios | jistr: yeah sure | 09:46 |
| d0ugal | jaosorior: Right, I don't know what that means but I'll keep reading :) | 09:46 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Upgrades: object storage node upgrade fix https://review.openstack.org/291254 | 09:46 |
| *** gfidente has joined #tripleo | 09:49 | |
| *** gfidente has quit IRC | 09:49 | |
| *** gfidente has joined #tripleo | 09:49 | |
| openstackgerrit | Merged openstack/tripleo-common: Install the upgrade-non-controller.sh script with tripleo-common https://review.openstack.org/291564 | 09:50 |
| *** bandini_ is now known as bandini | 09:51 | |
| jistr | marios: thx! I think we merged just about everything upgrades-related on t-h-t side, except https://review.openstack.org/#/c/291173/ which might not be a blocker (not sure there) | 09:51 |
| dtantsur | hey folks! have you seen "libvirtError: invalid argument: could not find capabilities for domaintype=kvm" in the nova-compute logs? | 09:52 |
| dtantsur | my overcloud pingtest fails in the virtual environment, and I'm trying to understand why | 09:52 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Upgrades: initialization command/snippet https://review.openstack.org/291400 | 09:54 |
| derekh | dtantsur: you probably just need "--libvirt-type=qemu" in the overcloud deploy args | 09:55 |
| jistr | dtantsur: hmm i haven't seen that, but if i had to guess by the error message, could it be a virtual deployment with --libvirt-type kvm, but not having nested HW virt enabled? | 09:55 |
| jistr | heh | 09:55 |
| dtantsur | thanks guys, will try! | 09:55 |
| marios | jistr: yeah i think so. we can probably get that landed by this afternoon anyway | 09:56 |
| marios | jistr: pending anything else that comes up during testing | 09:56 |
| dtantsur | damn, it was even in docs >_< | 09:56 |
| *** mgould has joined #tripleo | 09:57 | |
| jistr | can someone spare a while to review a 3 character patch here please https://review.openstack.org/#/c/291173/ | 09:57 |
| marios | jistr: also forgot to say thanks for the cherrypick last night! | 09:58 |
| jistr | the patch has passed all CI jobs in summary, and isn't tested by CI anyway, so once we have one more +2, i'm gonna workflow it. No need to torture CI on something that isn't included in the test. | 09:59 |
| jistr | marios: heh sure thing :) | 09:59 |
| mannidi | Hi folks, I'm trying to build an opensuse image using diskimage-builder and its failing. Anyone tried building it? | 09:59 |
| *** paramite is now known as paramite|afk | 10:04 | |
| *** nijaba has quit IRC | 10:06 | |
| *** mkovacik has joined #tripleo | 10:07 | |
| *** nijaba has joined #tripleo | 10:07 | |
| jistr | marios: did you hit the overcloud upgrade getting stuck issue lately? i ran a stack-update last night and it went fine | 10:13 |
| marios | jistr: i am just running pingtest and starting on both (i was able to get passed the undercloud install issue with the fix at https://review.openstack.org/#/c/291292 | 10:15 |
| marios | jistr: i *expect* it on my beaker box (24GB, 6GB undercloud), but on my localbox hopefully not (8GB undercloud) | 10:16 |
| *** paramite|afk is now known as paramite | 10:16 | |
| *** saibarspeis has quit IRC | 10:16 | |
| marios | jistr: i updated the kbase with the init script change | 10:16 |
| jistr | marios: thanks | 10:17 |
| marios | jistr: what memory did your undercloud have? | 10:17 |
| marios | (but is non network iso right?) you didn't hit it once? that is great | 10:17 |
| *** athomas has quit IRC | 10:18 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: Ignore both the AUTHORS and ChangeLog files https://review.openstack.org/291645 | 10:19 |
| jistr | marios: i did hit it once, about a week ago i think, but not since. Non iso, 7G undercloud. Also i create a 1G swap space there, just to make sure. | 10:20 |
| marios | jistr: ack thx | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: Use automatic numbering for list https://review.openstack.org/291647 | 10:23 |
| *** tosky has joined #tripleo | 10:29 | |
| *** jcoufal has joined #tripleo | 10:30 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: Correct a link the basic_deployment document https://review.openstack.org/291650 | 10:31 |
| *** lazy_prince has joined #tripleo | 10:34 | |
| shardy | Hey guys, any chance I can get some reviews of https://review.openstack.org/#/c/255228/ please? | 10:35 |
| shardy | it simplifies the baremetal import so you don't need to specify e.g --json | 10:35 |
| shardy | and also adds support for loading yaml | 10:36 |
| shardy | dtantsur: I think I adressed your concerns in the latest revision | 10:36 |
| shardy | It's passing CI and I'd like it to land before mitaka if possible | 10:36 |
| *** ccamacho has quit IRC | 10:36 | |
| d0ugal | shardy: reviewing | 10:36 |
| shardy | d0ugal: thanks :) | 10:36 |
| d0ugal | shardy: was the change of "_" to "_r" intentional? | 10:37 |
| d0ugal | oh, I guess it was | 10:37 |
| d0ugal | I've not seen that before. | 10:37 |
| d0ugal | ah, I see why. | 10:37 |
| shardy | d0ugal: Yeah I had to because it shadows an import now | 10:37 |
| d0ugal | shardy: Sorry, I should let my brain process for a moment longer. | 10:37 |
| * shardy hands d0ugal a coffee ;) | 10:38 | |
| lazy_prince | Hi all.. Need reviews for https://review.openstack.org/#/c/287784. The patch is for generating UEFI Linux images using DIB. | 10:39 |
| d0ugal | shardy: Should we use safe_load? | 10:39 |
| d0ugal | yaml.safe_load that is | 10:39 |
| shardy | oops! | 10:40 |
| shardy | I just noticed another thing - we probably need an error if we hit an unknown file type | 10:40 |
| d0ugal | Yup, that would be good | 10:40 |
| shardy | d0ugal: Yeah, thanks for spotting, will fix | 10:40 |
| d0ugal | and the yaml file should be a safe/trusted file - but an easy change. | 10:40 |
| d0ugal | np | 10:40 |
| jaosorior | I honestly didn't know about safe_load, good to know | 10:41 |
| d0ugal | jaosorior: it should really be the default :( | 10:41 |
| shardy | lazy_prince: nice, I have a uefi box locally and I couldn't get it to boot with the current image, will test :) | 10:41 |
| jaosorior | d0ugal: Reading from the documentation after you referenced it. Damn dude, it sure should be. | 10:41 |
| d0ugal | jaosorior: There is also a safe_dump btw. | 10:42 |
| jaosorior | such a simple to use library and yet so subtle details | 10:44 |
| d0ugal | shardy: Otherwise the change looks good, so feel free to ping me when you have updated it. | 10:44 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Change the CinderISCSIHelper to lioadm https://review.openstack.org/291654 | 10:45 |
| lazy_prince | shardy: Thanks.. If you could test that and let us know of any issues that you find, that would be awesome.. | 10:45 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: Don't repeat titles from the documents. Sphinx will add these. https://review.openstack.org/291655 | 10:46 |
| openstackgerrit | Giulio Fidente proposed openstack/python-tripleoclient: Forcibly clear parameters now passed as parameter_defaults https://review.openstack.org/256670 | 10:46 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: Use automatic numbering for lists https://review.openstack.org/291647 | 10:47 |
| openstackgerrit | Giulio Fidente proposed openstack/python-tripleoclient: Forcibly clear parameters now passed as parameter_defaults https://review.openstack.org/256670 | 10:48 |
| *** ccamacho has joined #tripleo | 10:52 | |
| *** ccamacho has joined #tripleo | 10:53 | |
| -openstackstatus- NOTICE: Gerrit is going to be restarted due to bad performance | 10:56 | |
| *** ChanServ changes topic to "Gerrit is going to be restarted due to bad performance" | 10:56 | |
| openstackgerrit | Purandhar Sairam Mannidi proposed openstack/diskimage-builder: Add support for building images capable of UEFI https://review.openstack.org/287784 | 10:58 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient: Allow node import via yaml not only csv/json https://review.openstack.org/255228 | 10:59 |
| *** ChanServ changes topic to "TripleO | stable/liberty fix for https://bugs.launchpad.net/tripleo/+bug/1555803 merged | CI status: http://tripleo.org/cistatus.html | Docs: http://tripleo.org/" | 11:01 | |
| shardy | d0ugal: I think that should address the issues ^^ | 11:01 |
| -openstackstatus- NOTICE: Gerrit has been restarted successfully | 11:01 | |
| d0ugal | shardy: cool, looking | 11:01 |
| dtantsur | folks, is there any plan to do something about meaningless 2016-03-11 11:02:23 [2]: SIGNAL_COMPLETE Unknown messages? | 11:02 |
| dtantsur | shardy, maybe you know ^^ | 11:02 |
| shardy | dtantsur: Yeah, we need to include the resource name in there | 11:03 |
| dtantsur | it's fun when something is happening on the screen, but it's not fun if you don't have a slightest idea what it means :) | 11:03 |
| dtantsur | good :) | 11:03 |
| gfidente | dtantsur, for me it's always like that ... :) | 11:06 |
| shardy | lol! | 11:06 |
| dtantsur | :D | 11:06 |
| dtantsur | well, if it outputs something meaningful, I can at least ask here :) | 11:07 |
| openstackgerrit | Merged openstack/python-tripleoclient: Generate a unique DeployIdentifier on updates https://review.openstack.org/268126 | 11:08 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: The file type is now detected, so we don't need to use the --json flag. https://review.openstack.org/291659 | 11:08 |
| gfidente | like this for example https://review.openstack.org/#/c/256670/ | 11:10 |
| gfidente | the most troublesome submission ever | 11:10 |
| gfidente | I am trying to get it landed but it just won't | 11:10 |
| gfidente | any gerrit keyword or button I click, it just won't | 11:10 |
| *** jprovazn has quit IRC | 11:10 | |
| gfidente | oh it's going now | 11:11 |
| dtantsur | one more tricky question: how can I test "HA-ness" of my setup? what should I kill and what should I see then? | 11:12 |
| shardy | dtantsur: https://review.openstack.org/291660 | 11:14 |
| shardy | untested, I'll post a WIP patch to prove it looks OK via CI | 11:14 |
| gfidente | I think a nice test to do is virsh pause a controller and check pcmk on the remaining nodes, then try to use your overcloud | 11:14 |
| *** stendulker has quit IRC | 11:15 | |
| gfidente | it might take a while for both pcmk to react and the openstack services to realize some agents are down | 11:15 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Testing, nothing to see here https://review.openstack.org/291661 | 11:16 |
| *** d0ugal has quit IRC | 11:16 | |
| dtantsur | gfidente, could you please elaborate on the "check pcmk" part? :) also how do I find out which of 3 controllers to pause? | 11:17 |
| *** d0ugal has joined #tripleo | 11:17 | |
| bandini | dtantsur: any controller should do, although if you test with the one holding the main VIP it will be more of an effective test | 11:18 |
| * bandini sneaks in the conversation | 11:19 | |
| dtantsur | bandini, how do I find this "main VIP" thingy? :) | 11:19 |
| dtantsur | please safely assume I have no idea about pacemaker :) | 11:20 |
| *** dshulyak has quit IRC | 11:20 | |
| d0ugal | shardy: hah, you are ahead of me :) | 11:20 |
| bandini | :) so do a "pcs status | grep IPaddr2" you will see the IP addresses that are managed by pcmk | 11:21 |
| bandini | choose one that points to an endpoint api that you want to test and verify on which controller it is started | 11:22 |
| bandini | reboot that controller, observe that the VIP has moved somewhere else, check if the api is still working | 11:22 |
| bandini | does that make sense? | 11:22 |
| shardy | d0ugal: hehe :) | 11:22 |
| dtantsur | bandini, this 'pcs' command, where should I start it? on undercloud it cannot be found | 11:23 |
| shardy | dtantsur: pacemaker is only running on the overcloud controllers | 11:24 |
| bandini | dtantsur: ah ok. yes the pcs command manages the cluster, the cluster runs only on the overcloud controllers (you have to be root) | 11:25 |
| bandini | dtantsur: you will find it on the controllers only (no compute) | 11:25 |
| *** larstobi has quit IRC | 11:25 | |
| *** tosky has quit IRC | 11:26 | |
| dtantsur | bandini, interesting, in "pcs status | grep IPaddr2" I see 2 IP addresses, one if which belong to my previous overcloud installation (presumably, at least it's not part of my current installation) | 11:27 |
| dtantsur | bandini, is it something expected? | 11:27 |
| *** larstobi has joined #tripleo | 11:29 | |
| *** akrivoka has quit IRC | 11:29 | |
| *** mannidi has quit IRC | 11:29 | |
| *** ooolpbot has joined #tripleo | 11:29 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:29 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1556041 | 11:29 |
| *** ooolpbot has quit IRC | 11:29 | |
| openstack | Launchpad bug 1556041 in tripleo "Nova_config[DEFAULT/cpu_allocation_ratio] is already declared" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 11:29 |
| bandini | dtantsur: those are random addresses generated by tripleo at initial deployment time, so yes it should be ok | 11:29 |
| *** thrash|bbl is now known as thrash | 11:30 | |
| dtantsur | ok, so I got one real: ip-192.0.2.6. now I have to pause the associated controller and watch this IP changing eventually and overcloud still operation. right? | 11:30 |
| *** tosky has joined #tripleo | 11:31 | |
| bandini | yes, it will take a bit of time but eventually it will move over to the other nodes | 11:31 |
| bandini | need to prepare lunch for the kids. bbiab | 11:31 |
| dtantsur | thanks a lot, trying now! | 11:32 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Move tripleo.sh into tripleo-ci repo https://review.openstack.org/272210 | 11:32 |
| *** tesseract has joined #tripleo | 11:33 | |
| *** jtomasek has quit IRC | 11:34 | |
| *** tesseract has quit IRC | 11:34 | |
| *** Guest16009 has joined #tripleo | 11:34 | |
| *** akrivoka has joined #tripleo | 11:35 | |
| dtantsur | bandini, gfidente, hmm, no I still don't get it. both IP addresses are not known to uc nova, both are assigned as second IP addresses with netmask /32 to the brex on 2 controllers... how do I know which one to kill | 11:36 |
| *** Guest16009 has quit IRC | 11:37 | |
| jaosorior | Hey guys, does anybody know why we're using notification_driver=messaging for the services in the undercloud instead of notification_driver=messagingv2? | 11:37 |
| *** dshulyak has joined #tripleo | 11:37 | |
| jaosorior | nothing wrong with it, just want to know if there was a reason for it\ | 11:38 |
| *** jtomasek has joined #tripleo | 11:39 | |
| *** tesseract- has joined #tripleo | 11:40 | |
| bandini | dtantsur: I would take the ip address noted on the "overcloudrc" file on the undercloud (aka the overcloud endpoint) | 11:40 |
| *** akrivoka has quit IRC | 11:40 | |
| bandini | that should be a decent test | 11:41 |
| dtantsur | aha | 11:41 |
| dtantsur | bandini, so we expect the IP address to get assigned to another controller, right? | 11:41 |
| bandini | yeppers | 11:41 |
| bandini | then haproxy will accept the connection on the new controller hosting that ip and relay the tcp connection to one of the controllers | 11:42 |
| bandini | dtantsur: the other ip address (not the overcloud endpoing) is used by redis (for the record), at least in a typical tripleo-quickstart stock install | 11:43 |
| * dtantsur is trying | 11:43 | |
| bandini | any bugs are gfidente's fault | 11:47 |
| * bandini ducks | 11:47 | |
| derekh | Mar 11 00:47:05 overcloud-controller-2 heat-engine[2179]: InvalidRequestError: This session is in 'prepared' state; no further SQL can be emitted within this transaction. | 11:48 |
| derekh | shardy: seen that befor ? ^ | 11:48 |
| dtantsur | ok, overcloud API's are no down, running instance still seems to work. Waiting. | 11:49 |
| *** paramite is now known as paramite|afk | 11:50 | |
| *** masco has quit IRC | 11:50 | |
| shardy | derekh: Hmm, that rings a bell, let me search a bit | 11:50 |
| ramishra | derekh: it this with heat master branch? | 11:53 |
| dtantsur | bandini, thanks, works for me! As a side note: is it normal for 'pcs status' to hang near the end of the output now? | 11:53 |
| derekh | shardy: its on a HA job, happened on one of the heat controllers, just after (about 3 minutes) the tenant-stack delete was issued | 11:54 |
| derekh | shardy: then the ping test stack delete failed | 11:54 |
| bandini | dtantsur: yes it takes a bit of time tryng to talk to the pcsd daemon of the controller you killed | 11:54 |
| derekh | ramishra: heat from saturday I think, stand by checking | 11:54 |
| dtantsur | bandini, heh, that's expected :) anyway, thanks for help. I've tested plenty of stuff today, and it all works really well | 11:55 |
| bandini | dtantsur: any time ;) just ping me | 11:55 |
| dtantsur | bandini, is it expected that one starting the old controller, it gets back its IP? | 11:56 |
| derekh | ramishra: 2016-03-04 03:02 (UTC I assume) | 11:56 |
| bandini | dtantsur: no in the stock configuration it won't (i.e. I don't think we set any scores on controllers that would make one preferred over the other) | 11:58 |
| ramishra | derekh: we've some fixes this week to resolve some stale data and transaction scope issues. | 11:58 |
| adarazs | derekh: are the gates dead? I tried to recheck but everything fails :( | 11:59 |
| dtantsur | bandini, well, it did :) | 11:59 |
| derekh | ramishra: that package I'm using was built with this commit as head http://git.openstack.org/cgit/openstack/heat/commit/?id=7d61fce04e1bf24678b3600a0c7205ec0fd032c5 | 11:59 |
| dtantsur | nothing seems broken due to that, but still | 11:59 |
| shardy | derekh: it's mentioned here https://bugs.launchpad.net/heat/+bug/1491185 | 11:59 |
| openstack | Launchpad bug 1491185 in heat "convergence: QueuePool limit of size 5 overflow 10 reached" [Medium,Fix released] - Assigned to Anant Patil (ananta) | 11:59 |
| bandini | dtantsur: ok, I'd have to check what rules we have in place, my memory is failing me ;) | 11:59 |
| shardy | it's possible we may need to tune the db/session settings I guess | 12:00 |
| derekh | adarazs: yup, a puppet-nova commit broke us, I've a revert being tested https://bugs.launchpad.net/tripleo/+bug/1556041 | 12:00 |
| openstack | Launchpad bug 1556041 in tripleo "Nova_config[DEFAULT/cpu_allocation_ratio] is already declared" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 12:00 |
| adarazs | derekh: ack | 12:00 |
| ramishra | derekh: that landed on 4th, I've this patch that fixes few issues. https://review.openstack.org/#/c/285425/ | 12:01 |
| ramishra | derekh: that landed few days ago. | 12:01 |
| *** jaosorior has quit IRC | 12:02 | |
| derekh | ramishra: ack, thanks, I'll chase down the other bug I'm seeing so and wait until our pin is updated to look for that one again | 12:02 |
| *** jaosorior has joined #tripleo | 12:03 | |
| ramishra | derekh: it looks to me like a stale data issue, probably should be resolved, however, do let me know. thanks. | 12:05 |
| derekh | shardy: thanks, I'll park that until our pin move past that patch ramishra pointed me at, | 12:05 |
| *** rhallisey has joined #tripleo | 12:06 | |
| derekh | I've also reproduced the "504 Gateway Time-out" heat error, looking into it now | 12:07 |
| *** lucasagomes is now known as lucas-hungry | 12:07 | |
| *** akrivoka has joined #tripleo | 12:07 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1556041 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1556041 in tripleo "Nova_config[DEFAULT/cpu_allocation_ratio] is already declared" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 12:10 |
| gfidente | derekh, shardy https://review.openstack.org/#/c/291665/1 | 12:12 |
| gfidente | this is the usual problem we've seen already where the parameter is moved into a class and *_config conflicts with it | 12:12 |
| gfidente | I think we should be extremely careful with using *_config in out manifests | 12:12 |
| *** ccamacho is now known as ccamacho|lunch | 12:14 | |
| *** akuznetsov has joined #tripleo | 12:14 | |
| *** jprovazn has joined #tripleo | 12:14 | |
| openstackgerrit | James Slagle proposed openstack/instack-undercloud: Configure nova to use custom scheduler filter https://review.openstack.org/291683 | 12:15 |
| *** trown|outtypewww is now known as trown | 12:15 | |
| gfidente | shardy, derekh oh no, totally different issue, this is an actual bug in the module itself | 12:15 |
| trown | gfidente: how would that type of puppet change pass the tripleo job | 12:15 |
| gfidente | it didn't! | 12:15 |
| trown | ok, so revert? | 12:16 |
| derekh | trown: revert is in CI | 12:16 |
| gfidente | derekh, pushed it already, linked from LP | 12:16 |
| trown | it isnt fair to blame tripleo if the CI was just ignored | 12:16 |
| trown | ah, cool, I am just waking up :) | 12:16 |
| trown | saw ooolpbot first thing... never good | 12:17 |
| slagle | i don't understand these puppet changes, they're interface breakages | 12:19 |
| slagle | same thing happened yesterday with puppet-heat | 12:19 |
| slagle | are we just using them wrong? | 12:20 |
| *** akuznetsov has quit IRC | 12:21 | |
| openstackgerrit | Giulio Fidente proposed openstack/python-tripleoclient: Forcibly clear parameters now passed as parameter_defaults https://review.openstack.org/291690 | 12:22 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Change the CinderISCSIHelper to lioadm https://review.openstack.org/291654 | 12:24 |
| *** jtomasek has quit IRC | 12:25 | |
| gfidente | shardy, not sure if you have a min but have you seen my comment on patchset #2 here https://review.openstack.org/#/c/289845/2 ? | 12:25 |
| *** rodrigods has quit IRC | 12:26 | |
| *** rodrigods has joined #tripleo | 12:26 | |
| gfidente | shardy, I tried get_addr [ test_flavor, show, name ] and that *does* report about the correct flavor name, but validation is still happening too early, when the flavor doesn't exist yet | 12:26 |
| *** jtomasek has joined #tripleo | 12:27 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Change default host reserved memory to 2048MB from 512MB https://review.openstack.org/291446 | 12:29 |
| slagle | derekh: overall looks like CI is holding up pretty well again over the night | 12:30 |
| slagle | i see a huge swath of green before the bath of red | 12:30 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: Basic beaker one node test. https://review.openstack.org/281376 | 12:31 |
| derekh | slagle: yup, we have a few tansient errors that we need to track down but no single thing causing major problems | 12:31 |
| EmilienM | hello | 12:33 |
| EmilienM | something is broken with https://review.openstack.org/#/c/290534/ the patch has been landed without looking tripleo job :(( | 12:33 |
| derekh | EmilienM: yup, https://review.openstack.org/#/c/291665/ | 12:34 |
| EmilienM | did you investigate before revert? | 12:34 |
| EmilienM | I found the bug in puppet-nova | 12:35 |
| EmilienM | I'm fixing it. | 12:35 |
| derekh | EmilienM: didn't test the revert but the log message suggest cpu_allocation_ratio is being declared twice, as its now in both nova::scheduler::filter and nova::compute | 12:35 |
| EmilienM | yes | 12:36 |
| EmilienM | so I'm fixing it in puppet-nova | 12:36 |
| EmilienM | give me 2 min | 12:36 |
| EmilienM | derekh: it seems like ram_allocation_ratio and cpu_allocation_ratio need to be on compute node, isn't? | 12:38 |
| derekh | EmilienM: assuming it passes CI why not just revert and re submit the original patch fixed? if your fix has a problem or people start arguing about how it should be fixed it could be hours | 12:38 |
| EmilienM | derekh: ok | 12:39 |
| derekh | EmilienM: yes, I think they should be on the compute node but could be wrong | 12:40 |
| EmilienM | yes | 12:41 |
| *** Goneri has quit IRC | 12:41 | |
| EmilienM | I'll take care of this move | 12:41 |
| EmilienM | derekh: I'm going to send a reminder email to my group about tripleo CI | 12:43 |
| derekh | EmilienM: great thanks | 12:43 |
| EmilienM | derekh: approved | 12:44 |
| shardy | gfidente: That get_resource should return the ID of the flavor: | 12:44 |
| shardy | so I don't get why it's validating the name | 12:44 |
| shardy | https://github.com/openstack/heat/blob/master/heat/engine/resources/openstack/nova/flavor.py#L120 | 12:44 |
| * shardy -> lunch, bbiab | 12:44 | |
| *** lblanchard has joined #tripleo | 12:53 | |
| rhallisey | EmilienM, are you talking about this error ? Error: Duplicate declaration: Nova_config[DEFAULT/cpu_allocation_ratio] is already declared in file /etc/puppet/modules/nova/manifests/compute.pp:199; | 12:54 |
| EmilienM | yes | 12:54 |
| rhallisey | cool | 12:54 |
| EmilienM | we reverted it, it's ok | 12:54 |
| EmilienM | I'm working on the fix | 12:54 |
| rhallisey | EmilienM, thank you | 12:55 |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Initial Integration of Mistral into TripleO https://review.openstack.org/282366 | 13:05 |
| *** stendulker has joined #tripleo | 13:05 | |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1556041 | 13:10 |
| openstack | Launchpad bug 1556041 in tripleo "Nova_config[DEFAULT/cpu_allocation_ratio] is already declared" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| *** stendulker has quit IRC | 13:12 | |
| *** jaosorior has quit IRC | 13:12 | |
| *** jaosorior has joined #tripleo | 13:12 | |
| *** Erming_ has joined #tripleo | 13:15 | |
| *** Erming__ has quit IRC | 13:17 | |
| *** ccamacho|lunch is now known as ccamacho | 13:19 | |
| *** dprince has joined #tripleo | 13:19 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: [WIP] Deploy and Scale Swift https://review.openstack.org/291711 | 13:19 |
| *** jayg|g0n3 is now known as jayg | 13:23 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Initial Integration of Mistral into TripleO https://review.openstack.org/282366 | 13:24 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: [WIP] Deploy and Scale Swift https://review.openstack.org/291711 | 13:24 |
| *** pradk_ has joined #tripleo | 13:26 | |
| *** pradk_ has quit IRC | 13:26 | |
| *** lucas-hungry is now known as lucasagomes | 13:29 | |
| *** paramite|afk is now known as paramite | 13:30 | |
| *** trown is now known as trown|afk | 13:31 | |
| *** rbrady has joined #tripleo | 13:34 | |
| *** morazi has joined #tripleo | 13:34 | |
| dtantsur | slagle, hi! maybe you know why we need os_cloud_config.nodes to be separate from tripleoclient (and tripleo-common in the future)? | 13:35 |
| dtantsur | slagle, it's kind of pita to update both places, and os_cloud_config seems to receive very few reviews | 13:36 |
| dtantsur | is it used anywhere else? | 13:36 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Upgrades: quiet yum upgrade on cinder nodes https://review.openstack.org/291173 | 13:37 |
| *** links has quit IRC | 13:39 | |
| slagle | dtantsur: it might be, you would probably know better than me :) | 13:40 |
| *** panda has quit IRC | 13:40 | |
| slagle | it could be used someone else just generally using ironic outside of the tripleo use case | 13:40 |
| *** panda has joined #tripleo | 13:40 | |
| dtantsur | slagle, so he's the problem: the code there is not so great, and I have a patch rewriting nearly completely. it's been around for months without reviews. now mgould needs a change there due to tripleoclient change, and he needs to share utility code, etc... | 13:41 |
| dtantsur | slagle, so tl;dr is: I'd like to move my new nodes.py to tripleoclient, stop using os_cloud_config.nodes there and deprecate this module | 13:41 |
| dtantsur | how many of tripleo folks would -2 it? :) | 13:41 |
| *** links has joined #tripleo | 13:42 | |
| dtantsur | shardy, collecting opinions ^^ | 13:42 |
| gfidente | so we need a w+1 bot | 13:42 |
| gfidente | which monitors all the rechecks | 13:42 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-heat-templates: IPv6: pass bracketed IP to rabbitmq puppet module https://review.openstack.org/291186 | 13:42 |
| slagle | dtantsur: i'm not opposed to it | 13:43 |
| dtantsur | ok, I'll try it and see if people hate me :D | 13:43 |
| slagle | once we do the keystone init via puppet, we won't need that from os-cloud-config either | 13:43 |
| slagle | so maybe we could deprecate the whole thing off | 13:43 |
| dtantsur | cool. lemme start with the ironic part | 13:43 |
| dprince | dtantsur: should it go into tripleo-common. So we could also create Mistral actions on it? | 13:44 |
| dtantsur | dprince, no problem with that, assuming that all logic goes there eventually | 13:44 |
| shardy | dtantsur: I'm fine with it moving, less repos == better IMO, but it should be tripleo-common | 13:44 |
| dprince | dtantsur: if this is something we'd want to do from the CLI, and UI then I think that would be a better place | 13:44 |
| dtantsur | awesome, will do | 13:45 |
| dprince | dtantsur: thanks | 13:45 |
| dtantsur | mgould, I'll propose a patch importing the nodes.py and wait_for_provision_state to tripleo-common | 13:46 |
| *** shivrao has joined #tripleo | 13:46 | |
| mgould | dtantsur, great! | 13:46 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Use service tenant for ceilometer https://review.openstack.org/291140 | 13:46 |
| slagle | bnemec: can you check https://review.openstack.org/#/c/291683/? | 13:46 |
| mgould | dtantsur, I think you'll need to move tripleoclient.exceptions too | 13:47 |
| dtantsur | mgould, whatever it takes :) | 13:47 |
| *** trown|afk is now known as trown | 13:53 | |
| slagle | jrist: let's get some t-shirts | 13:53 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Allow the containerized compute node to spawn larger VMs https://review.openstack.org/288822 | 13:54 |
| *** shivrao has quit IRC | 13:54 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Initial Integration of Mistral into TripleO https://review.openstack.org/282366 | 13:54 |
| shardy | Unable to establish connection to http://192.0.2.1:5000/v2.0/tokens | 13:54 |
| shardy | is keystone broken in CI now? | 13:54 |
| shardy | seen that in a couple of jobs started earlier today | 13:54 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Parameterize the heat-docker-agents image https://review.openstack.org/288731 | 13:54 |
| shardy | e.g http://logs.openstack.org/61/291661/1/check-tripleo/gate-tripleo-ci-f22-ceph/801d118/console.html | 13:54 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Remove unused Neutron Agents container https://review.openstack.org/287918 | 13:55 |
| *** Goneri has joined #tripleo | 13:55 | |
| shardy | nvm it's https://bugs.launchpad.net/tripleo/+bug/1556041 | 13:59 |
| openstack | Launchpad bug 1556041 in tripleo "Nova_config[DEFAULT/cpu_allocation_ratio] is already declared" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 13:59 |
| *** MaxPC has joined #tripleo | 14:00 | |
| *** MaxPC has quit IRC | 14:01 | |
| *** MaxPC has joined #tripleo | 14:01 | |
| openstackgerrit | Merged openstack/instack-undercloud: Enable IPA debug logging during introspection when undercloud_debug is True https://review.openstack.org/289297 | 14:02 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common: Import code working with Ironic nodes from os_cloud_config https://review.openstack.org/291723 | 14:05 |
| dtantsur | slagle, mgould, that's how it will look ^^ | 14:05 |
| dtantsur | I've imported my fixed version of nodes.py to not carry old (and broken) code around | 14:06 |
| dtantsur | will create a patch depending on it now | 14:06 |
| * mgould takes a look | 14:06 | |
| dtantsur | oh hmm... am I right assuming that Depends-On tripleo-common won't work? | 14:08 |
| openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient: Switch to using node utilities from tripleo-common https://review.openstack.org/291726 | 14:09 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1556041 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1556041 in tripleo "Nova_config[DEFAULT/cpu_allocation_ratio] is already declared" [Critical,Fix committed] - Assigned to Derek Higgins (derekh) | 14:10 |
| mgould | dtantsur, why not? | 14:12 |
| dtantsur | mgould, due to requirements.txt, I guess.. but maybe I'm wrong | 14:12 |
| * mgould sees the git dependency in requirements.txt | 14:13 | |
| dtantsur | slagle, shardy, could you please take a look at https://review.openstack.org/#/c/291723/ more or less soon? it fixes several bugs in nodes code, and unblocks some future work like mgould's enroll patch | 14:13 |
| dtantsur | mgould, note that this patch does not import wait_for_provision_state - worth doing in a follow-up | 14:13 |
| dtantsur | then we can drop it from tripleoclient | 14:13 |
| mgould | cool | 14:14 |
| thrash | d0ugal: can you take a look at the upgrades patches I have up for tripleo-common and python-tripleoclient? | 14:14 |
| mgould | so the wait_for_provision_state calls still need to go in register_node? | 14:14 |
| dtantsur | mgould, as it seems convenient to you | 14:14 |
| mgould | OK | 14:14 |
| openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: Use IPv6 on the ceph gate job https://review.openstack.org/289445 | 14:14 |
| mgould | I'll see how hard it is to make the change in python-tripleoclient alone, and push something up for review | 14:15 |
| thrash | d0ugal: https://etherpad.openstack.org/p/tripleo-upgrades-patches | 14:17 |
| thrash | pretty please. :D | 14:17 |
| *** links has quit IRC | 14:17 | |
| openstackgerrit | Ryan Hallisey proposed openstack/tripleo-heat-templates: Allow the containerized compute node to spawn larger VMs https://review.openstack.org/291235 | 14:23 |
| d0ugal | thrash: sure | 14:23 |
| openstackgerrit | Ryan Hallisey proposed openstack/tripleo-heat-templates: Remove unused Neutron Agents container https://review.openstack.org/291236 | 14:23 |
| *** nico_auv has joined #tripleo | 14:23 | |
| openstackgerrit | Ryan Hallisey proposed openstack/tripleo-heat-templates: Parameterize the heat-docker-agents image https://review.openstack.org/291237 | 14:23 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: Basic beaker one node test. https://review.openstack.org/281376 | 14:24 |
| thrash | d0ugal: you rock. thanks! | 14:24 |
| d0ugal | thrash: np, starting now. | 14:24 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: Add a service provider. https://review.openstack.org/286124 | 14:25 |
| *** paramite is now known as paramite|afk | 14:27 | |
| *** paramite|afk is now known as paramite | 14:27 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient: Switch to using node utilities from tripleo-common https://review.openstack.org/291726 | 14:28 |
| jrist | slagle: good plan, who do we bug | 14:29 |
| openstackgerrit | Merged openstack/instack-undercloud: Enable notifications on undercloud https://review.openstack.org/289518 | 14:31 |
| openstackgerrit | Merged openstack/python-tripleoclient: Forcibly clear parameters now passed as parameter_defaults https://review.openstack.org/256670 | 14:33 |
| trown | dibs on an owl shirt | 14:35 |
| trown | nice logo jrist | 14:35 |
| jrist | thanks trown ! | 14:36 |
| openstackgerrit | Giulio Fidente proposed openstack/python-tripleoclient: Generate a password for Redis and pass it as deployment parameter https://review.openstack.org/290610 | 14:36 |
| *** rlandy has joined #tripleo | 14:37 | |
| dprince | jrist: BTW, this is the theme https://github.com/dprince/tripleosphinx/tree/master/tripleosphinx/theme/tripleo | 14:38 |
| dprince | jrist: that isn't upstream yet, but the site deploys from that automatically | 14:39 |
| dprince | derekh: hey, so given we also saw some High CPU usuage I'm wondering if the plan to add more memory to our existing rack nodes is still a good one? | 14:42 |
| *** trozet has joined #tripleo | 14:42 | |
| *** saneax is now known as saneax_AFK | 14:43 | |
| jrist | dprince: ok I'll chekkit for a patch | 14:43 |
| jrist | dprince: any color preference? :) | 14:44 |
| jrist | (it can be styled via css) | 14:44 |
| derekh | dprince: ya, I was talking to the powers that be about that, suggesting that we still bump up a little but not to the scale we originally were aiming for | 14:44 |
| *** telnoratti has joined #tripleo | 14:44 | |
| dprince | jrist: my owl liked purple I think. Yours may have a slightly different color preference I think | 14:44 |
| jrist | dprince: ok | 14:44 |
| dprince | jrist: just ask your owl, he'll tell you what he likes | 14:45 |
| jrist | lol | 14:45 |
| jrist | he just says hoo all day? | 14:45 |
| *** jaosorior has quit IRC | 14:48 | |
| dprince | derekh: okay, sounds good. I agree we could use a bit more, but doubling it is probably not going to allow us to fully utilize it | 14:49 |
| derekh | dprince: we were talking about 4X , I'm suggesting maybe 2X instead | 14:50 |
| derekh | dprince: with 3 testenvs on a host if all are HA jobs we're currently are overcommited | 14:51 |
| openstackgerrit | Miles Gould proposed openstack/os-cloud-config: Return UUIDs from register_all_nodes https://review.openstack.org/291751 | 14:51 |
| derekh | dprince: so it should allow us to bump ram per host more if we want in the future, and allow the kernel to cache disk IO in RAM with whats left over | 14:52 |
| dprince | derekh: If 2x is the most cost effective then it is probably fine | 14:53 |
| d0ugal | thrash: Why wouldn't you want to run the post upgrade steps? Do we need --post? | 14:55 |
| telnoratti | I'm just starting out with triplo and got as far as deploying one controller and one compute with centos 7. After openstack overcloud deploy --templates the machines do boot and appear installed but grub comes back with an error. Something about cannot write outside of partition. Browsing from the grub rescue prompt I can see /boot and contents, but the FS appears corrupt when delving deeper. These are known | 14:56 |
| telnoratti | good drives | 14:56 |
| openstackgerrit | Merged openstack/tripleo-common: Upgrades: Add StackUpgradeManager https://review.openstack.org/288568 | 14:56 |
| telnoratti | I found a bug report on ubuntu's launchpad that had a similar problem when XFS wasn't periodically syncing it's journal. Since grub's xfs driver can't playback the journal it appeared corrupt. Is ironic shutting down the node instead of letting the installed node shut down itself? | 14:58 |
| *** jcoufal has quit IRC | 15:02 | |
| openstackgerrit | Merged openstack/python-tripleoclient: Forcibly clear parameters now passed as parameter_defaults https://review.openstack.org/291690 | 15:07 |
| d0ugal | thrash: oh, I see it either does the upgrade of the post upgrade. | 15:09 |
| adarazs | dprince, derekh: so it looks like rabbitmq won't work in ipv6 without using "-e /usr/share/openstack-tripleo-heat-templates/environments/puppet-pacemaker.yaml" | 15:18 |
| adarazs | dprince, derekh: is that acceptable to add it to the ceph job, or should we rather test ipv6 with the ha job? | 15:18 |
| openstackgerrit | Miles Gould proposed openstack/python-tripleoclient: [WIP] Use Ironic API v1.11 to support ENROLL state https://review.openstack.org/272206 | 15:19 |
| dprince | adarazs: is there something we could do to make rabbitmq work w/ IPv6 (without pacemaker) | 15:19 |
| dprince | adarazs: seems like this should be viewed as a bug perhaps | 15:19 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates: Upgrades: quiet yum upgrade on cinder nodes https://review.openstack.org/291760 | 15:20 |
| adarazs | dprince: according to jistr we need a fix for the rabbitmq puppet module. | 15:20 |
| adarazs | dprince: there's a command in it where the ipv6 address should be bracketed. | 15:21 |
| adarazs | curl -k --noproxy localhost --retry 30 --retry-delay 6 -f -L -o /var/lib/rabbitmq/rabbitmqadmin http://guest:guest@fd00:fd00:fd00:2000::12:15672/cli/rabbitmqadmin | 15:21 |
| *** mkovacik has quit IRC | 15:21 | |
| dprince | adarazs: okay, that just sounds like a bug to me. We can probably get it fixed right? | 15:22 |
| dprince | adarazs: in the meantime, if the HA job would be a way to demonstrate working IPv6 patches I'm fine w/ it | 15:22 |
| dprince | adarazs: We can debate the CI defaults perhaps separately, and where IPv6 should run separately | 15:23 |
| dprince | adarazs: while under development I would actually encourage you to enable IPv6 on all the jobs in your patch. I did this and it was useful, just be clear to mention that it is a WIP because otherwise devs may call you out because they don't understand you are just testing it w/ all the configs enabled for IPv6 | 15:24 |
| *** jprovazn has quit IRC | 15:24 | |
| adarazs | dprince: ack, you're right. I was a bit optimistic that I don't need that. :) | 15:24 |
| *** liverpooler has quit IRC | 15:24 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Pass public_addr to ceph::profile::params instead of ceph::mon https://review.openstack.org/280380 | 15:28 |
| *** jcoufal has joined #tripleo | 15:28 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: [WIP] Deploy and Scale Swift https://review.openstack.org/291711 | 15:30 |
| pradk | jdob, gnocchi with file backend == "Overcloud Deployed" in my local env :) .. so we have something to fall back to | 15:31 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Pass public_addr to ceph::profile::params instead of ceph::mon https://review.openstack.org/291768 | 15:31 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: [WIP] Deploy and Scale Swift https://review.openstack.org/291711 | 15:31 |
| pradk | jdob, next i'm testing ceph (my guess is it will have same fate as swift, but will see) | 15:31 |
| openstackgerrit | Merged openstack/tripleo-common: Prevent any property change from replacing OS::Nova::Server https://review.openstack.org/288273 | 15:31 |
| openstackgerrit | Ryan Hallisey proposed openstack/tripleo-docs: Document using node capabilities to control placement https://review.openstack.org/274217 | 15:33 |
| *** uncurlhalo has joined #tripleo | 15:34 | |
| openstackgerrit | Mike Burns proposed openstack/tripleo-common: Prevent any property change from replacing OS::Nova::Server https://review.openstack.org/291771 | 15:35 |
| *** leanderthal has quit IRC | 15:41 | |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Metrics tracking for TripleO deployment tasks https://review.openstack.org/291393 | 15:44 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-common: Create flavor as part of ping test https://review.openstack.org/291777 | 15:44 |
| dprince | derekh: I added a couple more for the testenv wait time, and the CI total time. Also put 'seconds' suffix on all the time metrics | 15:44 |
| *** yamahata_ has joined #tripleo | 15:45 | |
| *** athomas has joined #tripleo | 15:48 | |
| *** ifarkas has quit IRC | 15:51 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-common: Boot from volume in ping test https://review.openstack.org/291779 | 15:53 |
| shardy | If you use TESTENV_ARGS to specify multiple nics for an instack-virt-setup environment, how do you tell ironic which nic the node is supposed to boot from? | 15:54 |
| *** rwsu has quit IRC | 15:54 | |
| shardy | We document the former, but apparently not the latter AFAICS | 15:54 |
| *** rdopiera has quit IRC | 15:55 | |
| * shardy normally uses single-nic virt setups | 15:55 | |
| slagle | i thought when you add the mac to ironic, it will automatically set that as the boot device | 15:55 |
| shardy | slagle: Hmm, yeah actually the mac from the node failing to pxeboot does match the instackenv | 15:58 |
| shardy | must be some other issue then | 15:58 |
| shardy | basically ironic is in wait-callback but there's no pxelinux.cfg entry for the node | 15:59 |
| slagle | oh that sounds like the issue with boot.ipxe | 15:59 |
| slagle | the undionly.kpxe you have probably doesnt support the inc method | 15:59 |
| slagle | you could see that on the vm console | 16:00 |
| openstackgerrit | Ben Nemec proposed openstack/python-tripleoclient: Add password for HAProxy stats https://review.openstack.org/290905 | 16:00 |
| *** marios_ has joined #tripleo | 16:03 | |
| *** rpothier has joined #tripleo | 16:03 | |
| *** rpothier has left #tripleo | 16:03 | |
| *** ramishra has quit IRC | 16:08 | |
| *** paramite is now known as paramite|afk | 16:09 | |
| *** ramishra has joined #tripleo | 16:09 | |
| *** xinwu has joined #tripleo | 16:10 | |
| thrash | d0ugal: yeah. we don't want them run at the same time. There are steps that will occur (manual) before we unpin nova. | 16:22 |
| *** absubram has joined #tripleo | 16:24 | |
| *** beagles has joined #tripleo | 16:25 | |
| *** paramite|afk is now known as paramite | 16:25 | |
| *** absubram_ has joined #tripleo | 16:26 | |
| *** dmacpher has joined #tripleo | 16:27 | |
| *** xinwu has quit IRC | 16:27 | |
| *** hjensas has quit IRC | 16:28 | |
| *** mikelk has quit IRC | 16:28 | |
| trown | shardy: we just got mitaka delorean setup with symlinks copied from master for current-tripleo... to patch that into tripleoci so we dont start getting newton deps I can make a dependant patch on https://review.openstack.org/#/c/272210/ ya? | 16:28 |
| *** absubram has quit IRC | 16:29 | |
| *** absubram_ is now known as absubram | 16:29 | |
| shardy | trown: Yup, I'll recheck that now as I think the puppet-nova issue is fixed | 16:30 |
| trown | cool | 16:30 |
| *** ohamada has quit IRC | 16:34 | |
| openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: WIP: Use IPv6 on the gate jobs a test https://review.openstack.org/289445 | 16:35 |
| openstackgerrit | James Slagle proposed openstack/instack-undercloud: Nova should not sync power state of overcloud nodes https://review.openstack.org/291804 | 16:35 |
| *** mbound has quit IRC | 16:36 | |
| *** paramite is now known as paramite|afk | 16:36 | |
| *** lazy_prince has quit IRC | 16:39 | |
| *** pblaho has quit IRC | 16:42 | |
| *** mbound has joined #tripleo | 16:45 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-image-elements: Use package-installs for undercloud elements https://review.openstack.org/291808 | 16:45 |
| *** rbrady has quit IRC | 16:46 | |
| *** rbrady has joined #tripleo | 16:47 | |
| dprince | derekh: what if instead of cron we had a postci hook in testenv-worker that re-created the bridges each time | 16:48 |
| dprince | derekh: bridges and vms | 16:49 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Updated the heat_template_version https://review.openstack.org/288134 | 16:50 |
| *** pcaruana has quit IRC | 16:50 | |
| *** aufi has quit IRC | 16:53 | |
| *** tesseract- has quit IRC | 16:55 | |
| *** absubram has quit IRC | 16:55 | |
| *** absubram has joined #tripleo | 16:55 | |
| *** dtantsur is now known as dtantsur|afk | 16:56 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Deploy Gnocchi as a Ceilometer metrics storage backend https://review.openstack.org/252032 | 16:57 |
| *** rcernin has quit IRC | 17:01 | |
| *** dshulyak has quit IRC | 17:03 | |
| *** absubram has quit IRC | 17:08 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: Basic beaker one node test. https://review.openstack.org/281376 | 17:11 |
| derekh | dprince: yup, that could work, might be trickier to get right though, I'll look into it | 17:18 |
| dprince | derekh: just sent you an email. We could bounce OVS on a cron job too | 17:18 |
| dprince | derekh: the signal handling I added to the testenv-workers might help here | 17:18 |
| dprince | derekh: killall -USR2 testenv-worker, then wait for jobs to finish | 17:19 |
| dprince | derekh: then work your magic | 17:19 |
| dprince | derekh: killall -USR1 testenv-worker to re-enable job processing... | 17:19 |
| derekh | dprince: yup, that sounds perfect | 17:19 |
| * derekh was using that today ;-) | 17:19 | |
| *** penick has joined #tripleo | 17:23 | |
| *** dshulyak has joined #tripleo | 17:24 | |
| *** mbound has quit IRC | 17:25 | |
| *** derekh has quit IRC | 17:27 | |
| *** dshulyak has quit IRC | 17:29 | |
| *** xinwu has joined #tripleo | 17:33 | |
| *** pcaruana has joined #tripleo | 17:36 | |
| *** xinwu has quit IRC | 17:36 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: [WIP] Deploy and Scale Swift https://review.openstack.org/291711 | 17:36 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: Don't repeat titles from the documents. Sphinx will add these. https://review.openstack.org/291655 | 17:37 |
| *** panda has quit IRC | 17:40 | |
| *** panda has joined #tripleo | 17:40 | |
| *** dshulyak has joined #tripleo | 17:42 | |
| *** dmacpher has quit IRC | 17:44 | |
| *** ccamacho is now known as ccamacho|afw | 17:47 | |
| *** ccamacho|afw is now known as ccamacho|afk | 17:47 | |
| *** lucasagomes is now known as lucas-afk | 17:51 | |
| *** paramite|afk is now known as paramite | 17:53 | |
| *** tosky_ has joined #tripleo | 17:54 | |
| *** trown is now known as trown|lunch | 17:54 | |
| *** tosky has quit IRC | 17:55 | |
| mburned | dprince: slagle any chance you can look at https://review.openstack.org/#/c/274492/ ? | 17:57 |
| *** athomas has quit IRC | 17:57 | |
| mburned | lots of +1s but no +2s, passed ci... | 17:57 |
| dprince | mburned: its fine +2 from me | 17:58 |
| *** paramite has quit IRC | 17:58 | |
| mburned | bnemec: shardy ^^ pretty please? | 17:58 |
| mburned | dprince: thanks! | 17:58 |
| *** absubram has joined #tripleo | 18:00 | |
| *** dmacpher has joined #tripleo | 18:00 | |
| *** dmacpher has quit IRC | 18:00 | |
| *** dmacpher has joined #tripleo | 18:01 | |
| *** jdob has quit IRC | 18:01 | |
| *** yamahata_ has quit IRC | 18:01 | |
| *** jdob has joined #tripleo | 18:01 | |
| mburned | slagle: thanks! | 18:01 |
| *** xinwu has joined #tripleo | 18:02 | |
| *** tosky_ has quit IRC | 18:02 | |
| *** penick has quit IRC | 18:10 | |
| openstackgerrit | Merged openstack/os-net-config: Enable os_net_config to configure IVS https://review.openstack.org/274492 | 18:11 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Metrics tracking for TripleO deployment tasks https://review.openstack.org/291393 | 18:13 |
| *** shardy has quit IRC | 18:13 | |
| dsneddon | dprince, Can you review a few quick os-net-config changes? https://review.openstack.org/#/c/268806/ | 18:14 |
| dsneddon | https://review.openstack.org/290224 | 18:14 |
| dsneddon | https://review.openstack.org/291420 | 18:14 |
| dprince | dsneddon: the first is in merge conflict? | 18:15 |
| dsneddon | dprince, Ugh, just realized I'll have to rebase all of these since the IVS changes just merged. | 18:15 |
| dprince | dsneddon: yeah, sorry :/ | 18:15 |
| dsneddon | dprince, I think they all just went into merge conclict because of the IVS change | 18:15 |
| dprince | dsneddon: I will look once you rebase | 18:16 |
| openstackgerrit | Dan Sneddon proposed openstack/os-net-config: Fix order-of-operations bug in os-net-config restart_interfaces https://review.openstack.org/291420 | 18:19 |
| *** jistr has quit IRC | 18:22 | |
| openstackgerrit | Dan Sneddon proposed openstack/os-net-config: Fix hierarchy for Linux Bonds and Linux Bridges https://review.openstack.org/290224 | 18:22 |
| openstackgerrit | Dan Sneddon proposed openstack/os-net-config: Add ability to set IPv6 routes in os-net-config templates https://review.openstack.org/268806 | 18:24 |
| dsneddon | dprince, Rebased ^^^ | 18:25 |
| dsneddon | gfidente, If you want to take a look, I'd appreciate a review from you, too ^^^ | 18:25 |
| dsneddon | bnemec, It'd be great to get a review from you, too, let's make it a party ^^^ | 18:26 |
| bnemec | Ain't no party like a TripleO review party. :-) | 18:27 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-common: Make Nova scheduler filter work with Liberty https://review.openstack.org/291849 | 18:28 |
| bnemec | slagle: ^ | 18:28 |
| bnemec | Wasn't too hard to fix as it turns out. I'll add a depends-on to the i-u patch. | 18:28 |
| slagle | cool, thx | 18:28 |
| slagle | ugh, what happened to our tripleo jobs | 18:29 |
| slagle | i think they restarted zuul | 18:30 |
| openstackgerrit | Ben Nemec proposed openstack/instack-undercloud: Configure nova to use custom scheduler filter https://review.openstack.org/291683 | 18:31 |
| bnemec | All that green was too good to last | 18:34 |
| bnemec | And...still dead. | 18:36 |
| bnemec | No bueno | 18:36 |
| slagle | guess we won't have any red either | 18:37 |
| *** sthillma has joined #tripleo | 18:38 | |
| *** yamahata_ has joined #tripleo | 18:41 | |
| *** gfidente has quit IRC | 18:42 | |
| dprince | with our long job wall time I think infra reserves the right to be able to restart zuul | 18:44 |
| dprince | and have it kill a few of our jobs from time to time... | 18:44 |
| dprince | slagle, bnemec ^ | 18:44 |
| dprince | I'm not sure that is what happened here, just saying | 18:45 |
| *** shivrao has joined #tripleo | 18:45 | |
| bnemec | Yeah, I don't see anything in -infra about a zuul restart, and a recheck is still coming back NOT_REGISTERED. | 18:45 |
| slagle | i thought i saw something earlier up | 18:46 |
| slagle | we should ask them | 18:46 |
| bnemec | Yeah, still failing 15 minutes later. | 18:48 |
| prometheanfire | anyone else able to look at this DIB testing update? https://review.openstack.org/#/c/290894/ | 18:48 |
| slagle | sounds like gearman, nodepool and zuul all got restarted | 18:50 |
| prometheanfire | they did iirc | 18:51 |
| *** jcoufal has quit IRC | 18:52 | |
| *** nico_auv has quit IRC | 18:55 | |
| bnemec | toci is working again, but anything with puppet jobs still appears to be kaput. | 18:56 |
| *** marios_ has quit IRC | 19:00 | |
| dprince | jobs appear to be back I think | 19:03 |
| bnemec | dprince: Is puppet working again too now? | 19:04 |
| bnemec | In the interest of not firing off another doomed recheck. | 19:04 |
| dprince | bnemec: my recheck is running and listed in zuul | 19:05 |
| dprince | bnemec: give it a shot | 19:05 |
| dprince | bnemec: what do you mean by "puppet working"? | 19:05 |
| bnemec | dprince: I mean my last recheck on https://review.openstack.org/#/c/291683/ still failed due to a couple of puppet jobs still being broken. | 19:05 |
| bnemec | The toci jobs are running, but the check jobs failed. | 19:06 |
| dprince | bnemec: not sure about the puppet jenkin's slaves. But the tripleO ones work | 19:06 |
| dprince | bnemec: we can always ignore the puppet ones | 19:07 |
| * dprince jokes | 19:07 | |
| bnemec | Heh | 19:07 |
| bnemec | \o/ a puppet-syntax job just started | 19:08 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Metrics tracking for TripleO deployment tasks https://review.openstack.org/291393 | 19:23 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-common: Create flavor as part of ping test https://review.openstack.org/291777 | 19:27 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-common: Boot from volume in ping test https://review.openstack.org/291779 | 19:27 |
| openstackgerrit | Miles Gould proposed openstack/python-tripleoclient: Use Ironic API v1.11 to support ENROLL state https://review.openstack.org/272206 | 19:27 |
| *** mgould has quit IRC | 19:29 | |
| *** Marga_ has quit IRC | 19:32 | |
| *** trown|lunch is now known as trown | 19:36 | |
| *** akrivoka has quit IRC | 19:37 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Support the deployment of Ceph over IPv6 https://review.openstack.org/291455 | 19:40 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Set host in nova.conf for compute nodes https://review.openstack.org/291881 | 19:40 |
| openstackgerrit | Merged openstack/instack-undercloud: mysqld config: set innodb_file_per_table to ON https://review.openstack.org/288867 | 19:41 |
| *** ccamacho|afk has quit IRC | 19:43 | |
| *** xinwu has quit IRC | 19:47 | |
| *** electrofelix has quit IRC | 19:50 | |
| *** Slower has quit IRC | 19:53 | |
| *** xinwu has joined #tripleo | 19:54 | |
| *** xinwu has quit IRC | 19:55 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient: Aodh integration to tripleoclient https://review.openstack.org/283857 | 20:05 |
| *** xinwu has joined #tripleo | 20:07 | |
| *** xinwu has quit IRC | 20:08 | |
| *** Marga_ has joined #tripleo | 20:09 | |
| *** Marga_ has quit IRC | 20:09 | |
| *** Marga_ has joined #tripleo | 20:10 | |
| *** xinwu has joined #tripleo | 20:10 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient: Aodh integration to tripleoclient https://review.openstack.org/283857 | 20:10 |
| *** dshulyak has quit IRC | 20:12 | |
| *** xinwu has quit IRC | 20:16 | |
| *** mbound has joined #tripleo | 20:17 | |
| *** eil397 has joined #tripleo | 20:19 | |
| *** rbrady has quit IRC | 20:20 | |
| *** rbrady has joined #tripleo | 20:20 | |
| pradk | slagle, bnemec, hey guys, to help with reviewing aodh/gnocchi i added some notes from my local testing .. please review https://review.openstack.org/#/c/289435/3 and https://review.openstack.org/#/c/252032/ | 20:39 |
| slagle | pradk: cool, i actually just deployed with the patch | 20:40 |
| slagle | i forgot to pull the os-cloud-config one though | 20:40 |
| pradk | slagle, yea you'll need that and python-tripleoclient | 20:40 |
| pradk | for aodh: https://gist.github.com/pkilambi/3226a2698345b6af8d73 | 20:40 |
| *** xinwu has joined #tripleo | 20:41 | |
| pradk | for gnocchi: https://gist.github.com/pkilambi/af45c4cce8027e6517ca | 20:41 |
| pradk | https://review.openstack.org/#/c/272110/ | 20:41 |
| pradk | https://review.openstack.org/#/c/283857/ are dependent patches for aodh | 20:41 |
| *** Goneri has quit IRC | 20:44 | |
| slagle | pradk: is the aodh-api service supposed to be started? | 20:47 |
| slagle | or does that run under wsgi? | 20:47 |
| pradk | slagle, wsgi | 20:47 |
| slagle | it looks like something had tried to start it | 20:47 |
| slagle | but failed with Address already in use | 20:47 |
| pradk | slagle, with wsgi? | 20:48 |
| slagle | no, the service | 20:48 |
| slagle | openstack-aodh-api | 20:48 |
| slagle | i see it in the CI logs too | 20:49 |
| pradk | slagle, hmm which logs do you see on controller? messages? | 20:49 |
| slagle | http://logs.openstack.org/35/289435/3/check-tripleo/gate-tripleo-ci-f22-ha/a19f719/logs/overcloud-controller-0.tar.xz | 20:50 |
| pradk | slagle, openstack-aodh-api is not needed standalone as we use apache now | 20:50 |
| slagle | in /var/log/aodh/api.log | 20:50 |
| pradk | http://paste.openstack.org/show/490252/ | 20:51 |
| pradk | interesting i dont see that log | 20:51 |
| *** tdasilva has joined #tripleo | 20:51 | |
| pradk | hmm this mine is non ha | 20:51 |
| pradk | lemme check in ha case what could trigger this | 20:51 |
| pradk | + pacemaker::resource::service { $::aodh::params::api_service_name : | 20:52 |
| pradk | + clone_params => 'interleave=true', | 20:52 |
| pradk | + } | 20:52 |
| pradk | slagle, perhaps that should be httpd? | 20:52 |
| *** MaxPC has quit IRC | 20:53 | |
| slagle | possibly | 20:53 |
| slagle | yea, pacemaker is reporting it stopped | 20:54 |
| slagle | Clone Set: openstack-aodh-api-clone [openstack-aodh-api] | 20:54 |
| slagle | Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ] | 20:54 |
| slagle | Failed Actions: | 20:54 |
| slagle | * openstack-aodh-api_start_0 on overcloud-controller-1 'not running' (7): call=370, status=complete, exitreason='none', last-rc-change='Fri Mar 11 20:15:22 2016', queued=0ms, exec=2173ms | 20:54 |
| pradk | slagle, that would make sense.. i configure aodh::api with service name httpd, but looks like pacemaker resource is getting named to the service name | 20:55 |
| *** bvandenh has joined #tripleo | 20:57 | |
| pradk | slagle, is there an existing httpd pacemaker resource already i can use? | 20:57 |
| slagle | let me check how we did it for keystone in wsgi | 20:59 |
| pradk | Pacemaker::Resource::Service[$::apache::params::service_name] ? | 21:00 |
| slagle | right | 21:01 |
| slagle | so, you can just remove these 3 lines i think for aodh-api | 21:01 |
| slagle | since httpd is already a pacemaker resource | 21:01 |
| pradk | slagle, this should do it? http://paste.openstack.org/show/490257/ | 21:04 |
| slagle | i think so, yea | 21:05 |
| *** dshulyak has joined #tripleo | 21:05 | |
| openstackgerrit | Ben Nemec proposed openstack/puppet-tripleo: Allow enabling authentication on haproxy.stats https://review.openstack.org/290896 | 21:10 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Metrics tracking for TripleO deployment tasks https://review.openstack.org/291393 | 21:12 |
| *** dprince has quit IRC | 21:13 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Deploy Aodh services, replacing Ceilometer Alarm https://review.openstack.org/289435 | 21:20 |
| *** jayg is now known as jayg|g0n3 | 21:27 | |
| *** bvandenh has quit IRC | 21:34 | |
| openstackgerrit | Merged openstack/os-net-config: Add ability to set IPv6 routes in os-net-config templates https://review.openstack.org/268806 | 21:36 |
| pradk | slagle, running ha case locally now, i always end up with memory error.. lets see | 21:36 |
| *** rlandy has quit IRC | 21:37 | |
| *** jdob has quit IRC | 21:37 | |
| *** mkovacik has joined #tripleo | 21:39 | |
| *** panda has quit IRC | 21:40 | |
| *** panda has joined #tripleo | 21:41 | |
| *** r-mibu has quit IRC | 21:47 | |
| *** r-mibu has joined #tripleo | 21:47 | |
| *** thrash is now known as thrash|wknd | 21:57 | |
| openstackgerrit | Merged openstack/tripleo-common: Make Nova scheduler filter work with Liberty https://review.openstack.org/291849 | 21:58 |
| pradk | slagle, which log did you see the pacemaker issue? | 21:59 |
| *** dshulyak has left #tripleo | 22:00 | |
| slagle | pradk: it was just output of pcs status | 22:01 |
| *** dmsimard has joined #tripleo | 22:03 | |
| pradk | slagle, hmm says cluster is not running on this server .. the deploy succeed though | 22:05 |
| slagle | on one of the overcloud controllers? | 22:07 |
| slagle | it looks fixed to me :) | 22:07 |
| slagle | i just redeployed | 22:07 |
| pradk | $ ceilometer alarm-list | 22:07 |
| pradk | +--------------------------------------+----------+-------------------+----------+---------+------------+--------------------------------------+------------------+ | 22:07 |
| pradk | | Alarm ID | Name | State | Severity | Enabled | Continuous | Alarm condition | Time constraints | | 22:07 |
| pradk | +--------------------------------------+----------+-------------------+----------+---------+------------+--------------------------------------+------------------+ | 22:07 |
| pradk | | 6e9095d3-f418-40b1-9606-aa22017c3b03 | cpu_high | insufficient data | low | True | False | avg(cpu_util) > 70.0 during 3 x 600s | None | | 22:07 |
| pradk | +--------------------------------------+----------+-------------------+----------+---------+------------+--------------------------------------+------------------+ | 22:07 |
| pradk | able to create alarm in ha case now | 22:07 |
| pradk | slagle, i guess.. wonder why it says cluster not running on this server | 22:08 |
| pradk | slagle, can i remove those delay constraints ? jiri said we probably dont need them anymore | 22:08 |
| slagle | i'm not sure on that bit tbh | 22:09 |
| slagle | it looks good to me now, i +2'd them all | 22:09 |
| slagle | we can have jistr re-review | 22:10 |
| slagle | unless someone beats him to it :) | 22:10 |
| pradk | slagle, ok, i'll redeploy without delay constraints and see if it makes any diff | 22:11 |
| pradk | thx yea we can have jiri re-review | 22:11 |
| slagle | i gotta run, have a good wknd | 22:11 |
| pradk | later, you too! | 22:11 |
| *** lblanchard has quit IRC | 22:12 | |
| *** Goneri has joined #tripleo | 22:13 | |
| *** dmsimard is now known as dmsimard|pto | 22:15 | |
| *** trown is now known as trown|outtypewww | 22:18 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates: Enable predictable IPs on non-controllers https://review.openstack.org/291932 | 22:21 |
| *** Marga_ has quit IRC | 22:23 | |
| *** Marga_ has joined #tripleo | 22:24 | |
| *** zaneb has quit IRC | 22:30 | |
| *** xinwu has quit IRC | 22:31 | |
| *** Slower has joined #tripleo | 22:31 | |
| openstackgerrit | imain proposed openstack/tripleo-common: Allow run-os-net-config to be idempotent https://review.openstack.org/283389 | 22:34 |
| openstackgerrit | imain proposed openstack/tripleo-heat-templates: Add database directory mount for openvswitchdb https://review.openstack.org/291935 | 22:35 |
| *** david-lyle has quit IRC | 22:37 | |
| *** jtomasek has quit IRC | 22:38 | |
| openstackgerrit | Merged openstack/instack-undercloud: Configure nova to use custom scheduler filter https://review.openstack.org/291683 | 22:39 |
| openstackgerrit | Dan Sneddon proposed openstack/os-net-config: Fix order-of-operations bug in os-net-config restart_interfaces https://review.openstack.org/291420 | 22:39 |
| *** Marga_ has quit IRC | 22:44 | |
| *** zaneb has joined #tripleo | 22:44 | |
| *** Marga_ has joined #tripleo | 22:44 | |
| *** rcernin has joined #tripleo | 22:47 | |
| *** Slower has quit IRC | 22:48 | |
| *** zaneb has quit IRC | 22:52 | |
| *** dmsimard|pto has quit IRC | 22:52 | |
| *** Slower has joined #tripleo | 22:57 | |
| *** zaneb has joined #tripleo | 23:05 | |
| *** rcernin has quit IRC | 23:06 | |
| *** rcernin has joined #tripleo | 23:07 | |
| *** mbound has quit IRC | 23:09 | |
| *** MaxPC has joined #tripleo | 23:17 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-common: Create flavor as part of ping test https://review.openstack.org/291777 | 23:20 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-common: Boot from volume in ping test https://review.openstack.org/291779 | 23:20 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-common: Use m1.small for ping test https://review.openstack.org/291942 | 23:20 |
| *** trozet has quit IRC | 23:24 | |
| *** eil397 has quit IRC | 23:30 | |
| *** rcernin has quit IRC | 23:31 | |
| *** eil397 has joined #tripleo | 23:31 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!