*** mlupton has joined #tripleo | 00:00 | |
*** mlupton has quit IRC | 00:05 | |
*** vijaykc4 has quit IRC | 00:10 | |
*** thrash is now known as thrash|g0ne | 00:13 | |
*** yamahata has quit IRC | 00:14 | |
*** chlong has quit IRC | 00:16 | |
*** saneax is now known as saneax-_-|AFK | 00:42 | |
*** yamahata has joined #tripleo | 00:47 | |
*** Goneri has quit IRC | 00:56 | |
*** fzdarsky_ has joined #tripleo | 01:25 | |
*** akshai has quit IRC | 01:26 | |
*** fzdarsky|afk has quit IRC | 01:29 | |
*** vijaykc4 has joined #tripleo | 01:29 | |
*** dmacpher has joined #tripleo | 01:36 | |
*** chlong has joined #tripleo | 01:40 | |
*** bana_k has quit IRC | 01:41 | |
*** Goneri has joined #tripleo | 01:46 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: configure Heat with new authtoken parameters https://review.openstack.org/361412 | 01:47 |
---|---|---|
*** Ryjedo_ has joined #tripleo | 01:52 | |
*** Ryjedo has quit IRC | 01:53 | |
*** Ryjedo_ is now known as Ryjedo | 01:53 | |
openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Enable modern authtoken for Neutron and Glance https://review.openstack.org/362980 | 01:54 |
*** bana_k has joined #tripleo | 01:57 | |
*** limao has joined #tripleo | 02:03 | |
*** bkopilov has quit IRC | 02:05 | |
*** pblaho has quit IRC | 02:14 | |
*** Goneri has quit IRC | 02:15 | |
*** yamahata has quit IRC | 02:35 | |
*** anbu has quit IRC | 02:36 | |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Wire in jinja templating for custom roles https://review.openstack.org/362465 | 02:41 |
*** saneax-_-|AFK is now known as saneax | 02:43 | |
saneax | https://blueprints.launchpad.net/tripleo/+spec/tripleo-ovs-dpdk closed | 02:43 |
larsks | I have a review failing (quickly!) because "Exception registering nodes: Node 59a06f3a-41a9-4913-9a9e-85e3f157c420 is locked by host localhost.localdomain, please retry after the current operation is completed." I am sure that has nothing to do with my review, but is it something that will eventually clear up on its own? Or is something wedged that needs cleaning up? | 02:51 |
*** pblaho has joined #tripleo | 02:54 | |
*** pblaho has quit IRC | 02:59 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/os-collect-config: Updated from global requirements https://review.openstack.org/350905 | 03:08 |
*** vijaykc4 has quit IRC | 03:09 | |
*** vijaykc4 has joined #tripleo | 03:12 | |
*** bkopilov has joined #tripleo | 03:22 | |
*** pblaho has joined #tripleo | 03:24 | |
*** ayoung has quit IRC | 03:27 | |
*** bana_k has quit IRC | 03:29 | |
*** anbu has joined #tripleo | 03:30 | |
*** jdob has quit IRC | 03:34 | |
*** anbu_ has joined #tripleo | 03:38 | |
*** saneax is now known as saneax-_-|AFK | 03:40 | |
*** anbu__ has joined #tripleo | 03:41 | |
*** anbu has quit IRC | 03:42 | |
*** anbu_ has quit IRC | 03:44 | |
*** padkrish has joined #tripleo | 04:00 | |
*** bkopilov_ has joined #tripleo | 04:03 | |
*** bkopilov_ has quit IRC | 04:03 | |
*** bkopilov_ has joined #tripleo | 04:04 | |
*** crinkle_ has joined #tripleo | 04:16 | |
*** cschwede has quit IRC | 04:17 | |
*** crinkle has quit IRC | 04:17 | |
*** cschwede has joined #tripleo | 04:17 | |
*** mpsairam has quit IRC | 04:18 | |
*** tzumainn has quit IRC | 04:18 | |
*** bana_k has joined #tripleo | 04:23 | |
*** masco has joined #tripleo | 04:24 | |
*** pmannidi has joined #tripleo | 04:26 | |
*** pgadiya has joined #tripleo | 04:28 | |
*** fultonj has quit IRC | 04:34 | |
*** dtantsur|afk has quit IRC | 04:36 | |
*** links has joined #tripleo | 04:36 | |
*** coolsvap_ has joined #tripleo | 04:36 | |
*** limao has quit IRC | 04:37 | |
*** chlong has quit IRC | 04:38 | |
*** chlong has joined #tripleo | 04:39 | |
*** padkrish has quit IRC | 04:40 | |
*** padkrish has joined #tripleo | 04:41 | |
*** padkrish has quit IRC | 04:41 | |
*** chlong has quit IRC | 04:45 | |
*** limao has joined #tripleo | 04:53 | |
*** chlong has joined #tripleo | 04:57 | |
*** yamahata has joined #tripleo | 05:03 | |
*** yamahata has quit IRC | 05:06 | |
*** mcornea has joined #tripleo | 05:10 | |
*** bana_k has quit IRC | 05:13 | |
*** Ryjedo_ has joined #tripleo | 05:18 | |
*** fragatina has quit IRC | 05:19 | |
*** jaosorior has joined #tripleo | 05:21 | |
*** Ryjedo has quit IRC | 05:22 | |
*** Ryjedo_ is now known as Ryjedo | 05:22 | |
jaosorior | Can someone review this? https://review.openstack.org/#/c/359038/ | 05:35 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Move service/endpoint configuration to keystone profile https://review.openstack.org/359681 | 05:43 |
*** dbecker has joined #tripleo | 05:46 | |
*** ifarkas_afk has quit IRC | 05:50 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Remove the ha2 JOBTYPE https://review.openstack.org/363411 | 05:52 |
openstackgerrit | Babu Shanmugam proposed openstack/tripleo-heat-templates: OVN heat templates https://review.openstack.org/307734 | 05:58 |
*** fragatina has joined #tripleo | 06:02 | |
*** bvandenh has quit IRC | 06:04 | |
*** fragatina has quit IRC | 06:07 | |
*** bana_k has joined #tripleo | 06:11 | |
*** pcaruana has joined #tripleo | 06:15 | |
skramaja | jaosorior: CI passed fro the SR-IOV THT - https://review.openstack.org/#/c/361430/ - has 4 +2s, ptal | 06:18 |
jaosorior | skramaja: done | 06:19 |
skramaja | jaosorior: thanks. | 06:19 |
*** rcernin has joined #tripleo | 06:21 | |
*** xinwu has joined #tripleo | 06:23 | |
*** xinwu has left #tripleo | 06:27 | |
*** bana_k has quit IRC | 06:29 | |
*** abregman has quit IRC | 06:31 | |
*** hewbrocca-afk is now known as hewbrocca | 06:37 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Refactor DeploymentPlan Component https://review.openstack.org/358814 | 06:39 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Mistral Actions error handling https://review.openstack.org/359764 | 06:39 |
hewbrocca | Good morning everyone | 06:39 |
jaosorior | hewbrocca: sup dude, how's it going? | 06:39 |
hewbrocca | Very well thanks | 06:40 |
hewbrocca | I leave on PTO tomorrow! | 06:40 |
*** dsariel has joined #tripleo | 06:41 | |
jaosorior | nice! | 06:41 |
jaosorior | gonna travel anywhere? | 06:41 |
hewbrocca | La France! | 06:41 |
hewbrocca | BTW | 06:41 |
hewbrocca | if anyone has time to review these: | 06:41 |
jaosorior | nice! | 06:41 |
hewbrocca | https://review.openstack.org/#/c/353506/ and | 06:42 |
hewbrocca | https://review.openstack.org/#/c/254788/ | 06:42 |
hewbrocca | ops-tools reviews -- poor larsks keeps having to rebase them | 06:42 |
*** tobias_fiberdata has joined #tripleo | 06:43 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Roles Listing using Mistral Action https://review.openstack.org/360569 | 06:50 |
marios | hewbrocca: "i don't often ask for reviews, but when I do they are >1K lines" | 06:54 |
*** bvandenh has joined #tripleo | 06:55 | |
*** rasca has joined #tripleo | 06:55 | |
*** liverpooler has quit IRC | 06:56 | |
hewbrocca | IKR | 06:57 |
hewbrocca | this is why... | 06:57 |
marios | the https://review.openstack.org/#/c/254788/ is the parent for the sensu one ... i've previously +2d it but staring at it a bit in gitk cos I was away last week | 06:58 |
marios | err sorry parent of the fluentd one | 06:58 |
hewbrocca | Yeah they are in the unfortunate situation where their reviews touch every damn thing | 06:59 |
jaosorior | marios: can you review this one? https://review.openstack.org/#/c/359038/ only 14 lines :D | 07:01 |
marios | jaosorior: added to queue | 07:01 |
jtomasek | hm, the sensu patch still did not address comments I made - add environment to capabilities-map.yaml, parameters have no labels etc. defined ... | 07:02 |
jtomasek | same applies to the other one | 07:02 |
*** leanderthal|afk is now known as leanderthal | 07:05 | |
hewbrocca | jtomasek: blearrgh, OM | 07:06 |
hewbrocca | OK | 07:06 |
*** tesseract- has joined #tripleo | 07:08 | |
*** karthiks has quit IRC | 07:09 | |
*** florianf has joined #tripleo | 07:11 | |
*** shardy has joined #tripleo | 07:12 | |
*** jpena|off is now known as jpena | 07:13 | |
*** sshnaidm|afk is now known as sshnaidm | 07:15 | |
*** ifarkas has joined #tripleo | 07:18 | |
*** dciabrin has joined #tripleo | 07:20 | |
hewbrocca | jtomasek: can you make sure to poke mmagr / paramite when he gets on | 07:21 |
hewbrocca | and tell him to address those issues immediately | 07:21 |
jaosorior | marios: can you check out my comment on this patch you just +2ed? https://review.openstack.org/#/c/254788/ What do you think? | 07:22 |
marios | jtomasek: please add comment on the review | 07:22 |
jtomasek | ok, I've just started relying to the email Lars sent | 07:22 |
marios | jaosorior: looking | 07:22 |
*** bvandenh has quit IRC | 07:23 | |
marios | jaosorior: but each service has its own subscription though | 07:24 |
marios | jaosorior: i mean it is a separate string (default) for each service | 07:24 |
*** saneax-_-|AFK is now known as saneax | 07:24 | |
marios | jaosorior: oh you mean pacemaker vs base not 'for each service' (i saw the top level comment) | 07:25 |
jaosorior | marios: is it? Seems to me that pacemaker/ceilometer-agent-central.yaml is different than ceilometer-agent-central.yaml | 07:25 |
jaosorior | marios: yes | 07:25 |
jaosorior | I mean | 07:25 |
jaosorior | is the same | 07:25 |
jaosorior | those are the same | 07:26 |
jaosorior | and so | 07:26 |
jaosorior | each service has the same string in the pacemaker and non-pacemaker version | 07:26 |
marios | jaosorior: yeah so i guess we could just remove the param from the pacemaker version and use only the base, but again, i personally wouldn't block on it ... i may change my vote though since jtomasek says the requests are ui critical | 07:27 |
*** zoli_gone-proxy is now known as zoliXXL | 07:27 | |
jtomasek | marios: the changes to that patch are simple and bring great value to configuring those services via GUI | 07:28 |
*** jprovazn has joined #tripleo | 07:29 | |
d0ugal | shadower: Hey, can you re-review https://review.openstack.org/#/c/359784/? | 07:30 |
d0ugal | Anyone else got a moment to review ^? | 07:30 |
hewbrocca | marios: ISTR there were 4 or 5 reviews outstanding last week that are critical for 9-10 upgrades | 07:31 |
hewbrocca | you happen to know if those landed or not? | 07:31 |
shadower | d0ugal: sure. Can you see if my reply is satisfactory here? https://review.openstack.org/#/c/329039/20 | 07:31 |
marios | hewbrocca: not not yet there are still some workarouds | 07:31 |
d0ugal | shadower: Sure, sorry, I missed that reply. | 07:31 |
*** numans has joined #tripleo | 07:31 | |
marios | hewbrocca: sec | 07:31 |
*** mhenkel has joined #tripleo | 07:31 | |
*** panda|bbl is now known as panda | 07:32 | |
hewbrocca | marios: do we need e.g. FFEs for these? | 07:32 |
marios | hewbrocca: no upgrades always gets ffe | 07:32 |
marios | hewbrocca: i mean, we always land things after ff for upgrades because of the nature of, we are going to upgrade the thing we are yet to release | 07:33 |
d0ugal | jaosorior: This is the counterpart to the other command you reviewed if you have a moment: https://review.openstack.org/#/c/359784/ | 07:33 |
hewbrocca | marios: OK, I see | 07:33 |
d0ugal | shadower: Sounds good to me +2/+w | 07:33 |
hewbrocca | Any impediments to getting those fixes landed? | 07:33 |
shadower | thanks! | 07:33 |
d0ugal | +all-the-things | 07:33 |
shadower | indeed | 07:34 |
d0ugal | shadower: I'll take a look at the last one now | 07:34 |
*** ebalduf has quit IRC | 07:34 | |
shadower | d0ugal: thanks :-) | 07:34 |
marios | jaosorior: so, i added a comment at https://review.openstack.org/#/c/254788/ - I agree with your point. I do not intend to diminish it, just saying that this is a huuge patch, i can imagine the author/interested parties have been running and testing locally, and as you well know, such testing is expensive, time consuming, tedious etc etc. So whilst i agree with your comment, i personally wouldn't block sin | 07:35 |
marios | ce it isn't functionally borked? Like we could tidy up the params after. BUT | 07:35 |
jaosorior | d0ugal: why do you have to create an object store client? Isn't that available through the client_manager interface of OpenStack client? | 07:35 |
marios | jaosorior: it depends on the author and how willing/easy it is for them to make that change and test etc etc and not make any typos | 07:35 |
marios | jaosorior: but that is just imo | 07:35 |
d0ugal | jaosorior: It isn't swiftclient, it is a much lighter client that only does what they need. | 07:36 |
*** dmacpher has quit IRC | 07:36 | |
d0ugal | jaosorior: I added a wee comment about that here: https://review.openstack.org/#/c/359784/20/tripleoclient/plugin.py | 07:36 |
*** abregman has joined #tripleo | 07:36 | |
jaosorior | marios: sure thing. Only thing is that I think this amount of repetition adds to the technical depth and is stuff we have to maintain | 07:36 |
jaosorior | d0ugal: alright | 07:36 |
*** jpich has joined #tripleo | 07:37 | |
*** abregman has quit IRC | 07:37 | |
*** abregman has joined #tripleo | 07:38 | |
*** shardy has quit IRC | 07:39 | |
jaosorior | marios: but yeah, I know it's a tough commit | 07:39 |
jaosorior | I didn't -1 | 07:39 |
*** tremble has joined #tripleo | 07:39 | |
shadower | d0ugal: btw love the "overcast" plan name | 07:40 |
marios | jaosorior: ack :) it isn't particularly complex i think it is just a lot of files. i mean the basics is it adds service/sensu and env/config file for it, and then for each service adds the subscription. just a lot of services | 07:40 |
*** shardy has joined #tripleo | 07:40 | |
d0ugal | shadower: haha, thanks. I was waiting for somebody to comment on that :) | 07:40 |
d0ugal | shadower: I decided to stop using the default after I found it hardcoded somewhere any it was missed by tests. | 07:41 |
shadower | d0ugal: yeah it makes a lot of sense | 07:41 |
*** flepied has joined #tripleo | 07:43 | |
*** fzdarsky_ is now known as fzdarsky | 07:43 | |
panda | in case someone missed, today is the last day to register for free ATC pass | 07:46 |
*** dmacpher has joined #tripleo | 07:49 | |
*** bvandenh has joined #tripleo | 07:50 | |
*** nyechiel has joined #tripleo | 07:50 | |
*** xinwu has joined #tripleo | 07:52 | |
*** dbecker has quit IRC | 07:53 | |
*** bkopilov_ has quit IRC | 07:57 | |
*** bkopilov has quit IRC | 07:57 | |
*** liverpooler has joined #tripleo | 07:57 | |
*** xinwu has quit IRC | 07:57 | |
*** gfidente has joined #tripleo | 07:57 | |
*** gfidente has quit IRC | 07:57 | |
*** gfidente has joined #tripleo | 07:57 | |
*** liverpooler has quit IRC | 07:58 | |
*** liverpooler has joined #tripleo | 07:58 | |
*** zoliXXL is now known as zoli|afk | 08:00 | |
*** bkopilov has joined #tripleo | 08:01 | |
*** r-mibu has quit IRC | 08:02 | |
d0ugal | hrm, I thought tripleo-common was going to be released at 5.0 yesterday? | 08:04 |
d0ugal | I see 2.1.0 was released | 08:04 |
*** athomas has joined #tripleo | 08:04 | |
d0ugal | This means PyPI has 5.0 beta releases and a new 2.1 release | 08:04 |
d0ugal | PyPI versions: 0.0.2, 0.1.0, 0.1.1, 0.2.0, 0.2.1, 0.3.0, 0.3.1, 1.0.0, 2.0.0, 2.1.0, 5.0.0.0b1, 5.0.0.0b2 | 08:05 |
d0ugal | shardy: ^ | 08:05 |
*** chlong has quit IRC | 08:06 | |
d0ugal | ... but it looks like 2.1 isn't a recent version from git, so now I'm less sure :) | 08:07 |
honza | i'm having a hard time running tripleo-quickstart: the issue seems to be regarding the creation of a virsh pool. If it's there, it complains it's there. If I delete it, it complains it's not there. | 08:13 |
honza | the only arg i've specified is the release | 08:14 |
*** lucas-dinner is now known as lucasagomes | 08:20 | |
*** ohamada has joined #tripleo | 08:23 | |
jaosorior | honza: you might want to ask in the #oooq channel | 08:24 |
openstackgerrit | Julie Pichon proposed openstack/tripleo-specs: Update bug tag policy to match actual tag names https://review.openstack.org/363477 | 08:27 |
*** milan has joined #tripleo | 08:29 | |
shadower | shardy: on top of what d0ugal said, tripleo-validations did not seem to get a new release | 08:30 |
d0ugal | shadower: Maybe it hasn't happened yet? | 08:30 |
*** rhefner has quit IRC | 08:31 | |
d0ugal | shadower: I am only seeing Mitaka releases for everything | 08:31 |
*** derekh has joined #tripleo | 08:31 | |
shadower | d0ugal: I thought so, too but then I checked https://github.com/openstack/tripleo-heat-templates/releases | 08:32 |
shadower | which lists 2.1.0 as created 15 hours ago | 08:32 |
d0ugal | shadower: That is also 2.1, which I think is Mitaka | 08:32 |
shadower | so something does seem up | 08:32 |
shadower | ah okay | 08:32 |
d0ugal | shadower: 5.0 is Newton, there is only a beta for that | 08:32 |
shadower | right | 08:32 |
d0ugal | ... I think! | 08:32 |
shadower | i.e. we could still get some patches in if it weren't for the CI | 08:32 |
d0ugal | Aye | 08:33 |
shardy | d0ugal: no, we released mitaka yesterday | 08:33 |
*** r-mibu has joined #tripleo | 08:33 | |
shardy | we'll release 5.0.0b3 today if all goes to plan | 08:33 |
d0ugal | shardy: okay, cool - thanks :) | 08:33 |
shardy | shadower: ack, we'll release it today as part of newton-3 | 08:33 |
derekh | sshnaidm: so I spend some time yesterday trying to find out why we were sometimes getting timeouts in ipmitool, I noticed you were also looking at ipmitool timeouts last week | 08:33 |
shadower | shardy: btw just realised -- since tripleo-validations is already 5.0.0 (at the request of the release people), what should we call the final Newton version? | 08:34 |
* shadower didn't think about that at the time | 08:34 | |
shardy | shadower: I'll have to check with dhellmann, sounds like it's been considered a library, so we may have to increment from 5.0.0 | 08:35 |
derekh | sshnaidm: it turns out the ipmi library we use on our fake bmc ( pyghmi) had a bug in it and it didn't work if the client host used the same UDP port twice | 08:35 |
shadower | right | 08:35 |
honza | wait, is oooq just "tripleo quickstart"? | 08:35 |
shardy | shadower: the problem is, libraries were frozen recently, so I'm not sure we'll be allowed to release again :( | 08:35 |
shadower | honza: afaik yeah | 08:35 |
honza | ugh | 08:35 |
shardy | shadower: I'll chat with dhellmann and see what can be arranged | 08:35 |
derekh | sshnaidm: so that ended up getting fixed in this patch https://review.openstack.org/#/c/362944/ | 08:35 |
shardy | I had to fight to not release tripleo-common in the same way | 08:35 |
shadower | honza: "openstack on openstack quickstart" I think? Because things weren't confusing before | 08:35 |
derekh | sshnaidm: now we need to updated the template we use in CI to take advantage of it | 08:36 |
derekh | sshnaidm: do you want to do it? I can show you what needs to happen | 08:36 |
honza | shadower: and i'm here running around with google in my hand trying to find this elusive oooq project | 08:36 |
shadower | shardy: ah, that's not good :-( | 08:36 |
shardy | shadower: worst case we'll have to branch the repo early and handle patches as "stable" backports | 08:36 |
shadower | ok | 08:36 |
shardy | honza: it's https://github.com/openstack/tripleo-quickstart | 08:37 |
*** xinwu has joined #tripleo | 08:38 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role https://review.openstack.org/289027 | 08:40 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: [NO MERGE] Test Ceph RadosGW as replacement for Swift https://review.openstack.org/357182 | 08:41 |
gfidente | shardy, fwiw, I am investigating status of RGW submissions to reply on the list | 08:42 |
shardy | gfidente: ack, thanks | 08:42 |
gfidente | I want to get a better handle myself of how much work is left | 08:42 |
gfidente | ty :) | 08:42 |
*** xinwu has quit IRC | 08:43 | |
*** zoli|afk is now known as zoli | 08:45 | |
*** zoli is now known as zoliXXL | 08:45 | |
*** yolanda has joined #tripleo | 08:45 | |
sshnaidm | derekh, yeah, I'm here | 08:46 |
*** dbecker has joined #tripleo | 08:49 | |
d0ugal | jpich: Hey, did you ever hit this? http://paste.openstack.org/show/565102/ (note line 10 and all the lines above it) | 08:50 |
sshnaidm | derekh, which template are we talking about? | 08:50 |
derekh | when CI creates a testenv the bmc has some software installed on it, to speed this up we have a image template with the packages pre-installed, so you need to recreate the template | 08:51 |
sshnaidm | derekh, is it bmc_template image? | 08:51 |
derekh | sshnaidm: if you do a nova image-list as the openstack-nodepool user you should see an image called bmc-template | 08:51 |
derekh | sshnaidm: yes | 08:52 |
sshnaidm | derekh, ok | 08:52 |
sshnaidm | derekh, where is it constructed? | 08:52 |
derekh | sshnaidm: its a vanilla centos cloud image with this script run on it http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/bmc-template/bmc-template.sh | 08:52 |
derekh | sshnaidm: its contructed as part of "scripts/prepare-ovb-cloud.sh" | 08:52 |
derekh | sshnaidm: while I guess should be extracted out so it can be run independently | 08:53 |
derekh | It should be just a matter of logging onto the rh1 undercloud | 08:53 |
derekh | and running the code inside the if statement (line 73 here http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/prepare-ovb-cloud.sh) | 08:53 |
derekh | But you'll also need to run this command "nova image-delete bmc-template" | 08:53 |
derekh | befor the "nova image-create ..." | 08:53 |
derekh | sshnaidm: ^^ | 08:53 |
jpich | d0ugal: Yes, just a sec | 08:54 |
jpich | d0ugal: https://bugs.launchpad.net/tripleo/+bug/1611284 | 08:54 |
openstack | Launchpad bug 1611284 in tripleo "[tripleoclient] Wrong message displayed when running introspect_manageable_nodes workflow" [Medium,Fix released] - Assigned to Julie Pichon (jpichon) | 08:54 |
d0ugal | jpich: aha! Thanks :) | 08:55 |
derekh | sshnaidm: brb | 08:55 |
sshnaidm | derekh, if ! nova image-show bmc-template | 08:55 |
*** numans has quit IRC | 08:55 | |
jpich | d0ugal: You're welcome! | 08:55 |
sshnaidm | derekh, ok | 08:55 |
*** oneswig has joined #tripleo | 08:57 | |
d0ugal | jpich: so it turns out I was only hitting it because I hadn't activated my virtualenv, oops. | 09:00 |
*** karthiks has joined #tripleo | 09:00 | |
sshnaidm | derekh, afaiu pyghmi should be released for installing it with pip | 09:00 |
jpich | d0ugal: boo :) | 09:01 |
lucasagomes | derekh, fyi, pyghmi 1.0.9 does fix the problem of ipmi clients trying to reuse the UDP ports | 09:03 |
lucasagomes | derekh, I put a patch to requirements bumping the g-r in OS https://review.openstack.org/#/c/363497/ | 09:03 |
derekh | lucasagomes: ack, thanks | 09:04 |
derekh | sshnaidm: don't worry about the "if ! nova image-show bmc-template" | 09:04 |
derekh | sshnaidm: that there to prevent us having to run the code if the image already exists | 09:05 |
derekh | sshnaidm: in other words its there to stop us doing exactly what we want to do | 09:05 |
sshnaidm | derekh, yeah, exactly) | 09:05 |
*** nijaba has quit IRC | 09:05 | |
sshnaidm | derekh, we need to recreate the image, right? | 09:06 |
derekh | sshnaidm: so we need to manually run the code inside that if statement | 09:06 |
derekh | sshnaidm: with an extra image delete | 09:06 |
derekh | sshnaidm: yes to recreate the image | 09:06 |
derekh | sshnaidm: the the new version of pyghmi will be in the images | 09:06 |
*** nijaba has joined #tripleo | 09:07 | |
*** nijaba has quit IRC | 09:07 | |
*** nijaba has joined #tripleo | 09:07 | |
*** electrofelix has joined #tripleo | 09:07 | |
sshnaidm | derekh, afaik it's in all tenants there | 09:08 |
sshnaidm | derekh, is it same image in all tenants, or we need to do it for each one? | 09:09 |
*** numans has joined #tripleo | 09:10 | |
derekh | sshnaidm: yes it looks like it (I checked the uuid of the image), somebody must have made it public | 09:10 |
derekh | it may even have been me.............. | 09:11 |
sshnaidm | derekh, so I start deleting it, ok? | 09:11 |
openstackgerrit | Merged openstack/tripleo-quickstart: pin the undercloud-post and overcloud roles https://review.openstack.org/356669 | 09:12 |
derekh | sshnaidm: are you read to run the "nova image-create --poll bmc-template bmc-template" command yet? | 09:12 |
*** dtantsur has joined #tripleo | 09:13 | |
derekh | sshnaidm: wait until that point to delete the old one, then it wont be missing for as long | 09:13 |
dtantsur | Morning folks. My IRC bouncer went down yesterday evening (as well as my lab environment, sigh), so please repeat any pings. | 09:14 |
derekh | dtantsur: ping | 09:14 |
sshnaidm | derekh, does it create snapshot? | 09:14 |
*** abregman has quit IRC | 09:15 | |
derekh | sshnaidm: yes | 09:15 |
sshnaidm | derekh, ok, running | 09:15 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for keystone https://review.openstack.org/327029 | 09:15 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Add profile to write overcloud VIPs into /etc/hosts https://review.openstack.org/357762 | 09:16 |
dtantsur | derekh, From #rhos-mgt icmp_seq=1 Destination Host Unreachable | 09:18 |
sshnaidm | derekh, No server with a name or ID of 'bmc-template' exists | 09:18 |
derekh | sshnaidm: what did you run? | 09:18 |
sshnaidm | derekh, nova image-create --poll bmc-template bmc-template | 09:19 |
*** chem has joined #tripleo | 09:20 | |
derekh | sshnaidm: did you run the other code in the if statment to create the bmc-template VM ? | 09:20 |
sshnaidm | derekh, no | 09:20 |
sshnaidm | derekh, sorry, I don't follow - what is the order? | 09:21 |
derekh | sshnaidm: this is whats needed http://paste.openstack.org/show/565107/ | 09:21 |
derekh | sshnaidm: so it creates a VM, which installs some packages on it | 09:22 |
derekh | sshnaidm: then deletes the old snapshot and creates a new one | 09:22 |
sshnaidm | derekh, sorry, I thought you mean firstly to run snapshot creating | 09:22 |
*** limao has quit IRC | 09:22 | |
openstackgerrit | Martin André proposed openstack-infra/tripleo-ci: Add quotes around systemctl command in test https://review.openstack.org/363518 | 09:22 |
*** akrivoka has joined #tripleo | 09:22 | |
derekh | sshnaidm: ahh ok, no prob | 09:22 |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates: Ironic: enabled_services moved from ironic to ironic::conductor manifest https://review.openstack.org/363520 | 09:23 |
openstackgerrit | Michael Henkel proposed openstack/tripleo-heat-templates: add composable services for Contrail https://review.openstack.org/346799 | 09:24 |
sshnaidm | derekh, when booting it which network to use? ERROR (Conflict): Multiple possible networks found, | 09:26 |
openstackgerrit | Michael Henkel proposed openstack/puppet-tripleo: Added Contrail Composable Services https://review.openstack.org/348905 | 09:26 |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates: Ironic: enabled iPXE by default and make it configurable https://review.openstack.org/362148 | 09:26 |
derekh | sshnaidm: private | 09:27 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Generate composable service node_names lists https://review.openstack.org/355068 | 09:27 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Generate composable service node_names lists https://review.openstack.org/355068 | 09:28 |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates: Ironic: enabled iPXE by default and make it configurable https://review.openstack.org/362148 | 09:28 |
*** abregman has joined #tripleo | 09:28 | |
sshnaidm | derekh, hmm.. and what is $EXTNET here? it doesn't appear in the script | 09:29 |
*** yolanda has quit IRC | 09:30 | |
derekh | sshnaidm: hmmm, It must have been something at some stage, weird | 09:30 |
derekh | sshnaidm: leave it out, I don't think its needed | 09:30 |
sshnaidm | derekh, not to make the float ip? | 09:31 |
*** aufi has joined #tripleo | 09:32 | |
sshnaidm | derekh, why do we make float ip at all? we need only image there, isn't it? | 09:32 |
derekh | sshnaidm: it should just work without it I think | 09:33 |
*** _milan_ has joined #tripleo | 09:33 | |
derekh | sshnaidm: so we can ssh to the instance to check when the script is done | 09:33 |
derekh | sshnaidm: thats what the while loop is doing | 09:34 |
openstackgerrit | Dmitry Tantsur proposed openstack/puppet-tripleo: Ironic: manage PXE environment for conductors https://review.openstack.org/361109 | 09:34 |
sshnaidm | derekh, ok, so to wait a little | 09:34 |
derekh | sshnaidm: this script is what being run on the instance "http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/bmc-template/bmc-template.sh" | 09:35 |
*** milan has quit IRC | 09:35 | |
derekh | sshnaidm: exactly we're waiting on this line to be done "touch /var/tmp/ready" | 09:35 |
sshnaidm | derekh, ok, done, snapshot is ready, to continue to deleting? | 09:39 |
derekh | sshnaidm: go for it | 09:40 |
*** chem has quit IRC | 09:41 | |
sshnaidm | derekh, done | 09:41 |
*** chem has joined #tripleo | 09:42 | |
sshnaidm | derekh, need to make it public now? | 09:42 |
derekh | sshnaidm: great ;-) | 09:42 |
derekh | sshnaidm: last thing to do, is to make the image public | 09:42 |
derekh | sshnaidm: its not needed for CI but just so it can be used for the dev testenvs | 09:43 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: Refactor upgrade checks. https://review.openstack.org/357750 | 09:43 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: M/M upgrade sahara-api fails to restart. https://review.openstack.org/358022 | 09:43 |
sshnaidm | derekh, hmm.. glance image-update --visibility public 1aabe923-041d-46c2-b5bf-1bfa28317416 | 09:44 |
sshnaidm | 403 Forbidden: You are not authorized to complete this action. | 09:44 |
derekh | sshnaidm: do it as admin | 09:44 |
derekh | sshnaidm: all done, other users can see it now | 09:46 |
sshnaidm | derekh, yep | 09:46 |
*** gfidente has left #tripleo | 09:46 | |
derekh | ;-) | 09:46 |
*** gfidente has joined #tripleo | 09:46 | |
sshnaidm | derekh, thanks :) | 09:46 |
sshnaidm | derekh, so now the timeouts should be ok? | 09:47 |
derekh | sshnaidm: yes, I believe so(or at the very least there'll be less of them) | 09:47 |
sshnaidm | ok, I'll keep eye on it.. | 09:48 |
*** pgadiya has quit IRC | 09:49 | |
openstackgerrit | Martin André proposed openstack-infra/tripleo-ci: Fix scp command with IPv6 addresses https://review.openstack.org/363545 | 09:50 |
hewbrocca | is this the image caching thing? | 09:52 |
openstackgerrit | Martin André proposed openstack-infra/tripleo-ci: Fix scp command with IPv6 addresses https://review.openstack.org/363545 | 09:52 |
hewbrocca | oh, no, pxe | 09:52 |
openstackgerrit | yuyafei proposed openstack/tripleo-common: Replace raw_input with input to make PY3 compatible https://review.openstack.org/337129 | 09:57 |
openstackgerrit | Merged openstack/tripleo-specs: Spec: Centralized logging support https://review.openstack.org/356691 | 09:59 |
*** oneswig has quit IRC | 10:02 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Fix Ironic service bind IPs https://review.openstack.org/361459 | 10:03 |
*** ifarkas_ has joined #tripleo | 10:05 | |
*** pgadiya has joined #tripleo | 10:07 | |
*** mburned is now known as mburned_out | 10:08 | |
*** jubapa has joined #tripleo | 10:08 | |
*** zoliXXL is now known as zoli|lunch | 10:11 | |
*** adarazs is now known as adarazs_lunch | 10:12 | |
jaosorior | jistr, marios: Hey guys, I'm trying to use mod_ssl from apache, but for some reason it doesn't seem to get installed when I enable it in puppet (in my case by including ::keystone::wsgi::apache and setting ssl to true) am Imissing something? | 10:13 |
*** jubapa has quit IRC | 10:13 | |
EmilienM | good morning | 10:15 |
EmilienM | jaosorior: yeah puppet doesn't install the package (on purpose in puppetlabs apache) | 10:16 |
EmilienM | jaosorior: ayoung had the same thing with mellon | 10:16 |
EmilienM | you need to manage the package yourself, I sugest by using ensure_package | 10:16 |
shardy | sshnaidm: Hi, do you have any bug references re failing periodic jobs? | 10:16 |
shardy | http://status-tripleoci.rhcloud.com/ | 10:17 |
EmilienM | periodic still failing? | 10:17 |
shardy | I see we've not had a clean run in a few days, wondering how close we are to fixing that, or if we need to derive the release SHA's from some non-periodic job run | 10:17 |
sshnaidm | shardy, not yet, it's planned, for now it's tracked in: https://etherpad.openstack.org/p/tripleo-ci-status | 10:17 |
sshnaidm | shardy, the main problem is timeouts | 10:18 |
sshnaidm | shardy, as you see in http://status-tripleoci.rhcloud.com/ almost every ha job fails because of timeout | 10:18 |
EmilienM | can we change the pipeline? | 10:19 |
EmilienM | and remove ha job | 10:19 |
EmilienM | from promotion pipeline | 10:19 |
EmilienM | temporary | 10:19 |
shardy | Yeah we've clearly got performance problems with rh1 which I know bnemec is looking into | 10:19 |
sshnaidm | shardy, I try to make a workaround here: https://review.openstack.org/#/c/362904/ | 10:19 |
jaosorior | EmilienM: that makes sense now. thanks! | 10:19 |
jaosorior | EmilienM: what time is it there? | 10:20 |
shardy | good morning EmilienM btw! :) | 10:20 |
EmilienM | jaosorior: 6.20 am | 10:20 |
jaosorior | holy crap | 10:21 |
jaosorior | that's early | 10:21 |
EmilienM | I'm an early bird today | 10:21 |
sshnaidm | EmilienM, we can, but it's too radical step imho, we can just a limit the feature tests there - without overcloud delete and undercloudidempotent | 10:21 |
shardy | EmilienM: I'd suggest we push a WIP patch to t-h-t which makes a change e.g to a comment, then recheck until it's all green & use the SHA's from that run and the parent of the WIP patch for the release? | 10:21 |
EmilienM | shardy: yes | 10:22 |
shardy | EmilienM: ack, I'll push a patch now | 10:22 |
jaosorior | EmilienM: is there a difference between just using package and using ensure_package? | 10:23 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: WIP testing do not merge https://review.openstack.org/363560 | 10:23 |
shardy | jtomasek, shadower: since they're not yet tested in CI, what SHA's do you want for tripleo-ui and tripleo-validations? | 10:25 |
EmilienM | jaosorior: yes, wieh ensure_package you can declare it multiple time without resource duplication | 10:25 |
EmilienM | jaosorior: while package can be used once for a resource | 10:25 |
shardy | is the current master HEAD OK? | 10:25 |
EmilienM | no | 10:26 |
shadower | shardy: yeah. I.e.: 3c031c68e63d584079ed6195a8516d6b2fe5d9c7 | 10:26 |
EmilienM | we need latest consistent | 10:26 |
jaosorior | EmilienM: good to nkow. Will use that then, thanks a lot man | 10:26 |
EmilienM | 59/91/599171ade4475709ddd8544e7dfd7ee4ba4ba2a2_54a99005 | 10:26 |
shadower | hey folks, this seems to fix a CI issue: https://review.openstack.org/#/c/363545/ | 10:26 |
EmilienM | this is the latest consistent ^ | 10:26 |
shadower | is there a way to have a patch try it out to verify? | 10:27 |
*** abehl has joined #tripleo | 10:27 | |
shardy | EmilienM: sure, we can compare with the versions in the delorean-current used for the CI run on the patch I just posted | 10:27 |
shardy | I'm just making sure there aren't any release blocker pending patches | 10:27 |
jtomasek | shardy: yes, tripleo-ui master is fine | 10:29 |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fix an autoclass reference and add missing pages to the toctree https://review.openstack.org/342747 | 10:30 |
EmilienM | shardy: ok I thought you wanted to test all latest openstack packages | 10:30 |
EmilienM | sshnaidm: go for limit | 10:30 |
shardy | EmilienM: I don't see how we can, given that current-tripleo hasn't promoted in 7 days | 10:30 |
shardy | EmilienM: I just want to get a snapshot from a green CI run so we know a good point-in-time for the current tripleo repos | 10:32 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for keystone https://review.openstack.org/327029 | 10:32 |
shardy | clearly it would be better if we had a newer current-tripleo pin, we'll have to fix that ASAP before the rc1 release | 10:32 |
EmilienM | shardy: fair enough | 10:32 |
EmilienM | I got one patch yesterday with all green | 10:33 |
shardy | It needs to be a patch which doesn't make any changes though, so we can derive that the parent SHA is OK? | 10:33 |
sshnaidm | shardy, sorry for nit, but what do you think about this? https://review.openstack.org/#/c/362904/ | 10:33 |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates: Ironic: enabled iPXE by default and make it configurable https://review.openstack.org/362148 | 10:34 |
EmilienM | shardy: perfect | 10:34 |
shardy | Ok https://bugs.launchpad.net/tripleo/+milestone/newton-3 is all green, now we can wait for https://review.openstack.org/#/c/363560/ to (hopefully) pass and base the release on that | 10:35 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Last round of modern authtoken update https://review.openstack.org/363182 | 10:36 |
EmilienM | shardy: can you approve https://review.openstack.org/#/c/362980/ please? | 10:36 |
EmilienM | shardy: great news | 10:36 |
EmilienM | and also can you guys review https://review.openstack.org/#/c/362504/ please? all green | 10:37 |
jtomasek | florianf: you can merge you'r GUI patch now (+ tiny fix the other one and we can merge that one too) before shardy takes GUI master and releases it:) | 10:38 |
shardy | jtomasek: if that WIP patch passes CI it's too late, but I'm guessing we'll need to do rechecks | 10:39 |
florianf | jtomasek: did you +2 yet? | 10:40 |
jtomasek | florianf: yes | 10:40 |
jtomasek | florianf: and added comment to this one https://review.openstack.org/#/c/361561/ | 10:40 |
florianf | jtomasek: yep, just saw it | 10:41 |
*** ansiwen has quit IRC | 10:42 | |
EmilienM | jaosorior: I suggest you to read https://github.com/puppetlabs/puppetlabs-stdlib/blob/master/lib/puppet/parser/functions/ensure_packages.rb | 10:44 |
dtantsur | folks, do you have a quick hint where I screwed up syntax in https://review.openstack.org/#/c/362148/5/puppet/services/ironic-conductor.yaml ? | 10:46 |
EmilienM | jaosorior: wait in puppet ci we include ::apache::mod::ssl and it works | 10:47 |
jaosorior | EmilienM: huh? | 10:48 |
jaosorior | EmilienM: yeah, that's the puzzling thing. When I had read the code for the ::apache::mod it seems to do the package install | 10:48 |
*** paramite has joined #tripleo | 10:48 | |
EmilienM | jaosorior: https://github.com/puppetlabs/puppetlabs-apache/blob/master/manifests/mod/ssl.pp#L70-L72 | 10:48 |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Port plan-edit file listing to use Swift https://review.openstack.org/361561 | 10:48 |
EmilienM | but tripleo overcloud prevents to install packages | 10:48 |
EmilienM | you need to patch puppet elements | 10:49 |
EmilienM | dprince wrote a provider in puppet tripleo to noop any Package resource iirc | 10:49 |
jaosorior | EmilienM: I see | 10:49 |
jaosorior | so we need to do the same for mod_auth_mellon I guess | 10:49 |
EmilienM | because we want everything managed in the image | 10:49 |
EmilienM | yes | 10:49 |
EmilienM | maybe you can confirm with him | 10:49 |
jaosorior | well, that makes sense | 10:49 |
EmilienM | but I'm almost sure now | 10:49 |
dtantsur | "dprince wrote a provider in puppet tripleo to noop any Package resource" WUT? | 10:50 |
dtantsur | so this is why PXE configuration does not work, right? | 10:50 |
jaosorior | EmilienM: by the way | 10:50 |
jaosorior | EmilienM: for some reason, puppet-barbican isn't getting included in the images | 10:50 |
EmilienM | https://github.com/openstack/puppet-tripleo/blob/master/lib/puppet/provider/package/norpm.rb | 10:50 |
EmilienM | dtantsur: ^ | 10:50 |
dtantsur | this is insane | 10:51 |
EmilienM | jaosorior: is it in puppet elements? | 10:51 |
EmilienM | iirc yes | 10:51 |
jaosorior | EmilienM: AFAIK yes | 10:51 |
dtantsur | that means that random puppet elements we include will just silently not work | 10:51 |
dtantsur | social, ^^ we need fox fix dpri...ee I mean puppet elements | 10:51 |
dtantsur | s/fox/to/ dunno how I typed that | 10:51 |
hewbrocca | we definitely need to fix dprince | 10:51 |
hewbrocca | that's well established :D | 10:52 |
EmilienM | dtantsur: no | 10:52 |
EmilienM | packages need to be managed in puppet element | 10:52 |
EmilienM | not in puppet | 10:52 |
EmilienM | ie: puppet-tripleo, puppet-nova, etc | 10:52 |
EmilienM | they need to be managed in tripleo puppet elements | 10:52 |
dtantsur | EmilienM, when do you plan to fix all puppet modules in the world to comply with it? >_< | 10:52 |
EmilienM | because we think tripleo is better with a prepared image | 10:52 |
EmilienM | dtantsur: tomorrow morning | 10:52 |
EmilienM | not today lol | 10:52 |
* dtantsur is close to rage quit | 10:52 | |
shardy | dtantsur: you can re-enable package install by passing EnablePackageInstall: true | 10:53 |
openstackgerrit | Babu Shanmugam proposed openstack/tripleo-heat-templates: OVN heat templates https://review.openstack.org/307734 | 10:53 |
dtantsur | well, if you ask for it... now we'll have tftp-server and ipxe-bootimgs on the overcloud | 10:53 |
shardy | dtantsur: https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.yaml#L227 | 10:53 |
dtantsur | I hope nobody -2s this request | 10:53 |
EmilienM | dtantsur: -3 | 10:53 |
shardy | dtantsur: so, the context is we need to support deployment with only images, and no external connectivity | 10:54 |
florianf | jtomasek: I updated https://review.openstack.org/#/c/361561/ | 10:54 |
shardy | so any new packages must be able to be built into the overcloud-full image | 10:54 |
dtantsur | shardy, then why don't we *fail* with a reasonable message? | 10:54 |
jaosorior | shardy: where do I add stuff to overcloud-full? | 10:54 |
*** thrash|g0ne is now known as thrash | 10:54 | |
florianf | jtomasek: we need another reviewer. honza? ^ | 10:54 |
shardy | however, folks can enable package install if they want and use "thin" images, it's just not our default | 10:54 |
dtantsur | it's a pure luck I saw this conversation, otherwise social and me would get gray hair today | 10:54 |
shardy | dtantsur: agreed, if we dont then please raise a bug, it needs fixing | 10:54 |
dtantsur | shardy, sure, against what? | 10:55 |
shardy | dtantsur: raise it on the main tripleo launchpad and we'll decide where it needs to get fixed | 10:55 |
jtomasek | florianf: you can +2 this one in the meantime so it runs the CI https://review.openstack.org/#/c/360550/ | 10:55 |
shardy | we should have the puppet provider interpret that boolean, and raise an error if any package install is attempted | 10:55 |
dtantsur | "Sorry, something just went wrong in Launchpad. " | 10:57 |
* dtantsur quits for real | 10:57 | |
jaosorior | shardy: which element in tripleo-puppet-elements is for overcloud-full? | 10:57 |
shardy | jaosorior: we include a bunch of different elements, what do you need to add? | 10:58 |
jaosorior | shardy: I need to add some packages | 10:59 |
jaosorior | shardy: mod_ssl for the TLS work and mod_auth_mellon for fedeartion (to start with) | 10:59 |
*** mburned_out is now known as mburned | 11:01 | |
thrash | jaosorior: overcloud-full is actually in instack-undercloud | 11:01 |
jaosorior | thrash: excellent, thanks man | 11:02 |
*** rhallisey has joined #tripleo | 11:02 | |
shardy | https://github.com/openstack/tripleo-puppet-elements/blob/master/elements/overcloud-controller/install.d/package-installs-overcloud-controller | 11:02 |
jaosorior | thrash: uhm... there doesn't seem to be much there, only glance installs, what's up there? | 11:02 |
*** tobias-fiberdata has joined #tripleo | 11:03 | |
shardy | yeah but probably it's best to add them to the overcloud-controller element | 11:03 |
thrash | jaosorior: I was just looking at that... you might want to use overcloud-base instead. i | 11:03 |
shardy | IIRC overcloud-full is somewhat unused now | 11:03 |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-puppet-elements: Install ipxe-bootimgs and tftp-server on controller https://review.openstack.org/363576 | 11:03 |
dtantsur | shardy, correct ^^^? | 11:04 |
dtantsur | also a bug: https://bugs.launchpad.net/tripleo/+bug/1618834 | 11:04 |
openstack | Launchpad bug 1618834 in tripleo "Fail with an explicit error when a puppet module attempts to install a package" [Medium,Triaged] | 11:04 |
thrash | jaosorior: or overcloud-controller | 11:04 |
shardy | dtantsur: yup, +2, thanks | 11:05 |
dtantsur | now I need some help please figuring our a syntax problem in https://review.openstack.org/#/c/362148/5/puppet/services/ironic-conductor.yaml presumably in the list_join part. | 11:05 |
thrash | jaosorior: overcloud-controller might be better for you as well. | 11:05 |
*** tobias_fiberdata has quit IRC | 11:05 | |
*** pkovar has joined #tripleo | 11:06 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-puppet-elements: Add mod_ssl to overcloud-controller element https://review.openstack.org/363578 | 11:06 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-puppet-elements: Add mod_auth_mellon to overcloud-controller element https://review.openstack.org/363579 | 11:06 |
jaosorior | thrash, shardy ^^ | 11:06 |
jaosorior | ah | 11:07 |
jaosorior | I missed something I guess | 11:07 |
shardy | dtantsur: what error does it give? | 11:08 |
thrash | jaosorior: follow the same pattern. append '_package', then map in the package map | 11:08 |
dtantsur | shardy, puppet fails when it can't find files from the package it expects to be installed (precisely, /usr/share/ipxe/undionly.kpxe) | 11:08 |
thrash | although I suppose that's not *totally* necessary | 11:08 |
thrash | jaosorior: but better to stick with the existing pattern here. :) | 11:09 |
*** fzdarsky is now known as fzdarsky|lunch | 11:09 | |
dtantsur | thrash, jaosorior, one day we might support non-RH distributions, then it will be required.. | 11:09 |
openstackgerrit | Michael Henkel proposed openstack/puppet-tripleo: Added Contrail Composable Services https://review.openstack.org/348905 | 11:09 |
openstackgerrit | Merged openstack/tripleo-ui: Use Mistral/Zaqar for folder-based plan-creation https://review.openstack.org/360550 | 11:09 |
dtantsur | e.g. all openstack packages don't have "openstack" prefix on debian/ubuntu | 11:09 |
dtantsur | ipxe-bootimgs is just ipxe, etc | 11:10 |
jaosorior | thrash: is the _package suffix needed? | 11:10 |
thrash | jaosorior: so yeah. use the pkg-map. :) | 11:10 |
shardy | dtantsur: I mean the template, why do you think the syntax is broken, what error does heat give? | 11:10 |
thrash | jaosorior: I would stick with using it. | 11:10 |
jaosorior | thrash: I didn't use it when I introduced the certmonger package there | 11:10 |
thrash | jaosorior: that part is completely arbitrary. But use of the pkg-map is not. | 11:11 |
dtantsur | ah | 11:11 |
dtantsur | shardy, "The Referenced Attribute (ControllerServiceChain role_data) is incorrect" | 11:11 |
*** bkopilov has quit IRC | 11:11 | |
jaosorior | thrash: ok, fixing the commits | 11:12 |
openstackgerrit | Michael Henkel proposed openstack/tripleo-heat-templates: add composable services for Contrail https://review.openstack.org/346799 | 11:13 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-puppet-elements: Add mod_ssl to overcloud-controller element https://review.openstack.org/363578 | 11:14 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-puppet-elements: Add mod_auth_mellon to overcloud-controller element https://review.openstack.org/363579 | 11:14 |
jaosorior | thrash, shardy, EmilienM ^^ | 11:14 |
*** paramite has quit IRC | 11:14 | |
shardy | dtantsur: it's a problem with IronicIPXEPort, heat doesn't like trying to join an integer into a string | 11:15 |
dtantsur | shardy, hmm, this was one of my suspects. do you think it's better to just make it a string or somehow convert number -> string? | 11:16 |
shardy | dtantsur: the easiest fix is s/number/string in the parameter type | 11:16 |
shardy | I'd just change the parameter type | 11:16 |
dtantsur | ack, thanks a lot | 11:16 |
shardy | it is a bug though, I'll raise a heat bug so we can cast it internally | 11:16 |
shardy | dtantsur: FYI this is how I debugged it - I hacked your template so it could be created standalone: | 11:18 |
shardy | http://paste.fedoraproject.org/417847/42242147/ | 11:18 |
shardy | heat stack-create id1 -f ironic_debug.yaml | 11:18 |
shardy | heat output-show id1 role_data | 11:18 |
shardy | there is another heat bug related to output validation, when that is fixed we'll surface a better error when this happens | 11:18 |
dtantsur | shardy, wow, cool! mind writing a blog post on it? or is it obvious for people who have a clue about heat? :) | 11:18 |
openstackgerrit | Michael Henkel proposed openstack/tripleo-heat-templates: add composable services for Contrail https://review.openstack.org/346799 | 11:19 |
*** mkovacik__ has joined #tripleo | 11:19 | |
shardy | dtantsur: possibly the second thing, but I'll definitely think about it if you think it would be helpful to folks :) | 11:19 |
shardy | glad it was a simple fix | 11:20 |
*** maeca1 has joined #tripleo | 11:20 | |
dtantsur | shardy, maybe at least a couple of lines in the troubleshooting guide :) I guess with time we'll get more and more folks who don't know heat well enough | 11:20 |
dtantsur | (I hope at least) | 11:20 |
*** ramishra has quit IRC | 11:21 | |
shardy | dtantsur: Yeah, hopefully soon the error the user sees will be a lot clearer though | 11:21 |
shardy | https://bugs.launchpad.net/heat/+bug/1599114 | 11:21 |
openstack | Launchpad bug 1599114 in heat "Outputs aren't correctly validated" [Medium,In progress] - Assigned to Oleksii Chuprykov (ochuprykov) | 11:21 |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates: Ironic: enabled iPXE by default and make it configurable https://review.openstack.org/362148 | 11:21 |
shardy | That is the reason we need the extra step of creating the standalone template, it should just fail and the error exposed to the user | 11:21 |
dtantsur | yeah, makes sense | 11:22 |
*** _milan_ has quit IRC | 11:22 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role https://review.openstack.org/289027 | 11:22 |
shardy | When that is fixed, the error you saw would be like "Output error: Items to join must be string, map or list not 8088" | 11:22 |
shardy | which probably would have led you straight to the problem | 11:23 |
*** ramishra has joined #tripleo | 11:23 | |
dtantsur | shardy, yeah... now I wonder how to delete the failed stack | 11:23 |
dtantsur | aha, the third delete attempt worked | 11:23 |
*** shardy is now known as shardy_lunch | 11:24 | |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common: Allow for building specific images https://review.openstack.org/363095 | 11:25 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for keystone https://review.openstack.org/327029 | 11:25 |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Port plan-edit file listing to use Swift https://review.openstack.org/361561 | 11:26 |
*** adarazs_lunch is now known as adarazs | 11:27 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role https://review.openstack.org/289027 | 11:28 |
dtantsur | hmm, folks, have you seen http://logs.openstack.org/76/363576/1/check/gate-tripleo-ci-centos-7-nonha-multinode/8877c14/console.html#_2016-08-31_11_24_33_633896 before? | 11:29 |
openstackgerrit | Brad P. Crochet proposed openstack-infra/tripleo-ci: Only ask for the overcloud-full image https://review.openstack.org/363592 | 11:29 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Add barbican profile https://review.openstack.org/352447 | 11:29 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Add barbican profile https://review.openstack.org/352447 | 11:30 |
openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient: Deprecate 'overcloud image build' command https://review.openstack.org/337676 | 11:31 |
*** jbadiapa has quit IRC | 11:32 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add Barbican to the overcloud - WIP https://review.openstack.org/352458 | 11:32 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: DO NOT MERGE - TESTING BARBICAN https://review.openstack.org/353262 | 11:32 |
*** zoli|lunch is now known as zoli | 11:36 | |
jaosorior | dtantsur: there seems to be something quite screwed today in the CI | 11:36 |
*** zoli is now known as zoliXXL | 11:36 | |
dtantsur | sigh... | 11:36 |
jaosorior | have seen that and other really weird stuff today :/ | 11:36 |
jaosorior | patches are failing like there's no tomorrow | 11:36 |
dtantsur | I hope you guys do give me feature freeze exception for ironic services :) seems like there is no chance of landing anything substantial today | 11:36 |
dtantsur | questions continue :) is it possible to use {get_param: ..} in dport fields for firewall_rules like https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/ironic-conductor.yaml#L56? | 11:41 |
dtantsur | I've just realized I need to open this port as well | 11:41 |
dtantsur | this = iPXE one | 11:41 |
honza | florianf: looking | 11:41 |
jaosorior | dtantsur: which dport field? | 11:42 |
dtantsur | jaosorior, see the link for an example | 11:42 |
*** lucasagomes is now known as lucas-hungry | 11:43 | |
florianf | honza: thx! | 11:43 |
jaosorior | dtantsur: you should be able to do get_param. Depending on where you want to get that value from though | 11:43 |
florianf | akrivoka: thanks for the review! | 11:44 |
florianf | honza: ^ | 11:44 |
dtantsur | jaosorior, ok thanks, I'll just try it | 11:44 |
akrivoka | florianf: yw :) | 11:44 |
jaosorior | EmilienM: where are we getting the endpoint for the keystone puppet provider in tripleo? from the ini file? | 11:46 |
*** zoliXXL is now known as zoli|brb | 11:47 | |
*** coolsvap_ is now known as coolsvap | 11:47 | |
mcornea | gfidente: hi! quick one re https://review.openstack.org/#/c/362816/ - how can I activate the Ceph RGW ? | 11:49 |
gfidente | mcornea, I am testing that locally as well | 11:49 |
*** sshnaidm is now known as sshnaidm|afk | 11:50 | |
gfidente | mcornea, but you'd need quite a few patches | 11:50 |
gfidente | mcornea, puppet-ceph: https://review.openstack.org/#/c/363164/ https://review.openstack.org/#/c/347956/ | 11:51 |
gfidente | mcornea, puppet-tripleo: https://review.openstack.org/#/c/334081/ (it depends on two more changes for puppet-tripleo, see the tree) | 11:51 |
gfidente | mcornea, tht: https://review.openstack.org/#/c/289027/52 | 11:51 |
hewbrocca | oh boy | 11:52 |
openstackgerrit | Merged openstack/tripleo-ui: Port plan-edit file listing to use Swift https://review.openstack.org/361561 | 11:52 |
hewbrocca | sshnaidm|afk: and derekh is there any possibility that pxe change to CI this morning is causing CI failures? | 11:52 |
mcornea | gfidente: ok, they're quite a lot,checking them | 11:53 |
colonwq | It is a long thread which pulling in a lot of code. | 11:53 |
gfidente | mcornea, are you okay sharing the env where I am doing it otherwise? | 11:53 |
*** rhallisey has quit IRC | 11:54 | |
mcornea | gfidente: yeah, that works as well but I'd prefer to check them first so I get familiar with what's happening there | 11:55 |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates: Ironic: enabled iPXE by default and make it configurable https://review.openstack.org/362148 | 11:55 |
*** oshvartz has joined #tripleo | 11:56 | |
*** mhenkel has quit IRC | 11:56 | |
gfidente | mcornea, ack thanks for helping | 11:57 |
jaosorior | gfidente: I had asked you this before but I can't find it again :( where did the replacement from network name to IP took place? | 11:58 |
*** rhallisey has joined #tripleo | 11:59 | |
derekh | hewbrocca: whats failing, readin back | 12:01 |
*** mkovacik__ is now known as milan | 12:01 | |
jaosorior | derekh: everything | 12:01 |
*** panda is now known as panda|lunch | 12:01 | |
jaosorior | or at least it has been a while since I've seen the ovb patches or the multinode patches pass | 12:01 |
gfidente | sshnaidm|afk, derekh, jaosorior the multinode job is failing with what seems to be an ipv6 issue in infra | 12:02 |
gfidente | ssh: connect to host 2001 port 22: Invalid argument | 12:02 |
gfidente | the command is actually an scp against 2001:4800:1ae1:18:f816:3eff:fe02:1d89 | 12:03 |
gfidente | so this is "a problem of brackets" it seems | 12:03 |
hewbrocca | that never happened before | 12:03 |
shadower | gfidente: https://review.openstack.org/#/c/363545/ | 12:03 |
gfidente | http://logs.openstack.org/12/357312/10/check/gate-tripleo-ci-centos-7-nonha-multinode/0cbb93c/console.html#_2016-08-31_11_23_40_079668 | 12:03 |
derekh | hewbrocca: did you mean ipmi change this morning (the one I was talking sshnaidm|afk through?) | 12:04 |
shadower | gfidente: that patch has a fix | 12:04 |
gfidente | shadower, ack +1 :) | 12:04 |
gfidente | derekh, ^^ | 12:04 |
shadower | gfidente: it's mandre's work :-) | 12:04 |
*** morazi has joined #tripleo | 12:04 | |
gfidente | can we merge it? | 12:04 |
gfidente | looks like it made multinode green so I wouldn't wait more | 12:04 |
*** jaosorior has quit IRC | 12:04 | |
derekh | gfidente: jaosorior: hewbrocca if the non ovb jobs are failing then there is no chance the update to pyghmi had anything to do with it | 12:04 |
hewbrocca | OK | 12:05 |
mandre | gfidente: hold on, there is more scp invocations that I'm fixing right now | 12:05 |
hewbrocca | I'm just automatically nervous about any CI change | 12:05 |
gfidente | mandre :) | 12:05 |
shadower | hewbrocca: what's the worst that can happen | 12:05 |
hewbrocca | wait | 12:05 |
gfidente | sorry you got into the brackets spirale as well | 12:05 |
hewbrocca | these are real bugs? | 12:05 |
hewbrocca | in that case, hurray for CI actually working like it's supposed to | 12:05 |
*** jaosorior has joined #tripleo | 12:06 | |
*** jayg|g0n3 is now known as jayg | 12:06 | |
shadower | hewbrocca: nope, atleast the ipv6 thing is a CI bug I think | 12:06 |
hewbrocca | Oh | 12:07 |
*** rodrigods has quit IRC | 12:09 | |
*** rodrigods has joined #tripleo | 12:09 | |
*** zoli|brb is now known as zoli | 12:11 | |
*** zoli is now known as zoliXXL | 12:11 | |
openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: Add fluentd client service https://review.openstack.org/353506 | 12:12 |
*** dtantsur is now known as dtantsur|bbl | 12:12 | |
*** jpena is now known as jpena|lunch | 12:12 | |
*** dprince has joined #tripleo | 12:13 | |
*** shardy_lunch is now known as shardy | 12:15 | |
*** tobias-fiberdata has quit IRC | 12:20 | |
*** pradk has joined #tripleo | 12:20 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Bind to FQDNs instead of IPs https://review.openstack.org/363616 | 12:22 |
hewbrocca | folks, special attention for 353506 ^^^ please? | 12:22 |
hewbrocca | marios, jaosorior ^^^ | 12:22 |
*** tobias-fiberdata has joined #tripleo | 12:23 | |
social | ow, step in right direction \o/ | 12:23 |
derekh | jaosorior: gfidente so there seems to also be another problem in addition to the non ovb jobs failing because of IPv6 problems | 12:24 |
derekh | jaosorior: gfidente all of the OVB jobs seem to be timeing out after 3 hours | 12:24 |
openstackgerrit | Karthik S proposed openstack/tripleo-heat-templates: Added environment file for SR-IOV deployment https://review.openstack.org/363617 | 12:24 |
openstackgerrit | Martin André proposed openstack-infra/tripleo-ci: Fix scp command with IPv6 addresses https://review.openstack.org/363545 | 12:24 |
gfidente | derekh, yeah I've seen local deployments take much longer when we added the part to create the endpoints in puppet | 12:25 |
derekh | gfidente: jaosorior: this is different | 12:25 |
jaosorior | gfidente: this didn't start with the endpoints in puppet. | 12:25 |
derekh | gfidente: they are all timing out before anything tripleo scripts run on this at all | 12:25 |
jaosorior | actually stuff had been passing even with that | 12:26 |
derekh | its during the zuul setup | 12:26 |
derekh | e.g. | 12:26 |
derekh | http://logs.openstack.org/81/359681/6/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/b9b1bd4/_zuul_ansible/ansible_log.txt | 12:26 |
jaosorior | derekh: yeah, that's what I've noticed, but I didn't know where in the steps did that happen | 12:26 |
derekh | 2016-08-31 07:02:35,056 p=25417 u=zuul | TASK [zuul_runner with 10744 second timeout] *********************************** | 12:26 |
derekh | 2016-08-31 10:06:40,232 p=27103 u=zuul | Using /tmp/tmpGBkMqI/ansible/ansible.cfg as config file | 12:26 |
derekh | jaosorior: where did those 3 hours go | 12:26 |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Wire in jinja templating for custom roles https://review.openstack.org/362465 | 12:27 |
derekh | seems to be during a rsync zuul_ansible does to set stuff up | 12:27 |
derekh | pabelanger: ^^ any ideas ? | 12:27 |
derekh | pabelanger: could the AFS server be banjaxed ? | 12:28 |
weshay | sshnaidm|afk, periodic tripleo is failing on http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha/37fe6d7/logs/undercloud/var/log/undercloud_install.txt.gz | 12:28 |
*** sshnaidm|afk is now known as sshnaidm | 12:29 | |
EmilienM | jaosorior: I don't get the endpoint question | 12:29 |
jaosorior | EmilienM: was asking about the provider we use for keystone | 12:29 |
jaosorior | when provisioning | 12:29 |
jaosorior | but it seems we get it from keystone.conf | 12:29 |
*** trown|outtypewww is now known as trown | 12:29 | |
jaosorior | as far as I can see | 12:29 |
sshnaidm | weshay, it's from yesterday | 12:30 |
sshnaidm | weshay, I don't see results of today still | 12:30 |
pabelanger | derekh: looks like something in the job failed, and 3 hours later zuul killed the job. | 12:30 |
EmilienM | jaosorior: sorry, I still dont get the question | 12:30 |
sshnaidm | weshay, this problem was solved yesterday: https://bugs.launchpad.net/tripleo/+bug/1618418 | 12:30 |
openstack | Launchpad bug 1618418 in tripleo "CI: periodic jobs fail on undercloud install because "AttributeError: 'module' object has no attribute 'RegionInvalidationStrategy'"" [High,Fix released] | 12:30 |
EmilienM | jaosorior: you want to know how the provider get credentials? | 12:31 |
jaosorior | EmilienM: yes | 12:31 |
EmilienM | ah, so ask it :) | 12:31 |
EmilienM | credentials are in /root/openrc | 12:31 |
jaosorior | EmilienM: that's what I thought I had asked. only thing that I don't call it credentials. | 12:31 |
EmilienM | no prob | 12:31 |
jaosorior | EmilienM: but, we don't have an openrc | 12:31 |
weshay | sshnaidm, thanks! | 12:31 |
jaosorior | in tripleo, or do we? | 12:31 |
EmilienM | if you don't, puppet will find the resources in the catalog, with the admin resource | 12:32 |
derekh | pabelanger: ahh ok, so that log file holds logs for setup and teardown? | 12:32 |
EmilienM | jaosorior: keystone::roles::admin | 12:32 |
pabelanger | derekh: not sure I follow | 12:33 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Bind to FQDNs instead of IPs https://review.openstack.org/363616 | 12:33 |
jaosorior | EmilienM: thanks man | 12:34 |
*** openstackgerrit has quit IRC | 12:34 | |
derekh | pabelanger: the entrys in the ansible log file for from 07:02 too 10:06 http://logs.openstack.org/81/359681/6/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/b9b1bd4/_zuul_ansible/ansible_log.txt | 12:34 |
*** openstackgerrit has joined #tripleo | 12:34 | |
EmilienM | jaosorior: admin token is disable | 12:34 |
EmilienM | jaosorior: let me find the code | 12:34 |
derekh | pabelanger: I origionaly thought it was stuck for 3 hours, but if the same log file is used for setup and teardown (at the start and then the end of the job) then that explains it | 12:35 |
pabelanger | derekh: ya, the _zuul_ansible folder is logs from the zuul-launcher server, which invoked the job | 12:35 |
pabelanger | derekh: zuul_runner is an ansible async task, which we wait until the timeout value before moving to the next task | 12:36 |
dprince | plumgrid will be broken in the release unless this lands https://review.openstack.org/#/c/338284/ | 12:36 |
dprince | https://review.openstack.org/#/c/338287/ | 12:36 |
dprince | ditto for contrail ^^ | 12:36 |
EmilienM | jaosorior: wait, i think we use admin token | 12:37 |
EmilienM | jaosorior: sorry I was confused with puppet CI | 12:37 |
*** zoliXXL is now known as zoli|brb | 12:37 | |
jaosorior | EmilienM: but where does the auth_url come from? | 12:37 |
pabelanger | derekh: So, based on the log you posted. zuul-launcher ran http://logs.openstack.org/81/359681/6/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/b9b1bd4/_zuul_ansible/scripts/59964d4560064a7bbc1f61f170493006.sh async, then 3 hours later killed the job because of the timeout | 12:37 |
EmilienM | jaosorior: keystone.conf | 12:37 |
jaosorior | I see | 12:37 |
EmilienM | chem: should we use ::keystone::disable_admin_token_auth in tripleo? | 12:37 |
EmilienM | I don't remember all the story but I thought the admin token was removed in keystone | 12:38 |
chem | EmilienM: sorry, without any digging I can't reply to this one. | 12:38 |
chem | EmilienM: I can dig though | 12:38 |
derekh | pabelanger: so its not zuul-launcher itself that took 3 hours, ok so now I need to find out what else could be going on | 12:38 |
chem | EmilienM: what's the matter ? | 12:38 |
pradk | shardy, EmilienM, so the redis issue is fixed with dprince's patch merged https://review.openstack.org/#/c/357344/ .. the quickstart images were a few days old so it was still happening. But if i manually pull in this patch all is well with redis | 12:39 |
EmilienM | chem: jaosorior is asking how credentials are given to our puppet provider to manage keystone resources | 12:39 |
pabelanger | derekh: correct | 12:39 |
EmilienM | chem: and it seems like in tripleo we don't use openrc file | 12:39 |
pradk | shardy, confirmed locally | 12:39 |
*** liverpooler has quit IRC | 12:39 | |
EmilienM | chem: we seem to use admin token style | 12:39 |
chem | EmilienM: oula, old stuff | 12:39 |
EmilienM | pradk: excellent. Why do we have it in CI? | 12:40 |
EmilienM | chem: yeah | 12:40 |
EmilienM | chem: i'm going to fix that thing :) | 12:40 |
chem | EmilienM: I didn't think it was still supported at all | 12:40 |
EmilienM | me neither | 12:40 |
pradk | EmilienM, not sure what you mean.. have what in CI? | 12:40 |
chem | EmilienM: which part of tripleo, undercloud/overcloud ? | 12:40 |
shardy | pradk: ack, good news, thanks for confirming! | 12:41 |
EmilienM | pradk: the error I showed you yesterday with redis / gnocchi was in our upstream CI | 12:41 |
EmilienM | chem: overcloud | 12:41 |
EmilienM | chem: but prob both | 12:41 |
EmilienM | shardy: I'm still not sure gnocchi actually works in CI, I tested it with pingtest and it failed. | 12:42 |
EmilienM | shardy: I'll work on it today to confirm. | 12:42 |
derekh | pabelanger: the console is useless stdout isn't being synced so I can't see how far the script got, is it possible to add my key to a running VM so I can take a look? | 12:42 |
EmilienM | jaosorior, chem: this thing is not urgent, i'll look a bit later, on my todo | 12:43 |
*** rlandy has joined #tripleo | 12:44 | |
jaosorior | EmilienM: sure | 12:44 |
pradk | EmilienM, may be your scenario was not initializing haproxy ? the ci on other patches passes fine | 12:44 |
EmilienM | jaosorior: do you know if admin token is deprecated or removed in keystone? | 12:44 |
jaosorior | EmilienM: we shouldn't be using it | 12:44 |
EmilienM | pradk: show me where it pass please. | 12:44 |
pradk | EmilienM, initializing correctly i mean.. i donno why your scenario fails | 12:44 |
jaosorior | AFAIK | 12:44 |
EmilienM | what do you mean by initializing | 12:45 |
pradk | EmilienM, the key is tripleo::haproxy::redis_password should be set which is done in puppet/services/haproxy.yaml templates | 12:45 |
*** lucas-hungry is now known as lucasagomes | 12:45 | |
pradk | EmilienM, can you check if this is set locally for you when your scenario is deployed? | 12:46 |
*** ifarkas has quit IRC | 12:46 | |
EmilienM | pradk: I can check but tell me where you saw it working in CI | 12:46 |
*** bkopilov has joined #tripleo | 12:46 | |
pradk | EmilienM, any recently merged patch see the logs.. for example http://logs.openstack.org/62/361362/8/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/c07ec11/logs/overcloud-controller-2/var/log/gnocchi/metricd.txt.gz | 12:46 |
*** ifarkas_ is now known as ifarkas | 12:47 | |
pradk | EmilienM, see that gnocchi joins coordination as expected | 12:47 |
pradk | 2016-08-30 15:17:06.504 27404 INFO gnocchi.cli [-] Joined coordination group: gnocchi-scheduler | 12:47 |
hewbrocca | larsks: are you guys ready to merge? | 12:47 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Add NetApp Manila driver integration and tidy up generic https://review.openstack.org/354019 | 12:47 |
EmilienM | pradk: ok thanks | 12:47 |
EmilienM | pradk: i'll continue the tests today. | 12:47 |
*** jdob has joined #tripleo | 12:48 | |
*** liverpooler has joined #tripleo | 12:49 | |
openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Default haproxy listeners activation on hiera service _enabled https://review.openstack.org/362798 | 12:49 |
openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Add Ceph RGW profile https://review.openstack.org/334081 | 12:49 |
openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Add Ceph RGW listener to HAProxy https://review.openstack.org/362816 | 12:49 |
*** zoli|brb is now known as zoli | 12:49 | |
*** zoli is now known as zoliXXL | 12:49 | |
pradk | ok | 12:50 |
*** abehl has quit IRC | 12:51 | |
*** jefrite has quit IRC | 12:51 | |
larsks | hewbrocca: well, *I* think so, but it looks like 254788 has developed a -1, and someone asked for changes on my review this morning. 353507 still seems to be in good shape. | 12:51 |
larsks | hewbrocca: the -1 is from dprince, asking that we drop the description on several of the parameters so that they don't show up in the ui. I'll go ahead and make that change right now... | 12:52 |
shardy | larsks: FYI I moved tripleo-opstools-centralized-logging to RC1 so we have a little more time to land this | 12:53 |
openstackgerrit | Karthik S proposed openstack/tripleo-heat-templates: Added environment file for SR-IOV deployment https://review.openstack.org/363617 | 12:53 |
shardy | larsks: if you'd like to drop a mail to the FFE/newton-3 thread with a list of outstanding patches that would be good | 12:54 |
larsks | shardy: Thanks, I'll do that. | 12:54 |
dprince | larsks: +2 on your fluent patch... | 12:54 |
larsks | dprince: \o/ | 12:54 |
dprince | larsks: and yeah, for sensu I'd just like the descriptions gone. Easy fix I think and it matches how we did Fluent | 12:55 |
EmilienM | shardy: fyi https://review.openstack.org/363629 | 12:55 |
larsks | dprince: yeah, no problem. Tackling that right now. | 12:55 |
hewbrocca | jtomasek: did you have anything on the ops-tools patches | 12:55 |
hewbrocca | w/r/t parameter description etc. | 12:56 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Install tripleo-admin ssh keys on CI nodes https://review.openstack.org/363630 | 12:56 |
*** jcoufal has joined #tripleo | 12:56 | |
*** jefrite has joined #tripleo | 12:56 | |
derekh | OK, all tripleo OVB jobs are timing out after 3 hours I got now idea why until we can get onto a running ci instance and have a look | 12:56 |
jtomasek | dprince: the parameters should have labels though | 12:57 |
jtomasek | dprince: and added environments should get added in capabilities-map | 12:57 |
*** abehl has joined #tripleo | 12:57 | |
hewbrocca | derekh: what has changed? | 12:58 |
*** tzumainn has joined #tripleo | 12:58 | |
dprince | jtomasek: how would you like them then. Is a name a label? | 12:58 |
jtomasek | dprince: name is like an ID, whereas label is what you'd expect to get in the form as a label | 12:59 |
*** fzdarsky|lunch is now known as fzdarsky | 12:59 | |
jtomasek | dprince: in general, I'd love to see all parameters having as much information provided as HOT spec allows (constraints etc.) | 13:00 |
*** egafford has joined #tripleo | 13:00 | |
derekh | hewbrocca: the image change we made this morning, and god know what else I havn't been following along | 13:00 |
dprince | jtomasek: for "internal" parameters we started not including descriptions | 13:00 |
dprince | jtomasek: that is a convention but it is all we've got ATM | 13:00 |
*** jbadiapa has joined #tripleo | 13:01 | |
hewbrocca | dprince: we haven't changed anything else in CI since last week, have we? | 13:01 |
*** pradk has quit IRC | 13:01 | |
jtomasek | dprince: ok, that somewhat makes sense, hope there are not many deviations from that rule, so it is actually usable:) | 13:01 |
derekh | hewbrocca: this appears to be related to something early in the process so could something out of our control completly | 13:01 |
hewbrocca | meh | 13:01 |
dprince | jtomasek: if you want descriptions on everything. Then we could do that but there are quite a few missing descriptions at this point | 13:01 |
hewbrocca | pabelanger: you guys didn't make those shade changes on nodepool yet did you? | 13:01 |
dprince | jtomasek: and labels I think are only for Heat parameter groups. Not for individual parameters | 13:01 |
derekh | hewbrocca: dprince for example the image we use is rebuilt nightly, something my have gone into the zuul ansible scripts | 13:02 |
dprince | hewbrocca: I have been trying to slow the rate of CI changes unless they are critical | 13:02 |
dprince | hewbrocca: don't think we've changed a lot | 13:02 |
jtomasek | dprince: hm, HOT spec defines label: http://docs.openstack.org/developer/heat/template_guide/hot_spec.html#parameters-section | 13:02 |
jtomasek | dprince: and afaik the heat-validate output includes those labels for parameters which have them defined, so we use them in GUI | 13:03 |
hewbrocca | pabelanger: was talking about landing some shade patches to hopefully fix our FIP problem | 13:03 |
hewbrocca | and doing a nodepool restart | 13:03 |
hewbrocca | I don't know when that was going to happen though | 13:03 |
dprince | jtomasek: cool. We aren't using them much | 13:03 |
dprince | jtomasek: Heat may add them for you automatically based on the name | 13:04 |
dprince | jtomasek: I guess my thought here is it is too late in the game to call out adding labels for this release | 13:04 |
derekh | dprince: the console logs show nothing tripleo rated running at all, it seems to be stalling as part of the workspace setup so I don't think its something todo with the tripleo-ci scripts (at least no likely) | 13:04 |
jtomasek | dprince: I know, I am trying to get them in as much as possible because it is a big deal for GUI UX. And since those are new templates... it is better to add that now then never doing it later:) | 13:04 |
dprince | jtomasek: we aren't using them in t-h-t. If you are getting them it is automatic | 13:04 |
jtomasek | dprince: yeah, I am going to prepare the params update requirements for next summit discussion | 13:05 |
pabelanger | hewbrocca: today we are planning on restarting nodepool | 13:05 |
jtomasek | dprince: ok | 13:05 |
dprince | jtomasek: larsks: so just to be clear. I'd recommend just dropping the descriptions for now... and we can have the debate about adding 'label's for the 'O' release | 13:06 |
larsks | dprince: we're on the same page. | 13:06 |
shardy | dprince, jtomasek: If the label isn't specified it defaults to the parameter name | 13:06 |
*** zoliXXL is now known as zoli|brb | 13:07 | |
jtomasek | dprince: regarding the capabilities-map update, If the patch does not do it, I will have to do it myself later as it will be required for GUI - and it is much better when it is added by someone who actually understands the usage of that specific environment | 13:07 |
shardy | so personally I don't see it as super critical unless we've got some unintuitive names? | 13:07 |
dprince | shardy: ack, I figured. sounds like jtomasek wants them everywhere or has UX ideas to improved them | 13:07 |
larsks | jtomasek: the capabilities-map update is already there. | 13:08 |
jtomasek | larsks: oh, cool, I didn't check sorry | 13:08 |
* jtomasek takes a look | 13:08 | |
shardy | Sure, I'm not opposed to adding them, providing we're not just doing a hard-coded conversion to add spaces to the parameter name | 13:08 |
larsks | jtomasek: but don't review, because I'm uploading a rebase in just a few minutes... | 13:08 |
jtomasek | ok | 13:09 |
hewbrocca | pabelanger: OK, that's not the problem then | 13:09 |
hewbrocca | blearrgh | 13:09 |
hewbrocca | pabelanger: thanks, sorry to bother you | 13:09 |
pabelanger | hewbrocca: which problem, the job timeout? | 13:09 |
derekh | pabelanger: can you ssh to a running ci node and see where its stuck? | 13:09 |
hewbrocca | pabelanger: yeah | 13:10 |
jtomasek | larsks: looks good, thanks for updating it | 13:10 |
openstackgerrit | Merged openstack/instack-undercloud: Enable modern authtoken for Neutron and Glance https://review.openstack.org/362980 | 13:11 |
pabelanger | jenkins 9165 0.0 0.0 157976 3956 ? S 11:29 0:05 git-remote-http http://zm01.openstack.org/p/openstack/horizon http://zm01.openstack.org/p/openstack/horizon | 13:11 |
pabelanger | looks like the job hung on git clone | 13:12 |
pabelanger | switching to #openstack-infra, there was some reports of git issue today | 13:13 |
jpich | d0ugal: It looks like I may have broken something, would you know what the recommendation should be to resolve https://bugs.launchpad.net/tripleo/+bug/1618877 ? I guess it's because there hasn't been a promoted common yet, but there was a promoted client, or something like that? | 13:13 |
openstack | Launchpad bug 1618877 in tripleo "problem importing instackenv.json" [Undecided,New] | 13:13 |
*** maeca2 has joined #tripleo | 13:14 | |
*** maeca1 has quit IRC | 13:15 | |
gfidente | shardy, to do a release of tripleo-puppet-elements | 13:17 |
*** milan has quit IRC | 13:17 | |
*** rhallisey has quit IRC | 13:18 | |
*** jpena|lunch is now known as jpena | 13:18 | |
gfidente | shardy, oh we need opentack/releases, fine will push it | 13:18 |
shardy | gfidente: we're planning to release everything for newton-3 imminently | 13:18 |
gfidente | shardy, ack holding on | 13:19 |
shardy | as soon as we have a consistent set of SHA's from CI to use | 13:19 |
shardy | gfidente: what's the commit you need, to ensure we get it? | 13:19 |
gfidente | https://github.com/openstack/tripleo-puppet-elements/commit/343f93f2a259b25ed5abe4b27bb3aa9070c92b02 | 13:19 |
shardy | gfidente: ack, thanks | 13:20 |
gfidente | ty :) | 13:20 |
*** paramite has joined #tripleo | 13:21 | |
*** lblanchard has joined #tripleo | 13:23 | |
openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: Add fluentd client service https://review.openstack.org/353506 | 13:23 |
openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: Availability monitoring agents support https://review.openstack.org/254788 | 13:23 |
*** coolsvap is now known as _coolsvap_ | 13:23 | |
larsks | dprince: hewbrocca: jtomasek: rebased, with requested changes | 13:24 |
hewbrocca | woowoo lars | 13:24 |
hewbrocca | woowoo larsks | 13:24 |
*** oshvartz has quit IRC | 13:24 | |
*** masco has quit IRC | 13:24 | |
hewbrocca | dprince jtomasek can we get us some +2s on the ops 2ls | 13:24 |
larsks | for the record, there are three: https://review.openstack.org/#/c/353506/ https://review.openstack.org/#/c/254788/ https://review.openstack.org/#/c/353507/ | 13:26 |
larsks | Thanks all! | 13:26 |
*** oshvartz has joined #tripleo | 13:26 | |
*** Goneri has joined #tripleo | 13:27 | |
*** flepied has quit IRC | 13:28 | |
*** akuznetsov has joined #tripleo | 13:30 | |
hewbrocca | dprince: ^^^ | 13:31 |
dprince | hewbrocca: ack | 13:32 |
*** panda|lunch is now known as panda | 13:33 | |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Document Third Party CI and developer usage https://review.openstack.org/360007 | 13:34 |
*** cdearborn has joined #tripleo | 13:34 | |
*** ansiwen has joined #tripleo | 13:34 | |
jrist | anyone comfortable +2 on this? it has two 2s and two 1s | 13:35 |
jrist | https://review.openstack.org/#/c/344140/ | 13:35 |
openstackgerrit | Harry Rybacki proposed openstack/tripleo-docs: Fix minor doc errors https://review.openstack.org/363660 | 13:35 |
jrist | and some more eyes on this? https://review.openstack.org/#/c/361712/ it has one +2 and one +1 | 13:35 |
jrist | 1 +2 and 2 +1 https://review.openstack.org/#/c/360593/ | 13:36 |
*** jeckersb_gone is now known as jeckersb | 13:36 | |
jrist | these are minor changes | 13:36 |
EmilienM | jrist: both gate-tripleo-ci-centos-7-ovb-ha and gate-tripleo-ci-centos-7-ovb-nonha are red | 13:37 |
d0ugal | jpich: Looking | 13:38 |
jrist | EmilienM: oh | 13:38 |
jrist | EmilienM: I'm sorry | 13:38 |
jrist | EmilienM: I didn't even notice | 13:39 |
d0ugal | jpich: I'm not sure, I've never hit this situation before. | 13:39 |
jrist | EmilienM: what does POST_FAILURE mean? | 13:39 |
jrist | EmilienM: oh you ran some rechecks? | 13:39 |
EmilienM | jrist: zuul failed to report the job status, which is because job timeouted | 13:39 |
jrist | :( | 13:39 |
jpich | d0ugal: Ok, thanks for looking. I'm going to create a new undercloud and see if I can reproduce, to begin with | 13:40 |
d0ugal | jpich: Okay, sounds like a good start. Hopefully it is just unlucky timing - if package updates are available now they should be able to update with yum and re-run the undercloud install. | 13:40 |
rbrady | shardy: the mistral custom roles patch is ready for another review when you get a chance: https://review.openstack.org/#/c/362465/ | 13:41 |
shardy | rbrady: awesome, thanks! | 13:41 |
shardy | I'm planning to rebase the jinja2 patches today so will test them with the new action :) | 13:41 |
*** pkovar has quit IRC | 13:42 | |
jpich | d0ugal: Yeah, I'm hoping so! It sounds like something that should resolve itself shortly, but if it means no one can register nodes on a new undercloud right now it kinda sucks so I'll poke a little | 13:42 |
*** pkovar has joined #tripleo | 13:44 | |
*** liverpooler has quit IRC | 13:44 | |
*** wgd3 has joined #tripleo | 13:44 | |
d0ugal | jpich: Good luck! | 13:45 |
jpich | d0ugal: Ta! | 13:45 |
EmilienM | bnemec: can you +A or not https://review.openstack.org/#/c/362904/ please ? | 13:48 |
EmilienM | bnemec: you had a comment | 13:48 |
EmilienM | sshnaidm: once it's merged, any way to run periodic job? ^ | 13:48 |
sshnaidm | EmilienM, yeah, I'll trigger them | 13:49 |
*** zoli|brb is now known as zoli | 13:49 | |
*** paramite has quit IRC | 13:49 | |
hewbrocca | Everything is timing out in CI right now | 13:49 |
*** zoli is now known as zoliXXL | 13:50 | |
hewbrocca | due to some infra git problem, pabelanger thinks | 13:50 |
EmilienM | yeah I noticed last night | 13:50 |
EmilienM | puppet CI was all red | 13:50 |
pabelanger | If I had to guess, we are having networking issues in rackspace | 13:50 |
hewbrocca | damn private companies | 13:51 |
*** dtantsur|bbl is now known as dtantsur | 13:51 | |
sshnaidm | pabelanger, is this related to fact we have periodic jobs queued for a 7 hr 51 min already? | 13:52 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: Add IPv6 network configuration for ipv6 job types https://review.openstack.org/363674 | 13:54 |
*** ayoung has joined #tripleo | 13:54 | |
*** anbu__ has quit IRC | 13:55 | |
openstackgerrit | Jiri Stransky proposed openstack/puppet-tripleo: Write restart flags to restart services only when necessary https://review.openstack.org/358510 | 13:55 |
EmilienM | panda: https://review.openstack.org/#/c/363674/1/toci_gate_test.sh | 13:55 |
EmilienM | it won't work | 13:55 |
*** liverpooler has joined #tripleo | 13:55 | |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates: Restart only services that need it https://review.openstack.org/358511 | 13:55 |
EmilienM | panda: because the case will stop in ha) | 13:55 |
*** milan has joined #tripleo | 13:55 | |
EmilienM | the jobname contains ha | 13:55 |
dtantsur | shardy, may I use your brilliant brain again re https://review.openstack.org/#/c/362148/7/puppet/services/ironic-conductor.yaml ? | 13:56 |
panda | EmilienM: isn't there a for loop for all the keywords in job type ? | 13:57 |
shardy | dtantsur: what's up? | 13:57 |
EmilienM | panda: mhh, maybe | 13:57 |
dtantsur | shardy, I end up with http_url = http://ctlplane:8088 even though in other places the same {get_param: [ServiceNetMap, IronicNetwork]} results in a proper IP... | 13:57 |
EmilienM | panda: have you executed the experimental job? | 13:57 |
*** pgadiya has quit IRC | 13:57 | |
shardy | dtantsur: I think that is because it should be IronicApiNetwork, sec | 13:58 |
shardy | dtantsur: Hmm, actually no, wait | 13:58 |
shardy | dtantsur: the problem is we do an exact map value substitution | 13:58 |
shardy | and this is a substring | 13:59 |
shardy | so foo: ctlplane would end up with foo: <ip> | 13:59 |
panda | EmilienM: not yet, spinning now | 13:59 |
shardy | dtantsur: it seems that http_url is the conductor endpoint? | 13:59 |
shardy | (even if it's not something we put into keystone) | 14:00 |
*** adarazs is now known as adarazs_afk | 14:00 | |
shardy | dtantsur: or, in other words, can we express this formatted URL as an endpoint? | 14:00 |
*** links has quit IRC | 14:00 | |
*** ebalduf has joined #tripleo | 14:00 | |
dtantsur | shardy, yes, http_url is from conductor (not a VIP, just its IP). it should not be tagged if it matters | 14:01 |
EmilienM | panda: let's watch it in zuul | 14:01 |
shardy | dtantsur: Ok, I'm thinking it might be better to do something like: | 14:01 |
EmilienM | panda: I don't see it :( | 14:01 |
panda | EmilienM: so, the gerrit review will check itself with its own code ? | 14:01 |
shardy | {get_param: [EndpointMap, IronicInspectorInternal, uri]} | 14:02 |
jaosorior | ayoung: figured out that the issue you had with mod_auth_mellon was that tripleo overrides the package installs in puppet | 14:02 |
EmilienM | panda: so my patch was merged but zuul not restarted yet https://review.openstack.org/#/c/362966/ | 14:02 |
dtantsur | shardy, you mean IronicApiInternal? | 14:02 |
jaosorior | ayoung: so we need to add mod_auth_mellon to the overcloud image. | 14:02 |
shardy | then we can do the url formatting in the endpoint map, and stuff like changing the port or protocol can be handled in a standard way | 14:02 |
EmilienM | panda: I don't understand your question | 14:02 |
*** pradk has joined #tripleo | 14:02 | |
shardy | dtantsur: No, I mean add an endpoint for the endpoint related to IronicIPXEPort | 14:02 |
jaosorior | ayoung: submitted a fix to get it into the image https://review.openstack.org/#/c/363579/ | 14:03 |
panda | EmilienM: add a post pipeline script to restart zuul :) | 14:03 |
dtantsur | shardy, I'm a bit lost, we don't have an endpoint for IronicIPXEPort... | 14:03 |
shardy | because this isn't pointing at the Ironic API is it? | 14:03 |
jaosorior | ayoung: and did the same for mod_ssl since I need it https://review.openstack.org/#/c/363578/2 | 14:03 |
ayoung | jaosorior, excellent | 14:03 |
dtantsur | shardy, no, it's not | 14:03 |
shardy | dtantsur: I'm saying should we add one instead of mangling an enpoint inside this template | 14:03 |
shardy | seems like it might be cleaner | 14:03 |
shardy | we already have endpoints for stuff like mysql in there that's internal | 14:03 |
dtantsur | shardy, this is the problem. it's a standalone HTTP vhost used for iPXE. it does not match Ironic API | 14:03 |
panda | EmilienM: I commented "check experimental" in my own review. I wanted to be sure that the check will take code from my change to test my change itself | 14:04 |
EmilienM | sshnaidm: I approved it | 14:04 |
dtantsur | shardy, hmm, a new one. yes, maybe. do you have an example handy of how to introduce a new endpoint with a reasonable default? | 14:04 |
openstackgerrit | Merged openstack/tripleo-quickstart: Update section header indicators https://review.openstack.org/360522 | 14:04 |
EmilienM | panda: of course, that's how zuul works | 14:04 |
shardy | dtantsur: yes, sec | 14:04 |
sshnaidm | EmilienM, thanks, but periodics look like stuck in zuul for 8 hours already | 14:05 |
panda | EmilienM: for normal changes yes, but this works also for the changes that affect the test launched by zuul ? | 14:05 |
sshnaidm | EmilienM, I think it's similar issue that pabelanger told about | 14:05 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Remove repeated apache-related hieradata https://review.openstack.org/363687 | 14:06 |
*** saneax is now known as saneax-_-|AFK | 14:06 | |
*** akshai has joined #tripleo | 14:07 | |
shardy | dtantsur: https://review.openstack.org/#/c/305751/ shows how it was wired in for mysql | 14:08 |
shardy | this case should be much simpler, I'd start by updating endpoint_data.yaml then re-running build_endpoint_map.py | 14:08 |
*** anbu has joined #tripleo | 14:08 | |
shardy | then check endpoint_data.yaml to see which output you need, reference it in your template | 14:09 |
dtantsur | shardy, yeah.. is it fine to just skip enable_tls thing? I'm not sure we can even achieve SSL with iPXE.. | 14:09 |
shardy | dtantsur: yep I think so | 14:10 |
hewbrocca | good lord, ssl + ipxe? | 14:10 |
dtantsur | thanks shardy | 14:10 |
dtantsur | hewbrocca, no way | 14:10 |
dtantsur | I mean, maybe there is a way... but it's going to be a lot of dirty fun | 14:11 |
hewbrocca | for 0 reason | 14:11 |
jaosorior | dtantsur: which enable_tls stuff? | 14:12 |
dtantsur | jaosorior, I'm looking at https://review.openstack.org/#/c/305751/33/environments/enable-tls.yaml as an example | 14:13 |
*** matbu is now known as matbu|mtg | 14:14 | |
jaosorior | dtantsur: you need to add it there | 14:14 |
*** rhallisey has joined #tripleo | 14:14 | |
jaosorior | dtantsur: if ipxe can't do TLS, it doesn't matter, just put the protocol as http | 14:14 |
dtantsur | jaosorior, aha, ok | 14:14 |
*** akuznetsov has quit IRC | 14:14 | |
dtantsur | wait, where is this file nowadays? | 14:14 |
*** mhenkel has joined #tripleo | 14:15 | |
dtantsur | environments/enable-tls.yaml no longer lists endpoints | 14:15 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role https://review.openstack.org/289027 | 14:15 |
*** abregman has quit IRC | 14:16 | |
mhenkel | hey Steve, I pushed all the patches but tht failed because if nonha-multinode | 14:16 |
*** alee has joined #tripleo | 14:16 | |
pabelanger | sshnaidm: it is not stuck, periodic queue has precedence low, so all other pipelines get assigned nodes first. Once check-tripleo clears out, the periodic jobs will get assigned nodes | 14:17 |
sshnaidm | pabelanger, ok, let's call it "stuck in queue" then :) | 14:17 |
dtantsur | shardy, I'm trying to figure our the relationship of this change with https://github.com/openstack/tripleo-heat-templates/commit/cb2570c237907da2b91d402fec19665c9e422adf that dprince did | 14:17 |
sshnaidm | pabelanger, is there a way to schedule them a little bit earlier? | 14:18 |
alee | hi all - I'm getting a failed undercloud install with something about "/Firewall[998 log all]: Dependency Augeas[lvm.conf] has failures: true" .. any idea how to fix/ get around that? | 14:18 |
dtantsur | shardy, I'm not sure how to ask the right question, but still: do need this endpoint to "belong" to this IronicNetwork? | 14:18 |
pabelanger | sshnaidm: yes, we can control when the pipeline starts periodic jobs but doubt it will be moved | 14:19 |
dprince | dtantsur: which patch? | 14:19 |
*** jprovazn has quit IRC | 14:20 | |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates: Ironic: enabled iPXE by default and make it configurable https://review.openstack.org/362148 | 14:20 |
pabelanger | sshnaidm: what is the periodic job doing? | 14:20 |
dtantsur | dprince, ^^^ | 14:20 |
dtantsur | dprince, I seem to be highly confused by networks vs endpoints | 14:20 |
sshnaidm | pabelanger, it's like regular gate job, but if it succeeds we update the current tripleo repository | 14:21 |
dprince | dtantsur: there are VIPs and then there are local ports | 14:22 |
dprince | dtantsur: the endpoint map primarily deals with the former (VIPs) | 14:22 |
dprince | dtantsur: so long as what you are doing is meant to do something along those likes it should be fine | 14:22 |
pabelanger | sshnaidm: why don't you do that in the post pipeline? | 14:23 |
pabelanger | I suspect since you don't have voting jobs in gate | 14:23 |
dtantsur | dprince, I'm not sure, that's the problem. I need to figure our the endpoint for iPXE (which is the same as PXE, but over HTTP instead of TFTP) | 14:23 |
dtantsur | dprince, you've changed the TFTP address to use IronicNetwork, now I'm changing HTTP address to a new endpoint.. the IP must be the same, also untagged, etc | 14:24 |
dtantsur | I have a gut feeling something might be wrong in what I'm doing | 14:24 |
hewbrocca | dtantsur: I know what it is | 14:26 |
hewbrocca | dtantsur: OpenStack | 14:26 |
dtantsur | lol | 14:26 |
dprince | dtantsur: commented | 14:26 |
dprince | dtantsur: your' patch is close... | 14:26 |
dtantsur | dprince, so, net_param: Ironic, right? | 14:27 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Implement scenari001, 002 and 003 https://review.openstack.org/362504 | 14:28 |
dprince | dtantsur: basically, when you generate the endpoint map you should see your new iPXE entries using the same IronicNetwork which we are defining as the Ironic provisioning network | 14:28 |
dprince | dtantsur: yes | 14:28 |
*** rajinir has joined #tripleo | 14:28 | |
dtantsur | dprince, oh, now I get it. thanks man :) | 14:28 |
*** zoliXXL is now known as zoli|brb | 14:28 | |
dtantsur | OpenStack Networking: magic and ponies :D | 14:28 |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates: Ironic: enabled iPXE by default and make it configurable https://review.openstack.org/362148 | 14:29 |
dtantsur | dprince, makes sense ^^^? | 14:29 |
sshnaidm | pabelanger, I'm not sure what post-pipeline is.. | 14:29 |
hewbrocca | athomas: you have a theory about networking and ponies, if I remember | 14:30 |
*** oshvartz has quit IRC | 14:30 | |
athomas | hewbrocca, Very true. | 14:30 |
EmilienM | sshnaidm: this pipeline is used for tags, releasenotes, etc | 14:30 |
pabelanger | sshnaidm: pipeline in zuul that runs after code has been merged | 14:30 |
dprince | dtantsur: looks good to me | 14:31 |
*** abregman has joined #tripleo | 14:31 | |
pradk | is anyone else seeing this erro deploying undercloud ---> /Firewall[998 log all]: Dependency Augeas[lvm.conf] has failures: true ? | 14:31 |
pradk | alee is seeing this | 14:31 |
pradk | seems related to https://review.openstack.org/#/c/360790/ | 14:31 |
gfidente | athomas, what's the theory? | 14:31 |
* gfidente waiting for more rgw updates | 14:31 | |
athomas | hewbrocca, By the time people are using network bridges, you might as well visualise it in terms of magical ponies, fying down, picking up the individual packets in their mouths, and flying them over to their destination. For all the sense any of it makes, that's as accessible a visualisation as any. | 14:32 |
sshnaidm | pabelanger, ok, afaik in periodic jobs we use different repos than in patch gate jobs | 14:32 |
athomas | gfidente, ^^ You're welcome. ;-) | 14:32 |
*** akshai has quit IRC | 14:32 | |
alee | pradk, I know jaosorior was seeing the same thing .. | 14:32 |
hewbrocca | dtantsur: there you go, magical network ponies | 14:33 |
pradk | alee, yea seems like a regression .. my undercloud yesterday went fine, though quickstart image might have been older | 14:33 |
dtantsur | athomas, ROFL | 14:33 |
pabelanger | sshnaidm: that is fine, just think of moving from periodic (once a day) to running the job everytime code merges. The jobs can be the same, but just run more often | 14:33 |
bnemec | So by "ponies" we really mean magical unicorn pegasus? | 14:33 |
*** akshai has joined #tripleo | 14:33 | |
bnemec | :-) | 14:33 |
hewbrocca | sure | 14:33 |
hewbrocca | as long as it can pick up a packet | 14:33 |
gfidente | I thought that was OVB | 14:34 |
pabelanger | this is one of the reason why I think tripleo should stand up there own zuul instances, so we can provide better workflows in the form of pipelines | 14:34 |
openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Add env. setup for virt deployments doc https://review.openstack.org/363120 | 14:34 |
hewbrocca | pabelanger: makes sense to me | 14:34 |
dtantsur | dprince, thanks! now I'll test it locally | 14:34 |
sshnaidm | pabelanger, I'd say it would be great, the current tripleo ping would be updates much faster | 14:34 |
dprince | dtantsur: I +2'd it. That means it works right :) | 14:34 |
pabelanger | the issue is, a 3+ hour job in post likely won't flight right now | 14:34 |
*** jlinkes has joined #tripleo | 14:35 | |
dtantsur | hmm, true, to hell with local testing, let's go to the beach :D | 14:35 |
pabelanger | So, you could do that process in rdoproject.org or work toward your own zuul server for the tripleo project | 14:35 |
dprince | dtantsur: I'm there man | 14:35 |
dtantsur | haha | 14:35 |
EmilienM | gfidente: nobody got your joke dude | 14:35 |
dtantsur | dprince, one of the worst things about Czech republic is that it's equally far from all possible seas in Europe | 14:36 |
dprince | EmilienM: that is because gfidente is smarter than us, he is a level up man | 14:36 |
EmilienM | his joke was too technical for us :P | 14:36 |
*** ansiwen has quit IRC | 14:36 | |
*** ansiwen has joined #tripleo | 14:37 | |
dprince | dtantsur: I drive 5-6 hours to get to a good beach | 14:37 |
dtantsur | cool! | 14:37 |
* gfidente wonders where is marios when he needs him | 14:38 | |
EmilienM | at the beach | 14:38 |
EmilienM | he need to walk 2 min AFIK | 14:38 |
derekh | I can't drive 4 hours without hitting a beach.... | 14:38 |
jaosorior | pradk: so I consistently keep getting that augeas issue in oooq :/ | 14:38 |
sshnaidm | pabelanger, and how will help the own zuul server? | 14:38 |
jaosorior | have been trying for days | 14:38 |
derekh | or a cliff | 14:38 |
dtantsur | derekh, lol | 14:38 |
EmilienM | derekh: you win | 14:38 |
dprince | EmilienM: yeah, marios won the work on the beach lottery I think | 14:38 |
gfidente | EmilienM, I wasn't making any joke though | 14:39 |
EmilienM | dprince: he works "remotely" | 14:39 |
gfidente | dprince, and what bad did I do to you really | 14:39 |
*** ansiwen has quit IRC | 14:39 | |
dprince | gfidente: I'll never understand it anyways... I'm trying | 14:39 |
dprince | gfidente: you have hair on your head? yep, thats it | 14:40 |
*** ansiwen has joined #tripleo | 14:40 | |
*** tzumainn has quit IRC | 14:40 | |
*** tzumainn has joined #tripleo | 14:41 | |
lucasagomes | derekh, I want to look at that NodeLocked in the tripleO ci, do you know off the top of your head a patch which failed with that ? | 14:41 |
* dtantsur got a strong feeling that it's Friday already | 14:41 | |
lucasagomes | otherwise I will start looking at random patches to find it | 14:41 |
dtantsur | lucasagomes, I've attached one to the trello card | 14:41 |
lucasagomes | dtantsur, a-ha | 14:41 |
lucasagomes | thanks | 14:41 |
dtantsur | lucasagomes, also this http://logs.openstack.org/25/354125/24/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/0c6890d/ | 14:42 |
pabelanger | sshnaidm: greater flexibility in changing pipelines | 14:42 |
EmilienM | dprince: please review https://review.openstack.org/#/c/363204/ | 14:42 |
derekh | lucasagomes: I think the pyghmi may make the problem go away, but one sec I'll find you one | 14:42 |
EmilienM | dprince: this is an ipv6 bug bnemec found | 14:42 |
derekh | lucasagomes: *pyghmi fix | 14:42 |
bnemec | There are multiple ipv6 bugs | 14:42 |
lucasagomes | derekh, found one already | 14:42 |
derekh | lucasagomes: ok | 14:42 |
EmilienM | bnemec: did you list them? | 14:42 |
lucasagomes | derekh, cool, FWIW the g-r patch is now merged | 14:42 |
derekh | g-r? | 14:43 |
derekh | lucasagomes: requirments | 14:43 |
bnemec | EmilienM: https://bugs.launchpad.net/tripleo/+bug/1618623 is the first. There's one in cinder too. | 14:43 |
openstack | Launchpad bug 1618623 in tripleo "vncproxy config broken in ipv6 deployments" [Critical,In progress] - Assigned to Ben Nemec (bnemec) | 14:43 |
derekh | lucasagomes: got it | 14:43 |
EmilienM | bnemec: thanks | 14:43 |
*** wgd3 is now known as wgd3[away] | 14:43 | |
lucasagomes | derekh, yeah global-requirements (sorry for the shortcut) | 14:43 |
bnemec | I'm still verifying the fix for the Cinder one and will push a patch shortly. | 14:43 |
EmilienM | bnemec: panda and I are working on the experimental job to test ipv6/ha scenario | 14:43 |
EmilienM | bnemec: do you test in CI? | 14:43 |
sshnaidm | pabelanger, that's sure, although I suspect also additional efforts for its maintenance. Together with latest intentions to be similar as any other project in upstream CI, I'd say it has a little chance to be approved.. :( | 14:44 |
*** ansiwen has quit IRC | 14:44 | |
EmilienM | jaosorior: can you land https://review.openstack.org/363105 please ? | 14:44 |
* dtantsur can't resist imaging a panda testing something in CI... | 14:44 | |
gfidente | bnemec, I think there is a host_nobrackets output we can use in both | 14:44 |
bnemec | EmilienM: No, locally, but I'm working on ipv6 support for OVB too, which you will also need. | 14:45 |
*** ansiwen has joined #tripleo | 14:45 | |
EmilienM | dtantsur: http://s.quickmeme.com/img/c4/c4196ca721c280fe5ba953c7d01949395aaf220d6ef3aadc30142b68756ac51f.jpg | 14:45 |
EmilienM | bnemec: ack | 14:45 |
bnemec | I actually think it's working fine, but I ran out of time last night. | 14:45 |
dtantsur | THIS | 14:45 |
pabelanger | sshnaidm: rdoproject.org has the infrastructure today, that would be 90% of the effort | 14:45 |
EmilienM | bnemec: you can sync with panda on this thing | 14:45 |
dprince | bnemec, EmilienM: I think we can just use host_nobrackets right? | 14:45 |
EmilienM | dprince: also | 14:45 |
sshnaidm | pabelanger, do they have zuul at all? | 14:45 |
pabelanger | sshnaidm: but yes, I believe this is the main reason it hasn't happend sooner. Lack of resources to manage it | 14:46 |
EmilienM | sshnaidm: yes | 14:46 |
pabelanger | sshnaidm: yes, they are using Software Factory | 14:46 |
EmilienM | sshnaidm: rdoproject.org is Software Factory | 14:46 |
EmilienM | and it's a replica of OpenStack Infra | 14:46 |
bnemec | dprince: gfidente: That's fine. This is what we were doing in the vncproxy profile though, so I reused it. | 14:46 |
panda | EmilienM: dtantsur: I prefer this one https://media.tenor.co/images/60a9f8d2822a17e426ddaf001c1a7ab7/raw | 14:46 |
EmilienM | sshnaidm: http://softwarefactory-project.io/docs/faqs.html#what-is-the-added-value-of-software-factory | 14:47 |
dprince | bnemec: maybe change them both? I struck me as odd I think now that the endpoint map has _nobracket stuff | 14:47 |
dtantsur | panda, so-you-say-it-worked-on-devstack.gif | 14:47 |
EmilienM | panda: I don't see you doing that, you're too calm ;-) | 14:47 |
bnemec | dprince: Yeah, that's fine. I'll update it when I push the cinder patch. | 14:47 |
sshnaidm | EmilienM, pabelanger cool, good to know.. | 14:47 |
EmilienM | jaosorior: thx | 14:47 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: Refactor upgrade checks. https://review.openstack.org/357750 | 14:50 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: M/M upgrade sahara-api fails to restart. https://review.openstack.org/358022 | 14:51 |
*** maeca2 has quit IRC | 14:51 | |
sshnaidm | EmilienM, pabelanger, and what if really to run additional gate job, looking exactly as periodic one, including only repos that periodic job uses, and use post-pipeline to update current tripleo pin in case it succeeds | 14:52 |
*** fragatina has joined #tripleo | 14:53 | |
*** fragatina has quit IRC | 14:53 | |
sshnaidm | or just update the current pin within the job | 14:53 |
pabelanger | sshnaidm: can you rephrase your question, I didn't follow | 14:53 |
EmilienM | me neither | 14:53 |
sshnaidm | sorry, thinking loud :) | 14:53 |
*** fragatina has joined #tripleo | 14:54 | |
sshnaidm | I mean using gate job for updating current tripleo repo pin, as pabelanger said, each time patch is merged, just to create a special gate job for this | 14:54 |
EmilienM | it will cost a lot of CI resources | 14:55 |
sshnaidm | but not to vote, so it won't block patches from being merged | 14:55 |
EmilienM | comparing to periodic jobs | 14:55 |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-docs: [WIP] Documentation for installing and using Ironic in overcloud https://review.openstack.org/354016 | 14:55 |
pabelanger | sshnaidm: right, we cannot do that today. Because we don't want per project pipelines in zuul.o.o however, it is possible to do that | 14:55 |
sshnaidm | EmilienM, only when it's going to be merged, not each patch check | 14:55 |
EmilienM | it would also break the job if something broke in OpenStack | 14:55 |
*** zoli|brb is now known as zoli | 14:56 | |
*** zoli is now known as zoliXXL | 14:56 | |
bnemec | Pfft, nothing every breaks in OpenStack. ;-) | 14:56 |
*** rbrady has quit IRC | 14:56 | |
dtantsur | sshnaidm, post-jobs suffer from the same problem as periodic jobs: nobody see their results :( | 14:57 |
pabelanger | EmilienM: after zuulv3 we'll also have the ability to "if existing job running in pipeline foo, don't add job to pipeline", to avoid waiting resources | 14:57 |
dtantsur | sshnaidm, we're using post jobs to build IPA images. sometimes we find that they haven't built for a month :D | 14:57 |
sshnaidm | dtantsur, you just don't have a dashboard with red lights for monitoring this :) | 14:57 |
EmilienM | pabelanger: awesome, so many things in zuul v3 that we're waiting for | 14:58 |
dtantsur | that's true, we don't :) | 14:58 |
EmilienM | pabelanger: do you know when zuul v3 will be out? | 14:58 |
derekh | dtantsur: that doesn't happen in tripleo, if the periodic job fails we know.....how long it takes to fix it is another thing entirely | 14:58 |
pabelanger | EmilienM: a good example of wasted resources is the wheel-build jobs, that run in the release-post pipeline. This is what tripleo could do, replacing the periodic job | 14:58 |
pabelanger | EmilienM: soon(tm) | 14:58 |
dtantsur | derekh, that's pretty cool actually | 14:58 |
EmilienM | bnemec: never, it works in devstack | 14:58 |
pabelanger | EmilienM: we're going to be hacking on it durning the mid-cycle in 2 weeks | 14:58 |
*** fragatin_ has joined #tripleo | 14:58 | |
EmilienM | please don't sleep and don't go in bars | 14:58 |
EmilienM | just do zuul v3 | 14:59 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: remove the ci-scripts dir from tripleo-quickstart https://review.openstack.org/363732 | 14:59 |
*** milan has quit IRC | 14:59 | |
*** bana_k has joined #tripleo | 15:01 | |
*** fragatina has quit IRC | 15:02 | |
*** milan has joined #tripleo | 15:02 | |
*** bvandenh has quit IRC | 15:05 | |
*** mwhahaha has joined #tripleo | 15:08 | |
*** jaosorior has quit IRC | 15:08 | |
*** _coolsvap_ is now known as coolsvap | 15:09 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Split additional features across the periodic jobs https://review.openstack.org/362904 | 15:09 |
*** yamahata has joined #tripleo | 15:10 | |
sshnaidm | bnemec, I think there is an issue with infra, pabelanger was talking about it before | 15:10 |
bnemec | sshnaidm: Okay, thanks. I'll read the scrollback. | 15:10 |
*** matbu|mtg is now known as matbu | 15:10 | |
*** rbrady has joined #tripleo | 15:11 | |
*** mcornea has quit IRC | 15:11 | |
*** dprince has quit IRC | 15:13 | |
jpeeler | shardy: https://bugs.launchpad.net/tripleo-common/+bug/1612819 for rc1 | 15:14 |
openstack | Launchpad bug 1612819 in tripleo-common "GetCapabilitiesAction output incomplete" [Undecided,New] | 15:14 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart: WIP: Add directory to store documentation files https://review.openstack.org/361483 | 15:15 |
EmilienM | jistr: ouch https://review.openstack.org/#/c/358510/ | 15:15 |
marios | gfidente: sorry i was on a call | 15:15 |
marios | (*at the beach obviosuly) | 15:15 |
EmilienM | marios: :-) | 15:16 |
*** panda is now known as panda|afk | 15:16 | |
EmilienM | jistr: couldn't you write something in puppet-pacemaker? | 15:17 |
dtantsur | dpr<TAB> :( | 15:17 |
EmilienM | jistr: it's a bit hackish, no? | 15:17 |
jistr | EmilienM: heh yea i think it's our best shot though :) i'm a bit worried about the redis one, but the rest should be fairly ok i hope. I commented there that it's an "ouch", but probably the best we can do. | 15:17 |
jistr | EmilienM: not in puppet-pacemaker unless we have the refactoring that chem has been working on | 15:18 |
EmilienM | jistr: right | 15:18 |
jistr | EmilienM: once we have it, all this may change, but i think it's fairly certain that the puppet-pacemaker refactoring will not make Newton | 15:18 |
EmilienM | chem: what is the status of the refactoring btw? | 15:18 |
EmilienM | jistr: right I'm ok with your change +2 | 15:18 |
EmilienM | jistr: please refactor it asap though | 15:19 |
*** alee is now known as alee_afk | 15:19 | |
*** egafford has quit IRC | 15:20 | |
*** adarazs_afk is now known as adarazs | 15:20 | |
jistr | EmilienM: ack thanks | 15:21 |
*** leanderthal is now known as leanderthal|afk | 15:21 | |
dtantsur | folks, could someone please help me with this iPXE network again? please see my latest comment at https://review.openstack.org/#/c/362148/ | 15:22 |
*** pcaruana has quit IRC | 15:22 | |
*** rcernin has quit IRC | 15:22 | |
shardy | jpeeler: So I think we agreed to retire the tripleo-common launchpad project, as I'm tracking everything in the main tripleo one for the release | 15:22 |
dtantsur | I need the endpoint to contain the real IP, not the VIP... | 15:23 |
shardy | jpeeler: can I ask you to mark the bug as affects tripleo, and target it to rc1? | 15:23 |
jpeeler | i see, yes | 15:23 |
* shardy checks jpeeler is in the tripleo drivers group | 15:23 | |
EmilienM | shardy: a lot of people are missing | 15:23 |
EmilienM | shardy: and I could not add them, I don't have permission | 15:23 |
EmilienM | shardy: can you make me admin please? | 15:23 |
shardy | jpeeler: added | 15:24 |
shardy | you should be able to adjust it so it's tracked in https://launchpad.net/tripleo/+milestone/newton-rc1 now | 15:24 |
shardy | EmilienM: sure | 15:24 |
EmilienM | thx | 15:24 |
dtantsur | even shorter version of the same question: how do make an endpoint to use a real IP, not VIP? | 15:24 |
dtantsur | shardy, maybe you know ^^^ | 15:25 |
hewbrocca | dtantsur: dsneddon might know | 15:25 |
hewbrocca | if not gfidente certainly will, if you don't mind him writing a few more bugs | 15:26 |
dtantsur | yeah, I just did not want to drag more people in my patch :) | 15:26 |
dtantsur | maybe I have to though | 15:26 |
shardy | dtantsur: in a meeting, will take a look and let you know | 15:26 |
dtantsur | cool, thnx | 15:27 |
shardy | most of the services are mapped to a vip that's true | 15:27 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Expose parameter to enable combination alarms https://review.openstack.org/363748 | 15:27 |
EmilienM | shardy: thx so much my dream came true | 15:28 |
EmilienM | i can now add people to launchpad group | 15:28 |
dtantsur | shardy, yeah, but iPXE is special.. it must be the local IP | 15:28 |
dtantsur | in the same fashion as we already have tftp_server | 15:28 |
*** tremble has quit IRC | 15:29 | |
jistr | dtantsur: i'm not 100% sure about the inner workings there :) -- but could this help? https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-vncproxy.yaml#L54 | 15:29 |
shardy | dtantsur: ack, I'll look at how we can wire it in | 15:29 |
gfidente | dtantsur, so I might miss context but you need a local IP of the node where the service is running? | 15:29 |
jistr | i think that actually resolves to a local ip | 15:29 |
shardy | and comment on the review | 15:29 |
dtantsur | gfidente, correct | 15:30 |
dtantsur | jistr, I tried using a similar thing, but I was unable to build a proper HTTP URL out of it | 15:30 |
gfidente | dtantsur, right we build the URL in endpoint_map | 15:30 |
gfidente | dtantsur, is shardy going to comment on same submission already? | 15:31 |
dtantsur | hopefully | 15:31 |
gfidente | I think you can build it up | 15:31 |
*** bana_k has quit IRC | 15:31 | |
dtantsur | jistr, I've already tried: https://review.openstack.org/#/c/362148/7/puppet/services/ironic-conductor.yaml but it does work | 15:32 |
dtantsur | lines 54-61 | 15:32 |
gfidente | dtantsur, yeah because map_replace doesn't do deep search | 15:32 |
*** jayg is now known as jayg|g0n3 | 15:32 | |
jistr | dtantsur: well, that's exactly what i was going to suggest :( | 15:32 |
gfidente | this guy {get_param: [ServiceNetMap, IronicNetwork]} is not replaced | 15:32 |
gfidente | dtantsur, so you get http://ctlplane:blabla ? | 15:33 |
jistr | right it's not str_replace, it only replaces if the match is exact, right? | 15:33 |
gfidente | yeah | 15:33 |
dtantsur | gfidente, correct | 15:33 |
gfidente | jistr, can we interpolate %{} within a string thouhg? | 15:33 |
jistr | gfidente: jinx!! | 15:33 |
jistr | yea hack it via 2 hiera keys | 15:34 |
dtantsur | so I ended up getting a proper endpoint, which looks cleaner. except for it gives my a VIP... | 15:34 |
*** aufi has quit IRC | 15:34 | |
jistr | ugly but i'm not sure if we can do better ATM | 15:34 |
gfidente | ugly yes | 15:34 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Set default for pingtest template https://review.openstack.org/363753 | 15:35 |
gfidente | jistr, , dtantsur, so I am going to comment that unless shardy come up with nicer solution | 15:36 |
*** tesseract- has quit IRC | 15:36 | |
dtantsur | ack thanks | 15:37 |
jistr | gfidente, dtantsur: https://paste.fedoraproject.org/418392/72657814/raw/ ? | 15:37 |
gfidente | yes that | 15:37 |
gfidente | post it in gerrit | 15:37 |
jistr | ok will do | 15:37 |
jistr | will fix the indentation too :) | 15:38 |
gfidente | wait | 15:38 |
gfidente | dtantsur, why latest version doesn't work? | 15:38 |
dtantsur | gfidente, ends up with VIP instead of a local IP | 15:38 |
dtantsur | gfidente, see the last comment for details | 15:38 |
gfidente | ah right right | 15:38 |
*** mlupton has joined #tripleo | 15:39 | |
gfidente | jistr, also not sure about the single quotes | 15:39 |
gfidente | and if those prevent {hiera()} | 15:39 |
jistr | gfidente: well we have the bug that single line strings don't get quoted :) | 15:41 |
gfidente | jistr, let's try locally, sec | 15:43 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Implement scenari001, 002 and 003 https://review.openstack.org/362504 | 15:43 |
jistr | gfidente, dtantsur: i expect that it should literally end up in hiera like this: | 15:43 |
jistr | ironic::conductor::http_url: http://%{hiera("ironic_conductor_http_host")}:8088 | 15:43 |
larsks | hewbrocca: do you know if http://logs.openstack.org/88/254788/51/check/gate-tripleo-ci-centos-7-nonha-multinode/0dd3a32/console.html#_2016-08-31_13_36_03_818182 is just ci being broken? | 15:43 |
gfidente | jistr, that format works for me locally | 15:43 |
openstackgerrit | Christopher Brown proposed openstack/tripleo-docs: The documentation is missing the tenant network under the list of networks the controller should have. This adds it. https://review.openstack.org/363760 | 15:44 |
gfidente | jistr, it also works with ironic::conductor::http_url: 'http://%{hiera("ironic_conductor_http_host")}:8088' though | 15:45 |
gfidente | though false alarm on that | 15:45 |
jistr | yea should work but to get the quotes there we'd have to do extra work :D | 15:45 |
jistr | dtantsur, gfidente: FWIW https://paste.fedoraproject.org/418400/72658325/ so if i didn't muck up the list_join, we should be golden | 15:46 |
openstackgerrit | Christopher Brown proposed openstack/tripleo-docs: Fix missing tenant network item https://review.openstack.org/363760 | 15:46 |
jistr | ^^ that's just hacked directly into the file, i didn't do heat stack-update :) | 15:46 |
*** jayg|g0n3 is now known as jayg | 15:47 | |
gfidente | weren't we talking about going to beach already before? | 15:47 |
dtantsur | jistr, thanks! I'll try it until other folks explain how wrong we are in a few minute :) | 15:47 |
*** abregman has quit IRC | 15:47 | |
gfidente | dtantsur, yeah so you don't need the endpoint_map addition | 15:47 |
gfidente | for that | 15:48 |
gfidente | which is probably good | 15:48 |
dtantsur | I was just typing this question ;) | 15:48 |
openstackgerrit | Merged openstack/puppet-tripleo: Reload HAProxy on refresh https://review.openstack.org/359038 | 15:48 |
dtantsur | jistr, I think the one-liner won't work though, as I also need to substitute a port | 15:48 |
openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Add env. setup for virt deployments doc https://review.openstack.org/363120 | 15:49 |
jistr | dtantsur: yea that's just an example of how Heat should generate it into Hiera so that it works in the end. The raw form which should be in t-h-t is different, posted here: https://review.openstack.org/#/c/362148/9/puppet/services/ironic-conductor.yaml | 15:50 |
larsks | jistr: do you know if http://logs.openstack.org/88/254788/51/check/gate-tripleo-ci-centos-7-nonha-multinode/0dd3a32/console.html#_2016-08-31_13_36_03_818182 is just ci being broken? | 15:50 |
jistr | larsks: hmm i think i saw it earlier today so now i think that yes, it's CI being broken | 15:51 |
larsks | Ugh. Okay. Just recheck, or are we waiting for someone to fix things? | 15:51 |
bnemec | larsks: It's still broken, AFAIK. | 15:54 |
*** rcernin has joined #tripleo | 15:54 | |
larsks | bnemec: okay, thanks. | 15:54 |
bnemec | For some reason git clones from git.o.o are hanging for some people, including our CI cloud. :-/ | 15:55 |
*** dsariel has quit IRC | 15:58 | |
sshnaidm | bnemec, afaiu from pabelanger it's rackspace issues | 15:59 |
*** ansiwen has quit IRC | 15:59 | |
*** abregman has joined #tripleo | 16:00 | |
*** alee_afk is now known as alee | 16:00 | |
dtantsur | do I get it right that we also haven't had a promotion since more than a week? | 16:01 |
EmilienM | dtantsur: right. | 16:01 |
EmilienM | dtantsur: jobs are timeouting as hell | 16:01 |
dtantsur | sigh, got it | 16:02 |
*** weshay is now known as weshay_food | 16:02 | |
*** trown is now known as trown|brb | 16:03 | |
jpich | d0ugal: FYI on that bug I mentioned earlier, things appear to work fine on a Brand New Undercloud | 16:04 |
*** ansiwen has joined #tripleo | 16:05 | |
jrist | jtomasek: https://review.openstack.org/#/c/358814/3/src/less/components/DeploymentPlan.less why not just delete the code? | 16:06 |
*** hewbrocca is now known as hewbrocca-afk | 16:07 | |
*** trown|brb is now known as trown | 16:08 | |
*** jprovazn has joined #tripleo | 16:09 | |
*** links has joined #tripleo | 16:10 | |
*** ianw has quit IRC | 16:13 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Skip warning for required parameters https://review.openstack.org/361384 | 16:13 |
*** abregman has quit IRC | 16:13 | |
*** fragatin_ has quit IRC | 16:14 | |
*** zoliXXL is now known as zoli|gone | 16:16 | |
*** zoli|gone is now known as zoli_gone-proxy | 16:17 | |
*** fragatina has joined #tripleo | 16:18 | |
*** akshai has quit IRC | 16:18 | |
*** jdob has quit IRC | 16:21 | |
*** fragatina has quit IRC | 16:22 | |
*** fragatina has joined #tripleo | 16:22 | |
gfidente | can you guys imagine | 16:23 |
gfidente | I had sourced overcloudrc | 16:23 |
gfidente | and tried to deploy the overcloud in the overcloud? | 16:23 |
gfidente | I think bnemec can | 16:23 |
*** egafford has joined #tripleo | 16:24 | |
pabelanger | sshnaidm: bnemec: we are still working on the issue | 16:24 |
bnemec | gfidente: Heh. That's what CI is doing. | 16:24 |
bnemec | Well, it was when jobs were running. :-) | 16:24 |
bnemec | pabelanger: Thanks for the update. Let us know if there's anything we can do to help. | 16:25 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Add NetApp Manila driver integration and tidy up generic https://review.openstack.org/354019 | 16:25 |
gfidente | bnemec, I didn't do it on purpose, but it actually went up to fail for an actual error in the tht code | 16:25 |
dtantsur | gfidente, why do you think I'm working on ironic support in overcloud? | 16:26 |
dtantsur | specifically to run TripleO there | 16:26 |
bnemec | I suppose. Creating servers, networks, etc. on the overcloud should work fine. | 16:26 |
bnemec | Now I'm curious if you could run an entire deployment that way. | 16:27 |
gfidente | dtantsur, aaaaaaaaaaah ahaaaaaaaaaaaa I knew there was something going on | 16:27 |
gfidente | bnemec, was without netiso to be fair | 16:27 |
shardy | In theory you could do it without ironic, just deploying to virt OS::Nova::Server's | 16:28 |
dtantsur | this is not fun, c'mon | 16:28 |
shardy | I tried a while ago but ran into some networking stuff I didn't find time to debug | 16:28 |
bnemec | Yeah. That's kind of what the multinode job does. Except it completely stubs out the Servers. | 16:29 |
*** jpich has quit IRC | 16:29 | |
dtantsur | shardy, will you have a second to check guys' suggestion on https://review.openstack.org/#/c/362148/9/puppet/services/ironic-conductor.yaml ? | 16:29 |
*** dprince has joined #tripleo | 16:30 | |
*** weshay_food is now known as weshay | 16:30 | |
shardy | dtantsur: Yeah, that's simpler, I think I missed the lack of VIP thing when we first discussed it | 16:31 |
dtantsur | okie, lemme try | 16:31 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Add NetApp Manila driver integration and tidy up generic https://review.openstack.org/354019 | 16:32 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: IGNORE - testing manila-generic deploy after tidyup https://review.openstack.org/362866 | 16:32 |
*** wgd3[away] has quit IRC | 16:34 | |
*** nyechiel has quit IRC | 16:34 | |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates: Ironic: enable iPXE by default and make it configurable https://review.openstack.org/362148 | 16:37 |
dtantsur | shardy, gfidente better ^^? | 16:37 |
gfidente | dtantsur, I think it's fine | 16:39 |
gfidente | why is it that we need it formatted as an url but points to local ip though? | 16:39 |
dtantsur | gfidente, ironic uses it to serve images cached locally on the conductor | 16:40 |
dtantsur | gfidente, this "locally on the conductor" means we can't load-balance it or anything like that | 16:40 |
gfidente | yeah | 16:40 |
gfidente | got it | 16:41 |
dtantsur | what's wrong with gerrit and git today?? both work like if it's Friday evening or even night already... | 16:41 |
*** ianw has joined #tripleo | 16:43 | |
*** lucasagomes has quit IRC | 16:44 | |
*** lucasagomes has joined #tripleo | 16:46 | |
*** akshai has joined #tripleo | 16:50 | |
*** numans has quit IRC | 16:50 | |
*** trown is now known as trown|lunch | 16:58 | |
*** bana_k has joined #tripleo | 17:02 | |
*** ohamada has quit IRC | 17:03 | |
*** yamahata has quit IRC | 17:05 | |
*** akshai has quit IRC | 17:07 | |
*** derekh has quit IRC | 17:09 | |
*** akshai has joined #tripleo | 17:12 | |
*** dbecker has quit IRC | 17:13 | |
*** akshai has quit IRC | 17:14 | |
*** jpena is now known as jpena|off | 17:17 | |
*** akshai has joined #tripleo | 17:18 | |
*** lucasagomes is now known as lucas-dinner | 17:19 | |
*** dsariel has joined #tripleo | 17:23 | |
*** akshai has quit IRC | 17:23 | |
*** akshai has joined #tripleo | 17:25 | |
*** akshai has quit IRC | 17:26 | |
*** akshai has joined #tripleo | 17:28 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: WIP testing do not merge https://review.openstack.org/363560 | 17:28 |
*** dsariel has quit IRC | 17:30 | |
*** jdob has joined #tripleo | 17:31 | |
EmilienM | shardy: no release today i guess | 17:35 |
EmilienM | shardy: I see less timeouts now | 17:35 |
EmilienM | maybe I'll submit it later if I see green jobs | 17:35 |
shardy | EmilienM: No, I guess not, hopefully we'll get CI working and can release tomorrow | 17:35 |
*** akrivoka has quit IRC | 17:35 | |
shardy | EmilienM: ack, thanks, I'll do likewise if CI is working when I start tomorrow morning | 17:36 |
shardy | EmilienM: note we need to release tripleo-ui and tripleo-validations too which I don't think we did for newton-2 | 17:36 |
*** dtantsur is now known as dtantsur|afk | 17:36 | |
EmilienM | shardy: right | 17:36 |
*** abregman has joined #tripleo | 17:37 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: oooq undercloud install https://review.openstack.org/358919 | 17:37 |
*** pcaruana has joined #tripleo | 17:39 | |
*** athomas has quit IRC | 17:39 | |
dhill_ | hi guys | 17:40 |
dhill_ | https://bugzilla.redhat.com/1371685 | 17:41 |
openstack | bugzilla.redhat.com bug 1371685 in openstack-tripleo-heat-templates "When using HostnameMap with more than 9 computes, hostnames are not properly set" [Unspecified,New] - Assigned to jstransk | 17:41 |
dhill_ | Anyone knows a quick hack for this issue? | 17:41 |
*** yamahata has joined #tripleo | 17:42 | |
*** electrofelix has quit IRC | 17:42 | |
*** nyechiel has joined #tripleo | 17:44 | |
*** rwsu has quit IRC | 17:44 | |
*** mhenkel has quit IRC | 17:44 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Remove hard-coded per-service rabbitmq hieradata https://review.openstack.org/361731 | 17:52 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Create NetIpListMap for all roles https://review.openstack.org/361777 | 17:52 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Generate composable service node_names lists https://review.openstack.org/355068 | 17:52 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Composable per-service VIP hieradata https://review.openstack.org/361778 | 17:52 |
shardy | dhill_: yes, sec | 17:52 |
*** nyechiel has quit IRC | 17:53 | |
shardy | dhill_: just commented, it's a duplicate of another bz related to https://bugs.launchpad.net/heat/+bug/1600209 | 17:56 |
openstack | Launchpad bug 1600209 in tripleo "HostnameMap can result in partial replacement" [High,Fix released] - Assigned to Steven Hardy (shardy) | 17:56 |
shardy | there is a workaround of adding an end character to the strings, and also a heat fix which has landed | 17:56 |
*** akshai has quit IRC | 17:57 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart: WIP: Add directory to store documentation files https://review.openstack.org/361483 | 17:58 |
*** nyechiel has joined #tripleo | 17:58 | |
*** trown|lunch is now known as trown | 18:02 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Composable per-service VIP hieradata https://review.openstack.org/361778 | 18:02 |
*** akshai has joined #tripleo | 18:06 | |
*** abehl has quit IRC | 18:07 | |
*** pkovar has quit IRC | 18:10 | |
*** florianf has quit IRC | 18:16 | |
*** shardy is now known as shardy_afk | 18:24 | |
*** shardy_afk has quit IRC | 18:25 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: set up quickstart to replace instack-virt-setup https://review.openstack.org/358089 | 18:25 |
EmilienM | tripleo newton-3 release patch is ready for review https://review.openstack.org/363868 | 18:27 |
openstackgerrit | Jeff Peeler proposed openstack/tripleo-common: Add List Roles Action https://review.openstack.org/330283 | 18:28 |
bnemec | EmilienM: panda|afk: Okay, I give up. I don't know how to make the cinder config right in ipv6. https://bugs.launchpad.net/tripleo/+bug/1618930 | 18:31 |
openstack | Launchpad bug 1618930 in tripleo "cinder config broken in ipv6" [Critical,Triaged] - Assigned to Ben Nemec (bnemec) | 18:31 |
EmilienM | bnemec: ok looking | 18:31 |
EmilienM | damn we had this problem before | 18:32 |
EmilienM | I remember gfidente fixed that | 18:32 |
gfidente | oh a question of brackets again | 18:32 |
gfidente | it might have gone missed with the roles | 18:32 |
gfidente | bnemec, right looks like we want the quotes around the brackets? | 18:33 |
bnemec | gfidente: I _think_ so, but I can't figure out how to get the templates to write that to hiera. | 18:33 |
bnemec | I tested adding the brackets manually to cinder.conf after deployment, but I don't know for sure what the hieradata needs to look like. | 18:34 |
*** dprince has quit IRC | 18:36 | |
*** sshnaidm is now known as sshnaidm|afk | 18:36 | |
pradk | bnemec, hi, was looking at https://bugs.launchpad.net/tripleo/+bug/1618924 | 18:38 |
openstack | Launchpad bug 1618924 in tripleo "gnocchi-metricd fails to start in nonha" [High,Triaged] | 18:38 |
pradk | bnemec, do you know which repo we use in ci? the issue is fixed in cotyledon 1.2.7 | 18:39 |
pradk | bnemec, so we just need to pull in new version of cotyledon into deps repo and we should be good | 18:39 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Ensure cinder_iscsi_address is in quotes https://review.openstack.org/363882 | 18:39 |
gfidente | bnemec, probably https://review.openstack.org/363882 | 18:40 |
gfidente | my hopes are that heat will consider " as part of the template for the str_replace | 18:40 |
gfidente | bnemec, I guess we can inspect the hieradata of the normal CI run to see if the IPv4 address goes in " | 18:40 |
bnemec | pradk: Okay, we only have python-cotyledon-1.2.5-0.1.pre_review.el7.noarch in CI. | 18:41 |
bnemec | If that's coming from the deps repo then I guess we'll need to talk to RDO folks. | 18:41 |
pradk | bnemec, yea thats the issue.. i'll chase it down. can you point me to the repo link we're using? | 18:41 |
bnemec | gfidente: I can try it quick locally too. | 18:41 |
gfidente | bnemec, ah nice | 18:41 |
*** _milan_ has joined #tripleo | 18:42 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Last round of modern authtoken update https://review.openstack.org/363182 | 18:42 |
*** milan has quit IRC | 18:43 | |
bnemec | pradk: It's whatever tripleo.sh --repo-setup downloads. | 18:43 |
*** chem has quit IRC | 18:43 | |
pradk | k i'll check | 18:43 |
*** chem has joined #tripleo | 18:44 | |
EmilienM | gfidente: nice :) | 18:45 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: midonet: update neutron parameter https://review.openstack.org/363178 | 18:47 |
bnemec | Sigh. Stack updates are still broken? | 18:49 |
bnemec | Mine are anyway. | 18:49 |
*** jbadiapa has quit IRC | 18:49 | |
bnemec | So much for a quick test. | 18:49 |
gfidente | EmilienM, if it works ... | 18:53 |
*** mwhahaha has quit IRC | 18:54 | |
EmilienM | bnemec: have you heat updated? | 18:54 |
bnemec | EmilienM: I'm using whatever I got when I installed the undercloud yesterday. | 18:54 |
*** akshai has quit IRC | 18:55 | |
*** akshai has joined #tripleo | 18:55 | |
EmilienM | the problem is that promotion didn't happen in our CI for 7 days | 18:55 |
EmilienM | and the heat fix was packaged in the meantime | 18:56 |
*** dprince has joined #tripleo | 18:59 | |
*** mwhahaha has joined #tripleo | 19:00 | |
*** hrybacki is now known as hrybacki|afk | 19:02 | |
dhill_ | shardy: thank you sir... that'll help me a bit | 19:04 |
dhill_ | shardy: I'm wondering why I didn't find it | 19:04 |
bnemec | Good grief. A 12 GB undercloud is no longer large enough for a development environment. | 19:05 |
bnemec | heat-engine just oom'd on just my third deployment today. | 19:05 |
chem | bnemec: time to add some swap file | 19:06 |
bnemec | chem: No, this is why I just bought a box with 144 GB of RAM. ;-) | 19:07 |
*** kjw3 has joined #tripleo | 19:08 | |
EmilienM | you can test all composable services with 144GB of RAM | 19:08 |
chem | bnemec: that will warmup you house by a few degree :) | 19:08 |
*** ifarkas is now known as ifarkas_afk | 19:11 | |
bnemec | chem: It does, but it's better than I thought it might be. The box only pulls around 90 watts at idle. | 19:11 |
bnemec | And in the winter I'll appreciate it. :-) | 19:11 |
bnemec | EmilienM: Maybe...;-) | 19:11 |
*** links has quit IRC | 19:13 | |
chem | bnemec: not that bad, what about noise, can we have nowadays a big server at home without everybody going crazy | 19:14 |
gfidente | bnemec, do you still buy these on ebay? | 19:15 |
EmilienM | my gf would kill me if I do that | 19:15 |
EmilienM | or just leave | 19:15 |
dhill_ | bnemec: I have less memory than you | 19:16 |
dhill_ | bnemec and it's not ooming | 19:16 |
dhill_ | bnemec but I'm cheating with lots of swap on SSD :) | 19:16 |
bnemec | chem: This one is not bad. The Poweredge R710 is incredibly quiet by server standards. | 19:17 |
EmilienM | jrist: fyi https://review.openstack.org/363897 | 19:17 |
bnemec | Still louder than my quiet desktops, but very tolerable. | 19:17 |
chem | bnemec: hum ... interesting. Thanks for the info | 19:17 |
bnemec | gfidente: Yeah, it's another EBay special. | 19:17 |
chem | hehe | 19:17 |
bnemec | dhill_: SSDs are nice for swap. :-) | 19:18 |
*** fragatin_ has joined #tripleo | 19:18 | |
EmilienM | just make sure you keep enough space on your ssd disk not encrypted | 19:19 |
EmilienM | so you win performance | 19:19 |
dhill_ | bnemec: on a 32gb laptop I can deploy 9 overcloud nodes and a director... running into all the possible race conditions possible ;) | 19:19 |
bnemec | dhill_: I don't hate myself enough to do that. :-P | 19:20 |
*** coolsvap has quit IRC | 19:22 | |
*** fragatina has quit IRC | 19:22 | |
bnemec | Just finished cleaning up all the leftover instances on rh1 from deleted heat stacks and the leftover instance_uuids in my undercloud ironic from deleted nova instances. | 19:23 |
bnemec | OpenStack: Eventual consistency, for extremely large values of "eventual". | 19:23 |
bnemec | Okay, ipv6 overcloud is finally deploying. Time to eat before I pass out from low blood sugar. | 19:24 |
*** mlupton has quit IRC | 19:24 | |
*** mlupton has joined #tripleo | 19:25 | |
*** akshai has quit IRC | 19:25 | |
*** akshai has joined #tripleo | 19:28 | |
gfidente | bnemec, oh the cinder thing worked? | 19:28 |
gfidente | bnemec, I need guidance over those ebay buys | 19:28 |
openstackgerrit | Jeff Peeler proposed openstack/tripleo-common: Include environments in capabilities output https://review.openstack.org/355598 | 19:29 |
*** mlupton has quit IRC | 19:29 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: apache: Remove product informations https://review.openstack.org/363105 | 19:30 |
bnemec | gfidente: I'm just testing the cinder thing. My undercloud oom'd the first time I tried it, then it was failing because of bogus node associations. | 19:30 |
*** akshai has quit IRC | 19:31 | |
*** akshai has joined #tripleo | 19:32 | |
*** nyechiel has quit IRC | 19:32 | |
larsks | Hey folks; do we know if CI is feeling better at this point? | 19:32 |
*** jeckersb is now known as jeckersb_gone | 19:32 | |
bnemec | gfidente: http://www.ebay.com/itm/Dell-Poweredge-R710-2x-Xeon-X5670-2-93ghz-Hex-144gb-2x-2tb-SATA-Perc6i-2x-870w-/232063580171?hash=item360811380b:g:2o8AAOSwl8NVeaET | 19:33 |
bnemec | :-) | 19:33 |
bnemec | larsks: Afraid not. Still no jobs running. | 19:34 |
bnemec | At least not to the point where they would spin up a testenv. | 19:34 |
larsks | Well okay then :) | 19:34 |
bnemec | Infra is continuing to investigate, but from the scrollback it doesn't sound like they have a fix yet. | 19:35 |
pabelanger | waiting on rackspace now | 19:36 |
pabelanger | is a support issue | 19:36 |
*** flepied has joined #tripleo | 19:37 | |
*** mlupton has joined #tripleo | 19:37 | |
EmilienM | pabelanger: is it a bad time for asking a review ? https://review.openstack.org/#/c/363629/ | 19:37 |
*** bfournie has left #tripleo | 19:38 | |
pabelanger | EmilienM: Ya, head down launching a new cloud. I'll review once finished | 19:38 |
EmilienM | pabelanger: np | 19:38 |
*** mlupton has quit IRC | 19:40 | |
EmilienM | bnemec: what do you think if we add more debug during pingtest | 19:40 |
*** mlupton has joined #tripleo | 19:40 | |
EmilienM | it's hard to find out what was wrong during pingtest if it failed | 19:40 |
EmilienM | pradk: you remember the error I had with gnocchi and pingtest? | 19:42 |
EmilienM | pradk: I think it wasn't redis | 19:42 |
EmilienM | pradk: http://logs.openstack.org/05/362505/2/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-nv/2f6c560/logs/subnode-2/var/log/aodh/app.txt.gz | 19:42 |
EmilienM | GnocchiUnavailable: Cannot use v2 authentication with domain scope | 19:42 |
EmilienM | it seems like aodh is not able to talk with gnocchi | 19:42 |
*** mlupton has quit IRC | 19:43 | |
EmilienM | pradk: I don't even see gnocchi & aodh config in http://logs.openstack.org/05/362505/2/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-nv/2f6c560/logs/subnode-2/etc/ wtf | 19:43 |
*** fragatin_ has quit IRC | 19:45 | |
*** fragatina has joined #tripleo | 19:45 | |
bnemec | EmilienM: Such as? We already dump out a bunch of stuff if it fails, but if there's more that would be useful there I'm fine with adding it. | 19:46 |
bnemec | openstack stack failures list tenant-stack would probably be good, I guess. Now that that's a thing. :-) | 19:46 |
EmilienM | bnemec: good idea | 19:46 |
pradk | EmilienM, hmm i see.. need to double check service credentials . aodh should be able to find gnocchi service from keystone service catelog | 19:47 |
*** jeckersb_gone is now known as jeckersb | 19:47 | |
bnemec | gfidente: Bad news: tripleo::profile::base::cinder::volume::iscsi::cinder_iscsi_address: "storage_uri" | 19:47 |
bnemec | Es no bueno. | 19:47 |
* bnemec needs to brush up on his Spanish before Barcelona | 19:47 | |
*** mlupton has joined #tripleo | 19:48 | |
*** mlupton has quit IRC | 19:49 | |
*** akshai has quit IRC | 19:49 | |
*** mlupton has joined #tripleo | 19:49 | |
sshnaidm|afk | is ipv6 ssh problem tracked anywhere? | 19:51 |
*** maeca1 has joined #tripleo | 19:55 | |
*** mlupton has quit IRC | 19:56 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: pingtest: run 'openstack stack failures list' when failure https://review.openstack.org/363918 | 19:56 |
EmilienM | bnemec: ^ | 19:56 |
*** mlupton has joined #tripleo | 19:56 | |
EmilienM | sshnaidm|afk: not afik | 19:56 |
*** mburned has quit IRC | 20:01 | |
*** liverpooler has quit IRC | 20:07 | |
pradk | EmilienM, we ran into similar issue with ceilo i think.. the issue is we append auth url with /v2 . But if you see the rest of the logs, i dont see any gnochi or aodh services come up due to redis not being up and also due to the bug https://bugs.launchpad.net/tripleo/+bug/1618924 | 20:08 |
openstack | Launchpad bug 1618924 in tripleo "gnocchi-metricd fails to start in nonha" [High,Triaged] | 20:08 |
chem | gfidente: could you tell me what I should look to decipher this error: resources.Controller: resources[0]: NotFound_Remote: resources.UpdateDeployment: Software config with id efdb9688-0279-4173-854f-c2be1c83fe3e not found | 20:09 |
*** mburned has joined #tripleo | 20:09 | |
pradk | EmilienM, with metricd, statsd not up and evaluator not running.. aodh wont be able to much with gnocchi | 20:09 |
thrash | EmilienM: I think it needs a stack name, right? | 20:09 |
thrash | EmilienM: it does. | 20:10 |
chem | gfidente: how can I find which conf trigger that | 20:10 |
thrash | EmilienM: https://review.openstack.org/#/c/363918/1/scripts/tripleo.sh,unified | 20:10 |
*** jprovazn has quit IRC | 20:10 | |
chem | EmilienM: do you know who could answer this question ^ | 20:11 |
EmilienM | brb | 20:11 |
thrash | chem: Can you try running 'openstack stack failures list --long overcloud'? | 20:12 |
chem | thrash: ack ... I have to wait a few minute before doing it, I have restarted my fail upgrade | 20:13 |
thrash | chem: ack | 20:13 |
chem | thrash: oki, it failed :) | 20:14 |
*** mlupton_ has joined #tripleo | 20:14 | |
chem | thrash: only one soft conf id was missing this time ... anyway running the command | 20:14 |
gfidente | bnemec, right, the quotes are in there but the key is not replaceable anymore | 20:15 |
*** mlupton has quit IRC | 20:16 | |
chem | thrash: http://paste.openstack.org/show/565312/ , if you could help me debug this | 20:16 |
bnemec | chem: Are you running with the current-tripleo Heat? Apparently that one is broken for stack updates and you need to use the one from the latest dlrn repo. | 20:17 |
bnemec | gfidente: Yeah, same problem I had in my test. I have no idea how the replacement works, so I don't know how to fix it. | 20:17 |
gfidente | bnemec, so I don't think we're going to get quotes after the key is replaced | 20:18 |
chem | bnemec: I have osp-d heat running | 20:18 |
chem | bnemec: version 10 | 20:18 |
*** jayg is now known as jayg|g0n3 | 20:18 | |
EmilienM | thrash: ack, thanks | 20:18 |
EmilienM | pradk: ok but why don't we see aodh/gnocchi etc? | 20:19 |
chem | bnemec: so not far from current-triple .. but don't know exactly whchi version I should look for | 20:19 |
*** mlupton has joined #tripleo | 20:19 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: pingtest: run 'openstack stack failures list' when failure https://review.openstack.org/363918 | 20:19 |
EmilienM | thrash: ^ | 20:19 |
bnemec | chem: Probably the same issue. The latest director builds probably have the same bug. | 20:20 |
*** mlupton has quit IRC | 20:20 | |
chem | bnemec: do you have a link or something to the bug ? | 20:20 |
*** mlupton_ has quit IRC | 20:22 | |
*** mlupton has joined #tripleo | 20:25 | |
*** akshai has joined #tripleo | 20:27 | |
*** nyechiel has joined #tripleo | 20:27 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Ensure cinder_iscsi_address is in quotes https://review.openstack.org/363882 | 20:29 |
gfidente | bnemec, ^^ ugly but ... | 20:29 |
*** jpeeler has quit IRC | 20:30 | |
EmilienM | nice ! | 20:30 |
*** Goneri has quit IRC | 20:30 | |
gfidente | EmilienM, ahahah it's even worst than what it was | 20:30 |
gfidente | EmilienM, but I can't think of many other ways to make this work | 20:30 |
gfidente | if not *any* other way | 20:31 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Implement scenari001, 002 and 003 https://review.openstack.org/362504 | 20:32 |
gfidente | EmilienM, we can't work it out in puppet-tripleo for example because hiera fails parsing the value in brackets without inner quotes | 20:32 |
*** assassin has quit IRC | 20:33 | |
*** ubijtsa has joined #tripleo | 20:33 | |
EmilienM | gfidente: right | 20:34 |
EmilienM | gfidente: hopefully we can sort this out later with fqdn | 20:34 |
gfidente | yeah | 20:34 |
*** ubijtsa is now known as Guest44588 | 20:34 | |
thrash | chem: I think what bnemec told you is best bet at this point. | 20:37 |
pblaho | hi guys... pls, where I can find how policy.json files are generated in RDO? | 20:38 |
*** nyechiel has quit IRC | 20:39 | |
pblaho | b/c upstream one is empty - https://github.com/openstack/nova/blob/master/etc/nova/policy.json | 20:39 |
*** ansiwen has quit IRC | 20:41 | |
bnemec | gfidente: Heh, okay let me try that one. | 20:43 |
gfidente | bnemec, :( | 20:43 |
chem | thrash: ack | 20:45 |
chem | thrash: bnemec thanks for looking | 20:45 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Add missing reference to ExternalPort for DVR https://review.openstack.org/363188 | 20:46 |
chem | bnemec: but ... if you have more info about this broken upgrade I would really apreciate :) | 20:47 |
bnemec | chem: I'm on a call right now, but I assume a bug was opened in launchpad. | 20:47 |
bnemec | I wasn't actually involved in it, I just heard about it in IRC. | 20:48 |
openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Add Ceph RGW profile https://review.openstack.org/334081 | 20:49 |
*** _milan_ has quit IRC | 20:49 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role https://review.openstack.org/289027 | 20:53 |
*** jdob has quit IRC | 20:58 | |
*** rwsu has joined #tripleo | 21:00 | |
*** rhallisey has quit IRC | 21:01 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role https://review.openstack.org/289027 | 21:01 |
*** ansiwen has joined #tripleo | 21:03 | |
pradk | EmilienM, yea its weird you dont have those dir's in etc .. a good way to verify this would be to try creating gnocchi alarms from cli once overcloud comes up with master . I'll check tonight | 21:05 |
*** jlinkes has quit IRC | 21:08 | |
pradk | *this* == is aodh able to talk to gnocchi when overcloud comes up | 21:09 |
*** ayoung has quit IRC | 21:10 | |
*** jcoufal has quit IRC | 21:12 | |
*** jlinkes has joined #tripleo | 21:12 | |
*** jlinkes has quit IRC | 21:16 | |
chem | bnemec: ack thanks, will look for it | 21:17 |
*** matbu is now known as matbu|afk | 21:17 | |
bnemec | chem: https://bugs.launchpad.net/heat/+bug/1616550 | 21:19 |
openstack | Launchpad bug 1616550 in heat "Overcloud update is broken: UPDATE_FAILED NotFound_Remote: resources[0]: Software config with id not found" [High,Fix released] - Assigned to Zane Bitter (zaneb) | 21:19 |
*** dprince has quit IRC | 21:19 | |
bnemec | The call is waiting for the user to configure their networking correctly. :-) | 21:19 |
*** lblanchard has quit IRC | 21:19 | |
chem | bnemec: ah, thanks you. I was about to look for it | 21:19 |
chem | bnemec: hum ... yep not easy :) | 21:19 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role https://review.openstack.org/289027 | 21:20 |
*** ansiwen has quit IRC | 21:21 | |
EmilienM | thrash, bnemec: easy review https://review.openstack.org/#/c/363178/ | 21:23 |
EmilienM | and https://review.openstack.org/#/c/363182/ | 21:23 |
*** yolanda has joined #tripleo | 21:26 | |
*** egafford has quit IRC | 21:27 | |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Decouple deployment plans from Heat stacks https://review.openstack.org/363950 | 21:29 |
*** fzdarsky has quit IRC | 21:29 | |
*** jlinkes has joined #tripleo | 21:36 | |
*** cdearborn has quit IRC | 21:38 | |
*** rwsu has quit IRC | 21:38 | |
*** rwsu has joined #tripleo | 21:38 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Use netapp_host_type instead of netapp_eseries_host_type https://review.openstack.org/363955 | 21:42 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: oooq undercloud install https://review.openstack.org/358919 | 21:43 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Use netapp_host_type instead of netapp_eseries_host_type https://review.openstack.org/363955 | 21:43 |
*** mburned is now known as mburned_out | 21:48 | |
openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Add Ceph RGW profile https://review.openstack.org/334081 | 21:50 |
*** maeca1 has quit IRC | 21:50 | |
*** maeca1 has joined #tripleo | 21:51 | |
*** maeca1 has quit IRC | 21:51 | |
*** yolanda has quit IRC | 21:56 | |
*** morazi has quit IRC | 21:59 | |
*** hrybacki|afk is now known as hrybacki | 21:59 | |
*** mlupton has quit IRC | 22:01 | |
openstackgerrit | Steve Baker proposed openstack/tripleo-specs: Propose a config-agent bug tag https://review.openstack.org/363960 | 22:01 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK: periodic jobs https://review.openstack.org/359215 | 22:01 |
*** mlupton has joined #tripleo | 22:02 | |
openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Ensure iscsi_ip_address is in brackets if IPv6 https://review.openstack.org/363961 | 22:03 |
*** ansiwen has joined #tripleo | 22:05 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Pass cinder_iscsi_address without brackets https://review.openstack.org/363882 | 22:05 |
gfidente | bnemec, EmilienM so this was my last attempt, I am sorry I wasted your time as well | 22:05 |
mwhahaha | didn't a function get added in puppet to check if it's an ipv6 address and add brackets | 22:09 |
mwhahaha | can't you just use that | 22:09 |
mwhahaha | chem wrote it i thought | 22:10 |
gfidente | mwhahaha, enclose_ipv6 ? | 22:10 |
gfidente | I think it returns an array though | 22:11 |
gfidente | even if you pass it a string | 22:11 |
bnemec | Bracket me maybe, to the tune of https://www.youtube.com/watch?v=fWNaR-rxAic | 22:11 |
bnemec | :-) | 22:11 |
mwhahaha | no was something else | 22:11 |
mwhahaha | https://github.com/openstack/puppet-openstacklib/blob/master/lib/puppet/parser/functions/normalize_ip_for_uri.rb | 22:11 |
mwhahaha | normalize_ip_for_uri | 22:11 |
mwhahaha | aka we couldn't think of anything better | 22:12 |
gfidente | ahahaha | 22:12 |
gfidente | checking | 22:12 |
gfidente | thanks | 22:12 |
*** panda|afk has quit IRC | 22:12 | |
*** akshai has quit IRC | 22:12 | |
gfidente | mwhahaha, welcome? | 22:12 |
mwhahaha | thanks? :D | 22:13 |
gfidente | ^_^ | 22:13 |
chem | gfidente: mwhahaha well everybody was against add_ipv6_bracket_maybe | 22:13 |
mwhahaha | is_this_an_ipv6_address_question_mark | 22:14 |
chem | gfidente: it doesn't return an array, and it works with only one arg https://github.com/openstack/puppet-openstacklib/blob/master/spec/functions/normalize_ip_for_uri_spec.rb | 22:17 |
gfidente | mwhahaha, chem yeah noticed | 22:17 |
gfidente | I need to include ::openstacklib | 22:19 |
gfidente | to call it right? | 22:19 |
mwhahaha | no | 22:19 |
mwhahaha | it's a parser function | 22:19 |
mwhahaha | as long as openstacklib is in the module path it'll work | 22:19 |
mwhahaha | which it should be if you're using any openstack puppet modules :D | 22:20 |
gfidente | ah I did not know those were global | 22:22 |
gfidente | or maybe never noticed | 22:22 |
gfidente | thanks! | 22:22 |
mwhahaha | they are pretty hidden | 22:23 |
openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Ensure iscsi_ip_address is in brackets if IPv6 https://review.openstack.org/363961 | 22:23 |
mwhahaha | need better docs around what's available | 22:23 |
gfidente | mwhahaha, chem so that should just work? | 22:23 |
mwhahaha | yea | 22:24 |
*** panda|afk has joined #tripleo | 22:25 | |
chem | mwhahaha: yep, some entries in the readme.md would be nice. | 22:26 |
chem | mwhahaha: will had bracket_me_maybe tomorrow | 22:26 |
mwhahaha | :o | 22:27 |
gfidente | don't deprecate the old one though | 22:27 |
gfidente | just mv | 22:27 |
chem | hehe | 22:27 |
chem | s/had/add/ | 22:27 |
chem | oki, I'm off | 22:28 |
*** chem is now known as chem|off | 22:28 | |
bnemec | gfidente: It's looking like that should work. | 22:29 |
bnemec | I tested the original non-bracket me maybe version, but since they do the same thing I expect the results to match. | 22:30 |
gfidente | bnemec, we'll have this _uri thing with all the outputs | 22:30 |
gfidente | potentially breaking hiera? | 22:30 |
*** akshai has joined #tripleo | 22:32 | |
*** akshai has quit IRC | 22:34 | |
bnemec | gfidente: It's on step 5 and hasn't blown up on hiera errors, so I think we should be okay. | 22:35 |
bnemec | Overcloud deploys take so damn long now though. | 22:35 |
bnemec | I used to be able to do them in a little over 15 minutes. Now it's close to 30. :-( | 22:36 |
*** akshai has joined #tripleo | 22:42 | |
gfidente | bnemec, good, thanks | 22:42 |
*** bana_k has quit IRC | 22:42 | |
*** nyechiel has joined #tripleo | 22:43 | |
bnemec | gfidente: tripleo.sh -- Overcloud pingtest SUCCEEDED | 22:44 |
bnemec | Looks like we're good. | 22:44 |
openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Add Ceph RGW profile https://review.openstack.org/334081 | 22:45 |
gfidente | bnemec, ehe | 22:46 |
*** nyechiel has quit IRC | 22:53 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role https://review.openstack.org/289027 | 22:56 |
*** bana_k has joined #tripleo | 22:56 | |
*** dtrainor has quit IRC | 22:58 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: [NO MERGE] Test Ceph RadosGW as replacement for Swift https://review.openstack.org/357182 | 22:59 |
*** pradk has quit IRC | 23:03 | |
*** jlinkes has quit IRC | 23:03 | |
*** dtrainor has joined #tripleo | 23:09 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: oooq undercloud install https://review.openstack.org/358919 | 23:11 |
*** akshai_ has joined #tripleo | 23:15 | |
*** jlinkes has joined #tripleo | 23:16 | |
*** akshai has quit IRC | 23:19 | |
*** maeca1 has joined #tripleo | 23:23 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Pass cinder_iscsi_address without brackets https://review.openstack.org/363882 | 23:30 |
*** dtrainor has quit IRC | 23:31 | |
*** dtrainor has joined #tripleo | 23:44 | |
*** jlinkes has quit IRC | 23:57 | |
*** rwsu has quit IRC | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!