| *** Ryjedo_ has joined #tripleo | 00:06 | |
| *** Ryjedo has quit IRC | 00:08 | |
| *** Ryjedo_ is now known as Ryjedo | 00:08 | |
| *** myoung has quit IRC | 00:10 | |
| *** limao has joined #tripleo | 00:51 | |
| *** maeca1 has joined #tripleo | 01:03 | |
| *** dmacpher has joined #tripleo | 01:11 | |
| *** limao_ has joined #tripleo | 01:16 | |
| openstackgerrit | Ratnakar Kolli proposed openstack/tripleo-heat-templates: Adding optional aci-opflex hiera data https://review.openstack.org/352661 | 01:18 |
|---|---|---|
| *** limao has quit IRC | 01:19 | |
| *** ratnakar has joined #tripleo | 01:21 | |
| ratnakar | #openstack-meeting-alt | 01:22 |
| *** ratnakar has quit IRC | 01:22 | |
| *** chlong has joined #tripleo | 01:27 | |
| *** bana_k has quit IRC | 01:32 | |
| *** bana_k has joined #tripleo | 01:34 | |
| *** jrist has quit IRC | 01:36 | |
| *** ebalduf has quit IRC | 01:39 | |
| *** jrist has joined #tripleo | 01:50 | |
| *** yamahata has quit IRC | 02:02 | |
| *** yamahata has joined #tripleo | 02:07 | |
| jrist | thrash|g0ne: I am | 02:08 |
| *** jdob has quit IRC | 02:08 | |
| *** jrist has quit IRC | 02:14 | |
| *** coolsvap has joined #tripleo | 02:19 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/tripleo-quickstart: [WIP] undercloud reboot https://review.openstack.org/350489 | 02:24 |
| *** maeca1 has quit IRC | 02:25 | |
| *** jrist has joined #tripleo | 02:26 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/tripleo-quickstart: [WIP] undercloud reboot https://review.openstack.org/350489 | 02:34 |
| *** Ryjedo_ has joined #tripleo | 02:40 | |
| *** fragatina has quit IRC | 02:44 | |
| *** Ryjedo has quit IRC | 02:44 | |
| *** Ryjedo_ is now known as Ryjedo | 02:44 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Move *Flavor parameters into per-role templates https://review.openstack.org/347265 | 02:45 |
| openstackgerrit | Merged openstack/instack-undercloud: Revert "glance: disable swift backend" https://review.openstack.org/336652 | 02:49 |
| *** ebalduf has joined #tripleo | 02:53 | |
| *** coolsvap is now known as coolsvap_ | 02:59 | |
| *** milan has quit IRC | 03:00 | |
| *** julim has quit IRC | 03:00 | |
| *** tzumainn has quit IRC | 03:03 | |
| *** limao_ has quit IRC | 03:03 | |
| *** limao has joined #tripleo | 03:04 | |
| *** limao has quit IRC | 03:09 | |
| *** milan has joined #tripleo | 03:10 | |
| openstackgerrit | Xiang Chen proposed openstack/diskimage-builder: check APT_SOURCES earlier https://review.openstack.org/346605 | 03:19 |
| *** saneax_AFK has quit IRC | 03:19 | |
| *** yamahata has quit IRC | 03:21 | |
| *** saneax_AFK has joined #tripleo | 03:22 | |
| *** saneax_AFK is now known as saneax | 03:22 | |
| *** saneax is now known as Guest79977 | 03:22 | |
| openstackgerrit | Xiang Chen proposed openstack/diskimage-builder: check APT_SOURCES earlier https://review.openstack.org/346605 | 03:25 |
| *** Guest79977 is now known as saneax_AFK | 03:40 | |
| *** myoung has joined #tripleo | 03:42 | |
| *** limao_ has joined #tripleo | 03:59 | |
| *** fultonj has quit IRC | 04:00 | |
| *** limao__ has joined #tripleo | 04:00 | |
| *** limao_ has quit IRC | 04:03 | |
| *** links has joined #tripleo | 04:11 | |
| *** numans has joined #tripleo | 04:13 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/tripleo-quickstart: [WIP] undercloud reboot https://review.openstack.org/350489 | 04:25 |
| *** yamahata has joined #tripleo | 04:28 | |
| *** bana_k has joined #tripleo | 04:33 | |
| *** bana_k has quit IRC | 04:45 | |
| *** trozet has quit IRC | 04:45 | |
| *** trozet has joined #tripleo | 04:45 | |
| *** coolsvap_ is now known as coolsvap | 04:51 | |
| *** r-mibu has joined #tripleo | 05:02 | |
| *** aqkhan__ has joined #tripleo | 05:02 | |
| *** skramaja has joined #tripleo | 05:05 | |
| *** aqkhan_ has quit IRC | 05:07 | |
| jtomasek | awayne: hi | 05:07 |
| *** david-lyle_ has joined #tripleo | 05:11 | |
| jtomasek | awayne: it is the intermediate tripleo-api solution which is unfortunately not opensource at the moment :/ It is going to be removed in couple of weeks - replaced by Mistral driven api, which is in progress | 05:11 |
| *** david-lyle has quit IRC | 05:13 | |
| ccamacho | hey coolsvap good morning! Mind to review https://review.openstack.org/#/c/351625/ when having some time? Its a long but trivial change, ordering a little bit things in puppet-tripleo | 05:15 |
| coolsvap | ccamacho: ack will do sometime later | 05:16 |
| openstackgerrit | Saravanan KR proposed openstack/os-net-config: Add support for OVS DPDK Bond https://review.openstack.org/349183 | 05:18 |
| ccamacho | coolsvap thanks dude! | 05:20 |
| *** rcernin has joined #tripleo | 05:21 | |
| *** pgadiya has joined #tripleo | 05:21 | |
| *** jaosorior has joined #tripleo | 05:21 | |
| *** rlandy has quit IRC | 05:23 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Remove KeystoneRegion from controller.yaml https://review.openstack.org/352338 | 05:24 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Move neutron-related options for nova to base profile https://review.openstack.org/352402 | 05:24 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Move nova's kestone::auth parameters to API profile https://review.openstack.org/352333 | 05:24 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Move gnocchi's kestone::auth parameters to API profile https://review.openstack.org/352319 | 05:24 |
| *** jtomasek_ has joined #tripleo | 05:26 | |
| *** jtomasek has quit IRC | 05:26 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/diskimage-builder: DO NOT MERGE - TESTING KEYSTONE ENDPOINTS https://review.openstack.org/352705 | 05:27 |
| *** jtomasek_ is now known as jtomasek | 05:37 | |
| *** trozet has quit IRC | 05:44 | |
| openstackgerrit | sandhya proposed openstack/diskimage-builder: Add support for building images capable of UEFI https://review.openstack.org/287784 | 05:46 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Include heat base profile outside of step https://review.openstack.org/352713 | 05:48 |
| ccamacho | jaosorior! morning! man passing CI https://review.openstack.org/#/c/351625/ and https://review.openstack.org/#/c/352373/ :) | 06:02 |
| jaosorior | ccamacho: Hey dude, I'll check em out | 06:06 |
| jaosorior | how's it gonig? | 06:07 |
| jaosorior | *going | 06:07 |
| *** rbrady has quit IRC | 06:07 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud: Remove deprecated neutron auth options https://review.openstack.org/352724 | 06:08 |
| ccamacho | thanks, but when having time :) Fine man :) investing all day finding things to fix, improve and also add, also Ill like to make a deep dive session so im digging into a few few things that might be interesting, and you? How its the cold up there? | 06:08 |
| ccamacho | jaosorior ^ | 06:08 |
| jaosorior | ccamacho haha, not really cold | 06:09 |
| *** jprovazn has joined #tripleo | 06:10 | |
| ccamacho | Im at 30 degrees all day all night... ;( | 06:10 |
| ccamacho | insane | 06:10 |
| jaosorior | somewhere between 17 degrees or something. So not cold but not hot either. Pretty nice if you ask me :P | 06:10 |
| jaosorior | shit | 06:10 |
| *** ebalduf has quit IRC | 06:12 | |
| ccamacho | lucky you | 06:12 |
| *** ccamacho_ has joined #tripleo | 06:17 | |
| *** ccamacho_ has quit IRC | 06:18 | |
| *** ccamacho_ has joined #tripleo | 06:19 | |
| *** akuznetsov has joined #tripleo | 06:20 | |
| openstackgerrit | sandhya proposed openstack/diskimage-builder: Add support for building images capable of UEFI https://review.openstack.org/287784 | 06:22 |
| *** ccamacho_ has quit IRC | 06:23 | |
| jaosorior | easy review moving some hieradata https://review.openstack.org/#/c/352313/4 | 06:24 |
| *** radeks has joined #tripleo | 06:24 | |
| *** ccamacho_ has joined #tripleo | 06:24 | |
| *** ccamacho_ has quit IRC | 06:25 | |
| *** ccamacho_ has joined #tripleo | 06:28 | |
| *** bana_k has joined #tripleo | 06:28 | |
| *** ccamacho_ has quit IRC | 06:31 | |
| *** chlong is now known as chlong|mtg | 06:32 | |
| *** ccamacho_ has joined #tripleo | 06:33 | |
| jaosorior | ccamacho_: I'm getting some mem usage errors lately too | 06:33 |
| jaosorior | I think it's due to the fact that sahara was added to the list of services not too long ago | 06:33 |
| ccamacho_ | jaosorior yeah, we should disable non mandatory services by default | 06:35 |
| jaosorior | ccamacho_: problem is, sahara is meant to be a default | 06:35 |
| ccamacho_ | Mmm :( | 06:36 |
| openstackgerrit | sandhya proposed openstack/diskimage-builder: Add support for building images capable of UEFI https://review.openstack.org/287784 | 06:39 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Set Sahara workers to 1 https://review.openstack.org/352729 | 06:39 |
| jaosorior | ccamacho_: Lets see if this helps ^^ | 06:39 |
| *** pcaruana has joined #tripleo | 06:39 | |
| *** oshvartz has joined #tripleo | 06:43 | |
| *** tesseract- has joined #tripleo | 06:45 | |
| jaosorior | ccamacho_: unfortunately I don't think it'll make much difference | 06:45 |
| jaosorior | as the default in the sahara configuration seems to be one already | 06:45 |
| *** liverpooler has joined #tripleo | 06:45 | |
| ccamacho_ | jaosorio yeah man, anyways I.e. in my case I'll like to be able to deploy a sort of naked overcloud.. | 06:45 |
| jaosorior | seems that there is another option | 06:46 |
| jaosorior | well | 06:46 |
| jaosorior | the same one | 06:46 |
| jaosorior | but giving 0 there | 06:46 |
| jaosorior | seems to run all sahara in one thread | 06:46 |
| jaosorior | maybe that helps | 06:46 |
| jaosorior | it'll be hella slow | 06:46 |
| ccamacho_ | And enable other services or all on demand | 06:46 |
| jaosorior | but lets see | 06:46 |
| *** ccamacho_ has quit IRC | 06:50 | |
| *** coolsvap is now known as coolsvap_ | 06:51 | |
| *** ccamacho_ has joined #tripleo | 06:51 | |
| *** ccamacho_ has quit IRC | 06:52 | |
| *** ccamacho_ has joined #tripleo | 06:55 | |
| *** ccamacho_ has quit IRC | 06:57 | |
| *** ccamacho_ has joined #tripleo | 06:59 | |
| *** ccamacho_ has quit IRC | 07:00 | |
| *** ccamacho_ has joined #tripleo | 07:01 | |
| *** mcornea has joined #tripleo | 07:02 | |
| *** ccamacho_ has quit IRC | 07:04 | |
| *** ccamacho_ has joined #tripleo | 07:04 | |
| jaosorior | marios: Hey dude, if you have time can you check this out? https://review.openstack.org/#/c/352312/5 one of the commits needed to finally get keystone endpoints in puppet :D | 07:05 |
| d0ugal | Morning | 07:05 |
| jaosorior | d0ugal: Hey dude, how's it going? | 07:05 |
| d0ugal | jaosorior: Good good, just waking up :-D You? | 07:05 |
| jaosorior | d0ugal: having coffee deploying the overcloud :P | 07:06 |
| jaosorior | basic morning | 07:06 |
| jaosorior | d0ugal: Have you had a chance to check out latest mistral? | 07:06 |
| jaosorior | * the latest | 07:06 |
| jaosorior | to see if they fixed it :D | 07:07 |
| *** ebarrera has joined #tripleo | 07:09 | |
| *** ccamacho_ has quit IRC | 07:10 | |
| d0ugal | jaosorior: No, not yet. I am avoiding busting my dev env | 07:10 |
| jaosorior | d0ugal: lol, crap, same here | 07:11 |
| d0ugal | jaosorior: Are the TripleO periodic jobs passing now? | 07:11 |
| d0ugal | That is probably a good sign | 07:11 |
| jaosorior | d0ugal: No clue | 07:12 |
| *** jpena|off is now known as jpena | 07:12 | |
| jaosorior | d0ugal: Well... before celebrating we would need to ask in #rdo if they pinned mistral or not | 07:13 |
| d0ugal | jaosorior: good point | 07:13 |
| jaosorior | asking now | 07:15 |
| jaosorior | d0ugal: They didn't pin it :D | 07:15 |
| d0ugal | jaosorior: I seen, thanks for checking! | 07:16 |
| marios | jaosorior: sure thing | 07:16 |
| *** stendulker has joined #tripleo | 07:19 | |
| *** florianf has joined #tripleo | 07:21 | |
| *** bootsha has joined #tripleo | 07:26 | |
| *** jbadiapa has joined #tripleo | 07:28 | |
| *** abehl has joined #tripleo | 07:28 | |
| *** leanderthal|afk is now known as leanderthal | 07:29 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Only db-sync sahara is included in the bootstrapnode https://review.openstack.org/352746 | 07:29 |
| *** jpich has joined #tripleo | 07:29 | |
| *** tremble has joined #tripleo | 07:31 | |
| *** aufi has joined #tripleo | 07:32 | |
| *** sshnaidm|afk has quit IRC | 07:32 | |
| *** rbrady has joined #tripleo | 07:34 | |
| *** david-lyle has joined #tripleo | 07:44 | |
| *** hewbrocca-afk is now known as hewbrocca | 07:44 | |
| *** david-lyle_ has quit IRC | 07:46 | |
| *** bvandenh has quit IRC | 07:46 | |
| hewbrocca | Morning folks | 07:46 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Only db-sync sahara is included in the bootstrapnode https://review.openstack.org/352746 | 07:48 |
| jaosorior | ccamacho: I think this ^^ will fix the db-sync issues in sahara that randomly happen | 07:48 |
| *** pino|work has quit IRC | 07:48 | |
| jaosorior | for instance, in that mistral patch, it failed because of that | 07:48 |
| *** shardy has joined #tripleo | 07:54 | |
| *** ohamada has joined #tripleo | 07:55 | |
| *** devvesa has joined #tripleo | 07:55 | |
| *** ohamada has quit IRC | 07:55 | |
| *** bana_k has quit IRC | 07:56 | |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Stop using deprecated network range https://review.openstack.org/343443 | 07:56 |
| *** ohamada has joined #tripleo | 07:56 | |
| *** pino|work has joined #tripleo | 07:58 | |
| *** coolsvap_ is now known as coolsvap | 07:58 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart: Persist ironic configuration changes https://review.openstack.org/351683 | 07:58 |
| *** ifarkas_afk is now known as ifarkas | 07:59 | |
| d0ugal | shardy: Hey | 07:59 |
| *** lucas-dinner is now known as lucasagomes | 07:59 | |
| *** yamahata has quit IRC | 08:00 | |
| *** radeks has quit IRC | 08:04 | |
| *** athomas has joined #tripleo | 08:06 | |
| *** dmacpher has quit IRC | 08:06 | |
| *** mcornea is now known as mcornea|afk | 08:07 | |
| *** ramishra_ has quit IRC | 08:07 | |
| d0ugal | shardy: un-ing, gotta go to a drs appt. I'll catch you after. | 08:07 |
| d0ugal | un-ping* | 08:07 |
| *** ramishra has joined #tripleo | 08:08 | |
| *** sshnaidm|afk has joined #tripleo | 08:11 | |
| *** sshnaidm|afk is now known as sshnaidm | 08:11 | |
| *** akuznetsov has quit IRC | 08:13 | |
| jaosorior | Hey guys, can we merge this? https://review.openstack.org/#/c/352312/ :D | 08:17 |
| marios | jaosorior: am looking now man, but why is ovb failing didn'g get to it | 08:18 |
| jaosorior | marios: Where? | 08:18 |
| jaosorior | marios: Ah, it had failed because ever since sahara was enabled by default, we started seeing failures | 08:18 |
| marios | jaosorior: oh i didn't refresh, was red on previous run | 08:18 |
| jaosorior | there's some OOM | 08:18 |
| marios | ack | 08:18 |
| jaosorior | and there's a db-sync issue | 08:18 |
| jaosorior | marios: Actually, in this commit I'm trying to fix the db-sync issue https://review.openstack.org/#/c/352746/ | 08:19 |
| jaosorior | marios: there appears to be race-conditions with sahara's db-sync. Since it's not limited to only run on the bootstrap node (like is the case for nova) | 08:20 |
| *** Goneri has joined #tripleo | 08:20 | |
| jaosorior | marios: For the OOM I submitted this to tripleo-ci https://review.openstack.org/#/c/352729/ but I'm not sure if setting the sahara workers to 1 will help | 08:21 |
| jaosorior | marios: By the way, regarding the neutron password, there is actually a commit that gets rid of it. It's part of a long series haha | 08:22 |
| marios | jaosorior: hehe thanks :) | 08:22 |
| *** chem has quit IRC | 08:22 | |
| jaosorior | marios: Anyway, as part of that series, can you check this one out too? https://review.openstack.org/#/c/352313/4 it's the one next in the chain | 08:23 |
| *** amoralej|off is now known as amoralej | 08:23 | |
| marios | jaosorior: ack, i've a few requests to go through, added to list may be bumped though depending | 08:23 |
| jaosorior | sure | 08:23 |
| jaosorior | marios: thanks dude | 08:24 |
| marios | jaosorior: doing my job like everyone else around here man | 08:24 |
| marios | jaosorior: luckily red hat sends me some money every month to do this stuff :) | 08:25 |
| openstackgerrit | Michele Baldessari proposed openstack/instack-undercloud: WIP galera and rabbit do not need to be accessible over the network https://review.openstack.org/352484 | 08:25 |
| jaosorior | marios: we thanks taxi and bus drivers for taking us to places, and waiters from bringing food. Why not thank a fellow dev? | 08:26 |
| marios | jaosorior: haha yeah i know man i am the same too I am just messing. | 08:27 |
| openstackgerrit | Michele Baldessari proposed openstack/instack-undercloud: WIP galera and rabbit do not need to be accessible over the network https://review.openstack.org/352484 | 08:28 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Move neutron's kestone::auth parameters to server profile https://review.openstack.org/352312 | 08:28 |
| jaosorior | bandini: So mysql and rabbit are listening on 0.0.0.0 ? | 08:28 |
| jaosorior | in the undercloud | 08:28 |
| jaosorior | can we get rid of that? :O | 08:29 |
| bandini_ | jaosorior: no they listen to 192.0.2.1, but I don't think they need to be accessible over that ip | 08:29 |
| *** bandini_ is now known as bandini | 08:30 | |
| jaosorior | bandini_: if we can restrict them to listen in localhost, that would be alright | 08:30 |
| bandini | jaosorior: yeah my same thinking | 08:30 |
| bandini | jaosorior: dciabrin and I will scribble up some notes on general undercloud hardening ideas | 08:31 |
| jaosorior | bandini: actually, that's pretty much what I want for all the services | 08:31 |
| jaosorior | only haproxy should be listening on publicly accessible IPs | 08:31 |
| bandini | jaosorior: ah so only haproxy ? do we have a list of services that do need to listen to anything except localhost? | 08:31 |
| jaosorior | bandini: not that I know of | 08:32 |
| jaosorior | right now, the only ones that are not haproxy terminated that need to be accessible are ironic-inspector and zaqar | 08:32 |
| jaosorior | I'm trying to get them into haproxy though | 08:32 |
| jaosorior | there are two commits out there | 08:32 |
| jaosorior | the only thing I'm missing is zaqar's websocket endpoint | 08:32 |
| jaosorior | once that's done | 08:32 |
| bandini | oh I see, cool | 08:32 |
| jaosorior | then I can make all the services listen on localhost and get haproxy as a default for the undercloud | 08:33 |
| jaosorior | cause right now, haproxy is only deployed if TLS is enabled | 08:33 |
| *** dsariel has joined #tripleo | 08:33 | |
| jaosorior | of course, if you wanna step in and help out, that would be awesome :D | 08:33 |
| bandini | jaosorior: I am definitely interested. Do you have a link to those two reviews for ironic/zaqar? | 08:36 |
| *** milan has quit IRC | 08:37 | |
| jaosorior | bandini: here https://review.openstack.org/#/c/332641/12 | 08:37 |
| jaosorior | bandini: That's for ironic, but you can see the series on the "Related changes" section to the right | 08:37 |
| bandini | ack | 08:37 |
| jaosorior | bandini: it was being blocked due to a mistral issue. But that got merged already. Now we just need to wait for promotion to happen in RDO | 08:38 |
| *** dsariel has quit IRC | 08:38 | |
| ccamacho | bandini when having some free cycles mind to check https://review.openstack.org/#/c/351625/ ? Long but trivial submission BTW jaosorior I think the parameters got scrambled as the puppet lint check is not checking the params order :P | 08:39 |
| ccamacho | morning! | 08:39 |
| Jokke_ | morn ccamacho | 08:39 |
| ccamacho | Jokke_ morning dude! | 08:40 |
| *** myoung is now known as myoung|afk | 08:40 | |
| bandini | ccamacho: will do so! | 08:42 |
| ccamacho | thanks! | 08:42 |
| bandini | does anyone have recommendations for a console review-based tool? I kind of dislike doing it over the web interface | 08:43 |
| jtomasek | shardy: hi, could you please take a look at my comments here if it makes sense or not? https://review.openstack.org/#/c/298682/13 | 08:43 |
| bandini | is gerrty what all the cool kids use these days? | 08:43 |
| jaosorior | bandini: Seems so | 08:44 |
| jaosorior | I tried using it and couldn't get it running nicely | 08:44 |
| openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Fix 'no nodes found' message in introspect manageable nodes workflow https://review.openstack.org/352783 | 08:46 |
| *** milan has joined #tripleo | 08:49 | |
| jaosorior | If someone feels like merging some code https://review.openstack.org/#/c/352313/4 here's a small commit :D | 08:49 |
| *** jaosorior is now known as jaosorior_brb | 08:49 | |
| *** limao__ has quit IRC | 08:49 | |
| openstackgerrit | Lucas Alvares Gomes proposed openstack/instack-undercloud: Revert "Revert "Deploy and Upgrade Ironic to run in mod_wsgi"" https://review.openstack.org/351803 | 08:49 |
| *** limao has joined #tripleo | 08:50 | |
| *** vijaykc4 has joined #tripleo | 08:50 | |
| bandini | jaosorior_brb: https://etherpad.openstack.org/p/undercloud-hardening-ideas | 08:53 |
| *** gfidente has joined #tripleo | 08:57 | |
| openstackgerrit | Merged openstack/tripleo-docs: Upgrade documentation https://review.openstack.org/308985 | 08:57 |
| shardy | jtomasek: Hey, I think we're mixing two different definitions here, the parameters schema (returned by GetParametersAction) and the parameter values (modified by UpdateParametersAction) | 09:00 |
| shardy | jtomasek: I need to think about how we can improve that, but I'm not sure the parameter schema data can ever be from a mistral environment | 09:01 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart: Run dstat on the virthost and the undercloud https://review.openstack.org/349591 | 09:02 |
| jtomasek | shardy: no, I mean, the parameters values set using UpdateParameters are stored in mistral environment. I proposed 2 things in that comment: UpdateParameters makes sure it stores there only the parameters which actually differ from what template processing outputs | 09:04 |
| jtomasek | and 2. that GetParameters makes use of this so it processes the templates + mistral environment and then it checks the mistral environment and identifies which parameters values come from the mistral environment | 09:05 |
| shardy | jtomasek: yup, but GetParameters doesn't return any parameter values, other than the template defaults | 09:06 |
| shardy | it only returns the schema, and nothing related to the mistral environment | 09:06 |
| jtomasek | shardy: yeah, that is the only way to get parameter values though | 09:06 |
| shardy | we could change that, but I'm not sure that we should | 09:06 |
| jtomasek | shardy: mistral environment gets passed as an additional environment to heat-validate | 09:07 |
| shardy | jtomasek: Ah, yeah I guess we can do that | 09:07 |
| jtomasek | shardy: so the parameter schema returns correct value (but as a parameter_default) | 09:07 |
| *** milan has quit IRC | 09:07 | |
| shardy | it's not very clear from that patch that processed_data contains the mistral environment | 09:08 |
| shardy | I'll have to pull this and test, but what you're requesting sounds OK | 09:08 |
| *** electrofelix has joined #tripleo | 09:08 | |
| jtomasek | shardy: and when we receive such parameter schema, we can compare it with what is stored in mistral env. and in action output make it clear with some flag, that a specific environment has been set by user via mistral environment | 09:08 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/tripleo-quickstart: [WIP] undercloud reboot https://review.openstack.org/350489 | 09:08 |
| jtomasek | ups "specific parameter" not "specfic environment" | 09:08 |
| shardy | jtomasek: I guess what I'm not super-keen on is we're combining two different heat interfaces into a single category of action | 09:09 |
| shardy | e.g heat parameters, and heat environments | 09:09 |
| shardy | in heat those are distinct interfaces | 09:09 |
| *** coolsvap is now known as coolsvap_ | 09:09 | |
| shardy | here we combine them in *Parameters actions | 09:09 |
| shardy | I'm wondering how that will work when we need to consider other environment interfaces | 09:09 |
| shardy | e.g not just parameters, but resource_registry overrides, event sinks, hooks, etc | 09:10 |
| jtomasek | shadower: yeah, but it is the only way to determine the parameter values - as environments actually hold the parameter values | 09:10 |
| *** chlong|mtg has quit IRC | 09:10 | |
| jtomasek | shardy: resource registry updates would also get stored in mistral environment. I am considering it as an additional environment which is applied as last one and overrides any previous values defined in other environments | 09:12 |
| ccamacho | hey bandini are you using pycharm? Im using the gerrit pluging for Pycharm and works really well and you have IDE+gerrit in one single window | 09:13 |
| bandini | ccamacho: ah no I don't use pycharm but I can give it a try :) | 09:13 |
| bandini | thanks | 09:13 |
| *** akrivoka has joined #tripleo | 09:16 | |
| *** mgould|afk is now known as mgould | 09:19 | |
| *** abehl has quit IRC | 09:19 | |
| *** abehl has joined #tripleo | 09:20 | |
| *** bvandenh has joined #tripleo | 09:20 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-docs: Fix environment-specific limiting for upgrade docs https://review.openstack.org/352800 | 09:24 |
| jistr | marios: here you go ^ :) | 09:24 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Move cinder's kestone::auth parameters to API profile https://review.openstack.org/352313 | 09:24 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Configure project name for keystone::auth resource in heat https://review.openstack.org/352434 | 09:25 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Move setting of Glance's keystone region to API profile https://review.openstack.org/352314 | 09:25 |
| marios | jistr: ha.. so make this the parent review /me looks at the review | 09:26 |
| marios | jistr: k whatever it is afollow on but thanks jistr | 09:29 |
| *** mcornea|afk is now known as mcornea | 09:29 | |
| jistr | marios: yea i didn't want to block the main one on nits b/c it was quite large and it got finally like 4 + votes :) | 09:30 |
| marios | jistr: sure np just firing up sphinxy to sanity check | 09:31 |
| *** tosky has joined #tripleo | 09:33 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Move nova's kestone::auth parameters to API profile https://review.openstack.org/352333 | 09:35 |
| marios | jistr: lgtm thanks | 09:35 |
| d0ugal | shardy: ping | 09:39 |
| shardy | d0ugal: Hi! | 09:39 |
| d0ugal | shardy: I am getting myself stuck with the CLI work and wanted to talk it through with you | 09:40 |
| d0ugal | shardy: From what I can tell, the files need to be processed locally - to find relative files in environments etc. | 09:40 |
| d0ugal | shardy: but the result of processed files is then quite different from the original, so uploading that to swift seems wrong | 09:40 |
| d0ugal | shardy: An example that wont work: uploading environments with absolute paths (which we document btw) will break when in swift. | 09:41 |
| *** jaosorior_brb is now known as jaosorior | 09:42 | |
| jaosorior | shardy: Thanks for the reviews dude | 09:42 |
| shardy | d0ugal: Yeah, I think we'll need to strip the path prefix so that everything is relative to the root of the swift container | 09:43 |
| d0ugal | shardy: so re-writing the environments is better than using heatclient to merge? | 09:43 |
| d0ugal | I felt a bit stumped as I didn't like either option | 09:44 |
| shardy | d0ugal: Yeah, ideally we want to avoid any client side merging, as we need to use server side merging to do e.g https://review.openstack.org/#/c/330414/ | 09:44 |
| jtomasek | +1 | 09:44 |
| d0ugal | shardy: Okay, cool - I guess I also then need to walk the envs to find all the referenced files and upload them. | 09:45 |
| openstackgerrit | Merged openstack/python-tripleoclient: Make validation errors fatal by default https://review.openstack.org/349609 | 09:45 |
| *** numans has quit IRC | 09:46 | |
| d0ugal | shardy: I couldn't see any code in heatclient that would do that for me easily without doing the full merge. Do you know if that can be done or should I just write it? | 09:46 |
| *** limao has quit IRC | 09:46 | |
| shardy | d0ugal: heatclient should already do it, sec | 09:46 |
| shardy | d0ugal: basically you need the keys from the "files" map we pass to heat: | 09:47 |
| *** chlong|mtg has joined #tripleo | 09:47 | |
| shardy | https://github.com/openstack/python-heatclient/blob/master/heatclient/v1/shell.py#L125 | 09:47 |
| shardy | d0ugal: and the values are what you need to upload to swift (unless they're already in the plan) | 09:47 |
| shardy | We also need to store "environment_files" which is a list of keys | 09:48 |
| shardy | that exist in the files map | 09:48 |
| shardy | https://github.com/openstack/python-heatclient/blob/master/heatclient/v1/shell.py#L131 | 09:48 |
| shardy | I assume that will end up in the mistral environment | 09:48 |
| d0ugal | shardy: okay, cool. I think I can work with that. | 09:48 |
| d0ugal | and then I need to make sure the UI can get those environments too | 09:49 |
| jtomasek | shardy, d0ugal: Do I understand it right, that certain environments in tht point to the templates that are outside the actual tht path? | 09:49 |
| d0ugal | I thought this bit would be easy :) | 09:49 |
| d0ugal | jtomasek: They can do, yes. | 09:49 |
| shardy | d0ugal: FWIW I'd probably work backwards from that hc.stacks.create, dump the **fields and see where each kwarg comes from in the mistral flow | 09:49 |
| shardy | end result should be the exact same request to heat | 09:50 |
| d0ugal | jtomasek: Well, not templates in t-h-t, but envs that the user adds can | 09:50 |
| *** paramite has joined #tripleo | 09:50 | |
| shardy | jtomasek: Yes, someone can do -e my_custom_env.yaml and it can reference any file | 09:50 |
| shardy | or even a URL | 09:50 |
| jtomasek | d0ugal: that is going to break the functionality then. lets say there is a tht tarball, that user uses to create plan (uploads to swift). if that tarbal includes such environments, then the plan is broken and the templates processing will fail | 09:50 |
| jtomasek | d0ugal: ah, ok | 09:50 |
| jaosorior | shardy, marios: By the way, I proposed a commit to tripleo-quickstart changing the default network range to 172.29.172.0/24 https://review.openstack.org/#/c/343443 | 09:50 |
| d0ugal | jtomasek: http://docs.openstack.org/developer/tripleo-docs/advanced_deployment/network_isolation.html?highlight=environment#create-network-environment-file | 09:50 |
| d0ugal | jtomasek: ^ That is an example of where we document doing that | 09:51 |
| jtomasek | d0ugal: ok, makes sense, thanks | 09:51 |
| d0ugal | jtomasek: so I just need to re-write the paths - simples ;) | 09:51 |
| shardy | jtomasek: This is the way heat environments have always worked - basically we just need to translate the files map into the swift container, and I think all should be OK | 09:51 |
| jtomasek | d0ugal: such case will probably not be possible to support with GUI | 09:51 |
| jaosorior | shardy, marios: It's not enforced in any way in tripleo, but I thought quickstart would be a good starting place to have a discussion about a new default. | 09:51 |
| marios | jaosorior: thanks adding to reviews for tomorrow | 09:52 |
| d0ugal | jtomasek: After the CLI re-writes the paths and uploads it to swift it should be fine for you | 09:52 |
| jtomasek | d0ugal: yeah | 09:52 |
| d0ugal | jtomasek: but yeah, if they are uploading a tar to the UI they need to make sure all the files are included - that I think should be expected by the user | 09:52 |
| shardy | d0ugal: Yup, I think all that's needed is an absolute to relative path conversion on the files map key, and upload all-the-things to swift | 09:52 |
| d0ugal | Alright, I'll see how I get on. | 09:53 |
| d0ugal | shardy, jtomasek - thanks! | 09:53 |
| jtomasek | d0ugal: I meant the case when user wants to update plan from GUI (add additional environment) -> such environment must point to templates that are in plan (or get uploaded together with that environment) | 09:53 |
| jtomasek | yep, thanks | 09:53 |
| shardy | jtomasek: Yeah, I think any time a user-provided environment is specified, we will have to handle passing additional files into the plan | 09:53 |
| shardy | maybe we'll need a user_files and user_environments subdirectory in the plan container or something | 09:54 |
| shardy | jaosorior: sure, sounds good, although we have to keep in mind that there are still a lot of non-quickstart users | 09:55 |
| jtomasek | shardy: I see it as a general updatePlan action, those user-provided ones can live normally next to the other templates/environments | 09:55 |
| d0ugal | jtomasek: Right, adding environments in the UI could be complicated. I guess you will need to check all the paths resolve to something. | 09:55 |
| jtomasek | shardy: template/environment metadata can be used to identify those if user wants | 09:55 |
| shardy | jtomasek: Yeah, we just need to be careful about path collisions, hence my suggestion re a subdir | 09:56 |
| shardy | e.g if I do | 09:56 |
| *** devvesa has quit IRC | 09:56 | |
| shardy | mkdir puppet && vim puppet/controller.yaml | 09:57 |
| d0ugal | shardy: Even with a subdir we could have collisions, so we might need to do unique names somehow. | 09:57 |
| jtomasek | d0ugal: that could get solved by a sane error message on templates processing action | 09:57 |
| d0ugal | jtomasek: Yup, that would be good. | 09:57 |
| shardy | then add puppet/controller.yaml to a user environment, we don't want it to overwrite the original controller.yaml in the plan | 09:57 |
| jtomasek | d0ugal: as that is the place where such potential problem gets uncovered | 09:57 |
| jaosorior | shardy: yeah, for sure, but that's mostly meant to have a discussion about the defaults. And at least have somewhere that uses that default. Afterwards we can start pushing the rest of tripleo (mostly the undercloud and our CI) to use that | 09:57 |
| d0ugal | jtomasek: True, without downloading the full plan you can't tell. makes sense. | 09:57 |
| shardy | d0ugal: true, but just using a subdir which we know doesn't exist in t-h-t would be a good starting point | 09:58 |
| d0ugal | shardy: +1 | 09:58 |
| d0ugal | I'll get that working then worry about the next bit | 09:58 |
| shardy | ++, sounds good, thanks! | 09:58 |
| jtomasek | shardy: considering a generic UpdatePlan action, I'd expect that action to fail if file with such path (key) is already presen in the plan, and notify user about it | 09:59 |
| *** dtantsur|sick is now known as dtantsur | 10:00 | |
| d0ugal | jtomasek: We might need to update the file in some cases | 10:00 |
| d0ugal | i.e. running this twice: openstack overcloud deploy --templates -e myenv.yaml | 10:00 |
| jtomasek | d0ugal: hmm, right | 10:01 |
| *** Nakato has quit IRC | 10:05 | |
| *** Nakato has joined #tripleo | 10:06 | |
| *** radeks has joined #tripleo | 10:07 | |
| *** athomas has quit IRC | 10:11 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP - Implement overcloud upgrade job - Mitaka -> Newton https://review.openstack.org/323750 | 10:14 |
| *** pblaho has quit IRC | 10:15 | |
| *** jcoufal has joined #tripleo | 10:15 | |
| *** athomas has joined #tripleo | 10:18 | |
| *** jeckersb is now known as jeckersb_gone | 10:32 | |
| Jokke_ | EmilienM: around? | 10:32 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates: DO NOT MERGE: testing ironic https://review.openstack.org/329872 | 10:39 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates: Add composable service for configuring Nova compute with Ironic https://review.openstack.org/341433 | 10:39 |
| *** sshnaidm is now known as sshnaidm|lnch | 10:39 | |
| *** jcoufal has quit IRC | 10:44 | |
| *** Ryjedo_ has joined #tripleo | 10:48 | |
| *** Ryjedo has quit IRC | 10:49 | |
| *** Ryjedo_ is now known as Ryjedo | 10:49 | |
| jaosorior | Jokke_: too early. give him a couple more hours | 10:50 |
| jaosorior | He's in quebec I think | 10:51 |
| *** lucasagomes has quit IRC | 10:51 | |
| jaosorior | Jokke_: How's it going? Visited Finland yet? | 10:51 |
| openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Add puppet-lint for checking parameters order in puppet-tripleo manifests https://review.openstack.org/352847 | 10:52 |
| *** vijaykc4 has quit IRC | 10:53 | |
| *** assassin is now known as ubijtsa | 10:54 | |
| *** florianf has quit IRC | 10:54 | |
| *** ubijtsa is now known as assassin | 10:54 | |
| *** vijaykc4 has joined #tripleo | 10:55 | |
| *** apetrich has joined #tripleo | 10:57 | |
| *** akrivoka has quit IRC | 10:57 | |
| *** akrivoka has joined #tripleo | 11:01 | |
| jaosorior | I'm seeing several post_failures in CI | 11:05 |
| jaosorior | anybody has an idea of what's going on? | 11:05 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates: Availability monitoring agents support https://review.openstack.org/254788 | 11:07 |
| openstackgerrit | Julie Pichon proposed openstack/tripleo-specs: Add 'bug tagging' policy https://review.openstack.org/352852 | 11:08 |
| *** r-mibu has quit IRC | 11:11 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Fix parameters and headers inconsistency in the puppet manifests. https://review.openstack.org/351625 | 11:12 |
| gfidente | jaosorior, on https://review.openstack.org/#/c/352746/2/manifests/profile/base/sahara.pp | 11:12 |
| gfidente | I think if we don't add the or condition | 11:12 |
| gfidente | then sync_db might be running without proper sahar.conf ? | 11:13 |
| gfidente | unless it includes ::sahara? | 11:13 |
| jaosorior | gfidente: can you explain? | 11:13 |
| *** stendulker has quit IRC | 11:16 | |
| *** akuznetsov has joined #tripleo | 11:16 | |
| *** devvesa has joined #tripleo | 11:19 | |
| *** r-mibu has joined #tripleo | 11:19 | |
| *** lucasagomes has joined #tripleo | 11:22 | |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Fix use of bootstrap_node in cinder base profile https://review.openstack.org/352365 | 11:23 |
| *** sshnaidm|lnch is now known as sshnaidm | 11:25 | |
| *** jaosorior has quit IRC | 11:27 | |
| *** jaosorior has joined #tripleo | 11:28 | |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Fix use of bootstrap_node in cinder base profile https://review.openstack.org/352365 | 11:30 |
| *** apetrich_ has joined #tripleo | 11:32 | |
| *** vijaykc4 has quit IRC | 11:32 | |
| *** vijaykc4 has joined #tripleo | 11:32 | |
| *** lucasagomes has quit IRC | 11:34 | |
| *** apetrich_ has quit IRC | 11:34 | |
| *** apetrich has quit IRC | 11:35 | |
| openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Add support for cinder::volume::rbd hiera parameters https://review.openstack.org/335137 | 11:35 |
| *** lucasagomes has joined #tripleo | 11:35 | |
| *** dsariel has joined #tripleo | 11:36 | |
| paramite | Hi guys, is there a way how to actually find out what is wrong with role_data, when I get: [overcloud]: CREATE_FAILED Resource CREATE failed: The Referenced Attribute (ControllerServiceChain role_data) is incorrect. | 11:37 |
| *** social has quit IRC | 11:37 | |
| *** devvesa has quit IRC | 11:37 | |
| *** devvesa has joined #tripleo | 11:38 | |
| *** jeckersb_gone is now known as jeckersb | 11:39 | |
| *** lucasagomes has quit IRC | 11:39 | |
| *** coolsvap_ is now known as coolsvap | 11:39 | |
| *** lucasagomes has joined #tripleo | 11:41 | |
| gfidente | paramite, what is the submission? | 11:41 |
| gfidente | probably you're operating on a parameter which isn't defined for the service template | 11:41 |
| paramite | gfidente, https://review.openstack.org/#/c/254788/28 | 11:41 |
| paramite | gfidente, so this is causing it: https://review.openstack.org/#/c/254788/28/puppet/services/services.yaml ? | 11:42 |
| *** dprince has joined #tripleo | 11:43 | |
| shadower | can I have a review for https://review.openstack.org/#/c/352278/ ? It's short and it'll make the subsequent validation patches simpler + keep the docs up to date | 11:43 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: remove overcloud roles from oooq https://review.openstack.org/351259 | 11:43 |
| sshnaidm | pabelanger, hi | 11:44 |
| *** lucasagomes is now known as lucas-hungry | 11:44 | |
| sshnaidm | pabelanger, for running experimental jobs on tripleo-heat-templates project, should I add here "- name: experimental-tripleo-jobs" in https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L14139 ? | 11:46 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Configure keystone endpoints in service profiles https://review.openstack.org/352364 | 11:47 |
| *** julim has joined #tripleo | 11:47 | |
| *** milan has joined #tripleo | 11:48 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: add debug to undercloud post https://review.openstack.org/345559 | 11:49 |
| *** larsks has quit IRC | 11:51 | |
| *** dprince has quit IRC | 11:56 | |
| *** larsks has joined #tripleo | 11:56 | |
| *** dprince has joined #tripleo | 11:56 | |
| *** sshnaidm is now known as sshnaidm|afk | 11:56 | |
| *** weshay has joined #tripleo | 11:57 | |
| *** fultonj has joined #tripleo | 11:57 | |
| openstackgerrit | Merged openstack/tripleo-ui: Add npm version to webpack output https://review.openstack.org/348976 | 11:57 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Configure keystone endpoints in service profiles https://review.openstack.org/352364 | 11:57 |
| jaosorior | shardy: Is there a way to debug what comes out of the specific service chain templates? | 11:58 |
| jaosorior | shardy: In this commit the role_data output comes out as null https://review.openstack.org/#/c/352319/8 | 11:59 |
| jaosorior | and I don't understand why :/ | 11:59 |
| *** jayg|g0n3 is now known as jayg | 12:00 | |
| *** pkovar has joined #tripleo | 12:01 | |
| *** akuznetsov has quit IRC | 12:01 | |
| *** ohamada_ has joined #tripleo | 12:02 | |
| *** ohamada has quit IRC | 12:02 | |
| *** numans has joined #tripleo | 12:02 | |
| *** jpena is now known as jpena|lunch | 12:02 | |
| *** devvesa has quit IRC | 12:03 | |
| *** rhallisey has joined #tripleo | 12:04 | |
| *** vijaykc4 has quit IRC | 12:04 | |
| *** jeckersb is now known as jeckersb_gone | 12:05 | |
| *** jcoufal has joined #tripleo | 12:06 | |
| shardy | jaosorior: Yes, look at the heat stack-show output for the nested stack with the null output | 12:07 |
| shardy | jaosorior: I raised a heat bug about it, we should surface the error at validation time | 12:08 |
| shardy | jaosorior: another option is to create a stack only containing the service template | 12:08 |
| *** ioggstream has joined #tripleo | 12:09 | |
| jaosorior | shardy: is it possible to do a heat resource-show for the specific element in the chain? | 12:11 |
| shardy | jaosorior: Yes, you just need the ID of the stack, sec | 12:11 |
| *** yolanda_ has joined #tripleo | 12:11 | |
| *** amoralej is now known as amoralej|lunch | 12:12 | |
| shardy | jaosorior: http://paste.openstack.org/show/552433/ | 12:13 |
| *** jeckersb_gone is now known as jeckersb | 12:14 | |
| shardy | jaosorior: if you know the failing service you can just do heat resource-list -n5 overcloud | grep "OS::TripleO::Services::GlanceRegistry" | 12:14 |
| openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: WIP - Add puppet-lint for checking parameters order in puppet-tripleo manifests https://review.openstack.org/352847 | 12:15 |
| *** yolanda_ has quit IRC | 12:15 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-quickstart: fix teardown (tagging and ansible_user) https://review.openstack.org/352112 | 12:15 |
| jaosorior | shardy: Excellent | 12:15 |
| jaosorior | thanks | 12:15 |
| jaosorior | wow | 12:16 |
| jaosorior | shardy: Right, so for a very strange reason the gnocchi API is giving a null role_data | 12:16 |
| jaosorior | it's specifically that one | 12:16 |
| shardy | jaosorior: on t-h-t master, or an under review patch? | 12:16 |
| jaosorior | under review | 12:16 |
| jaosorior | shardy: So when it was initially proposed, it had this same issue. But it was worked around...somehow | 12:17 |
| shardy | jaosorior: whats the link pls? | 12:17 |
| jaosorior | shardy: https://review.openstack.org/#/c/352319/8 | 12:17 |
| *** ccamacho is now known as ccamacho|lunch | 12:20 | |
| *** pradk has joined #tripleo | 12:20 | |
| *** jcoufal has quit IRC | 12:22 | |
| *** jcoufal has joined #tripleo | 12:22 | |
| *** akshai has joined #tripleo | 12:22 | |
| openstackgerrit | Merged openstack/tripleo-quickstart: Add dlrn-gate-testing job type for roles-deploy.sh https://review.openstack.org/351759 | 12:23 |
| *** lucas-hungry is now known as lucasagomes | 12:24 | |
| EmilienM | hello | 12:25 |
| *** jdob has joined #tripleo | 12:26 | |
| *** thrash|g0ne is now known as thrash | 12:26 | |
| slagle | morning | 12:27 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Include heat base profile outside of step https://review.openstack.org/352713 | 12:28 |
| *** rlandy has joined #tripleo | 12:28 | |
| openstackgerrit | Merged openstack/tripleo-quickstart: Improve readability of the overcloud failure output https://review.openstack.org/351155 | 12:29 |
| *** yolanda has quit IRC | 12:29 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Move neutron-related options for nova to base profile https://review.openstack.org/352402 | 12:30 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-docs: Fix environment-specific limiting for upgrade docs https://review.openstack.org/352800 | 12:31 |
| *** ohamada_ has quit IRC | 12:31 | |
| *** ohamada_ has joined #tripleo | 12:31 | |
| *** ayoung has quit IRC | 12:33 | |
| pabelanger | sshnaidm|afk: yes | 12:33 |
| *** sshnaidm|afk is now known as sshnaidm | 12:33 | |
| EmilienM | can someone approve https://review.openstack.org/#/c/352724/ please? | 12:34 |
| EmilienM | before puppet-neutron breaks tripleo | 12:34 |
| jaosorior | EmilienM: Good thing that breaking CR depends on that change | 12:34 |
| sshnaidm | pabelanger, then I'll go wild: https://review.openstack.org/352880 | 12:35 |
| jaosorior | but yeah, it should be approved soon | 12:35 |
| EmilienM | yeah | 12:35 |
| EmilienM | jaosorior: the last one is https://review.openstack.org/#/c/352407/ | 12:35 |
| *** maeca1 has joined #tripleo | 12:35 | |
| *** sshnaidm has quit IRC | 12:35 | |
| *** florianf has joined #tripleo | 12:35 | |
| shardy | jaosorior: I think I spotted the issue, see comment on https://review.openstack.org/#/c/352319/8 | 12:35 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add cinder-backup service as role https://review.openstack.org/304563 | 12:36 |
| jaosorior | shardy: Awesome! | 12:36 |
| jaosorior | shardy: Will try to deploy with the changes you pointed out, lets see how it goes | 12:36 |
| shardy | jaosorior: I think just not removing the GnocchiPassword parameter should fix it | 12:36 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart: Run dstat on the virthost and the undercloud https://review.openstack.org/349591 | 12:36 |
| *** egafford has joined #tripleo | 12:37 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: [WIP] remove ci-scripts from the oooq repo https://review.openstack.org/351324 | 12:37 |
| jistr | marios: FYI after 2nd round of downstream issues in compute vs. novacompute i think we may want to consider again merging https://review.openstack.org/#/c/305705 | 12:37 |
| jistr | marios: +2'd and rechecked | 12:38 |
| jistr | after we started supporting upgrades upstream i think this one might be better than the other one | 12:39 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Remove static hieradata https://review.openstack.org/351741 | 12:39 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-quickstart: fix teardown (tagging and ansible_user) https://review.openstack.org/352112 | 12:40 |
| shardy | jistr: FWIW I've been thinking that long term this, and other similar workarounds for backwards compatibility, would be better handled via a mistral workflow that can adjust the stack parameters by looking at the already deployed stack | 12:40 |
| shardy | at least then we'd be able to maintain the list of hacks in one place | 12:41 |
| marios | jistr: ok ... and then we point to it where applicable in docs i guess (if starting at ... include ... in the upgrade init setting it once should do it) | 12:41 |
| shardy | vs an ever increasing variety of special environment files | 12:41 |
| jistr | shardy: yea that would be cool | 12:41 |
| openstackgerrit | Merged openstack/instack-undercloud: Remove deprecated neutron auth options https://review.openstack.org/352724 | 12:41 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/tripleo-quickstart: [WIP] undercloud reboot https://review.openstack.org/350489 | 12:41 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Remove KeystoneRegion from controller.yaml https://review.openstack.org/352338 | 12:42 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Move gnocchi's kestone::auth parameters to API profile https://review.openstack.org/352319 | 12:42 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Remove outdated Neutron auth options https://review.openstack.org/352407 | 12:43 |
| jistr | marios: yea. Was thinking it would be nice if Newton in particular would have synced names on fresh deploys already, so that we don't have to carry the desync forward for much longer. | 12:44 |
| jaosorior | shardy: Seems that the issue is still there :/ | 12:44 |
| openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Use modern auth options for Neutron https://review.openstack.org/352518 | 12:44 |
| shardy | jaosorior: You've got the same issue with KeystoneRegion | 12:47 |
| shardy | local testing with either stack-show or output-show would tell you that | 12:48 |
| shardy | https://bugs.launchpad.net/heat/+bug/1599114 | 12:49 |
| openstack | Launchpad bug 1599114 in heat "Outputs aren't correctly validated" [Medium,In progress] - Assigned to Oleksii Chuprykov (ochuprykov) | 12:49 |
| shardy | that's the heat bug btw, which will make these errors easier to debug | 12:49 |
| shardy | well, the fix for it will | 12:50 |
| *** tzumainn has joined #tripleo | 12:50 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart: fix link in the readme file https://review.openstack.org/351787 | 12:51 |
| *** jrist has quit IRC | 12:52 | |
| *** numan_ has joined #tripleo | 12:54 | |
| *** fultonj has quit IRC | 12:55 | |
| *** numans has quit IRC | 12:55 | |
| *** morazi has joined #tripleo | 12:56 | |
| *** fultonj has joined #tripleo | 12:56 | |
| *** yolanda has joined #tripleo | 12:57 | |
| EmilienM | do we have plans to disable sahara by default? | 12:57 |
| EmilienM | it's failing quite often in our CI | 12:58 |
| EmilienM | Error: /Stage[main]/Sahara::Db::Sync/Exec[sahara-dbmanage]: Failed to call refresh: sahara-db-manage --config-file /etc/sahara/sahara.conf upgrade head returned 255 instead of one of [0]\u001b[0m\n\u001b[1;31mError: /Stage[main]/Sahara::Db::Sync/Exec[sahara-dbmanage]: sahara-db-manage --config-file /etc/sahara/sahara.conf upgrade head returned 255 instead of one of [0] | 12:58 |
| slagle | EmilienM: let's just do it | 12:58 |
| EmilienM | http://logs.openstack.org/37/351937/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/42be55f/logs/postci.txt.gz#_2016-08-09_12_43_38_000 | 12:58 |
| EmilienM | slagle: ok, I'm doing it | 12:58 |
| EmilienM | slagle: have you seen it also? | 12:58 |
| *** sshnaidm has joined #tripleo | 12:58 | |
| slagle | not specifically | 12:58 |
| *** coolsvap is now known as _coolsvap_ | 12:58 | |
| *** jpena|lunch is now known as jpena | 12:58 | |
| slagle | but our run times are horrible | 12:58 |
| EmilienM | yeah | 12:59 |
| slagle | we keep making everything slower | 12:59 |
| slagle | so +1 on disabling things we don't need | 12:59 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-docs: Only show stable repositories in upgrade guide https://review.openstack.org/352883 | 13:00 |
| EmilienM | slagle: can you approve https://review.openstack.org/#/c/349408/ then? | 13:00 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Create per-role node_names in hieradata for all nodes https://review.openstack.org/348973 | 13:00 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: WIP Create composable mapping between enabled services and role ips https://review.openstack.org/348974 | 13:00 |
| *** rook_ is now known as rook | 13:01 | |
| slagle | EmilienM: done | 13:01 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Move AllNodesValidationDeployments into jinja template loop https://review.openstack.org/337587 | 13:01 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Convert overcloud.yaml to support jinja2 templating https://review.openstack.org/315679 | 13:02 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Remove Compute role parameters from overcloud.yaml https://review.openstack.org/347926 | 13:02 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Move AllNodesDeployments into jinja template loop https://review.openstack.org/337267 | 13:02 |
| *** jeckersb is now known as jeckersb_gone | 13:03 | |
| *** myoung|afk is now known as myoung | 13:04 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Disable sahara services by default https://review.openstack.org/352886 | 13:05 |
| EmilienM | slagle: thanks. And last one ^ | 13:05 |
| *** jrist has joined #tripleo | 13:05 | |
| *** jrist has joined #tripleo | 13:05 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Disable mistral services by default. https://review.openstack.org/349408 | 13:05 |
| *** links has quit IRC | 13:06 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Convert EndpointMap to not require per-service VIP parameters https://review.openstack.org/342900 | 13:06 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Allow map_replace substitution of network names https://review.openstack.org/345510 | 13:06 |
| *** jeckersb_gone is now known as jeckersb | 13:07 | |
| rcernin | shardy: slagle: If we restart the heat-engine service it kills the parent stack, but doesn't clear any IN_PROGRESS which are nested. Could that cause problems with deployment or is it fine to just re-run the deployment, even if the tasks are still stuck in the IN_PROGRESS state? | 13:07 |
| *** trozet has joined #tripleo | 13:07 | |
| shardy | rcernin: No, all stacks including nested stacks should be either COMPLETE or FAILED, or the update won't work | 13:08 |
| shardy | sounds like you have an old heat as I believe we fixed several issues around this | 13:09 |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-validations: Validation to check the undercloud processes https://review.openstack.org/351248 | 13:09 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-docs: Only show stable repositories in upgrade guide https://review.openstack.org/352883 | 13:10 |
| shardy | rcernin: Note it's important to distinguish between nested stacks that are IN_PROGRESS from deployments (e.g from heat deployment-list) | 13:10 |
| shardy | having IN_PROGRESS deployments is OK and a known issue - they will be replaced provided the owning resource is FAILED | 13:10 |
| rcernin | shardy: heat-templates and engine is 5.0.1-5 | 13:11 |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-validations: Port the network environment validation https://review.openstack.org/341586 | 13:11 |
| *** oshvartz has quit IRC | 13:12 | |
| *** bfournie has quit IRC | 13:13 | |
| *** bootsha has quit IRC | 13:14 | |
| rcernin | shardy: The issue is that parent is FAILED but no new tasks are able to be created against that node with tasks that are stuck in IN_PROGRESS. | 13:14 |
| *** julim has quit IRC | 13:14 | |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-validations: Validation to detect if undercloud disks use 512e https://review.openstack.org/322179 | 13:14 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates: DO NOT MERGE: testing ironic https://review.openstack.org/329872 | 13:15 |
| shardy | rcernin: When you say tasks, do you mean deployments or resources? | 13:15 |
| shardy | e.g is heat giving you an error, or is the node stuck because it's still processing the old deployment? | 13:16 |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-validations: Add network gateway validation https://review.openstack.org/329385 | 13:18 |
| rcernin | shardy: the deployment-list shows these IN_PROGRESS deployments. | 13:19 |
| *** jpeeler has joined #tripleo | 13:19 | |
| shardy | rcernin: right, and that is OK unless the node is wedged on one of them which never completes | 13:20 |
| *** lblanchard has joined #tripleo | 13:21 | |
| shardy | Simple stable backport ready for review/approve if anyone has a moment: https://review.openstack.org/#/c/345650/ | 13:25 |
| *** amoralej|lunch is now known as amoralej | 13:25 | |
| jaosorior | shardy: So I'm doing local testing, which is why I mentioned that it didn't work. But debugging this stuff is really not trivial | 13:26 |
| jaosorior | because the output it not something that's relevant to the issue | 13:26 |
| *** ayoung has joined #tripleo | 13:26 | |
| shardy | http://paste.openstack.org/show/552439/ | 13:26 |
| jaosorior | EmilienM: wasn't sahara supposed to be included by default? | 13:26 |
| EmilienM | jaosorior: it's currently failing very often in CI | 13:27 |
| jaosorior | shardy: I see | 13:27 |
| shardy | jaosorior: I agree we can improve it, which is why I raised that heat bug, but the output-show error is very clear | 13:27 |
| jaosorior | only thing I got out was | 13:27 |
| jaosorior | 2016-08-09 12:48:01 [overcloud]: CREATE_FAILED Resource CREATE failed: The Referenced Attribute (ControllerServiceChain role_data) is incorrect. | 13:27 |
| EmilienM | maybe we could disable it now and investigate why it fails afterwards | 13:27 |
| shardy | jaosorior: Yeah, until that heat bug is fixed you have to dig in to the nested stacks to figure out which one broke role_data | 13:27 |
| jaosorior | EmilienM: Actually this is my attempt to fix it https://review.openstack.org/#/c/352746/ | 13:27 |
| *** Goneri has quit IRC | 13:28 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Remove KeystoneRegion from controller.yaml https://review.openstack.org/352338 | 13:29 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Move gnocchi's kestone::auth parameters to API profile https://review.openstack.org/352319 | 13:29 |
| EmilienM | jaosorior: nice | 13:30 |
| EmilienM | jaosorior: I +2 | 13:30 |
| EmilienM | gfidente: can you look it again maybe? | 13:31 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Convert EndpointMap to not require per-service VIP parameters https://review.openstack.org/342900 | 13:33 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Allow map_replace substitution of network names https://review.openstack.org/345510 | 13:33 |
| *** Goneri has joined #tripleo | 13:33 | |
| gfidente | bnemec, was working on a doc update to add the ceph repos | 13:33 |
| gfidente | not sure how familiar are you with those docs or if you stick to tripleo.sh as I do | 13:34 |
| gfidente | but I don't see where we give the list of .repo files to be included in the image for the image building | 13:34 |
| gfidente | bnemec, any clue where OVERCLOUD_IMAGES_DIB_YUM_REPO_CONF is set in tripleo-docs? or if not, why? | 13:35 |
| *** rodrigods has quit IRC | 13:35 | |
| *** rodrigods has joined #tripleo | 13:35 | |
| jaosorior | ayoung: Hey man, saw your tweet about having fixed SAML federation behind HAProxy. What did you do? | 13:36 |
| *** ccamacho|lunch is now known as ccamacho | 13:37 | |
| *** cdearborn has joined #tripleo | 13:39 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Remove NeutronPassword parameter from puppet/controller.yaml https://review.openstack.org/352907 | 13:40 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Only db-sync sahara is included in the bootstrapnode https://review.openstack.org/352746 | 13:42 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-docs: Document Ceph repositories to be enabled https://review.openstack.org/352910 | 13:44 |
| *** ramishra has quit IRC | 13:45 | |
| *** bfournie has joined #tripleo | 13:45 | |
| *** bootsha has joined #tripleo | 13:46 | |
| ayoung | jaosorior, Majik | 13:46 |
| ayoung | jaosorior, Blackest of majik. | 13:46 |
| jaosorior | I see | 13:46 |
| ayoung | jaosorior, na, it was actually a few things we needed to sort | 13:47 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: upgrades job is renamed to updates https://review.openstack.org/351937 | 13:47 |
| ayoung | we needed to get Keystone's public interface on TLS | 13:47 |
| jaosorior | shardy: the KeystoneRegion parameter did the trick! it's now going forward with the deployment | 13:47 |
| jaosorior | ayoung: Whhat do you mean? | 13:47 |
| jaosorior | You mean we need to get keystone to stop being terminated by haproxy? | 13:47 |
| ayoung | jaosorior, and needed to force the interface to report itself as openstack.<hostname -d> | 13:47 |
| ayoung | jaosorior, horizon was using the non TLS | 13:48 |
| jaosorior | aaah | 13:48 |
| jaosorior | that | 13:48 |
| ayoung | need to add to HA proxy the ability to rewrite the URLs for redirects | 13:48 |
| jaosorior | so the public_endpoint (or something like that) parameter in the keystone configuration? | 13:48 |
| jaosorior | thought that was being set | 13:48 |
| ayoung | jaosorior, /etc/openstack-dashboard/local_settings | 13:48 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement undercloud upgrade job - Mitaka -> Newton https://review.openstack.org/346995 | 13:48 |
| ayoung | rodrigods, discussing here | 13:49 |
| jaosorior | ayoung: tell me the changes you made and I can start setting up commits for tripleo | 13:49 |
| ayoung | jaosorior, working up a blog post. There is a lot of little details | 13:49 |
| jaosorior | ayoung: Sure man | 13:49 |
| *** pgadiya has quit IRC | 13:49 | |
| jaosorior | ayoung: Can you also open a launchpad bug so we can backport this stuff? | 13:49 |
| ayoung | jaosorior, yep...all that | 13:49 |
| rodrigods | ayoung, nice | 13:50 |
| ayoung | jaosorior, I also need to take a better look at the current puppet support. I suspect I am not using it all properly | 13:50 |
| EmilienM | tripleo meeting in 10 min, https://etherpad.openstack.org/p/tripleo-meeting-items | 13:50 |
| ayoung | for example, I need to set a bunch of vaules in local-settings, and I don't know if they are all supportted. I did it manually post deploy, but it really should be done via the heat template | 13:50 |
| rodrigods | ayoung, what steps are you doing automatically? | 13:51 |
| ayoung | rodrigods, I'll paste my current deploy-env | 13:51 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Implement non-ovb overcloud update job - Newton -> Newton https://review.openstack.org/351330 | 13:52 |
| *** bfournie has left #tripleo | 13:52 | |
| *** bfournie has joined #tripleo | 13:52 | |
| jaosorior | ayoung: Sure thing, when you have that blog post ping my and I'll start looking into that too | 13:52 |
| ayoung | rodrigods, jaosorior http://paste.openstack.org/show/552441/ | 13:53 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement overcloud upgrade job - Mitaka -> Newton https://review.openstack.org/323750 | 13:53 |
| ayoung | jaosorior, so I lumped all of my changes into a single file that I can revision control. We should talk Certificate management, though. | 13:53 |
| jaosorior | ayoung: We should. What I'm doing at the moment is getting rid of the obstacles for the internal endpoints though (like finally getting keystone endpoints managed by puppet) ... and it's really near. at least I have that working in my local environment, just needs to pass CI and merge | 13:54 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: additional info about host in CI https://review.openstack.org/352916 | 13:55 |
| ayoung | jaosorior, so, we should provide a midground prior to the auto-registration of nodes. Let the user do it manually, and set an OTP/controller map | 13:55 |
| rodrigods | ayoung, so the mapping, idp, protocol, etc and also, running the keycloak client install is done manually? | 13:55 |
| ayoung | rodrigods, I have a Ansible to do that, but, yes, I ended up doing it manually | 13:56 |
| rodrigods | ok | 13:56 |
| jaosorior | ayoung: well, without the service that rcrit was working on. I was planning on passing the OTP's via heat metadata | 13:56 |
| ayoung | rodrigods, that stuff goes in the database, and probably should not be done via puppet on each node. I also generated the metadata on the undercloud node, made it into a tarball, and expanded it manually, which is something that needs to happen after the yum install of mod_auth_mellon | 13:57 |
| ayoung | jaosorior, yes, exactly | 13:57 |
| ayoung | jaosorior, do you have a POC of doing that? | 13:57 |
| *** julim has joined #tripleo | 13:57 | |
| jaosorior | ayoung: Not at the moment but it shouldn't be a big deal. | 13:57 |
| shardy | meeting starts in ~3mins https://wiki.openstack.org/wiki/Meetings/TripleO | 13:58 |
| *** rbrady has quit IRC | 13:58 | |
| shardy | https://etherpad.openstack.org/p/tripleo-meeting-items | 13:58 |
| ayoung | jaosorior, excellent. I was doing the old steps, which include private keys in a heat template...I find that yucky | 13:58 |
| shardy | please add any one-off items there | 13:58 |
| *** rbrady has joined #tripleo | 13:58 | |
| jaosorior | ayoung: well, that will probably stay supported for the public endpoints. There's not much to do about that. | 13:58 |
| ayoung | jaosorior, it is disgusting | 13:59 |
| jaosorior | ayoung: hopefully soon we can give the user an option to have certs provided by FreeIPA as al alternative | 13:59 |
| ayoung | its an antipattern, we should not be propagating it | 13:59 |
| jaosorior | ayoung: If you can figure out a better way to support user-provided certificates. I'm in. | 13:59 |
| ayoung | jaosorior, if we really need a Lowest comon denominator like that, we should think it through | 13:59 |
| jaosorior | deployers will need to inject certificates somehow. That's a requirement | 14:00 |
| *** jistr is now known as jistr|debug | 14:00 | |
| ayoung | jaosorior, Anchor or FreeIPA is the simplest set of alternatives. Let Cermonger do it | 14:00 |
| *** _coolsvap_ is now known as coolsvap | 14:00 | |
| ayoung | jaosorior, yep...we can brainstorm. I could see Heat playing the role of the CA proxy | 14:00 |
| jaosorior | ayoung: And what about the sharing of private keys? if we don't share them (which is what you guys had proposed) won't that break SSL pinning? | 14:01 |
| bnemec | gfidente: Right now we don't use DIB_YUM_REPO_CONF. There's a patch up to start using it ( https://review.openstack.org/#/c/337669 ), but there's some contention over the move to a non-OSC image build command so it hasn't merged yet. | 14:01 |
| jaosorior | ayoung: So browsers will have a bad time when trying to access horizon | 14:02 |
| ayoung | jaosorior, shouldn't. Heat should be capable of getting the CSRs signed by a real CA in the case where certmonger is not capable of reaching it directly | 14:02 |
| ccamacho | EmilienM jaosorior please can you briefly check this? This got merged https://review.openstack.org/#/c/349408/ but in the tree https://review.openstack.org/#/c/323436/ isn't yet. So Im not sure if things will break | 14:02 |
| ayoung | the current self-signed is no better anyway. | 14:03 |
| jaosorior | ayoung: That doesn't address the issue | 14:03 |
| ayoung | jaosorior, so long as we can "swap up" to a real cert, we could start with a self signed. | 14:03 |
| *** limao has joined #tripleo | 14:03 | |
| ayoung | jaosorior, anyway, as I said, we need to discuss... | 14:04 |
| *** skramaja_ has joined #tripleo | 14:04 | |
| *** ebalduf has joined #tripleo | 14:04 | |
| jaosorior | ayoung: If each node has a different private key. When a browser that has SSL pinning enabled accesses horizon, it will notice that the signature of the server certificate doesn't match the one that it stored and it will spit an error. | 14:05 |
| ccamacho | jaosorior EmilienM should not break anything*** but just to be sure | 14:05 |
| EmilienM | ccamacho: should not | 14:06 |
| ccamacho | okiç | 14:06 |
| *** skramaja has quit IRC | 14:06 | |
| *** skramaja_ is now known as skramaja | 14:06 | |
| jaosorior | ccamacho: I actually think that the db-sync in mistral is broken | 14:07 |
| jaosorior | was gonna submit a patch about it but got caught up with other stuff | 14:07 |
| d0ugal | jaosorior: still broken? | 14:07 |
| ccamacho | jaosorior, Ill look it also | 14:07 |
| gfidente | bnemec, so how does DIB know about the repos? is there an element adding the delorean .repo ? | 14:07 |
| jaosorior | d0ugal: now I'm talking about the puppet-tripleo parts haha. Not mistral itself | 14:08 |
| jaosorior | ayoung: But yeah, if we can come up with a solution that replaces the current approach, that would be great | 14:08 |
| *** limao_ has joined #tripleo | 14:08 | |
| d0ugal | jaosorior: ah okay, cool :) | 14:08 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/tripleo-quickstart: Add undercloud reboot https://review.openstack.org/350489 | 14:08 |
| jaosorior | I'm actually quite fond of rcrit's initial suggestion of using FreeIPA's Vault to fetch the keys. It could be somethign else too. | 14:09 |
| jaosorior | ayoung ^^ | 14:09 |
| bnemec | gfidente: No, whatever paths you set in DIB_YUM_REPO_CONF get copied into the image and used as the yum repos verbatim. The elements don't have to know anything about the repos you use. | 14:09 |
| ayoung | jaosorior, so all of the HA proxy impls need identical certs, not just certs signed by the same CA....nasty | 14:10 |
| *** jcoufal has quit IRC | 14:10 | |
| gfidente | bnemec, yeah so I mean if we're not using it, how is currently DIB provisioning the repos to build the images? | 14:10 |
| jaosorior | ayoung: Yeah dude. Actually my initial proposal had different certs with the same DNS and different keys. But then I stumbled upon SSL pinning. | 14:11 |
| jaosorior | ayoung: After going back and forth with was to to public SSL, ended up with what's there now | 14:11 |
| *** limao has quit IRC | 14:11 | |
| ayoung | jaosorior, Holy Carp. Pinning seems like a spectacularly bad idea. its like someone said "how can I best mess up security and force peopoe to use compromised keys?" | 14:11 |
| jaosorior | ayoung: I agree... Aaaand it's used (apparently) | 14:12 |
| bnemec | gfidente: Oh, yeah I think there's a delorean-repo element or something that is pulling them down. | 14:12 |
| ayoung | jaosorior, can we say that we won't support it? | 14:12 |
| ayoung | Its like, wow...such bad. | 14:12 |
| jaosorior | ayoung: not something I can answer | 14:12 |
| ayoung | K | 14:12 |
| jaosorior | ayoung: We could push the certmonger-based solution as an alternative, and document that SSL pinning won't work if you deploy with that. | 14:13 |
| ayoung | jaosorior, ++ | 14:13 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-heat-templates: Composable Mistral services https://review.openstack.org/323436 | 14:13 |
| openstackgerrit | Miles Gould proposed openstack/diskimage-builder: Allow installing proliant tools from an OS package https://review.openstack.org/344214 | 14:14 |
| gfidente | bnemec, ack | 14:14 |
| gfidente | so I'd need one for the ceph repos too | 14:14 |
| bnemec | gfidente: I'd really prefer that we just move to the method in thrash's review. Actually, I'd prefer that we had a user-facing tool to handle repo management, but at least it's a step in that direction. | 14:16 |
| *** bootsha has quit IRC | 14:16 | |
| *** r2bit__ is now known as r2bit | 14:16 | |
| thrash | bnemec: yeah... it would be relatively easy to add some repo entries to the yaml. | 14:16 |
| thrash | if we wanted. :) | 14:17 |
| openstackgerrit | Matt Young proposed openstack/tripleo-common: Add support to image build yaml input to handle env vars https://review.openstack.org/318087 | 14:17 |
| *** r2bit has quit IRC | 14:17 | |
| *** r2bit has joined #tripleo | 14:17 | |
| gfidente | thrash, bnemec ok adding me to https://review.openstack.org/#/c/337669 meantime | 14:17 |
| *** limao_ has quit IRC | 14:19 | |
| *** liverpooler has quit IRC | 14:19 | |
| jaosorior | ayoung: If you're at the openstack-meeting-alt channel we're talking about the default network range and trying to come up with an alternative | 14:20 |
| openstackgerrit | Brad P. Crochet proposed openstack-infra/tripleo-ci: Use tripleo-build-images for CI https://review.openstack.org/336312 | 14:21 |
| *** yamahata has joined #tripleo | 14:22 | |
| pabelanger | weshay: If you didn't see: http://docs.openstack.org/developer/tripleo-quickstart/ | 14:23 |
| weshay | pabelanger, nice! | 14:24 |
| openstackgerrit | Brad P. Crochet proposed openstack-infra/tripleo-ci: Use tripleo-build-images for CI https://review.openstack.org/336312 | 14:24 |
| pabelanger | weshay: I'll finish up converting the other docs today | 14:24 |
| bnemec | gfidente: You could split out the repo setup part of thrash's review. I don't think that will be contentious since it's what we're doing in CI anyway. | 14:24 |
| *** tosky_ has joined #tripleo | 14:25 | |
| *** tosky has quit IRC | 14:27 | |
| *** akrivoka has quit IRC | 14:27 | |
| *** akrivoka has joined #tripleo | 14:28 | |
| *** oshvartz has joined #tripleo | 14:28 | |
| *** yamahata has quit IRC | 14:28 | |
| openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Fix mistral sync_db profile steps https://review.openstack.org/352937 | 14:32 |
| rcernin | shardy: when doing the deployment the os-refresh-config has to run alongside the os-collect-config? when starting a deployment in ps output i see only os-collect-config no os-refresh-config nor any other puppet deployments, there is no deployed folder in /var/lib/heat-config when checking journalctl -u os-collect-config there is polling every 30s but only WARNINGS about no auth url for zaqar. | 14:34 |
| gfidente | needs votes pls :) https://review.openstack.org/#/c/352365/ | 14:36 |
| *** ramishra has joined #tripleo | 14:38 | |
| *** Goneri has quit IRC | 14:38 | |
| jaosorior | ayoung: went through the configuration values you added http://paste.openstack.org/show/552456/ | 14:40 |
| *** abehl has quit IRC | 14:41 | |
| ayoung | jaosorior, so...I am not a huge fan of having customer puppet modules for the values from Keystone. I would rather keystoneconfig be the source of truth there, and have a consistant way to specify all config values | 14:42 |
| ayoung | but, I'm not going to make a fuss. That is the least ugly part of my deploy. The Horizon stuff needs far more work. | 14:42 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Composable Mistral services https://review.openstack.org/323436 | 14:43 |
| rcernin | shardy: when doing deployment on the node being stuck only os-collect-config runs, it was run from the past, i restarted it manually but nothing changed. | 14:43 |
| jaosorior | EmilienM: for federation, ayoung used this http://paste.openstack.org/show/552441/ which contains some values for keystone_config. Do you think it's alright to leave them as they are or should we enable the setting of those through puppet-keystone? | 14:44 |
| EmilienM | always use puppet-keysne | 14:44 |
| jaosorior | right | 14:44 |
| EmilienM | keystone::config::* should be avoided, I told it 1000 times maybe | 14:44 |
| ayoung | EmilienM, So, yeah, I am not sold | 14:45 |
| ayoung | EmilienM, I really want to not get in the business of having to worry about something in a puppet module shocins a different default than the true default | 14:45 |
| EmilienM | if you use keystone::config, one day something will break because someone will add the options in puppet-keystone | 14:45 |
| ayoung | and I don't want lag between changes in keystone config and puppet keeping us from using new options | 14:45 |
| EmilienM | that's the reason why I don't like it | 14:45 |
| EmilienM | I don't understand the problem of patching puppet-keystone | 14:46 |
| jaosorior | ayoung: are we always gonna enable the federation options? | 14:46 |
| *** chem has joined #tripleo | 14:46 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: DO NOT TEST CHECKING MISTRAL SUBMISSION https://review.openstack.org/352947 | 14:46 |
| ayoung | jaosorior, EmilienM anyway, let me get the whole process written down first, and we can do the incrementals to getting this productized | 14:46 |
| ayoung | right now, I am not properly setting vlaues in at least 3 places | 14:47 |
| EmilienM | k | 14:47 |
| jaosorior | ayoung: Sure; So first we patch puppet-* to enable the options we need. Then we set them in t-h-t. | 14:47 |
| ayoung | haproxy.cfg, local_settings, and the Apache config files | 14:47 |
| ayoung | I want to be able to do everytihg in Mitaka, so withoug backports etc | 14:47 |
| ayoung | we can clean it up for Newton and later | 14:48 |
| jaosorior | ayoung: for haproxy.cfg there is already a place to set them https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp | 14:48 |
| ayoung | jaosorior, well, we will see. I suspect that what I need is not in that fi;le, but in the underlying puppet modules | 14:49 |
| jaosorior | ayoung: For keystone this is where you want to change it https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L520 | 14:49 |
| ayoung | Ok...fo rthat I neededL | 14:49 |
| ayoung | bind 10.0.0.4:5000 transparent ssl crt /etc/pki/tls/private/overcloud_endpoint.pem | 14:49 |
| ayoung | and | 14:49 |
| ayoung | redirect scheme https code 301 if { hdr(host) -i 10.0.0.4 } !{ ssl_fc } | 14:49 |
| ayoung | rsprep ^Location:\ http://(.*) Location:\ https://\1 | 14:49 |
| ayoung | those 3 values have to be added to the public endpoint. | 14:50 |
| jaosorior | the redirect and rsprep can be done without an issue | 14:50 |
| ayoung | Well...I added those values, I do not know if they *need* to be | 14:50 |
| jaosorior | I'm not sure what you want from the bind though | 14:50 |
| sshnaidm | pabelanger, the rh2 cloud is still in use, right? | 14:50 |
| ayoung | Lots a cargo culting going on! | 14:50 |
| ayoung | jaosorior, I needed Keystone and HA proxy to agree on the port | 14:50 |
| *** thrash is now known as thrash|biab | 14:51 | |
| ayoung | 13000 is strange | 14:51 |
| jaosorior | ayoung: Right, that's gonna be a bigger change and I'm working on that fix | 14:51 |
| ayoung | we already have a 5000 internal without HTTPS | 14:51 |
| ayoung | but this is external, and I added HTTPS on there, | 14:51 |
| pabelanger | sshnaidm: no, it is currently disabled in nodepool | 14:51 |
| jaosorior | basically you'll get that once I get the keystone endpoints to be changed by puppet | 14:51 |
| * ayoung might have broken something, though | 14:51 | |
| pabelanger | sshnaidm: there is some discussions on bring it back online, but we need to address the networking issues first. EG: ntpd getting blocked | 14:52 |
| jaosorior | ayoung: But anyway, you can already change those ports already, but it takes... several additions to hieradata | 14:52 |
| jaosorior | what I'm working on is having that seamless (basically you would only change the endpoint map value and that's it) | 14:52 |
| ayoung | jaosorior, the one change that worries me is that in /etc/httpd/conf.d/10-keystone_wsgi_main.conf I made it ServerName https://openstack.ayoung-dell-t1700.test | 14:53 |
| ccamacho | jaosorior, I have pushed the same fix than for AODH for the sync_db steps | 14:54 |
| ccamacho | mind to check it? | 14:54 |
| ayoung | However, the internal port is http, not https. It needs to be the https value, however, to confirm the vlaue sent by the SAML IdP | 14:54 |
| jaosorior | ccamacho: pass the CR | 14:54 |
| jaosorior | ayoung: so you need internal TLS in the internal endpoints (which is what I'm working on too); or something else? | 14:55 |
| ccamacho | jaosorior dude you are super fast :) https://review.openstack.org/#/c/352937/ thanks also gfidente | 14:55 |
| jaosorior | ccamacho haha | 14:56 |
| *** bana_k has joined #tripleo | 14:57 | |
| panda | bswartz: how do you run it ? and what failures did you see ? | 14:57 |
| *** dtrainor has joined #tripleo | 14:57 | |
| bswartz | panda: http://paste.openstack.org/show/547837/ | 14:58 |
| bswartz | panda: I cloned the git repo, and ran the quickstart.sh script from that | 14:58 |
| bswartz | I tried both as myself and as root | 14:58 |
| bswartz | I pointed it at localhost | 14:58 |
| ayoung | jaosorior, I bet that if you get internal TLS working, it will be enough | 15:00 |
| ayoung | just make sure you use the cloudname for the endpoints, not internals | 15:00 |
| jaosorior | ayoung: that will be needed for IPA anyway | 15:00 |
| jaosorior | FreeIPA won't give us a cert if we request it for an IP | 15:01 |
| jaosorior | ayoung: I'm adding what you need for haproxy | 15:01 |
| jaosorior | I did a very similar change (if not the same) for horizon. So I'm searching for that commit first, to see that I don't miss anything | 15:01 |
| panda | bswartz: can I see you command line that starts it ? | 15:02 |
| panda | the command line you use to start it | 15:02 |
| bswartz | ./quickstart.sh localhost | 15:02 |
| bswartz | that's run as me (bswartz) | 15:02 |
| bswartz | in the /home/bswartz/tripleo-quickstart directory | 15:03 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Handle redirects for keystone https://review.openstack.org/352956 | 15:03 |
| jaosorior | ayoung: ^^ | 15:03 |
| panda | bswartz: can you paste the entire log somewhere ? the cache directory should be create early in the workflow. Anyway using localhost as target for deployment is not heavily tested. | 15:05 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart: Fix InvocationError during ansible-lint run. https://review.openstack.org/352957 | 15:06 |
| jaosorior | shardy: regarding the composable services work. I think stuff gets pretty complicated with HAProxy, since it needs to know which services are running on each node in order to proxy them. I was thinking... what if we have HAProxy as a different type of service. All the other services could output their endpoint template, port and such, and the haproxy service would get that as an input. | 15:07 |
| *** bana_k has quit IRC | 15:07 | |
| *** bana_k has joined #tripleo | 15:08 | |
| *** bana_k has quit IRC | 15:09 | |
| bswartz | panda: sure I'll post log -- what do you recommend other than localhost? the readme file explicitly mentions using localhost | 15:09 |
| *** skramaja has quit IRC | 15:09 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Used subunit to track metrics https://review.openstack.org/352961 | 15:10 |
| pabelanger | dprince: is 23.253.94.71 your graphite server? | 15:12 |
| dprince | pabelanger: should be, yeah | 15:12 |
| ayoung | jaosorior, ++ | 15:12 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Set Sahara workers to 0 https://review.openstack.org/352729 | 15:13 |
| panda | bswartz: readme mentions it as a possible option, but the usual use is targeting a beefy machine for testing | 15:14 |
| *** aufi has quit IRC | 15:14 | |
| jaosorior | ayoung: Do you need anything else in haproxy.cfg? | 15:14 |
| pabelanger | dprince: okay, I wanted to talk to you about moving the metric data to start using generate-subunit over an external graphite server. We have a new tool called stackviz that will render the data from subunit at the end of a job, and visualize it. eg: | 15:15 |
| pabelanger | http://logs.openstack.org/60/337860/25/check/gate-puppet-openstack-integration-3-scenario001-tempest-ubuntu-xenial/11b3677/logs/stackviz/#/testrepository.subunit/timeline | 15:15 |
| *** [1]cdearborn has joined #tripleo | 15:15 | |
| pabelanger | dprince: part of the effort to remove private infrastructure dependencies from tripleo-ci | 15:16 |
| dprince | pabelanger: sounds great to me | 15:16 |
| dprince | pabelanger: so long as we have sometime to profile individual chunks (of our choosing) | 15:16 |
| *** links has joined #tripleo | 15:16 | |
| dprince | pabelanger: like I'm really interested in walltimes of various taks | 15:16 |
| dprince | pabelanger: over time. | 15:16 |
| dprince | pabelanger: so like if we add a change that made DIB much slower for example, just for TripleO. It'd be nice to know that via a graph | 15:17 |
| ayoung | jaosorior, I think that was it. I need to diff what was there before and what I put in. It was defintely only for the Keystone public, so that should be good. | 15:17 |
| jaosorior | ayoung: I added those options in keystone admin too though. Should I remove them? | 15:17 |
| ayoung | jaosorior, we need to look at the Federation support in puppet modules altogether | 15:17 |
| ayoung | jaosorior, I don't know. I would like to get Keystone down to a single port anyway | 15:18 |
| dprince | pabelanger: if the tool doesn't support similar ad-hoc walltime stuff then it would be nice to get something that did | 15:18 |
| ayoung | with V3, there is no difference on wht is on main vs admin | 15:18 |
| jaosorior | hat | 15:18 |
| jaosorior | ayoung: Lets do this. I'll remove them from keystone admin and if they're needed then I push another commit for that | 15:18 |
| ayoung | jaosorior, ++ | 15:18 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Handle redirects for keystone https://review.openstack.org/352956 | 15:19 |
| jaosorior | ayoung ^^ | 15:19 |
| pabelanger | dprince: right, there is actually a spec open for that in qa-specs: http://specs.openstack.org/openstack/qa-specs/specs/devstack/counter-inspection.html | 15:20 |
| openstackgerrit | Ana Krivokapic proposed openstack/instack-undercloud: Add default plan creation https://review.openstack.org/349532 | 15:21 |
| pabelanger | dprince: I think we could contribute code to that, since it is a common request for openstack projects | 15:21 |
| ayoung | jaosorior, I just realized that my deployment is more broken than I realized. I only have identity service and endpoint definied | 15:21 |
| jaosorior | huh? | 15:21 |
| ayoung | jaosorior, yeah, the deploye succeeded, no error reported | 15:22 |
| jaosorior | that's funky | 15:22 |
| dprince | pabelanger: sure, sounds promising. But if it is just starting it might be a while ? | 15:22 |
| *** jistr|debug is now known as jistr | 15:23 | |
| pabelanger | dprince: I think QA has already started the effort, I'd have to follow up with them and see where they stand. | 15:23 |
| ayoung | jaosorior, let me document what I did, and then we can break down the specific tasks. I certainly want a second set of eyes on some of the decisions I made | 15:23 |
| jaosorior | ayoung: Sure, I'll be online for a couple of hours more so we can go through it if you want | 15:25 |
| *** radeks has quit IRC | 15:25 | |
| pabelanger | bnemec: EmilienM: any reason not to bring https://review.openstack.org/#/c/346985/ online? all jobs have passed at one point in time | 15:26 |
| EmilienM | slagle: I recently find this error quite often in multinode job http://logs.openstack.org/46/352746/3/check/gate-tripleo-ci-centos-7-nonha-multinode-nv/03242b0/logs/postci.txt.gz#_2016-08-09_14_32_59_000 | 15:26 |
| EmilienM | pabelanger: merged | 15:27 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Add conditional check for tripleo-test-cloud-rh1 https://review.openstack.org/346985 | 15:27 |
| pabelanger | EmilienM: thanks | 15:27 |
| slagle | EmilienM: i think that just happens in postci if no stack was actually created | 15:28 |
| slagle | EmilienM: so you'd need to check why the job failed before creating a stack | 15:28 |
| jaosorior | pabelanger: I see this error in one commit that seems to have passed the gate... but was reported as a failure anyway | 15:30 |
| *** ebarrera has quit IRC | 15:30 | |
| jaosorior | 2016-08-09 15:24:26.551223 | [Zuul] standard output/error still open after child exited2016-08-09 15:24:26.551562 | [Zuul] Task exit code: 1 | 15:30 |
| *** cdearborn has quit IRC | 15:30 | |
| awayne | jtomasek: does that mean that openstack-ui cannot be successfully deployed at the moment? | 15:31 |
| slagle | EmilienM: i think i see the issue, 1 sec | 15:32 |
| *** tremble has quit IRC | 15:32 | |
| EmilienM | slagle: http://logs.openstack.org/46/352746/3/check/gate-tripleo-ci-centos-7-nonha-multinode-nv/03242b0/console.html#_2016-08-09_14_32_47_115243 | 15:32 |
| openstackgerrit | Merged openstack/puppet-tripleo: Use modern auth options for Neutron https://review.openstack.org/352518 | 15:32 |
| EmilienM | /home/jenkins/overcloudrc: No such file or directory | 15:33 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use --validation-errros-nonfatal in osinfra jobs https://review.openstack.org/352975 | 15:34 |
| slagle | EmilienM: ^ | 15:34 |
| jtomasek | awayne: that's unfortunately right. It It will work but the pieces which use tripleo-api won't work. Removing of that stuff should be done in matter of days though. This is due to the fact that mistral workflows/action that are replacing that functionality are still in progress | 15:34 |
| slagle | EmilienM: ^ that should fix it | 15:34 |
| slagle | EmilienM: this is what broke it https://review.openstack.org/#/c/349609 | 15:34 |
| slagle | EmilienM: it never passed multinode ci | 15:34 |
| EmilienM | slagle: ok but does it mean we'll ignore all validation failures? | 15:35 |
| slagle | EmilienM: we already were | 15:35 |
| awayne | jtomasek: ok, in that case I'll wait for the new API before I continue trying to get the UI stood up. thanks for the help. | 15:35 |
| slagle | EmilienM: but, yes. | 15:35 |
| EmilienM | mhh ok | 15:35 |
| EmilienM | slagle: what are those validations? I missed it | 15:36 |
| jtomasek | awayne: thanks! sorry about the trouble | 15:36 |
| pabelanger | jaosorior: mind linking the log file? | 15:36 |
| slagle | EmilienM: they're in tripleoclient if you want to see what they are | 15:36 |
| EmilienM | ok | 15:36 |
| slagle | EmilienM: they are not new. look at the patch I linked | 15:36 |
| slagle | EmilienM: all that is doing is making them fatal by default | 15:36 |
| jaosorior | pabelanger: http://logs.openstack.org/13/352713/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/1b11920/console.html#_2016-08-09_15_24_26_551223 | 15:37 |
| EmilienM | slagle: yeah, I missed that thing | 15:37 |
| slagle | EmilienM: so we need to have them be non fatal in the multinode job | 15:37 |
| bnemec | EmilienM: If/when we make the multinode setup a supported configuration we need to fix the validations to handle that case somehow. | 15:37 |
| shardy | slagle, EmilienM: In CI validation warnings/errors should already be fatal | 15:37 |
| *** ohamada_ has quit IRC | 15:37 | |
| shardy | https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L111 | 15:37 |
| *** leanderthal is now known as leanderthal|afk | 15:37 | |
| slagle | shardy: not for the multinode job | 15:37 |
| slagle | shardy: we override it | 15:37 |
| shardy | slagle: ah, right | 15:37 |
| slagle | i actually meant to discuss making the multinode jobs voting in the meeting | 15:39 |
| pabelanger | jaosorior: looks like the job hit the timeout, cause the job to fail. The zuul-launcher tried to write something to the console, which failed. | 15:39 |
| slagle | but i forgot and then blew off the meeting | 15:40 |
| slagle | i'll mail the list | 15:40 |
| EmilienM | slagle: me too | 15:40 |
| shardy | slagle: Sorry I missed that failure before approving, +1 on fixing then making it voting | 15:40 |
| EmilienM | slagle: I think we should enable voting | 15:40 |
| slagle | shardy: no worries, i meant to do this patch when I reviewed it myself :) | 15:40 |
| slagle | but forgot | 15:40 |
| pabelanger | jaosorior: Suspect if you address the timeout problem, zuul-launcher will be able to write properly to the console log | 15:40 |
| *** numan_ has quit IRC | 15:41 | |
| jaosorior | pabelanger: thanks, makes sense | 15:41 |
| *** numan_ has joined #tripleo | 15:42 | |
| jaosorior | shardy: You had a really useful link with the status of promotion in RDO, which was it? | 15:44 |
| shardy | https://dashboards.rdoproject.org/rdo-dev | 15:45 |
| shardy | jaosorior: ^^ | 15:45 |
| jaosorior | daaaamn | 15:45 |
| jaosorior | it's been a whle | 15:45 |
| jaosorior | so I guess we still don't have the newest mistral :( | 15:46 |
| *** amoralej is now known as amoralej|brb | 15:47 | |
| *** numan_ has quit IRC | 15:47 | |
| *** tosky_ has quit IRC | 15:48 | |
| *** pcaruana has quit IRC | 15:48 | |
| *** rcernin has quit IRC | 15:50 | |
| *** tesseract- has quit IRC | 15:50 | |
| *** fragatina has joined #tripleo | 15:51 | |
| bswartz | panda: in my case localhost IS a beefy machine (24 core 64GB RAM) | 15:51 |
| bswartz | panda: I changed to using the actual hostname and that fixed my problems however | 15:52 |
| bswartz | panda: thanks for you help -- maybe someone should file a bug about the localhost thing, if it can be reproduced elsewhere | 15:52 |
| *** cdnchris has joined #tripleo | 15:54 | |
| paramite | shardy, Hey Steve, can I bother you for few minutes? I'm probably missing something obvious here. I'm trying to add another attribute to role_data of ResourceChain on the same level as service_names, but I'm getting following error: https://paste.fedoraproject.org/ . Does this ring a bell for you or something I did in the patch: https://review.openstack.org/#/c/254788/28 ? | 15:57 |
| *** hewbrocca is now known as hewbrocca-afk | 16:02 | |
| *** dprince has quit IRC | 16:04 | |
| *** dprince has joined #tripleo | 16:05 | |
| *** jbadiapa has quit IRC | 16:07 | |
| shardy | paramite: Hey, no paste referenced there, but assuming it's the same issue CI is failing on I think I spotted it, commented on the review | 16:08 |
| paramite | shardy, thanks! | 16:08 |
| paramite | shardy, and the paste was https://paste.fedoraproject.org/404923/07579341/ sorry | 16:09 |
| shardy | paramite: Ah, that's slightly different from the error in CI so could be a different problem, but the resource_registry mapping definitely needs to be fixed anyway | 16:10 |
| paramite | shardy, ah-hah, in my testing I'm using https://review.openstack.org/#/c/254788/28/puppet/services/monitoring/sensu-client.yaml as a resource | 16:10 |
| paramite | shardy, will fix it, of course, but it probably is not the cause of the problem | 16:11 |
| EmilienM | paramite: can you look https://review.openstack.org/352484 ? | 16:11 |
| EmilienM | paramite: I'm wondering if it will cause issue for sensu to connect to rabbitmq undercloud | 16:11 |
| *** numan_ has joined #tripleo | 16:11 | |
| paramite | EmilienM, checking | 16:11 |
| EmilienM | or if we changed the design here | 16:12 |
| shardy | paramite: the error you're seeing is a generic error you see when there's something malformed in the role_data section of the *Services templates | 16:12 |
| shardy | paramite: I raised a heat bug to improve it, but for now you'll need to check the output role_data for each service until you spot which one is broken | 16:12 |
| slagle | EmilienM: i believe we said in the monitoring spec that it would not use the underclouds rabbit | 16:12 |
| slagle | EmilienM: we would deploy a new rabbit on the monitoring node | 16:13 |
| paramite | EmilienM, nope, it's ok we won't use undercloud rabbit or redis | 16:13 |
| EmilienM | slagle: ah ok | 16:13 |
| EmilienM | good, nevermind then | 16:13 |
| paramite | shardy, damn ... ok, I browsed them several times already. I think I'm blind :) ... do you have a link to a patch which can I apply to make my debugging faster? | 16:14 |
| *** jpich has quit IRC | 16:15 | |
| shardy | paramite: There is a heat patch, but I've not yet tested/reviewed it | 16:17 |
| shardy | paramite: you could just look up all role_data by brute force: | 16:17 |
| shardy | http://paste.openstack.org/show/552477/ | 16:17 |
| shardy | then tee the result and search for Error | 16:17 |
| paramite | shardy, I guess it's worth the time for me to test it, thanks! | 16:17 |
| *** jcoufal has joined #tripleo | 16:17 | |
| shardy | paramite: one or more of those output-shows will contain the error pointing to a broken *Services template | 16:18 |
| *** mcornea has quit IRC | 16:18 | |
| paramite | shardy, ok, I'm checking it. Thanks for help | 16:18 |
| shardy | paramite: https://bugs.launchpad.net/heat/+bug/1599114 is the heat bug FYI | 16:19 |
| openstack | Launchpad bug 1599114 in heat "Outputs aren't correctly validated" [Medium,In progress] - Assigned to Oleksii Chuprykov (ochuprykov) | 16:19 |
| paramite | shardy, ack, thx | 16:19 |
| *** amoralej|brb is now known as amoralej | 16:20 | |
| gfidente | jaosorior, was the sahara db sync fix merged? | 16:21 |
| jaosorior | gfidente: Not yet | 16:21 |
| openstackgerrit | Merged openstack/instack-undercloud: Default to Ironic API v1.15 on undercloud https://review.openstack.org/348323 | 16:22 |
| panda | bswartz: mh interesting, could *you* file a bug in launchpad then ? :) https://bugs.launchpad.net/tripleo-quickstart/+filebug | 16:25 |
| EmilienM | can someone approve https://review.openstack.org/336538 please? | 16:33 |
| EmilienM | shardy: I have a dumb question, what are becoming the tripleo-puppet-elements defined for controller/compute etc, with composable services? | 16:34 |
| *** ifarkas is now known as ifarkas_afk | 16:34 | |
| openstackgerrit | Merged openstack/tripleo-specs: tripleo-ovs-dpdk https://review.openstack.org/313871 | 16:35 |
| openstackgerrit | Merged openstack/tripleo-image-elements: Deprecate old RDO release https://review.openstack.org/335984 | 16:35 |
| *** bvandenh has quit IRC | 16:36 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Used subunit to track metrics https://review.openstack.org/352961 | 16:36 |
| shardy | EmilienM: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_image.py#L192 | 16:36 |
| EmilienM | oh right | 16:36 |
| EmilienM | shardy: are we converging into overcloud-full ? | 16:36 |
| shardy | EmilienM: we include all the elements in overcloud-full | 16:36 |
| EmilienM | excellent | 16:36 |
| shardy | EmilienM: Yeah, I think a common image is kinda mandatory if folks want flexibility with service placement | 16:37 |
| *** athomas has quit IRC | 16:37 | |
| EmilienM | cool, I just wanted to make sure :) | 16:37 |
| openstackgerrit | Merged openstack/tripleo-specs: Metal to Tenant: Ironic in Overcloud https://review.openstack.org/320995 | 16:37 |
| *** milan has quit IRC | 16:38 | |
| *** fragatin_ has joined #tripleo | 16:38 | |
| *** dsariel has quit IRC | 16:39 | |
| openstackgerrit | Merged openstack/tripleo-incubator: Don't require EPEL https://review.openstack.org/350619 | 16:40 |
| *** fragatina has quit IRC | 16:41 | |
| openstackgerrit | Merged openstack/tripleo-specs: Spec: Add Adapter Teaming Support to os-net-config https://review.openstack.org/337886 | 16:41 |
| openstackgerrit | Merged openstack/tripleo-puppet-elements: Add puppet-ec2api module https://review.openstack.org/336538 | 16:41 |
| openstackgerrit | Merged openstack/tripleo-puppet-elements: Add packages required for dpdk in compute node https://review.openstack.org/341313 | 16:42 |
| *** dprince has quit IRC | 16:42 | |
| *** dprince has joined #tripleo | 16:43 | |
| openstackgerrit | Merged openstack/tripleo-docs: Add all puppet modules to includepkgs https://review.openstack.org/350776 | 16:45 |
| *** paramite is now known as paramite|afk | 16:46 | |
| *** akrivoka has quit IRC | 16:48 | |
| *** bana_k has joined #tripleo | 16:48 | |
| *** yamahata has joined #tripleo | 16:54 | |
| *** dprince has quit IRC | 16:54 | |
| bswartz | tbarron: ping | 16:55 |
| *** ebarrera has joined #tripleo | 16:55 | |
| *** dtantsur is now known as dtantsur|afk | 16:56 | |
| *** lucasagomes is now known as lucas-dinner | 16:58 | |
| EmilienM | slagle: merging your fix, it passed multinode | 16:59 |
| slagle | i don't object | 17:00 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Use --validation-errros-nonfatal in osinfra jobs https://review.openstack.org/352975 | 17:00 |
| EmilienM | ok one last thing we need is https://review.openstack.org/#/c/352746/ | 17:01 |
| EmilienM | both ovb jobs passed | 17:01 |
| EmilienM | slagle: what about enabling voting on multinode job? | 17:02 |
| EmilienM | the nonha at least for now | 17:02 |
| *** dsariel has joined #tripleo | 17:03 | |
| *** numan_ has quit IRC | 17:03 | |
| *** jpena is now known as jpena|off | 17:07 | |
| *** jcoufal has quit IRC | 17:10 | |
| *** dsariel has quit IRC | 17:10 | |
| slagle | EmilienM: chill. i'm working on it | 17:10 |
| slagle | i'm in the yaml, updating the yaml | 17:11 |
| EmilienM | slagle: it's all yaml | 17:11 |
| slagle | i need some yaml to define this yaml | 17:11 |
| *** amoralej is now known as amoralej|off | 17:11 | |
| EmilienM | lol | 17:11 |
| *** mgould is now known as mgould|afk | 17:11 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Add manifests to inject and trust CA certificates https://review.openstack.org/353021 | 17:12 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Used subunit to track metrics https://review.openstack.org/352961 | 17:13 |
| *** bana_k has quit IRC | 17:14 | |
| slagle | EmilienM: Yo, check my yaml, https://review.openstack.org/#/c/353019/ | 17:14 |
| *** numan_ has joined #tripleo | 17:15 | |
| EmilienM | slagle: yo I had to -1 | 17:16 |
| *** thrash|biab is now known as thrash | 17:17 | |
| slagle | it's b/c i can't yaml | 17:17 |
| EmilienM | the alternative option is to use a template | 17:17 |
| EmilienM | where you define both jobs in check & gate and use the template in check-tripleo-jobs | 17:17 |
| slagle | do you think we need them in the gate? | 17:18 |
| EmilienM | if they are voting, yes | 17:18 |
| slagle | i had planned to leave them as check for now | 17:18 |
| EmilienM | I never saw a CI job voting that is not in gate | 17:18 |
| EmilienM | maybe I'm wrong, pabelanger can you confirm? | 17:18 |
| *** fragatin_ has quit IRC | 17:19 | |
| shardy | EmilienM: won't that mean we have to run the whole job again every time a patch is approved? | 17:22 |
| slagle | yea that's what i'd like to avoid | 17:22 |
| pabelanger | EmilienM: correct, voting jobs should be in gate too | 17:22 |
| slagle | pabelanger: should be or have to be? | 17:23 |
| pabelanger | have to be if they are voting | 17:23 |
| slagle | ok | 17:23 |
| slagle | i'll update it | 17:24 |
| slagle | shardy: so i'll update the patch to add them to the gate too. i guess this will be a good litmus test to see if we can live with this as a project | 17:25 |
| shardy | slagle: Ok - I suspect it's going to be unworkable, but lets see I guess | 17:25 |
| * shardy looks at the worn out r-e-c-h-e-c-k keys on his keyboard | 17:26 | |
| slagle | shardy: certainly possible. though we've been saying for 3+ years we want gating jobs. so if it doesnt work, at least we can stop saying that | 17:27 |
| slagle | i'll clarify this on my mail as well | 17:28 |
| EmilienM | slagle++ | 17:28 |
| bswartz | shardy: if the c h or k keys are broken, you can use the synonym "reverify" ;-) | 17:29 |
| *** lblanchard has quit IRC | 17:29 | |
| *** weshay has quit IRC | 17:30 | |
| *** lblanchard has joined #tripleo | 17:30 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Convert ServiceNetMap to a nested template https://review.openstack.org/353032 | 17:31 |
| *** dprince has joined #tripleo | 17:32 | |
| tbarron | bswartz: pong | 17:32 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add alternative environment to deploy CAs via hieradata https://review.openstack.org/353037 | 17:33 |
| bnemec | We may be able to get away with it in multinode. | 17:34 |
| bnemec | There's no baremetal deployment and no ha in that job. | 17:34 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add deployment of CAs via hieradata https://review.openstack.org/353037 | 17:34 |
| bnemec | That's the vast majority of our failures in the other jobs. | 17:34 |
| jaosorior | shardy, EmilienM: Hey guys, I did an alternative approach to deploy the CA certs via hieradata instead of the bash script that does it currently. I haven't tested it yet, but if you guys can take a quick look about the approach, would appreciate it https://review.openstack.org/#/c/353037/ | 17:38 |
| EmilienM | jaosorior: ok | 17:39 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add deployment of CAs via hieradata https://review.openstack.org/353037 | 17:40 |
| EmilienM | slagle: +1 yo | 17:40 |
| *** ioggstream has quit IRC | 17:41 | |
| *** Vijayendra has quit IRC | 17:41 | |
| *** Vijayendra has joined #tripleo | 17:42 | |
| *** yamahata has quit IRC | 17:42 | |
| EmilienM | jaosorior: https://review.openstack.org/#/c/353037/3/puppet/ceph-storage.yaml | 17:43 |
| EmilienM | not sure we want to keep this file on long term | 17:43 |
| EmilienM | well, all the hiera files | 17:44 |
| EmilienM | same for https://review.openstack.org/#/c/353037/3/puppet/manifests/overcloud_cephstorage.pp | 17:44 |
| EmilienM | we don't want to keep old manifests | 17:44 |
| EmilienM | you might want to use profiles | 17:44 |
| EmilienM | think container ! | 17:44 |
| *** pcaruana has joined #tripleo | 17:45 | |
| jaosorior | EmilienM: right. So I thought of that, but my only fear is that the deployer will mess up and not include the CA parts in one of the roles | 17:46 |
| *** weshay has joined #tripleo | 17:46 | |
| jaosorior | and then we'll get into trouble cause things will break | 17:46 |
| jaosorior | and it's a "supported path" | 17:46 |
| jaosorior | even if having the CA installed should be mandatory | 17:46 |
| EmilienM | jaosorior: in tripleo::init? | 17:47 |
| jaosorior | EmilienM: Does that get run every time? | 17:47 |
| jaosorior | if that's the case I'll just do it there | 17:47 |
| jaosorior | *ran | 17:47 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: WIP: Upgrade scripts to migrate aodh alarm data https://review.openstack.org/353042 | 17:48 |
| jaosorior | EmilienM: Should I move tripleo::packages and tripleo::firewall there then? | 17:48 |
| EmilienM | no it doesn't but we should do it | 17:49 |
| EmilienM | that's the way to write puppet manifests | 17:49 |
| EmilienM | ::tripleo should be a common class to all nodes | 17:49 |
| jaosorior | alright | 17:49 |
| EmilienM | but we need to be very careful | 17:49 |
| jaosorior | tomorrow I'll give it a try then | 17:49 |
| jaosorior | I gotta go | 17:50 |
| *** yamahata has joined #tripleo | 17:50 | |
| *** pkovar has quit IRC | 17:50 | |
| jaosorior | have a good one guys! | 17:50 |
| *** jaosorior has quit IRC | 17:50 | |
| *** liverpooler has joined #tripleo | 17:53 | |
| EmilienM | shardy: I agree with your statement, re- voting jobs. See now, check queue is 430 jobs... it means we'll have to wait in case of emergencies patches. | 17:53 |
| EmilienM | but it's like all OpenStack projects | 17:54 |
| EmilienM | so I guess this is fair to give a try | 17:54 |
| *** yamahata has quit IRC | 17:54 | |
| bnemec | Most of our projects have to wait for the gate queue anyway because they have unit tests of some sort. | 18:00 |
| *** sarath_ has joined #tripleo | 18:02 | |
| bnemec | +A anyone? https://review.openstack.org/#/c/351763/ | 18:03 |
| EmilienM | bnemec: right | 18:05 |
| *** electrofelix has quit IRC | 18:05 | |
| EmilienM | bnemec: +A | 18:05 |
| bnemec | EmilienM: Thanks | 18:05 |
| gfidente | bnemec, thanks | 18:05 |
| slagle | darn. you stole my Thanks | 18:05 |
| bnemec | Thankses all around :-) | 18:06 |
| *** gfidente is now known as gfidente|afk | 18:07 | |
| *** yamahata has joined #tripleo | 18:07 | |
| *** liverpooler has quit IRC | 18:08 | |
| *** bana_k has joined #tripleo | 18:08 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Only db-sync sahara is included in the bootstrapnode https://review.openstack.org/352746 | 18:12 |
| openstackgerrit | Merged openstack/tripleo-quickstart: allow RHEL virthosts to use an updated ipxe-roms-qemu https://review.openstack.org/348017 | 18:13 |
| *** bana_k has quit IRC | 18:14 | |
| *** fragatina has joined #tripleo | 18:16 | |
| *** cdnchris has quit IRC | 18:17 | |
| *** chem has quit IRC | 18:18 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Add 'ceph status' and tripleo-overcloud-passwords to host_info https://review.openstack.org/348862 | 18:19 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Implement non-ovb overcloud update job - Newton -> Newton https://review.openstack.org/351330 | 18:20 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement undercloud upgrade job - Mitaka -> Newton https://review.openstack.org/346995 | 18:21 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement overcloud upgrade job - Mitaka -> Newton https://review.openstack.org/323750 | 18:22 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Revert "We don't need to set a default for the CephX keys and cluster FSID" https://review.openstack.org/351763 | 18:24 |
| *** akshai has quit IRC | 18:26 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Used subunit to track metrics https://review.openstack.org/352961 | 18:26 |
| *** akshai has joined #tripleo | 18:27 | |
| *** fragatina has quit IRC | 18:29 | |
| *** fragatina has joined #tripleo | 18:30 | |
| *** bana_k has joined #tripleo | 18:32 | |
| EmilienM | bnemec: do we still actually need https://review.openstack.org/#/c/348884/ ? | 18:37 |
| pabelanger | EmilienM: shardy: I think the wait will be worth it for voting in gate. Brings tripleo jobs into the fold with other openstack projects, a good thing | 18:38 |
| EmilienM | pabelanger: I agree | 18:39 |
| EmilienM | let's see how it works during the next days/weeks | 18:39 |
| pabelanger | Yup | 18:39 |
| shardy | pabelanger: I agree, it's just that our runtimes and rate of false negatives are pretty high compared to most projects | 18:39 |
| shardy | hopefully it will work out OK tho | 18:39 |
| *** myoung|alt has joined #tripleo | 18:40 | |
| *** links has quit IRC | 18:40 | |
| *** david-lyle has quit IRC | 18:41 | |
| pabelanger | shardy: right, have I some ideas how to fix that, by refactoring some of tripleo-ci. I hope to have a spec in place by barcelona to discuss options | 18:41 |
| *** rkolli has joined #tripleo | 18:41 | |
| shardy | pabelanger: ack, sounds good! | 18:42 |
| *** david-lyle has joined #tripleo | 18:42 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Print services statuses of nodes in CI https://review.openstack.org/352916 | 18:42 |
| *** bana_k has quit IRC | 18:43 | |
| rkolli | shardy: in continuation to our discussion regarding aci_opflex in this morning's meeting. Can you please take a look at http://paste.openstack.org/show/552653/ where I have provided snippets of the out of tree heat templates | 18:45 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: [WIP] Prototype tandem documentation generation https://review.openstack.org/347592 | 18:48 |
| *** yamahata has quit IRC | 18:48 | |
| shardy | rkolli: Hi, thanks - that's interesting | 18:48 |
| shardy | rkolli: so, an alternative to adding things to the hierarchy and using *ExtraConfigPre is this: | 18:49 |
| shardy | http://paste.openstack.org/show/552655/ | 18:49 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Used subunit to track metrics https://review.openstack.org/352961 | 18:49 |
| shardy | there are parameters which will inject any hieradata you need, and you can still use NodeExtraConfigPost to apply your manifests | 18:49 |
| shardy | rkolli: I'm not blocking the patches you have posted, but I wonder if this pattern may be more flexible for you, as it won't require any upstream patches at all? | 18:50 |
| *** rcernin has joined #tripleo | 18:51 | |
| rkolli | shardy: I am a novice to tripleO, let me go thru the link you sent and try it out | 18:51 |
| *** florianf has quit IRC | 18:53 | |
| shardy | rkolli: Ok, thanks - I'll comment on the review and we can discuss further if needed | 18:53 |
| * shardy dropping off for dinner now | 18:53 | |
| rkolli | shardy: I understand that this will write the hiera data, but the patch i put to controller.yaml file was so that puppet run loads the hiera file | 18:54 |
| shardy | rkolli: the patch to controller.yaml only writes the hieradata | 18:54 |
| shardy | you can still run puppet via your NodeExtraConfigPost changes | 18:54 |
| rkolli | shardy: thanks, i will try it out | 18:55 |
| shardy | basically this just replaces the ControllerExtraConfigPre part | 18:55 |
| shardy | you can use NovaComputeExtraConfig to deploy the same data on the compute nodes | 18:55 |
| *** myoung has quit IRC | 18:55 | |
| *** myoung|alt is now known as myoung | 18:55 | |
| beagles | has anyone tried building overcloud images for mitaka from a a mitaka based undercloud lately? | 18:57 |
| shardy | rkolli: there is also a generic ExtraConfig parameter which deploys the hieradata to all roles | 18:57 |
| rkolli | shardy: thanks for your input, this is my first time with tripleO, I need to read up further. Appreciate your help | 18:57 |
| shardy | rkolli: No problem, if you try this approach and it doesn't work for you, we can still land the hierarchy addition | 18:58 |
| openstackgerrit | Dan Sneddon proposed openstack/os-net-config: Fix Linux bond/slave ifup ordering https://review.openstack.org/353072 | 18:58 |
| rkolli | shardy: thanks, dont want hold up your dinner, we can chat later | 18:58 |
| shardy | ack, thanks! | 18:58 |
| *** shardy is now known as shardy_afk | 18:58 | |
| *** social has joined #tripleo | 19:07 | |
| *** akshai has quit IRC | 19:08 | |
| dsneddon | ^^^ Fix for serious os-net-config bug: https://bugs.launchpad.net/os-net-config/+bug/1611471 | 19:08 |
| openstack | Launchpad bug 1611471 in os-net-config "os-net-config 0.2.4 fails to enable Linux bonds" [High,In progress] - Assigned to Dan Sneddon (dsneddon) | 19:08 |
| *** akshai has joined #tripleo | 19:09 | |
| *** myoung has quit IRC | 19:09 | |
| *** myoung has joined #tripleo | 19:10 | |
| *** akshai has quit IRC | 19:14 | |
| *** paramite|afk is now known as paramite | 19:22 | |
| *** abehl has joined #tripleo | 19:27 | |
| *** paramite has quit IRC | 19:28 | |
| *** rkolli has quit IRC | 19:29 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Used subunit to track metrics https://review.openstack.org/352961 | 19:35 |
| *** radeks has joined #tripleo | 19:37 | |
| *** abehl has quit IRC | 19:38 | |
| EmilienM | ayoung: what are plans to integrate fernets into OOO? | 19:38 |
| EmilienM | ayoung: is uuid removed in Ocata? | 19:39 |
| *** david-lyle_ has joined #tripleo | 19:41 | |
| *** numan_ has quit IRC | 19:41 | |
| sshnaidm | pabelanger, do you know if there is a way to set more memory to nodes, now it has 4.7 GB per node and no swap, I meet more and more jobs killed by OOM | 19:42 |
| pabelanger | sshnaidm: which node? | 19:42 |
| *** david-lyle has quit IRC | 19:43 | |
| sshnaidm | pabelanger, controller nodes | 19:44 |
| larsks | Can someone here answer some composable service design questions? Particular w/r/t where I should put "required" overrides to puppet module parameters... | 19:44 |
| sshnaidm | pabelanger, and undercloud too | 19:46 |
| *** penick has joined #tripleo | 19:46 | |
| pabelanger | sshnaidm: in general, the clouds openstack-infra jobs on have 8GB RAM configured. | 19:46 |
| larsks | For setting up a 'fluentd' service, I need to override several of the parameter defaults. I can put these into the config_settings of the tempalte...or I could put them in the puppet-tripleo module. | 19:46 |
| pabelanger | sshnaidm: which cloud is your job running on? | 19:46 |
| sshnaidm | pabelanger, and how do I know now? | 19:46 |
| *** jeckersb is now known as jeckersb_gone | 19:46 | |
| pabelanger | sshnaidm: also, if you are missing a swap, you have the ability to enable it | 19:47 |
| pabelanger | sshnaidm: look for Building remotely on ... | 19:47 |
| pabelanger | in the console.log | 19:47 |
| sshnaidm | pabelanger, no, there is no swap at all on node | 19:47 |
| sshnaidm | pabelanger, tripleo-centos-7-tripleo-test-cloud-rh1-3316702 | 19:48 |
| sshnaidm | pabelanger, as I see in "free -h" it's 6 GB for undercloud and 5GB for controller | 19:48 |
| sshnaidm | pabelanger, controller-0 and undercloud are close to out of memory | 19:49 |
| sshnaidm | e.g. undercloud: http://logs.openstack.org/98/352598/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/c3bf5b4/logs/undercloud/var/log/host_info.txt.gz | 19:49 |
| pabelanger | sshnaidm: | 18e29a9b-8b32-4b61-bc76-6346dc7468f2 | undercloud | 6144 | 40 | 0 | 2 | True | | 19:50 |
| pabelanger | that is the flavor nodepool is using to launch VMs | 19:50 |
| sshnaidm | pabelanger, what is it? | 19:50 |
| pabelanger | I am not sure why it is 6144 RAM | 19:50 |
| sshnaidm | pabelanger, ok, 6GB, as I said | 19:50 |
| pabelanger | It should be 8GB to be inline with other clouds | 19:51 |
| pabelanger | as for swap, I think devstack-gate has a function to enable it | 19:51 |
| sshnaidm | yeah, 8 would be very very nicer.. | 19:51 |
| *** coolsvap has quit IRC | 19:51 | |
| pabelanger | you'll need to ask the cloud admins, I am not sure why they chose that amount | 19:52 |
| sshnaidm | pabelanger, ok, and who are them? :) | 19:52 |
| pabelanger | slagle: ^ | 19:52 |
| sshnaidm | slagle, hi | 19:52 |
| slagle | hi | 19:53 |
| pabelanger | sshnaidm: http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n324 will setup the swap too | 19:53 |
| slagle | we could add more memory if there is capacity | 19:53 |
| slagle | these instances aren't spawned by nodepool | 19:53 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Update hieradata parameters to match recent changes https://review.openstack.org/353090 | 19:54 |
| slagle | so that's why it doesnt match those instances that are | 19:54 |
| slagle | that's the whole point of why we have ovb | 19:54 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Used subunit to track metrics https://review.openstack.org/352961 | 19:55 |
| pabelanger | slagle: sshnaidm: right, I was just looking at the undercloud node | 19:56 |
| slagle | pabelanger: sshnaidm : it's as simple as updating the baremetal flavor in the overcloud | 19:56 |
| slagle | we just need to do some analysis of available capacity before we do that | 19:57 |
| sshnaidm | slagle, how can we know if we have a capacity? | 19:57 |
| sshnaidm | slagle, can you give me please an access to this cloud? at least ro | 19:57 |
| pabelanger | sshnaidm: http://grafana.openstack.org/dashboard/db/nodepool-tripleo-test-cloud | 19:58 |
| slagle | sshnaidm: would have to check available memory when we are running all of our jobs | 19:58 |
| pabelanger | is the current capacity from nodepool | 19:58 |
| slagle | sshnaidm: i thought you had access already? | 19:58 |
| sshnaidm | slagle, nope | 19:59 |
| sshnaidm | pabelanger, do I understand right from this board that we are always in full nodes (50) mode? | 20:00 |
| pabelanger | sshnaidm: not always, the last 6 hours | 20:00 |
| pabelanger | sshnaidm: you can change the time range on the top right | 20:01 |
| sshnaidm | pabelanger, oh, right, sorry) | 20:01 |
| pabelanger | sshnaidm: but 50 is currently the max nodes we launch in tripleo-test-cloud-rh1 | 20:01 |
| slagle | sshnaidm: we probably need to update this process, but can you propose a patch adding yourself here: https://github.com/openstack/tripleo-incubator/tree/master/tripleo-cloud | 20:01 |
| pabelanger | I don't have access to the cloud capacity | 20:01 |
| slagle | sshnaidm: to tripleo-cd-admins and include your ssh key under ssh-keys | 20:02 |
| sshnaidm | slagle, great, will do | 20:02 |
| slagle | that's how we've been managing access for now | 20:02 |
| slagle | from what I can tell, we have a full queue right now with around 40 jobs in progress | 20:07 |
| slagle | and are consuming 1.5TB of 4TB of available memory | 20:07 |
| slagle | so I'd say we have some room | 20:07 |
| openstackgerrit | Ade Lee proposed openstack/puppet-tripleo: Add barbican profile - WIP https://review.openstack.org/352447 | 20:10 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates: Add Barbican to the overcloud - WIP https://review.openstack.org/352458 | 20:10 |
| *** julim has quit IRC | 20:11 | |
| *** david-lyle_ is now known as david-lyle | 20:12 | |
| bnemec | Yeah, we have a ton of memory capacity. | 20:14 |
| bnemec | We were getting uncomfortably high on CPU usage on the rh1 controller, but I made a change in OVB so it won't hit the host cloud apis quite as hard now. | 20:14 |
| bnemec | I was actually going to propose that we bump the number of testenvs since we're set up for at least 80 right now. | 20:15 |
| slagle | yea, there is plenty of ram :) | 20:15 |
| bnemec | We have compute nodes that look completely unused, in fact. | 20:16 |
| bnemec | Which seems like a waste. :-) | 20:16 |
| slagle | my only concern is we keep bumping the resources and having longer job run times and I'd like to know why | 20:17 |
| slagle | i'd like to remove all of the optional services from the controller | 20:17 |
| slagle | in the main HA job | 20:17 |
| slagle | bnemec: we got a whole cloud sitting unused :) | 20:19 |
| slagle | we should turn rh2 back on | 20:20 |
| bnemec | Well, that too. | 20:20 |
| bnemec | Part of the problem is that we're building images in every job right now. | 20:20 |
| bnemec | And for some reason it's taking an absurdly long time. | 20:20 |
| bnemec | Like 40+ minutes. | 20:20 |
| bnemec | I can build both images locally on basic hardware in ~16 minutes. | 20:21 |
| *** radeks has quit IRC | 20:27 | |
| *** rhallisey has quit IRC | 20:27 | |
| *** lblanchard has quit IRC | 20:28 | |
| *** jprovazn has quit IRC | 20:30 | |
| *** ebarrera has quit IRC | 20:31 | |
| ayoung | EmilienM, good question. Need to come up with a story for Key rotation | 20:36 |
| ayoung | I think uuid will still be there Ocata and beyond. There is some demand for UUID still in the community | 20:36 |
| *** dprince has quit IRC | 20:37 | |
| *** ioggstream has joined #tripleo | 20:43 | |
| *** ioggstream has quit IRC | 20:49 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-incubator: Add sshnaidm to tripleo-cloud https://review.openstack.org/353103 | 20:49 |
| sshnaidm | bnemec, I think we used promoted images before, at least in part of jobs. did we reutrn to building intentionally? | 20:49 |
| bnemec | sshnaidm: Yes, it was intentional. There was a change in how we install puppet modules that required us to stop using cached images for a while. | 20:50 |
| bnemec | We may be able to turn it back on now. I'm not sure though. | 20:50 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE TESTING https://review.openstack.org/316436 | 20:53 |
| pabelanger | bnemec: does that mean we are not using the private mirror for puppet modules? | 20:54 |
| shardy_afk | we could use DeployArtifactURLs to update the modules in a cached image, either from source or by passing in a list of RPMs from delorean-current plus delorean-ci | 20:55 |
| bnemec | pabelanger: I think that's correct, yes. We're installing them from package now, so not using the git repos on the mirror server. | 20:55 |
| *** shardy_afk is now known as shardy | 20:55 | |
| bnemec | I thought we had a way to inject packages into the CI image? | 20:55 |
| pabelanger | bnemec: if so, I'd prefer not to switch back to it. And remove those bits from tripleo-ci and use openstack-infra if we need something | 20:55 |
| bnemec | We had to do that for stuff like os-net-config too. | 20:56 |
| pabelanger | bnemec: looking for the commit now | 20:56 |
| bnemec | pabelanger: That's fine. I don't think anyone is proposing we start pulling puppet from git again. | 20:56 |
| *** radeks has joined #tripleo | 20:57 | |
| pabelanger | bnemec: great | 20:57 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: [WIP] Prototype tandem documentation generation https://review.openstack.org/347592 | 21:01 |
| *** dergrunepunkt has joined #tripleo | 21:01 | |
| dergrunepunkt | hi guys, to deploy with tripleO is it absolutelly neccesary to have IPMI? | 21:02 |
| sshnaidm | if we install puppet modules from rpms, it could be just "yum update puppet-* --disablerepo=* enablerepo=delorean-current" in undercloud? | 21:05 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: Remove git repo mirror scripts https://review.openstack.org/353112 | 21:07 |
| pabelanger | bnemec: ^ once that is landed, we can manually delete the apache folder | 21:07 |
| bnemec | sshnaidm: It's not the undercloud that is a problem. It's the overcloud images. If they're pre-built, we either need to crack them open and update the puppet packages (which is how we handle other packages), or we need to use the artifact deploy to update the puppet modules. | 21:10 |
| sshnaidm | bnemec, I see.. using virt-customize, etc? | 21:11 |
| bnemec | sshnaidm: Yeah, although we're actually just mounting the image: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/common_functions.sh#n73 | 21:13 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Expand templated bash to allow for doc generation https://review.openstack.org/347592 | 21:15 |
| *** thrash is now known as thrash|g0ne | 21:15 | |
| sshnaidm | bnemec, oh, so it's almost ready, just one more line there | 21:15 |
| *** bana_k has joined #tripleo | 21:15 | |
| sshnaidm | maybe it would be cool to have a task, that is triggered by every new build of puppet module and rebuild our overcloud images, and then uploads them to server where each job can take it | 21:16 |
| bnemec | sshnaidm: Actually, I think it might be fine already. Since the puppet modules are just packages now, they'll be updated just like all the other packages were. | 21:17 |
| bnemec | The main thing I don't know for sure is when we last updated our cached images. | 21:17 |
| bnemec | If it's since we switched to packaged puppet we can probably turn back on caching and it will Just Work(tm) | 21:18 |
| sshnaidm | bnemec, worth a try.. | 21:18 |
| *** ayoung has quit IRC | 21:19 | |
| sshnaidm | as I heard we have a pretty old undercloud, but overcloud is new.. maybe pabelanger knows better | 21:19 |
| bnemec | sshnaidm: We aren't uploading undercloud anymore because we don't build a separate undercloud image now. | 21:19 |
| bnemec | It just runs on the Jenkins slave. | 21:19 |
| *** radeks has quit IRC | 21:20 | |
| sshnaidm | bnemec, uh, so that's why it's old :) | 21:20 |
| sshnaidm | so we just run yum update every job, right? | 21:21 |
| bnemec | Basically. The base image gets updated periodically by infra, so it should always be pretty up to date in the first place. | 21:22 |
| bnemec | The main place it hurts us timewise is installing the OpenStack packages. | 21:22 |
| bnemec | Looks like we're hovering a little under 25 minutes for the undercloud install right now. | 21:22 |
| bnemec | Which is in line with what I see locally. | 21:22 |
| *** dergrunepunkt has quit IRC | 21:23 | |
| pabelanger | nice images get build everyday and uploaded | 21:23 |
| pabelanger | which is done via nodepool | 21:23 |
| pabelanger | new* | 21:24 |
| slagle | bnemec: i think that's because through the power of puppet we install 1 package at a time | 21:25 |
| bnemec | slagle: Yeah, it's pretty terrible. I wonder if it would be worth pre-installing stuff we know we need in instack-undercloud. | 21:26 |
| * bnemec is off to try | 21:26 | |
| *** bana_k has quit IRC | 21:28 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Convert ServiceNetMap to a nested template https://review.openstack.org/353032 | 21:28 |
| *** bana_k has joined #tripleo | 21:31 | |
| *** zigo has quit IRC | 21:32 | |
| *** zigo has joined #tripleo | 21:35 | |
| *** yamahata has joined #tripleo | 21:36 | |
| *** weshay has quit IRC | 21:38 | |
| *** shardy has quit IRC | 21:38 | |
| *** julim has joined #tripleo | 21:40 | |
| *** bank_ has joined #tripleo | 21:43 | |
| *** bank_ has quit IRC | 21:43 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Add Plan Deletion https://review.openstack.org/299937 | 21:44 |
| *** bana_k has quit IRC | 21:46 | |
| *** morazi has quit IRC | 21:53 | |
| openstackgerrit | Ben Nemec proposed openstack/instack-undercloud: Pre-install packages before running puppet https://review.openstack.org/353121 | 21:55 |
| *** Goneri has joined #tripleo | 21:56 | |
| *** rbrady has quit IRC | 21:57 | |
| *** rbrady has joined #tripleo | 21:58 | |
| *** rbrady has quit IRC | 22:01 | |
| *** rcernin has quit IRC | 22:02 | |
| openstackgerrit | Stephanie Miller proposed openstack/diskimage-builder: Explain the difference between 'DIB_OFFLINE' and 'DIB_DEBIAN_USE_DEBOOTSTRAP_CACHE' https://review.openstack.org/345935 | 22:12 |
| *** yamahata has quit IRC | 22:23 | |
| *** bfournie has quit IRC | 22:25 | |
| *** davidlenwell has quit IRC | 22:25 | |
| *** fragatin_ has joined #tripleo | 22:33 | |
| *** rkolli has joined #tripleo | 22:34 | |
| *** rkolli has quit IRC | 22:35 | |
| *** fragatina has quit IRC | 22:36 | |
| *** bana_k has joined #tripleo | 22:36 | |
| *** davidlenwell has joined #tripleo | 22:38 | |
| *** ChanServ sets mode: +v davidlenwell | 22:38 | |
| *** Goneri has quit IRC | 22:53 | |
| *** TSCHAK has quit IRC | 22:57 | |
| *** TSCHAK has joined #tripleo | 22:58 | |
| *** Ryjedo has quit IRC | 22:59 | |
| *** bana_k has quit IRC | 23:05 | |
| *** rlandy has quit IRC | 23:16 | |
| *** david-lyle has quit IRC | 23:20 | |
| *** sarath_ has quit IRC | 23:32 | |
| *** ayoung has joined #tripleo | 23:35 | |
| *** david-lyle has joined #tripleo | 23:39 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!