*** mbozhenko has joined #tripleo | 00:02 | |
*** mbozhenko has quit IRC | 00:07 | |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/360004 | 00:16 |
---|---|---|
*** bana_k has quit IRC | 00:18 | |
*** pradk has joined #tripleo | 00:19 | |
*** bana_k has joined #tripleo | 00:31 | |
*** thrash is now known as thrash|g0ne | 00:38 | |
openstackgerrit | Merged openstack/tripleo-image-elements: Open tripleo-image-elements for Ocata https://review.openstack.org/382431 | 00:39 |
openstackgerrit | Merged openstack/python-tripleoclient: Open python-tripleoclient for Ocata https://review.openstack.org/382418 | 00:42 |
*** tobias-fiberdata has quit IRC | 00:46 | |
*** tobias-fiberdata has joined #tripleo | 00:46 | |
*** dtrainor has quit IRC | 00:47 | |
*** dtrainor has joined #tripleo | 01:02 | |
*** kberger has joined #tripleo | 01:09 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Increase disk_allocation_ratio to 4 https://review.openstack.org/379618 | 01:18 |
*** bana_k has quit IRC | 01:18 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Add Mistral to the CI status https://review.openstack.org/379335 | 01:19 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Add TripleO scenarios jobs in status dashboard https://review.openstack.org/367324 | 01:19 |
openstackgerrit | Dan Sneddon proposed openstack/os-net-config: Modify os-net-config to make changes without bouncing interfaces. https://review.openstack.org/152732 | 01:28 |
openstackgerrit | Dan Sneddon proposed openstack/os-net-config: Modify os-net-config to make changes without bouncing interfaces. https://review.openstack.org/152732 | 01:29 |
*** fultonj has quit IRC | 01:30 | |
openstackgerrit | Merged openstack/diskimage-builder: Create (md5|sha256) checksum files for images https://review.openstack.org/380577 | 01:45 |
*** fzdarsky_ has joined #tripleo | 01:45 | |
*** fzdarsky|afk has quit IRC | 01:49 | |
*** mbozhenko has joined #tripleo | 02:03 | |
*** mbozhenko has quit IRC | 02:08 | |
EmilienM | ccamacho: ok | 02:12 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Add generic template for custom roles. https://review.openstack.org/381587 | 02:13 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: enable undercloud/ssl on multinode jobs https://review.openstack.org/382082 | 02:15 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 02:15 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/360004 | 02:15 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: DO NOT MERGE testing switch to Ocata DLRN instance https://review.openstack.org/382521 | 02:25 |
*** ramishra has quit IRC | 02:28 | |
*** ramishra has joined #tripleo | 02:28 | |
*** tiswanso has joined #tripleo | 02:40 | |
*** maticue has quit IRC | 02:55 | |
*** bana_k has joined #tripleo | 02:59 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: j2 template role config templates https://review.openstack.org/382276 | 03:02 |
*** mbozhenko has joined #tripleo | 03:02 | |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/360004 | 03:04 |
*** mbozhenko has quit IRC | 03:07 | |
openstackgerrit | Merged openstack/puppet-tripleo: Use service-specific servernames for haproxy https://review.openstack.org/382534 | 03:08 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Move the main template files for defalut services to new syntax generation https://review.openstack.org/382137 | 03:08 |
*** yamahata has quit IRC | 03:12 | |
*** bana_k has quit IRC | 03:16 | |
*** tiswanso has quit IRC | 03:30 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/os-collect-config: Updated from global requirements https://review.openstack.org/350905 | 03:31 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/375993 | 03:33 |
*** dtrainor has quit IRC | 03:33 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements https://review.openstack.org/375997 | 03:34 |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Port Scale Down Functionality into Workflow https://review.openstack.org/382707 | 03:35 |
openstackgerrit | Merged openstack/python-tripleoclient: Add optional overcloud deploy roles_data.yaml override https://review.openstack.org/382224 | 03:37 |
openstackgerrit | Merged openstack/tripleo-common: Remove references to overcloud-without-mergepy https://review.openstack.org/382486 | 03:37 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Add IPv6 network configuration for ipv6 job types https://review.openstack.org/363674 | 03:37 |
openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates: GATE TEST, please ignore https://review.openstack.org/365449 | 03:39 |
*** links has joined #tripleo | 03:47 | |
*** pmannidi has quit IRC | 03:48 | |
*** pmannidi has joined #tripleo | 03:50 | |
*** dsariel_ has quit IRC | 03:59 | |
openstackgerrit | Merged openstack/tripleo-quickstart: Add swap to the undercloud when using an overcloud image https://review.openstack.org/374809 | 04:09 |
*** jaosorior has joined #tripleo | 04:25 | |
*** pgadiya has joined #tripleo | 04:28 | |
*** rajinir has quit IRC | 04:35 | |
*** oshvartz has quit IRC | 04:36 | |
*** sudswas__ has joined #tripleo | 04:36 | |
*** sudipto has joined #tripleo | 04:36 | |
*** sudipto has quit IRC | 04:42 | |
*** sudswas__ has quit IRC | 04:42 | |
*** liverpooler has quit IRC | 04:45 | |
*** yamahata has joined #tripleo | 04:52 | |
*** pmannidi has quit IRC | 05:19 | |
*** jprovazn has joined #tripleo | 05:25 | |
*** mbozhenko has joined #tripleo | 05:30 | |
*** pmannidi has joined #tripleo | 05:35 | |
openstackgerrit | Merged openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/375993 | 05:36 |
openstackgerrit | Merged openstack/tripleo-common: Updated from global requirements https://review.openstack.org/375997 | 05:36 |
*** mbozhenk1 has joined #tripleo | 05:42 | |
*** dsariel_ has joined #tripleo | 05:43 | |
jaosorior | ccamacho: hey dude, can you check this out? https://review.openstack.org/#/c/382183/ | 05:43 |
*** bana_k has joined #tripleo | 05:44 | |
openstackgerrit | Julie Pichon proposed openstack/puppet-tripleo: Explicitly use Keystone v2 endpoint in the UI https://review.openstack.org/382724 | 05:44 |
*** mbozhenko has quit IRC | 05:44 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Only ask for the overcloud-full image https://review.openstack.org/363592 | 05:47 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Always configure ipv6 address with net-iso https://review.openstack.org/374922 | 05:53 |
*** mbozhenk1 has quit IRC | 05:55 | |
openstackgerrit | Merged openstack/instack-undercloud: correctly spell yaql_limit_iterators https://review.openstack.org/382056 | 05:55 |
*** jaosorior has quit IRC | 05:55 | |
*** oshvartz has joined #tripleo | 05:56 | |
*** bana_k has quit IRC | 05:56 | |
*** jaosorior has joined #tripleo | 05:57 | |
ccamacho | jaosorior morning man :) | 06:01 |
ccamacho | done | 06:01 |
jaosorior | ccamacho: thanks dude, how's it going? | 06:01 |
*** liverpooler has joined #tripleo | 06:02 | |
ccamacho | ahahah with this ga stuff.f.. | 06:02 |
jaosorior | haha know the feel | 06:02 |
*** bana_k has joined #tripleo | 06:02 | |
jaosorior | daaamn I need coffee | 06:02 |
ccamacho | all night trying to pass | 06:02 |
ccamacho | ci | 06:02 |
jaosorior | and it's getting pretty cold here in Finland | 06:02 |
ccamacho | :P | 06:02 |
ccamacho | dude you are ir the north pole | 06:02 |
ccamacho | what you want :P | 06:02 |
*** tzumainn has quit IRC | 06:02 | |
jaosorior | hahaha it's the south of Finland, it shouldn't be thaaaat bad | 06:03 |
jaosorior | ccamacho: hey dude, can you re-visit this patch https://review.openstack.org/#/c/366548/ ? There was a merge conflict and I lost all the votes there :/ | 06:03 |
ccamacho | jaosorior can you check https://review.openstack.org/#/c/381587/ and https://review.openstack.org/#/c/381593/ I need to finish to land them in order to push an additional fix | 06:04 |
ccamacho | sure dude | 06:04 |
jaosorior | ccamacho: of course, let me take a look | 06:05 |
ccamacho | jaosorior sorry for not having time for the tests on the TLS changes, Ill do them asap (I have already checked the blog post) | 06:06 |
jaosorior | ccamacho: is used anywhere yet? https://review.openstack.org/#/c/381587/14/puppet/role.role.j2.yaml | 06:06 |
ccamacho | not yet | 06:06 |
ccamacho | but depending on what lands first | 06:06 |
jaosorior | cause the output for role.role.j2.yaml will need an extra value | 06:07 |
ccamacho | will need a fix for https://review.openstack.org/#/c/378764/ | 06:07 |
ccamacho | yeahp | 06:07 |
ccamacho | I know :) | 06:07 |
*** liverpooler has quit IRC | 06:07 | |
jaosorior | ccamacho: ok, lets merge it (since it's not used yet) and that extra value can be added in a subsequent patch. | 06:07 |
*** liverpooler has joined #tripleo | 06:07 | |
ccamacho | cool | 06:08 |
ccamacho | Hopefully we will merge the backport and have them into ga | 06:08 |
ccamacho | jaosorior btw I already have created the patch here https://review.openstack.org/#/c/382217/ | 06:10 |
*** numans has joined #tripleo | 06:11 | |
ccamacho | I did that yesterday in the morning for not forgetting about it. | 06:11 |
jaosorior | I seee | 06:11 |
jaosorior | ccamacho: why not just put a depends-on? | 06:12 |
ccamacho | dude, I dont want to disturb the forces as was really painful to pass CI :P | 06:12 |
ccamacho | and because its not used yet | 06:13 |
ccamacho | yesterday stable/newton was broken | 06:13 |
ccamacho | but it will get merged today for sure :) | 06:14 |
ccamacho | yeeeeahh! | 06:14 |
* ccamacho going for coffee | 06:14 | |
*** rcernin has joined #tripleo | 06:15 | |
*** bana_k has quit IRC | 06:15 | |
jaosorior | haha nice | 06:16 |
jaosorior | ccamacho: why was stable/newton broken? | 06:16 |
ccamacho | let me get the fix | 06:18 |
ccamacho | jaosorior this https://review.openstack.org/#/c/382658/ | 06:18 |
ccamacho | after it got merged I have rechecked lot of stuck submissions | 06:18 |
*** bana_k has joined #tripleo | 06:18 | |
ccamacho | and they are all landed by now :) | 06:19 |
ccamacho | ccamacho | 06:20 |
*** mbozhenko has joined #tripleo | 06:20 | |
ccamacho | jaosorior and this was the error from the jobs 2016-10-05 19:34:52.681 30093 ERROR ironic_inspector.main Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-aa14d9ab-4154-4ed6-a478-3a833a29b263) | 06:20 |
*** rasca has joined #tripleo | 06:20 | |
openstackgerrit | Merged openstack/python-tripleoclient: Remove auth_required=False from upload image command https://review.openstack.org/382656 | 06:23 |
jaosorior | ccamacho: wow, that's funky | 06:25 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Add generic template for custom roles. https://review.openstack.org/382737 | 06:27 |
*** bana_k has quit IRC | 06:27 | |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-common: Add support to create role main template file based in role.role.j2.yaml https://review.openstack.org/382738 | 06:27 |
ccamacho | yeahh.. the weird stuff for me was that It was working before man.. | 06:28 |
ccamacho | and mast was working fine... | 06:28 |
ccamacho | s/mast/master/ | 06:29 |
*** ohamada has joined #tripleo | 06:29 | |
jaosorior | what the hell | 06:29 |
jaosorior | ccamacho: hey dude, any idea on why this failed to merge? https://review.openstack.org/#/c/381587/ | 06:30 |
ccamacho | mmm | 06:31 |
ccamacho | can we recheck it? | 06:31 |
ccamacho | the jobs were not failing | 06:32 |
*** pmannidi_ has joined #tripleo | 06:32 | |
jaosorior | lets try that | 06:32 |
*** pmannidi has quit IRC | 06:33 | |
ccamacho | brb | 06:34 |
*** ccamacho has quit IRC | 06:34 | |
*** kaslcrof has joined #tripleo | 06:40 | |
jaosorior | gfidente, shadower: Can you guys revisit https://review.openstack.org/#/c/366548/ ? There was a merge conflict and the commit lost all the votes :( | 06:40 |
*** dciabrin has joined #tripleo | 06:41 | |
*** athomas has joined #tripleo | 06:44 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Integrate node tagging workflow https://review.openstack.org/367562 | 06:45 |
*** masco has joined #tripleo | 06:46 | |
*** masco has quit IRC | 06:47 | |
*** masco has joined #tripleo | 06:48 | |
*** zoli_gone-proxy is now known as zoliXXL | 06:53 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Integrate node tagging workflow https://review.openstack.org/367562 | 06:55 |
*** cylopez has joined #tripleo | 07:01 | |
*** b00tcat has joined #tripleo | 07:04 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Adds Environment File for Removing Sahara during M/N upgrade https://review.openstack.org/382748 | 07:05 |
*** zoliXXL is now known as zoli_gone-proxy | 07:05 | |
*** jlinkes has joined #tripleo | 07:05 | |
*** aufi has joined #tripleo | 07:07 | |
*** abehl has joined #tripleo | 07:09 | |
*** amoralej|off is now known as amoralej | 07:10 | |
jtomasek | d0ugal: looking at https://review.openstack.org/#/c/382277/2 I still see the wrong behavior of the action - acting as a workflow: this is the response I am getting: http://paste.openstack.org/show/584617/ | 07:11 |
*** tesseract- has joined #tripleo | 07:11 | |
d0ugal | jtomasek: You probably don't have the depends-on :) | 07:11 |
d0ugal | (and the depends-on for the depends-on) | 07:11 |
jtomasek | d0ugal: aaha, cool, I probably did not wake up yet... | 07:12 |
d0ugal | jtomasek: one merged an hour ago, the other had +W, so should soon | 07:13 |
jtomasek | d0ugal: do you expect it to get to newton mistral? | 07:13 |
*** zoli_gone-proxy is now known as zoliXXL | 07:13 | |
d0ugal | jtomasek: no, I think it is too late to be backported :( | 07:14 |
jtomasek | d0ugal: ok | 07:14 |
*** jidar has quit IRC | 07:16 | |
*** jidar_ has joined #tripleo | 07:16 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Integrate node tagging workflow https://review.openstack.org/367562 | 07:17 |
*** jidar_ is now known as jidar | 07:17 | |
*** ebarrera has joined #tripleo | 07:22 | |
*** jpena|off is now known as jpena | 07:23 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Integrate node tagging workflow https://review.openstack.org/367562 | 07:24 |
*** pcaruana has joined #tripleo | 07:26 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 07:29 |
*** ccamacho_ has joined #tripleo | 07:32 | |
*** shardy_afk is now known as shardy | 07:34 | |
shardy | morning all! | 07:34 |
bandini | morning ;) | 07:34 |
ccamacho_ | morning! | 07:34 |
shardy | Can anyone check https://review.openstack.org/#/c/382480 please, passing CI, one line fix :) | 07:35 |
ccamacho_ | stable/newtow got unstuck yesterday about 1:30am CET+2 | 07:35 |
jaosorior | is something wrong in the gate? Several commits have passed all tests and haven't merged. They just seem stalled... | 07:35 |
ccamacho_ | really? | 07:35 |
ccamacho_ | ;( | 07:36 |
shardy | jaosorior: got a link? | 07:36 |
jaosorior | shardy: all the commits for the per-network hostnames | 07:36 |
jaosorior | shardy: http://status.openstack.org/zuul/ | 07:36 |
jaosorior | zuul has kept them there, all green, for a while now | 07:36 |
*** abregman_ has joined #tripleo | 07:37 | |
shardy | hmm | 07:37 |
jaosorior | yeah, pretty weird | 07:40 |
jaosorior | yolanda: you were working in infra, right? | 07:42 |
shardy | The top of the gate queue seems to be https://review.openstack.org/#/c/382273/ which has been gating for 1hr40 | 07:42 |
* shardy checks if we run the ovb jobs in the gate queue | 07:42 | |
jaosorior | shardy: I thought we weren't | 07:43 |
yolanda | hi jaosorior , i'm on infra yes | 07:44 |
*** jpich has joined #tripleo | 07:44 | |
jaosorior | yolanda: hi, I see several tripleo commits here http://status.openstack.org/zuul/ that have passed all tests in the gate, however, it's taking unusually long for them to get merged by zuul. Any idea what could be the issue? | 07:46 |
*** masco_ has joined #tripleo | 07:48 | |
shardy | jaosorior: I don't think they have passed all tests in the gate pipeline | 07:48 |
shardy | the top of the tripleo-ci gate queue is still running the nonha-multinode job | 07:48 |
shardy | it's just either stalled or taking much longer than normal | 07:48 |
jaosorior | shardy: but that is a stable/newton patch, unrelated to these ones | 07:48 |
*** zoliXXL is now known as zoli|afk | 07:49 | |
yolanda | so they way it works, is that these patches are queued. The latest in the queue won't be merged until the first one of the queue does | 07:50 |
yolanda | as soon as non-ha-multinode job finishes, the next ones will be merged in cascade | 07:51 |
jaosorior | yolanda: I see, so that happens regardless if they're on different branches? | 07:51 |
yolanda | yes, zuul is not considering branches at this point, it only looks for changes with similar jobs | 07:51 |
jaosorior | aah, I see | 07:51 |
*** masco has quit IRC | 07:51 | |
jaosorior | yolanda: thanks for the explanation and sorry for the spam | 07:51 |
shardy | that makes sense, given that e.g Depends-On isn't branch aware | 07:51 |
shardy | thanks yolanda ! :) | 07:52 |
yolanda | jaosorior, no problems, your concern was logic, and it's not the first time that people ask about it. Actually that should be a nice feature | 07:52 |
jaosorior | it sure would be :) | 07:52 |
ccamacho_ | good to hear this :P | 07:53 |
gfidente | tbarron hey thanks for trying out the manila change | 08:02 |
jaosorior | gfidente: thanks for vote dude | 08:05 |
*** hewbrocca-afk is now known as hewbrocca | 08:12 | |
d0ugal | jtomasek: it is going to be in Newton :-D | 08:15 |
jtomasek | d0ugal: cool! | 08:16 |
hewbrocca | Morning folks | 08:17 |
d0ugal | Morning! | 08:17 |
*** jaosorior is now known as jaosorior_lunch | 08:17 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add cloud names to hosts output https://review.openstack.org/382769 | 08:17 |
*** ccamacho_ has quit IRC | 08:19 | |
*** tremble has joined #tripleo | 08:20 | |
*** tremble has joined #tripleo | 08:20 | |
*** abregman__ has joined #tripleo | 08:21 | |
*** abregman_ has quit IRC | 08:25 | |
*** limao has joined #tripleo | 08:26 | |
*** dbecker has joined #tripleo | 08:27 | |
*** limao_ has joined #tripleo | 08:29 | |
snecklifter | Hello, basic doc change to help out people running tempest, thanks https://review.openstack.org/#/c/380954/ | 08:31 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Save the result of direct action calls in Mistral https://review.openstack.org/382775 | 08:32 |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-ui: Save the result of direct action calls in Mistral https://review.openstack.org/382776 | 08:32 |
*** limao has quit IRC | 08:32 | |
*** fzdarsky_ is now known as fzdarsky | 08:34 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: [WIP] Add IPv6 coverage using existing jobs https://review.openstack.org/382515 | 08:35 |
*** derekh has joined #tripleo | 08:38 | |
*** zoli|afk is now known as zoli|wfh | 08:42 | |
tbarron | gfidente: no problem, not sure what's going on there yet | 08:42 |
* tbarron starts his first coffee today | 08:43 | |
shardy | snecklifter: lgtm, thanks! | 08:44 |
snecklifter | shardy: thanks | 08:44 |
tbarron | gfidente: trying changes is **so** much less painful with the puppet artifacts upload! | 08:45 |
shardy | Gah, all the multinode jobs in the gate queue are timing out :( | 08:47 |
*** lhinds is now known as lhinds|away | 08:47 | |
*** masco__ has joined #tripleo | 08:48 | |
sshnaidm | derekh, hi | 08:48 |
derekh | sshnaidm: hi ya | 08:49 |
*** dtantsur|afk is now known as dtantsur | 08:49 | |
sshnaidm | derekh, maybe you know, what could I adjust to solve such errors? http://logs.openstack.org/94/381094/6/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/c004046/logs/undercloud/var/log/ironic/ironic-conductor.txt.gz#_2016-10-06_08_21_27_699 | 08:49 |
sshnaidm | derekh, is it flavor issue..? | 08:49 |
*** limao has joined #tripleo | 08:50 | |
derekh | sshnaidm: looking | 08:50 |
sshnaidm | derekh, it's my patch issue, not ci | 08:51 |
sshnaidm | derekh, trying to run quickstart there.. | 08:51 |
openstackgerrit | Merged openstack/puppet-tripleo: Enable usage of "short names" for Galera cluster https://review.openstack.org/382183 | 08:52 |
*** masco_ has quit IRC | 08:52 | |
shardy | Anyone know how I can connect to the ipv6 telnet console exposed via the zuul queue? | 08:52 |
*** limao_ has quit IRC | 08:52 | |
openstackgerrit | Merged openstack/tripleo-ui: Add image names to Nodes registration workflow https://review.openstack.org/381855 | 08:56 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Save the result of direct action calls in Mistral https://review.openstack.org/382775 | 08:56 |
therve | shardy, Well, I know that I can connect to it | 08:57 |
therve | shardy, I bet you don't have v6 connectivity? | 08:57 |
d0ugal | shardy: Yeah, you'll need to connect via something with ipv6 | 08:57 |
d0ugal | I also don't have ipv6 :( | 08:57 |
d0ugal | shardy: http://ipv6-test.com/ | 08:58 |
*** _milan_ has joined #tripleo | 08:59 | |
derekh | sshnaidm: I don't understand, the error message say "only 4865 MiB " but the overcloud nodes have 41G disks | 08:59 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Add image names to Nodes registration workflow https://review.openstack.org/382785 | 08:59 |
openstackgerrit | Julie Pichon proposed openstack/tripleo-ui: Add image names to Nodes registration workflow https://review.openstack.org/382785 | 08:59 |
jpich | jtomasek: Sorry!! | 09:00 |
jtomasek | jpich: lol! | 09:00 |
sshnaidm | derekh, yeah, it's confusing mee too | 09:00 |
jpich | jtomasek: :) | 09:00 |
jtomasek | jpich: what is the chance of doing that at totally same time :D | 09:01 |
jtomasek | shardy or anyone: I see only OvercloudControlFlavor and OvercloudComputeFlavor in heat validate output, I can't figure out why I don't see other role flavor parameters there or what I need to do to make that happen | 09:02 |
jpich | jtomasek: On RC day I guess slightly higher than usual! :) | 09:03 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 09:03 |
*** chem has joined #tripleo | 09:04 | |
dtantsur | hi owlers, could you please merge a trivial documentation addition? https://review.openstack.org/#/c/382524/ | 09:04 |
dtantsur | I'm really afraid of people getting hit by it | 09:04 |
jtomasek | jpich: it should be possible to cherry pick on top of other pending patch for subsequent patches (to maintain the order and avoid conflicts) using gerrit, right? | 09:05 |
sshnaidm | derekh, I'll run it again with saving instackenv.json. It's weird that it's not reproducing on local den env on rh1. | 09:05 |
*** abehl has quit IRC | 09:06 | |
shardy | therve, d0ugal: yeah ipv6 is the problem, my isp supports it, but I don't have it enabled on my local network | 09:06 |
derekh | sshnaidm: you have instackenv.json here http://logs.openstack.org/94/381094/6/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/c004046/console.html#_2016-10-06_07_38_45_868927 | 09:06 |
shardy | was wondering if folks had some other approach to access those consoles | 09:06 |
d0ugal | shardy: aha, my isp doesn't support it :( | 09:06 |
jpich | jtomasek: I think the automatic cherry-picking isn't that smart... Or maybe if you specify the commit number instead of a branch name? | 09:07 |
*** chem has quit IRC | 09:07 | |
sshnaidm | derekh, oh, right, thanks.. looks correct | 09:07 |
shardy | jtomasek: it's probably because the count is zero for all other roles | 09:07 |
*** chem has joined #tripleo | 09:07 | |
jpich | jtomasek: If you're busy finishing stuff I can do manual cherry-picking for stuff that needs to be backported in a series, just let me know which patches | 09:08 |
* derekh is now curious if he can get to IPv6 | 09:09 | |
shardy | jtomasek: https://review.openstack.org/#/c/374226/ would probably "fix" it for you, but the alternative is to pass *Count parameters to the validation so all roles are non-zero | 09:09 |
*** limao_ has joined #tripleo | 09:11 | |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/379547 | 09:12 |
jtomasek | shardy: interesting, thanks, and also quite cool:) since it technically allow user to configure role parameters only when that role is enabled | 09:12 |
jtomasek | (in GUI) | 09:13 |
snecklifter | hi folks, so cinder-backup is not configurable in Mitaka, am I correct? | 09:13 |
openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement overcloud upgrade job - Mitaka -> Newton https://review.openstack.org/323750 | 09:13 |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-docs: Recommend using only metadata cleaning with Ironic in virtual overcloud https://review.openstack.org/382524 | 09:13 |
*** karthiks has joined #tripleo | 09:13 | |
dtantsur | fixed a typo ^^^ | 09:13 |
*** limao has quit IRC | 09:14 | |
shardy | jtomasek: Yup - if that's desirable behavior tho please comment on the heat patch I just linked | 09:15 |
shardy | as that would change it to assume count=1 by default | 09:15 |
shardy | there are advantages to both approaches, but if folks will rely on the current behavior we probably can't change it | 09:15 |
shardy | the main disadvantage is we don't fully validate the tree of templates | 09:16 |
shardy | therve: ^^ FYI ref https://review.openstack.org/#/c/374226/ | 09:16 |
jtomasek | shardy: I don't have a strong opinion and probably favor the one which that patch brings | 09:16 |
jtomasek | shardy: because in general the best approach is allow user to add/enable roles as he wants (which means manipulate roles_data.yaml somehow from GUI) and if the role is enabled, he can configure it regardless of nodes count being set | 09:18 |
shardy | jtomasek: Yeah, I think for TripleO that's the right approach | 09:18 |
jtomasek | jpich: those are GUI patches that need to get reviewed and merged asap https://review.openstack.org/367562 (dependent tripleo-common one is almost merged), https://review.openstack.org/381845 | 09:20 |
*** egafford has quit IRC | 09:20 | |
*** tosky has joined #tripleo | 09:21 | |
*** abehl has joined #tripleo | 09:21 | |
*** pgadiya has quit IRC | 09:22 | |
openstackgerrit | Merged openstack/tripleo-common: Add support to create role main template file based in role.role.j2.yaml https://review.openstack.org/381593 | 09:26 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Fix OpendaylightApiNetwork key naming https://review.openstack.org/382480 | 09:26 |
derekh | sshnaidm: http://logs.openstack.org/94/381094/6/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/c004046/logs/undercloud/var/log/host_info.txt.gz | 09:28 |
derekh | sshnaidm: search for "df -h" | 09:28 |
jpich | jtomasek: Ok, will look and test a bit | 09:29 |
derekh | the undercloud node has only 6.5G available, possibly less when that failed, I'd see if you can free more space up | 09:29 |
jtomasek | jpich: thanks! | 09:30 |
derekh | sshnaidm: we free up some space here http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_gate_test.sh#n19 | 09:30 |
derekh | sshnaidm: you could try removing all of /opt/stack/cache I don't think we use anything in there after the zuul setup is done | 09:31 |
*** limao_ has quit IRC | 09:32 | |
*** pgadiya has joined #tripleo | 09:34 | |
*** jaosorior_lunch has quit IRC | 09:36 | |
sshnaidm | derekh, it doesn't exist when I start install undercloud | 09:36 |
*** jaosorior_lunch has joined #tripleo | 09:36 | |
*** limao has joined #tripleo | 09:37 | |
derekh | sshnaidm: you mean in your manual test? | 09:37 |
openstackgerrit | Merged openstack/tripleo-common: Support node untagging https://review.openstack.org/372628 | 09:38 |
sshnaidm | derekh, uh, yeah | 09:38 |
sshnaidm | derekh, forgot that zull installs it there | 09:38 |
sshnaidm | derekh, but ironic errors are related to ironic node, isn't it? | 09:39 |
*** saneax-_-|AFK is now known as saneax | 09:39 | |
*** mah has joined #tripleo | 09:40 | |
derekh | sshnaidm: I thought that at first but I'm starting to think it might be the undercloud its talking about | 09:40 |
mah | Hi all, I have shutdown my tripleo cluster. then powered them on again. but I can not connect to the undercloud VM and the instances do not get an IP. So what I you should do after rebooting the cluster ? | 09:41 |
*** jaosorior_lunch is now known as jaosorior | 09:44 | |
dtantsur | folks, shardy, EmilienM, I've got a potentially flame war blueprint for you: https://blueprints.launchpad.net/tripleo/+spec/re-enable-cleaning :) | 09:46 |
dtantsur | lucas-afk, FYI ^^ | 09:46 |
jaosorior | Hey guys, I'm seeing the following errors while trying to install the undercloud: | 09:46 |
jaosorior | 2016-10-06 08:25:04 - ESC[1;31mError: /Stage[main]/Tripleo::Profile::Base::Ui/Package[openstack-tripleo-ui]/ensure: change from absent to present failed: Execution of '/bin/yum -d 0 -e 0 -y install openstack-tripleo-ui' returned 1: Error downloading packages: | 09:46 |
jaosorior | 2016-10-06 08:25:04 - openstack-tripleo-ui-1.0.3-0.20160929175454.f7297c3.el7.centos.noarch: [Errno 256] No more mirrors to try.ESC[0m | 09:46 |
mah | Hi all, I have shutdown my tripleo cluster. then powered them on again. but I can not connect to the undercloud VM and the instances do not get an IP. So what I you should do after rebooting the cluster ? | 09:47 |
jpich | jaosorior: Only for that package? | 09:48 |
*** masco_ has joined #tripleo | 09:48 | |
jaosorior | jpich: that's the first one I saw | 09:49 |
jaosorior | jpich: nevermind, seems to be more packages | 09:49 |
jaosorior | jpich: same with mistral, same with heat packages | 09:49 |
*** mbozhenko has quit IRC | 09:49 | |
jpich | jaosorior: Beh. Hopefully a transient error? | 09:50 |
*** mbozhenko has joined #tripleo | 09:50 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart: Stop using deprecated network range https://review.openstack.org/343443 | 09:50 |
jaosorior | jpich: I'll try the deployment again, but it has happened twice in the last couple of hours | 09:50 |
jpich | jaosorior: That's concerning... | 09:51 |
*** masco__ has quit IRC | 09:52 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: j2 template per-role ServiceNetMapDefaults https://review.openstack.org/382273 | 09:52 |
jaosorior | jpich: tried again, same issue :( | 09:54 |
*** limao has quit IRC | 09:54 | |
*** limao has joined #tripleo | 09:54 | |
jpich | jaosorior: I'm not sure if this will help but, just in case it's actually that package causing a problem, can you try adding openstack-tripleo-ui to the list of included packages in /etc/yum.repos.d/delorean-current.repo? I've been meaning to update the docs for a while, CI already does that. I doubt it's causing the issue for peace of mind | 09:56 |
jpich | jaosorior: I'm setting up a new virt setup at the moment so I'll be trying soon as well | 09:56 |
jaosorior | jpich: well, I'm having issues with openstack-mistral-engine and even heat | 09:56 |
jaosorior | so I think it might be an issue with the RDO mirrors, asked there | 09:56 |
jpich | jaosorior: I'll be watching for replies too... can you access other URLs just fine from that env? | 09:58 |
jaosorior | jpich: I can | 09:58 |
*** mbozhenko has quit IRC | 10:06 | |
*** limao_ has joined #tripleo | 10:16 | |
*** ccamacho has joined #tripleo | 10:17 | |
marios | gfidente: are we goign to target https://bugs.launchpad.net/tripleo/+bug/1630777 for rc3? | 10:18 |
openstack | Launchpad bug 1630777 in tripleo "T-H-T manila cepfhs backend sets wrong cephfs_conf_path" [Undecided,In progress] - Assigned to Tom Barron (tpb) | 10:18 |
marios | gfidente: https://review.openstack.org/#/c/382671/1 lgtm | 10:18 |
*** akrivoka has joined #tripleo | 10:19 | |
*** mbozhenko has joined #tripleo | 10:19 | |
sshnaidm | does anybody know, what is default for heat::api::workers: ? | 10:19 |
*** limao has quit IRC | 10:20 | |
tbarron | marios: gfidente thanks for the reviews on https://review.openstack.org/#/c/382671/1 | 10:21 |
jpich | jaosorior: fwiw undercloud install worked for me, but I think you got your solution from the #rdo folks already anyway :) | 10:21 |
shardy | sshnaidm: https://github.com/openstack/heat/blob/master/heat/common/config.py#L88 | 10:21 |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart: Add ability to deploy an overcloud with ssl https://review.openstack.org/382830 | 10:21 |
shardy | the engine workers defaults to either 4 or the number of CPUs | 10:21 |
shardy | I think the API workers are just the number of CPUs | 10:21 |
tbarron | marios: gfidente if we can avoid having users complain/ask about that unconventional ceph config file path that would be great | 10:22 |
marios | tbarron: o/ sorry i was away for a few days - other that this review, are things OK with netapp/generic/ceph manila now? | 10:22 |
tbarron | marios: we have an outstanding issue for ceph deploy, see https://review.openstack.org/#/c/382386 | 10:23 |
sshnaidm | shardy, and we limit them to 1 here, right? https://github.com/openstack/tripleo-heat-templates/blob/master/environments/low-memory-usage.yaml | 10:23 |
marios | tbarron: thanks looking | 10:24 |
tbarron | marios: thank you | 10:24 |
shardy | sshnaidm: yup, we override the defaults for CI | 10:24 |
* tbarron doesn't understand puppet arrays and string joins | 10:25 | |
jaosorior | gchamoul: ping | 10:26 |
sshnaidm | shardy, each worker is a separate process, right? trying to understand why I have 6 processes of heat-engine on undercloud | 10:28 |
shardy | sshnaidm: there's a parent process then $workers forked workers | 10:28 |
shardy | so I'd expect to see a minimum of 5 heat-engine processes in ps aux | grep heat-engine | 10:29 |
shardy | depending on the hardware | 10:29 |
*** thrash|g0ne is now known as thrash | 10:29 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-common: Support node untagging https://review.openstack.org/382832 | 10:29 |
tbarron | marios: gfidente I can set topic on https://review.openstack.org/382671 to tripleo/rc3 if you guys agree | 10:30 |
shardy | sshnaidm: http://paste.openstack.org/show/584643/ | 10:30 |
sshnaidm | shardy, yeah, I have those: http://paste.openstack.org/show/584644/ | 10:31 |
gchamoul | jaosorior: pong | 10:31 |
sshnaidm | shardy, seems like settings didn't work? | 10:31 |
shardy | sshnaidm: those settings only control the overcloud deployment, not the undercloud | 10:32 |
marios | tbarron: sure i wanted just to get a feel for what is outstanding before proposing we rush it into rc3... if indeed it is those two (the path one and the enable_share_protocols, i think we can make the case.. thought that last one needs at least one more revision but almost there i think) | 10:32 |
sshnaidm | shardy, uh, sorry, confused it | 10:33 |
sshnaidm | shardy, so for limit them on undercloud I need configure it in undercloud.conf? | 10:34 |
shardy | sshnaidm: yeah, add a hieradata_override = foo.yaml to undercloud.conf | 10:34 |
shardy | the add the hieradata to control the workers in foo.yaml | 10:34 |
sshnaidm | shardy, it's possible also to configure them in the undercloud.conf itself, right? | 10:35 |
shardy | sshnaidm: Not as far as I'm aware | 10:35 |
tbarron | marios: ack, i'll wait on the label then but will propose stable/newton backports if I see these land in master | 10:35 |
tbarron | s/label/topic/ | 10:36 |
marios | tbarron: gonna quickly fixup the puppet-tripleo for the nits you point at there | 10:36 |
marios | gfidente: ^ | 10:36 |
*** limao_ has quit IRC | 10:36 | |
shardy | Note that for bugfixes we can backport them after rc3/GA and tag another newton release | 10:37 |
sshnaidm | shardy, do you know if we have any performance tests of tripleo deployments? like dependencies of memory, workers count, cpu, deploy time, etc ? | 10:37 |
*** limao has joined #tripleo | 10:37 | |
tbarron | marios: gfidente i've started a deploy with local changes that attempt that, can test again if you push a new patch too of course | 10:37 |
EmilienM | hi | 10:37 |
shardy | sshnaidm: Yes, rook has provided such data for scale testing in the past | 10:37 |
shardy | sshnaidm: I've also done some basic profiling of heat memory usage locally on a few occasions | 10:38 |
shardy | https://bugs.launchpad.net/heat/+bug/1626675 covers the most recent | 10:38 |
openstack | Launchpad bug 1626675 in heat "Further memory usage issues with big stacks" [Critical,In progress] - Assigned to Zane Bitter (zaneb) | 10:38 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge https://review.openstack.org/382839 | 10:40 |
sshnaidm | shardy, it'd be cool to have it running regularly with nice test matrix.. | 10:40 |
shardy | sshnaidm: Yeah I agree | 10:40 |
* cmyster clicks | 10:40 | |
sshnaidm | shardy, maybe on rdo infra | 10:41 |
shardy | we've been bitten repeatedly by memory usage regressions, and it would be great to catch them earlier | 10:41 |
openstackgerrit | Marios Andreou proposed openstack/puppet-tripleo: Set enabled_share_protocols based on enabled backends https://review.openstack.org/382386 | 10:41 |
openstackgerrit | Ryan Brady proposed openstack/python-tripleoclient: Use Password Generation in the Mistral workflows https://review.openstack.org/375544 | 10:41 |
cmyster | shardy: thing is, you need a system that runs for days to really check for those. | 10:41 |
marios | tbarron: ack thanks | 10:41 |
shardy | cmyster: for long term leaks, yes | 10:42 |
shardy | but right now we don't even catch when e.g some change in heat means we use an extra gigabyte of ram | 10:42 |
*** mburned_out is now known as mburned | 10:42 | |
cmyster | whats an extra gb... | 10:42 |
cmyster | anywho | 10:42 |
shardy | http://people.redhat.com/~shardy/heat/plots/heat_before_after_end_newton.png | 10:44 |
EmilienM | shardy: I'm afk ~3h from now fyi keep "recheck" on the backports | 10:44 |
shardy | cmyster: it's much worse than that, our heat memory usage quadrupled during Newton | 10:44 |
EmilienM | shardy: I'll prepare the release patch tonight and we'll proceed tomorrow I guess, i'll sync with doug | 10:44 |
shardy | Some fixes are landing which fix it tho | 10:44 |
cmyster | seen ^ bug | 10:44 |
cmyster | shardy: did anyone see it on rhel as well? is this rdo? | 10:45 |
shardy | EmilienM: ack, yup I'll try to get the remaining patches landed today so we can cut the release late today or early tomorrow | 10:45 |
EmilienM | chem, bandini, ccamacho, jaosorior, gfidente, marios, jpich, jtomasek: please make sure having tripleo/rc3 gerrit topic if needed and also do the cherry-picks | 10:45 |
ccamacho | EmilienM sure man thanks | 10:45 |
chem | EmilienM: ack | 10:45 |
*** dsariel_ has quit IRC | 10:46 | |
jaosorior | EmilienM: will do | 10:46 |
jpich | EmilienM: Yes, thank you | 10:47 |
jtomasek | EmilienM: ack | 10:47 |
rook | shardy sshnaidm we are working on something to do better tracking of this... However it still takes human eyes to identify the regression for what we are using, ie collectd->graphite->grafana. | 10:47 |
marios | EmilienM: ack ... tbarron i think the issues you report at https://review.openstack.org/#/c/382386/ are because indeed of the comments you made about the wrong hiera lookup. so they were in fact nill/undef. Once we see/hear that looks OK (v5) then I'd be happy to back that and https://review.openstack.org/#/c/382671/ for rc3 (the last one can go i think idependently right?) | 10:47 |
marios | gfidente: ^ | 10:47 |
rook | shardy sshnaidm - we are working to get this work added to CI, so they can use our playbooks to install collectd and point their agents at our hosts so we can monitor the system utilization. | 10:48 |
sshnaidm | rook, sure, do you have these statistics online that we can see it? | 10:48 |
rook | shardy sshnaidm this was a conversation I had this week, we move fast, but not that fast. | 10:48 |
tbarron | marios: gfidente EmilienM yes, those two reviews are independent of one another | 10:48 |
rook | sshnaidm shardy right now CI has a dstat running where you can get some information. | 10:48 |
sshnaidm | rook, thanks, good to know it will be :) | 10:48 |
sshnaidm | rook, yeah, although it requires an additional parsing | 10:49 |
rook | sshnaidm shardy however that just gets us system stats... I am also interestd in the time it takes for different deployments. | 10:49 |
shardy | rook: ack, yeah would be good to keep discussing so we can hopefully reuse a common approach | 10:49 |
rook | sshnaidm: correct. | 10:49 |
shardy | there's been similar discussion around how we might wire in tests to the heat/tripleo gates | 10:49 |
*** masco__ has joined #tripleo | 10:49 | |
rook | sshnaidm shardy so there is another effort within browbeat to add a lib for tripleo to allow us to get better metrics on time for deployements, time for scale along with tracking system utilization. | 10:49 |
shardy | e.g actually do something with the dstat data and/or have a load test for heat which fails if memory usage goes up | 10:49 |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Change README.rst to point to the full docs https://review.openstack.org/382842 | 10:50 |
rook | the idea is two fold shardy sshnaidm --- how does scaling impact tripleo, and how does adding addtional resources to the overcloud impact the overcloud... | 10:50 |
sshnaidm | rook, we already have metrics inside ci scripts, it sends them to dprince grafana | 10:50 |
rook | sweet, where? | 10:50 |
shardy | That's only time though I think | 10:50 |
shardy | https://23.253.94.71/ | 10:51 |
shardy | rook: ^^ | 10:51 |
rook | oh, that is a graphite host | 10:51 |
sshnaidm | rook, https://23.253.94.71/dashboard/#temporary-3 | 10:51 |
sshnaidm | rook, yeah, graphite, not grafana | 10:52 |
rook | total in seconds? | 10:52 |
rook | sshnaidm: so what deployment is this showing? 3 control N number of computes? | 10:52 |
marios | EmilienM: tbarron i added the https://review.openstack.org/#/c/382671/1 to rc3 easy enough fix imo | 10:52 |
*** masco_ has quit IRC | 10:53 | |
tbarron | marios: thx, yeah can't get any easier :) | 10:53 |
EmilienM | marios: why don't you approve it? | 10:53 |
sshnaidm | rook, I suspect it mix of ha and nonha jobs | 10:53 |
marios | EmilienM: ack i was just checking in case we needed to discuss an exception etc | 10:54 |
rook | sshnaidm ok -- might want to have different graphs per the deployment. | 10:54 |
rook | sshnaidm I am interested in not just control/computes, how does ceph impact the deployment,etc. | 10:54 |
rook | all things we are looking into... but need to automate better. | 10:54 |
marios | EmilienM: tbarron thanks +a that one so now just https://review.openstack.org/#/c/382386/5 ... if you get clean run with that maybe we can land today tbarron | 10:54 |
rook | shardy speaking of things to look into :) | 10:54 |
rook | shardy did that blog post ever see the light of day? :P | 10:55 |
shardy | rook: the custom roles one? | 10:55 |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Add devmode.sh to wrap full-deploy.sh https://review.openstack.org/382845 | 10:55 |
rook | yessir | 10:55 |
tbarron | marios: yup, will test | 10:55 |
EmilienM | marios: can you cherry-pick it now the patch you just +A? so I can approve it too | 10:55 |
shardy | I'm writing it right now - we had a bunch of bugs that needed fixing (last couple of patches are gating now) | 10:55 |
marios | EmilienM: ack | 10:55 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Set proper ceph config path for manila https://review.openstack.org/382846 | 10:55 |
rook | all good shardy just giving you a hard time. | 10:55 |
shardy | rook: should be posted later today, I just didn't want to post something with a bunch of workarounds or pending patches | 10:55 |
marios | EmilienM: https://review.openstack.org/#/c/382846/ | 10:55 |
shardy | rook: hehe, no worries | 10:56 |
rook | shardy tip of the spear. | 10:56 |
EmilienM | marios: thx, approved | 10:56 |
shardy | tripleo-docs patch should be ready next week | 10:56 |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Document Third Party CI and devmode.sh https://review.openstack.org/360007 | 10:56 |
marios | EmilienM: thanks | 10:56 |
rook | sshnaidm are you developing anything for testing OOO? | 10:56 |
rook | sshnaidm if so, we should look to converge on what each of us are doing | 10:57 |
rook | or planning to do :) | 10:57 |
sshnaidm | rook, hmm.. I'm usually suffering from perf. issues in testing ooo :)) | 10:57 |
rook | lol | 10:57 |
rook | in what regard? | 10:57 |
rook | testing in VMs | 10:57 |
*** limao has quit IRC | 10:58 | |
sshnaidm | rook, yeah, memory shortage there | 10:58 |
openstackgerrit | Martin Mágr proposed openstack/puppet-tripleo: Deploy monitoring/logging agents sooner https://review.openstack.org/381604 | 10:58 |
sshnaidm | rook, I think we can look where can I help with that | 10:58 |
*** limao has joined #tripleo | 10:58 | |
sshnaidm | rook, if you will tell about what is planned and so | 10:58 |
rook | sshnaidm it was my understanding that Newton was going to help with the memory consumption, i haven't looked in much detail here yet. | 10:59 |
rook | I am going to do a scale deployment with newton today | 10:59 |
shardy | rook: we fixed a bunch of issues, then reintroduced new ones late in the cycle :( | 10:59 |
sshnaidm | rook, I think it became worse, correct me if I'm wrong | 10:59 |
shardy | rook: currently under investigation ref https://bugs.launchpad.net/heat/+bug/1626675 | 11:00 |
openstack | Launchpad bug 1626675 in heat "Further memory usage issues with big stacks" [Critical,In progress] - Assigned to Zane Bitter (zaneb) | 11:00 |
rook | sshnaidm yeah, I know CI saw some increased mem usage | 11:00 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Adds Environment File for Removing Sahara during M/N upgrade https://review.openstack.org/382748 | 11:00 |
rook | it is much easier to see the mem issue in VMs then baremetal | 11:00 |
rook | as you have a much lower ceiling | 11:00 |
*** shardy is now known as shardy_lunch | 11:01 | |
*** pkovar has joined #tripleo | 11:01 | |
sshnaidm | rook, which infra do you use for tests? | 11:02 |
rook | :) | 11:02 |
rook | all baremetal | 11:02 |
rook | sshnaidm: are you a RH Employee? | 11:02 |
sshnaidm | rook, yep | 11:02 |
rook | sshnaidm so i lead the team doing Performance and Scale within Red Hat. | 11:03 |
rook | sshnaidm so we have a bunch of gear :) | 11:03 |
rook | sshnaidm we are in RDU if you are local :) | 11:03 |
sshnaidm | rook, cool! I know rdu, but not local :) I think this question could be discussed in internal net channels then | 11:04 |
*** d0ugal has quit IRC | 11:05 | |
*** d0ugal has joined #tripleo | 11:06 | |
*** Lokesh_Jain has quit IRC | 11:14 | |
*** jpena is now known as jpena|lunch | 11:14 | |
*** rhallisey has joined #tripleo | 11:16 | |
*** Lokesh_Jain has joined #tripleo | 11:17 | |
*** limao has quit IRC | 11:19 | |
*** limao has joined #tripleo | 11:19 | |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Port Scale Down Functionality into Workflow https://review.openstack.org/382707 | 11:24 |
*** shardy_lunch is now known as shardy | 11:31 | |
shardy | https://review.openstack.org/#/c/382430/ needs another reviewer if anyone has a moment | 11:33 |
*** dprince has joined #tripleo | 11:39 | |
*** limao has quit IRC | 11:40 | |
*** limao has joined #tripleo | 11:41 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 11:41 |
openstackgerrit | Julie Pichon proposed openstack/puppet-tripleo: Update websocket service name in config template https://review.openstack.org/382875 | 11:49 |
*** masco_ has joined #tripleo | 11:50 | |
*** masco__ has quit IRC | 11:54 | |
*** bfournie has quit IRC | 11:55 | |
openstackgerrit | Merged openstack/puppet-tripleo: Enable usage of "short names" for Ceph cluster https://review.openstack.org/382408 | 11:55 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Select per-network hostnames for service_node_names https://review.openstack.org/378764 | 11:56 |
marios | pradk: hey https://review.openstack.org/#/c/360004/22 added another comment... do we need to redeclare apache here at all? | 11:57 |
marios | chem: ^ | 11:57 |
pradk | marios, thats what i'm trying to confirm | 11:59 |
pradk | marios, rerunning the update without it to see | 11:59 |
panda | jaosorior: do you have a few minutes to mentor me over SSL + net-iso ? | 12:00 |
jaosorior | panda: what's up? | 12:00 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable usage of "short names" for Galera cluster https://review.openstack.org/382883 | 12:01 |
panda | jaosorior: apparently I have to create the new certificate specifying (probably) the IP we use in net-iso as CN | 12:01 |
*** limao has quit IRC | 12:01 | |
jaosorior | panda: that's correct. | 12:01 |
panda | jaosorior: http://logs.openstack.org/15/382515/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/954a5d5/console.html#_2016-10-06_10_09_30_896913 | 12:02 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable usage of "short names" for Ceph cluster https://review.openstack.org/382885 | 12:02 |
*** limao has joined #tripleo | 12:02 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Select per-network hostnames for service_node_names https://review.openstack.org/382886 | 12:02 |
jaosorior | panda: yeah, that is expected. | 12:03 |
*** trown|outtypewww is now known as trown | 12:03 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 12:03 |
jaosorior | so you need to do two things: You need to set up the IP address to be predictable (we do that for the nonha job), and you need a new cert, with that IP as the CN | 12:03 |
marios | pradk: thanks... i think we should be good with just the include ::ceilometer::wsgi::apache like at https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/ceilometer/api.pp#L33 for example... and all the wsgi apache services are the same afaics and we just include apache in one place at https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/ui.pp#L22 | 12:04 |
*** rbrady-afk is now known as rbrady | 12:05 | |
*** jayg|g0n3 is now known as jayg | 12:05 | |
panda | jaosorior: so I have to create a certificate request with tha CN, and sign it with the CA key in inject-trust-anchor.yaml ? | 12:06 |
panda | jaosorior: I think net-iso is using fixed IPs in the environment | 12:06 |
pradk | marios, just include wont work due to servername issue | 12:06 |
panda | jaosorior: also, I may need to change the ControlFixedIp on enable-tls.yaml, right ? | 12:06 |
jaosorior | panda: so, inject-trust-anchor.yaml doesn't have a CA key. It's only the cert | 12:07 |
*** limao has quit IRC | 12:07 | |
jaosorior | we don't need to pass around keys for the CA | 12:07 |
*** lucas-afk is now known as lucasagomes | 12:07 | |
pradk | jaosorior, may be you have some thoughts on https://review.openstack.org/#/c/365585/ .. this is causing issues during upgrades as the fqdn_inertnal_ip return nil in hiera | 12:07 |
*** limao has joined #tripleo | 12:07 | |
marios | pradk: yeah even just declaring class { '::ceilometer::wsgi::apache then | 12:07 |
jaosorior | pradk: any idea why it's returning nil? we should have that available | 12:08 |
*** mburned is now known as mburned_out | 12:09 | |
panda | jaosorior: I wanted to add a enable-tls-netiso.yaml with the keyfor the netiso IP, dont' I need to sign that cert with CA key ? | 12:09 |
jaosorior | panda: yes, if you don't, the undercloud won't trust the certificate that the overcloud offers and will return SSL errors | 12:10 |
panda | jaosorior: ok, so where can I find the CA key ? | 12:11 |
*** jpena|lunch is now known as jpena | 12:11 | |
panda | jaosorior: or should I request someone to make a certificate for me ? | 12:11 |
*** tzumainn has joined #tripleo | 12:11 | |
jaosorior | panda: the CA is just a self signed certificate. We don't use anything fancy for CI | 12:12 |
*** mburned_out is now known as mburned | 12:12 | |
*** limao_ has joined #tripleo | 12:13 | |
*** abregman__ is now known as abregman | 12:13 | |
jaosorior | panda: you can use this if you need http://galeracluster.com/documentation-webpages/sslcert.html | 12:13 |
pradk | jaosorior, not sure, does this need corresponding puppet-tripleo change to get that value? or is this directly from facter | 12:14 |
jaosorior | pradk: there is a puppet-tripleo change. I thought it had been there for a while though | 12:14 |
jaosorior | let me check | 12:14 |
pradk | jaosorior, in newton, but not mitaka.. during pre upgrade step the puppet-tripleo is still mitaka | 12:14 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Integrate node tagging workflow https://review.openstack.org/367562 | 12:14 |
jaosorior | pradk: you are correct :/ | 12:15 |
pradk | jaosorior, this causes apache to fail with syntax error.. as servername is nil and httpd conf file for service is missing that :( | 12:15 |
jaosorior | pradk: well, if you're doing pre-upgrade, you don't necessarily need the correct values for the servername. As I mentioned the other day, those are not used yet since we are using IPs for everything | 12:15 |
jaosorior | pradk: this is why I told you we could hardcode $::hostname in that manifest | 12:16 |
*** limao has quit IRC | 12:16 | |
pradk | jaosorior, right but we need to do that for a aodh,gnocchi and keystone and repopulate with all the releavnt params again | 12:16 |
panda | jaosorior: so you're suggesting to not use the same CA cert and key used for the ssl/nonha certificate we're currently using, just make another CA cert and key, create the ssl/nonha/netiso certificate with that and add the inject-trust-anchor-netiso.yaml and enable-tls-netiso.yaml to test-environments | 12:16 |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/379547 | 12:17 |
pradk | jaosorior, just doing include *::wsgi::apache would leverage existing hiera .. | 12:17 |
pradk | which we cant now | 12:17 |
jaosorior | panda: pretty much. Unfortunately the key wasn't included for the CA that's used in the nonha job... so we can't sign another certificate with that one :/ | 12:19 |
panda | jaosorior: ok, I'll proceed then, maybe I'll ask bnemc if he saved the CA key somewhere, so we don't have to distribute two CA eventually | 12:20 |
panda | jaosorior: thanks. | 12:20 |
*** dsariel_ has joined #tripleo | 12:21 | |
*** mbozhenk1 has joined #tripleo | 12:23 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Deployment states optimization https://review.openstack.org/381845 | 12:25 |
openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient: Add ReNo support https://review.openstack.org/382046 | 12:25 |
*** maticue has joined #tripleo | 12:25 | |
*** mbozhenko has quit IRC | 12:26 | |
*** mbozhenk1 has quit IRC | 12:27 | |
*** mbozhenko has joined #tripleo | 12:28 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Set proper ceph config path for manila https://review.openstack.org/382671 | 12:31 |
*** bfournie has joined #tripleo | 12:32 | |
*** limao_ has quit IRC | 12:33 | |
openstackgerrit | Merged openstack/python-tripleoclient: Do not use selinux-permissive for the CentOS image https://review.openstack.org/360097 | 12:34 |
*** mbozhenk1 has joined #tripleo | 12:34 | |
*** limao has joined #tripleo | 12:34 | |
openstackgerrit | Merged openstack/tripleo-common: Add support to create role main template file based in role.role.j2.yaml https://review.openstack.org/382738 | 12:34 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Add generic template for custom roles. https://review.openstack.org/381587 | 12:34 |
openstackgerrit | Merged openstack/tripleo-heat-templates: restore missing fluentd client functionality https://review.openstack.org/382430 | 12:34 |
*** mbozhenko has quit IRC | 12:35 | |
EmilienM | tbarron: can you cherry-pick https://review.openstack.org/#/c/382671/ please? | 12:36 |
EmilienM | gfidente: do we need https://review.openstack.org/#/c/360097/ into newton? | 12:36 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Set proper ceph config path for manila https://review.openstack.org/382846 | 12:36 |
EmilienM | ccamacho: can you backport https://review.openstack.org/#/c/381587/ please? | 12:37 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-common: Add the J2 exclude file exception (When file not found) https://review.openstack.org/382911 | 12:37 |
EmilienM | larsks: can you backport https://review.openstack.org/#/c/382430/ please? | 12:37 |
*** fultonj has joined #tripleo | 12:37 | |
ccamacho | EmilienM sure https://review.openstack.org/#/c/382737/ waiting for the merge | 12:37 |
EmilienM | ccamacho: excellent thanks | 12:38 |
ccamacho | EmilienM im keeping the log for all the submissions related to the pending work for the composable roles (with the backports) | 12:38 |
*** jcoufal has joined #tripleo | 12:40 | |
openstackgerrit | Merged openstack/tripleo-quickstart: Change README.rst to point to the full docs https://review.openstack.org/382842 | 12:41 |
*** jaosorior has quit IRC | 12:41 | |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Add Select per-network hostnames for service_node_names to role.role.j2.yaml https://review.openstack.org/382217 | 12:42 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Add Select per-network hostnames for service_node_names to role.role.j2.yaml https://review.openstack.org/382217 | 12:43 |
*** jeckersb_gone is now known as jeckersb | 12:44 | |
*** dsavineau has joined #tripleo | 12:47 | |
EmilienM | ccamacho: ok | 12:48 |
*** morazi has joined #tripleo | 12:48 | |
gfidente | marios https://review.openstack.org/#/c/382386/4..5/manifests/profile/base/manila/api.pp | 12:49 |
gfidente | I wanted the heat hiera there | 12:50 |
gfidente | built after the service_name parameter | 12:50 |
*** links has quit IRC | 12:50 | |
*** masco__ has joined #tripleo | 12:50 | |
*** tiswanso has joined #tripleo | 12:50 | |
*** tiswanso has quit IRC | 12:50 | |
*** tiswanso has joined #tripleo | 12:51 | |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Add the KeystoneCredential0 and KeystoneCredential1 parameters https://review.openstack.org/381169 | 12:54 |
*** masco_ has quit IRC | 12:54 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: [WIP] Add IPv6 coverage using existing jobs https://review.openstack.org/382515 | 12:54 |
*** limao has quit IRC | 12:54 | |
*** morazi has quit IRC | 12:54 | |
marios | gfidente: yes like https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/manila-backend-netapp.yaml#L91 | 12:55 |
marios | gfidente: not sure what the questino is tho | 12:55 |
*** limao has joined #tripleo | 12:55 | |
*** liverpooler has quit IRC | 12:56 | |
EmilienM | gfidente: can you reply to my question please? | 12:56 |
tbarron | marios: gfidente patch set 5 worked deploying ceph + netapp http://paste.fedoraproject.org/444820/14757585/ | 12:57 |
EmilienM | gfidente: same question for https://review.openstack.org/#/c/382671/ | 12:57 |
EmilienM | tbarron: ^ | 12:57 |
larsks | EmilienM, sure; backport to stable/newton, yes? | 12:57 |
tbarron | marios: gfidente i'll try the singular cases yest | 12:57 |
EmilienM | larsks: yes; | 12:57 |
EmilienM | I'm about to release rc3 very shortly I suggest people to submit the backports asap | 12:58 |
marios | tbarron: cool | 12:58 |
gfidente | tbarron so can you see the output of | 12:58 |
gfidente | hiera manila_backend_generic_enabled | 12:58 |
*** Goneri has joined #tripleo | 12:58 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 12:58 |
gfidente | heat is supposed to generate ${service_name}_enabled for each role enabled | 12:59 |
tbarron | gfidente: where do i look? heat logs? | 12:59 |
gfidente | no on a controller | 13:00 |
gfidente | as root | 13:00 |
gfidente | just give that command | 13:00 |
*** jtomasek_ has joined #tripleo | 13:00 | |
tbarron | gfidente: sec | 13:00 |
openstackgerrit | Merged openstack/instack-undercloud: Pin beaker due to ruby requirement https://review.openstack.org/382686 | 13:01 |
*** pkovar has quit IRC | 13:01 | |
jrist | jtomasek: https://blueprints.launchpad.net/tripleo-ui/+spec/deployment-progress is this taken care of by your progress/deployment detail work? | 13:01 |
*** akuznetsov has joined #tripleo | 13:01 | |
jtomasek | jrist: nope | 13:02 |
tbarron | gfidente: output is: nil with the current deployment, which just deployed cephfs and netapp | 13:02 |
gfidente | EmilienM https://review.openstack.org/#/c/382671/ went in newton already | 13:02 |
*** oshvartz has quit IRC | 13:03 | |
*** [1]cdearborn has joined #tripleo | 13:03 | |
tbarron | gfidente: output for: hiera manila_backend_netapp_enabled is true | 13:03 |
EmilienM | gfidente: ok, I missed it. And https://review.openstack.org/#/c/360097/ ? | 13:03 |
gfidente | tbarron yet you don't have CEPHFS amongst the protocols | 13:03 |
marios | gfidente: ah i see so you mean you expect them to be available from some other mechanism not what we pass ?( y u no speak to me faidentee just cos i told you to shutup a few times i means srsly some poeople!) | 13:03 |
tbarron | gfidente: oh, you are right!!! | 13:04 |
gfidente | tbarron yeah you don't have CEPHFS anyway | 13:04 |
tbarron | gfidente: wtf!! | 13:04 |
gfidente | sec guys | 13:04 |
tbarron | gfidente: same issue | 13:04 |
gfidente | I think we had to fix the delete_undef_below | 13:04 |
*** ayoung has joined #tripleo | 13:04 | |
gfidente | yeah give me a sec to update | 13:04 |
sshnaidm | do we still need "ironic::drivers::deploy::http_port: 3816" in hiera override? I don't see it's applied, do I miss something? | 13:04 |
marios | gfidente: i.e. you expect hiera('manila_backend_generic_enabled', false) as well as hiera('manila_generic_enable_backend', false) to be a thing? | 13:04 |
marios | gfidente: also, shutup | 13:04 |
* tbarron suffers from wishful thinking sometimes | 13:04 | |
gfidente | marios it's just a generic thing in the templates | 13:05 |
gfidente | works for any role like that | 13:05 |
*** links has joined #tripleo | 13:05 | |
EmilienM | ayoung: now https://review.openstack.org/#/c/371247/ has landed, do you plan to do the tripleoclient/tripleo-common/tht work to enable fernets? | 13:05 |
gfidente | EmilienM the puppet-tripleoclient one | 13:05 |
ayoung | EmilienM, yep | 13:05 |
gfidente | I think it'd be a nice to have yes, but it wasn't a bug | 13:05 |
ayoung | EmilienM, was on the task list for today | 13:05 |
EmilienM | ayoung: cool :) | 13:05 |
EmilienM | gfidente: ok, so no | 13:05 |
marios | gfidente: right i see... well why is it still nil on tbarron env perhaps didn't land into his env tht yet? | 13:06 |
marios | gfidente: but we _dO_ definitely set the ones on v5 in the tht right now, so we could leave as is and revise later? | 13:06 |
gfidente | marios it only sets to :true | 13:06 |
gfidente | when the role is enabled | 13:06 |
gfidente | so generic was nil because he was using netapp/cephfs as intended | 13:07 |
tbarron | gfidente: marios and for completeness: hiera manila_backend_cephfs_enabled is indeed true in that deploy | 13:07 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Deployment states optimization https://review.openstack.org/381845 | 13:07 |
gfidente | yeah let me revert that so we refer to the generic mechanism | 13:07 |
gfidente | I think the issue is in the delete_undef | 13:07 |
marios | tbarron: ah great so it *does* work there then? | 13:07 |
*** morazi has joined #tripleo | 13:08 | |
tbarron | marios: no, in manila.conf: 'enabled_share_protocols = NFS,CIFS' | 13:08 |
tbarron | marios: 'CEPHFS' is missing despite being enabled | 13:08 |
openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Set enabled_share_protocols based on enabled backends https://review.openstack.org/382386 | 13:09 |
tbarron | marios: i guess i was wrong though about the tests for what is enabled, gfidente's way for that works | 13:09 |
openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates: Fix OpendaylightApiNetwork key naming https://review.openstack.org/382926 | 13:09 |
gfidente | marios tbarron ^^ unless of syntax errors | 13:09 |
gfidente | I think the problem is puppet module expects a string with comma | 13:09 |
tbarron | gfidente: marios i'll pick it up and see | 13:10 |
*** panda is now known as panda|afk | 13:10 | |
EmilienM | larsks: do you have merge conflict? | 13:10 |
larsks | EmilienM, doesn't look like it. | 13:10 |
openstackgerrit | Dan Prince proposed openstack/python-tripleoclient: Revert "Clear the old environment in rc file" https://review.openstack.org/382928 | 13:11 |
gfidente | EmilienM this guy worries me a little https://review.openstack.org/#/c/382131/ | 13:11 |
EmilienM | larsks: ok, I was wondering if you had it, because I don't see the backport | 13:11 |
gfidente | which we want in newton | 13:11 |
EmilienM | larsks: you just need to click on Gerrit 'Cherry-pick' fyi | 13:11 |
EmilienM | gfidente: looking | 13:11 |
larsks | EmilienM, that is because you just asked me two minutes ago, and I have not yet gotten to it :) | 13:11 |
EmilienM | ah ok np | 13:11 |
larsks | Just catching up on a few other things first. | 13:12 |
gfidente | EmilienM this is the tht part https://review.openstack.org/#/c/382132/ | 13:12 |
EmilienM | larsks: ok. Sorry for pushing, trying to release rc3 on time | 13:12 |
dprince | gfidente: next time I guess I'll use a -2 :/ https://review.openstack.org/#/c/347553/ | 13:12 |
larsks | EmilienM, let me go do that right now, then. | 13:12 |
dprince | gfidente: https://bugs.launchpad.net/tripleo/+bug/1630993 | 13:12 |
openstack | Launchpad bug 1630993 in tripleo "source'ing overcloudrc unsets any external OS_ variables and breaks some environments" [Critical,In progress] - Assigned to Dan Prince (dan-prince) | 13:12 |
openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: restore missing fluentd client functionality https://review.openstack.org/382930 | 13:12 |
dprince | gfidente: unsetting OS_ variables is just bad practice I think | 13:12 |
*** b00tcat has quit IRC | 13:12 | |
EmilienM | larsks: thx. Approving now. | 13:13 |
marios | gfidente: ack thanks | 13:13 |
gfidente | dprince: (also) ack thanks | 13:13 |
EmilienM | gfidente: do you need me to resolve a conflict? | 13:13 |
gfidente | dprince I think I didn't see the implications there | 13:13 |
EmilienM | gfidente: wrt puppet ceph | 13:13 |
*** tiswanso has quit IRC | 13:14 | |
dprince | gfidente: its okay. I had a -1 on it, sometimes people take -2's the wrong way.... | 13:14 |
dprince | gfidente: when actually I just wanted a sticky -1 that doesn't go away | 13:14 |
gfidente | dprince yeah I only saw that now | 13:14 |
EmilienM | dprince: I don't think -2 is wrong when discussion is required before a patch to land | 13:15 |
gfidente | I think the patch was updated and the -1 went away | 13:15 |
dprince | EmilienM: people often perceive the -2 as harsh, that is all I think | 13:15 |
EmilienM | yes, which is the main diff with a -2 | 13:15 |
EmilienM | the -2 doesn't go away | 13:15 |
EmilienM | dprince: yeah, I agree. Though it's not harshing | 13:15 |
*** limao has quit IRC | 13:16 | |
EmilienM | it's just a strong opinion of making sure the patch doesn't land before we find an agreement | 13:16 |
gfidente | EmilienM which conflict | 13:16 |
gfidente | ? | 13:16 |
*** nyechiel_ has quit IRC | 13:16 | |
gfidente | https://review.openstack.org/#/c/382131/ looks good to me | 13:16 |
EmilienM | gfidente: puppet-ceph patch, you're worried. Is it fine? | 13:16 |
shardy | I think -2 is often percieved as hostile, so FWIW I always prefer to use -1 when there's some possibility a patch could be reworked into something acceptable | 13:16 |
*** limao has joined #tripleo | 13:16 | |
EmilienM | gfidente: ok I'll -2 it :P | 13:16 |
shardy | but I agree a sticky -1 would be useful, -1.5 :) | 13:16 |
dprince | gfidente: do you mind if I fast track revert that and we can re-propose to debate it | 13:17 |
EmilienM | I agree it's hard to -2, you feel like the bad guy | 13:17 |
*** nyechiel_ has joined #tripleo | 13:17 | |
gfidente | fwiw, not to me guys | 13:18 |
EmilienM | gfidente: why do you pass an array here ? https://review.openstack.org/#/c/382131/7/manifests/params.pp | 13:18 |
EmilienM | I don't get it | 13:18 |
gfidente | I always said I need the -1s and -2s | 13:18 |
gfidente | what's gerrit for otherwise | 13:18 |
EmilienM | gfidente: you can still give an array in hiera, no need to set default to an array, right? | 13:18 |
gfidente | dprince yes revert is good | 13:19 |
*** lblanchard has joined #tripleo | 13:19 | |
gfidente | not sure if there is a mechanism to re-use the pre-existing change-id to refresh the old submission then | 13:19 |
*** tiswanso has joined #tripleo | 13:20 | |
gfidente | EmilienM I think it needs to be an array for Package { $packages } to parse it correctly, not comma separated | 13:20 |
gfidente | so I kinda 'suggested' that in the default | 13:20 |
EmilienM | ok but it's not required | 13:20 |
EmilienM | I'm fine with it fwiw | 13:21 |
gfidente | it's not required in the default value which is only 1 item no | 13:21 |
EmilienM | gfidente: +2 | 13:21 |
gfidente | tks! | 13:21 |
EmilienM | gfidente: please add tripleo/rc3 gerrit topic to puppet-ceph patches | 13:21 |
EmilienM | gfidente: I need to know when to release puppet-ceph again | 13:21 |
EmilienM | for our newton release | 13:21 |
openstackgerrit | Merged openstack/tripleo-ui: Add image names to Nodes registration workflow https://review.openstack.org/382785 | 13:21 |
*** pkovar has joined #tripleo | 13:23 | |
*** b00tcat has joined #tripleo | 13:26 | |
*** jtomasek_ has quit IRC | 13:26 | |
*** dsavineau has quit IRC | 13:27 | |
*** dsavineau has joined #tripleo | 13:27 | |
EmilienM | Mitaka CI looks broken, anyone already looked at it? | 13:30 |
d0ugal | dprince: ping | 13:31 |
EmilienM | ok I found the Mitaka CI issue, it's the same packaging thing we had this week end with cisco networking. Will fix it | 13:32 |
*** masco__ has quit IRC | 13:32 | |
dprince | d0ugal: hey, whats up? | 13:36 |
*** bnemec has joined #tripleo | 13:36 | |
d0ugal | dprince: Do you remember discussing getting the snmpd_readonly_user_password from hiera? | 13:37 |
*** limao has quit IRC | 13:37 | |
d0ugal | dprince: That doesn't work, the Mistral user can't access it. Any other ideas? | 13:37 |
*** limao has joined #tripleo | 13:37 | |
dprince | d0ugal: can we specifically store/stash it somewhere on deployment (create or update) | 13:38 |
d0ugal | dprince: This is the undercloud password (IIUC), so maybe instack could do that? | 13:38 |
ccamacho | hey shardy, finally https://paste.fedoraproject.org/444864/47576058/ custom role (WakaWaka) deployed in an additional node, overriding roles_data.yaml with --roles-file, so just waiting to have all merged and backported T-15:22:00 for Newton GA I think the basic interface for custom roles/services is finished | 13:38 |
dprince | d0ugal: sure, but it is also supplied to the overcloud via a Heat parameter so we should have access to it either way right? | 13:39 |
*** tiswanso has quit IRC | 13:39 | |
d0ugal | dprince: Right, but how do we get it to Heat? | 13:39 |
d0ugal | dprince: it's easy for the CLI to pass it to a workflow, that is what it does now | 13:39 |
d0ugal | dprince: but not so easy for the UI | 13:40 |
d0ugal | dprince: it is stored in hiera and the undercloud conf file in the stack home directory. | 13:40 |
dprince | d0ugal: Can't we write a custom Mistral action that essentially looks it up for us via the same python function (utils.get_config_value) | 13:42 |
dprince | d0ugal: kind of an evil thing to expose via the API so perhaps guard it to just the passwords we need | 13:42 |
d0ugal | dprince: Mistral is running as the wrong user, so it wont have the permissions | 13:42 |
dprince | d0ugal: so, then I think this is a 2 part fix. Update the instack installer to provide access to this for the Mistral user | 13:43 |
d0ugal | (wrong user for that file, it is running as the correct user for Mistral) | 13:43 |
d0ugal | dprince: okay, how would you provide access? | 13:43 |
dprince | d0ugal: we can have multiple hiera files.... they don't all have to have extra permissions I think | 13:43 |
maticue | Hi! I hope someone can help me. On which stage of an "openstack overcloud deploy" endpoints are configured? Because I have an environment with TLS (enable-tls.yaml) miss configured (undercloud reports CERTIFICATE_VERIFY_FAILED after Stack is created) and when I see the endpoints table on the database is incomplete (just Keystone entries) | 13:43 |
dprince | d0ugal: just read perms would be required, perhaps we create a simple unix group that can read this extra file | 13:44 |
*** panda|afk is now known as panda | 13:44 | |
dprince | d0ugal: share_passwords.yaml or something | 13:44 |
dprince | d0ugal: shared_passwords? | 13:44 |
d0ugal | dprince: okay, that sounds good, I'll start digging. | 13:44 |
dprince | d0ugal: I don't have a strong oppinion on the name yet | 13:44 |
d0ugal | /cc rbrady ^ | 13:45 |
dprince | d0ugal: thanks for chasing this. The last few params are always the funnest | 13:45 |
rbrady | dprince: thanks | 13:46 |
*** akshai has joined #tripleo | 13:49 | |
EmilienM | for the record, https://bugs.launchpad.net/tripleo/+bug/1631012 | 13:49 |
openstack | Launchpad bug 1631012 in tripleo "neutron/mitaka is broken at dbsync" [Critical,Triaged] | 13:49 |
rook | heya lucasagomes - openstack baremetal import for newton... any reason we cannot have all the added registration as a post operation | 13:50 |
rook | so the CLI isn't just sitting there? | 13:50 |
openstackgerrit | Leif Madsen proposed openstack/tripleo-validations: Port the network environment validation https://review.openstack.org/341586 | 13:50 |
openstackgerrit | Leif Madsen proposed openstack/tripleo-validations: Add jsonschema validation for os-net-config data https://review.openstack.org/351345 | 13:50 |
rook | lucasagomes w/ ~150 hosts it is quite slow. | 13:50 |
*** akshai_ has joined #tripleo | 13:50 | |
lucasagomes | rook, that's a TripleO command actually | 13:51 |
lucasagomes | AFAICT it's totally possible to break the steps of import into more steps | 13:51 |
rook | lucasagomes: oh, who should I bother then? | 13:52 |
rook | :D | 13:53 |
lucasagomes | rook, you are in the right channel! The import command is part of the python-tripleoclient | 13:53 |
d0ugal | rook: You can bother me :) | 13:53 |
lucasagomes | rook, https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/baremetal.py#L116 | 13:54 |
*** akshai has quit IRC | 13:54 | |
*** akuznetsov has quit IRC | 13:55 | |
d0ugal | lucasagomes: most of the "logic" is now in a mistral workflow. | 13:55 |
rook | d0ugal: cool, so it is my understanding with Newton there is this added level of steps for import -- due to mistral | 13:55 |
d0ugal | rook: Yeah, so the difference now is that you don't see any output until they are all finished | 13:56 |
d0ugal | rook: is that what you are asking about? | 13:56 |
rook | d0ugal well output and time | 13:56 |
rook | with 150 nodes it is close to more than 10 minutes now. | 13:56 |
rook | well 15 now. | 13:56 |
rook | and it still hasn't completed. | 13:56 |
*** tiswanso has joined #tripleo | 13:56 | |
d0ugal | rook: dang, out of interest, how long did it take before? | 13:57 |
rook | is there a test upstream to keep a eye on how long this takes? | 13:57 |
rook | d0ugal < 1 minute | 13:57 |
d0ugal | No, I don't think there is a test. | 13:57 |
rook | this is a bit excessive. | 13:57 |
d0ugal | oh, wow | 13:57 |
d0ugal | Yeah. | 13:57 |
rook | honestly, with this amount of time, i would expect introspection to happen too :D | 13:58 |
d0ugal | rook: I wonder if there is an issue. | 13:58 |
d0ugal | rook: Can you look at "mistral execution-list" for any errors? | 13:58 |
*** limao has quit IRC | 13:58 | |
d0ugal | e.g. mistral execution-list | grep "ERROR"; | 13:58 |
*** limao has joined #tripleo | 13:58 | |
rook | https://gist.github.com/jtaleric/7ea802c7b98d735223c382aeb9865782 | 13:59 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Add generic template for custom roles. https://review.openstack.org/382737 | 13:59 |
d0ugal | rook: okay, next: "mistral action-execution-list" | 13:59 |
d0ugal | rook: This one will be quite a bit bigger :) | 13:59 |
*** akuznetsov has joined #tripleo | 14:00 | |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-common: Add the J2 exclude file exception (When file not found) https://review.openstack.org/382973 | 14:00 |
*** ramishra_ has joined #tripleo | 14:01 | |
rook | https://gist.github.com/jtaleric/195921495a5627e4d2673ba56e0db8ad | 14:01 |
d0ugal | rook: the formatting is a bit wonky there, but it looks like you have hit an error. | 14:02 |
*** oshvartz has joined #tripleo | 14:02 | |
d0ugal | rook: I would probably dive into the mistral logs to track it down. | 14:03 |
social | EmilienM: why this isn't going to newton ?https://bugs.launchpad.net/tripleo/+bug/1614928 | 14:03 |
openstack | Launchpad bug 1614928 in tripleo "openstack overcloud update stack should be powered by a mistral workflow" [High,In progress] - Assigned to Brad P. Crochet (brad-9) | 14:03 |
rook | yeah d0ugal that could be from a prior import? | 14:03 |
d0ugal | social: because we are doing a workaround in the CLI for Newton | 14:03 |
d0ugal | social: the full move to Mistral will happen in Ocata. | 14:03 |
*** ramishra has quit IRC | 14:03 | |
EmilienM | social: have you seen https://review.openstack.org/#/c/381351/ ? | 14:04 |
d0ugal | social: https://bugs.launchpad.net/bugs/1626128 | 14:04 |
openstack | Launchpad bug 1626128 in tripleo "openstack overcloud update stack is broken" [Critical,In progress] - Assigned to Brad P. Crochet (brad-9) | 14:04 |
EmilienM | social: maybe ask thrash | 14:04 |
social | d0ugal: thx | 14:04 |
d0ugal | rook: oh, maybe, sorry it is quite hard to read that paste. | 14:04 |
openstackgerrit | Leif Madsen proposed openstack/tripleo-validations: Port the network environment validation https://review.openstack.org/341586 | 14:05 |
d0ugal | rook: How many nodes are registered in ironic now? | 14:05 |
*** dtrainor has joined #tripleo | 14:05 | |
d0ugal | rook: I'm trying to figure out if it is still progressing. | 14:05 |
openstackgerrit | Merged openstack/tripleo-common: Support node untagging https://review.openstack.org/382832 | 14:06 |
rook | does it wait for enroll to complete? | 14:06 |
rook | d0ugal ^ | 14:06 |
rook | 141 | 14:06 |
d0ugal | rook: Good question, I'm looking. | 14:07 |
rook | where does this code live? | 14:07 |
rook | so many layers of indirection | 14:07 |
d0ugal | rook: Yeah, so the workflow is defined here: https://github.com/openstack/tripleo-common/blob/master/workbooks/baremetal.yaml#L28 | 14:07 |
d0ugal | rook: but this is the actual registration code: https://github.com/openstack/tripleo-common/blob/master/tripleo_common/utils/nodes.py#L474 | 14:08 |
openstackgerrit | Merged openstack/tripleo-ui: Deployment states optimization https://review.openstack.org/381845 | 14:08 |
d0ugal | rook: I suspect we might be doing some extra setting of the node states | 14:10 |
bnemec | EmilienM: So the updates job now appears to be failing correctly on that missing file bug. How would you feel about just merging the ci patch so we can use the experimental job to test the fixes? | 14:10 |
EmilienM | bnemec: looking | 14:10 |
bnemec | Oh, I forgot a link to the patch. | 14:11 |
bnemec | EmilienM: https://review.openstack.org/#/c/374406/ | 14:11 |
EmilienM | bnemec: we could indeed | 14:12 |
EmilienM | wfm | 14:12 |
EmilienM | I'll let you change the commit msg | 14:12 |
EmilienM | panda: any progress on testing ipv6 for ovb-ha only? | 14:12 |
d0ugal | rook: Would you mind opening a bug for this? | 14:12 |
bnemec | EmilienM: Oh, I should probably recheck it anyway to make sure the stable jobs still pass on it. | 14:12 |
EmilienM | panda: oh I just saw https://review.openstack.org/#/c/382515/ | 14:13 |
openstackgerrit | Leif Madsen proposed openstack/tripleo-validations: Add jsonschema validation for os-net-config data https://review.openstack.org/351345 | 14:13 |
EmilienM | bnemec: I think it will, it only affects updates | 14:13 |
EmilienM | but yeah, let's remove depends-on and see if it pass. I'll +2 | 14:13 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Make the ovb-updates job work again https://review.openstack.org/374406 | 14:13 |
panda | EmilienM: I think I'm making good progress, but there's a big problem, nonha configuration with net-iso is loaded for multinode jobs too, so I may need to refactor that part too. | 14:14 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - Test Undercloud upgrade mitaka -> newton https://review.openstack.org/381309 | 14:15 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Undercloud upgrade for mitaka and newton https://review.openstack.org/381286 | 14:15 |
*** snecklifter has quit IRC | 14:15 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Deployment states optimization https://review.openstack.org/382982 | 14:16 |
*** sshnaidm has quit IRC | 14:17 | |
*** athomas has quit IRC | 14:19 | |
*** limao has quit IRC | 14:19 | |
*** limao has joined #tripleo | 14:20 | |
jrist | slagle: https://review.openstack.org/#/c/382707/ | 14:20 |
jrist | slagle: did you see that? | 14:20 |
shardy | matbu: Hey, I added a question on https://review.openstack.org/#/c/379547 when you get a moment | 14:21 |
EmilienM | dprince: I have some spare time now, are you looking at firewall problem already? | 14:21 |
shardy | matbu: I'm testing it locally trying to make the patch resolve bug #1625783 and it's working a little differently than how I expected | 14:22 |
openstack | bug 1625783 in tripleo "unable to leverage swap-partition extraconfig" [High,Triaged] https://launchpad.net/bugs/1625783 - Assigned to Steven Hardy (shardy) | 14:22 |
dprince | EmilienM: yes, I was locally, but the python-tripleoclient has wrecked my env. I think I'm just going to revert it locally for now and move ahead | 14:22 |
EmilienM | dprince: ok | 14:22 |
rook | yup d0ugal so it is waiting for hosts to leave enroll | 14:22 |
rook | why!!! :P | 14:22 |
*** liverpooler has joined #tripleo | 14:23 | |
matbu | shardy: ack thanks for testing it, feel free to comment amend or whatever .. :) i change the temp dir the user home dir, according to Ben comment | 14:23 |
shardy | matbu: yup, it's the "get tht_root file" section I'm not sure about | 14:24 |
shardy | probably missing something, just unclear what that walking the tree is doing | 14:24 |
matbu | shardy: yep i answer to your comment | 14:24 |
*** athomas has joined #tripleo | 14:25 | |
jistr | hi, has anyone seen on overcloud deploy: | 14:25 |
jistr | Object GET failed: http://192.0.2.1:8080/v1/AUTH_a78762b707954f42b618b97715c4c288/overcloud/ 404 Not Found [first 60 chars of response] <html><h1>Not Found</h1><p>The resource could not be found.< | 14:25 |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: DO NOT MERGE fake periodic job to update cache to Ocata https://review.openstack.org/382521 | 14:25 |
jistr | i wonder if there's something i need to clean up? | 14:25 |
*** sshnaidm has joined #tripleo | 14:25 | |
EmilienM | jistr: where do you see it, in CI? | 14:25 |
shardy | jistr: aha, yeah I see now, thanks | 14:25 |
jistr | EmilienM: no, locally | 14:26 |
EmilienM | jistr: newton/ocata? | 14:26 |
shardy | sorry matbu I see now | 14:26 |
jistr | EmilienM: master | 14:26 |
EmilienM | jistr: sounds like you might need to update your packages | 14:26 |
jistr | i deployed about 3 hrs ago... | 14:26 |
EmilienM | we merged a bunch of stuffs lately, i'm not sure aobut this error but it's not in CI | 14:26 |
EmilienM | jistr: what version of tripleoclient do you have? | 14:26 |
*** akuznetsov has quit IRC | 14:27 | |
jistr | i tried master and also pulling matbu's patch to fix stack updates, both behave the same | 14:27 |
jistr | i've used to hit weird issues when i didn't delete the overcloud plan between deploys | 14:27 |
jistr | so actually to add more context | 14:28 |
jistr | first deploy went fine | 14:28 |
jistr | then i deleted the stack and the plan | 14:28 |
jistr | and now 2nd deploy hits that error ^^ | 14:28 |
jistr | d0ugal: does it ring a bell perhaps? | 14:28 |
jistr | i'll try to restore from the package just to verify it's not some desync | 14:29 |
matbu | jistr: hmm i think i got it also, when i delete the overcloud and clean swift and mistral | 14:29 |
shardy | jistr: I'd check the container is there (swift list), and assuming it's not then check the mistral logs for errors creating the plan | 14:31 |
shardy | jistr: you could also try openstack overcloud plan create to debug the plan create independent of the deploy/update | 14:31 |
jistr | oh i got it. Indeed it's probably some desync, when i use everything from packages, it works. So i messed up when i used tripleoclient from source, but not tripleo-common. I deployed from scratch very recently so i thought i'd be in the clear even with packages, but it's not the case... | 14:32 |
jistr | thanks all :) | 14:32 |
jistr | EmilienM was right ;) | 14:32 |
sshnaidm | pabelanger, hi | 14:33 |
pabelanger | morning | 14:33 |
EmilienM | jistr: you're welcome :-P | 14:34 |
jistr | btw is there something i need to do to refresh mistral workflows/actions when using a new tripleo-common from source? i guess restart mistral at least, but maybe there's more? | 14:34 |
shardy | jistr: http://paste.fedoraproject.org/444933/57645401 | 14:35 |
shardy | probably don't need all the sleeps | 14:35 |
jistr | shardy: awesome, thanks | 14:36 |
*** rhallisey has quit IRC | 14:36 | |
*** dhill_ has quit IRC | 14:38 | |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: Have docker start script honor configuration https://review.openstack.org/366138 | 14:39 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: Add steps to containerized compute deployment https://review.openstack.org/346927 | 14:39 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: WIP: Containerized Services for Composable Roles https://review.openstack.org/330659 | 14:39 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: Bind mount files to run DiD in latest atomic host https://review.openstack.org/347218 | 14:39 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: Be more inclusive in insecure registry regex https://review.openstack.org/366111 | 14:39 |
*** dhill_ has joined #tripleo | 14:39 | |
mandre | Slower: ^^ | 14:40 |
pradk | marios, confirmed the vhosts files get overridden without apache init | 14:41 |
*** limao has quit IRC | 14:44 | |
EmilienM | ccamacho: you should not backport a patch that is not merged upstream. | 14:45 |
*** limao has joined #tripleo | 14:45 | |
*** mbozhenk1 has quit IRC | 14:45 | |
EmilienM | because if the master patch change, you need to update the cherry pick again, pointless. | 14:45 |
dprince | EmilienM: can you diff the old and latest again? | 14:45 |
dprince | EmilienM: I've checked them manually too but I don't have that old file | 14:45 |
dprince | handy | 14:45 |
matbu | bnemec: hey :) regarding your comment, you mean 'working into a '/tmp/tmpZv7yrt' ' ? actually, in my latest update i tried to address both your and shardy comment, who was pointing the fact that we could leak the /tmp dir | 14:46 |
EmilienM | dprince: ok a sec | 14:46 |
ccamacho | Emilien, i did that to gain some time (passing CI) both patchsets should not be updated | 14:46 |
matbu | bnemec: i was originaly in mind to create a mkdtemp() dir | 14:46 |
ccamacho | EmilienM good idea to have it blocked until the other gets merged | 14:47 |
EmilienM | ccamacho: but don't do it please | 14:47 |
EmilienM | it's very risky | 14:47 |
EmilienM | to merge something in stable before master and code is not same at the end | 14:47 |
ccamacho | EmilienM ack | 14:47 |
EmilienM | thx | 14:47 |
bnemec | matbu: I explained how to do that in my previous comment. tmp_dir = tempfile.mkdtemp(); try: [all of the processing code]...finally: shutil.rmtree(tmp_dir) | 14:49 |
bnemec | No leaked files, no security problems, no chance of overwriting user files. | 14:49 |
EmilienM | marios, gfidente: lint issue on https://review.openstack.org/#/c/382386 - like CI actually shows it :) | 14:49 |
*** pkovar has quit IRC | 14:51 | |
shardy | matbu: If it helps I'm hacking on a reworked version locally which resolves the ordering issue I mention | 14:51 |
shardy | I'm happy to rework the tmpdir stuff too and push a revision for consideration, unless you're already on it? | 14:51 |
matbu | shardy: as you want, i'm on a mtg right now, so if you have a bit of time that fine to me | 14:52 |
shardy | matbu: ack, thanks, just trying to help out as this is one of the final blockers for Newton | 14:52 |
matbu | shardy: yep thnks very much :) | 14:53 |
*** pkovar has joined #tripleo | 14:53 | |
EmilienM | dprince: doing it now | 14:55 |
*** mwhahaha has quit IRC | 14:55 | |
*** CaptTofu has quit IRC | 14:55 | |
*** coolsvap has quit IRC | 14:55 | |
*** patrickeast has quit IRC | 14:55 | |
*** hrybacki has quit IRC | 14:55 | |
EmilienM | dprince: https://www.diffchecker.com/txfANLJw | 14:57 |
*** fultonj_ has joined #tripleo | 14:58 | |
dprince | EmilienM: looks good to me. I'm wondering if there is a missing rule on the compute node? | 14:59 |
d0ugal | rook: dang, thanks for tracking that down - we don't need that obviously. Did you open a bug? Otherwise I can. | 14:59 |
EmilienM | dprince: excellent idea | 15:00 |
EmilienM | dprince: let me check | 15:00 |
*** mbozhenko has joined #tripleo | 15:00 | |
*** ccamacho has quit IRC | 15:01 | |
openstackgerrit | Tom Barron proposed openstack/puppet-tripleo: Set enabled_share_protocols based on enabled backends https://review.openstack.org/382386 | 15:01 |
EmilienM | dprince: oh wait | 15:01 |
dprince | EmilienM: also, when I read the console.log it looks like ssh is initiated | 15:02 |
EmilienM | dprince: http://paste.openstack.org/show/FkhckBkIyYh3nh0sipqB/ | 15:02 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-heat-templates: Composable Mistral services https://review.openstack.org/323436 | 15:02 |
*** limao has quit IRC | 15:02 | |
EmilienM | looks like no iptables rules on the compute (back in August, when things worked) | 15:02 |
gfidente | tbarron thanks for updating it, is it working as intended now? | 15:02 |
EmilienM | let's see now | 15:02 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-heat-templates: Composable Zaqar services https://review.openstack.org/331682 | 15:02 |
*** jlinkes has quit IRC | 15:02 | |
*** limao has joined #tripleo | 15:02 | |
*** mwhahaha has joined #tripleo | 15:02 | |
tbarron | gfidente: I knew you guys were busy. Test deploy is still running. | 15:03 |
dprince | EmilienM: hmmm, that is almost certainly the issue. We are likely missing rules on compute then. Perhaps it never really worked then/ | 15:03 |
EmilienM | dprince: http://paste.openstack.org/show/EiUAtsi3G9klN9J8uMBo/ | 15:03 |
dprince | EmilienM: I can disable it on compute really quick via the roles_data.yaml by removing Firewall entirely there | 15:03 |
EmilienM | dprince: that's now ^ | 15:03 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add the workflow name to the starting workflow message https://review.openstack.org/375331 | 15:04 |
*** r-mibu has quit IRC | 15:04 | |
dprince | EmilienM: at a minimum I'd say we need the vxlan one | 15:04 |
EmilienM | dprince: the problem is that we never tested iptables rules on compute until now | 15:04 |
dprince | EmilienM: perhaps more | 15:04 |
EmilienM | yes | 15:04 |
EmilienM | dprince: ok let's iterate: please disable rules on compute now | 15:04 |
shardy | dprince, EmilienM: according to https://bugs.launchpad.net/tripleo/+bug/1630761 no non-controller roles get the rules configured | 15:04 |
openstack | Launchpad bug 1630761 in tripleo "Custom roles nodes don't get iptables rules configured" [High,Triaged] | 15:04 |
EmilienM | dprince: and I'm working on compute iptables rules | 15:04 |
dprince | EmilienM: ack, yes. Step at a time | 15:04 |
shardy | not had time to look into why yet | 15:04 |
EmilienM | shardy: /me looking now. I think it's a security problem | 15:05 |
EmilienM | I took the bug | 15:05 |
EmilienM | dprince: ack, excellent | 15:05 |
*** numans has quit IRC | 15:05 | |
*** mbozhenko has quit IRC | 15:05 | |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Re-enable ManageFirewall by default. https://review.openstack.org/381864 | 15:06 |
dprince | EmilienM: ^^ lets see what happens ther | 15:06 |
EmilienM | dprince: ok I'll propose a patch on top of it for compute. | 15:06 |
EmilienM | dprince: I found out I think | 15:07 |
EmilienM | 18 neutron vxlan networks rule is on neutron-server nodes | 15:07 |
EmilienM | it must be where l2 agent is running | 15:07 |
EmilienM | I'm proposing a fix | 15:07 |
dprince | EmilienM: agree that looks suspicious | 15:08 |
EmilienM | dprince: let me rebase your patch | 15:08 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Re-enable ManageFirewall by default. https://review.openstack.org/381864 | 15:08 |
EmilienM | done | 15:08 |
*** r-mibu has joined #tripleo | 15:09 | |
*** rajinir has joined #tripleo | 15:10 | |
*** tremble has quit IRC | 15:11 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 15:12 |
EmilienM | bandini, jistr, gfidente: can you confirm pacemaker needs vrrp open in iptables? | 15:14 |
*** _milan_ has quit IRC | 15:14 | |
*** milan has joined #tripleo | 15:15 | |
*** lucasagomes is now known as lucas-hungry | 15:15 | |
beagles | EmilienM: it is needed for neutron L3 HA | 15:15 |
EmilienM | beagles: yeah but for pacemaker itself? | 15:15 |
beagles | EmilienM: ah... yeah, no idea :) | 15:16 |
EmilienM | for pacemaker heartbeat I mean | 15:16 |
bandini | EmilienM: no it is not needed by pacemaker. only by neutron (under certain conditions) | 15:16 |
EmilienM | bandini: ok thanks | 15:17 |
*** CaptTofu has joined #tripleo | 15:18 | |
*** ccamacho has joined #tripleo | 15:18 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Enable firewalling by default on compute nodes https://review.openstack.org/383029 | 15:18 |
EmilienM | dprince: let's try ^ | 15:18 |
openstackgerrit | Merged openstack/tripleo-ui: Integrate node tagging workflow https://review.openstack.org/367562 | 15:19 |
rook | d0ugal: one sec, I have something else to try | 15:20 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Integrate node tagging workflow https://review.openstack.org/383030 | 15:21 |
*** mwhahaha is now known as mwhahaha_ | 15:21 | |
dprince | EmilienM: +2 on that one. given compute wasn't covered before there may be other roles not working as well. Like object, and ceph, or volume | 15:21 |
EmilienM | dprince: good proof multinode job was not enough here, we need to increase the # of nodes | 15:22 |
EmilienM | to have at least a controller/compute | 15:22 |
dprince | EmilienM: that is a start, we'd want more nodes that that to cover important cases too | 15:23 |
*** limao_ has joined #tripleo | 15:23 | |
dprince | EmilienM: specifically separate rabbit, and or mysql roles. And a separate networking role | 15:24 |
bnemec | I suspect this may have been at least somewhat intentional. The firewall was protecting the nodes with a public interface. | 15:24 |
dprince | EmilienM: without upstream tests on these they will constantly broken | 15:24 |
bnemec | And given that it didn't even work until about halfway through this cycle I imagine nobody got around to implementing firewall rules for the other nodes. | 15:24 |
dprince | bnemec: agree, that hidden meaning slipped through the cracks perhaps when we decomposed the services in newton. It was just assumed Firewalls were on everywhere... | 15:25 |
EmilienM | dprince: I agree | 15:26 |
*** abregman is now known as abregman|afk | 15:26 | |
*** limao has quit IRC | 15:27 | |
gfidente | EmilienM bandini jistr no I don't think pcmk uses vrrp | 15:28 |
bandini | gfidente: nope it most definitely does not | 15:28 |
EmilienM | ok good | 15:28 |
EmilienM | I didn't create the rule for it | 15:28 |
bandini | unless they snuck it in when I was drunk | 15:28 |
*** saneax is now known as saneax-_-|AFK | 15:29 | |
*** hrybacki has joined #tripleo | 15:29 | |
bnemec | I feel like something used vrrp though. keepalived maybe? | 15:30 |
*** bana_k has joined #tripleo | 15:30 | |
EmilienM | ah yes indeed | 15:30 |
EmilienM | bnemec: thx :) | 15:31 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Enable firewalling by default on compute nodes https://review.openstack.org/383029 | 15:31 |
gfidente | bnemec though we don't use keepalived in the pcmk scenario | 15:33 |
gfidente | EmilienM ^ | 15:33 |
bandini | bnemec: yes keepalived and neutron l3 ha | 15:33 |
*** abregman|afk is now known as abregman | 15:33 | |
EmilienM | gfidente: I thought we used it for the vip | 15:34 |
gfidente | EmilienM in pcmk scenario is pcmk owning the VIPs | 15:34 |
gfidente | in non-pcmk is keepalived | 15:34 |
EmilienM | maybe on nonha jobs? | 15:34 |
gfidente | nonha exactly | 15:35 |
EmilienM | ok cool | 15:35 |
panda | bnemec: is it possible to have a predicatble endpoint VIP when using network isolation ? | 15:36 |
*** patrickeast has joined #tripleo | 15:37 | |
openstackgerrit | Merged openstack/tripleo-ui: Deployment states optimization https://review.openstack.org/382982 | 15:37 |
openstackgerrit | Merged openstack/tripleo-ui: Integrate node tagging workflow https://review.openstack.org/383030 | 15:38 |
bnemec | panda: Yes, that's what is in the docs now. | 15:38 |
bnemec | parameter_defaults: | 15:38 |
bnemec | PublicVirtualFixedIPs: [{'ip_address':'10.0.0.1'}] | 15:38 |
*** [1]cdearborn has quit IRC | 15:39 | |
b00tcat | hey, I'm in a new laptop so I forgot to add the commit-id thing to my last commits | 15:40 |
b00tcat | `git-review` suggestion only applies to the last commit | 15:40 |
b00tcat | does someone know how to add the commitId to the latest `n` commits? | 15:41 |
b00tcat | or is it even possible? | 15:41 |
shardy | b00tcat: you can create a new branch, then cherry pick the commits one at a time, then do git commit --amend to add the ChangeId | 15:41 |
panda | bnemec: mh, thanks | 15:41 |
shardy | I'm not aware of a way to batch-amend the commits | 15:42 |
b00tcat | shardy: that's smart, I'll try that thanks! | 15:42 |
panda | bnemec: the "mh" is because I'm not sure where to put this in current jobs configuration | 15:42 |
*** bana_k has quit IRC | 15:44 | |
bnemec | b00tcat: git rebase -i HEAD~#, where # is the number of commits you need to amend. | 15:45 |
bnemec | Change the "pick" on each commit to "edit" and it will stop and let you amend each one as it rebases. | 15:45 |
bnemec | Do git rebase --continue after each amend. | 15:46 |
*** coolsvap has joined #tripleo | 15:47 | |
shardy | bnemec: ah, nice, I'd forgotten about edit | 15:48 |
*** mwhahaha has joined #tripleo | 15:49 | |
bnemec | Some day I'm going to sit down and record a video of all these git/gerrit common tasks. I've been meaning to for about two years. :-) | 15:50 |
rbrady | bnemec++ | 15:50 |
jpich | d0ugal: Hey, I wonder if I may have found a belated issue with https://review.openstack.org/#/c/381169/ | 15:52 |
openstackgerrit | Alejandro Andreu proposed openstack/tripleo-puppet-elements: Installs more packages with the Midonet element https://review.openstack.org/383056 | 15:53 |
openstackgerrit | Alejandro Andreu proposed openstack/tripleo-puppet-elements: Separate Datastax repository from the Midonet one https://review.openstack.org/383057 | 15:53 |
openstackgerrit | Alejandro Andreu proposed openstack/tripleo-puppet-elements: Update git commit sources for Midonet element https://review.openstack.org/383058 | 15:53 |
shadower | jtomasek: hey so do I understand it correctly, that the GUI calls the tripleo.baremetal.v1.register_or_update workflow to register nodes? | 15:53 |
*** ohamada has quit IRC | 15:53 | |
d0ugal | jpich: oh, fun. | 15:53 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: [WIP] Add IPv6 coverage using existing jobs https://review.openstack.org/382515 | 15:54 |
jpich | shadower: Should be correct | 15:54 |
rbrady | jpich: should be a quick patch. do you want to file a bug? | 15:54 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/360004 | 15:54 |
shadower | jpich: awesome, thanks! | 15:55 |
jpich | rbrady: It's not merged yet so maybe we can fix it as part of it? I'd like to file a bug anyway so it's easier to backport (the missing param is breaking deploys in the UI) | 15:55 |
beagles | ugh... if someone decides to enable GRE tunnelling they are going to get bitten by the firewall rule issue as well | 15:55 |
beagles | EmilienM: ^ do we care? | 15:55 |
d0ugal | jpich: Your UI deploys will break missing another param when these are fixed :( | 15:55 |
*** akshai_ has quit IRC | 15:55 | |
d0ugal | jpich: The other one is proving much harder to resolve | 15:55 |
EmilienM | beagles: we might need to support both | 15:55 |
rbrady | jpich: ack | 15:56 |
EmilienM | beagles: GRE is port 47 ? | 15:56 |
jpich | d0ugal: Oh :( Is there a bug for that one? I'm trying to document workarounds + bugs/patches needed for the UI at https://etherpad.openstack.org/p/tripleo-ui-newton-rc during this rough period :) | 15:56 |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Perform a booting test for our images https://review.openstack.org/204639 | 15:56 |
d0ugal | EmilienM: It looks like you added this, is this how keystone credentials must be created? https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/utils.py#L572 | 15:57 |
EmilienM | d0ugal: yes Sir | 15:57 |
EmilienM | d0ugal: I stole it from keystone istelf | 15:57 |
EmilienM | itsel | 15:57 |
jpich | haha | 15:57 |
EmilienM | err.. /me goes sleep | 15:57 |
d0ugal | lol | 15:57 |
EmilienM | well you got it | 15:57 |
beagles | EmilienM: yup | 15:57 |
thrash | d0ugal: I'm still at a loss on this update thing. | 15:57 |
d0ugal | EmilienM: Indeed, thanks, I'll steal it also | 15:57 |
d0ugal | jpich: no, there isn't a but - I was just tackling these under the overall password generation bug thing | 15:58 |
d0ugal | thrash: damn :( | 15:58 |
* d0ugal juggles | 15:58 | |
EmilienM | beagles: indeed then, we need to add it too. I'm curious how can we make it flexible but I have an idea ;-) | 15:58 |
d0ugal | thrash: What happens if (when?) we miss RC3? | 15:58 |
thrash | d0ugal: since we have a bug for it, we can still backport. | 15:58 |
d0ugal | thrash: okay, good. Just trying to figure out where I should focus my attention right now :) | 15:59 |
thrash | d0ugal: ack. Don't pull away from anything just yet. I'm still messing with it. | 15:59 |
thrash | shardy: is there anything recently in heat that you know of that might mess with breakpoints? | 15:59 |
EmilienM | beagles: wait no, it's 'gre' proto in iptables, no port. Right? | 16:00 |
d0ugal | jpich: The other issue you will hit is that SnmpdReadonlyUserPassword isn't set. | 16:00 |
beagles | EmilienM: just thinking that... dbl checking the extact rule | 16:00 |
d0ugal | jpich: well, it is set as an empty string | 16:00 |
*** ebarrera has quit IRC | 16:00 | |
shardy | thrash: Nothing that I'm aware of, but honestly I've not tested any breakpoint stuff in a while | 16:00 |
*** rcernin has quit IRC | 16:01 | |
thrash | shardy: ack. | 16:01 |
thrash | d0ugal: question for ya... once someone does a deployment and the plan is created, it contains all of the environment files too right? | 16:02 |
d0ugal | thrash: Yeah, in a slightly strange way, but yeah | 16:02 |
thrash | matbu: take a look at bnemec's comment on https://review.openstack.org/#/c/381899/7/tripleoclient/v1/overcloud_update.py | 16:02 |
thrash | matbu: if he hasn't commented on your patch yet. | 16:02 |
thrash | d0ugal: so, the update command should only need to just pull down the files from the plan, and work with those, right? | 16:03 |
*** weshay is now known as weshay_bbiab | 16:03 | |
thrash | and add in the environment that update needs... | 16:03 |
jpich | d0ugal: Ok, thank you for the information. The workaround would be to check the hiera data and set it manually before the deploy, for now? | 16:03 |
thrash | d0ugal: it doesn't make sense to me to pass additional environment files to update. | 16:04 |
beagles | EmilienM: yup it's just gre | 16:04 |
EmilienM | beagles: ok | 16:04 |
beagles | been forever since I deployed with GRE | 16:04 |
*** kberger has quit IRC | 16:05 | |
panda | EmilienM: bnemec: something I'm missing for the ipv6 gate is why we don't just add the ha-ipv6 gate job to the list of gates. Resources problem ? | 16:05 |
*** kberger has joined #tripleo | 16:05 | |
*** cdearborn has joined #tripleo | 16:05 | |
bnemec | panda: Right. | 16:06 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Enable firewalling by default on compute nodes https://review.openstack.org/383029 | 16:06 |
EmilienM | beagles: done ^ | 16:06 |
EmilienM | panda: yep | 16:06 |
bnemec | We've only got capacity to run so many jobs, and we need the nonha, ha, and updates jobs. Adding ha-ipv6 too would ~double our current load. | 16:06 |
bnemec | (because we're not running updates yet either) | 16:06 |
beagles | EmilienM: we can ditch VRRP on the compute dvr btw | 16:06 |
dprince | bnemec: I think just running it on one of the jobs woudl be a start | 16:07 |
EmilienM | beagles: why? | 16:07 |
beagles | EmilienM: HA routers don't get scheduled to L3 agents running on compute nodes | 16:07 |
EmilienM | ah k | 16:07 |
*** rhallisey has joined #tripleo | 16:07 | |
bnemec | dprince: Yeah, it's on the updates job, but the updates job wasn't working until like yesterday. :-) | 16:07 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Enable firewalling by default on compute nodes https://review.openstack.org/383029 | 16:07 |
dprince | gotcha | 16:08 |
*** hewbrocca is now known as hewbrocca-afk | 16:08 | |
EmilienM | bnemec, dprince, panda: why not deploy hajob with ipv6 and nonha with ipv4? | 16:08 |
bnemec | EmilienM: Because then we have no CI coverage without net-iso. | 16:08 |
tbarron | gfidente: marios looks like it worked! - http://paste.fedoraproject.org/444996/77004314/ | 16:08 |
gfidente | tbarron cool, thanks | 16:08 |
dprince | EmilienM: IPv4 is still probably the most common case. I'd hate to see us not cover that for the ha job | 16:08 |
panda | EmilienM: there is a discussion on this on the change comments | 16:08 |
bnemec | And a lot of devs deploy that way, so breaking it would be bad. | 16:08 |
* beagles makes note on checklist "do firewall rules make sense everywhere" | 16:09 | |
panda | aslo, I'm tryiong to point out that with the current script, it's difficult to separate nonha and multinode configuration | 16:09 |
dprince | beagles: if we don't have firewalls everywhere I fear that we'll leave holes open with all the incoming composability | 16:10 |
beagles | dprince: indeed! | 16:10 |
beagles | dprince: I meant "make sure the firewall rules are properly configured" :) | 16:11 |
dprince | beagles: noting that I don't even run the firewalls in my dev environment. There are users who will roll this way too | 16:11 |
*** akshai has joined #tripleo | 16:11 | |
beagles | ack | 16:11 |
dprince | beagles: I can only care soo much about things. But maybe I'll turn them on | 16:12 |
jpich | d0ugal, rbrady: I opened https://bugs.launchpad.net/tripleo/+bug/1631049 for that KeystoneProperty0 issue, if you want to reference it in the next version of the patch | 16:12 |
openstack | Launchpad bug 1631049 in tripleo "Property KeystoneCredential0 is not assigned" [High,In progress] - Assigned to Dougal Matthews (d0ugal) | 16:12 |
*** lucas-hungry is now known as lucasagomes | 16:12 | |
trown | EmilienM: I set https://bugs.launchpad.net/tripleo/+bug/1631052 to ocata-1 because I do not have a patch for it and we are trying to put RC3 today, but I think it is a bit of a blocker (at least for anyone not using tripleo.sh) | 16:13 |
openstack | Launchpad bug 1631052 in tripleo "openstack overcloud image upload command is broken" [Critical,Confirmed] | 16:13 |
EmilienM | trown: right it is | 16:13 |
trown | EmilienM: revert of https://git.openstack.org/cgit/openstack/instack-undercloud/commit/?id=b2e5648fda8815dd448777339e6a24d95e0d48bb would be a very quick fix | 16:14 |
d0ugal | jpich: will do, thanks! | 16:14 |
trown | I can put that up if we are ok with that | 16:14 |
EmilienM | Juan is not around | 16:14 |
EmilienM | trown: go for it | 16:14 |
EmilienM | trown: at least in stable/newton | 16:14 |
*** jistr is now known as jistr|afk | 16:14 | |
*** aufi has quit IRC | 16:15 | |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Add the KeystoneCredential0 and KeystoneCredential1 parameters https://review.openstack.org/381169 | 16:15 |
d0ugal | jpich: ^ | 16:15 |
trown | EmilienM: oh, actually I dont think it was backported and landed after we branched, so we should be fine wrt blocker | 16:16 |
tbarron | gfidente: marios EmilienM so https://review.openstack.org/#/c/382386/6 looks good from a functional standpoint; i will follow with tests on openstack.org/#/c/382386/7 but I can't imagine a functional difference. | 16:16 |
trown | EmilienM: so maybe worth figuring out how to fix it properly in tripleoclient since glance V1 API is going away | 16:16 |
jpich | d0ugal: Thanks! Looking now | 16:16 |
*** jcoufal has quit IRC | 16:16 | |
d0ugal | jpich: cheers, just testing it manually | 16:17 |
EmilienM | trown: wait, are we sure the commit isn't in stable/newton? | 16:17 |
trown | EmilienM: I dont see it https://git.openstack.org/cgit/openstack/instack-undercloud/log/?h=stable/newton | 16:17 |
EmilienM | trown: ok same. Good :-D | 16:17 |
EmilienM | no more bugs please! | 16:18 |
trown | I hit the issue on master | 16:18 |
d0ugal | jpich: actually, I wont be able to do that right now, my clouds are reforming. | 16:18 |
EmilienM | gfidente: can you write commit messages when you send a patch? example: https://review.openstack.org/#/c/382386/ | 16:18 |
d0ugal | rbrady, EmilienM: can you re-review https://review.openstack.org/#/c/381169 now than I'm doing it properly? | 16:19 |
*** jcoufal has joined #tripleo | 16:20 | |
EmilienM | d0ugal: done | 16:20 |
d0ugal | Thanks! | 16:20 |
thrash | bnemec: I totally get your concerns about the tmp directory... However, there is no reliable way to know when everyone is done with those templates. | 16:21 |
thrash | bnemec: re: https://review.openstack.org/#/c/379547/20 and my update patch | 16:21 |
bnemec | thrash: Why not? They only need to persist through the running of the command, right? After that we're done with the local copies. | 16:22 |
thrash | bnemec: I guess as long as the heat api call has been made, we can get rid of them? | 16:22 |
bnemec | thrash: I would think so, but we poll the status in update anyway, don't we? We could just wait until everything is done. | 16:23 |
*** penick has joined #tripleo | 16:24 | |
openstackgerrit | John Trowbridge proposed openstack/instack-undercloud: Revert "Stop pinning Glance API version on stackrc" https://review.openstack.org/383091 | 16:24 |
thrash | bnemec: not necessarily. If you don't do an interactive update, then the answer to your question is no. | 16:24 |
trown | I put up a revert anyways ^ because CI did not legitimately pass on the original change | 16:24 |
*** mwhahaha_ has quit IRC | 16:24 | |
thrash | bnemec: but i think you're right... once we've made the call to either stacks.create or stacks.update, they are no longer needed. | 16:24 |
*** fultonj_ has quit IRC | 16:25 | |
thrash | all the other calls just refer to a stack id | 16:25 |
*** limao has joined #tripleo | 16:25 | |
*** ccamacho1 has joined #tripleo | 16:25 | |
bnemec | thrash: Yeah, I would think the api call sends whatever local data Heat needs as part of the call. | 16:25 |
*** ccamacho has quit IRC | 16:26 | |
gfidente | tbarron see Emilien's comment on https://review.openstack.org/#/c/382386/ | 16:26 |
gfidente | do you want to update the commit message? | 16:26 |
gfidente | (explaining why) | 16:26 |
openstackgerrit | John Trowbridge proposed openstack/instack-undercloud: Revert "Stop pinning Glance API version on stackrc" https://review.openstack.org/383091 | 16:26 |
EmilienM | gfidente: it helps reviewers to understand what is happenning | 16:26 |
EmilienM | trown: maybe shoot an email to Juan | 16:27 |
thrash | bnemec: I will try it on the update. It's broken as it is. :P | 16:27 |
openstackgerrit | Lucas Alvares Gomes proposed openstack/instack-undercloud: Add option to set a custom dnsmasq configuration file https://review.openstack.org/364391 | 16:27 |
bnemec | thrash: Yeah, I noticed. It didn't fix the updates job when I added the depends-on. :-) | 16:28 |
bnemec | thrash: Hopefully we can get the ci patch merged soon so we can test the client patches more easily though. | 16:28 |
gfidente | EmilienM yeah again it was in the LP bug but having it in the commit is also good | 16:28 |
trown | EmilienM: I added him to the review | 16:28 |
*** limao_ has quit IRC | 16:28 | |
EmilienM | cool | 16:28 |
* EmilienM afk lunch | 16:28 | |
tbarron | gfidente: ok, i'll update the commit msg | 16:29 |
gfidente | tbarron ack | 16:29 |
thrash | bnemec: definitely. But there is something fundamentally broken in the update code. What I am seeing is the breakpoint hits, and I clear it, but nothing happens. It just spins until it times out | 16:29 |
bnemec | thrash: Good times. :-) | 16:31 |
*** tesseract- has quit IRC | 16:31 | |
*** limao has quit IRC | 16:34 | |
*** b00tcat has quit IRC | 16:38 | |
*** limao has joined #tripleo | 16:39 | |
*** cylopez has quit IRC | 16:40 | |
lucasagomes | hi, can I get some eyes on https://review.openstack.org/#/c/370773/ ? It's tiny review already +2 fixing the enrollment of nodes using the UCS driver. Thanks | 16:41 |
rook | d0ugal so now I am curious if a single host fails to go from enroll->managable if that causes the hiccup :/ | 16:41 |
*** dsariel_ has quit IRC | 16:43 | |
rook | lucasagomes dtantsur what is the best medium to start the discussion on making oc deploy more resilient? | 16:44 |
*** ebarrera has joined #tripleo | 16:44 | |
dtantsur | rook, define resilient please :) | 16:45 |
lucasagomes | rook, hmm we need to map what parts needs to be fixed and probably open bugs for them | 16:45 |
dtantsur | probably the ML in any case, with [ironic] tag | 16:45 |
rook | dtantsur: "able to withstand or recover quickly from difficult conditions." | 16:45 |
dtantsur | rook, I think it would be cool to collect real life examples and bring them to the ML. we were discussing it last summit, but we didn't have enough examples. | 16:46 |
rook | so, i should use ironic or tripleo? | 16:48 |
openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Set enabled_share_protocols based on enabled backends https://review.openstack.org/382386 | 16:48 |
*** rbrady is now known as rbrady-afk | 16:49 | |
bnemec | lucasagomes: Was that a typo being fixed, or did the name actually change? | 16:49 |
lucasagomes | bnemec, the name changed | 16:49 |
lucasagomes | bnemec, I put the link to the patch changing it in the commit message | 16:50 |
bnemec | lucasagomes: Because we don't have stable branches for os-cloud-config, so this is going to break with older Ironics. | 16:50 |
lucasagomes | bnemec, hmmm | 16:50 |
bnemec | lucasagomes: Is it safe to just set both, or will Ironic freak out if we pass something it doesn't expect? | 16:50 |
lucasagomes | bnemec, it's safe, yes | 16:51 |
d0ugal | rook: use tripleo I think | 16:51 |
lucasagomes | bnemec, looks odd when you do a node-show because the informaiton will be duplicated | 16:52 |
lucasagomes | but in ironic it's safe | 16:52 |
jtomasek | shadower: yes | 16:53 |
lucasagomes | bnemec, you wanna go that route then ? | 16:53 |
bnemec | lucasagomes: That seems like the simplest solution. If they don't want it duplicated, then they shouldn't break their driver interface like this. :-) | 16:53 |
dtantsur | rook, it depends on whose attention you want to get :) you pinged Lucas and me, so I assumed you want something from Ironic :) | 16:54 |
rook | dtantsur: lol | 16:55 |
rook | dtantsur: ill just email you guys directly then | 16:55 |
*** rasca has quit IRC | 16:55 | |
bnemec | lucasagomes: Come to think of it, how does that work on the Ironic side? If someone registered a node with the old name, then upgrades Ironic, is there something to map the old name to the new name? | 16:55 |
shadower | jtomasek: thanks | 16:55 |
*** derekh has quit IRC | 16:56 | |
dtantsur | rook, well, big changes in Ironic won't happen after private emails ;) but again, I probably miss the context of the problems you're trying to solve | 16:56 |
lucasagomes | bnemec, we would keep both options working for at least 1 cycle and logigng a warm when the old one is used | 16:56 |
lucasagomes | and then after the deprecation period we would remove the old one | 16:56 |
lucasagomes | similar to what we do with config options | 16:56 |
*** jtomasek_ has joined #tripleo | 16:56 | |
lucasagomes | and now we have release notes as well to notify deployers that a deprecation option was removed and they have to update as part of the upgrade | 16:57 |
bnemec | lucasagomes: Okay, makes sense. Was just wondering. | 16:57 |
*** jistr|afk is now known as jistr | 16:57 | |
lucasagomes | bnemec, but yeah, since cloud-config does not cut releases. I guess the best way to keep it backward compatible is to register both | 16:58 |
lucasagomes | bnemec, I will change the patch | 16:58 |
bnemec | lucasagomes: Yeah, maybe leave a comment there that the old name can be removed once Mitaka (?) Ironic goes out of support. | 16:58 |
*** jcoufal_ has joined #tripleo | 16:59 | |
lucasagomes | bnemec, ack will do | 16:59 |
*** limao_ has joined #tripleo | 16:59 | |
*** yamahata has quit IRC | 17:01 | |
*** yamahata has joined #tripleo | 17:01 | |
*** jcoufal has quit IRC | 17:01 | |
*** dtantsur is now known as dtantsur|afk | 17:02 | |
*** cylopez has joined #tripleo | 17:02 | |
*** cylopez has quit IRC | 17:02 | |
*** limao has quit IRC | 17:02 | |
openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient: Downloads templates from swift before processing update https://review.openstack.org/381899 | 17:04 |
*** fzdarsky is now known as fzdarsky|afk | 17:06 | |
*** saneax-_-|AFK has quit IRC | 17:07 | |
*** chem has quit IRC | 17:07 | |
rook | shardy: heya so I am doing a large deployment now, watching rss memory w/ heat-engine | 17:08 |
rook | shardy: if you are interested in watching, snooping in | 17:08 |
rook | sshnaidm: heya | 17:09 |
dprince | shardy: the templates are in so much flux every time I rebase my hiera patch I have to start over again :/ | 17:09 |
rook | same as ^^^ | 17:09 |
sshnaidm | rook, yeah, sure | 17:09 |
dprince | shardy: it hasn't been top of list mind you, but proving to be a significant rebase time sync | 17:10 |
rook | what might be interesting is to monitor things going on in heat, and try to associate the memory growth with actions in heat | 17:11 |
rook | but I dunno what/where to look | 17:11 |
rook | shardy ^ maybe you can help with that. | 17:11 |
rook | we could add some sort of collection of information? | 17:11 |
*** pkovar has quit IRC | 17:12 | |
shardy | dprince: I'm sorry about that - we made the decision to go ahead and get the composability features landed for Newton, and a bunch of stuff had to change to make that possible | 17:12 |
shardy | I hope it'll mean much less churn during ocata, but I agree it's been a rough process with the custom roles stuff landing so late | 17:13 |
*** jpich has quit IRC | 17:14 | |
dprince | shardy no need to appoligies man. I'm turning my head towards ocata w/ this anyways. But it is really wild :) | 17:14 |
*** weshay_bbiab is now known as weshay | 17:15 | |
*** fzdarsky|afk has quit IRC | 17:17 | |
*** saneax-_-|AFK has joined #tripleo | 17:18 | |
*** tosky has quit IRC | 17:18 | |
*** cdearborn has quit IRC | 17:18 | |
*** abregman has quit IRC | 17:18 | |
lucasagomes | bnemec, I'm looking at the commit history in ironic, apparently it was never called ucs_hostname. It was a mistake in the documentation only | 17:19 |
lucasagomes | bnemec, https://review.openstack.org/#/c/159734/28/ironic/drivers/modules/ucs/helper.py | 17:19 |
lucasagomes | that's the patch introducing the driver | 17:19 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/360004 | 17:19 |
lucasagomes | bnemec, and this patch https://review.openstack.org/#/c/232834/ is only fixing the docs | 17:20 |
openstackgerrit | Lucas Alvares Gomes proposed openstack/os-cloud-config: Replace ucs_hostname with ucs_address https://review.openstack.org/370773 | 17:23 |
* lucasagomes updated the commit message ^ | 17:23 | |
*** jpena is now known as jpena|off | 17:24 | |
*** bnemec has quit IRC | 17:25 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Specify the Ceph packages to be installed https://review.openstack.org/382132 | 17:25 |
*** cdearborn has joined #tripleo | 17:34 | |
*** athomas has quit IRC | 17:38 | |
*** bnemec has joined #tripleo | 17:38 | |
*** panda is now known as panda|off | 17:40 | |
*** trown is now known as trown|lunch | 17:41 | |
*** milan has quit IRC | 17:45 | |
*** bnemec has quit IRC | 17:47 | |
*** jprovazn has quit IRC | 17:48 | |
*** bana_k has joined #tripleo | 17:48 | |
openstackgerrit | Paul Belanger proposed openstack/python-tripleoclient: Do not merge https://review.openstack.org/383164 | 17:48 |
*** rbrady-afk is now known as rbrady | 17:50 | |
EmilienM | dprince: your patch is passing ovb ha, congrats | 17:52 |
EmilienM | dprince: firewall | 17:52 |
*** bnemec has joined #tripleo | 17:57 | |
EmilienM | bnemec: can you review https://review.openstack.org/#/c/381864/ please? | 17:59 |
*** ebarrera has quit IRC | 18:00 | |
*** bnemec has quit IRC | 18:03 | |
ccamacho1 | EmilienM mind to check https://review.openstack.org/#/c/382911/ already passing CI | 18:05 |
*** cdearborn has quit IRC | 18:06 | |
EmilienM | ccamacho1: looking | 18:06 |
*** bnemec has joined #tripleo | 18:08 | |
ccamacho1 | EmilienM thanks! Ill be around until things get merged. we still have 10 hours left :) | 18:08 |
*** cdearborn has joined #tripleo | 18:10 | |
openstackgerrit | Alex Schultz proposed openstack/puppet-pacemaker: Pin beaker to < 3.0.0 https://review.openstack.org/383184 | 18:12 |
openstackgerrit | Alex Schultz proposed openstack/puppet-pacemaker: Changed the home-page to point Openstack Puppet Homepage https://review.openstack.org/381582 | 18:13 |
*** shardy is now known as shardy_afk | 18:14 | |
openstackgerrit | Paul Belanger proposed openstack/python-tripleoclient: Do not merge https://review.openstack.org/383164 | 18:14 |
*** flepied1 has joined #tripleo | 18:15 | |
*** yamahata has quit IRC | 18:15 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Serialize AllNodesDeployment and UpdateWorkflow https://review.openstack.org/383188 | 18:16 |
*** mcornea has joined #tripleo | 18:16 | |
*** bnemec has quit IRC | 18:17 | |
*** flepied has quit IRC | 18:18 | |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Ceilometer Wsgi Mitaka->Newton upgrades https://review.openstack.org/360004 | 18:20 |
*** amoralej is now known as amoralej|off | 18:22 | |
*** zoli|wfh is now known as zoli|gone | 18:23 | |
*** zoli|gone is now known as zoli_gone-proxy | 18:24 | |
openstackgerrit | Andreas Jaeger proposed openstack/diskimage-builder: Enable release notes translation https://review.openstack.org/383210 | 18:26 |
*** bnemec has joined #tripleo | 18:27 | |
EmilienM | firewall/compute: pingtest OK :) | 18:31 |
EmilienM | sounds like enabling VXLAN was good :) | 18:31 |
openstackgerrit | Merged openstack/puppet-tripleo: Explicitly use Keystone v2 endpoint in the UI https://review.openstack.org/382724 | 18:31 |
*** bnemec has quit IRC | 18:33 | |
*** bnemec has joined #tripleo | 18:34 | |
ccamacho1 | dprince around? mind to check https://review.openstack.org/#/c/382911/ +2ed and passing CI, need to land it to land the backport | 18:36 |
mcornea | EmilienM: hi! quick question regarding the firewall rules: they have an implicit accept policy and there's no deny/reject rule at the end so I guess we allow all traffic even if we set specific services rules. Do I get it right? | 18:36 |
ccamacho1 | gfidente around? | 18:37 |
EmilienM | mcornea: I think we're dropping in last rule by default AFIK | 18:37 |
EmilienM | let me check | 18:37 |
EmilienM | mcornea: https://github.com/openstack/puppet-tripleo/blob/master/manifests/firewall/post.pp#L43-L47 | 18:38 |
EmilienM | let's see if we enable debug | 18:39 |
*** trown|lunch is now known as trown | 18:39 | |
mcornea | EmilienM: I don't have an overcloud deployed atm to check it but noticed this in the output in https://bugs.launchpad.net/tripleo/+bug/1630761 | 18:40 |
openstack | Launchpad bug 1630761 in tripleo "Custom roles nodes don't get iptables rules configured" [High,In progress] - Assigned to Emilien Macchi (emilienm) | 18:40 |
*** bnemec has quit IRC | 18:41 | |
EmilienM | -A INPUT -m comment --comment "999 drop all" -m state --state NEW -j DROP | 18:41 |
*** saneax-_-|AFK has quit IRC | 18:41 | |
EmilienM | that's the last INPUT rule | 18:41 |
EmilienM | see in: | 18:41 |
EmilienM | http://logs.openstack.org/64/381864/6/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/fa37860/logs/overcloud-controller-0/var/log/host_info.txt.gz | 18:41 |
EmilienM | though we don't block in OUTPUT but less critical I would say | 18:42 |
mcornea | ok, I see it there. I'll check it on my env as well once I get something deployed. thanks | 18:42 |
EmilienM | cool | 18:43 |
*** saneax-_-|AFK has joined #tripleo | 18:44 | |
openstackgerrit | Paul Belanger proposed openstack/python-tripleoclient: Do not merge https://review.openstack.org/383164 | 18:46 |
ccamacho1 | beagles around? | 18:47 |
beagles | ccamacho1: hey, s'up? | 18:47 |
openstackgerrit | Andreas Jaeger proposed openstack/puppet-pacemaker: Enable release notes translation https://review.openstack.org/383354 | 18:47 |
ccamacho1 | supa! man mind to check https://review.openstack.org/#/c/382911/ already passed CI +2ed and waiting for merge, I need that for rc3 | 18:48 |
beagles | ccamacho1: ack.. looking | 18:48 |
ccamacho1 | beagles thanks!!! | 18:48 |
*** yamahata has joined #tripleo | 18:53 | |
*** bnemec has joined #tripleo | 18:54 | |
beagles | ccamacho1: so if getting the excludes fails, we don't run the jinja render? | 18:55 |
tbarron | gfidente: when you get a chance, pls. see alex schulz's -1 on https://review.openstack.org/#/c/382386/ | 18:55 |
ccamacho1 | it skips the missing file and defaults the list to {'name'=[]} that list is only for those templates that we dont want to render | 18:56 |
*** jcoufal_ has quit IRC | 18:56 | |
ccamacho1 | then if {'name'=[]} will render all | 18:56 |
ccamacho1 | beagles ^ | 18:56 |
ccamacho1 | i.e. we stil have controller-role.yaml | 18:56 |
ccamacho1 | so the list will have {'name'=[puppet/controller-role.yaml]}, this validation is in case of not having that file | 18:57 |
beagles | ccamacho1: I'm thinking of the 'return' in the except block... won't that just exit the function without running the code blow the try/except? | 18:58 |
ccamacho1 | nope | 18:58 |
ccamacho1 | :) | 18:58 |
ccamacho1 | check the logs from the comments | 18:58 |
ccamacho1 | this is what you will have | 18:59 |
ccamacho1 | 2016-10-06 13:05:05.801 567 INFO tripleo_common.actions.templates [-] No J2 exclude file found, defaulted to: {'name': []} | 18:59 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Include ceilometer in swift proxy pipeline https://review.openstack.org/371950 | 18:59 |
*** jtomasek_ has quit IRC | 19:00 | |
ccamacho1 | beagles end to end test https://paste.fedoraproject.org/444864/47576058/ | 19:00 |
gfidente | tbarron ack mwhahaha commented on https://review.openstack.org/#/c/382386/ | 19:00 |
mwhahaha | gfidente: the point is they are new lookups to the class | 19:01 |
mwhahaha | we need to be doing hiera lookups as parameters so that when we write tests we can properly test the logic | 19:01 |
ccamacho1 | beagles dude also this one https://review.openstack.org/#/c/382217/ which is missing from https://review.openstack.org/#/c/378764/ as we didnt had the template merged | 19:02 |
gfidente | mwhahaha yeah but those are somewhat special | 19:02 |
ccamacho1 | please :) | 19:02 |
gfidente | heat generates "glance_api_enabled" | 19:02 |
gfidente | or "ceph_mon_enabled" | 19:02 |
gfidente | and so on, for each role | 19:02 |
gfidente | we don't want those to be class-specific | 19:02 |
gfidente | (for each service) | 19:02 |
mwhahaha | gfidente: the point is for testing | 19:03 |
mwhahaha | and puppet structure | 19:03 |
mwhahaha | not tripleo functionality | 19:03 |
mwhahaha | use the hiera lookup as the default value for parameters to the class | 19:03 |
beagles | ccamacho1: I'm either misunderstanding something or not asking the right question... 1s | 19:03 |
gfidente | mwhahaha ok | 19:03 |
ccamacho1 | thanks | 19:04 |
mwhahaha | gfidente: for example, https://review.openstack.org/#/c/380406/2/manifests/profile/base/ceilometer/collector.pp | 19:04 |
mwhahaha | allows us to do https://review.openstack.org/#/c/380406/2/spec/classes/tripleo_profile_base_ceilometer_collector_spec.rb | 19:04 |
mwhahaha | where if you bury the hiera lookups in the class there is not a good way to exercise the logic you're writting | 19:04 |
mwhahaha | any new hiera lookups should go as class parameters and not be buried in the puppet class itself | 19:05 |
*** yamahata has quit IRC | 19:05 | |
mwhahaha | it also allows us to see what we're actually using in each class in terms of hieradata that we query and not using databindings for | 19:05 |
*** jcoufal has joined #tripleo | 19:06 | |
beagles | ccamacho1: I guess this is what I'm getting at: http://paste.fedoraproject.org/445129/75780764/ | 19:06 |
gfidente | mwhahaha agreed, working on the update | 19:07 |
mwhahaha | thanks | 19:07 |
*** yamahata has joined #tripleo | 19:08 | |
matbu | shardy_afk: do you plan to update the review or do you want me to update regarding the comments from you and ben ? | 19:08 |
*** absubram has joined #tripleo | 19:08 | |
dprince | ccamacho1: +2 +A | 19:10 |
EmilienM | gfidente: can we cut puppet-ceph? | 19:10 |
*** bnemec has quit IRC | 19:10 | |
EmilienM | gfidente: for newton | 19:10 |
EmilienM | gfidente: or is there still WIP in there? | 19:11 |
ccamacho1 | beagles I was getting the info from the python docs, let me get it again | 19:11 |
*** bnemec has joined #tripleo | 19:11 | |
ccamacho1 | dprince also mind to review https://review.openstack.org/#/c/382217/ this is to add the per-network hostnames in the generic role. (coming from https://review.openstack.org/#/c/378764) | 19:13 |
ccamacho1 | ?? | 19:13 |
ccamacho1 | thanks!!! | 19:13 |
*** coolsvap has quit IRC | 19:16 | |
trozet | slagle: hi | 19:16 |
openstackgerrit | Merged openstack/puppet-pacemaker: Enable release notes translation https://review.openstack.org/383354 | 19:18 |
beagles | ccamacho1: done with https://review.openstack.org/#/c/382217/ | 19:19 |
openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Set enabled_share_protocols based on enabled backends https://review.openstack.org/382386 | 19:21 |
tbarron | gfidente: thanks ^^, will do a deploy with that patch set | 19:22 |
trozet | does anyone know how to fix " install failed with error Running install-packages install. Package list: PyYAML" when building overcloud images? is there some ENV variable I'm missing? | 19:23 |
* beagles reviews what mwhahaha was saying.. learning ensues | 19:23 | |
tbarron | mwhahaha: if you can take a look at https://review.openstack.org/382386 before I start the next deploy that would be awesome | 19:24 |
mwhahaha | tbarron: on it | 19:24 |
mwhahaha | tbarron gfidente: looks good, thanks | 19:25 |
tbarron | mwhahaha: gfidente thanks, uploading the latest puppet modules now ... | 19:26 |
gfidente | EmilienM puppet-ceph seems good to me, was waiting for https://review.openstack.org/#/c/382131/ to merge | 19:26 |
gfidente | thanks mwhahaha for checking | 19:26 |
beagles | ccamacho1: so is it that you expect the 'return' statement in the catch to have no affect (i.e. the rest of the function is run) or is it supposed to return early... | 19:26 |
EmilienM | gfidente: ok I'm cutting it. Thoughts mwhahaha ? | 19:27 |
mwhahaha | EmilienM: should be ok | 19:27 |
* beagles may need a dose of caffeine | 19:27 | |
*** Goneri has quit IRC | 19:28 | |
beagles | ccamacho1: actually in the except block just above it, the return comes after a log msg saying it is skipping the templating | 19:28 |
beagles | ccamacho1: if that's what is intended, my apologies :) | 19:29 |
ccamacho1 | should fail early yeahp | 19:29 |
ccamacho1 | yeahp | 19:29 |
beagles | aaaahhhh okay | 19:29 |
ccamacho1 | we need to agree what to do | 19:29 |
EmilienM | gfidente: if that change please let me know. We're releasing puppet-ceph now. | 19:29 |
ccamacho1 | but I needed to remove that defaulted list | 19:29 |
gfidente | EmilienM so up to and including https://review.openstack.org/#/c/382131/ but | 19:30 |
gfidente | works for me | 19:30 |
beagles | ccamacho1: apologies | 19:30 |
gfidente | *thanks* EmilienM | 19:30 |
ccamacho1 | if we decide that the file is not mandatory (or if can be empty) we need to change it | 19:30 |
beagles | ack | 19:30 |
ccamacho1 | but after rc3 | 19:30 |
ccamacho1 | yeahp | 19:30 |
ccamacho1 | :) | 19:30 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: enable undercloud/ssl on multinode jobs https://review.openstack.org/382082 | 19:32 |
*** penick has quit IRC | 19:34 | |
slagle | trozet: hello | 19:34 |
trozet | slagle: hey your name pops up for multiple hits on google about install failed with error Running install-packages install. Package list: PyYAML | 19:35 |
slagle | dang. am I getting ad revenue from that? | 19:35 |
trozet | slagle: i see you closed a bug that was filed on it, and looks liek wrote some element in DIB | 19:35 |
trozet | slagle: haha I'll paypal you a dollar if you fix this for me, how about that? ;) | 19:35 |
EmilienM | slagle: lol | 19:35 |
EmilienM | your name is on google when I type "tripleo bug" | 19:36 |
trozet | EmilienM: i think all i have to do is search puppet error to find you :) | 19:36 |
slagle | EmilienM: i'm sure i'm the #1 hit | 19:36 |
EmilienM | :) | 19:36 |
trozet | congrats you're famous | 19:36 |
trozet | on par with taylor swift | 19:37 |
slagle | trozet: how are you building images? can i see the command and log somewhere? | 19:37 |
trozet | slagle: well I was trying to build using python-tripleoclient | 19:37 |
trozet | slagle: openstack overcloud image build --type overcloud-full --overcloud-full-name overcloud-odl --base-image /home/stack/rhel-guest-image-7.2-20160302.0.x86_64.qcow2 | 19:37 |
trozet | slagle: so one thing here is --base-image in tripleoclient doesnt actually work so i had to export DIB_LOCAL_IMAGE | 19:38 |
slagle | ok yea i was going to suggest that | 19:38 |
slagle | you also probably need to inject some yum repo files via DIB_YUM_REPO_CONF | 19:38 |
trozet | slagle: yeah that was what i was wondering if I need to set that | 19:39 |
ccamacho1 | LOL this sounds like https://www.youtube.com/watch?v=y4uTwTxefbE (too bad its in Spanish) | 19:39 |
trozet | slagle: so my goal here is to build the overcloud-odl image, which uses a different tripleo-common image-yaml | 19:39 |
trozet | slagle: so is it correct that they --type should still be overcloud-full, and hten --overcloud-full-name will search that image-yaml for the right image name? I'm a bit confused on how that works | 19:40 |
slagle | if you want to use the image-yaml approach, you can't use python-tripleoclient | 19:40 |
slagle | you'd want to use tripleo-build-images from tripleo-common | 19:40 |
slagle | that should still honor the env vars I think | 19:41 |
*** mbozhenko has joined #tripleo | 19:41 | |
trozet | slagle: yeah so I tried that way too heh. But no matter what image-yaml I use: https://paste.fedoraproject.org/445152/raw/ | 19:41 |
slagle | whose name is on google for that one? | 19:43 |
slagle | i don't think you want --config-file | 19:43 |
slagle | try --image-config-file | 19:43 |
slagle | and pass it overcloud-odl-rhel7.yaml instead of overcloud-images.yaml | 19:43 |
*** jbennett_ has joined #tripleo | 19:44 | |
slagle | and be sure also have the DIB_* vars set | 19:44 |
jbennett_ | \join | 19:44 |
jbennett_ | hello | 19:44 |
jbennett_ | during swift introspection I received the following error: Swift failed to create container ironic-inspector. Error was: Container PUT failed: http://10.1.82.1:8080/v1/AUTH_88cd3098b3d94f33bc1e4f03a384cbf4/ironic-ins pector 404 Not Found [first 60 chars of response] <html><h1>Not Found</h1><p>The resource could not be found.< | | 19:45 |
trozet | slagle: haha well i asked trown first about that, but he didnt come on google | 19:45 |
pabelanger | anybody mind +3 on https://review.openstack.org/#/c/376469/ adds ssl development heads for bindep, so buildimage jobs works again | 19:46 |
*** mbozhenko has quit IRC | 19:46 | |
pradk | EmilienM, i think this is in pretty good shape now https://review.openstack.org/#/c/360004/25 .. see my last comment | 19:46 |
trozet | slagle: this is my first time building with RHEL, do i need all those portal registration vars? | 19:47 |
EmilienM | pradk: nice work | 19:47 |
slagle | trozet: not if you pass in the right repo files via DIB_YUM_REPO_CONF | 19:47 |
*** penick has joined #tripleo | 19:47 | |
pradk | thx | 19:47 |
slagle | trozet: if those repos are just unauthenticated yum repos, then the image build will use those | 19:48 |
slagle | trozet: and that is much easier than trying to register to the portal during the image build | 19:48 |
trown | I am confued... who is on google? | 19:48 |
pradk | EmilienM, we need to get shardy's patch in before this .. https://review.openstack.org/#/c/383188/1 | 19:48 |
trozet | trown: slagle is famous | 19:48 |
trown | well ya, obviously | 19:48 |
trozet | slagle: so then I can just point the DIB_YUM_REPO_CONF to centos7 repos? it will work? | 19:48 |
slagle | trozet: if those packages install on rhel, you could | 19:49 |
trozet | slagle, trown: btw newton links are missing on trunk.rdoproject.org | 19:49 |
slagle | or use internal repos (if there are any), and you're image build has access to them | 19:50 |
trown | trozet: indeed they are... we just cut master over to ocata this morning, will ask on #rdo where the source for that page comes from | 19:52 |
*** penick has quit IRC | 19:53 | |
*** akuznetsov has joined #tripleo | 19:53 | |
*** akuznetsov has quit IRC | 19:53 | |
*** penick has joined #tripleo | 19:54 | |
*** jcoufal_ has joined #tripleo | 20:00 | |
*** jbennett_ has quit IRC | 20:02 | |
*** jcoufal has quit IRC | 20:03 | |
*** lblanchard has quit IRC | 20:04 | |
*** jcoufal_ has quit IRC | 20:05 | |
beagles | EmilienM: I was looking at the CI failures in https://review.openstack.org/#/c/382082/ and besides the bogosity with the testresources being included in neutron (wt.), I noticed messages like ct 5 15:48:48 localhost os-collect-config: #033[1;31mError: /Stage[main]/Neutron/Resources[neutron_config]: Failed to generate additional resources using 'generate': OpenStackConfig only support collecting instances | 20:06 |
beagles | when a file path is hard coded#033[0m | 20:07 |
beagles | EmilienM: which is weird, because i think we fixed the puppet modules for mitaka | 20:07 |
beagles | at least I hope we did.. I remember doing it :) | 20:08 |
EmilienM | beagles: i'll check | 20:08 |
* beagles checks other CI runs.. maybe something particular to that job | 20:09 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge https://review.openstack.org/383433 | 20:12 |
beagles | argh. | 20:16 |
beagles | EmilienM: that fix wasn't pulled into openstack-puppet-modules package | 20:16 |
EmilienM | beagles: what fix? | 20:17 |
beagles | EmilienM: it's a fix to puppet-openstacklib If27152863b9df5a28bf45e23ca989019666a958c | 20:17 |
* beagles goes to work the program to get it updated | 20:22 | |
*** gfidente has quit IRC | 20:25 | |
*** pkovar has joined #tripleo | 20:27 | |
*** TSCHAK_ has joined #tripleo | 20:28 | |
*** TSCHAK has joined #tripleo | 20:28 | |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Perform a booting test for our images https://review.openstack.org/204639 | 20:29 |
openstackgerrit | Guil Barros proposed openstack/tripleo-heat-templates: Populate vnc_api_lib.ini on compute nodes with OpenContrail https://review.openstack.org/383445 | 20:30 |
openstackgerrit | Guil Barros proposed openstack/tripleo-heat-templates: Populate vnc_api_lib.ini on compute nodes with OpenContrail https://review.openstack.org/383446 | 20:31 |
*** jayg is now known as jayg|g0n3 | 20:34 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Re-enable ManageFirewall by default. https://review.openstack.org/381864 | 20:35 |
openstackgerrit | Merged openstack/instack-undercloud: Switch to use Puppet Openstack spec helper https://review.openstack.org/382662 | 20:35 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Fix OpendaylightApiNetwork key naming https://review.openstack.org/382926 | 20:35 |
*** gfidente has joined #tripleo | 20:39 | |
*** gfidente has quit IRC | 20:39 | |
*** gfidente has joined #tripleo | 20:39 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Re-enable ManageFirewall by default. https://review.openstack.org/383448 | 20:40 |
EmilienM | dprince: backport ^ | 20:40 |
tbarron | gfidente: marios mwhahaha beagles updated https://review.openstack.org/#/c/382386/9 with the latest deploy results - looks good | 20:41 |
tbarron | gfidente: marios mwhahaha beagles EmilienM ^^^ I don't plan to do more deploys of this one unless it's requested for some reason | 20:42 |
*** bfournie has quit IRC | 20:42 | |
tbarron | gfidente: marios mwhahaha beagles EmilienM IMO when this passes jenkins it should merge and we should do the stable/newton backport | 20:43 |
beagles | dprince: more worker count bugs.. so nice | 20:43 |
EmilienM | again manilla? | 20:43 |
EmilienM | it never ends :( | 20:43 |
tbarron | EmilienM: :( | 20:43 |
*** abregman has joined #tripleo | 20:44 | |
tbarron | EmilienM: I don't have any more up my sleeve, and I want to get CI or at least scenario going for this (with cephfs backend) in O | 20:44 |
*** mcornea has quit IRC | 20:44 | |
EmilienM | tbarron: have you start to push on it? | 20:44 |
tbarron | EmilienM: there's nothing like being a human impersonating CI to make one a believer in CI | 20:44 |
tbarron | EmilienM: well, I'm dev, not QE: I just push a little bit :) | 20:45 |
EmilienM | mwhahaha: see https://bugs.launchpad.net/tripleo/+bug/1631133 | 20:45 |
openstack | Launchpad bug 1631133 in OpenStack Compute (nova) "nova's osapi_compute_workers is not valid (must be greater than 1)" [High,In progress] - Assigned to Dan Prince (dan-prince) | 20:45 |
tbarron | EmilienM: or do you mean, push *for* CI | 20:45 |
tbarron | EmilienM: that I am doing | 20:46 |
EmilienM | mwhahaha: isn't it something we're fixing or fixed? | 20:46 |
mwhahaha | kinda | 20:46 |
EmilienM | mwhahaha: the worker thing :D | 20:46 |
mwhahaha | the problem is there that we're defauling to 0 in tht | 20:46 |
mwhahaha | which completely by passes any puppet work we do around this | 20:46 |
*** nyechiel_ has quit IRC | 20:46 | |
mwhahaha | so we still would like to allow an end user to override it i would assume, but we shouldn't be using 0 in tht | 20:47 |
EmilienM | tbarron: feel free to add manila to one of our CI scenarios. | 20:47 |
EmilienM | mwhahaha: we should default to '' right? | 20:47 |
beagles | nova used to do something specific when set to 0, so we left it alone | 20:47 |
beagles | they changed it, breaking all | 20:47 |
mwhahaha | EmilienM: yea but it's a number in THT | 20:47 |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Fix developer guide TOC https://review.openstack.org/383454 | 20:48 |
*** paramite has quit IRC | 20:48 | |
mwhahaha | I looked, techincally i think we should default to $::os_workers but not sure how to do that in THT | 20:48 |
beagles | EmilienM, mwhahaha, in retrospect, I should've changed all of them, not just the ones that werent' working at the time | 20:48 |
tbarron | EmilienM: ok, first step will be to get the ceph deploy to deploy MDS on controllers (or whereever composable roles put them). Shouldn't be a big deal but was not a newton deliverable. | 20:48 |
mwhahaha | beagles: it's all good, the defaults for all the services are so inconsistent | 20:49 |
*** lucasagomes is now known as lucas-afk | 20:53 | |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Stop forcing oslosphinx for docs https://review.openstack.org/383456 | 20:54 |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Use globaltoc in docs for sidebar https://review.openstack.org/383457 | 20:55 |
*** pkovar has quit IRC | 20:55 | |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Remove copyright from docs / toc https://review.openstack.org/383459 | 20:59 |
mwhahaha | in tht is there a way to pass through to leverage a puppet fact or something | 20:59 |
mwhahaha | cause it looks like all of our workers are set to 0 which is probably going to be problematic | 21:00 |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Rename devloper documentation to developer guide https://review.openstack.org/383461 | 21:02 |
dprince | beagles: I pushed a fix to nova for that. I always love how projects allow default config settings to get changed, and then they shoot the guy in the foot who points out the breakage https://review.openstack.org/#/c/383440/ | 21:02 |
*** ayoung has quit IRC | 21:02 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Enable firewalling by default on compute nodes https://review.openstack.org/383029 | 21:05 |
*** shardy_afk is now known as shardy | 21:05 | |
*** penick has quit IRC | 21:05 | |
shardy | matbu: Hey I've been working on a revised patch but it's not quite complete | 21:05 |
shardy | I can either push what I have or finish it first thing tomorrow | 21:05 |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Fix formatting for supported distros in docs https://review.openstack.org/383464 | 21:06 |
*** penick has joined #tripleo | 21:07 | |
*** trown is now known as trown|outtypewww | 21:11 | |
*** fultonj_ has joined #tripleo | 21:12 | |
openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient: Download templates from swift before processing with heatclient https://review.openstack.org/379547 | 21:13 |
*** maticue has quit IRC | 21:14 | |
EmilienM | shardy: I'll request rc3 Friday 9pm for you | 21:16 |
shardy | matbu: ^^ pushed my WIP patch, we can chat again tomorrow about it | 21:16 |
EmilienM | we really need to get this bug fixed before | 21:16 |
shardy | EmilienM: ack, thanks | 21:16 |
shardy | EmilienM: Yeah, I'll prioritize it tomorrow morning | 21:16 |
EmilienM | thx | 21:16 |
beagles | dprince: were you going to do the nova workers patches for tht? If not, I'll take it. I'll also go through the rest of the workers-as-a-number templates | 21:17 |
fultonj_ | shardy: EmilienM : you had +2'd https://review.openstack.org/#/c/382132/ before (only the commit message changed). CI just had slight issue. do you need a recheck before re-reviewing? | 21:18 |
*** tiswanso has quit IRC | 21:18 | |
dprince | beagles: the NovaWorkers patch is already a number though right? | 21:18 |
beagles | dprince: yup | 21:18 |
EmilienM | fultonj_: doing recheck | 21:19 |
beagles | dprince: umm.. actually not the patch, the current template | 21:19 |
dprince | beagles: so do we need to change t-h-t? | 21:19 |
fultonj_ | EmilienM: thanks | 21:19 |
beagles | dprince: fwict, with your fix to nova we don't need it right now. We might to consider changing tht to just not set anything for ocata | 21:20 |
beagles | "might to consider" = "might want to consider" | 21:20 |
dprince | beagles: Right. I suppose I like setting it to 0. That way we keep the integer validation in Heat templates | 21:20 |
dprince | beagles: we can debate this I suppose. For now though I was just planning on pushing to fix the Nova regression. This is a regression IMO | 21:21 |
mwhahaha | I was just looking at teh THT and thinking of switching it to a string with validation for a number or '' | 21:21 |
beagles | dprince: agreed | 21:21 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Enable firewalling by default on compute nodes https://review.openstack.org/383477 | 21:21 |
EmilienM | dprince: last one ^ | 21:21 |
beagles | mwhahaha: yeah..that'd be cool | 21:21 |
*** dprince has quit IRC | 21:21 | |
*** shardy has quit IRC | 21:22 | |
beagles | mwhahaha: too bad there isn't a way to make a parameter truly optional in heat but I presume that was a decision made for the best of reasons | 21:23 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates: Switch Nova workers to '' by default https://review.openstack.org/383478 | 21:24 |
mwhahaha | going to see if -^ works | 21:25 |
mwhahaha | nova isn't the only one we set 0 for the default for so if this works we'll probably need to update the other ones as well | 21:26 |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Generate ssh-hostkeys on boot for ironic agent https://review.openstack.org/383481 | 21:30 |
beagles | mwhahaha: yup | 21:30 |
beagles | mwhahaha: although for some services '0' means don't spawn any workers, i.e. do everything in a single process. Saves memory etc. | 21:31 |
mwhahaha | of course it does because why would we want a consistent experience across services | 21:31 |
beagles | mwhahaha: but I guess 0 is a number ;) | 21:31 |
beagles | mwhahaha: heh | 21:32 |
mwhahaha | the installer life | 21:32 |
beagles | mwhahaha: if we want it 0 in the gate, we can always set it that way as long as the validation allows | 21:32 |
beagles | s/gate/ci/ | 21:32 |
mwhahaha | http://i.imgur.com/F6b0h2v.gif <- the installer life | 21:33 |
beagles | lol | 21:34 |
ccamacho1 | mwhahaha++ | 21:35 |
EmilienM | mwhahaha: lol | 21:35 |
openstackgerrit | Ian Main proposed openstack/tripleo-heat-templates: WIP: Containerized Services for Composable Roles https://review.openstack.org/330659 | 21:38 |
*** cdearborn has quit IRC | 21:38 | |
*** pradk has quit IRC | 21:39 | |
*** mbozhenko has joined #tripleo | 21:42 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates: Switch Nova workers to '' by default https://review.openstack.org/383478 | 21:43 |
tbarron | EmilienM: gfidente mwhahaha marios beagles Jenkins likes https://review.openstack.org/#/c/382386/ - workflow? | 21:44 |
tbarron | EmilienM: also, do we wait for merge in master in this project before cherry-pick to stable/newton ? | 21:45 |
EmilienM | yes | 21:46 |
EmilienM | we wait | 21:46 |
tbarron | EmilienM: ack | 21:46 |
*** mbozhenko has quit IRC | 21:47 | |
*** rcernin has joined #tripleo | 21:47 | |
*** bnemec has quit IRC | 21:47 | |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add bugs link to docs https://review.openstack.org/383488 | 21:49 |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add low-hanging-fruit bug tag to docs https://review.openstack.org/383489 | 21:51 |
ccamacho1 | EmilienM man quick question .. Im going to sleep, I have: | 21:58 |
ccamacho1 | to be merged: (https://review.openstack.org/#/c/382911/ https://review.openstack.org/#/c/382217/) | 21:58 |
ccamacho1 | pending backport after master is merged: (https://review.openstack.org/#/c/382973/) | 21:58 |
ccamacho1 | to be backported: (https://review.openstack.org/#/c/382217/) | 21:58 |
ccamacho1 | Do you think you can check them, before GA? I'm falling asleep | 21:58 |
*** penick has quit IRC | 21:59 | |
*** rcernin has quit IRC | 21:59 | |
*** rcernin has joined #tripleo | 21:59 | |
*** absubram has quit IRC | 22:01 | |
slagle | ccamacho1: i can check back on them later tonight | 22:01 |
ccamacho1 | hey slagle! thanks man :) | 22:02 |
ccamacho1 | Its that im like super asleep right now | 22:02 |
ccamacho1 | :) | 22:02 |
ccamacho1 | ttl :) | 22:02 |
*** penick has joined #tripleo | 22:04 | |
openstackgerrit | Merged openstack/tripleo-common: Add the J2 exclude file exception (When file not found) https://review.openstack.org/382911 | 22:04 |
*** assassin has quit IRC | 22:07 | |
*** akshai has quit IRC | 22:07 | |
*** ubijtsa has joined #tripleo | 22:08 | |
*** ubijtsa is now known as Guest21331 | 22:08 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-common: Add the J2 exclude file exception (When file not found) https://review.openstack.org/382973 | 22:11 |
beagles | slagle: updated one of ccamacho1's backports.. though it looks like he still might be around ... | 22:12 |
ccamacho1 | beagles just shutting down the laptop | 22:13 |
ccamacho1 | :) | 22:13 |
*** ccamacho1 has quit IRC | 22:13 | |
beagles | 154239 | 22:14 |
beagles | ugh | 22:14 |
*** tiswanso has joined #tripleo | 22:16 | |
*** fultonj_ has quit IRC | 22:17 | |
*** abregman has quit IRC | 22:19 | |
*** ayoung has joined #tripleo | 22:21 | |
openstackgerrit | Guil Barros proposed openstack/tripleo-heat-templates: Update OpenContrail loadbalancer plugin value https://review.openstack.org/383497 | 22:22 |
openstackgerrit | Guil Barros proposed openstack/tripleo-heat-templates: Update OpenContrail loadbalancer plugin value https://review.openstack.org/383498 | 22:23 |
*** morazi has quit IRC | 22:24 | |
mwhahaha | beagles: nope looks like you can't mix numbers and strings in heat templates | 22:27 |
beagles | mwhahaha: crap | 22:27 |
mwhahaha | u'message': u"Failed to run action [action_ex_id=be268ff5-e0e1-4a21-9287-444d9e6a83cf, action_cls='<class 'mistral.actions.action_factory.DeployStackAction'>', attributes='{}', params='{u'container': u'overcloud', u'timeout': 80}']\n ERROR: Failed to validate: : resources.ControllerServiceChain: : Failed to validate nested template: Failed to validate: | 22:27 |
mwhahaha | resources[24]: Parameter 'NovaWorkers' is invalid: Invalid default 1 (expected string or buffer)", | 22:27 |
mwhahaha | yay artificial complexities | 22:28 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates: Switch Nova workers to '' by default https://review.openstack.org/383478 | 22:30 |
*** rhallisey has quit IRC | 22:40 | |
*** rhallisey has joined #tripleo | 22:40 | |
*** rhallisey has joined #tripleo | 22:41 | |
*** rhallisey has quit IRC | 22:41 | |
*** apetrich has quit IRC | 23:03 | |
*** apetrich has joined #tripleo | 23:04 | |
*** tiswanso has quit IRC | 23:04 | |
*** ayoung has quit IRC | 23:05 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB https://review.openstack.org/381094 | 23:06 |
*** saneax-_-|AFK is now known as saneax | 23:12 | |
*** jcoufal has joined #tripleo | 23:13 | |
*** abehl has quit IRC | 23:18 | |
*** anshul has joined #tripleo | 23:19 | |
*** anshul has quit IRC | 23:23 | |
openstackgerrit | Merged openstack/puppet-tripleo: Enable usage of "short names" for Galera cluster https://review.openstack.org/382883 | 23:24 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Add Select per-network hostnames for service_node_names to role.role.j2.yaml https://review.openstack.org/382217 | 23:24 |
openstackgerrit | Merged openstack/tripleo-common: Add the KeystoneCredential0 and KeystoneCredential1 parameters https://review.openstack.org/381169 | 23:24 |
openstackgerrit | Merged openstack/instack-undercloud: Revert "Stop pinning Glance API version on stackrc" https://review.openstack.org/383091 | 23:24 |
*** thrash is now known as thrash|g0ne | 23:33 | |
*** rcernin has quit IRC | 23:36 | |
*** mbozhenko has joined #tripleo | 23:42 | |
*** mbozhenko has quit IRC | 23:47 | |
*** ayoung has joined #tripleo | 23:49 | |
*** dtantsur|afk has quit IRC | 23:53 | |
*** jcoufal has quit IRC | 23:54 | |
*** pcaruana has quit IRC | 23:55 | |
*** pblaho has quit IRC | 23:55 | |
*** jcoufal has joined #tripleo | 23:57 | |
*** bana_k has quit IRC | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!