bnemec | bkero: Take a look at the deploy args: http://logs.openstack.org/06/353506/46/check/gate-tripleo-ci-centos-7-nonha-multinode/104e2ba/console.html#_2016-09-12_21_14_47_411974 | 00:00 |
---|---|---|
bnemec | My guess would be that you're missing the validation errors nonfatal one. | 00:01 |
bkero | bnemec: Ahh, yeah. I had to remove that one because I was targeting mitaka. | 00:01 |
bkero | but now I'm trying master -- let's see if that's it. | 00:02 |
*** jobewan has joined #tripleo | 00:09 | |
thrash | EmilienM: https://review.openstack.org/#/c/368808/ didn't merge.. I'll backport as soon as that lands on stable/newton | 00:12 |
thrash | EmilienM: I did a recheck on it. | 00:12 |
*** mbound has quit IRC | 00:16 | |
*** limao has joined #tripleo | 00:39 | |
EmilienM | thrash: ok thx | 00:40 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: set up quickstart to replace instack-virt-setup https://review.openstack.org/358089 | 00:53 |
openstackgerrit | yuyafei proposed openstack/tripleo-common: Replace raw_input with input to make PY3 compatible https://review.openstack.org/337129 | 01:01 |
*** rbrady has quit IRC | 01:10 | |
*** akshai_ has quit IRC | 01:10 | |
*** bana_k has quit IRC | 01:11 | |
*** cwolferh has quit IRC | 01:12 | |
*** bana_k has joined #tripleo | 01:12 | |
*** pmannidi has joined #tripleo | 01:13 | |
*** bana_k has quit IRC | 01:13 | |
*** chlong_ has joined #tripleo | 01:13 | |
*** mbound has joined #tripleo | 01:16 | |
*** mburned is now known as mburned_out | 01:17 | |
*** fultonj has quit IRC | 01:19 | |
*** mbound has quit IRC | 01:22 | |
*** saneax is now known as saneax-_-|AFK | 01:22 | |
*** rbrady has joined #tripleo | 01:26 | |
*** rbrady has joined #tripleo | 01:26 | |
*** jobewan has quit IRC | 01:32 | |
*** rbrady has quit IRC | 01:44 | |
*** chlong_ has quit IRC | 01:49 | |
*** fzdarsky has joined #tripleo | 01:54 | |
*** egafford has joined #tripleo | 01:55 | |
*** egafford has quit IRC | 02:00 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Expose parameter to enable combination alarms https://review.openstack.org/363748 | 02:03 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Add fluentd client service https://review.openstack.org/353506 | 02:04 |
*** chlong_ has joined #tripleo | 02:05 | |
*** dmacpher has joined #tripleo | 02:07 | |
*** myoung|bbl is now known as myoung | 02:10 | |
openstackgerrit | Merged openstack/puppet-tripleo: Fill DNS name for haproxy certificates https://review.openstack.org/368559 | 02:21 |
*** bkopilov__ has quit IRC | 02:24 | |
*** bkopilov_ has quit IRC | 02:26 | |
*** bkopilov has quit IRC | 02:27 | |
*** yamahata has quit IRC | 02:29 | |
*** fzdarsky has quit IRC | 02:51 | |
*** thrash is now known as thrash|g0ne | 03:02 | |
*** Ryjedo_ has joined #tripleo | 03:09 | |
*** Ryjedo has quit IRC | 03:10 | |
*** Ryjedo_ is now known as Ryjedo | 03:10 | |
*** tzumainn has quit IRC | 03:12 | |
*** pmannidi has quit IRC | 03:19 | |
*** jobewan has joined #tripleo | 03:26 | |
*** rhefner has joined #tripleo | 03:29 | |
*** yamahata has joined #tripleo | 03:29 | |
*** coolsvap has joined #tripleo | 03:34 | |
*** bana_k has joined #tripleo | 03:36 | |
*** oshvartz has quit IRC | 03:43 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: set up quickstart to replace instack-virt-setup https://review.openstack.org/358089 | 03:45 |
*** bkopilov has joined #tripleo | 03:51 | |
*** bkopilov_ has joined #tripleo | 03:51 | |
*** bkopilov__ has joined #tripleo | 03:52 | |
*** rbrady has joined #tripleo | 03:52 | |
*** yamahata has quit IRC | 03:54 | |
*** nyechiel has joined #tripleo | 03:55 | |
*** nyechiel has quit IRC | 03:55 | |
*** oshvartz has joined #tripleo | 03:58 | |
*** nyechiel has joined #tripleo | 03:59 | |
*** bana_k has quit IRC | 04:01 | |
*** pmannidi has joined #tripleo | 04:04 | |
openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Use centos-release-ceph-jewel package https://review.openstack.org/369137 | 04:04 |
*** myoung is now known as myoung|afk | 04:06 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-docs: Use centos-release-ceph-jewel package https://review.openstack.org/369139 | 04:08 |
*** karthiks has joined #tripleo | 04:21 | |
*** oshvartz has quit IRC | 04:24 | |
*** skramaja has joined #tripleo | 04:25 | |
*** pgadiya has joined #tripleo | 04:58 | |
*** limao has quit IRC | 04:59 | |
*** limao has joined #tripleo | 05:01 | |
openstackgerrit | Saravanan KR proposed openstack/os-net-config: Fixed nic numbering issue of DPDK nics after the nic has bound https://review.openstack.org/364354 | 05:01 |
*** cwolferh has joined #tripleo | 05:04 | |
*** jtomasek has quit IRC | 05:08 | |
*** masco has joined #tripleo | 05:13 | |
openstackgerrit | Saravanan KR proposed openstack/os-net-config: Fixed nic numbering issue of DPDK nics after the nic has bound https://review.openstack.org/364354 | 05:17 |
*** anshul has joined #tripleo | 05:20 | |
*** jaosorior has joined #tripleo | 05:21 | |
*** anshul has quit IRC | 05:22 | |
*** anshul has joined #tripleo | 05:23 | |
*** bandini has joined #tripleo | 05:23 | |
jaosorior | d0ugal: let me know when you're online | 05:28 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Hook internal TLS flag to apache-based services https://review.openstack.org/366075 | 05:29 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add flag for internal TLS https://review.openstack.org/365942 | 05:29 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add HAProxy TLS handled by certmonger as composable service https://review.openstack.org/356430 | 05:29 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add option to specify Certmonger CA https://review.openstack.org/368643 | 05:29 |
*** anshul has quit IRC | 05:31 | |
*** penick has joined #tripleo | 05:39 | |
*** dsariel has joined #tripleo | 05:41 | |
*** dbecker has joined #tripleo | 05:46 | |
*** anshul has joined #tripleo | 05:47 | |
*** flepied has quit IRC | 05:47 | |
*** oshvartz has joined #tripleo | 05:50 | |
*** jobewan has quit IRC | 05:52 | |
*** saneax-_-|AFK is now known as saneax | 06:00 | |
*** rasca has joined #tripleo | 06:03 | |
openstackgerrit | Merged openstack/diskimage-builder: Fix mellanox element required kernel modules and user space packages https://review.openstack.org/365312 | 06:07 |
*** jlinkes has joined #tripleo | 06:11 | |
*** rcernin has joined #tripleo | 06:19 | |
*** dmacpher has quit IRC | 06:22 | |
*** penick has quit IRC | 06:24 | |
*** fragatina has quit IRC | 06:25 | |
*** flepied has joined #tripleo | 06:25 | |
*** fragatina has joined #tripleo | 06:26 | |
*** jprovazn has joined #tripleo | 06:28 | |
*** fragatin_ has joined #tripleo | 06:29 | |
*** fragatina has quit IRC | 06:30 | |
*** liverpooler has joined #tripleo | 06:32 | |
*** fragatin_ has quit IRC | 06:33 | |
*** masco has quit IRC | 06:34 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Terminate Zaqar websocket endpoint in HAProxy https://review.openstack.org/360329 | 06:35 |
*** athomas has joined #tripleo | 06:40 | |
*** panda|Zz is now known as panda | 06:40 | |
panda | periodic jobs did not run today ? | 06:46 |
*** masco has joined #tripleo | 06:48 | |
*** dixiaoli has quit IRC | 06:48 | |
*** jcoufal has joined #tripleo | 06:50 | |
*** tremble has joined #tripleo | 06:56 | |
*** florianf has joined #tripleo | 06:56 | |
*** dixiaoli has joined #tripleo | 06:58 | |
*** pcaruana has joined #tripleo | 07:02 | |
*** mcornea has joined #tripleo | 07:07 | |
*** tesseract- has joined #tripleo | 07:08 | |
*** shardy has joined #tripleo | 07:08 | |
*** jtomasek has joined #tripleo | 07:10 | |
*** anshul has quit IRC | 07:10 | |
*** dprince has joined #tripleo | 07:13 | |
shardy | d0ugal: hey, can you check https://bugs.launchpad.net/tripleo/+bug/1622720 please? | 07:16 |
openstack | Launchpad bug 1622720 in tripleo "deploying an overcloud a second time after a failure, doesn't find overcloud.yaml" [Undecided,New] | 07:16 |
shardy | looks like we don't re-run the jinja templating action when updating the plan | 07:16 |
jaosorior | shardy: I actually ran into that yesterday | 07:16 |
jaosorior | shardy: also have been seeing a bunch of issues with swift not being able to find overcloud-without-mergepy.yaml | 07:17 |
*** jbadiapa has joined #tripleo | 07:18 | |
*** ccamacho has joined #tripleo | 07:19 | |
shardy | jaosorior: Yeah, the problem is we're not always running the ProcessTemplatesAction I think, which means only overcloud.j2.yaml (not overcloud.yaml) exists in the plan | 07:21 |
shardy | the CreatePlan workflow includes that action, but I suspect the update plan one doesn't | 07:22 |
*** shardy is now known as shardy_mtg | 07:22 | |
*** anshul has joined #tripleo | 07:23 | |
*** ifarkas_afk is now known as ifarkas | 07:24 | |
*** ebarrera has joined #tripleo | 07:26 | |
*** jpena|off is now known as jpena | 07:37 | |
d0ugal | shardy_mtg: Yeah, I opened another bug for that | 07:37 |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Add update puppet-lint to check puppet-tripleo manifests https://review.openstack.org/352847 | 07:38 |
jaosorior | d0ugal: do you know what uses zaqar queues besides mistral? | 07:39 |
d0ugal | jaosorior: no, nothing that I am aware of. | 07:40 |
jaosorior | alright | 07:40 |
*** dciabrin|away is now known as dciabrin | 07:41 | |
*** b00tcat has quit IRC | 07:42 | |
*** zoli_gone-proxy is now known as zoliXXL | 07:44 | |
*** dsneddon has joined #tripleo | 07:44 | |
*** dsariel has quit IRC | 07:46 | |
*** dbecker has quit IRC | 07:48 | |
*** aufi has joined #tripleo | 07:48 | |
*** pmannidi has quit IRC | 07:48 | |
*** openstackgerrit has quit IRC | 07:48 | |
*** openstackgerrit has joined #tripleo | 07:49 | |
*** dtantsur|afk is now known as dtantsur | 07:53 | |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Add process templates to the update_deployment_plan workflow https://review.openstack.org/369202 | 07:55 |
*** ohamada has joined #tripleo | 07:55 | |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Add process templates to the update_deployment_plan workflow https://review.openstack.org/369202 | 07:56 |
*** hjensas has joined #tripleo | 07:56 | |
*** hjensas has joined #tripleo | 07:56 | |
*** jpich has joined #tripleo | 08:03 | |
d0ugal | shardy_mtg, jaosorior: https://review.openstack.org/#/c/369202 | 08:04 |
d0ugal | Just testing this. | 08:04 |
jaosorior | d0ugal: dude... | 08:05 |
jaosorior | I'm running into a VERY funky issue now | 08:05 |
*** mbound has joined #tripleo | 08:05 | |
jaosorior | mistral is failing executions because of this | 08:05 |
jaosorior | ZaqarAction.queue_post failed: <class 'zaqarclient.transport.errors.MalformedRequest'>: Error response from Zaqar. Code: 400. Title: Invalid API request. Description: Message collection size is too large. Max size 524288. | 08:05 |
d0ugal | jaosorior: hey, stop finding new issues I am still trying to fix the previous one :P | 08:06 |
*** dsariel has joined #tripleo | 08:07 | |
d0ugal | jaosorior: That is weird. | 08:07 |
d0ugal | jaosorior: Failing all executions? | 08:07 |
jaosorior | d0ugal: no | 08:08 |
jaosorior | d0ugal: only the overcloud deploy | 08:08 |
jaosorior | introspection succeeds | 08:08 |
d0ugal | I wonder why your message is so big. | 08:08 |
jaosorior | d0ugal: well, it might be cause I have a lot of environments that I'm passing | 08:08 |
d0ugal | There was a patch to increase the upper limit, but I forgot what happened to it. | 08:08 |
jaosorior | gonna try with a simple one | 08:08 |
d0ugal | jaosorior: They shouldn't be passed to zaqar tho' | 08:08 |
jaosorior | also I'm seeing mongodb errors in zaqar | 08:08 |
d0ugal | oh, that is weird. | 08:09 |
jaosorior | InvalidDocument: key 'https://172.29.172.2:13808/v1/AUTH_91630ce28aae44fdb89cb906e5bac785/overcloud/puppet/services/nova-consoleauth.yaml' must not contain '.' | 08:09 |
*** b00tcat has joined #tripleo | 08:09 | |
d0ugal | I have never seen a mongo error - zaqar uses mongo? | 08:09 |
jaosorior | d0ugal: yes, heavily | 08:09 |
d0ugal | lol | 08:09 |
jaosorior | and mistral forces stuff to use the public endpoint haha | 08:10 |
jaosorior | but I'm fixing that one at the moment | 08:10 |
d0ugal | hrm | 08:10 |
d0ugal | cool | 08:10 |
*** zoliXXL is now known as zoli|trng | 08:10 | |
d0ugal | jaosorior: Actually, nevermind - it wasn't a Zaqar limit I had seen before it was a Mistral execution input | 08:11 |
d0ugal | but we changed things | 08:11 |
d0ugal | so you are in totally new ground again. | 08:11 |
jpich | There was a patch merged recently to raise the Zaqar limit -> https://review.openstack.org/#/c/368197/ | 08:11 |
jaosorior | d0ugal: all I wanted was to get TLS everywhere working :( | 08:11 |
jaosorior | (for haproxy) | 08:12 |
jaosorior | jpich: nice! | 08:12 |
jaosorior | let me try that out | 08:12 |
d0ugal | jaosorior: Based on the error you have, it seems you don't have that new limit | 08:12 |
jpich | Hopefully that helps! | 08:12 |
d0ugal | jaosorior: so I guess you are hitting whatever slagle hit? | 08:12 |
d0ugal | jpich: Thanks, it does! | 08:13 |
d0ugal | or, it should? | 08:13 |
jpich | d0ugal: Exactly my thoughts ;) | 08:14 |
*** limao has quit IRC | 08:14 | |
*** sshnaidm|pto is now known as sshnaidm | 08:16 | |
jaosorior | awww yes | 08:16 |
jaosorior | that seems to have worked | 08:16 |
d0ugal | \o/ | 08:16 |
jaosorior | the deploy is on-going | 08:16 |
jaosorior | but | 08:16 |
jaosorior | there is an execution that failed | 08:16 |
jaosorior | for some reason | 08:16 |
jaosorior | though it seems like a non-fatal error | 08:17 |
jaosorior | yeah | 08:17 |
jaosorior | create_deployment_plan failed | 08:17 |
jaosorior | but deploy_plan succeeded | 08:17 |
jaosorior | d0ugal: any idea what's up? | 08:17 |
*** limao has joined #tripleo | 08:18 | |
*** lmiccini_ has joined #tripleo | 08:19 | |
d0ugal | jaosorior: I'd need to see the details | 08:19 |
d0ugal | jaosorior: mistral execution-get $ID | 08:19 |
jaosorior | error message says Failure caused by error in tasks: notify_zaqar | 08:19 |
jaosorior | aaand the logs say ZaqarAction.queue_post failed: <class 'zaqarclient.transport.errors.ServiceUnavailableError'>: Error response from Zaqar. Code: 503. Title: Service temporarily unavailable. Description: Messages could not be en | 08:20 |
jaosorior | queued. Please try again in a few seconds.. | 08:20 |
jaosorior | what the hell | 08:20 |
*** lmiccini has quit IRC | 08:20 | |
jaosorior | yeah, and zaqar seems to be failing with the mongodb error | 08:20 |
jaosorior | InvalidDocument: key 'http://172.29.172.1:8080/v1/AUTH_91630ce28aae44fdb89cb906e5bac785/overcloud/puppet/services/keystone.yaml' must not contain '.' | 08:20 |
d0ugal | jaosorior: dang, i feel like something is wrong with your Zaqar/Mongo | 08:20 |
jaosorior | well, looking at the documentation | 08:21 |
jaosorior | it seems that it's mongodb's default behavior not to take periods as keys | 08:21 |
jaosorior | so in that case, I'm surprised how it worked earlier | 08:21 |
d0ugal | Yeah, that is weird. | 08:21 |
*** electrofelix has joined #tripleo | 08:22 | |
d0ugal | jaosorior: I don't understand why zaqar is making a document with that key? | 08:22 |
d0ugal | jaosorior: That looks like the swift url | 08:22 |
d0ugal | something very strange is going on | 08:22 |
d0ugal | brb | 08:23 |
*** lucas-dinner is now known as lucasagomes | 08:23 | |
*** bkopilov__ has quit IRC | 08:24 | |
*** bkopilov_ has quit IRC | 08:24 | |
*** lmiccini_ is now known as lmiccini | 08:25 | |
*** dsneddon has quit IRC | 08:29 | |
openstackgerrit | Imre Farkas proposed openstack/tripleo-common: Default to Ironic API v1.15 https://review.openstack.org/364319 | 08:30 |
*** zigo_ is now known as zigo | 08:34 | |
*** dbecker has joined #tripleo | 08:37 | |
skramaja | shardy_mtg: there is an issue in os-net-config for DPDK interface binding. i have raised bug - https://bugs.launchpad.net/os-net-config/+bug/1619330 | 08:38 |
openstack | Launchpad bug 1619330 in os-net-config "os-net-config fails on 2nd run with DPDK net config" [Undecided,In progress] - Assigned to Saravanan KR (skramaja) | 08:38 |
skramaja | shardy_mtg: and the corresponding review is - https://review.openstack.org/#/c/364354/, could you comment on the approach? | 08:38 |
*** milan has joined #tripleo | 08:40 | |
*** dsneddon has joined #tripleo | 08:40 | |
*** jistr is now known as jistr|mtgs | 08:43 | |
jaosorior | d0ugal: I don't understand either... I honestly don't even know what the relation from swift to zaqar is | 08:44 |
therve | jaosorior, *presumably*, you're uploading template info into Zaqar. Templates can contain switf temp URLs. | 08:47 |
jaosorior | well that makes sense | 08:47 |
jaosorior | and the swift temp URL will most likely contain some path to the file | 08:48 |
jaosorior | which may contain periods | 08:48 |
jaosorior | aaand that's not actually supported by zaqar | 08:48 |
jaosorior | well that's a bummer | 08:48 |
d0ugal | therve, jaosorior - the only template related messages that should get sent to Zaqar are responses from Heat AFAIK. | 08:52 |
d0ugal | but I have no idea why Zaqar would use that contents as a key in Mongo. That makes no sense to me. | 08:52 |
*** dtantsur is now known as dtantsur|bbl | 08:53 | |
openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Verify that the Deployment Plan creation was successful https://review.openstack.org/369247 | 08:53 |
openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Verify that the Deployment Plan creation was successful https://review.openstack.org/369247 | 08:54 |
therve | d0ugal, zaqar directly store messages as mongo document, AFAIK | 08:57 |
*** saneax is now known as saneax-_-|AFK | 08:57 | |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Add template processing to the update plan workflow. https://review.openstack.org/368760 | 08:58 |
*** hjensas has quit IRC | 09:00 | |
openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Verify that the Deployment Plan creation was successful https://review.openstack.org/369247 | 09:00 |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Add update puppet-lint to check puppet-tripleo manifests https://review.openstack.org/352847 | 09:04 |
therve | d0ugal, jaosorior: I have a workaround if you're blocked | 09:04 |
*** skramaja has quit IRC | 09:04 | |
jaosorior | therve: I am interested in that workaround | 09:05 |
jaosorior | was gonna start working on a zaqar fix | 09:05 |
jaosorior | therve: I'm gonna go for lunch, but I'll check it out when I'm back | 09:05 |
*** jaosorior is now known as jaosorior_lunch | 09:05 | |
therve | jaosorior_lunch, http://paste.openstack.org/show/573542/ | 09:05 |
d0ugal | I am interested to, it might lead me to a fix :) | 09:06 |
d0ugal | therve: thanks | 09:06 |
d0ugal | hah, that I didn't expect :) | 09:06 |
jaosorior_lunch | therve: lol, I was gonna do basically that, but for all of mongodb's operations in the zaqar code-base | 09:06 |
jaosorior_lunch | well, adding a config option for that | 09:06 |
*** skramaja has joined #tripleo | 09:06 | |
jaosorior_lunch | anyway, that's great | 09:06 |
therve | Kinda :) | 09:07 |
therve | I think the real fix is to store the message as a blob | 09:07 |
therve | I don't think we support query operations on it anyway | 09:07 |
EmilienM | Good morning | 09:08 |
d0ugal | EmilienM: Morning | 09:08 |
d0ugal | EmilienM: early start? | 09:08 |
EmilienM | Yeah busy week | 09:08 |
d0ugal | Can't imagine why :) | 09:09 |
EmilienM | HA job looks red, I'll look | 09:09 |
*** hjensas has joined #tripleo | 09:11 | |
*** hjensas has quit IRC | 09:11 | |
*** hjensas has joined #tripleo | 09:11 | |
*** paramite has joined #tripleo | 09:15 | |
d0ugal | jaosorior_lunch, therve: FWIW, I am now hitting that issue. So I'll try this workaround :) | 09:18 |
sshnaidm | EmilienM, hi, I see all ha jobs fail from yesterday | 09:19 |
EmilienM | sshnaidm: I know | 09:20 |
EmilienM | I thought we fixed it | 09:20 |
EmilienM | but I still see the galera problem | 09:20 |
*** chem has joined #tripleo | 09:21 | |
EmilienM | wait I think I know why | 09:21 |
EmilienM | we have galera-25.3.12-2.el7.x86_64 but we should not since we don't deploy EPEL | 09:22 |
EmilienM | sshnaidm: look, we had it working here: https://review.openstack.org/#/c/347499/ | 09:22 |
*** saneax-_-|AFK is now known as saneax | 09:23 | |
*** fragatina has joined #tripleo | 09:26 | |
openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient: Do not include epel element when building overcloud images https://review.openstack.org/369276 | 09:26 |
EmilienM | I think we'll need this backport ^ | 09:26 |
*** limao has quit IRC | 09:28 | |
*** fragatina has quit IRC | 09:30 | |
EmilienM | d0ugal, therve: sorry for stupid question but are you guys talking about CI failures with mistral/zaqar? | 09:30 |
EmilienM | http://logs.openstack.org/66/364966/2/check/gate-tripleo-ci-centos-7-nonha-multinode/b2226a9/console.html#_2016-09-13_02_46_50_621744 | 09:30 |
EmilienM | is it what you're talking about? ^ | 09:31 |
therve | EmilienM, Possibly | 09:32 |
therve | EmilienM, Is it tripleo master? I don't see how it could have passed the gate in the fist place | 09:33 |
EmilienM | I see a high percent of failing CI jobs | 09:33 |
EmilienM | therve: yes | 09:33 |
therve | EmilienM, http://logs.openstack.org/66/364966/2/check/gate-tripleo-ci-centos-7-nonha-multinode/b2226a9/logs/var/log/zaqar/zaqar.txt.gz is the error we're talking about, but not sure it's the root cause | 09:33 |
EmilienM | stable/newton | 09:33 |
*** r-mibu has quit IRC | 09:34 | |
*** derekh has joined #tripleo | 09:34 | |
EmilienM | but it's master for most of projects except tripleoclient | 09:34 |
*** r-mibu has joined #tripleo | 09:34 | |
therve | stable/newton? Is that a thing already? | 09:34 |
EmilienM | we didn't branch others yet | 09:34 |
EmilienM | therve: for clients, yes. | 09:34 |
therve | Ah | 09:34 |
*** dbecker has quit IRC | 09:34 | |
therve | EmilienM, If I propose a zaqar patch can you check if it fixes the issue? | 09:34 |
EmilienM | therve: yes | 09:35 |
EmilienM | let me check if zaqar Ci has tripleo jobs otherwise we can use Depends-On | 09:35 |
EmilienM | so 1) submit your patch in Zaqar 2) send a dummy patch in tripleo-ci and use Depends-On the zaqar patch | 09:36 |
EmilienM | it should work | 09:36 |
therve | EmilienM, https://review.openstack.org/369233 | 09:36 |
therve | No | 09:36 |
therve | EmilienM, https://review.openstack.org/369285 this one | 09:37 |
EmilienM | therve: I can test it, let me do the patch | 09:37 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: DNM: test https://review.openstack.org/#/c/369285/ https://review.openstack.org/369289 | 09:38 |
EmilienM | therve: ^ let's see | 09:38 |
EmilienM | therve: on another topic, I see puppet CI failed to promote RDO repo last night because of heat timeout | 09:39 |
EmilienM | http://logs.openstack.org/01/369201/1/check/gate-puppet-openstack-integration-3-scenario003-tempest-centos-7/5db05f9/console.html#_2016-09-13_08_37_16_806586 | 09:39 |
EmilienM | have you already seen that error in CI? | 09:39 |
EmilienM | looks like related to this trace: http://logs.openstack.org/01/369201/1/check/gate-puppet-openstack-integration-3-scenario003-tempest-centos-7/5db05f9/logs/heat/heat-engine.txt.gz#_2016-09-13_08_17_09_100 | 09:40 |
sshnaidm | EmilienM, in tripleo ci it passed yesteday: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-tempest/99df38e/console.html#_2016-09-12_07_54_10_621490 | 09:41 |
panda | EmilienM: w/r/t epel remove change, should it backported to mitaka and liberty too ? I see liberty HA fail with the same error | 09:42 |
panda | EmilienM: oh wait, what are you doing awake ? | 09:42 |
EmilienM | panda: yes | 09:42 |
d0ugal | Do people think we can land https://review.openstack.org/#/c/335460/ with the ha failure? | 09:42 |
EmilienM | I submitted the patch | 09:42 |
* d0ugal really wants to get rid of the warnings on every command | 09:43 | |
EmilienM | sshnaidm: yes I know, we removed EPEL in CI and it was supposed to fix our issue, as job was green | 09:43 |
*** saneax is now known as saneax-_-|AFK | 09:44 | |
panda | EmilienM: ok, filing a bug to keep track of the changes | 09:44 |
EmilienM | panda: see https://review.openstack.org/#/c/369276/ | 09:44 |
therve | EmilienM, Sorry I don't know that failure. | 09:44 |
EmilienM | therve: np I'll file a bug | 09:46 |
*** dbecker has joined #tripleo | 09:50 | |
derekh | EmilienM: looking at the HA problems, do you know yet why the epel removal worked in CI but hasn't worked post merge? | 09:52 |
derekh | EmilienM: I think I know why | 09:52 |
*** tosky has joined #tripleo | 09:52 | |
EmilienM | derekh: whyN | 09:52 |
derekh | EmilienM: I havn't looked into it much but I'm guessing that EPEL is installed on the cached image | 09:53 |
derekh | EmilienM: the tripleo-ci patch didn't use the cached image because there was a depends-on for a patch on DIB | 09:53 |
EmilienM | dciabrin: ^ fyi | 09:53 |
EmilienM | ah | 09:53 |
EmilienM | derekh: it makes sense | 09:53 |
derekh | EmilienM: we don't use the cached image in DIB patches | 09:53 |
EmilienM | how can we update the cached image? | 09:53 |
derekh | EmilienM: sshnaidm did the periodic job pass last night? that would update it | 09:54 |
sshnaidm | derekh, the ones before last passed | 09:55 |
derekh | sshnaidm: ok, that one still had EPEL | 09:56 |
sshnaidm | 09-12 | 09:56 |
EmilienM | ok we need periodic job passing | 09:56 |
EmilienM | sshnaidm: why did it fail? | 09:56 |
sshnaidm | EmilienM, last jobs fail because this mysql problem exactly.. | 09:56 |
EmilienM | what? | 09:56 |
EmilienM | at what time | 09:56 |
derekh | EmilienM: sshnaidm so there are 2 options, 1. get a new cached image with a fake periodic job today (if we know why it failed) , or 2. disable the image cache until we have another promote | 09:56 |
EmilienM | derekh: I consider #2 the quickest option | 09:57 |
sshnaidm | EmilienM, http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha/588856a/ | 09:57 |
EmilienM | at this stage of the cycle, we really need CI working | 09:57 |
EmilienM | sshnaidm: did it have EPEL? | 09:57 |
derekh | hmmm, this mornings periodic job shouldn't have had EPEL should it? | 09:58 |
EmilienM | right | 09:59 |
panda | stupid question, I see the fix is for master and newton, are periodic jobs deploying mitaka and liberty ? | 09:59 |
EmilienM | derekh: as a backup solution, can you kickoff a patch that disable image caching? | 09:59 |
derekh | EmilienM: yup | 09:59 |
EmilienM | thx | 10:00 |
EmilienM | i'm debugging the periodic job now | 10:00 |
sshnaidm | as I see they do | 10:00 |
*** saneax-_-|AFK is now known as saneax | 10:00 | |
sshnaidm | EmilienM, derekh ^^ | 10:00 |
sshnaidm | EmilienM, derekh overcloud hosts have usual epel repo | 10:01 |
sshnaidm | the undercloud has /etc/yum.repos.d/epel.repo.rpmsave | 10:01 |
EmilienM | sshnaidm: can you run a fake periodic job please? | 10:02 |
panda | fake ? | 10:02 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Disable cache https://review.openstack.org/369303 | 10:02 |
sshnaidm | EmilienM, yes, sure | 10:02 |
derekh | EmilienM: ^ | 10:03 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK: periodic jobs https://review.openstack.org/359215 | 10:03 |
EmilienM | thx guys | 10:03 |
EmilienM | I'm adding more debug in our CI to have repolist | 10:04 |
panda | oh, that one | 10:04 |
*** jaosorior_lunch is now known as jaosorior | 10:04 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: get_host_info: get repos list https://review.openstack.org/369305 | 10:04 |
EmilienM | ^ let's see where is EPEL deployed and KILLIT forever :) | 10:05 |
panda | are periodic jobs even using cached images ? | 10:05 |
jaosorior | therve: so, got any example of storing it as a blob as you mentioned? | 10:05 |
jaosorior | d0ugal: did it work for you? | 10:05 |
derekh | panda: they wouldn't be, thats the confusing thing | 10:05 |
panda | derekh: and are they running mitaka and liberty only ? | 10:06 |
therve | jaosorior, http://paste.openstack.org/show/573555/ is one test I'm making | 10:06 |
therve | unit tests are blowing up quite spectacularly though | 10:06 |
derekh | panda: I'm not sure what you mean? | 10:06 |
sshnaidm | EmilienM, you have "/etc" folder within hostname.xz file, it's just not flattened as /var/log | 10:06 |
EmilienM | sshnaidm: right but my patch makes it easy to read in CI | 10:07 |
panda | derekh: the periodic jobs, which release are they deploying ? | 10:07 |
EmilienM | sshnaidm: I haven't looked files yet but will do in a few | 10:07 |
panda | derekh: I see that a periodic job ends with -liberty, but the others, are they mitaka ? | 10:07 |
derekh | panda: we have peridoc jobs for liberty, mitaka and master | 10:08 |
d0ugal | jaosorior: no :/ I'm not sure if I am doing something wrong tho' | 10:08 |
derekh | panda: only the master job builds an image that we use in the cach though | 10:08 |
*** skramaja has quit IRC | 10:09 | |
EmilienM | therve: re heat issue, it was transient FYI, job passed, we're promoting to trunk. | 10:12 |
therve | OK | 10:12 |
EmilienM | therve: probably timeouting because of running low resources in infra | 10:13 |
therve | Well presumably a 'real' failure, but we can look at it later | 10:13 |
EmilienM | therve: I'll file the bug anyway | 10:13 |
EmilienM | to keep record | 10:13 |
therve | Thanks | 10:13 |
panda | derekh: so, for what I understand, master HA fails because of the cache, mitaka and liberty may fail because the epel removal change was not back ported. Makes sense ? | 10:14 |
EmilienM | panda: yes | 10:14 |
EmilienM | exactly | 10:14 |
*** skramaja has joined #tripleo | 10:15 | |
derekh | panda: yes, but master-ha periodic is the confusing one | 10:15 |
panda | should we add a periodic-newton job too now ? | 10:16 |
EmilienM | panda: I created it already | 10:16 |
derekh | where did this job come from ? periodic-tripleo-ci-centos-7-promote-ovb-ha | 10:16 |
EmilienM | https://review.openstack.org/#/c/369024/ | 10:16 |
* derekh is curious | 10:16 | |
panda | EmilienM: of course, I had project-config 400 commits behind .. | 10:17 |
EmilienM | panda: I eat project-config for breakfast | 10:17 |
panda | diluted with coffee | 10:17 |
EmilienM | more seriously, I had to create the jobs since we're branching very soon | 10:18 |
*** thrash|g0ne is now known as thrash | 10:18 | |
panda | EmilienM: I understand, I asked because I was looking at a very old version of layout | 10:18 |
sshnaidm | does anybody know what is this job for? periodic-tripleo-ci-centos-7-promote-ovb-ha/ - http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-promote-ovb-ha/ | 10:19 |
sshnaidm | panda, EmilienM derekh ^^ | 10:19 |
EmilienM | no but first run is September 10th | 10:20 |
panda | sshnaidm: git blams shows slagle put it | 10:20 |
derekh | sshnaidm: I was wondering the same thing | 10:20 |
EmilienM | so maybe if we git log project-config we can see what created it? | 10:20 |
sshnaidm | ok, will ask slagle | 10:20 |
panda | commit c4f7fcf6f | 10:20 |
panda | derekh: I see periodic-tripleo-ci-centos-7-ovb-ha is using rdo-release mitaka, is that normal ? | 10:23 |
panda | shouldn't this be master ? | 10:23 |
EmilienM | probably it use latest GA | 10:23 |
panda | ok | 10:23 |
EmilienM | shardy_mtg: you aware about this job? | 10:23 |
jaosorior | therve: let me know when you get it working. I can test it out in my deployment | 10:24 |
derekh | EmilienM: sshnaidm so the reason the periodic job failed is because it used a repository with an old version of DIB , this one http://trunk.rdoproject.org/centos7/4c/93/4c93ad397ef9359797bb80cf930213b0b8028a28_073a7efe/ | 10:24 |
therve | jaosorior, The current patch doesn't work? | 10:24 |
derekh | EmilienM: sshnaidm panda DIB is from 2016-08-02 | 10:24 |
EmilienM | derekh: ah it's probably infra images are not updated | 10:24 |
EmilienM | dang | 10:24 |
*** lmiccini has quit IRC | 10:25 | |
EmilienM | I go back to sleep | 10:25 |
panda | ouch | 10:25 |
*** ayoung has quit IRC | 10:25 | |
jaosorior | therve: ah, I haven't tried your current patch | 10:25 |
derekh | EmilienM: panda sshnaidm so it still has EPEL , thewre is no mention of it being build in the delorean report http://trunk.rdoproject.org/centos7/report.html | 10:26 |
jaosorior | therve: you mean the one that gets the keys into blobs? | 10:26 |
therve | jaosorior, https://review.openstack.org/#/c/369285/ that one | 10:26 |
EmilienM | so we have no promotion because we haven't latest DIB but we haven't latest DIB because we have no promotion? | 10:26 |
*** saneax is now known as saneax-_-|AFK | 10:27 | |
sshnaidm | EmilienM, exactly | 10:27 |
EmilienM | great | 10:27 |
derekh | EmilienM: I'm not sure why we don't have latest DIB, .... rdo did start only building certain things on releast (instead of on commit), maybe DIB is one of those things | 10:27 |
sshnaidm | derekh, which version of dib do we need? I'll ask on #rdo | 10:27 |
EmilienM | maybe should we add DIB to the list of packages to take from latest consistent | 10:28 |
jaosorior | therve: thanks, I'll check that out | 10:28 |
EmilienM | sshnaidm: no need to ask | 10:28 |
sshnaidm | EmilienM, it is I think | 10:28 |
*** shardy_mtg is now known as shardy | 10:28 | |
EmilienM | you need the latest patch that remove EPEL | 10:28 |
EmilienM | merged yesterday | 10:28 |
sshnaidm | EmilienM, yeah, but it's not built as I understood from derekh | 10:29 |
sshnaidm | and this is could be a question to #rdo folks | 10:30 |
* derekh has asked in #rdo | 10:30 | |
*** pkovar has joined #tripleo | 10:30 | |
EmilienM | there is diskimage-builder-1.18.2-0.20160802165621.e884309.el7.centos.noarch.rpm in trunk | 10:30 |
EmilienM | July 27th ! | 10:31 |
EmilienM | oh dear | 10:31 |
*** ramishra has quit IRC | 10:31 | |
derekh | EmilienM: exactly, thats what I'm saying | 10:31 |
*** akrivoka has joined #tripleo | 10:32 | |
EmilienM | derekh: cool | 10:32 |
EmilienM | derekh: /me needs more coffee :P | 10:32 |
*** rodrigods has quit IRC | 10:32 | |
*** rodrigods has joined #tripleo | 10:32 | |
*** ifarkas has quit IRC | 10:33 | |
*** ifarkas has joined #tripleo | 10:33 | |
*** hjensas has quit IRC | 10:33 | |
panda | so, even if we backport the epel remove change to mitaka and liberty, we'll still need an updated version of DIB there ? | 10:33 |
derekh | EmilienM: the patch to stop using the cached image should work though, so we can merge that and go from there | 10:33 |
*** ramishra has joined #tripleo | 10:33 | |
EmilienM | derekh: i'm not sure, will it pick dib from source? | 10:34 |
EmilienM | derekh: maybe it worked in tripleo-ci patch because I had depends-on | 10:34 |
derekh | EmilienM: it will pick DIB from http://trunk.rdoproject.org/centos7/current/delorean.repo | 10:35 |
derekh | EmilienM: so master, because its on the includepkgs list http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/tripleo.sh#n270 | 10:36 |
derekh | EmilienM: yes, the depends-on made it work in CI | 10:36 |
EmilienM | derekh: current is https://trunk.rdoproject.org/centos7/c1/66/c166e4103d266a446751363e991656ffb9a547da_e74e2f6e/ | 10:36 |
*** saneax-_-|AFK is now known as saneax | 10:37 | |
EmilienM | and https://trunk.rdoproject.org/centos7/c1/66/c166e4103d266a446751363e991656ffb9a547da_e74e2f6e/ has old DIB | 10:37 |
EmilienM | iiuc | 10:37 |
EmilienM | so even with current, we're stucked | 10:37 |
jaosorior | therve: that did the trick for me | 10:37 |
sshnaidm | until we have a hack, removing epel mirrors from image | 10:37 |
*** ayoung has joined #tripleo | 10:37 | |
EmilienM | sshnaidm: yes! | 10:38 |
EmilienM | sshnaidm: I'm looking at releasing DIB now | 10:38 |
jaosorior | therve: the execution didn't fail, and zaqar didn't crash | 10:38 |
jaosorior | d0ugal: ^^ | 10:38 |
EmilienM | sshnaidm: can you look at where EPEL is deployed and remove it manually in tripleoCI until we have dib sorted out? | 10:38 |
EmilienM | if derekh approves this thing | 10:38 |
sshnaidm | EmilienM, yep, looking | 10:38 |
derekh | sshnaidm: EmilienM actually we can just make CI allways build DIB | 10:39 |
EmilienM | derekh: oh right. It would be easier in the meantime | 10:39 |
panda | faster | 10:39 |
panda | derekh: so, even if we backport the epel remove change to mitaka and liberty, we'll still need an updated version of DIB there ? | 10:40 |
*** mburned_out is now known as mburned | 10:40 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Remove EPEL mirror manually from image https://review.openstack.org/369325 | 10:41 |
derekh | panda: yup I think so | 10:41 |
EmilienM | panda: dib is branchless | 10:42 |
sshnaidm | EmilienM, derekh like so? ^^ | 10:42 |
EmilienM | so we only need the tripleoclient patch backported | 10:42 |
EmilienM | and we're good | 10:42 |
EmilienM | derekh: DIB release: https://review.openstack.org/369326 | 10:42 |
panda | EmilienM: and dib released at least | 10:42 |
EmilienM | derekh: I vote for fastest solution in the meantime, can you submit a patch in tripleo-ci to build dib from source? | 10:43 |
derekh | sshnaidm: that will remove epel from the cached image, yes but we'll still be using the old DIB | 10:44 |
derekh | EmilienM: will do | 10:44 |
sshnaidm | derekh, right | 10:44 |
*** dtantsur|bbl is now known as dtantsur | 10:44 | |
EmilienM | therve: https://bugs.launchpad.net/heat/+bug/1622979 | 10:46 |
openstack | Launchpad bug 1622979 in heat "Stack DELETE IN_PROGRESS: Unhandled error in asynchronous task" [Undecided,New] | 10:46 |
EmilienM | jaosorior: can you review this backport please? https://review.openstack.org/#/c/369276/ | 10:47 |
sshnaidm | EmilienM, derekh maybe it's time to see which of tripleo related projects are being built regularly, because we download them from last consistent repo that means to provide the latest packages, and in fact it doesn't | 10:47 |
*** dixiaoli has quit IRC | 10:47 | |
d0ugal | jaosorior: oh, nice - so it worked for you? | 10:47 |
*** flaper87 has joined #tripleo | 10:48 | |
*** flaper87 has joined #tripleo | 10:48 | |
d0ugal | jaosorior: Great, not sure how I patched it wrong :) I'll try again. | 10:48 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Always build DIB https://review.openstack.org/369329 | 10:48 |
derekh | EmilienM: sshnaidm ^ | 10:48 |
EmilienM | sshnaidm: right | 10:48 |
sshnaidm | EmilienM, derekh I mean those: https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L270 | 10:48 |
sshnaidm | derekh, maybe it's better to combine our patches? if building - use dib, if cached - use my hack | 10:49 |
derekh | sshnaidm: yes we should, the system we have was put in place back when rdo build all packages per commit, now that they have changed we may need to rethink things | 10:49 |
EmilienM | derekh: I added more context in a comment, and +2 | 10:49 |
sshnaidm | derekh, reenabling image building will increase the time again, and then to disable it again.. | 10:49 |
EmilienM | sshnaidm: I agree. Combining both could be an option. | 10:50 |
EmilienM | derekh: you ok? | 10:50 |
sshnaidm | EmilienM, derekh so I'll raise this maybe on the meeting today | 10:50 |
derekh | sshnaidm: yes it will, you patch might also need to uninstall galera from the cached image and reinstall it after epel is removed ? | 10:50 |
*** mhenkel has joined #tripleo | 10:51 | |
EmilienM | sshnaidm: I see no point of waiting for a meeting but if you want | 10:51 |
*** saneax is now known as saneax-_-|AFK | 10:51 | |
sshnaidm | derekh, hmm.. is it installed there already? if it has lower version (I'm not sure), it'll just be updated | 10:52 |
EmilienM | sshnaidm, derekh: feel free to squash your commits, I like the idea | 10:52 |
*** hjensas has joined #tripleo | 10:52 | |
*** hjensas has quit IRC | 10:52 | |
*** hjensas has joined #tripleo | 10:52 | |
EmilienM | sshnaidm: no, EPEL has higher version | 10:52 |
EmilienM | and we need a lower version, from RDO | 10:52 |
sshnaidm | EmilienM, derekh then if it's installed it's better to remove it, of course | 10:52 |
EmilienM | sshnaidm: go4it | 10:53 |
jaosorior | d0ugal: yeah, that worked for me | 10:53 |
jaosorior | d0ugal: now I'm unsure about the workflow though | 10:53 |
openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Add missing unit tests for the 'configure' workflows https://review.openstack.org/369332 | 10:53 |
sshnaidm | EmilienM, maybe it's better to raise it on rdo ML actually.. As I understand we need these packages to be built each commit anyway | 10:53 |
jaosorior | d0ugal: I guess we don't really do deploy anymore if we want to update | 10:53 |
jaosorior | there is a specific update command in tripleo CLI | 10:53 |
d0ugal | jaosorior: I don't follow - we don't really do deploy? | 10:54 |
sshnaidm | derekh, do you update your commit with mine? | 10:54 |
jaosorior | d0ugal: let me verify | 10:54 |
EmilienM | sshnaidm: I would rather ask on #rdo if we want to get it solved quickly | 10:54 |
jaosorior | wait up | 10:54 |
sshnaidm | EmilienM, ok | 10:55 |
EmilienM | jpena, number80 and apevec can help to have a quick reply | 10:55 |
derekh | sshnaidm: take mine and add it to your, then we'll have two going through CI, if there is a problem with the squash that we havn't thought about we can fall back to the cache disable | 10:55 |
jaosorior | d0ugal: so initially doing a deploy works | 10:56 |
jaosorior | and then if I try to do an overclou deploy again | 10:57 |
jaosorior | it fails | 10:57 |
sshnaidm | derekh, ok | 10:57 |
jaosorior | like this: http://paste.openstack.org/show/573568/ | 10:57 |
d0ugal | jaosorior: Yeah, because there is an issue with updating the plan in swift | 10:57 |
*** adarazs is now known as adarazs_lunch | 10:57 | |
d0ugal | due to the jinja2 changes | 10:57 |
d0ugal | jaosorior: That is what I am looking into now. | 10:58 |
jaosorior | right right | 10:59 |
*** ifarkas has quit IRC | 10:59 | |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Add template processing to the update plan workflow. https://review.openstack.org/368760 | 10:59 |
jaosorior | d0ugal: sorry about that, got confused | 10:59 |
d0ugal | jaosorior: no worries - I think ^ will fix it. | 10:59 |
d0ugal | jaosorior: I am just testing still | 11:00 |
d0ugal | I also realised that we changed what the workflow for create_plan returned - we need to be careful about that I guess. | 11:00 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Add NetApp Manila driver integration and tidy up generic https://review.openstack.org/354019 | 11:00 |
d0ugal | rbrady: ^ | 11:00 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Remove EPEL mirror manually from image https://review.openstack.org/369325 | 11:02 |
sshnaidm | derekh, EmilienM ^^ | 11:02 |
*** saneax-_-|AFK is now known as saneax | 11:02 | |
panda | sshnaidm: what reinstalls galera after removing it ? | 11:03 |
*** shardy is now known as shardy_mtg | 11:04 | |
d0ugal | jaosorior: yay, okay, I think I have fixed things. | 11:04 |
jaosorior | yay! | 11:05 |
jaosorior | :D | 11:05 |
EmilienM | panda, sshnaidm: tripleo-puppet-elements should install galera, but are we sure it runs after? | 11:05 |
sshnaidm | panda, good question | 11:05 |
sshnaidm | I'll install it again | 11:05 |
derekh | sshnaidm: see my comment also | 11:06 |
derekh | also is there anything the depends on galera that will also get uninstalled | 11:07 |
panda | the removal path is always more problematic | 11:08 |
jaosorior | d0ugal: so this is what got it working for you, right? | 11:08 |
jaosorior | https://review.openstack.org/#/c/368760/ | 11:08 |
sshnaidm | derekh, if I install it again, it should be ok I think | 11:09 |
sshnaidm | it's system package, less problematic than openstack packages | 11:09 |
*** dprince has quit IRC | 11:09 | |
derekh | sshnaidm: it depends, try it its the only way we'll find out, uninstalling it might cause other things to be uninstalled, then reinstalling it wont install them back again | 11:10 |
panda | I have the same feeling | 11:10 |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Add template processing to the update plan workflow. https://review.openstack.org/368760 | 11:10 |
*** mhenkel has quit IRC | 11:13 | |
derekh | zoli|trng: sshnaidm: btw, on friday we discovered the bastion was dropping traffic which looks like it was the reason we were weeing all kinds of network problem, we tweaked some conntrack setting and it appears to have fixed the problem | 11:14 |
sshnaidm | derekh, cool, great news | 11:15 |
sshnaidm | derekh, do we continue to be after the "bastion"? | 11:16 |
derekh | sshnaidm: be after the bastion? | 11:17 |
jaosorior | anybody knows where I can get the logs for the nodes registration? | 11:18 |
sshnaidm | derekh, sorry, do we still use it? | 11:18 |
derekh | sshnaidm: yes, all the public traffic goes through it | 11:18 |
sshnaidm | derekh, so we need also to look there in case of any network problems | 11:19 |
derekh | sshnaidm: but we have never had to do anything too it | 11:19 |
derekh | sshnaidm: yup | 11:19 |
sshnaidm | derekh, is it requirement? can't we just be opened | 11:20 |
marios | shardy_mtg: fwiw the jinja roles stuff is pretty cool from https://review.openstack.org/#/c/315679/ I had to rebase https://review.openstack.org/#/c/354019/ to add manila-backends to roles_data.yaml appreciate another pass when you get a chance thanks | 11:20 |
derekh | sshnaidm: I'm not sure, pabelanger has started a thread on the list about it | 11:20 |
pabelanger | derekh: sshnaidm: Yes, please comment. I posted it last week (thursday) I believe. Personally, I'd like to see it be removed, since it is causing trouble, but need to better understand why it exists. | 11:23 |
pabelanger | We should be treating tripleo-test-cloud-rh1 as a public cloud, not private | 11:23 |
openstackgerrit | Merged openstack-infra/tripleo-ci: pingtest: run 'openstack stack failures list' when failure https://review.openstack.org/363918 | 11:24 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Remove EPEL mirror manually from image https://review.openstack.org/369325 | 11:25 |
*** ccamacho is now known as ccamacho|lunch | 11:25 | |
sshnaidm | derekh, ^^ | 11:25 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DEBUGGING do not merge https://review.openstack.org/369359 | 11:26 |
derekh | sshnaidm: +2 hopefully the dependency thing doesn't happen | 11:27 |
*** bkopilov has quit IRC | 11:27 | |
sshnaidm | derekh, yeah, I didn't see something special in its deps | 11:28 |
derekh | sshnaidm: ok | 11:28 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Add NetApp Manila driver integration and tidy up generic https://review.openstack.org/354019 | 11:29 |
EmilienM | dciabrin: I have a fix coming | 11:29 |
akrivoka | honza: hey can you comment on rbrady's latest question here? https://review.openstack.org/#/c/332132 | 11:29 |
sshnaidm | EmilienM, derekh now we need to merge both patches? | 11:29 |
dciabrin | EmilienM, ok. what's the strategy? still removing EPEL or tweaking puppet-tripleo? | 11:30 |
*** lucasagomes is now known as lucas-hungry | 11:30 | |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: mysql: only add brackets to mysql_bind_host when needed https://review.openstack.org/369369 | 11:31 |
EmilienM | dciabrin: ^ | 11:31 |
EmilienM | dciabrin: so is my patch going to work with latest galera? | 11:31 |
EmilienM | sshnaidm, derekh: I might have a patch that would work to fix the actual root cause (fix galera deployment) | 11:32 |
EmilienM | https://review.openstack.org/#/c/369369/ | 11:32 |
sshnaidm | EmilienM, so we can cached images? | 11:33 |
sshnaidm | s/can/can use/ | 11:33 |
EmilienM | sshnaidm: I'm really unsure if cached images will help, since the version of dib in cache is still old. | 11:33 |
EmilienM | again, it passed in my tripleo-ci patch because I had depends-on a DIB patch | 11:33 |
sshnaidm | EmilienM, yes, but we don't use it if it's cached afaiu | 11:34 |
EmilienM | so it picked master | 11:34 |
*** gfidente|afk is now known as gfidente | 11:34 | |
*** fultonj has joined #tripleo | 11:35 | |
dciabrin | EmilienM, so I was trying to bootstrap with latest galera-25.3.16-1.el7.x86_64 on a centos 7 (similar to openstack master), and i can confirm that brackets need to be removed. ipv4 and ipv6 bootstrap works iif brackets are gone | 11:35 |
EmilienM | dciabrin: cool so my patch should help | 11:36 |
*** bfournie has quit IRC | 11:36 | |
EmilienM | sshnaidm: let's see if it pass | 11:36 |
dciabrin | EmilienM, now i want to double check with current version and ensure we don't regress by removing brackets | 11:37 |
panda | sshnaidm: heh, so in the end, it was the bracket problem ... | 11:38 |
EmilienM | dciabrin: sure. Let's apevec know | 11:38 |
sshnaidm | panda, which one? | 11:39 |
*** wfoster has left #tripleo | 11:40 | |
*** trown|outtypewww is now known as trown | 11:40 | |
panda | EmilienM: so even if we remove epel, the mysql connection problem will still appear, and has to be fixed by 369369 ? | 11:42 |
EmilienM | no if we remove EPEL, it won't appear | 11:43 |
EmilienM | as the version of galera in RDO is old and works for us | 11:43 |
EmilienM | my patch in puppet-tripleo helps to move forward with galera and upgrade it | 11:43 |
panda | EmilienM: and then we can use EPEL again ? | 11:43 |
EmilienM | bonus: it will also help tripleo to work if epel is currently enabled | 11:43 |
EmilienM | panda: we don't want EPEL | 11:43 |
EmilienM | EPEL is evil for us | 11:44 |
panda | bad epel | 11:44 |
panda | ok | 11:44 |
trown | ya, we have no control over EPEL and no one to complain to if an update in EPEL breaks us | 11:44 |
EmilienM | panda: the tl;dr is that RDO provides all we need and we don't need EPEL | 11:44 |
EmilienM | trown: good morning sir | 11:44 |
trown | so even if we fix galera, getting rid of EPEL is still good | 11:44 |
EmilienM | trown++ | 11:44 |
trown | good morning EmilienM | 11:45 |
EmilienM | trown: so, tl;dr of this morning, the DIB patch is not taken in account in TripleO CI, because our image have DIB from latest tag | 11:45 |
EmilienM | trown: i proposed a new DIB release, but in meantime, sshnaidm and derekh are working on https://review.openstack.org/369325 | 11:46 |
EmilienM | trown: and https://review.openstack.org/369369 should also help to use latest Galera | 11:46 |
*** dprince has joined #tripleo | 11:47 | |
trown | EmilienM: so galera is just upset about brackets in IPv4? they will work for IPv6? | 11:47 |
dciabrin | trown, i just checked and no they don't work in ipv6 either with new version of galera | 11:47 |
EmilienM | oh that's sad | 11:47 |
trown | ah, so that is still an issue... we support ipv6 | 11:48 |
EmilienM | we break ipv6 with newest galera | 11:48 |
dciabrin | EmilienM, trown: but if we remove bracket in ipv6, the cluster bootstraps. so maybe they aren't needed in the first place? | 11:48 |
EmilienM | IMHO brackets should always be here for ipv6 | 11:49 |
EmilienM | and if it doesn't work with brackets, that's a bug | 11:49 |
dciabrin | EmilienM, ok so that's an issue then | 11:49 |
trown | ok, so fastest path is still to remove EPEL I think | 11:49 |
EmilienM | I haven't git blame galera yet to find what commit broke that thing | 11:49 |
EmilienM | yes | 11:50 |
openstackgerrit | Merged openstack/python-tripleoclient: Replace agent elements with package python-heat-agent-puppet https://review.openstack.org/368808 | 11:50 |
honza | akrivoka: yes, will do that now | 11:51 |
trown | EmilienM: do you know if this is newton only https://review.openstack.org/#/c/366406/ | 11:52 |
trown | EmilienM: we need to change it in tripleo-common yaml too | 11:52 |
tbarron | marios: I'll pick up your changes on https://review.openstack.org/354019 and retest today. | 11:52 |
tbarron | marios: dumb question about testing: 354019 is THT only, but the rebase is b/c of changes to overcloud.j2 that I need to make sure I pick up, right? | 11:53 |
marios | tbarron: ack ... just left a comment at https://review.openstack.org/#/c/366760/4 as well which should help | 11:54 |
EmilienM | trown: sounds like newton only | 11:54 |
marios | tbarron: i think i'll also just add that param explicitly puppet-tripleo side too since it seems to be required (see comment there) | 11:54 |
jaosorior | thrash: around yet? | 11:54 |
marios | tbarron: though from what we can see it appears to be set correctly so who knows... but if it lets us progress then so be it | 11:54 |
trown | EmilienM: k thanks | 11:55 |
dciabrin | EmilienM, ok so I've tested bootstrapping without brackets in the option and it works for ipv4 and ipv6, both for the old galera-25.3.5-7.el7ost.x86_64 and the new galera-25.3.16-1.el7.x86_64.rpm | 11:56 |
marios | tbarron: yeah exactly (I think the comment also answers your very valid question about the testing)... you need to pickup the latest version of the templates | 11:56 |
marios | tbarron: and that review has been rebased today for the new overcloud. jinja stuff | 11:56 |
*** jpich has quit IRC | 11:57 | |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: mysql: never add brackets to mysql_bind_host https://review.openstack.org/369369 | 11:57 |
*** pkovar has quit IRC | 11:58 | |
openstackgerrit | Merged openstack/python-tripleoclient: Use heatclient poll_for_events in wait_for_stack_ready https://review.openstack.org/368844 | 11:58 |
*** fzdarsky has joined #tripleo | 11:59 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Terminate Zaqar websocket endpoint in HAProxy https://review.openstack.org/360329 | 12:00 |
EmilienM | gfidente: https://review.openstack.org/369369 FYI | 12:01 |
*** jpena is now known as jpena|lunch | 12:01 | |
thrash | jaosorior: yah | 12:01 |
EmilienM | mcornea: could you test https://review.openstack.org/369369 in ipv6 environment please? | 12:02 |
EmilienM | mcornea: we're trying to upgrade galera package and we want to make sure we don't break ipv6 | 12:02 |
jaosorior | thrash: dude, so I kept checking the haproxy/websocket issues | 12:03 |
mcornea | EmilienM: yep, spinning up a test environment | 12:03 |
jaosorior | thrash: and so far I got it working for introspection and deploying the overcloud | 12:03 |
jaosorior | thrash: but in CI, for some reason it keeps failing | 12:03 |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui: Treat eslint warnings as jenkins failures https://review.openstack.org/368152 | 12:03 |
jaosorior | thrash: seems that it has to do with websocket internals... trying to set up a tunnel cause of the proxy and not being allowed to (getting a 403) | 12:04 |
*** dsariel has quit IRC | 12:04 | |
jaosorior | thrash: have you gotten time to check it out? or did you move to working on something else? | 12:05 |
thrash | jaosorior: moved on... | 12:05 |
*** pkovar has joined #tripleo | 12:06 | |
thrash | jaosorior: but I am certainly up to taking another look. | 12:06 |
jaosorior | thrash: can you reproduce the bug in CI? | 12:07 |
openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient: Do not include epel element when building overcloud images https://review.openstack.org/369276 | 12:07 |
*** jayg|g0n3 is now known as jayg | 12:07 | |
thrash | jaosorior: I haven't tried.. | 12:09 |
*** bfournie has joined #tripleo | 12:11 | |
EmilienM | dciabrin: i'm adding more context in the code, i'll reupload a new PS | 12:11 |
dciabrin | EmilienM, ok super | 12:11 |
*** pradk has joined #tripleo | 12:11 | |
*** pradk has quit IRC | 12:11 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Undercloud install with tripleo-quickstart https://review.openstack.org/358919 | 12:12 |
*** pradk has joined #tripleo | 12:12 | |
openstackgerrit | Merged openstack/python-tripleoclient: Add libffi-dev to bindep.txt https://review.openstack.org/368800 | 12:13 |
panda | EmilienM: is there a list of puppet functions that deal with IPv6 somewhere I can use ? | 12:15 |
EmilienM | panda: in stdlib | 12:15 |
panda | EmilienM: ok | 12:15 |
tbarron | marios: just to make sure i understand, are you pushing a new version of https://review.openstack.org/#/c/354014 that I should get before re-testing? | 12:18 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: mysql: never add brackets to mysql_bind_host https://review.openstack.org/369369 | 12:18 |
EmilienM | dciabrin: ^ that's the best I could do now. I'll have to double check with gfidente and mcornea for extended testing | 12:19 |
*** chem has quit IRC | 12:19 | |
dciabrin | EmilienM, ok thx | 12:20 |
openstackgerrit | Marios Andreou proposed openstack/puppet-tripleo: Add manila-netapp backend to manila class and tidy up generic https://review.openstack.org/354014 | 12:20 |
EmilienM | dciabrin: I -2 the patch myself until we actually test it with existing ipv6 deployments | 12:20 |
*** saneax is now known as saneax-_-|AFK | 12:21 | |
dciabrin | EmilienM, ok perfect | 12:21 |
tbarron | marios: i guess that answered the question :) | 12:21 |
EmilienM | dciabrin: to sanitize it I would have to write terrible ruby code | 12:22 |
EmilienM | dciabrin: I prefer good doc so people use valid ipv6 syntax | 12:22 |
dciabrin | EmilienM, that's fair enough, I agree | 12:22 |
EmilienM | dciabrin: but I could also write some ruby code that test if the adresse finish by ":" and then I would add brackets | 12:23 |
EmilienM | dciabrin: I'll think about it today. | 12:23 |
*** adarazs_lunch is now known as adarazs | 12:23 | |
* EmilienM afk 30 min | 12:23 | |
*** mburned is now known as mburned_out | 12:23 | |
jaosorior | shadower: hey dude, got time for a review? https://review.openstack.org/#/c/368572/1 | 12:23 |
*** mburned_out is now known as mburned | 12:23 | |
*** nyechiel has quit IRC | 12:26 | |
openstackgerrit | Marios Andreou proposed openstack/puppet-tripleo: Fixup manila-cephfs native backend defaults https://review.openstack.org/366760 | 12:26 |
shadower | jaosorior: in a few mins | 12:26 |
*** nyechiel has joined #tripleo | 12:26 | |
openstackgerrit | Ana Krivokapic proposed openstack/tripleo-common: Add node tagging workflow https://review.openstack.org/332132 | 12:31 |
*** lucas-hungry is now known as lucasagomes | 12:34 | |
*** rbrady has quit IRC | 12:34 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: IGNORE - testing manila-generic deploy after tidyup https://review.openstack.org/362866 | 12:34 |
marios | tbarron: k done updating things...please make sure to pickup the puppet-tripleo updates too | 12:35 |
marios | tbarron: switching for now will revisit let me know how you get on | 12:35 |
tbarron | marios: thanks much, i will | 12:35 |
*** fzdarsky has quit IRC | 12:36 | |
*** rbrady has joined #tripleo | 12:37 | |
*** rbrady has joined #tripleo | 12:37 | |
ccamacho|lunch | Hey EmilienM morning :) quick question, do you know if this file (https://github.com/openstack/tripleo-puppet-elements/blob/bb317ab0d37b5048ae9953be7589a2721cabe1e1/elements/puppet-modules/source-repository-puppet-modules) can work as a reference to check the new upgrade for puppet-lint? Ill check all those repos "puppet-*" | 12:37 |
*** benoit_ has quit IRC | 12:39 | |
ccamacho|lunch | basically all the ones getting the dependency from https://git.openstack.org/openstack/puppet-openstack_spec_helper | 12:39 |
*** ccamacho|lunch is now known as ccamacho | 12:40 | |
*** egafford has joined #tripleo | 12:40 | |
*** rlandy has joined #tripleo | 12:41 | |
jaosorior | d0ugal: I pulled in your CR https://review.openstack.org/#/c/368760/ but I still get the same issue :/ | 12:42 |
jaosorior | Object GET failed: https://172.29.172.2:13808/v1/AUTH_91630ce28aae44fdb89cb906e5bac785/overcloud/overcloud.yaml 404 Not Found [first 60 chars of response] <html><h1>Not Found</h1><p>The resource could not be found.< | 12:43 |
*** fultonj_ has joined #tripleo | 12:43 | |
*** rhallisey has joined #tripleo | 12:43 | |
*** jpich has joined #tripleo | 12:44 | |
*** Goneri has joined #tripleo | 12:46 | |
*** trown is now known as trown|brb | 12:47 | |
EmilienM | ccamacho: not sure that is useful | 12:47 |
EmilienM | ccamacho: you need to run puppet lint for each puppet module | 12:47 |
mcornea | d0ugal: jaosorior I get some similar error when trying to deploy overcloud: Object GET failed: http://192.168.0.1:8080/v1/AUTH_3a4fb51cc9844b4f836f0bb2e41237d4/overcloud/overcloud.yaml 404 Not Found | 12:48 |
dtantsur | folks, is it something known: | 12:48 |
dtantsur | Error: /Stage[main]/Rabbitmq/Rabbitmq_plugin[rabbitmq_management]: Could not evaluate: Command is still failing after 180 seconds expired | 12:48 |
*** nyechiel has quit IRC | 12:48 | |
*** pgadiya has quit IRC | 12:49 | |
*** rhallisey has quit IRC | 12:49 | |
*** nyechiel has joined #tripleo | 12:49 | |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-docs: [WIP] Document multiple overclouds with shared ctlplane https://review.openstack.org/368840 | 12:49 |
dtantsur | bfournie, current version ^^^ | 12:49 |
dtantsur | now fails with rabbitmq error above | 12:49 |
ccamacho | EmilienM yeahp, this is my list http://paste.openstack.org/show/573600/ need to make a script for that :P | 12:49 |
jaosorior | mcornea: so currently overcloud update is broken and d0ugal is working on a fix https://review.openstack.org/#/c/368760/5 | 12:49 |
jaosorior | I tried it out, and I had missed initially to update the undercloud with that fix | 12:50 |
jaosorior | now I'm trying again | 12:50 |
jaosorior | aaaaand it failed :( | 12:50 |
jaosorior | d0ugal: Exception updating plan: The environment is not a valid YAML mapping data type. | 12:50 |
*** pkovar has quit IRC | 12:51 | |
dtantsur | bfournie, also, for computes I'm getting Error: Local ip for ovs agent must be set when tunneling is enabled at /etc/puppet/modules/neutron/manifests/agents/ml2/ovs.pp:220 on node stack1-compute1-0.openstackloc | 12:52 |
dtantsur | al | 12:52 |
openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient: Remove the rest of a removed path https://review.openstack.org/369431 | 12:52 |
thrash | EmilienM: ^^^ | 12:52 |
EmilienM | thrash: +2 | 12:53 |
bfournie | dtantsur: yes, when you have vxlan tunneling it needs a local IP configured, let me figure out which setting needs to be changed for that. For now we can just disable vxlan tunneling, one sec. | 12:55 |
dtantsur | bfournie, I'm totally fine with disabling it for now, unless it's easy to fix | 12:55 |
*** myoung|afk is now known as myoung | 12:55 | |
*** saneax-_-|AFK is now known as saneax | 12:56 | |
*** bkopilov has joined #tripleo | 12:56 | |
*** lblanchard has joined #tripleo | 12:57 | |
*** tzumainn has joined #tripleo | 12:59 | |
*** jaosorior has quit IRC | 12:59 | |
*** jaosorior has joined #tripleo | 13:00 | |
*** dbecker has quit IRC | 13:00 | |
bfournie | dtantsur: You can set this under paramater_defaults to disable tunneling while I figure out how to set the local ip in your new config: | 13:00 |
bfournie | dtantsur: NeutronTunnelTypes: '' | 13:00 |
*** trown|brb is now known as trown | 13:01 | |
openstackgerrit | Brad P. Crochet proposed openstack-infra/tripleo-ci: debug: Run 'openstack stack failures list' upon overcloud failures https://review.openstack.org/369434 | 13:01 |
*** jpena|lunch is now known as jpena | 13:01 | |
*** rhallisey has joined #tripleo | 13:02 | |
EmilienM | thrash: nice ^ | 13:04 |
dtantsur | ++ | 13:05 |
*** benoit has joined #tripleo | 13:05 | |
panda | EmilienM: you removed the sanitization step in 369369 ? | 13:10 |
*** morazi has joined #tripleo | 13:10 | |
EmilienM | panda: yes, read my comment in the code, we can't have brackets anyway | 13:10 |
EmilienM | panda: because of recent galera version | 13:10 |
bfournie | dtantsur: You will be fine with disabling vxlan tunneling as above, but if eventually you want to enable it, the local_ip that it needs comes from this setting in the ServiceNetMap: | 13:14 |
*** kjw3 has quit IRC | 13:14 | |
bfournie | dtantsur: NeutronTenantNetwork: 'stack1_tenant' | 13:14 |
dtantsur | hmm, what's wrong with it then? | 13:14 |
*** dbecker has joined #tripleo | 13:15 | |
*** pkovar has joined #tripleo | 13:15 | |
dtantsur | I'd prefer to avoid disabling vxlan eventually, seems too restrictive | 13:15 |
bfournie | dtantsur: is stack1_tenant set? | 13:15 |
dtantsur | bfournie, it's TenantNetName | 13:15 |
bfournie | dtantsur: hmm, not sure, let me look into it more. That's the value its using for local_ip: | 13:16 |
bfournie | dtantsur: puppet/services/neutron-ovs-agent.yaml: neutron::agents::ml2::ovs::local_ip: {get_param: [ServiceNetMap, NeutronTenantNetwork]} | 13:16 |
dtantsur | this all is strange... | 13:17 |
*** fzdarsky has joined #tripleo | 13:19 | |
*** anshul has quit IRC | 13:19 | |
dtantsur | bfournie, local ip is fine, but rabbit still fails... I suspect it gets some wrong configuration as well | 13:24 |
bfournie | dtantsur: yeah, could be related if local_ip wasn't being set correctly | 13:29 |
*** saneax is now known as saneax-_-|AFK | 13:30 | |
dtantsur | tripleo networking is pure magic, I have no idea what I am doing... | 13:30 |
openstackgerrit | Ana Krivokapic proposed openstack/tripleo-common: Add node tagging workflow https://review.openstack.org/332132 | 13:30 |
* social chews on Error: Duplicate declaration: Heat_config[DEFAULT/num_engine_workers] is already declared; cannot redeclare at /etc/puppet/modules/heat/manifests/engine.pp:186 on node overcloud-controller-0.localdomain | 13:31 | |
bfournie | dtantsur: is there any info in logs about rabbit timeouts? | 13:31 |
dtantsur | lemme dive into local logs | 13:32 |
*** cdearborn has joined #tripleo | 13:32 | |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Set default TERM for tput https://review.openstack.org/369455 | 13:34 |
bfournie | dtantsur: if you send me machine IP+creds I can also look | 13:34 |
mcornea | d0ugal: jaosorior from what I can see tripleoclient is looking for overcloud.yaml and overcloud-without-mergepy.yaml which are not present in t-h-t anymore: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/constants.py#L34 | 13:35 |
mcornea | is there any CR for this? | 13:35 |
d0ugal | mcornea: I would check tripleoclient is still using that constant, I am not sure it is | 13:36 |
*** akshai has joined #tripleo | 13:36 | |
dtantsur | bfournie, http://paste.openstack.org/show/573605/ | 13:36 |
dtantsur | bfournie, creds are a bit hard, this is a quickstart environment | 13:36 |
jaosorior | mcornea: so this is the CR https://review.openstack.org/#/c/368760/5 but the error seems to be going deeper :/ | 13:36 |
*** kjw3 has joined #tripleo | 13:37 | |
mcornea | d0ugal: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_deploy.py#L482 | 13:37 |
dtantsur | bfournie, no rabbitmq logs, nothing suspicious in /etc/rabbitmq | 13:38 |
*** jobewan has joined #tripleo | 13:38 | |
mcornea | jaosorior: I applied it but get the same swift not found error; should I do anything else except modifying the plan_management.yaml file? | 13:38 |
*** benoit has quit IRC | 13:38 | |
jaosorior | mcornea: right, so that's the attempt to fix it, but it still doesn't work on updates | 13:39 |
*** nico_auv has joined #tripleo | 13:39 | |
jaosorior | mcornea: and also, one thing is that my environment is pretty modified :/ | 13:39 |
jaosorior | I have this fix to zaqar too | 13:39 |
jaosorior | mcornea: https://review.openstack.org/#/c/369285/ | 13:39 |
jaosorior | mcornea: I have that applied manually | 13:39 |
bfournie | dtantsur: ok, yeah nothing definitive in those logs you sent. Let me look at my quickstart setup | 13:40 |
openstackgerrit | Merged openstack/python-tripleoclient: Update .gitreview for stable/newton https://review.openstack.org/364966 | 13:40 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Enable proxy header parsing for Manila https://review.openstack.org/368571 | 13:40 |
dtantsur | bfournie, you can reproduce the same thing based on the WIP docs | 13:40 |
*** skramaja_ has joined #tripleo | 13:42 | |
*** benoit has joined #tripleo | 13:42 | |
pabelanger | morning | 13:42 |
*** skramaja has quit IRC | 13:43 | |
pabelanger | dprince: slagle: bnemec: derekh: EmilienM: I'd like to loop back to https://review.openstack.org/#/c/357308/ if all possible. Is that something we can land if CI has improved? | 13:43 |
*** benoit has quit IRC | 13:44 | |
*** benoit has joined #tripleo | 13:44 | |
mcornea | d0ugal: jaosorior I changed the tripleoclient constants and I get this error so I think that's causing it: Object GET failed: http://192.168.0.1:8080/v1/AUTH_3a4fb51cc9844b4f836f0bb2e41237d4/overcloud/somefile.yaml | 13:44 |
slagle | pabelanger: i think that's up to dprince | 13:45 |
*** flepied has quit IRC | 13:45 | |
mcornea | d0ugal: jaosorior overcloud.yaml → overcloud.j2.yaml https://github.com/openstack/tripleo-heat-templates/commit/0a9b02b60ce366a20d67ff67dfce671f4f46585d | 13:46 |
*** skramaja_ is now known as skramaja | 13:46 | |
d0ugal | mcornea: Yeah, I know - but the bit missing is the process templates step | 13:46 |
d0ugal | I am adding that in, but it is causing another issue | 13:46 |
d0ugal | mcornea: This is the first pass that adds the process templates action. https://review.openstack.org/#/c/368760/ | 13:46 |
d0ugal | but that is causing a problem with updating the plan | 13:47 |
d0ugal | because updating a plan and the jinja2 stuff were both merged at the same time - they passed CI individually but broke the world together | 13:47 |
d0ugal | mcornea: From what I understand, overcloud.yaml will exist, after the process templates step has been done. | 13:48 |
d0ugal | so the file isn't in github, but should be generated. | 13:48 |
*** rhallisey is now known as rhallisey-brb | 13:48 | |
EmilienM | ccamacho: you need to loop over all puppet modules and run lint | 13:50 |
EmilienM | ccamacho: there is no other way to test such a change | 13:50 |
EmilienM | ccamacho: so what you can do, is to submit a patch on top of puppet-openstack_spec_helper that loop over all modules and run lint tests, instead of just puppet nova | 13:51 |
shardy_mtg | EmilienM: Hey, can you run the meeting today please, I'm in another meeting so won't be able to focus completely on it | 13:52 |
EmilienM | tripleo meeting in 9 minutes, please add off items if needed: https://etherpad.openstack.org/p/tripleo-meeting-items | 13:52 |
EmilienM | shardy_mtg: yup, will do | 13:52 |
shardy_mtg | thanks! | 13:52 |
*** hjensas has quit IRC | 13:53 | |
dprince | pabelanger: I would suggest we wait until after the release is cut to minimize CI risk for this | 13:54 |
dprince | pabelanger: so, lets treat https://review.openstack.org/#/c/357308/ as an early Ocata feature | 13:55 |
ccamacho | EmilienM so if I add a depends-on to every single puppet module it should run lint for all of them, right? Like I did for puppet-nova but a depends-on for each module (Adding an empty line to each module). | 13:56 |
EmilienM | derekh, sshnaidm, gfidente, trown, dciabrin: pingtest passed for HA job with https://review.openstack.org/#/c/369369/ | 13:56 |
EmilienM | ccamacho: no | 13:56 |
EmilienM | ccamacho: it won't work | 13:56 |
EmilienM | ccamacho: because we use bundle to install the gem and bundle doesn't support zuul-cloner | 13:57 |
EmilienM | so depends-on is useless here | 13:57 |
EmilienM | the otherway around work though: you can adds depends-on in spec_helper patch because we clone puppet nova using zuul cloner | 13:57 |
EmilienM | but it's useless in our case | 13:57 |
ccamacho | EmilienM and doing this? https://review.openstack.org/#/c/369445/3/Gemfile | 13:57 |
bfournie | dtantsur: still working on setting up my quickstart environment which didn't come up cleanly after ram was added to host6… | 13:58 |
*** akshai has quit IRC | 13:58 | |
EmilienM | ccamacho: I didn't know you could do it | 13:58 |
EmilienM | ccamacho: does it work? | 13:58 |
EmilienM | tripleo meeting is about to start folks | 13:58 |
ccamacho | waiting for CI to check if can get the gem reference from gerrit | 13:58 |
*** tobias-fiberdata has joined #tripleo | 13:58 | |
derekh | EmilienM: where did it pass, I don;t see it | 13:58 |
EmilienM | derekh: I'm watching zuul | 13:59 |
EmilienM | derekh: it will be showed very soon when other jobs pass | 13:59 |
*** akshai has joined #tripleo | 13:59 | |
derekh | EmilienM: I'm watching it in zuul too, its only started | 14:00 |
dciabrin | EmilienM, have you seen my comments on https://review.openstack.org/#/c/369369/3 ? i think we're good with any kind of ipv6 addresses | 14:00 |
derekh | EmilienM: this one has passed though https://review.openstack.org/#/c/369329/ | 14:00 |
EmilienM | derekh: ok i'll catch up after weekly meeting | 14:00 |
pabelanger | dprince: I can understand being reluctant about making CI changes, but I don't believe waiting until a future date is the right move in this case. Yes, I know triple CI is pretty touchy these days, but we should be iterating forward in small increments. But pushing these changes out until Ocata, we're basically blocking CI improvements | 14:00 |
derekh | EmilienM: ok | 14:00 |
EmilienM | tripleo meeting is starting | 14:00 |
EmilienM | dciabrin: it didn't pass HA job yet | 14:00 |
*** tobias_fiberdata has quit IRC | 14:01 | |
*** apetrich has quit IRC | 14:02 | |
*** oshvartz has quit IRC | 14:03 | |
*** apetrich has joined #tripleo | 14:04 | |
*** yamahata has joined #tripleo | 14:08 | |
*** shardy_mtg is now known as shardy | 14:16 | |
*** dbecker has quit IRC | 14:18 | |
*** limao has joined #tripleo | 14:19 | |
*** jprovazn has quit IRC | 14:19 | |
honza | I keep getting timeout errors when running "openstack overcloud deploy" even when setting --timeout 30 (minutes) --- what can I look for possible issues? | 14:19 |
*** dtantsur is now known as dtantsur|mtg | 14:20 | |
d0ugal | huh, I'm sure Heat used to allow me to do this: http://paste.openstack.org/show/573620/ | 14:22 |
*** rhallisey-brb is now known as rhallisey | 14:26 | |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the environments from Mistral when removing from Swift https://review.openstack.org/369486 | 14:26 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the environments from Mistral when removing from Swift https://review.openstack.org/369486 | 14:27 |
*** saneax-_-|AFK is now known as saneax | 14:27 | |
jpich | honza: There's been a couple of issues around timeouts lately, do you get a more specific error message like what component is timing out? | 14:29 |
honza | jpich: unfortunately not, it simply says "ERROR: Timed out waiting for a reply to message ID <id>" | 14:29 |
d0ugal | honza: Are the baremetal machines/vm's powering on? | 14:29 |
*** tobias-fiberdata has quit IRC | 14:30 | |
honza | d0ugal: welp, virsh list --all fails to connect, no socket | 14:31 |
*** fultonj has quit IRC | 14:31 | |
d0ugal | honza: as the stack user? | 14:31 |
d0ugal | honza: I think you might get that error if you are root | 14:32 |
*** fultonj_ is now known as fultonj | 14:32 | |
honza | ah | 14:32 |
honza | it's empty as the stack user | 14:32 |
*** tobias-fiberdata has joined #tripleo | 14:33 | |
*** nico_auv has quit IRC | 14:33 | |
honza | ugh, ignore me, in the wrong place | 14:33 |
honza | i have 2 baremetal machines running | 14:33 |
d0ugal | honza: I've had timeout's before when waiting for the VM's to start, so that was my only guess | 14:35 |
d0ugal | honza: btw --timeout defaults to 60, so with 30 you are reducing it :) | 14:35 |
d0ugal | Sorry, it defaults to 240 | 14:35 |
*** fzdarsky has quit IRC | 14:35 | |
honza | lolololol so it must be some other thing timing out | 14:36 |
d0ugal | honza: Yeah, that timeout is just for the full heat operation. | 14:36 |
d0ugal | honza: if you have it in a timedout state, can you list the failures? | 14:36 |
*** mhenkel has joined #tripleo | 14:37 | |
honza | d0ugal: not sure how? | 14:37 |
d0ugal | honza: openstack stack failures list overcloud | 14:37 |
d0ugal | I think | 14:37 |
d0ugal | I have no failures to verify with :P | 14:37 |
honza | yep that's the one | 14:38 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: set up quickstart to replace instack-virt-setup https://review.openstack.org/358089 | 14:38 |
*** flepied has joined #tripleo | 14:39 | |
honza | http://paste.openstack.org/show/573641/ d0ugal | 14:39 |
openstackgerrit | Merged openstack/python-tripleoclient: Do not include epel element when building overcloud images https://review.openstack.org/369276 | 14:39 |
d0ugal | honza: I have no idea what it means, but that is your problem :) | 14:39 |
honza | d0ugal: it was worth a shot :) | 14:39 |
d0ugal | honza: You might find people more responsive in here after the tripleo meeting ends | 14:40 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the environments from Mistral when removing from Swift https://review.openstack.org/369486 | 14:48 |
d0ugal | rbrady: Thanks for the review, I think we need this workaround for now. tripleoclient already updates the mistral env elsewhere | 14:49 |
d0ugal | rbrady: Without this everything is broken... | 14:49 |
*** shardy is now known as shardy_mtg | 14:50 | |
*** fzdarsky has joined #tripleo | 14:51 | |
shadower | honza: engine went down. Sounds bad. Was that a virtual undercloud? Could possibly be running out of memory | 14:51 |
honza | shadower: that would explain it | 14:52 |
*** florianf has quit IRC | 14:53 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: different current repo https://review.openstack.org/369506 | 14:54 |
*** dprince has quit IRC | 14:54 | |
honza | shadower: i think i used the defaults, UNDERCLOUD_NODE_MEM=6144 | 14:54 |
d0ugal | dprince, shardy_mtg: I sent you both an email ping about a bug if you have time at all this week. | 14:54 |
d0ugal | honza: https://github.com/d0ugal/tripleo-util/blob/master/host/restack.sh#L19 :) | 14:55 |
sshnaidm | slagle, do you know what are these jobs for? periodic-tripleo-ci-centos-7-promote-ovb-ha/ periodic-tripleo-ci-centos-7-promote-ovb-nonha/ | 14:55 |
shadower | honza: so I haven't had an issue with the defaults recently but I know folks use 8 or even 12GB just in case. And I did have to do that in the past | 14:56 |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: Use centos7-master-head DLRN instance for includepkgs repo https://review.openstack.org/369509 | 14:57 |
*** florianf has joined #tripleo | 14:58 | |
*** chem has joined #tripleo | 14:58 | |
openstackgerrit | Merged openstack/puppet-tripleo: Enable X-Forwarded-Proto for manila https://review.openstack.org/368572 | 15:00 |
*** coolsvap is now known as coolsvap_ | 15:01 | |
slagle | sshnaidm: yes, i added them so we could split out the promote jobs from other periodic ha/nonha jobs | 15:01 |
slagle | sshnaidm: but have not made that change in tripleo-ci yet | 15:01 |
slagle | sshnaidm: so that only jobs that have "promote" in the name will actually promote | 15:02 |
*** jaosorior has quit IRC | 15:02 | |
openstackgerrit | John Trowbridge proposed openstack/tripleo-docs: Use centos7-master-head DLRN instance for includepkgs repo https://review.openstack.org/369517 | 15:03 |
trown | derekh: bnemec: EmilienM I think https://review.openstack.org/369509 and https://review.openstack.org/369517 will fix our issue with not getting master of DIB and tripleoclient | 15:04 |
*** cdearborn has quit IRC | 15:04 | |
EmilienM | trown: will look shortly | 15:05 |
EmilienM | trown: in puppet meeting now ;) | 15:05 |
trown | lol, ETOOMANYMEETINGS | 15:06 |
EmilienM | trown: well, tripleo and puppet are the 2 meeting I really care by week | 15:07 |
EmilienM | trown: the rest is secondary :P | 15:07 |
derekh | trown: thanks | 15:07 |
*** lblanchard has quit IRC | 15:08 | |
*** lblanchard has joined #tripleo | 15:09 | |
*** trown has quit IRC | 15:10 | |
*** dbecker has joined #tripleo | 15:11 | |
*** limao has quit IRC | 15:12 | |
*** rlandy has quit IRC | 15:12 | |
*** dmanchad has quit IRC | 15:12 | |
*** jayg has quit IRC | 15:12 | |
*** trown has joined #tripleo | 15:12 | |
*** jayg has joined #tripleo | 15:12 | |
*** tremble has quit IRC | 15:13 | |
*** dmanchad has joined #tripleo | 15:13 | |
*** rlandy has joined #tripleo | 15:14 | |
*** oshvartz has joined #tripleo | 15:16 | |
bnemec | pabelanger: So the tripleo user should remain openstack-nodepool? | 15:18 |
*** jlinkes has quit IRC | 15:19 | |
*** ebarrera has quit IRC | 15:19 | |
EmilienM | trown: oh wow, nice patch | 15:19 |
pabelanger | bnemec: Ya, that would be used by tripleo things. Like ovb and private infrastructure. | 15:20 |
bnemec | pabelanger: Okay, and what would the infra users be creating, respectively? I'm wondering what quota to give each. | 15:21 |
*** aufi has quit IRC | 15:22 | |
pabelanger | bnemec: for openstackci, we'll only be launching a single user. For openstackzuul, that will be the quote for the amount of nodes you want to launch from nodepool | 15:23 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Add fluentd client service https://review.openstack.org/353506 | 15:23 |
*** skramaja has quit IRC | 15:23 | |
bnemec | pabelanger: Thanks, I'll get that set up. | 15:23 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: set up quickstart to replace instack-virt-setup https://review.openstack.org/358089 | 15:24 |
EmilienM | marios: yo | 15:26 |
EmilienM | marios: why do we use pacemaker role in https://review.openstack.org/#/c/354014/ ? | 15:26 |
panda | EmilienM: https://bugs.launchpad.net/puppet-tripleo/+bug/1623096 | 15:28 |
openstack | Launchpad bug 1623096 in puppet-tripleo "IPv6 handling for swift add_devices" [Undecided,New] | 15:28 |
slagle | lucasagomes: dtantsur|mtg : if the ssh power driver is not going to be supported any longer in ironic, do you think we should still be using it in tripleo-ci? | 15:29 |
dtantsur|mtg | slagle, we should slowly move to virtualbmc and pxe_ipmitool | 15:30 |
dtantsur|mtg | feel free to wait until our (ironic) CI moves to them though | 15:30 |
slagle | ok yea that was my next question is what is ironic CI using | 15:30 |
bnemec | Err, we aren't using the ssh power driver in ci anymore, are we? | 15:31 |
bnemec | ovb doesn't anyway | 15:31 |
marios | EmilienM: on advice from manila folks manila-share is the only pcmk managed service and it includes the tripleo::profile::pacemaker::manila profile. The backends are then brought up in this single pacemaker profile. We could move them to new file and include that, say in https://review.openstack.org/#/c/354019/17/puppet/services/manila-backend-generic.yaml tht side | 15:31 |
marios | EmilienM: EmilienM if you would prefer that should be easy enough to make ... thanks for looking | 15:32 |
slagle | bnemec: good point. though we should probably switch instack-virt-setup over as well | 15:32 |
bnemec | slagle: Yeah, that would still need to be changed. | 15:32 |
dtantsur|mtg | slagle, we're in progress of switching away from ssh drivers to virtualbmc | 15:32 |
dtantsur|mtg | slagle, I'm not sure if it happens in newton | 15:32 |
*** dtantsur|mtg is now known as dtantsur | 15:33 | |
*** gchamoul is now known as gchamoul|afk | 15:33 | |
*** gchamoul|afk is now known as gchamoul | 15:33 | |
EmilienM | panda: thans | 15:34 |
EmilienM | thanks | 15:34 |
lucasagomes | slagle, as dtmitry said, we currently are using this: https://github.com/openstack/virtualbmc | 15:35 |
lucasagomes | slagle, which is very similar to ovb | 15:35 |
lucasagomes | but instead of nova commands it converts the ipmi commands to libvirt commands and power on/off the vms | 15:35 |
EmilienM | marios: it just doesn't follow other services pattern, where each service has its own yaml, ie: nova-api, etc | 15:36 |
EmilienM | when I read the patch, I see all manila is in manifests/profile/pacemaker/manila.pp | 15:36 |
trown | lucasagomes: do you know if that still supports qemu://session connections to libvirt instead of using qemu://system? | 15:36 |
*** zoli|trng is now known as zoli|gone | 15:36 | |
EmilienM | marios: moreover, we don't have any CI running on manila, right? | 15:37 |
EmilienM | how is this patch tested? | 15:37 |
trown | lucasagomes: ah I see a libvirt_uri in the code, so seems so | 15:37 |
lucasagomes | trown, it does yeah yes | 15:37 |
sshnaidm | trown, is this repo mirrored on http://buildlogs.centos.org/? We had a lot of performance issues and jobs timing out because slow trunk.rdo | 15:37 |
lucasagomes | trown, when you create the vbmc you can specify the URI | 15:37 |
lucasagomes | trown, slagle https://raw.githubusercontent.com/umago/virtualbmc/master/images/demo.gif | 15:37 |
lucasagomes | it's a demo gif | 15:38 |
*** zoli|gone is now known as zoli_gone-proxy | 15:38 | |
slagle | lucasagomes: just watched it :) | 15:38 |
trown | lucasagomes: dtantsur is there plans to make rpm packaging for that? | 15:38 |
lucasagomes | just pass --libvirt-uri in the "add" command | 15:38 |
lucasagomes | trown, yes we should | 15:38 |
lucasagomes | there's a BZ for it already lemme find | 15:38 |
*** shardy_mtg has quit IRC | 15:38 | |
lucasagomes | trown, https://bugzilla.redhat.com/show_bug.cgi?id=1373468 | 15:39 |
openstack | bugzilla.redhat.com bug 1373468 in rhel-osp-director "[RFE] Switch from SSH drivers to virtualbmc" [Unspecified,New] - Assigned to lmartins | 15:39 |
marios | EmilienM: we do have base profiles for manila api/sched/share... this is just for the backends, but np i can revisit to move those out as i said | 15:39 |
marios | EmilienM: i mean we have separate files for those | 15:39 |
lucasagomes | trown, but there's no RPM spec for it yet :-/ | 15:39 |
*** dsneddon has quit IRC | 15:40 | |
trown | lucasagomes: k, seems pretty simple to package... we probably will have to wait for Ocata if it is not started yet though | 15:40 |
EmilienM | marios: no worries | 15:40 |
EmilienM | marios: we can iterate later, let me finish the review | 15:40 |
marios | EmilienM: yeah no ci for that, we are mainly relying on tbarron testing ... we *can* test manila-generic like https://review.openstack.org/#/c/362866/ but netapp no and i assume neither for manila-cephfs | 15:41 |
EmilienM | marios: did you manually tested it? | 15:41 |
lucasagomes | trown, yeah, I think ocata starts on ~ Sept 20 | 15:41 |
*** dsneddon has joined #tripleo | 15:41 | |
*** athomas has quit IRC | 15:41 | |
marios | EmilienM: tbarron is manually testing - my dev-env is used full time setup for 9..10 upgrades as that has to be a priority right now for me at least... waiting on ram for my beaker box so i can getn another going | 15:42 |
trown | lucasagomes: but I am willing to help get it packaged early in ocata cycle (since I want to get tripleo-quickstart switched to it ASAP) | 15:42 |
bnemec | pabelanger: Okay, the users and projects are created. Is there a good place for me to drop the credentials for you? | 15:42 |
lucasagomes | trown, oh that would be great actually | 15:43 |
*** mhenkel has quit IRC | 15:43 | |
lucasagomes | trown, you want me to create a initial spec ? | 15:43 |
tbarron | EmilienM: i have a beaker-box that i'm trying to hang on to and am testing marios' changes | 15:44 |
marios | EmilienM: OK, appreciate any thoughts on my comment at https://review.openstack.org/#/c/354014/8/manifests/profile/pacemaker/manila.pp | 15:44 |
*** jtomasek has quit IRC | 15:44 | |
marios | tbarron: EmilienM thanks very much I will fixup any issues/comments tomorrow /me approaching eod | 15:44 |
*** saneax is now known as saneax-_-|AFK | 15:45 | |
tbarron | EmilienM: it would be great to do CI with cephfs backend down the road as that doesn't require special h/w | 15:45 |
trown | lucasagomes: sure if you have bandwidth, we will need to create a packaging BZ in RDO for it to get it imported in DLRN, but we won't get much traction on that until after RDO ships newton | 15:45 |
lucasagomes | trown, added to my todo list, I will give it a go this week or next one tops | 15:45 |
*** dsneddon has quit IRC | 15:45 | |
*** egafford has quit IRC | 15:45 | |
lucasagomes | trown, fair enough | 15:45 |
tbarron | marios: yeah, i'm going to test your latest changes again after lunch (my time) | 15:45 |
EmilienM | tbarron: have you seen our tripleo scenario jobs? | 15:45 |
tbarron | marios: thanks, and have a good evening | 15:45 |
EmilienM | tbarron: we could add the services to one of our scenarios | 15:46 |
tbarron | EmilienM: only vaguely, i'm honestly kindofa n00b on OOO | 15:46 |
tbarron | EmilienM: am willing to look and learn, but right now we prob have to do manual testing, like for all the cinder env/backends that aren't in CI | 15:46 |
EmilienM | yes, manual testing is not the right option for us | 15:47 |
tbarron | EmilienM: our dirction is going to be to deprecate that "generic" backend, as it's useless in production | 15:47 |
tbarron | EmilienM: so getting cephfs in there instead is the way to go I think | 15:47 |
tbarron | EmilienM: I don't disagree :) | 15:47 |
tbarron | EmilienM: it's all that I can do atm, and for backend that requires h/w | 15:48 |
*** ccamacho is now known as ccamacho|afk | 15:50 | |
*** jcoufal has quit IRC | 15:51 | |
*** jlinkes has joined #tripleo | 15:52 | |
EmilienM | sshnaidm, derekh: should we abandon https://review.openstack.org/#/c/369329/ and https://review.openstack.org/#/c/369303/ ? | 15:53 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Remove EPEL mirror manually from image https://review.openstack.org/369325 | 15:53 |
sshnaidm | EmilienM, I hope so | 15:53 |
marios | thanks EmilienM ! | 15:53 |
derekh | EmilienM: yup | 15:53 |
*** jlinkes_ has joined #tripleo | 15:54 | |
*** mcornea has quit IRC | 15:54 | |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: Use centos7-master-head DLRN instance for includepkgs repo https://review.openstack.org/369509 | 15:55 |
*** akshai has quit IRC | 15:56 | |
*** jistr|mtgs is now known as jistr | 15:57 | |
openstackgerrit | Merged openstack/tripleo-quickstart: Add ability to use overcloud-full.qcow2 for undercloud image https://review.openstack.org/368810 | 15:57 |
*** jlinkes has quit IRC | 15:57 | |
sshnaidm | trown, I think you need to revert my patch to check this repo | 15:58 |
*** mhenkel has joined #tripleo | 15:58 | |
*** akshai has joined #tripleo | 15:59 | |
rbrady | honza: fwiw I have the same issue atm on an undercloud I built last week. | 15:59 |
EmilienM | slagle: FYI https://review.openstack.org/#/c/314485/ is re-open | 16:00 |
trown | sshnaidm: ? | 16:01 |
*** dtantsur is now known as dtantsur|afk | 16:02 | |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common: Replace agent elements with package python-heat-agent-puppet https://review.openstack.org/369557 | 16:04 |
thrash | EmilienM: this updates the code used for tripleo-build-images ^^^^ | 16:04 |
thrash | EmilienM: which I *think* is what all the build systems use now. | 16:05 |
trown | thrash: I think tripleo-ci does not yet | 16:05 |
thrash | trown: right... except for tripleo-ci | 16:06 |
trown | thrash: there is a patch for it, but it is not merged | 16:06 |
thrash | trown: https://review.openstack.org/#/c/336312/ | 16:06 |
thrash | :) | 16:06 |
thrash | anyway, my new patch just syncs the two methods | 16:06 |
trown | thrash: yep, meant to put that up yesterday when I saw the tripleoclient patch | 16:07 |
EmilienM | thrash: ok will look | 16:07 |
trown | just forgot | 16:07 |
thrash | EmilienM: thanks | 16:08 |
*** ohamada has quit IRC | 16:09 | |
openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient: Do not include epel element when building overcloud images https://review.openstack.org/369559 | 16:12 |
openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient: Do not include epel element when building overcloud images https://review.openstack.org/369559 | 16:13 |
slagle | EmilienM: liberty is not EOL'd is it? | 16:14 |
EmilienM | slagle: not yet but soon afik | 16:15 |
EmilienM | slagle: maybe we can have the tag | 16:16 |
*** florianf has quit IRC | 16:17 | |
* EmilienM afk lunch | 16:17 | |
*** trown is now known as trown|lunch | 16:18 | |
*** fzdarsky is now known as fzdarsky|lunch | 16:19 | |
*** akshai has quit IRC | 16:19 | |
*** akshai has joined #tripleo | 16:21 | |
*** akshai has quit IRC | 16:25 | |
*** akshai has joined #tripleo | 16:26 | |
*** ebarrera has joined #tripleo | 16:26 | |
*** fragatina has joined #tripleo | 16:28 | |
honza | rbrady: yay, i'm not doing something super stupid | 16:29 |
*** myoung is now known as myoung|lunch | 16:29 | |
*** milan has quit IRC | 16:31 | |
*** rasca has quit IRC | 16:32 | |
*** fragatina has quit IRC | 16:32 | |
*** derekh has quit IRC | 16:32 | |
*** fragatina has joined #tripleo | 16:33 | |
rbrady | shardy: in the jinja templating patch series, did you intend for the jinja templating of roles to be optional or required? | 16:40 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK: periodic jobs https://review.openstack.org/359215 | 16:40 |
openstackgerrit | Merged openstack/tripleo-common: Set Deployment Parameters https://review.openstack.org/365625 | 16:43 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Revert to tripleo image definition in a separate release file for devmode https://review.openstack.org/369571 | 16:44 |
*** myoung|lunch is now known as myoung | 16:44 | |
*** fragatina has quit IRC | 16:45 | |
*** fragatina has joined #tripleo | 16:45 | |
*** tesseract- has quit IRC | 16:46 | |
*** egafford has joined #tripleo | 16:47 | |
*** penick has joined #tripleo | 16:48 | |
*** mhenkel has left #tripleo | 16:49 | |
*** liverpooler has quit IRC | 16:50 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: M/N upgrade sahara-api fails to restart. https://review.openstack.org/358022 | 16:50 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Fix deploy timestamp parsing https://review.openstack.org/369577 | 16:51 |
*** kjw3 has quit IRC | 16:53 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: M/N upgrade sahara-api fails to restart. https://review.openstack.org/358022 | 16:53 |
*** electrofelix has quit IRC | 16:55 | |
*** lucasagomes is now known as lucas-dinner | 16:56 | |
*** yamahata has quit IRC | 16:58 | |
*** pcaruana has quit IRC | 16:59 | |
*** nyechiel has quit IRC | 17:01 | |
*** dbecker has quit IRC | 17:01 | |
*** rcernin has quit IRC | 17:03 | |
*** karthiks has quit IRC | 17:07 | |
*** gfidente is now known as gfidente|afk | 17:07 | |
*** panda is now known as panda|dinner | 17:09 | |
*** fzdarsky|lunch is now known as fzdarsky | 17:10 | |
*** flepied has quit IRC | 17:12 | |
*** nyechiel has joined #tripleo | 17:12 | |
-openstackstatus- NOTICE: The Gerrit service on review.openstack.org is being restarted now to address current performance problems, but should return to a working state within a few minutes | 17:12 | |
*** fragatina has quit IRC | 17:13 | |
*** jpena is now known as jpena|off | 17:15 | |
bnemec | Anybody know why my deployment is exploding if I pass a path to --templates: http://paste.openstack.org/show/574431/ | 17:15 |
*** abregman has joined #tripleo | 17:18 | |
*** nyechiel has quit IRC | 17:18 | |
*** bana_k has joined #tripleo | 17:20 | |
slagle | what? no one deploys from directories any more | 17:20 |
slagle | i dont really know :) | 17:21 |
*** kjw3 has joined #tripleo | 17:22 | |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common: Add FS_TYPE xfs to RHEL and CentOS images https://review.openstack.org/369600 | 17:22 |
jpich | bnemec: It's been reported at https://bugs.launchpad.net/tripleo/+bug/1623086 , not sure if it might be a duplicate of https://bugs.launchpad.net/tripleo/+bug/1622683 | 17:27 |
openstack | Launchpad bug 1623086 in tripleo "'Result' object has no attribute 'copy' - overcloud deployment fails" [Undecided,New] | 17:27 |
openstack | Launchpad bug 1622683 in tripleo "Updating plans breaks deployment" [Critical,In progress] - Assigned to Dougal Matthews (d0ugal) | 17:27 |
bnemec | jpich: Okay, thanks. | 17:30 |
*** pkovar has quit IRC | 17:30 | |
*** ebarrera has quit IRC | 17:30 | |
bnemec | In the meantime I guess I do the naughty thing and mess with packaged files. :-) | 17:31 |
*** trown|lunch is now known as trown | 17:35 | |
*** weshay is now known as weshay_brb | 17:37 | |
openstackgerrit | Brad P. Crochet proposed openstack-infra/tripleo-ci: Use tripleo-build-images for CI https://review.openstack.org/336312 | 17:38 |
*** yamahata has joined #tripleo | 17:38 | |
EmilienM | slagle: /me back from lunch. For the tag, yes we didn't follow it during Liberty but maybe we can try again now and show we respected the rules during 2 cycles and we want to continue | 17:39 |
*** mbound has quit IRC | 17:42 | |
*** flepied has joined #tripleo | 17:55 | |
*** flepied1 has joined #tripleo | 17:56 | |
*** weshay_brb is now known as weshay | 17:58 | |
*** jobewan is now known as jobewan_away | 17:59 | |
*** jobewan_away has quit IRC | 17:59 | |
*** flepied has quit IRC | 18:00 | |
*** tosky has quit IRC | 18:05 | |
*** mcornea has joined #tripleo | 18:07 | |
bnemec | Ouch. 8 ci jobs per tripleo-ci patch. | 18:08 |
bnemec | I wonder if we could try bumping the rh1 job capacity a bit now that we're running stable again. | 18:08 |
*** fragatina has joined #tripleo | 18:10 | |
*** panda|dinner is now known as panda | 18:11 | |
*** jobewan has joined #tripleo | 18:12 | |
pabelanger | EmilienM: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/tripleo.yaml#L64 | 18:13 |
pabelanger | EmilienM: the job I was talking about | 18:13 |
*** rcernin has joined #tripleo | 18:13 | |
*** jlinkes_ has quit IRC | 18:14 | |
*** akshai has quit IRC | 18:17 | |
openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Stop plan creation when container exists https://review.openstack.org/369623 | 18:22 |
*** jpich has quit IRC | 18:23 | |
*** david-lyle has quit IRC | 18:23 | |
*** david-lyle has joined #tripleo | 18:26 | |
*** pkovar has joined #tripleo | 18:27 | |
*** jlinkes has joined #tripleo | 18:28 | |
*** dtrainor has quit IRC | 18:31 | |
*** dtrainor has joined #tripleo | 18:31 | |
*** weshay is now known as weshay_mtg | 18:31 | |
*** jobewan is now known as jobewan_away | 18:32 | |
*** dsariel has joined #tripleo | 18:32 | |
*** jobewan_away has quit IRC | 18:32 | |
*** penick has quit IRC | 18:32 | |
*** pcaruana has joined #tripleo | 18:36 | |
beagles | EmilienM: bnemec: this https://bugs.launchpad.net/tripleo/+bug/1623155 seems to be true... thoughts? | 18:38 |
openstack | Launchpad bug 1623155 in tripleo "Neutron L3 HA isn't apparently being enabled anywere" [High,Confirmed] | 18:38 |
beagles | ugh.. fixed typo in title | 18:38 |
*** mhenkel has joined #tripleo | 18:39 | |
*** mhenkel has quit IRC | 18:40 | |
*** akshai has joined #tripleo | 18:40 | |
*** akshai_ has joined #tripleo | 18:41 | |
*** penick has joined #tripleo | 18:42 | |
*** akshai has quit IRC | 18:45 | |
*** dbecker has joined #tripleo | 18:48 | |
*** masco has quit IRC | 18:49 | |
*** abregman has quit IRC | 18:51 | |
openstackgerrit | Merged openstack/tripleo-quickstart: Add create-docs payload to minimal config https://review.openstack.org/368994 | 18:57 |
*** akrivoka has quit IRC | 18:57 | |
*** rlandy is now known as rlandy|brb | 19:11 | |
*** itlinux has joined #tripleo | 19:12 | |
itlinux | hello all, quick question, when installing with TripleO i see swift services, even though I have ceph configured on the backends. Any suggestions why? Thanks | 19:13 |
*** weshay_mtg is now known as weshay | 19:14 | |
*** david-lyle has quit IRC | 19:16 | |
*** morazi has quit IRC | 19:16 | |
*** jschlueter has quit IRC | 19:16 | |
*** pabelanger has quit IRC | 19:16 | |
*** jefrite has quit IRC | 19:16 | |
*** Nakato has quit IRC | 19:16 | |
*** cschwede has quit IRC | 19:16 | |
*** thrash has quit IRC | 19:16 | |
*** lynxman has quit IRC | 19:16 | |
*** dsariel has quit IRC | 19:16 | |
*** mcornea has quit IRC | 19:16 | |
*** flepied1 has quit IRC | 19:16 | |
*** dmanchad has quit IRC | 19:16 | |
*** pradk has quit IRC | 19:16 | |
*** noslzzp has quit IRC | 19:16 | |
*** jpena|off has quit IRC | 19:16 | |
*** bnemec has quit IRC | 19:16 | |
*** fpan has quit IRC | 19:16 | |
*** rwsu has quit IRC | 19:16 | |
*** Hazelesque has quit IRC | 19:16 | |
*** ianw has quit IRC | 19:16 | |
*** zoli_gone-proxy has quit IRC | 19:16 | |
*** cmyster has quit IRC | 19:16 | |
*** jmiu has quit IRC | 19:16 | |
*** itlinux has quit IRC | 19:17 | |
*** penick has quit IRC | 19:17 | |
*** trown has quit IRC | 19:17 | |
*** rhallisey has quit IRC | 19:17 | |
*** tzumainn has quit IRC | 19:17 | |
*** fultonj has quit IRC | 19:17 | |
*** ayoung has quit IRC | 19:17 | |
*** Ryjedo has quit IRC | 19:17 | |
*** gfidente|afk has quit IRC | 19:17 | |
*** davidlenwell has quit IRC | 19:17 | |
*** hrybacki has quit IRC | 19:17 | |
*** hogepodge has quit IRC | 19:17 | |
*** spredzy has quit IRC | 19:17 | |
*** patrickeast has quit IRC | 19:17 | |
*** adam_g has quit IRC | 19:17 | |
*** pleia2 has quit IRC | 19:17 | |
*** saneax-_-|AFK has quit IRC | 19:17 | |
*** vkmc has quit IRC | 19:17 | |
*** tbarron has quit IRC | 19:17 | |
*** rickflare has quit IRC | 19:17 | |
*** SpamapS has quit IRC | 19:17 | |
*** matbu has quit IRC | 19:17 | |
*** jlinkes has quit IRC | 19:17 | |
*** jayg has quit IRC | 19:17 | |
*** fzdarsky has quit IRC | 19:17 | |
*** rbrady has quit IRC | 19:17 | |
*** ccamacho|afk has quit IRC | 19:17 | |
*** zigo has quit IRC | 19:17 | |
*** nijaba has quit IRC | 19:17 | |
*** pblaho has quit IRC | 19:17 | |
*** zephcom has quit IRC | 19:17 | |
*** HenryG has quit IRC | 19:17 | |
*** mrunge has quit IRC | 19:17 | |
*** andreaf has quit IRC | 19:17 | |
*** mgagne has quit IRC | 19:17 | |
*** egafford has quit IRC | 19:17 | |
*** bkopilov has quit IRC | 19:17 | |
*** b00tcat has quit IRC | 19:17 | |
*** d0ugal has quit IRC | 19:17 | |
*** kbyrne has quit IRC | 19:17 | |
*** lucas-dinner has quit IRC | 19:17 | |
*** cinerama has quit IRC | 19:17 | |
*** stevebaker has quit IRC | 19:17 | |
*** jidar has quit IRC | 19:17 | |
*** StevenK has quit IRC | 19:17 | |
*** onovy has quit IRC | 19:17 | |
*** larstobi has quit IRC | 19:17 | |
*** ChanServ has quit IRC | 19:17 | |
*** dtantsur|afk has quit IRC | 19:17 | |
*** chem has quit IRC | 19:17 | |
*** apetrich has quit IRC | 19:17 | |
*** coolsvap_ has quit IRC | 19:17 | |
*** colonwq has quit IRC | 19:17 | |
*** mwhahaha has quit IRC | 19:17 | |
*** timothyb89 has quit IRC | 19:17 | |
*** igorbelikov has quit IRC | 19:17 | |
*** dtrainor has quit IRC | 19:17 | |
*** yamahata has quit IRC | 19:17 | |
*** bana_k has quit IRC | 19:17 | |
*** yolanda has quit IRC | 19:17 | |
*** tdasilva has quit IRC | 19:17 | |
*** ipsecguy has quit IRC | 19:17 | |
*** michchap has quit IRC | 19:17 | |
*** rcernin has quit IRC | 19:17 | |
*** flaper87 has quit IRC | 19:17 | |
*** ramishra has quit IRC | 19:17 | |
*** jistr has quit IRC | 19:17 | |
*** etp has quit IRC | 19:17 | |
*** myoung has quit IRC | 19:17 | |
*** honza has quit IRC | 19:17 | |
*** fungi has quit IRC | 19:17 | |
*** NachoDuck has quit IRC | 19:17 | |
*** lblanchard has quit IRC | 19:17 | |
*** jbadiapa has quit IRC | 19:17 | |
*** bandini has quit IRC | 19:17 | |
*** rhefner has quit IRC | 19:17 | |
*** mandre has quit IRC | 19:17 | |
*** zaneb has quit IRC | 19:17 | |
*** lazy_prince has quit IRC | 19:17 | |
*** toure has quit IRC | 19:17 | |
*** slagle has quit IRC | 19:17 | |
*** markmc has quit IRC | 19:18 | |
*** rcrit has quit IRC | 19:18 | |
*** r2bit has quit IRC | 19:18 | |
*** Goneri has quit IRC | 19:18 | |
*** cwolferh has quit IRC | 19:18 | |
*** chlong_ has quit IRC | 19:18 | |
*** shadower has quit IRC | 19:18 | |
*** afazekas has quit IRC | 19:18 | |
*** tobias-fiberdata has quit IRC | 19:18 | |
*** rodrigods has quit IRC | 19:18 | |
*** jbcraig has quit IRC | 19:18 | |
*** dciabrin has quit IRC | 19:18 | |
*** bvandenh has quit IRC | 19:18 | |
*** isq has quit IRC | 19:18 | |
*** rook has quit IRC | 19:18 | |
*** trozet has quit IRC | 19:18 | |
*** panda has quit IRC | 19:18 | |
*** jrist has quit IRC | 19:18 | |
*** akrzos has quit IRC | 19:18 | |
*** hewbrocca-afk has quit IRC | 19:18 | |
*** weshay has quit IRC | 19:18 | |
*** dmsimard has quit IRC | 19:18 | |
*** radez has quit IRC | 19:18 | |
*** sirushti has quit IRC | 19:18 | |
*** bkero has quit IRC | 19:18 | |
*** leifmadsen has quit IRC | 19:18 | |
*** fabbione has quit IRC | 19:18 | |
*** pcaruana has quit IRC | 19:18 | |
*** pkovar has quit IRC | 19:18 | |
*** r-mibu has quit IRC | 19:18 | |
*** paramite has quit IRC | 19:18 | |
*** rbowen has quit IRC | 19:18 | |
*** bswartz has quit IRC | 19:18 | |
*** CaptTofu has quit IRC | 19:18 | |
*** gregwork has quit IRC | 19:18 | |
*** mburned has quit IRC | 19:18 | |
*** ansiwen has quit IRC | 19:18 | |
*** sshnaidm has quit IRC | 19:18 | |
*** dhill_ has quit IRC | 19:18 | |
*** Ng has quit IRC | 19:18 | |
*** dobson` has quit IRC | 19:18 | |
*** NobodyCam has quit IRC | 19:18 | |
*** crinkle has quit IRC | 19:18 | |
*** greghaynes has quit IRC | 19:18 | |
*** fragatina has quit IRC | 19:18 | |
*** kjw3 has quit IRC | 19:18 | |
*** oshvartz has quit IRC | 19:18 | |
*** openstackgerrit has quit IRC | 19:18 | |
*** social has quit IRC | 19:18 | |
*** adarazs has quit IRC | 19:18 | |
*** lifeless has quit IRC | 19:18 | |
*** bkreitch has quit IRC | 19:18 | |
*** therve has quit IRC | 19:18 | |
*** beagles has quit IRC | 19:18 | |
*** sanjayu|AFK has quit IRC | 19:18 | |
*** gchamoul has quit IRC | 19:18 | |
*** marios has quit IRC | 19:18 | |
*** jroll has quit IRC | 19:18 | |
*** EmilienM has quit IRC | 19:18 | |
*** StevenK has joined #tripleo | 19:23 | |
*** jmiu has joined #tripleo | 19:23 | |
*** zoli_gone-proxy has joined #tripleo | 19:23 | |
*** noslzzp has joined #tripleo | 19:23 | |
*** trown has joined #tripleo | 19:23 | |
*** dciabrin has joined #tripleo | 19:23 | |
*** lynxman has joined #tripleo | 19:23 | |
*** thrash has joined #tripleo | 19:23 | |
*** cschwede has joined #tripleo | 19:23 | |
*** Nakato has joined #tripleo | 19:23 | |
*** jefrite has joined #tripleo | 19:23 | |
*** pabelanger has joined #tripleo | 19:23 | |
*** jschlueter has joined #tripleo | 19:23 | |
*** morazi has joined #tripleo | 19:23 | |
*** rodrigod` has joined #tripleo | 19:23 | |
*** dtantsur has joined #tripleo | 19:23 | |
*** trozet has joined #tripleo | 19:23 | |
*** isq has joined #tripleo | 19:23 | |
*** chlong_ has joined #tripleo | 19:23 | |
*** flepied has joined #tripleo | 19:23 | |
*** pkovar has joined #tripleo | 19:23 | |
*** bnemec has joined #tripleo | 19:23 | |
*** onovy has joined #tripleo | 19:23 | |
*** sirushti has joined #tripleo | 19:23 | |
*** sshnaidm has joined #tripleo | 19:23 | |
*** pcaruana has joined #tripleo | 19:23 | |
*** weshay has joined #tripleo | 19:23 | |
*** paramite has joined #tripleo | 19:23 | |
*** timothyb89 has joined #tripleo | 19:23 | |
*** mwhahaha has joined #tripleo | 19:23 | |
*** colonwq has joined #tripleo | 19:23 | |
*** apetrich has joined #tripleo | 19:23 | |
*** chem has joined #tripleo | 19:23 | |
*** Goneri has joined #tripleo | 19:23 | |
*** dmanchad has joined #tripleo | 19:23 | |
*** shadower has joined #tripleo | 19:23 | |
*** bswartz has joined #tripleo | 19:23 | |
*** fungi has joined #tripleo | 19:23 | |
*** honza has joined #tripleo | 19:23 | |
*** myoung has joined #tripleo | 19:23 | |
*** etp has joined #tripleo | 19:23 | |
*** jistr has joined #tripleo | 19:23 | |
*** ramishra has joined #tripleo | 19:23 | |
*** flaper87 has joined #tripleo | 19:23 | |
*** rcernin has joined #tripleo | 19:23 | |
*** thegodfather has joined #tripleo | 19:23 | |
*** larstobi has joined #tripleo | 19:23 | |
*** afazekas has joined #tripleo | 19:23 | |
*** tobias-fiberdata has joined #tripleo | 19:23 | |
*** jrist has joined #tripleo | 19:23 | |
*** dsariel has joined #tripleo | 19:23 | |
*** hewbrocca-afk has joined #tripleo | 19:23 | |
*** david-lyle has joined #tripleo | 19:23 | |
*** bkero has joined #tripleo | 19:23 | |
*** ChanServ has joined #tripleo | 19:23 | |
*** ianw has joined #tripleo | 19:23 | |
*** jbcraig has joined #tripleo | 19:23 | |
*** mcornea has joined #tripleo | 19:23 | |
*** fpan has joined #tripleo | 19:23 | |
*** jlinkes has joined #tripleo | 19:23 | |
*** jayg has joined #tripleo | 19:23 | |
*** fzdarsky has joined #tripleo | 19:23 | |
*** rbrady has joined #tripleo | 19:23 | |
*** ccamacho|afk has joined #tripleo | 19:23 | |
*** zigo has joined #tripleo | 19:23 | |
*** nijaba has joined #tripleo | 19:23 | |
*** pblaho has joined #tripleo | 19:23 | |
*** zephcom has joined #tripleo | 19:23 | |
*** HenryG has joined #tripleo | 19:23 | |
*** mrunge has joined #tripleo | 19:23 | |
*** andreaf has joined #tripleo | 19:23 | |
*** mgagne has joined #tripleo | 19:23 | |
*** lblanchard has joined #tripleo | 19:23 | |
*** jbadiapa has joined #tripleo | 19:23 | |
*** bandini has joined #tripleo | 19:23 | |
*** rhefner has joined #tripleo | 19:23 | |
*** mandre has joined #tripleo | 19:23 | |
*** zaneb has joined #tripleo | 19:23 | |
*** lazy_prince has joined #tripleo | 19:23 | |
*** toure has joined #tripleo | 19:23 | |
*** rcrit has joined #tripleo | 19:23 | |
*** slagle has joined #tripleo | 19:23 | |
*** markmc has joined #tripleo | 19:23 | |
*** r2bit has joined #tripleo | 19:23 | |
*** ansiwen has joined #tripleo | 19:23 | |
*** crinkle has joined #tripleo | 19:23 | |
*** r-mibu has joined #tripleo | 19:23 | |
*** itlinux has joined #tripleo | 19:23 | |
*** penick has joined #tripleo | 19:23 | |
*** rhallisey has joined #tripleo | 19:23 | |
*** tzumainn has joined #tripleo | 19:23 | |
*** fultonj has joined #tripleo | 19:23 | |
*** Ryjedo has joined #tripleo | 19:23 | |
*** gfidente|afk has joined #tripleo | 19:23 | |
*** orwell.freenode.net sets mode: +o ChanServ | 19:23 | |
*** davidlenwell has joined #tripleo | 19:23 | |
*** hogepodge has joined #tripleo | 19:23 | |
*** spredzy has joined #tripleo | 19:23 | |
*** patrickeast has joined #tripleo | 19:23 | |
*** adam_g has joined #tripleo | 19:23 | |
*** pleia2 has joined #tripleo | 19:23 | |
*** saneax-_-|AFK has joined #tripleo | 19:23 | |
*** tbarron has joined #tripleo | 19:23 | |
*** vkmc has joined #tripleo | 19:23 | |
*** rickflare has joined #tripleo | 19:23 | |
*** SpamapS has joined #tripleo | 19:23 | |
*** matbu has joined #tripleo | 19:23 | |
*** orwell.freenode.net sets mode: +v davidlenwell | 19:23 | |
*** rook has joined #tripleo | 19:23 | |
*** dmsimard has joined #tripleo | 19:23 | |
*** leifmadsen has joined #tripleo | 19:23 | |
*** rbowen has joined #tripleo | 19:23 | |
*** cmyster has joined #tripleo | 19:23 | |
*** mburned has joined #tripleo | 19:23 | |
*** fragatina has joined #tripleo | 19:23 | |
*** kjw3 has joined #tripleo | 19:23 | |
*** oshvartz has joined #tripleo | 19:23 | |
*** openstackgerrit has joined #tripleo | 19:23 | |
*** social has joined #tripleo | 19:23 | |
*** adarazs has joined #tripleo | 19:23 | |
*** lifeless has joined #tripleo | 19:23 | |
*** beagles has joined #tripleo | 19:23 | |
*** bkreitch has joined #tripleo | 19:23 | |
*** therve has joined #tripleo | 19:23 | |
*** sanjayu|AFK has joined #tripleo | 19:23 | |
*** gchamoul has joined #tripleo | 19:23 | |
*** marios has joined #tripleo | 19:23 | |
*** jroll has joined #tripleo | 19:23 | |
*** EmilienM has joined #tripleo | 19:23 | |
*** panda has joined #tripleo | 19:23 | |
*** bvandenh has joined #tripleo | 19:23 | |
*** rwsu has joined #tripleo | 19:23 | |
*** dtrainor has joined #tripleo | 19:23 | |
*** snecklifter has joined #tripleo | 19:23 | |
*** pradk has joined #tripleo | 19:23 | |
*** greghaynes has joined #tripleo | 19:23 | |
*** cwolferh has joined #tripleo | 19:23 | |
*** akrzos has joined #tripleo | 19:23 | |
*** dhill_ has joined #tripleo | 19:23 | |
*** Hazelesque has joined #tripleo | 19:23 | |
*** radez has joined #tripleo | 19:23 | |
*** yamahata has joined #tripleo | 19:23 | |
*** bana_k has joined #tripleo | 19:23 | |
*** yolanda has joined #tripleo | 19:23 | |
*** tdasilva has joined #tripleo | 19:23 | |
*** ipsecguy has joined #tripleo | 19:23 | |
*** michchap has joined #tripleo | 19:23 | |
*** egafford has joined #tripleo | 19:23 | |
*** bkopilov has joined #tripleo | 19:23 | |
*** b00tcat has joined #tripleo | 19:23 | |
*** d0ugal has joined #tripleo | 19:23 | |
*** kbyrne has joined #tripleo | 19:23 | |
*** lucas-dinner has joined #tripleo | 19:23 | |
*** cinerama has joined #tripleo | 19:23 | |
*** stevebaker has joined #tripleo | 19:23 | |
*** jidar has joined #tripleo | 19:23 | |
*** dmanchad has quit IRC | 19:23 | |
*** dmanchad has joined #tripleo | 19:23 | |
*** weshay has quit IRC | 19:24 | |
*** weshay has joined #tripleo | 19:24 | |
*** Hazelesque has quit IRC | 19:24 | |
*** Hazelesque has joined #tripleo | 19:24 | |
*** dtantsur has quit IRC | 19:24 | |
*** dtantsur has joined #tripleo | 19:24 | |
*** trown has quit IRC | 19:24 | |
*** trown has joined #tripleo | 19:24 | |
*** zoli_gone-proxy has quit IRC | 19:24 | |
*** zoli_gone-proxy has joined #tripleo | 19:24 | |
*** jmiu has quit IRC | 19:24 | |
*** jmiu has joined #tripleo | 19:24 | |
*** rook has quit IRC | 19:24 | |
*** rook has joined #tripleo | 19:24 | |
*** mburned has quit IRC | 19:24 | |
*** mburned has joined #tripleo | 19:24 | |
*** cmyster has quit IRC | 19:24 | |
*** cmyster has joined #tripleo | 19:24 | |
*** patrickeast has quit IRC | 19:24 | |
*** rook is now known as Guest46013 | 19:24 | |
*** radez has quit IRC | 19:24 | |
*** radez has joined #tripleo | 19:24 | |
*** akrzos has quit IRC | 19:24 | |
*** akrzos has joined #tripleo | 19:24 | |
*** leifmadsen has quit IRC | 19:24 | |
*** leifmadsen has joined #tripleo | 19:24 | |
*** cmyster is now known as Guest90031 | 19:24 | |
*** panda is now known as Guest46614 | 19:24 | |
*** rbowen has quit IRC | 19:24 | |
*** rbowen has joined #tripleo | 19:24 | |
*** jpena|off has joined #tripleo | 19:24 | |
*** dmsimard has quit IRC | 19:25 | |
*** rlandy|brb is now known as rlandy | 19:26 | |
*** ayoung has joined #tripleo | 19:26 | |
*** dmsimard has joined #tripleo | 19:26 | |
*** dobson has joined #tripleo | 19:27 | |
*** CaptTofu has joined #tripleo | 19:29 | |
*** bfournie has quit IRC | 19:34 | |
*** Guest46614 is now known as panda | 19:34 | |
*** bfournie has joined #tripleo | 19:34 | |
*** bfournie has quit IRC | 19:34 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: set up quickstart to replace instack-virt-setup https://review.openstack.org/358089 | 19:36 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: set up quickstart to replace instack-virt-setup https://review.openstack.org/358089 | 19:37 |
*** dmsimard is now known as dmsimard|afk | 19:37 | |
*** chem has quit IRC | 19:38 | |
*** dobson has quit IRC | 19:38 | |
*** dobson has joined #tripleo | 19:39 | |
*** NobodyCam has joined #tripleo | 19:41 | |
*** jrist has quit IRC | 19:43 | |
*** jrist has joined #tripleo | 19:43 | |
*** pkovar has quit IRC | 19:47 | |
*** akshai_ has quit IRC | 19:48 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Change position to gate injection https://review.openstack.org/369649 | 19:49 |
mwhahaha | trown: hey does tripleo-quickstart support multiple environments on a single virt host? | 19:53 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Move role ResourceGroups inside the jinja2 loop https://review.openstack.org/365793 | 19:54 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Convert allNodesConfig properties to composable jinja2 https://review.openstack.org/365794 | 19:54 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Convert deploy steps to jinja2 loop https://review.openstack.org/365796 | 19:54 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Convert UpdateWorkflow to support composable roles https://review.openstack.org/367282 | 19:54 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Convert AllNodesExtraConfig to support composable roles https://review.openstack.org/367295 | 19:55 |
EmilienM | it shoudl pass | 19:55 |
mwhahaha | none shall pass \o/| | 19:55 |
trown | mwhahaha: there is nothing theoretically in the way... | 19:55 |
trown | mwhahaha: ie if you use different virt names for the two different envs there is nothing blocking that from working | 19:55 |
*** dsariel has quit IRC | 19:56 | |
mwhahaha | trown: ok thanks, just wondering | 19:56 |
*** mcornea has quit IRC | 19:57 | |
*** jlinkes has quit IRC | 20:01 | |
*** jlinkes has joined #tripleo | 20:01 | |
*** igorbelikov has joined #tripleo | 20:03 | |
*** jobewan has joined #tripleo | 20:03 | |
*** NachoDuck has joined #tripleo | 20:04 | |
*** coolsvap_ has joined #tripleo | 20:05 | |
*** jobewan has quit IRC | 20:06 | |
*** gregwork has joined #tripleo | 20:06 | |
*** patrickeast has joined #tripleo | 20:06 | |
*** nyechiel has joined #tripleo | 20:07 | |
*** bfournie has joined #tripleo | 20:07 | |
*** itlinux has quit IRC | 20:08 | |
*** tzumainn has quit IRC | 20:08 | |
*** tzumainn has joined #tripleo | 20:08 | |
*** mgarciam has joined #tripleo | 20:10 | |
openstackgerrit | Ben Nemec proposed openstack/python-tripleoclient: Handle openstackclient.tests.utils move https://review.openstack.org/369658 | 20:11 |
*** pcaruana has quit IRC | 20:11 | |
bnemec | EmilienM: ^ is a workaround on our side. | 20:11 |
EmilienM | bnemec: nice, thanks for the quick fix | 20:11 |
bnemec | beagles: Sounds like a serious problem. Do you know how to fix it? | 20:12 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: [WIP] update to README to explain how to run a full end to end deployment and test https://review.openstack.org/369659 | 20:13 |
*** paramite has quit IRC | 20:17 | |
*** sshnaidm is now known as sshnaidm|afk | 20:17 | |
*** hrybacki has joined #tripleo | 20:18 | |
*** jayg is now known as jayg|g0n3 | 20:18 | |
*** apetrich has quit IRC | 20:19 | |
*** akuznetsov has joined #tripleo | 20:20 | |
*** yolanda has quit IRC | 20:20 | |
*** yolanda has joined #tripleo | 20:21 | |
*** itlinux has joined #tripleo | 20:21 | |
EmilienM | larsks: it sounds like to me https://review.openstack.org/#/c/353506/ has a valid CI failure | 20:21 |
EmilienM | http://logs.openstack.org/06/353506/48/check/gate-tripleo-ci-centos-7-scenario003-multinode/1960dbc/logs/postci.txt.gz#_2016-09-13_15_53_00_000 | 20:21 |
EmilienM | Resource CREATE failed: The Referenced Attribute (ControllerServiceChain role_data) is incorrect. | 20:21 |
EmilienM | I'll dig into logs | 20:22 |
*** akuznetsov has quit IRC | 20:24 | |
*** nyechiel has quit IRC | 20:24 | |
*** rhallisey has quit IRC | 20:28 | |
*** rhallisey has joined #tripleo | 20:30 | |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Remove Ceph from the ha job https://review.openstack.org/362990 | 20:30 |
*** apetrich has joined #tripleo | 20:33 | |
*** jlinkes_ has joined #tripleo | 20:35 | |
*** jlinkes has quit IRC | 20:39 | |
*** trown is now known as trown|outtypewww | 20:40 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: update the upgrade.sh script to work w/ qs extras https://review.openstack.org/369674 | 20:42 |
larsks | EmilienM, sigh. And after passing for two weeks. | 20:42 |
larsks | I'll take a look this evening. | 20:43 |
*** rodrigod` is now known as rodrigods | 20:45 | |
*** Ng has joined #tripleo | 20:56 | |
*** ChanServ sets mode: +v Ng | 20:56 | |
*** rhallisey has quit IRC | 21:09 | |
*** myoung is now known as myoung|bbl | 21:11 | |
*** lblanchard has quit IRC | 21:14 | |
*** apetrich has quit IRC | 21:16 | |
*** bnemec has quit IRC | 21:20 | |
*** akuznetsov has joined #tripleo | 21:20 | |
*** zoli_gone-proxy has quit IRC | 21:21 | |
*** noslzzp has quit IRC | 21:21 | |
*** trown|outtypewww has quit IRC | 21:21 | |
*** trown has joined #tripleo | 21:23 | |
*** fragatin_ has joined #tripleo | 21:24 | |
*** nyechiel has joined #tripleo | 21:24 | |
*** bnemec has joined #tripleo | 21:24 | |
*** mgarciam has left #tripleo | 21:26 | |
*** lucas-dinner has quit IRC | 21:26 | |
*** fragatina has quit IRC | 21:27 | |
*** fragatin_ has quit IRC | 21:27 | |
*** jlinkes_ has quit IRC | 21:27 | |
*** NachoDuck has quit IRC | 21:27 | |
*** pradk has quit IRC | 21:27 | |
*** cwolferh has quit IRC | 21:27 | |
*** akrzos has quit IRC | 21:27 | |
*** dhill_ has quit IRC | 21:27 | |
*** greghaynes has quit IRC | 21:27 | |
*** radez has quit IRC | 21:27 | |
*** Hazelesque has quit IRC | 21:27 | |
*** yamahata has quit IRC | 21:27 | |
*** bana_k has quit IRC | 21:27 | |
*** tdasilva has quit IRC | 21:27 | |
*** ipsecguy has quit IRC | 21:27 | |
*** michchap has quit IRC | 21:28 | |
*** akuznetsov has quit IRC | 21:28 | |
*** ipsecguy has joined #tripleo | 21:28 | |
*** radez has joined #tripleo | 21:28 | |
*** akrzos has joined #tripleo | 21:28 | |
*** cwolferh has joined #tripleo | 21:28 | |
*** greghaynes has joined #tripleo | 21:28 | |
*** jlinkes_ has joined #tripleo | 21:28 | |
*** dhill_ has joined #tripleo | 21:28 | |
*** pradk has joined #tripleo | 21:28 | |
*** michchap has joined #tripleo | 21:28 | |
*** bana_k has joined #tripleo | 21:28 | |
*** Hazelesque has joined #tripleo | 21:28 | |
*** fragatina has joined #tripleo | 21:29 | |
*** lucasagomes has joined #tripleo | 21:29 | |
*** yamahata has joined #tripleo | 21:30 | |
*** zoli_gone-proxy has joined #tripleo | 21:33 | |
*** fragatina has quit IRC | 21:33 | |
rwsu | why does "openstack undercloud install" ask for the user password? | 21:34 |
*** lucasagomes has quit IRC | 21:34 | |
*** NachoDuck has joined #tripleo | 21:35 | |
*** lucasagomes has joined #tripleo | 21:35 | |
bnemec | rwsu: There's a bug in the version of osc we have in the dlrn repos right now. | 21:36 |
bnemec | It should be fixed in master osc. | 21:36 |
bnemec | If you just hit enter on the prompt it will continue normally. | 21:37 |
rwsu | bnemec: ok thanks, i thought I might have misconfigured something | 21:37 |
*** fragatina has joined #tripleo | 21:39 | |
*** fragatina has quit IRC | 21:39 | |
*** fragatina has joined #tripleo | 21:40 | |
*** lucasagomes has quit IRC | 21:40 | |
*** lucasagomes has joined #tripleo | 21:41 | |
*** Guest46013 has quit IRC | 21:42 | |
*** rook has joined #tripleo | 21:42 | |
*** rook is now known as Guest734 | 21:42 | |
*** sai has quit IRC | 21:43 | |
*** sai has joined #tripleo | 21:43 | |
*** fragatina has quit IRC | 21:45 | |
*** lucasagomes has quit IRC | 21:46 | |
*** fzdarsky is now known as fzdarsky|afk | 21:46 | |
*** lucasagomes has joined #tripleo | 21:48 | |
*** nyechiel has quit IRC | 21:51 | |
*** fzdarsky|afk has quit IRC | 21:51 | |
*** lucasagomes has quit IRC | 21:52 | |
*** noslzzp has joined #tripleo | 21:56 | |
*** fragatina has joined #tripleo | 21:56 | |
*** lucasagomes has joined #tripleo | 21:57 | |
*** fragatina has quit IRC | 21:57 | |
*** lucasagomes has quit IRC | 22:02 | |
*** lucasagomes has joined #tripleo | 22:02 | |
*** tdasilva has joined #tripleo | 22:06 | |
*** lucasagomes has quit IRC | 22:07 | |
*** morazi has quit IRC | 22:09 | |
*** lucasagomes has joined #tripleo | 22:10 | |
*** panda is now known as panda|Zz | 22:11 | |
*** limao has joined #tripleo | 22:12 | |
openstackgerrit | Merged openstack/tripleo-quickstart: set up quickstart to replace instack-virt-setup https://review.openstack.org/358089 | 22:13 |
*** itlinux has quit IRC | 22:13 | |
*** lucasagomes has quit IRC | 22:15 | |
*** itlinux has joined #tripleo | 22:16 | |
*** lucasagomes has joined #tripleo | 22:16 | |
*** fragatina has joined #tripleo | 22:20 | |
*** lucasagomes has quit IRC | 22:21 | |
*** lucasagomes has joined #tripleo | 22:23 | |
*** akuznetsov has joined #tripleo | 22:23 | |
*** fragatina has quit IRC | 22:24 | |
*** itlinux has quit IRC | 22:26 | |
openstackgerrit | Steve Baker proposed openstack/os-collect-config: WIP ec2 collector attempt config-drive before metadata server https://review.openstack.org/369731 | 22:26 |
*** limao has quit IRC | 22:26 | |
*** limao has joined #tripleo | 22:26 | |
colonwq | EmilienM, or anyone, How do I recheck the OVB tests for a patch? | 22:26 |
*** akuznetsov has quit IRC | 22:27 | |
*** lucasagomes has quit IRC | 22:28 | |
*** lucasagomes has joined #tripleo | 22:29 | |
*** limao has quit IRC | 22:31 | |
*** dsariel has joined #tripleo | 22:33 | |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Migrate to using osc-lib https://review.openstack.org/335460 | 22:35 |
*** lucasagomes has quit IRC | 22:36 | |
*** lucasagomes has joined #tripleo | 22:38 | |
*** itlinux has joined #tripleo | 22:39 | |
*** sai has quit IRC | 22:43 | |
*** apetrich has joined #tripleo | 22:43 | |
*** sai has joined #tripleo | 22:44 | |
*** lucasagomes has quit IRC | 22:46 | |
*** itlinux has quit IRC | 22:49 | |
*** lucasagomes has joined #tripleo | 22:49 | |
*** gfidente|afk has quit IRC | 22:51 | |
*** lucasagomes has quit IRC | 22:54 | |
*** fragatina has joined #tripleo | 22:55 | |
*** lucasagomes has joined #tripleo | 22:56 | |
*** sai has quit IRC | 22:56 | |
*** Goneri has quit IRC | 22:57 | |
*** itlinux has joined #tripleo | 22:57 | |
*** fragatina has quit IRC | 23:00 | |
*** sai has joined #tripleo | 23:00 | |
*** fragatina has joined #tripleo | 23:03 | |
*** saneax-_-|AFK is now known as saneax | 23:03 | |
*** lucasagomes has quit IRC | 23:05 | |
*** lucasagomes has joined #tripleo | 23:06 | |
*** fragatina has quit IRC | 23:07 | |
*** lucasagomes has quit IRC | 23:10 | |
*** fragatina has joined #tripleo | 23:10 | |
*** dmsimard|afk is now known as dmsimard | 23:11 | |
*** yamahata has quit IRC | 23:15 | |
*** lucasagomes has joined #tripleo | 23:16 | |
*** ayoung has quit IRC | 23:20 | |
*** Goneri has joined #tripleo | 23:22 | |
*** pmannidi has joined #tripleo | 23:23 | |
*** rcernin has quit IRC | 23:23 | |
*** lucasagomes has quit IRC | 23:23 | |
*** akuznetsov has joined #tripleo | 23:24 | |
*** yamahata has joined #tripleo | 23:24 | |
*** lucasagomes has joined #tripleo | 23:27 | |
*** akuznetsov has quit IRC | 23:29 | |
*** lucasagomes has quit IRC | 23:31 | |
*** Goneri has quit IRC | 23:31 | |
*** lucasagomes has joined #tripleo | 23:33 | |
*** sai has quit IRC | 23:34 | |
*** dsariel has quit IRC | 23:36 | |
*** saneax is now known as saneax-_-|AFK | 23:36 | |
*** lucasagomes has quit IRC | 23:38 | |
*** sai has joined #tripleo | 23:38 | |
*** lucasagomes has joined #tripleo | 23:40 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Move role ResourceGroups inside the jinja2 loop https://review.openstack.org/365793 | 23:51 |
*** apetrich has quit IRC | 23:52 | |
EmilienM | colonwq: "recheck" | 23:55 |
*** apetrich has joined #tripleo | 23:55 | |
*** sai has quit IRC | 23:56 | |
*** sai has joined #tripleo | 23:57 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!