*** d0ugal has quit IRC | 00:04 | |
*** ramishra has quit IRC | 00:09 | |
*** jmelvin has quit IRC | 00:09 | |
*** ooolpbot has joined #tripleo | 00:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
---|---|---|
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1686455 | 00:10 |
*** ooolpbot has quit IRC | 00:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 00:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 00:10 |
openstack | Launchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 00:10 |
*** ramishra has joined #tripleo | 00:11 | |
*** salmankhan has joined #tripleo | 00:17 | |
*** salmankhan has quit IRC | 00:21 | |
*** ramishra has quit IRC | 00:25 | |
*** ramishra has joined #tripleo | 00:27 | |
*** ramishra has quit IRC | 00:35 | |
*** limao has joined #tripleo | 00:38 | |
*** ramishra has joined #tripleo | 00:40 | |
*** ramishra has quit IRC | 00:45 | |
*** ramishra has joined #tripleo | 00:57 | |
*** dixiaoli has joined #tripleo | 01:01 | |
*** gbarros has joined #tripleo | 01:02 | |
*** ramishra has quit IRC | 01:04 | |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1686455 | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 01:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 01:10 |
openstack | Launchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 01:10 |
*** ramishra has joined #tripleo | 01:12 | |
*** Goneri has joined #tripleo | 01:13 | |
*** ramishra has quit IRC | 01:17 | |
*** ramishra has joined #tripleo | 01:18 | |
*** Goneri has quit IRC | 01:19 | |
*** prateek has quit IRC | 01:26 | |
*** yamahata_ has quit IRC | 01:33 | |
*** ramishra has quit IRC | 01:35 | |
*** ramishra has joined #tripleo | 01:42 | |
*** ramishra has quit IRC | 01:49 | |
*** dparkes has joined #tripleo | 01:49 | |
*** ramishra has joined #tripleo | 01:50 | |
*** ramishra has quit IRC | 02:00 | |
*** ramishra has joined #tripleo | 02:01 | |
*** prateek has joined #tripleo | 02:04 | |
*** limao has quit IRC | 02:08 | |
*** limao has joined #tripleo | 02:09 | |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1686455 | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 02:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 02:10 |
openstack | Launchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 02:10 |
*** prateek has quit IRC | 02:11 | |
*** ramishra has quit IRC | 02:11 | |
*** salmankhan has joined #tripleo | 02:17 | |
*** dparkes has quit IRC | 02:18 | |
*** ramishra has joined #tripleo | 02:19 | |
*** salmankhan has quit IRC | 02:22 | |
*** ramishra has quit IRC | 02:23 | |
*** gbarros has quit IRC | 02:30 | |
*** ramishra has joined #tripleo | 02:30 | |
*** ramishra has quit IRC | 02:42 | |
*** ramishra has joined #tripleo | 02:44 | |
*** chlong has joined #tripleo | 02:47 | |
*** fragatin_ has joined #tripleo | 02:48 | |
*** liverpooler has quit IRC | 02:50 | |
*** ramishra has quit IRC | 02:50 | |
*** fragatina has quit IRC | 02:52 | |
*** ramishra has joined #tripleo | 02:52 | |
*** fragatin_ has quit IRC | 02:53 | |
*** ramishra has quit IRC | 02:56 | |
*** ramishra has joined #tripleo | 02:59 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: CI test - never merge https://review.openstack.org/460223 | 03:03 |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1686455 | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 03:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 03:10 |
openstack | Launchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 03:10 |
*** psahoo has joined #tripleo | 03:34 | |
*** morazi has joined #tripleo | 03:37 | |
*** ratailor has joined #tripleo | 03:39 | |
*** ratailor_ has joined #tripleo | 03:41 | |
*** ratailor_ has quit IRC | 03:42 | |
*** tzumainn has quit IRC | 03:43 | |
*** ratailor has quit IRC | 03:45 | |
*** garyk has joined #tripleo | 03:49 | |
*** garyk has quit IRC | 03:49 | |
*** garyk has joined #tripleo | 03:51 | |
*** ramishra has quit IRC | 03:51 | |
*** ramishra has joined #tripleo | 03:54 | |
*** yolanda has quit IRC | 03:56 | |
*** ykarel has joined #tripleo | 03:57 | |
openstackgerrit | Merged openstack/tripleo-quickstart master: Purge CentOS OpenStack repos if they exist https://review.openstack.org/460339 | 04:03 |
*** dsariel has joined #tripleo | 04:04 | |
*** yolanda has joined #tripleo | 04:04 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Remove centos-release-ceph-* package provided by nodepool https://review.openstack.org/460277 | 04:05 |
*** ramishra has quit IRC | 04:07 | |
*** ramishra has joined #tripleo | 04:08 | |
*** yolanda has quit IRC | 04:10 | |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1686455 | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 04:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 04:10 |
openstack | Launchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 04:10 |
*** gkadam has joined #tripleo | 04:12 | |
*** fragatina has joined #tripleo | 04:13 | |
*** jaganathan has joined #tripleo | 04:13 | |
*** nmathew has joined #tripleo | 04:15 | |
*** ramishra has quit IRC | 04:16 | |
*** ramishra has joined #tripleo | 04:16 | |
*** fragatina has quit IRC | 04:21 | |
*** udesale has joined #tripleo | 04:21 | |
*** fragatina has joined #tripleo | 04:21 | |
*** ratailor has joined #tripleo | 04:24 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: testing oooq https://review.openstack.org/459766 | 04:27 |
*** agurenko has joined #tripleo | 04:33 | |
*** ramishra has quit IRC | 04:40 | |
*** ramishra has joined #tripleo | 04:42 | |
*** yamahata_ has joined #tripleo | 04:45 | |
*** ramishra has quit IRC | 04:48 | |
*** skramaja has joined #tripleo | 04:49 | |
*** pgadiya has joined #tripleo | 04:58 | |
*** ramishra has joined #tripleo | 05:00 | |
*** Erming_ has quit IRC | 05:02 | |
*** Erming_ has joined #tripleo | 05:02 | |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1686455 | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 05:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 05:10 |
openstack | Launchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 05:10 |
*** ramishra has quit IRC | 05:12 | |
*** yprokule has joined #tripleo | 05:12 | |
*** pmannidi has quit IRC | 05:13 | |
*** ramishra has joined #tripleo | 05:14 | |
*** masco has joined #tripleo | 05:14 | |
*** ratailor_ has joined #tripleo | 05:14 | |
*** ratailor has quit IRC | 05:18 | |
*** ratailor_ has quit IRC | 05:31 | |
*** janki has joined #tripleo | 05:31 | |
*** ratailor has joined #tripleo | 05:31 | |
*** jaganathan has quit IRC | 05:39 | |
*** iranzo has joined #tripleo | 05:41 | |
*** mdnadeem has joined #tripleo | 05:41 | |
*** mdnadeem has quit IRC | 05:42 | |
*** mdnadeem has joined #tripleo | 05:42 | |
*** mdnadeem has quit IRC | 05:42 | |
*** mdnadeem has joined #tripleo | 05:42 | |
*** pmannidi has joined #tripleo | 05:46 | |
*** janki has quit IRC | 05:51 | |
*** bkopilov has quit IRC | 05:52 | |
*** bkopilov has joined #tripleo | 05:52 | |
*** janki has joined #tripleo | 05:56 | |
*** michapma_dsk has joined #tripleo | 05:56 | |
*** janki has quit IRC | 05:56 | |
*** janki has joined #tripleo | 05:57 | |
janki | Hey, will today's deep dive session recorded? | 05:58 |
*** prateek has joined #tripleo | 05:59 | |
*** lmiccini has joined #tripleo | 06:02 | |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1686455 | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 06:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 06:10 |
openstack | Launchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 06:10 |
*** dparkes has joined #tripleo | 06:11 | |
*** ckyriakidou has joined #tripleo | 06:14 | |
*** atheurer has quit IRC | 06:14 | |
*** mdnadeem has quit IRC | 06:14 | |
*** mdnadeem has joined #tripleo | 06:15 | |
*** ccamacho has quit IRC | 06:19 | |
*** idlemind has quit IRC | 06:24 | |
*** idlemind has joined #tripleo | 06:25 | |
*** bogdando has joined #tripleo | 06:26 | |
*** janki has quit IRC | 06:27 | |
*** artom has quit IRC | 06:30 | |
*** artom has joined #tripleo | 06:30 | |
*** janki has joined #tripleo | 06:31 | |
*** cylopez has joined #tripleo | 06:31 | |
*** jaganathan has joined #tripleo | 06:32 | |
*** artom has quit IRC | 06:32 | |
*** artom has joined #tripleo | 06:32 | |
*** dparkes has quit IRC | 06:32 | |
*** rwsu has quit IRC | 06:33 | |
*** rwsu has joined #tripleo | 06:34 | |
*** dciabrin has joined #tripleo | 06:38 | |
*** jprovazn has joined #tripleo | 06:40 | |
*** zoli|gone is now known as zoli | 06:41 | |
*** skramaja has quit IRC | 06:43 | |
*** skramaja_ has joined #tripleo | 06:43 | |
*** florianf has joined #tripleo | 06:43 | |
*** jlinkes has joined #tripleo | 06:44 | |
*** nyechiel has joined #tripleo | 06:44 | |
*** pcaruana has joined #tripleo | 06:44 | |
*** d0ugal has joined #tripleo | 06:44 | |
*** ratailor has quit IRC | 06:45 | |
*** rwsu has quit IRC | 06:45 | |
*** rwsu has joined #tripleo | 06:46 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Internal TLS: use common CA file parameter for libvirt CA cert https://review.openstack.org/460025 | 06:47 |
*** shardy has joined #tripleo | 06:50 | |
*** shardy has quit IRC | 06:50 | |
*** shardy has joined #tripleo | 06:51 | |
*** jaosorior_away is now known as jaosorior | 06:51 | |
jaosorior | shardy: hey, do you know where we include the base apache puppet module? | 06:52 |
shardy | jaosorior: grep only shows the ui.pp profile include it directly, so I assume each of the ::service::wsgi::apache modules include it as a dependency? | 06:55 |
jaosorior | you're right, just checked the puppet-openstacklib module (that all our modules use) | 06:56 |
jaosorior | and it gets included there | 06:56 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/ocata: upgrades: deploy mod_ssl when upgrading apache https://review.openstack.org/460309 | 06:56 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Include base apache module in tls_proxy resource https://review.openstack.org/460423 | 06:57 |
jaosorior | shardy: had do this ^^ | 06:57 |
*** dparkes has joined #tripleo | 06:59 | |
*** dtrainor has quit IRC | 07:03 | |
*** ckyriakidou has quit IRC | 07:07 | |
*** Nakato has quit IRC | 07:08 | |
*** Nakato has joined #tripleo | 07:08 | |
*** tesseract has joined #tripleo | 07:09 | |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 07:10 |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1686455 | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 07:10 |
openstack | Launchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 07:10 |
*** ramishra has quit IRC | 07:11 | |
*** flepied has quit IRC | 07:12 | |
*** ramishra has joined #tripleo | 07:12 | |
bogdando | mandre: https://review.openstack.org/#/c/460088 please take a look, the same fix as I did for rabbitmq init logs | 07:12 |
bogdando | /etc can't be RO if using docker-puppet.py | 07:13 |
mandre | bogdando: +2 | 07:14 |
bogdando | folks PTAL https://review.openstack.org/#/c/459768/ quickstart libvirt things | 07:14 |
mandre | bogdando: this should go somewhere in the doc, I'll take care of it | 07:14 |
bogdando | mandre: here are some docs I proposed in https://review.openstack.org/#/c/450792/ wrt undercloud deploy | 07:14 |
bogdando | or what did you mean? | 07:15 |
*** b00tcat has joined #tripleo | 07:16 | |
shardy | chem, marios: Hey are you around? | 07:16 |
chem | shardy: o/ | 07:16 |
shardy | Hey chem, wanted to sync up quickly about the plan for minor updates for Pike | 07:17 |
shardy | I was about to send a mail to openstack-dev, but wanted to check you guys are OK with my general direction first | 07:17 |
chem | shardy: yeap, I've seen the mail late yesterday, put it on my todo list ... didn't get to it yet | 07:17 |
shardy | chem: so, with the introduction of containers, neither the yum_update or upgrade_tasks interfaces really do what we need | 07:17 |
mandre | bogdando: I mean, clearly write in docs that we need to mount /etc rw for the docker_puppet_tasks, and eventually enforce this with a yaml-validate check | 07:17 |
*** aufi has joined #tripleo | 07:18 | |
marios | shardy: o/ hey | 07:18 |
bogdando | ah, yeah, indeed | 07:18 |
shardy | chem: so I've started refactoring to enable putting an ansible playbook on the host | 07:18 |
marios | shardy: we were discussing some new bzs | 07:18 |
marios | shardy: sounds good re syncup | 07:18 |
*** anshulbehl has joined #tripleo | 07:18 | |
*** anshulbehl has quit IRC | 07:18 | |
shardy | it'll then be possible to run that playbook through all the steps during the normal yum_update workflow (which I guess we'll rename) | 07:18 |
*** anshulbehl has joined #tripleo | 07:18 | |
shardy | marios: o/ | 07:18 |
bogdando | jistr: and all, PTAL https://review.openstack.org/#/c/460042/ | 07:18 |
bogdando | I really think we want this asap | 07:19 |
bogdando | debugging faily docker-puppet has a very poor UX | 07:19 |
marios | shardy: i need to go and check mail did you send one already? | 07:19 |
*** beagles has quit IRC | 07:19 | |
shardy | marios: No, not yet, I just wanted to give you guys a heads up, and check you didn't think the direction I've been describing sounds like a terrible idea :) | 07:19 |
bogdando | then, we could do some multiprocessing sync exercises jistr :) | 07:19 |
shardy | marios: if you're cool with it, I'll send a mail to openstack-dev and we can get into details there | 07:20 |
marios | shardy: ack ok was confused by something chem said ack ok | 07:20 |
shardy | I've also been chatting with stevebaker who has some ideas about how the container replacement workflow should work | 07:20 |
marios | i mean perhaps it is easier if we discuss there rather than you trying to explain to individuals on irc | 07:20 |
chem | marios: shardy I'm quite sure I've seen a discussion rolling somewhere, but maybe it was in my dreams O_o ? | 07:21 |
*** b3nt_pin has joined #tripleo | 07:21 | |
marios | shardy: so you want to put the playbook on the host to be executed later | 07:21 |
shardy | chem: there's been some discussion, but not yet on the upstream list | 07:21 |
shardy | marios: basically yes | 07:21 |
shardy | so during the minor update we can re-run it to pull any new containers | 07:21 |
shardy | on each host one at a time | 07:21 |
shardy | initially we'll use heat to do it, so all the breakpoint stuff still works (which the overcloud update CLI requires | 07:22 |
bogdando | shardy: do we have to discuss if ansible vs mistral? | 07:22 |
marios | shardy: right. so is it gathering docker/service ansible tasks still? | 07:22 |
bogdando | what are alternatives? | 07:22 |
bogdando | I mean all as we | 07:22 |
marios | shardy: i mean how are we going to generate the playbook is the question, perhaps static for first iteration? | 07:23 |
bogdando | marios: did you mean inventory? | 07:23 |
*** yprokule_ has joined #tripleo | 07:23 | |
shardy | marios: On overcloud deploy we'd rewrite the playbook, but on overcloud update I think we'd just re-run it | 07:23 |
shardy | which is OK as I don't think we allow changing the deployed services during overcloud update anyway | 07:23 |
shardy | none of the -e options work IIRC | 07:23 |
*** hjensas has joined #tripleo | 07:23 | |
*** hjensas has quit IRC | 07:23 | |
*** hjensas has joined #tripleo | 07:23 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Fix wrong notify in swift proxy profile https://review.openstack.org/460426 | 07:24 |
shardy | bogdando: IMO it's not really a question of mistral vs ansible, they are complimentary and we can't use mistral for this use-case | 07:24 |
shardy | which is basically running some commands on each host locally | 07:24 |
bogdando | shardy: well, update is a workflow... | 07:24 |
bogdando | we could be using Mistral for any a workflow | 07:24 |
shardy | bogdando: we could perhaps in future, but it'll break the current CI workflow for updates | 07:25 |
bogdando | shardy: I see | 07:25 |
shardy | keeping the workflow driven via heat for this first pass is going to be simpler I think | 07:25 |
shardy | bogdando: but yes, in future perhaps we could have mistral drive it instead | 07:25 |
*** yprokule has quit IRC | 07:25 | |
*** yprokule_ is now known as yprokule | 07:25 | |
bogdando | I'm asking cuz I know there are some things Mistral does, so just thinking why not | 07:26 |
marios | shardy: ack yeah makes sense indeed we don't allow service changes in minor update ... so the playbook is generated from some service specific tasks - are you defining new update tasks? | 07:26 |
shardy | in that case we'd have mistral run ansible I think, as mistral still doesn't provide a good replacement for the configuration aspects | 07:26 |
bogdando | oh I didn't know that | 07:26 |
shardy | marios: atm no update_tasks, as I'm hoping we can just replace the containers | 07:27 |
marios | shardy: cool :D | 07:27 |
shardy | marios: but yeah if we needed specific extra tasks that run on update we could wire them in | 07:27 |
marios | shardy: maybe some kind of 'stop'/'kill task or does docker do all that for us | 07:27 |
d0ugal | shardy: btw, I think the tripleo.deployment.v1.deploy_on_servers action allows running commands on each host. | 07:28 |
shardy | marios: stevebaker has a library (derived from the heat docker-cmd hook) which does some of that for us | 07:28 |
shardy | https://github.com/steveb/paunch | 07:28 |
marios | shardy: i see thanks | 07:29 |
shardy | marios: it's planned to be included as a tripleo project, so we can probably just use that | 07:29 |
shardy | d0ugal: sure, it's more the other features of ansible like looking, j2 templating and conditionals | 07:29 |
*** ffiore has joined #tripleo | 07:29 | |
shardy | d0ugal: I think running ansible via mistral could be great, but I'm not so keen on a clean-sheet mistral only implementation | 07:30 |
d0ugal | shardy: indeed :) my goal is to make the two work together as well as possible anyway | 07:30 |
*** Nakato has quit IRC | 07:30 | |
shardy | I think a major complaint from operators is familiarity, so I think it's a generally good thing to move towards some ansible pieces that can be run manually for debugging etc | 07:30 |
d0ugal | makes sense. | 07:30 |
shardy | d0ugal: ack, sounds good | 07:30 |
marios | shardy: so in this case what goes in the ansible playbook? i mean if we are replacing? is it the config for the new container? | 07:31 |
*** Nakato has joined #tripleo | 07:31 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Skipping build image for periodic tempest jobs https://review.openstack.org/459981 | 07:32 |
shardy | marios: you can see the WIP playbook here https://review.openstack.org/#/c/460285/1/docker/docker-steps.j2 | 07:32 |
shardy | marios: basically yes we write some json configuration files defining the containers to run and their config | 07:33 |
marios | shardy: thanks looking | 07:33 |
shardy | marios: then we run paunch which starts the containers | 07:33 |
shardy | marios: I also moved running puppet on the host to the same playbook, so you can run all tripleo configuration end-to-end via one playbook | 07:33 |
marios | shardy: ack makes sense | 07:34 |
shardy | marios: actually there are two playbooks in there atm, one runs only on the boostrap node | 07:34 |
shardy | but I'm iterating towards one mega-playbook we write everywhere ;) | 07:34 |
*** pmannidi has quit IRC | 07:35 | |
shardy | bogdando: this also makes the dependencies much clearer I think - it's just the order of tasks, and the steps | 07:35 |
shardy | I rememmber we discussed that last week, and hopefully this shows what I was talking about :) | 07:36 |
*** jpich has joined #tripleo | 07:36 | |
*** mcornea has joined #tripleo | 07:36 | |
*** brault has joined #tripleo | 07:37 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Skipping build image for periodic tempest jobs https://review.openstack.org/459981 | 07:37 |
*** amoralej|off is now known as amoralej | 07:39 | |
marios | thanks for the info shardy and since you asked this sounds like a sane thing to do - going to have to spend at least some of today on BZs but we have been trying to break free and get more involved here for a while - as I keep saying :/ | 07:39 |
chem | shardy: yeah, thanks | 07:40 |
shardy | marios, chem: Ok cool, yeah sorry for the big dump of information, I just wanted to give visibility of the work so far, as I know you've been super busy with bugs etc | 07:40 |
bogdando | shardy: "moved running puppet on the host to the same playbook" I new that at some point we'll start running puppet from ansible playbooks! | 07:41 |
shardy | I'll start the openstack-dev thread and we can continue discusing there, and perhaps have a call next week if needed | 07:41 |
shardy | in the meantime I'll work with stevebaker to hopefully get this initial prototype functional | 07:41 |
*** karthiks has joined #tripleo | 07:41 | |
*** ramishra has quit IRC | 07:41 | |
bogdando | shardy: "one mega-playbook" I believe true powers of ansible in small playbooks, driven by custom data settings | 07:42 |
bogdando | and dynamic inventories ofc | 07:42 |
shardy | bogdando: haha, yeah - it's really for backwards compatibility tho, if/when we get everything in containers we could deprecate the puppet configuration of the host | 07:42 |
shardy | bogdando: yeah I know, but given our current architecture, this is a stepping stone to a more typical ansible usage | 07:42 |
shardy | bogdando: e.g we now have a list of tasks instead of like 30 different SoftwareDeployments with hard to understand depends_on | 07:43 |
*** ramishra has joined #tripleo | 07:43 | |
shardy | I think that's an improvement, and we can do it without breaking any interfaces | 07:43 |
bogdando | would be glad to join discussions , testing, pair programming what ever, shardy, thanks for doing this ! | 07:43 |
bogdando | will be * | 07:43 |
bogdando | I really love ansible, so do I puppet | 07:44 |
shardy | bogdando: it's true to say we might have a future iteration which makes better use of ansible roles etc, but that's not my target in this iteration | 07:44 |
*** flepied has joined #tripleo | 07:44 | |
*** dtantsur|afk is now known as dtantsur | 07:44 | |
skramaja_ | can someone take a look at - https://review.openstack.org/#/c/459168/ - already has a +2 | 07:46 |
*** skramaja_ is now known as skramaja | 07:46 | |
bandini | marios: when you get a sec can you recheck https://review.openstack.org/#/c/459998/ I added a comment | 07:48 |
bandini | s/recheck/review/ | 07:49 |
*** dbecker has joined #tripleo | 07:49 | |
marios | thanks bandini | 07:50 |
*** jpena|off is now known as jpena | 07:50 | |
marios | bandini: you just need to pimp https://review.openstack.org/#/c/459994/ a bit this morning and should be gtg :D | 07:52 |
bandini | marios: sweet | 07:53 |
bandini | shardy: could you take a peek at https://review.openstack.org/#/c/459994/ if you have a sec? | 07:53 |
bandini | jistr: ^ | 07:53 |
marios | skramaja: dome | 07:54 |
marios | done even sorry | 07:54 |
skramaja | thanks marios and jaosorior | 07:55 |
shardy | bandini: ack will do | 07:57 |
bandini | shardy: thanks! | 07:57 |
*** jchhatbar has joined #tripleo | 07:58 | |
*** zoli is now known as zoli|doc-appt | 07:58 | |
*** zzzeek has quit IRC | 08:00 | |
*** zzzeek has joined #tripleo | 08:00 | |
*** janki has quit IRC | 08:00 | |
*** janki has joined #tripleo | 08:04 | |
*** jchhatbar has quit IRC | 08:05 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS-everywhere: Add missing profiles to docker compute services https://review.openstack.org/460435 | 08:09 |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1686455 | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 08:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 08:10 |
openstack | Launchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 08:10 |
*** lucas-afk is now known as lucasagomes | 08:17 | |
bogdando | folks, do you know something about containerized ironic pxe httpd port 80 in use conflict? I saw something discussed on that topic, can't find the patch... | 08:18 |
bogdando | it seems I have it on my dev undercloud env | 08:18 |
bogdando | the issue | 08:18 |
*** nyechiel has quit IRC | 08:20 | |
*** nyechiel has joined #tripleo | 08:21 | |
*** yprokule_ has joined #tripleo | 08:23 | |
*** bkopilov has quit IRC | 08:23 | |
*** trozet has joined #tripleo | 08:24 | |
*** yprokule has quit IRC | 08:25 | |
*** yprokule_ is now known as yprokule | 08:25 | |
*** pgadiya has quit IRC | 08:26 | |
*** nyechiel has quit IRC | 08:26 | |
*** shardy has quit IRC | 08:27 | |
bogdando | mandre: it seems like https://review.openstack.org/#/c/449040/ https://review.openstack.org/#/c/450731/ to be done for ironic_pxe_http as well... | 08:27 |
mandre | bogdando: unless I'm misunderstanding your question it's already the case, https://review.openstack.org/#/c/450731/1/docker/ironic/ironic-pxe/Dockerfile.j2 | 08:29 |
bogdando | mandre: indeed. Then I have something sepcific to my env | 08:30 |
bogdando | mandre: I have httpd running undercloud host, thus ironic pxe can't be started | 08:31 |
bogdando | in container | 08:31 |
*** garyk has quit IRC | 08:33 | |
mandre | bogdando: which port is apache in your ironic pxe container trying to bind? | 08:33 |
bogdando | mandre: 80 | 08:34 |
jaosorior | adarazs: if you have time could you check these out https://review.openstack.org/#/c/451523/ https://review.openstack.org/#/c/453223/ https://review.openstack.org/#/c/436198/ ? | 08:34 |
bogdando | I deploy with this file as undercloud role data https://github.com/bogdando/tripleo-heat-templates/blob/dev/environments/mini.yaml | 08:34 |
adarazs | jaosorior: I'll find some time for it a bit later, have to wrap some other stuff up before. | 08:34 |
*** dtantsur is now known as dtantsur|lunch | 08:34 | |
bogdando | mandre: I disabled apache service, not sure why it's running at host | 08:35 |
bogdando | mandre: wait, I got it! I use https://github.com/bogdando/tripleo-heat-templates/commit/89db6d58b7cb760b9ebfdfad58b8272a8a045b2f env. Which runs heat-api on host | 08:36 |
bogdando | so this seems installing httpd on host as well, and conflicts to ironix pxe http in container | 08:36 |
bogdando | a hybrid envs inconsequences... | 08:36 |
mandre | bogdando: yeah, but I'm still confused why your container binds port 80, I though ironic-pxe was using a different port | 08:37 |
*** enrraja has joined #tripleo | 08:38 | |
bogdando | I deploy with https://github.com/bogdando/oooq-warp/blob/master/custom.yaml_example#L74-L77 and my custom patch https://review.openstack.org/#/c/450792/ . Basically testing hostpath mounted logs. Well, FWIW logs are OK to go | 08:38 |
bogdando | mandre: a bug? | 08:38 |
bogdando | well, not ironic pxe itself, it's running WSGI apache | 08:38 |
bogdando | and that one binds host:80 | 08:38 |
*** jbadiapa has quit IRC | 08:39 | |
bogdando | may be I have an old version of openstack-kolla | 08:39 |
bogdando | mandre: oh, wait, I'm using upstream kolla images, not building any | 08:39 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart master: TripleO CI mixed release master UC / ocata OC https://review.openstack.org/459789 | 08:40 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart master: Add featureset011 - upgrade from BM to containerized https://review.openstack.org/450295 | 08:40 |
bogdando | it should be there with your patch included | 08:40 |
bogdando | (not really sure if tripleoupstream/centos-binary-ironic-pxe:latest is upstream and has it though) | 08:40 |
mandre | bogdando: you should check the apache configuration for ironic-pxe that puppet generated | 08:41 |
bogdando | mandre: strange, but there is no Listen: 80 in the /etc/httpd dir configs of the container | 08:43 |
*** jbadiapa has joined #tripleo | 08:45 | |
bogdando | mandre: got it: /var/lib/config-data/ironic/etc/httpd/conf/ports.conf:Listen 192.168.23.48:80 | 08:45 |
*** d0ugal has quit IRC | 08:45 | |
bogdando | so I'll file a "hybrid case" bug then | 08:45 |
mandre | bogdando: yep, seems like it | 08:46 |
mandre | hmm, but what's taking port 80 on the host? | 08:46 |
enrraja | Hi, I need some help | 08:47 |
*** ccamacho has joined #tripleo | 08:47 | |
*** janki has quit IRC | 08:48 | |
*** janki has joined #tripleo | 08:50 | |
enrraja | I trying to create ovs patch port with VLAN tag | 08:51 |
enrraja | and code is here https://paste.fedoraproject.org/paste/v2T5rSTzykbg2MniLmoHK15M1UNdIGYhyRLivL9gydE= | 08:51 |
*** garyk has joined #tripleo | 08:51 | |
bogdando | mandre: heat api running under WSGI | 08:52 |
*** bkopilov has joined #tripleo | 08:52 | |
mandre | bogdando: I'm pretty sure heat-api normally runs on a different port | 08:53 |
mandre | bogdando: port 8004 | 08:54 |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests https://review.openstack.org/403731 | 08:54 |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations https://review.openstack.org/403576 | 08:54 |
bogdando | mandre: that's that I have https://pastebin.com/hFQfrsEW | 08:54 |
bogdando | mandre: um, sorry, missed the full ss output, it is: [root@undercloud log]# ss -untap | grep :80 | 08:55 |
bogdando | tcp LISTEN 0 128 192.168.23.48:80 *:* users:(("httpd",pid=2526,fd=5),("httpd",pid=2525,fd=5),("httpd",pid=2524,fd=5),("httpd",pid=2523,fd=5),("httpd",pid=2522,fd=5),("httpd",pid=2521,fd=5),("httpd",pid=2520,fd=5),("httpd",pid=2519,fd=5),("httpd",pid=1249,fd=5)) | 08:55 |
bogdando | and the latter is the host OS httpd main process's pid | 08:55 |
mandre | bogdando: right, this doesn't mean it's heat-api that's binding port 80 | 08:56 |
bogdando | right | 08:56 |
mandre | bogdando: you should check apache configuration | 08:56 |
bogdando | mandre: grep -Er '\s\b80' /etc/httpd/ | 08:57 |
bogdando | /etc/httpd/conf/httpd.conf:#Listen 80 | 08:57 |
bogdando | strange things | 08:57 |
*** hewbrocca_afk is now known as hewbrocca | 08:58 | |
*** derekh has joined #tripleo | 08:59 | |
*** ffiore has quit IRC | 09:00 | |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: test do not review https://review.openstack.org/460457 | 09:00 |
*** salmankhan has joined #tripleo | 09:03 | |
*** d0ugal has joined #tripleo | 09:04 | |
*** d0ugal has quit IRC | 09:04 | |
*** d0ugal has joined #tripleo | 09:04 | |
bogdando | mandre: updated the bug descr | 09:05 |
*** flepied1 has joined #tripleo | 09:07 | |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart-extras master: Upgrade to containerized overcloud https://review.openstack.org/448576 | 09:07 |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 09:10 |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1686455 | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
*** ffiore has joined #tripleo | 09:10 | |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 09:10 |
openstack | Launchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 09:10 |
*** flepied has quit IRC | 09:10 | |
*** ramishra has quit IRC | 09:12 | |
*** ratailor has joined #tripleo | 09:18 | |
bogdando | mandre: so, the fresh undercloud node prepared by quickstart libvirt role has httpd config with Listen 80. But it is disabled/not running. Then we deploy any of the httpd-wsgi openstack services at host, it gets started by puppet and voila | 09:19 |
*** ramishra has joined #tripleo | 09:21 | |
*** ratailor has quit IRC | 09:22 | |
*** ratailor has joined #tripleo | 09:22 | |
bogdando | so the fix is perhaps to puppet-tripleo to remove Listen 80 from httpd config | 09:24 |
openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Use mixed release for container upgrade https://review.openstack.org/460061 | 09:24 |
openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Support container upgrades in multinode OOOQ CI https://review.openstack.org/450784 | 09:24 |
*** limao has quit IRC | 09:24 | |
mandre | bogdando: aha! | 09:25 |
mandre | bogdando: I believe puppet already prunes the apache config | 09:25 |
mandre | or is supposed to | 09:25 |
openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Use mixed release for container upgrade https://review.openstack.org/460061 | 09:26 |
openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Support container upgrades in multinode OOOQ CI https://review.openstack.org/450784 | 09:26 |
bogdando | mandre: actually, there is no pxe profile | 09:27 |
bogdando | all it has is manifests/profile/base/ironic/conductor.pp: include ::ironic::pxe | 09:28 |
*** salmankhan1 has joined #tripleo | 09:28 | |
*** salmankhan has quit IRC | 09:32 | |
*** salmankhan1 is now known as salmankhan | 09:32 | |
openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud master: Gate test https://review.openstack.org/459641 | 09:38 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: [WIP] Try fixing redis container https://review.openstack.org/460469 | 09:39 |
*** ebarrera has joined #tripleo | 09:39 | |
openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient master: Use Swift to store Plan environment https://review.openstack.org/453841 | 09:40 |
*** thrash|g0ne is now known as thrash | 09:42 | |
*** garyk has quit IRC | 09:56 | |
*** dixiaoli has quit IRC | 09:57 | |
jaosorior | jistr, marios: Do you guys know if anything is using the default vhost from apache? | 09:58 |
jaosorior | this 15-default.conf ? | 09:58 |
jistr | hm no i'm not very familiar with this area | 09:59 |
marios | jaosorior: don't know either jaosorior | 10:00 |
jistr | if there was something using it i'd expect it to be horizon most probably... dunno though | 10:00 |
marios | jaosorior: well we are creating it | 10:00 |
marios | jaosorior: and yeah i would also have guess the ui | 10:01 |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: collect-logs: add README for log files https://review.openstack.org/456317 | 10:01 |
*** tosky has joined #tripleo | 10:01 | |
marios | jaosorior: oh not us is managed by puppet | 10:01 |
*** d0ugal has quit IRC | 10:01 | |
marios | jaosorior: well 'us' but it is the module default i expect? unless it is the UI but i'd expect more in there | 10:01 |
marios | jaosorior: jistr don't think its ui since we already have a 10-horizon-vhost bth | 10:03 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: test do not review https://review.openstack.org/460457 | 10:04 |
jaosorior | marios, jistr: Then I guess nothing is using it. Lets remove it :D | 10:08 |
*** d0ugal has joined #tripleo | 10:08 | |
jaosorior | bogdando: ^^ | 10:08 |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1686455 | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 10:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 10:10 |
openstack | Launchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 10:10 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: test do not review https://review.openstack.org/460457 | 10:13 |
*** zoli|doc-appt is now known as zoli | 10:13 | |
bogdando | jaosorior: ack | 10:14 |
*** shardy has joined #tripleo | 10:17 | |
*** zoli is now known as zoli|lunch | 10:18 | |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Disable default vhost for apache https://review.openstack.org/460488 | 10:19 |
jaosorior | bogdando: awesome, thanks! | 10:20 |
*** cylopez has quit IRC | 10:20 | |
*** flepied1 has quit IRC | 10:21 | |
*** d0ugal has quit IRC | 10:21 | |
*** salmankhan has quit IRC | 10:22 | |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Disable default vhost for apache undercloud https://review.openstack.org/460491 | 10:25 |
*** cylopez has joined #tripleo | 10:25 | |
bogdando | jaosorior: one more | 10:26 |
*** d0ugal has joined #tripleo | 10:27 | |
jaosorior | bogdando: is the one for quickstart-extras needed? If we land the t-h-t change it would apply there as well AFAIK | 10:27 |
*** atoth has joined #tripleo | 10:27 | |
*** paramite has joined #tripleo | 10:30 | |
*** nmathew has quit IRC | 10:30 | |
*** nyechiel has joined #tripleo | 10:32 | |
*** flepied has joined #tripleo | 10:35 | |
*** jkilpatr has quit IRC | 10:38 | |
*** salmankhan has joined #tripleo | 10:39 | |
*** adarazs is now known as adarazs_lunch | 10:40 | |
*** fragatina has quit IRC | 10:40 | |
*** fragatina has joined #tripleo | 10:41 | |
*** morazi has quit IRC | 10:44 | |
*** d0ugal has quit IRC | 10:45 | |
*** cylopez has quit IRC | 10:47 | |
*** dtantsur|lunch is now known as dtantsur | 10:47 | |
dr_gogeta86 | good morning all | 10:48 |
*** tvignaud_ has joined #tripleo | 10:49 | |
*** tvignaud has quit IRC | 10:50 | |
*** enrraja_ has joined #tripleo | 10:54 | |
*** enrraja has quit IRC | 10:54 | |
EmilienM | Good morning folks | 10:58 |
*** jpena is now known as jpena|lunch | 10:59 | |
*** garyk has joined #tripleo | 11:01 | |
*** gfidente has joined #tripleo | 11:01 | |
*** d0ugal has joined #tripleo | 11:06 | |
*** udesale has quit IRC | 11:06 | |
*** jkilpatr has joined #tripleo | 11:08 | |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1686455 | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 11:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 11:10 |
openstack | Launchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 11:10 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix etcd_init_task volume https://review.openstack.org/460088 | 11:13 |
EmilienM | shardy: quick question about https://review.openstack.org/#/c/460292/ - do you think we should also move the "httpd restart" task from wsgi services into apache.yaml? | 11:16 |
EmilienM | shardy: it would make upgrades faster I think because we would only restart apache one time | 11:16 |
EmilienM | instead of X number of WSGI services running on a node | 11:16 |
EmilienM | chem, marios: ^ also | 11:17 |
*** ansmith has quit IRC | 11:18 | |
*** ebarrera has quit IRC | 11:19 | |
*** enrraja has joined #tripleo | 11:19 | |
chem | EmilienM: are we sure about that (ie the run only stuff), I mean we're creating a upgrade task wich will have it in all services | 11:19 |
chem | EmilienM: I mean the rendered ansible tasks will look the same | 11:20 |
marios | EmilienM: so duplicates should be removed by the yaql but checking the review more closely to see what exactly you mean | 11:20 |
chem | EmilienM: but it will remove duplicate in the code, so that's good | 11:20 |
EmilienM | marios, chem: ah nevermind | 11:21 |
marios | EmilienM: which is the restart i mean i see the addition of mod_ssl install | 11:21 |
EmilienM | we don't restart httpd | 11:21 |
EmilienM | we stop it only | 11:21 |
EmilienM | err nevermind. I just woke up | 11:21 |
marios | EmilienM: ack | 11:21 |
chem | EmilienM: enjoy your coffee :) | 11:22 |
EmilienM | yeah... | 11:22 |
openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud stable/ocata: undercloud/upgrade: change ownership for ironic-dbsync.log https://review.openstack.org/460508 | 11:23 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Upgrade failure when service parameter is changed for PankoApi https://review.openstack.org/459168 | 11:24 |
openstackgerrit | Merged openstack/puppet-tripleo master: Add a flag to rabbitmq so that we can deploy with ha-mode: all again https://review.openstack.org/459994 | 11:24 |
EmilienM | bnemec, mwhahaha: we have all Mitaka jobs green now: https://review.openstack.org/#/c/460223/ | 11:25 |
*** jaganathan has quit IRC | 11:25 | |
EmilienM | with ceph-0.94.9-0.el7.x86_64 (hammer) again | 11:26 |
EmilienM | bnemec, mwhahaha : so now, i'm engaging EOL for tripleo mitaka | 11:26 |
shardy | EmilienM: yeah we could, but I think it'd still run the same number of times? | 11:26 |
shardy | EmilienM: e.g there would still be duplicate tasks in the list, unless we somehow filtered them? | 11:26 |
shardy | EmilienM: also note we don't restart httpd, we just stop it | 11:26 |
shardy | so most of the duplicate tasks are probably pretty fast | 11:27 |
*** lucasagomes is now known as lucas-hungry | 11:27 | |
*** rhallisey has joined #tripleo | 11:27 | |
shardy | EmilienM: hey can you pls check https://review.openstack.org/#/c/458250/, it's waiting on PTL vote | 11:28 |
*** shardy is now known as shardy_lunch | 11:28 | |
*** adarazs_lunch is now known as adarazs | 11:28 | |
adarazs | sshnaidm|afk: let me know if you're around, I wanted to ask you about how the OVB behaved in the last week or so with the new config. | 11:29 |
EmilienM | shardy_lunch: ok good to know | 11:30 |
*** prateek has quit IRC | 11:30 | |
EmilienM | shardy_lunch: +1 done | 11:30 |
paramite | hey guys, can we get this backport merged? https://review.openstack.org/#/c/460102/ | 11:31 |
bogdando | jaosorior: it seems we don't | 11:32 |
EmilienM | paramite: a documentation thing? | 11:32 |
paramite | EmilienM, yup | 11:32 |
EmilienM | mhh | 11:32 |
EmilienM | I mean, I love doc, etc | 11:32 |
paramite | but? :) | 11:33 |
EmilienM | paramite: have you read OpenStack backport policies? | 11:33 |
paramite | EmilienM, long time ago, what's wrong with the backport? | 11:33 |
EmilienM | https://docs.openstack.org/project-team-guide/stable-branches.html#appropriate-fixes | 11:33 |
* paramite checking | 11:34 | |
*** hjensas has quit IRC | 11:34 | |
EmilienM | paramite: i've +2 | 11:34 |
*** hjensas has joined #tripleo | 11:35 | |
dtantsur | FYI we chatted with the stable team, and they told us that doc backports are fine | 11:36 |
dtantsur | so we've been doing them for some time | 11:36 |
dtantsur | we = ironic ofc | 11:36 |
dtantsur | we backported our whole install-guide from ocata to newton some time ago :D | 11:36 |
paramite | EmilienM, ok thanks, but still: The risk of regression: none; The user visible benefit: it's a documentation ...; How self-contained the fix is: enough I would say; Whether the fix is already on master and all consequent stable branches: done ... so I'm curious what's wrong ... or you just hate me :) | 11:37 |
*** pkovar has joined #tripleo | 11:38 | |
EmilienM | dtantsur: good to know | 11:38 |
EmilienM | paramite: I'll approve it then | 11:38 |
paramite | EmilienM, thanks :) | 11:39 |
EmilienM | therve: I can abandon this one I guess | 11:39 |
EmilienM | https://review.openstack.org/#/c/460273/3/manifests/profile/base/zaqar.pp | 11:39 |
jtomasek | honza, florianf: can we get https://review.openstack.org/#/c/460142/ merged, please? | 11:39 |
therve | EmilienM, If you want. We'd need to remember it if we ever want to enable swift in the overcloud. | 11:39 |
florianf | jtomasek: It's on its way... | 11:41 |
*** prateek has joined #tripleo | 11:41 | |
jistr | sshnaidm|afk: thanks again for the reviews! I amended the patches, and the container upgrade job finished successfully again at https://review.openstack.org/#/c/450784/ please take a look when you have a moment :) | 11:41 |
jtomasek | florianf: thanks! | 11:41 |
EmilienM | therve: and if we don't remember, CI will fail :) | 11:41 |
*** zoli|lunch is now known as zoli | 11:42 | |
*** abishop has joined #tripleo | 11:45 | |
bogdando | jaosorior: https://review.openstack.org/460488 worked for me | 11:45 |
therve | EmilienM, Well, one completely unrelated CI fails at some point, yes :p | 11:45 |
jaosorior | bogdando: brilliant! | 11:46 |
jaosorior | bogdando: you already have my +2 there :) | 11:46 |
bogdando | right :) | 11:46 |
bogdando | folks, PTAL as well! | 11:46 |
jistr | +2'd too | 11:47 |
jaosorior | jistr: if you have some time could you check this out https://review.openstack.org/#/c/460435/ ? | 11:48 |
*** prateek_ has joined #tripleo | 11:48 | |
jistr | sure | 11:48 |
jistr | jaosorior: makes sense. We don't have that CI'd anywhere yet, right? So check experimental is not needed i presume. | 11:49 |
*** jayg|g0n3 is now known as jayg | 11:49 | |
jaosorior | jistr: correct | 11:50 |
*** prateek has quit IRC | 11:51 | |
jkilpatr | anyone else seeing failures on ovb-manage-stack instackenv generation? It worked for this job yesterday morning, failed yesterday night and continues to fail. | 11:53 |
jistr | mandre, jaosorior: if/when you have some bandwidth, could you please take another peek at https://review.openstack.org/#/c/460435/ ? I addressed sshnaidm|afk 's reviews. | 11:54 |
jistr | mandre, jaosorior: i mean that and the 2 depends-on | 11:55 |
jaosorior | jistr: sure | 11:55 |
*** dprince has joined #tripleo | 11:55 | |
jaosorior | jistr: I think you passed the wrong link | 11:56 |
*** jcoufal has joined #tripleo | 11:56 | |
jistr | jaosorior, mandre: sorry, this one and deps https://review.openstack.org/#/c/450784/ | 11:56 |
* bogdando has an achievement unlocked: a first working (kind of) undercloud by quickstart | 11:57 | |
dr_gogeta86 | hi | 11:57 |
dr_gogeta86 | bogdando, just a simple question | 11:57 |
bogdando | at least openstack CLI now says something to me | 11:57 |
dr_gogeta86 | how to setup Ironic::Drivers::Ilo/Ironic_config[ilo/default_boot_mode] into a yaml | 11:58 |
dr_gogeta86 | ? | 11:58 |
bogdando | dr_gogeta86: I can't answer that, sorry | 11:58 |
dr_gogeta86 | tnx you | 11:59 |
*** morazi has joined #tripleo | 11:59 | |
*** milan has joined #tripleo | 12:00 | |
jistr | dr_gogeta86: IIUC you want to change the value of that param via a Heat environment file when deploying with tripleo? | 12:01 |
jistr | dr_gogeta86: see http://tripleo.org/advanced_deployment/node_config.html | 12:01 |
*** dsariel has quit IRC | 12:01 | |
dr_gogeta86 | i'm talking about undercloud sorry :-) | 12:01 |
jistr | ah ok, right it makes sense for ironic :) i'm just too used to dealing with overcloud haha | 12:02 |
jistr | hmm not sure off the top of my head but i bet we have something for that too | 12:02 |
dr_gogeta86 | next step ... i dunno why my undercloud wen wreck after too many deploy | 12:03 |
shardy_lunch | dr_gogeta86: You can set a hieradata_override file in undercloud.conf | 12:04 |
*** shardy_lunch is now known as shardy | 12:04 | |
*** ffiore has quit IRC | 12:04 | |
dr_gogeta86 | did it already | 12:05 |
jistr | yea just found it. It's mentioned here (in another context) https://docs.openstack.org/developer/tripleo-docs/advanced_deployment/deployed_server.html#undercloud | 12:05 |
dr_gogeta86 | but how to configure things wheren't into default topic | 12:05 |
dr_gogeta86 | like that | 12:05 |
*** ratailor_ has joined #tripleo | 12:06 | |
*** pradk has joined #tripleo | 12:06 | |
jistr | thanks jaosorior | 12:07 |
*** jpena|lunch is now known as jpena | 12:08 | |
*** ratailor has quit IRC | 12:09 | |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1686455 | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 12:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 12:10 |
openstack | Launchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 12:10 |
jistr | dr_gogeta86: not sure if i understand the last question. but if you want to configure the ilo default boot mode, the hiera key for that is ironic::drivers::ilo::default_boot_mode | 12:12 |
jistr | https://github.com/openstack/puppet-ironic/blob/master/manifests/drivers/ilo.pp#L45 | 12:12 |
dr_gogeta86 | so ironic::drivers::ilo::default_boot_mode: uefi ... and I'm done ? | 12:13 |
mandre | pradk: I was wrong when I said the redis container couldn't impact CI in https://review.openstack.org/#/c/442151/ :-/ | 12:13 |
jistr | dr_gogeta86: yea that and point the hieradata_override in undercloud.conf to the file where this is, and you're done | 12:14 |
pradk | mandre, question is why is the .puppet file not getting copied | 12:14 |
pradk | mandre, i see it in the logs | 12:15 |
pradk | mandre, using .puppet file directly seems incorrect | 12:15 |
mandre | pradk: I responded in https://review.openstack.org/#/c/460469/, that's because we disabled the 'exec' puppet tag | 12:15 |
pradk | mandre, ah ok | 12:16 |
panda|bbl | EmilienM: who has the power of recording, for the deep dive bluejeans channel ? | 12:22 |
*** enrraja_ has quit IRC | 12:23 | |
*** enrraja has quit IRC | 12:23 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Use EnpointMap port to create firewall rules. https://review.openstack.org/460526 | 12:25 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Use EnpointMap port to create firewall rules. https://review.openstack.org/460526 | 12:25 |
*** garyk has quit IRC | 12:29 | |
*** gbarros has joined #tripleo | 12:30 | |
*** ratailor_ has quit IRC | 12:30 | |
*** ramishra_ has joined #tripleo | 12:31 | |
*** rlandy has joined #tripleo | 12:31 | |
EmilienM | panda|bbl: owner of the BJ | 12:31 |
jaosorior | EmilienM: the deep dive is in half an hour, right? | 12:32 |
jaosorior | panda|bbl: ^^ | 12:32 |
EmilienM | yeah? i thought it was in 1h30 | 12:33 |
adarazs | EmilienM, jaosorior: not at 14:30 UTC when we normally have the CI Squad meeting? | 12:33 |
adarazs | that's ~2 hours from now. | 12:34 |
jaosorior | ouh | 12:34 |
jaosorior | ok | 12:34 |
*** gvrangan_ has quit IRC | 12:35 | |
adarazs | though I'm not super sure about that, but that's what I gathered. | 12:35 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: DONT REVIEW: testing ooq timeout https://review.openstack.org/460529 | 12:37 |
*** salmankhan has quit IRC | 12:38 | |
*** liverpooler has joined #tripleo | 12:38 | |
*** dsariel has joined #tripleo | 12:39 | |
panda|bbl | yes, 1400 UTC | 12:40 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Fix for the resource ControllerPostPuppetMaintenanceModeDeployment https://review.openstack.org/460457 | 12:40 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Fix redis container picking wrong config file https://review.openstack.org/460469 | 12:41 |
*** gkadam has quit IRC | 12:41 | |
*** ramishra_ has quit IRC | 12:41 | |
ccamacho | hey shardy morning! Im checking https://bugs.launchpad.net/tripleo/+bug/1686619, think I got the issue | 12:42 |
openstack | Launchpad bug 1686619 in tripleo "upgrades CI error ControllerPostPuppetMaintenanceModeDeployment" [High,In progress] - Assigned to Carlos Camacho (ccamacho) | 12:42 |
*** jmelvin has joined #tripleo | 12:45 | |
*** ansmith has joined #tripleo | 12:45 | |
weshay | pabelanger, have an infra review for arxcruz if you have a minute https://review.openstack.org/#/c/458054/ | 12:47 |
arxcruz | weshay: thanks, I ping pabelanger on #o-infra but I guess was too earlier for him :) | 12:47 |
dr_gogeta86 | jistr, doesn't work ... I alwauy found bios :-( | 12:50 |
bogdando | if I re-run undercloud deploy, why there is so much of CREATE_COMPLETE state changed ? | 12:53 |
bogdando | I supposed the vast majority to be omitted due to idempotency et al | 12:53 |
*** lucas-hungry is now known as lucasagomes | 12:53 | |
bogdando | Well, I know the answer for passwords/secrets, but what stands for changing VIPs? | 12:53 |
bogdando | and networks | 12:53 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 12:54 |
bogdando | ServiceChain/PuppetServices... basically everything reports changed | 12:54 |
bogdando | shardy: ^^ could you help please? Do I missing something important for Heat under the hood? | 12:54 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Simplify Node Ports fetching https://review.openstack.org/459628 | 12:55 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update to latest Patternfly https://review.openstack.org/460534 | 12:55 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Remove Nodes NavTabs https://review.openstack.org/460535 | 12:55 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: [WIP] NodesListView and ListView components https://review.openstack.org/460536 | 12:55 |
jistr | dr_gogeta86: hmm then i don't know :( the default setting is here https://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.yaml.template#L570 | 12:56 |
shardy | bogdando: for undercloud deploy the stack is newly created every time, nothing is persisted AFAIK | 12:56 |
jistr | dr_gogeta86: but the override file you crafted should take priority over that | 12:56 |
bogdando | and my 2nd naive question, why heat stack-list is empty undercloud?.. | 12:56 |
shardy | bogdando: but the underlying configuration should be idempotent | 12:56 |
dr_gogeta86 | i'm trying to fix the undercloud through yaml | 12:56 |
bogdando | how do you normally see/debug that's was createD? | 12:56 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Fix redis container picking wrong config file https://review.openstack.org/460469 | 12:56 |
shardy | bogdando: because you just deployed a new heat, with nothing in the DB | 12:57 |
dr_gogeta86 | intestead using a script | 12:57 |
bogdando | could I hack in the sqlite db of heat-config somehow? | 12:57 |
bogdando | shardy: | 12:57 |
dmsimard | sshnaidm|afk: let me know when you're around, need to check something with the periodic tripleo-ci jobs | 12:57 |
*** sshnaidm|afk is now known as sshnaidm | 12:58 | |
shardy | bogdando: I normally look at the log output from undercloud deploy, it shows all the configuration steps that occur on the node | 12:58 |
sshnaidm | dmsimard, yep | 12:58 |
*** vkhanna has joined #tripleo | 12:58 | |
shardy | bogdando: not sure tbh, I thought all data was transient, but dprince may know more | 12:58 |
adarazs | sshnaidm: can you also update https://etherpad.openstack.org/p/tripleo-ci-squad-meeting on line 35 with a short summary about the state of the almost-transitioned-OVB jobs? | 12:58 |
dmsimard | sshnaidm: It seems the periodic jobs used for promotion are using trunk.rdoproject.org/current/ instead of trunk.rdoproject.org/consistent/ | 12:58 |
bogdando | shardy: thanks | 12:58 |
*** vkhanna has quit IRC | 12:58 | |
sshnaidm | adarazs, will do | 12:59 |
dmsimard | sshnaidm: /current/ should not be used for promotions, the repository currently promoted is not consistent, can we fix that ? | 12:59 |
*** vkhanna has joined #tripleo | 12:59 | |
bogdando | but this really looks strange that undercloud deploy idempotent run takes soooo loong | 12:59 |
sshnaidm | dmsimard, hmm.. checking | 12:59 |
*** adarazs is now known as adarazs_brb | 12:59 | |
bogdando | even if it changes nothing, it still aplies all it seems | 12:59 |
bogdando | a great area to improve | 12:59 |
dmsimard | sshnaidm: I found this in an ocata periodic job logs COMMAND=/bin/curl -Lvo /etc/yum.repos.d//delorean.repo https://trunk.rdoproject.org/centos7-ocata/current//delorean.repo | 13:00 |
dmsimard | sshnaidm: I'm not sure where that's in the actual job | 13:00 |
*** japestinho has quit IRC | 13:00 | |
dmsimard | or code | 13:00 |
*** dparkes has quit IRC | 13:00 | |
jtomasek | florianf: there are 2 small patches pending on review https://review.openstack.org/#/c/454169/ https://review.openstack.org/453194 | 13:00 |
*** ffiore has joined #tripleo | 13:00 | |
jtomasek | florianf: I'd like to rebase my patchsets once those get merged in | 13:00 |
EmilienM | sshnaidm: I agree with dmsimard, we should use consistent for promotion | 13:01 |
shardy | bogdando: I think there's a bug where we always restart the containers, even when the images are the same | 13:01 |
shardy | bogdando: but it's expected that we run all the configuration steps again | 13:01 |
sshnaidm | EmilienM, of course we should, checking if it's really wrong configured.. | 13:01 |
EmilienM | ok | 13:01 |
bogdando | shardy: that's clear, puppet must reconfigure if anything changed | 13:01 |
EmilienM | mwhahaha: can we stop alert on https://bugs.launchpad.net/tripleo/+bug/1686455 ? | 13:01 |
openstack | Launchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 13:01 |
florianf | jtomasek: thanks, will have a look | 13:01 |
EmilienM | mwhahaha: nevermind, you replied | 13:01 |
mwhahaha | EmilienM: bogdando removed alert i believe | 13:01 |
bogdando | mwhahaha: yes | 13:02 |
shardy | bogdando: yup, but I think we shouldn't restart containers when the image is the same - AFAICS we docker rm all of them every time | 13:02 |
mwhahaha | EmilienM: i'm checking the status of it today to close it | 13:02 |
shardy | which probably wastes some time | 13:02 |
EmilienM | mwhahaha: ok, thx | 13:02 |
jtomasek | florianf: thanks | 13:02 |
*** d0ugal has quit IRC | 13:04 | |
EmilienM | zaneb, bnemec: re: https://bugs.launchpad.net/tripleo/+bug/1684272 - even with the revert in Heat (https://review.openstack.org/#/c/458813/) we still have ovb-updates that timeouts, though we saved ~200 seconds on ControllerServiceChain (from 547 to 339 now) | 13:04 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 13:04 |
*** trown|outtypewww is now known as trown | 13:04 | |
*** prateek_ has quit IRC | 13:06 | |
sshnaidm | EmilienM, dmsimard from what I see, we use both consistent and "current" repos in promotion jobs. We can promote consistent only, but we can use some packages in the job from current repo: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha/a7dadfd/console.html#_2017-04-27_06_09_52_640468 | 13:07 |
sshnaidm | EmilienM, dmsimard and this is not good, I gonna fix it.. | 13:07 |
dmsimard | sshnaidm: I think that gate jobs use /current/ | 13:08 |
sshnaidm | dmsimard, yes | 13:08 |
sshnaidm | dmsimard, and this leaked into promotion jobs too | 13:08 |
dmsimard | The reason I was given is "we need the absolute latest" which I don't particularly agree with but whatever | 13:09 |
sshnaidm | dmsimard, but I suspect it was always the situation | 13:09 |
trown | dmsimard: for tripleo gates we need the absolute latest of tripleo packages | 13:09 |
trown | dmsimard: otherwise depends-on is broken | 13:09 |
*** masco has quit IRC | 13:09 | |
trown | dmsimard: since zuul knows nothing about consistent/dlrn | 13:09 |
dmsimard | And it knows about current ? | 13:09 |
trown | dmsimard: ya... because current is everything that has merged | 13:10 |
*** ooolpbot has joined #tripleo | 13:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 13:10 |
*** ooolpbot has quit IRC | 13:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 13:10 |
trown | so once it merges a patch it is available | 13:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 13:10 |
dmsimard | trown: admittedly there can still be some lag before things lands in current but ok | 13:10 |
trown | if consistent!=current then when we merge a patch with depends-on the gates would be broken because the patch is not actually available | 13:10 |
trown | ya some lag is not days though | 13:11 |
dmsimard | But I thought doing depends-on rebuilt the package inside the job thougb | 13:11 |
dmsimard | though* | 13:11 |
trown | right... so the job would pass | 13:11 |
trown | then all following jobs would fail | 13:11 |
dmsimard | Oh, I see now | 13:11 |
trown | because it passed using a package that is not in consistent | 13:11 |
*** prateek has joined #tripleo | 13:12 | |
trown | i agree we need to fix promotion jobs as sshnaidm mentioned above, but the gate repo setup is the way it is for a good reason | 13:13 |
dmsimard | all good, I guess I never got to the bottom of why gate jobs used current | 13:14 |
*** janki is now known as janki|afk | 13:16 | |
*** bswartz has joined #tripleo | 13:19 | |
*** tzumainn has joined #tripleo | 13:20 | |
*** d0ugal has joined #tripleo | 13:21 | |
*** ffiore has quit IRC | 13:22 | |
dprince | bogdando: hi, per your comments here https://bugs.launchpad.net/tripleo/+bug/1686716 | 13:24 |
openstack | Launchpad bug 1686716 in tripleo "Undercloud deploy is not idempotent and takes a hard way to re-apply" [Medium,Triaged] | 13:24 |
dprince | bogdando: the new t-h-t undercloud stack was designed to be ephemeral. That isn't a bug... | 13:24 |
dprince | bogdando: we could change that, sure. But the whole point was to keep as little state as possible between runs | 13:24 |
bogdando | dprince: I see. Then I'll leave only the passwords and containers concerns | 13:25 |
dprince | bogdando: ack, I think steve address the passwords already in his patch | 13:25 |
dprince | bogdando: and the containers restarts should be doable as well | 13:25 |
dprince | bogdando: while I don't think it is a bug... we could certainly entertain keeping an undercloud heat stack around. But that is just more state... and the point of this was to eliminate as much state as possible | 13:26 |
*** chandankumar is now known as chkumar|off | 13:26 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: WIP: Add OVB support to devmode.sh https://review.openstack.org/452249 | 13:26 |
dprince | bogdando: it wouldn't be hard to adapt the approach to maintain the state of the heat stack if we wanted too. And maybe someone would find value in that. To me... it was just another upgrade problem to deal with | 13:27 |
*** ffiore has joined #tripleo | 13:28 | |
bogdando | dprince: yes, I agree, if undercloud works as well w/o state and deploys overclouds unchanged and omits idempotent things instead of re-applying them (for overclouds), than it should stay as is | 13:28 |
bogdando | then | 13:28 |
openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: Add a flag to rabbitmq so that we can deploy with ha-mode: all again https://review.openstack.org/460204 | 13:28 |
sshnaidm | dmsimard, trown are "current" and "consistent" repos in stable branches different? Because i see they have the same delorean hash | 13:29 |
openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Add role specific information to the service template https://review.openstack.org/437956 | 13:29 |
dmsimard | sshnaidm: sometimes they are the same, sometimes they are different | 13:30 |
*** lblanchard has joined #tripleo | 13:30 | |
dmsimard | sshnaidm: /current/ has all the new builds, regardless of status | 13:30 |
*** pkovar has quit IRC | 13:30 | |
dmsimard | while /consistent/ only has the last given set of packages with no known failure to build from source | 13:30 |
dmsimard | say, we can't build nova because of a new dep that was added | 13:30 |
*** lblanchard has quit IRC | 13:31 | |
dmsimard | new packages (oslo, neutron, whatever) will keep landing in /current/ -- but the consistent symlink will only get updated once the nova failure to build has been fixed | 13:31 |
dmsimard | you know, once everything is "consistent" | 13:31 |
dmsimard | Otherwise you're testing with something that technically hasn't been tested upstream (testing oslo with an "outdated" version of nova) | 13:31 |
dmsimard | there's some level of explanation in the docs http://dlrn.readthedocs.io/en/latest/repositories.html#dlrn-repository-current but that's the gist of it | 13:32 |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/newton: Touch /etc/httpd/conf.d/ssl.conf https://review.openstack.org/460555 | 13:32 |
*** lblanchard has joined #tripleo | 13:33 | |
sshnaidm | dmsimard, ok | 13:33 |
*** dsariel has quit IRC | 13:33 | |
skramaja | jtomasek: did you had a chance to validate flatten output - https://review.openstack.org/#/c/450021/? | 13:34 |
jtomasek | skramaja: not yet, I have it on the list, I'll try to check it tomorrow | 13:34 |
*** psahoo has quit IRC | 13:34 | |
skramaja | thanks jtomasek | 13:34 |
jtomasek | skramaja: sorry that it takes long :/ | 13:35 |
*** shardy has quit IRC | 13:36 | |
*** cylopez has joined #tripleo | 13:36 | |
*** nyechiel has quit IRC | 13:36 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix repos for promotion jobs https://review.openstack.org/460558 | 13:38 |
sshnaidm | dmsimard, EmilienM trown ^^ | 13:38 |
jkilpatr | rlandy, seeing failures on this step TASK [ovb-manage-stack : Build nodes.json file to be used as instackenv.json] we made it past that on the first build but not since. | 13:40 |
*** adarazs_brb is now known as adarazs | 13:41 | |
dmsimard | sshnaidm: thanks | 13:43 |
openstackgerrit | Lukas Bezdicka proposed openstack/puppet-tripleo stable/newton: Ensure we configure ssl.conf https://review.openstack.org/460560 | 13:44 |
rlandy | jkilpatr: I just updated the commit - you need python-glanceclient in the requirements.txt due to a change in OVB yesterday | 13:45 |
*** shardy has joined #tripleo | 13:45 | |
jkilpatr | rlandy, should that be included in the cherrypick now or do I need it in my personal commit? | 13:45 |
*** janki|afk is now known as janki | 13:46 | |
rlandy | jkilpatr: if you are working from a job and not from devmode, edit the piece that modifies requirements.txt and add python-glanceclient | 13:46 |
*** salmankhan has joined #tripleo | 13:46 | |
rlandy | if you are working with devmode, I already updated that | 13:46 |
rlandy | I am updating the jjb for the gates | 13:46 |
rlandy | but your poc will not be impacted | 13:46 |
skramaja | jtomasek: np at all, your feedback is important. | 13:46 |
EmilienM | sshnaidm: thx | 13:48 |
EmilienM | sshnaidm: wait but how tripleo will get 'current' packages for tripleo projects? | 13:49 |
*** ubijtsa is now known as assassin | 13:49 | |
sshnaidm | EmilienM, it will, but only if gate job (CACHEUPLOAD != 1) | 13:50 |
*** limao has joined #tripleo | 13:51 | |
*** ffiore has quit IRC | 13:51 | |
*** anshulbehl has quit IRC | 13:53 | |
panda|bbl | shardy: EmilienM: who's the owner of deep dive channel ? | 13:54 |
sshnaidm | and what is right bluejeans link to it? | 13:56 |
shardy | panda|bbl: I think whoever was talking just linked their bluejeans to https://etherpad.openstack.org/p/tripleo-deep-dive-topics | 13:57 |
bandini | meh the deep dive is today and I am stuck in another call :/ | 13:58 |
EmilienM | https://bluejeans.com/u/gcerami/ | 13:59 |
shardy | bandini: I guess we can record it :) | 13:59 |
*** dtrainor has joined #tripleo | 14:00 | |
EmilienM | bandini: no worries, it's recorded | 14:00 |
panda|bbl | deepd dive was moved to https://bluejeans.com/u/gcerami/ | 14:00 |
*** ramishra has quit IRC | 14:00 | |
*** limao_ has joined #tripleo | 14:01 | |
bandini | shardy, EmilienM: I forget that technology can be helpful sometimes :) | 14:01 |
EmilienM | lol | 14:01 |
bandini | it'd be great if we can record it | 14:01 |
*** limao has quit IRC | 14:01 | |
*** ramishra has joined #tripleo | 14:01 | |
*** skramaja has quit IRC | 14:03 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 14:04 |
EmilienM | sshnaidm: indeed, thx | 14:05 |
*** karthiks has quit IRC | 14:07 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Unset the UpgradeInitCommand on converge https://review.openstack.org/460571 | 14:08 |
*** ffiore has joined #tripleo | 14:09 | |
*** ooolpbot has joined #tripleo | 14:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 14:10 |
*** ooolpbot has quit IRC | 14:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 14:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 14:10 |
*** ratailor has joined #tripleo | 14:11 | |
*** pkovar has joined #tripleo | 14:11 | |
*** limao_ has quit IRC | 14:12 | |
shardy | pradk: Hey, are you aware of any issues re ceilometer and gnocchi in the container architecture atm? | 14:12 |
shardy | pradk: I rebased and ceilometer-upgrade --debug --skip-metering-database is failing, I think it's because it can't reach gnocchi | 14:13 |
pradk | shardy, ceilometer conatiner work hasnt merged yet | 14:13 |
pradk | shardy, still under review | 14:13 |
pradk | shardy, there was a bug we fixed recently | 14:13 |
shardy | http://paste.openstack.org/show/608207/ | 14:14 |
shardy | pradk: yeah I still have ceilometer on the host, but I'm wondering if it could be related to the recently merged redis patch? | 14:14 |
pradk | shardy, no this says it cant reach the api | 14:15 |
pradk | shardy, redis is only used for coordination | 14:15 |
pradk | shardy, any errors in apache logs | 14:15 |
shardy | pradk: Ok, I see tripleoupstream/centos-binary-gnocchi-api:latest running in the container OK | 14:15 |
shardy | I see two gnocchi services and 41 (!) httpd processes running in the container | 14:17 |
*** dsariel has joined #tripleo | 14:17 | |
shardy | [core:error] [pid 57] [client 192.168.24.19:58500] Script timed out before returning headers: app | 14:17 |
shardy | pradk: hmm, maybe that's related from the gnocchi_wsgi_error.log | 14:18 |
shardy | ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',) | 14:18 |
shardy | pradk: in /var/log/gnocchi/app.log | 14:19 |
shardy | so I guess something is broken | 14:19 |
jaosorior | could I get a review for this https://review.openstack.org/#/c/460435/ ? | 14:19 |
*** limao has joined #tripleo | 14:19 | |
pradk | shardy, yea app.log is the gnocchi api log from apache.. so gnocchi api isnt up | 14:19 |
pradk | shardy, how old are these conatiners? we fixed a few bugs recently | 14:19 |
shardy | pradk: that's a good point, I've not rebuilt them in over a week | 14:20 |
*** skramaja has joined #tripleo | 14:20 | |
pradk | shardy, http://logs.openstack.org/88/459388/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/a9b834e/logs/controller-0-tripleo-ci-a-foo/var/log/gnocchi/app.txt.gz | 14:20 |
pradk | looking on in ovb jobs | 14:20 |
pradk | ok* | 14:20 |
pradk | http://logs.openstack.org/88/459388/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/a9b834e/logs/controller-0-tripleo-ci-a-foo/var/log/ceilometer/ceilometer-upgrade.txt.gz | 14:21 |
shardy | pradk: ack, I guess I need to pull updated images, thanks and sorry for the noise! :) | 14:21 |
pradk | shardy, np, lemme know if you still see issues | 14:21 |
*** limao has quit IRC | 14:23 | |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Fix redis container https://review.openstack.org/460469 | 14:23 |
*** limao has joined #tripleo | 14:24 | |
mandre | pradk: this should get us a functional redis container https://review.openstack.org/#/c/460469/ | 14:25 |
*** karthiks has joined #tripleo | 14:25 | |
*** prateek has quit IRC | 14:26 | |
pradk | mandre, cool, will test this today .. so you dint use .puppet directly | 14:26 |
pradk | used exec instead, so it copies orig.. cool | 14:26 |
mandre | shardy: we may be chasing the same issue, redis container was failing to start | 14:27 |
*** d0ugal has quit IRC | 14:28 | |
*** ratailor has quit IRC | 14:29 | |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Add 'become: true' to haproxy validation https://review.openstack.org/460610 | 14:32 |
*** d0ugal has joined #tripleo | 14:33 | |
*** enrraja has joined #tripleo | 14:33 | |
*** enrraja_ has joined #tripleo | 14:33 | |
*** agurenko has quit IRC | 14:34 | |
shardy | mandre: ack thanks - I'm just rebuilding the container images then will re-test with your patch | 14:34 |
*** gfidente has quit IRC | 14:34 | |
*** jchhatbar has joined #tripleo | 14:35 | |
*** limao has quit IRC | 14:35 | |
*** gfidente has joined #tripleo | 14:35 | |
*** gfidente has quit IRC | 14:35 | |
*** gfidente has joined #tripleo | 14:35 | |
*** janki has quit IRC | 14:36 | |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/newton: Prepare 5.6.0 release (newton) https://review.openstack.org/460612 | 14:38 |
*** d0ugal has quit IRC | 14:39 | |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/ocata: Prepare 6.4.0 release (ocata) https://review.openstack.org/460614 | 14:39 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: TEST: Bisect heat https://review.openstack.org/460189 | 14:41 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: TEST: Bisect heat https://review.openstack.org/460188 | 14:41 |
*** aufi has quit IRC | 14:41 | |
*** limao has joined #tripleo | 14:42 | |
skramaja | shardy: if you remember, we have discussed about populating hiera data before PreNetworkConfig so that DPDK can be enabled in it, there was some issue because of cyclic dependecy in the earlier version of the change, now i have spiltted the hiera data config as 2 steps. i am not sure if this is a right apporach - can you provide your views on this - https://review.openstack.org/#/c/430215/ | 14:43 |
jaosorior | shardy: thanls | 14:43 |
jaosorior | *thanks | 14:43 |
*** lblanchard has quit IRC | 14:44 | |
*** lblanchard has joined #tripleo | 14:44 | |
bnemec | EmilienM: So https://review.openstack.org/#/c/460189/2 got us down to ControllerServiceChain 169.0 | 14:44 |
*** lblanchard has quit IRC | 14:44 | |
*** cylopez has quit IRC | 14:44 | |
bnemec | I'm continuing to bisect heat in ci to see if I can figure out the last good commit. | 14:44 |
*** lblanchard has joined #tripleo | 14:45 | |
shardy | skramaja: I'm not sure that will work, won't the additional hiera erase the previous deployment? | 14:45 |
*** limao has quit IRC | 14:45 | |
shardy | skramaja: can you clarify what the circular dependency was? | 14:46 |
shardy | AFAICS NetIpMap depends on the node existing, but not NetworkDeployment? | 14:46 |
*** limao has joined #tripleo | 14:47 | |
openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient master: Use Swift to store Plan environment https://review.openstack.org/453841 | 14:47 |
EmilienM | bnemec: interesting | 14:47 |
skramaja | shardy: i have tested it, it is updaing the new hiera files and not earsing the previous and the hierarcy is also in tact.. | 14:48 |
*** d0ugal has joined #tripleo | 14:48 | |
*** cylopez has joined #tripleo | 14:48 | |
skramaja | shardy: There is a circular dependency between ControllerDeployment, NetworkDeployment and UpdateDeployment with recent changes of https://review.openstack.org/#/c/439504/. While it is not possible to break this to move hiera population before NetworkDeployment. | 14:48 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Increase documentation about parameters https://review.openstack.org/460102 | 14:50 |
openstackgerrit | Merged openstack/tripleo-ui master: Import PropTypes separately from React https://review.openstack.org/460142 | 14:51 |
openstackgerrit | Merged openstack/puppet-tripleo master: Include base apache module in tls_proxy resource https://review.openstack.org/460423 | 14:52 |
shardy | skramaja: I think we can remove tripleo::packages::enable_upgrade and break that dependency | 14:52 |
shardy | skramaja: packages are never upgraded via puppet in our current architecture | 14:52 |
shardy | only via upgrade_tasks | 14:52 |
*** d0ugal has quit IRC | 14:56 | |
*** limao has quit IRC | 14:57 | |
bogdando | shardy, dprince: trying to inspect ephemeral stacks with heat CLI, when engine was switched to the temporary sqlite db. stack list/show works, but 'failures list' throws Remote error: InvalidToken: ... I'm wondering why :/ | 14:57 |
*** limao has joined #tripleo | 14:57 | |
bogdando | the stackrc is default one from quickstar... | 14:58 |
bogdando | and it seems keystone uses fernet now by default | 14:58 |
openstackgerrit | Julie Pichon proposed openstack/tripleo-common master: Use Swift to store Plan environment https://review.openstack.org/452291 | 14:58 |
bogdando | also I've tried https://github.com/larsks/dotstack but it throws same error | 14:59 |
*** hjensas has quit IRC | 14:59 | |
shardy | bogdando: the ephemeral heat stack is backed by a dummy keystone, are you using the password for the actual undercloud, not the installer in tripleoclient? | 14:59 |
bogdando | shardy: oh, yes, I'm using real keystone | 15:00 |
hamzy | thrash, for https://review.openstack.org/#/c/459704/ I tried to install it locally and am seeing a timeout and "Can not evaluate YAQL expression" http://paste.openstack.org/show/608211/ | 15:00 |
bogdando | but connection string sustitution works for heat | 15:00 |
jaosorior | bandini: how did one restart haproxy when it's ran with pacemaker? | 15:00 |
thrash | hamzy: thanks.. I'll take a look at it.. | 15:00 |
*** tvignaud_ has quit IRC | 15:00 | |
bandini | jaosorior: what's the context? | 15:01 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ui stable/newton: Prepare 1.2.0 release (newton) https://review.openstack.org/460621 | 15:01 |
*** tvignaud_ has joined #tripleo | 15:01 | |
EmilienM | honza, florianf, jtomasek ^ please | 15:01 |
shardy | bogdando: Ok I'm confused, are you talking about the undercloud deploy command? | 15:01 |
shardy | that's backed by https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/fake_keystone.py | 15:01 |
shardy | e.g stubbed keystone so it's really noauth | 15:01 |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-common master: Make validation inputs configurable via Mistral https://review.openstack.org/383763 | 15:01 |
bogdando | shardy: yes. Then I did https://pastebin.com/aJH5rJQu | 15:02 |
jaosorior | bandini: the certificate was changed from haproxy, so need to restart it | 15:02 |
bandini | jaosorior: if a reload is enough then systemctl is okay. otherwise pcs resource restart haproxy-clone | 15:03 |
florianf | EmilienM: done | 15:03 |
bogdando | shardy: It seems I need another stackrc | 15:03 |
EmilienM | florianf: thx | 15:03 |
*** pkovar has quit IRC | 15:03 | |
bogdando | for dummy keystone? | 15:03 |
shardy | bogdando: so you're pointing the undercloud heat at the sqlite db from the install? | 15:03 |
bogdando | shardy: yupp | 15:03 |
jaosorior | bandini: thanks | 15:04 |
shardy | bogdando: wouldn't it be easier to specify --keep-running then connect to the running heat-all process inside undercloud_deploy? | 15:05 |
shardy | https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/undercloud_deploy.py#L385 | 15:05 |
*** trown is now known as trown|brb | 15:05 | |
*** pcaruana has quit IRC | 15:05 | |
trown|brb | nice work panda|bbl thanks! | 15:05 |
shardy | bogdando: there's an auth encryption key in heat.conf, perhaps that's what is failing but it's hard to see from the error | 15:06 |
bogdando | shardy: thanks, I'll try that opt. How could I then explore stacks? | 15:06 |
bogdando | shardy: yes, engine logs mention encryption issues | 15:06 |
shardy | bogdando: there should be the temporary heat listenting on port 8006 | 15:06 |
shardy | https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/undercloud_deploy.py#L342 | 15:06 |
*** gbarros has quit IRC | 15:06 | |
shardy | bogdando: I've not tried, but I assume you can query it until the process gets killed | 15:06 |
*** limao has quit IRC | 15:08 | |
*** limao has joined #tripleo | 15:09 | |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 15:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 15:10 |
*** tellesnobrega has quit IRC | 15:10 | |
*** vkhanna has left #tripleo | 15:10 | |
bogdando | shardy: thank you, keep running should help | 15:13 |
*** jaosorior is now known as jaosorior_away | 15:13 | |
*** limao has quit IRC | 15:13 | |
*** limao has joined #tripleo | 15:14 | |
EmilienM | panda|bbl: thanks for the deep dive! | 15:15 |
jistr | weshay, matbu: FWIW i think the contianer upgrade CI vs. the N->O upgrade patches wouldn't conflict at all in the end. Or at least the container upgrade CI wouldn't break the N->O, and i'm hoping that holds vice versa too but i'm a bit less sure there. | 15:15 |
panda|bbl | EmilienM: hope it was helpful | 15:16 |
*** ebarrera has joined #tripleo | 15:16 | |
adarazs | EmilienM, trown, sshnaidm, weshay, hrybacki, panda|bbl, rlandy, bkero, arxcruz: CI Squad meeting in 15 minutes (this is an exception, usually it's 1 hour earlier): https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 15:16 |
*** zigo has quit IRC | 15:17 | |
weshay | jistr, was just looking for your patches :) you read my mind | 15:17 |
arxcruz | adarazs: <o/ | 15:17 |
jistr | hehe | 15:17 |
panda|bbl | arxcruz: is that the dab move ? | 15:18 |
*** Goneri has joined #tripleo | 15:18 | |
*** trown|brb is now known as trown | 15:18 | |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Fix for the resource ControllerPostPuppetMaintenanceModeDeployment https://review.openstack.org/460457 | 15:19 |
dprince | bogdando: use the fake keystone like this: https://etherpad.openstack.org/p/tripleo-composable-undercloud (line 110 at the bottom) | 15:19 |
dprince | bogdando: in other words the keystone on port 35358 (local only) | 15:19 |
*** vkhanna has joined #tripleo | 15:20 | |
weshay | jistr, added your reviews https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 15:21 |
arxcruz | panda|bbl: is the yes sir! move | 15:21 |
weshay | mtg in 9 min | 15:21 |
dprince | bogdando: also worth noting that this installer still supports baremetal too (what that etherpad was driving for with the initial implementation) | 15:21 |
*** d0ugal has joined #tripleo | 15:21 | |
shardy | dprince: Hey, do you know the cleanest way to purge all the images from the local docker registry? | 15:22 |
EmilienM | panda|bbl: it was | 15:22 |
*** gbarros has joined #tripleo | 15:22 | |
shardy | I've run out of disk space so I need to delete everything before I can rebuild/push new images | 15:22 |
dprince | shardy: docker images -q | xargs docker rmi -f | 15:22 |
dprince | shardy: I run that ^^^ | 15:22 |
shardy | dprince: perfect, thanks! | 15:22 |
bogdando | dprince: thanks a lot! | 15:22 |
dprince | shardy: you may need to run it twice fwiw | 15:22 |
amoralej | i'd appreciate reviews on https://review.openstack.org/#/c/460064/ it blocks some tests in rdo-ci | 15:23 |
bogdando | shardy: docker 1.13 / 2017 has a nice cleanup CLI AFAIK | 15:23 |
dprince | shardy: actually, to clarify that won't purge images in docker-distribution. Only those known about by docker daemon's images | 15:24 |
trown | amoralej: done. thanks! | 15:25 |
dprince | shardy: to cleanup docker-distribution I stop the daemon, and remove /var/lib/registry/* | 15:25 |
amoralej | thanks trown! | 15:25 |
shardy | dprince: ah, OK I may need to do that | 15:25 |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates master: Add templates to configure Ironic inspector https://review.openstack.org/436159 | 15:25 |
*** limao has quit IRC | 15:26 | |
shardy | Also a 2 node deployment is using 22G on /var/lib/docker/devicemapper/devicemapper :( | 15:26 |
skramaja | shardy: yes that will remove the ciruclar dependency. do you mean invoking of "tripleo::packages" can be removed? i haven't gone throught it, i will check and test it. | 15:26 |
dprince | shardy: try overlay? | 15:26 |
*** limao has joined #tripleo | 15:26 | |
shardy | dprince: ack, I'll give it a go | 15:26 |
jistr | weshay: thanks :) | 15:26 |
shardy | skramaja: yes I think it can be removed, as we never use puppet to update packages AFAIK | 15:27 |
shardy | so it should be safe to default it to false | 15:27 |
shardy | If it's ever needed in future we can find another way to set it IMO | 15:27 |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates master: DO NOT MERGE: testing ironic-inspector https://review.openstack.org/460639 | 15:28 |
skramaja | shardy: ok. i will proceed in that direction. thanks a lot. | 15:28 |
*** enrraja has quit IRC | 15:28 | |
*** enrraja_ has quit IRC | 15:29 | |
*** skramaja has quit IRC | 15:29 | |
bogdando | dotstack seems don't like fake keystone ;( | 15:30 |
adarazs | EmilienM: are you joining the ci squad meeting? | 15:30 |
*** pkovar has joined #tripleo | 15:33 | |
EmilienM | adarazs: on my way | 15:33 |
*** ebarrera has quit IRC | 15:34 | |
*** limao has quit IRC | 15:37 | |
*** karthiks has quit IRC | 15:37 | |
*** limao has joined #tripleo | 15:37 | |
*** vkhanna has quit IRC | 15:38 | |
*** yprokule has quit IRC | 15:39 | |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates master: Add advanced features to ironic-inspector templates https://review.openstack.org/460648 | 15:40 |
bogdando | dprince, shardy: at least 'openstack stack failures list undercloud' works now, thanks! | 15:41 |
bogdando | not the dotstack although | 15:41 |
*** vkhanna has joined #tripleo | 15:41 | |
dprince | dprince: nice | 15:41 |
*** dprince has quit IRC | 15:41 | |
*** ccamacho has quit IRC | 15:41 | |
openstackgerrit | James Slagle proposed openstack/tripleo-docs master: Additional docs for using deployed servers https://review.openstack.org/460652 | 15:43 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Stop/disable/mask rpcbind on undercloud vm https://review.openstack.org/460653 | 15:43 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Collect the last 4 hours from the journal in text form https://review.openstack.org/447099 | 15:45 |
*** ramishra has quit IRC | 15:45 | |
*** limao has quit IRC | 15:48 | |
*** limao has joined #tripleo | 15:48 | |
*** yamahata_ has quit IRC | 15:48 | |
openstackgerrit | Radomir Dopieralski proposed openstack/tripleo-heat-templates master: WIP: Containerize Horizon https://review.openstack.org/450303 | 15:51 |
openstackgerrit | Radomir Dopieralski proposed openstack/tripleo-heat-templates master: WIP: Containerize Horizon https://review.openstack.org/450303 | 15:51 |
*** pradk has quit IRC | 15:52 | |
*** jchhatbar has quit IRC | 15:53 | |
*** atoth has quit IRC | 15:55 | |
*** hewbrocca is now known as hewbrocca_afk | 15:56 | |
*** lmiccini has quit IRC | 15:59 | |
*** limao has quit IRC | 15:59 | |
openstackgerrit | Merged openstack/puppet-tripleo master: Add linuxbridge agent profile https://review.openstack.org/457936 | 15:59 |
*** limao has joined #tripleo | 15:59 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Don't set profile value to Role title https://review.openstack.org/454840 | 16:00 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Remove NodesAssignment view/functionality https://review.openstack.org/454736 | 16:00 |
*** ipsecguy_ has joined #tripleo | 16:01 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: [ironic] expose default boot_option in configuration and change it to local https://review.openstack.org/446961 | 16:01 |
*** ipsecguy has quit IRC | 16:02 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Add undercloud-containers job to cistatus https://review.openstack.org/446957 | 16:05 |
openstackgerrit | Merged openstack/tripleo-ui master: Add spacing between icon and text - refresh nodes https://review.openstack.org/454169 | 16:05 |
openstackgerrit | Merged openstack/tripleo-ui master: Correctly mark number values in translation https://review.openstack.org/453194 | 16:05 |
*** chlong_ has joined #tripleo | 16:08 | |
*** ykarel has quit IRC | 16:09 | |
*** yolanda has joined #tripleo | 16:09 | |
*** ooolpbot has joined #tripleo | 16:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 16:10 |
*** ooolpbot has quit IRC | 16:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 16:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 16:10 |
*** limao has quit IRC | 16:11 | |
*** atoth has joined #tripleo | 16:11 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ui stable/ocata: Bump to 3.2.0 (ocata) https://review.openstack.org/460664 | 16:13 |
EmilienM | florianf, honza, jtomasek ^ last request for today | 16:14 |
*** mdnadeem has quit IRC | 16:14 | |
*** chlong_ has quit IRC | 16:14 | |
bogdando | PTAL https://review.openstack.org/#/c/459768/ (oooq / libvirt) | 16:15 |
bogdando | and please merge https://review.openstack.org/#/c/460488/ | 16:15 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Pass httpd service_name to Zaqar https://review.openstack.org/459619 | 16:16 |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Mount hostpath logs on /var/log https://review.openstack.org/442603 | 16:16 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Prepare 6.1.0 (ocata) https://review.openstack.org/460665 | 16:18 |
*** b00tcat has quit IRC | 16:18 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-image-elements stable/ocata: Prepare 6.1.0 (ocata) https://review.openstack.org/460666 | 16:19 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-puppet-elements stable/ocata: Prepare 6.1.0 (ocata) https://review.openstack.org/460668 | 16:20 |
*** bogdando has quit IRC | 16:22 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: TLS-everywhere: Add missing profiles to docker compute services https://review.openstack.org/460435 | 16:23 |
*** ramishra has joined #tripleo | 16:23 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Remove Nodes NavTabs https://review.openstack.org/460535 | 16:24 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update to latest Patternfly https://review.openstack.org/460534 | 16:24 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Simplify Node Ports fetching https://review.openstack.org/459628 | 16:24 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: [WIP] NodesListView and ListView components https://review.openstack.org/460536 | 16:24 |
*** trozet has quit IRC | 16:25 | |
openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: Prepare 6.4.0 release (ocata) https://review.openstack.org/460614 | 16:26 |
openstackgerrit | Merged openstack/puppet-tripleo stable/newton: Prepare 5.6.0 release (newton) https://review.openstack.org/460612 | 16:26 |
*** mcornea has quit IRC | 16:28 | |
*** ykarel has joined #tripleo | 16:28 | |
*** dprince has joined #tripleo | 16:28 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Use ansible to write the docker json configs https://review.openstack.org/454816 | 16:29 |
*** jpich has quit IRC | 16:30 | |
*** lucasagomes is now known as lucas-afk | 16:31 | |
*** atheurer has joined #tripleo | 16:33 | |
*** zoli is now known as zoli|gone | 16:34 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: WIP: Add OVB support to devmode.sh https://review.openstack.org/452249 | 16:39 |
openstackgerrit | Michael Chapman proposed openstack/tripleo-quickstart master: Add support for external network bridges https://review.openstack.org/406421 | 16:41 |
*** ebarrera has joined #tripleo | 16:43 | |
*** ffiore has quit IRC | 16:45 | |
*** atheurer has quit IRC | 16:46 | |
*** jcoufal has quit IRC | 16:48 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update React to 15.5 https://review.openstack.org/460143 | 16:51 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Use prop-types lib to import PropTypes https://review.openstack.org/460144 | 16:51 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Use react-test-renderer https://review.openstack.org/460145 | 16:51 |
*** jcoufal has joined #tripleo | 16:52 | |
*** flepied has quit IRC | 16:52 | |
*** derekh has quit IRC | 16:52 | |
EmilienM | chem: https://review.openstack.org/#/c/460309/ is ready when you are | 16:56 |
jrist | jtomasek: did you figure out quick/easy way to use quickstart for our needs? | 16:56 |
jrist | jtomasek: pull down master and then use Wes' patch? | 16:56 |
jrist | Honza/Wes' patch https://review.openstack.org/#/c/407733/ | 16:57 |
*** dtantsur is now known as dtantsur|afk | 16:57 | |
openstackgerrit | James Slagle proposed openstack/tripleo-docs master: Additional docs for using deployed servers https://review.openstack.org/460652 | 16:57 |
jrist | oh nice that's almost merged | 16:58 |
jtomasek | jrist: I think so. in that case you probably need to use --no-clone option | 16:58 |
*** ramishra has quit IRC | 16:58 | |
jrist | ok | 16:58 |
jrist | ./devmode.sh ? | 16:58 |
jtomasek | jrist: not needed IIUC | 16:58 |
jtomasek | jrist: IIUC running a plain quickstart.sh (with that pach applied) should give you usable undercloud for GUI dev | 16:59 |
*** salmankhan has quit IRC | 16:59 | |
jtomasek | jrist: --release master-tripleo-ci (probably) | 17:00 |
jrist | k | 17:00 |
jrist | quickstart --no-clone --release master-tripleo-ci | 17:00 |
*** jprovazn has quit IRC | 17:01 | |
*** atheurer has joined #tripleo | 17:02 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add $STACK_NAME input var https://review.openstack.org/460681 | 17:03 |
*** trown is now known as trown|lunch | 17:03 | |
jtomasek | honza: how do I get this passing? https://review.openstack.org/#/c/460534/ /me confused again | 17:05 |
honza | jtomasek: looking | 17:07 |
honza | jtomasek: 1) The dependency upgrade should be in its own patch. 2) We have to get RDO to review and build the package. Then it will pass/merge. | 17:08 |
honza | RDO approves, we merge. Then we update openstack-tripleo-ui-deps.spec, and then RDO builds a new version, and then it can pass. | 17:08 |
honza | jtomasek: https://github.com/openstack/tripleo-ui/blob/master/docs/packaging.rst#what-to-do-when-dependencies-change | 17:09 |
*** tosky has quit IRC | 17:09 | |
jtomasek | honza: the changes are minimum changes required for that update to not to break build | 17:09 |
*** ooolpbot has joined #tripleo | 17:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 17:10 |
*** ooolpbot has quit IRC | 17:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 17:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 17:10 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add support for $DO_BOOTSTRAP_SUBNODES https://review.openstack.org/437434 | 17:11 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add generated nodepool key to authorized_keys https://review.openstack.org/437742 | 17:11 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Fix setting of node and node_private https://review.openstack.org/437433 | 17:11 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Support running toci_gate_test-oooq.sh locally https://review.openstack.org/437431 | 17:11 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Stop dstat at the end of a job https://review.openstack.org/438745 | 17:11 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Guard adding bridge interface with $STABLE_RELEASE https://review.openstack.org/440838 | 17:11 |
slagle | let's add 60 more jobs to the ovb queue | 17:12 |
bnemec | Meh, the check queue's actually pretty short today. | 17:13 |
bnemec | It'll be even better once mitaka is EOL'd. | 17:13 |
slagle | i know, it was only an hour wait when I checked :) | 17:13 |
jtomasek | honza: so now we need to wait for RDO to build a new version which includes the change from the patch? | 17:13 |
honza | jtomasek: That's how it works. | 17:14 |
jtomasek | honza: ok thanks, I was confused on this step | 17:15 |
honza | jtomasek: They have to approve each dependency change, and rebuild. We can batch updates so they only have to rebuild once for a few changes. | 17:15 |
*** tellesnobrega has joined #tripleo | 17:15 | |
jtomasek | honza: so technically after it is rebuilt (without ui patch being merged), approving and merging the UI patch is jsut formal since that new dependency is already built, right? | 17:17 |
honza | jtomasek: Yes, all you should need is a recheck. | 17:19 |
honza | jtomasek: The patch should only contain the package.json/npm-shrinkwrap.json code. Your actual code should be in a dependent patch. | 17:20 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Fix for the resource ControllerPostPuppetMaintenanceModeDeployment https://review.openstack.org/460457 | 17:25 |
*** sshnaidm is now known as sshnaidm|afk | 17:27 | |
jtomasek | honza: ok, I can split it, my concern is that quite oposite to React update patch or any other new dependency addition, this Patternfly update patch without additional code changes breaks npm build | 17:27 |
*** jpena is now known as jpena|off | 17:28 | |
jtomasek | honza: the code just won't compile without those changes. I am not sure how much of a problem it is | 17:28 |
honza | jtomasek: Yeah, I don't have a good answer for you there. | 17:28 |
jtomasek | honza: the tests will fail so the patch won't be able to merge | 17:28 |
*** michapma_dsk has quit IRC | 17:29 | |
honza | jtomasek: I guess in that case it'll have to be bundled with the dependency update. | 17:29 |
jtomasek | honza: +1 | 17:29 |
honza | jtomasek: Just make a note of the exception in the commit message so RDO doesn't get confused :) | 17:29 |
jtomasek | honza: ack | 17:30 |
openstackgerrit | Merged openstack/puppet-tripleo master: Fix wrong notify in swift proxy profile https://review.openstack.org/460426 | 17:33 |
*** ansmith has quit IRC | 17:34 | |
*** pkovar has quit IRC | 17:34 | |
*** milan has quit IRC | 17:36 | |
*** ffiore has joined #tripleo | 17:38 | |
shardy | Anyone seeing errors like this running container deployments? | 17:38 |
shardy | default_file=/etc/my.cnf.d/tripleo.cnf&read_default_group=tripleo" does not match "^(sqlite|mysql(\\+pymysql)?|postgresql) | 17:38 |
shardy | It's when running docker-puppet | 17:38 |
*** ebarrera has quit IRC | 17:38 | |
*** fragatina has quit IRC | 17:40 | |
*** ffiore has quit IRC | 17:41 | |
*** fragatina has joined #tripleo | 17:41 | |
EmilienM | shardy: probably because the database url doesn't contain a valid value, with the url of mysql database | 17:45 |
*** gfidente is now known as gfidente|afk | 17:45 | |
*** vpickard has quit IRC | 17:45 | |
*** vpickard has joined #tripleo | 17:45 | |
shardy | EmilienM: ah, that's a good clue, thanks | 17:46 |
shardy | will check it out | 17:46 |
EmilienM | shardy: we run some sort of validation in the puppet-* modules, and this errors looks familiar to me | 17:47 |
EmilienM | shardy: https://github.com/openstack/puppet-oslo/blob/master/manifests/db.pp#L136 | 17:47 |
*** ansmith has joined #tripleo | 17:49 | |
*** tellesnobrega has quit IRC | 17:49 | |
*** deadnull has joined #tripleo | 17:54 | |
shardy | EmilienM: thanks, you were right - I have a problem with writing the data that provides that config | 17:56 |
*** ffiore has joined #tripleo | 17:56 | |
EmilienM | cool | 17:57 |
*** tosky has joined #tripleo | 17:59 | |
*** tellesnobrega has joined #tripleo | 17:59 | |
*** shardy has quit IRC | 18:00 | |
*** sshnaidm|afk has quit IRC | 18:03 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add VipMap output https://review.openstack.org/460138 | 18:04 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add split-stack environments https://review.openstack.org/459900 | 18:04 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add DeploymentSwiftDataMap parameter https://review.openstack.org/459440 | 18:04 |
openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: Add support for ipv6_addrlabel with IPaddr2 RA https://review.openstack.org/460232 | 18:05 |
*** ffiore has quit IRC | 18:08 | |
*** ooolpbot has joined #tripleo | 18:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 18:10 |
*** ooolpbot has quit IRC | 18:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 18:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 18:10 |
*** amoralej is now known as amoralej|off | 18:16 | |
*** trown|lunch is now known as trown | 18:16 | |
openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP IPv6 VIP addresses need to be /128 https://review.openstack.org/460028 | 18:17 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Remove Nodes NavTabs https://review.openstack.org/460535 | 18:22 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update to latest Patternfly https://review.openstack.org/460534 | 18:22 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: [WIP] NodesListView and ListView components https://review.openstack.org/460536 | 18:22 |
*** gbarros has quit IRC | 18:25 | |
*** gbarros has joined #tripleo | 18:26 | |
*** flepied has joined #tripleo | 18:29 | |
*** gbarros has quit IRC | 18:29 | |
*** Goneri has quit IRC | 18:30 | |
*** ansmith has quit IRC | 18:31 | |
*** Goneri has joined #tripleo | 18:34 | |
*** gbarros has joined #tripleo | 18:38 | |
*** atoth has quit IRC | 18:38 | |
*** atoth has joined #tripleo | 18:39 | |
EmilienM | weshay: can you triage https://bugs.launchpad.net/tripleo/+bug/1686353 please? | 18:40 |
openstack | Launchpad bug 1686353 in tripleo "Proxy Options for TripleO QuickStart" [High,Triaged] | 18:40 |
EmilienM | or trown ^ | 18:40 |
*** anshulbehl has joined #tripleo | 18:42 | |
*** iranzo has quit IRC | 18:43 | |
*** deadnull has quit IRC | 18:43 | |
*** ansmith has joined #tripleo | 18:47 | |
trown | EmilienM: looking | 18:47 |
*** openstackgerrit has quit IRC | 18:48 | |
*** openstackgerrit has joined #tripleo | 18:48 | |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Automatically enable all available languages https://review.openstack.org/456646 | 18:48 |
*** fragatina has quit IRC | 18:50 | |
*** iranzo has joined #tripleo | 18:52 | |
*** iranzo has joined #tripleo | 18:52 | |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Add language switcher to login page https://review.openstack.org/441435 | 18:53 |
jrist | honza: is https://review.openstack.org/#/c/441435/10 just a rebase? | 18:56 |
honza | jrist: yes | 18:56 |
*** tellesnobrega has quit IRC | 18:57 | |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Add pre-selected Control Plane IP support. https://review.openstack.org/413278 | 18:57 |
jrist | because there were no file changes | 18:57 |
jrist | according to gerrit | 18:57 |
*** salmankhan has joined #tripleo | 18:58 | |
honza | jrist: gerrit is pretty dumb when it comes to rebase diffs | 18:58 |
*** pkovar has joined #tripleo | 18:58 | |
hamzy | EmilienM, I responded to https://bugs.launchpad.net/tripleo/+bug/1686201/comments/6 Given that I have yet to be able to fully install the undercloud and overcloud, I am wondering what differences exist between your CI and my clean install of a CentOS bare metal machine. | 19:02 |
openstack | Launchpad bug 1686201 in tripleo "Execution of '/bin/openstack token issue --format value' returned 1: Unable to establish connection to https://192.168.24.2:13000/v3/auth/tokens" [Undecided,Triaged] | 19:02 |
EmilienM | hamzy: our multinode jobs don't use images | 19:02 |
EmilienM | but use repos from rdo directly | 19:02 |
*** salmankhan has quit IRC | 19:02 | |
EmilienM | can you list packages that you deployed and compare with what is deployed in upstream CI? | 19:02 |
EmilienM | if you go on http://tripleo.org/cistatus.html you can pick a recent job on master (or the version that you deploy) and compare the rpm-qa files | 19:03 |
hamzy | EmilienM, should tripleo be installable by someone from the public? | 19:03 |
EmilienM | hamzy: of course, yes | 19:03 |
EmilienM | and if not there is a problem | 19:03 |
hamzy | well I have yet to be able to fully install the undercloud and overcloud on master or newton and I have been trying for weeks now | 19:05 |
hamzy | I will try and see if I can compare the packages... | 19:05 |
EmilienM | can you share the way you're deploying please? | 19:06 |
hamzy | EmilienM, http://paste.openstack.org/show/608231/ | 19:07 |
*** iranzo has quit IRC | 19:08 | |
hamzy | hopefully that is not a crazy way of doing it :) | 19:08 |
EmilienM | hamzy: ok so you're trying with a patch that fails in CI: https://review.openstack.org/#/c/456225/ | 19:10 |
EmilienM | hamzy: have you tried a deployment without it? | 19:10 |
*** ooolpbot has joined #tripleo | 19:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 19:10 |
*** ooolpbot has quit IRC | 19:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 19:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 19:10 |
hamzy | yes and ran into issues which the patch was designed to get around | 19:11 |
EmilienM | I'm not sure if trown's patch is ready to be tested, I see red CI jobs | 19:13 |
*** florianf has quit IRC | 19:16 | |
openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Handle failed actions https://review.openstack.org/460720 | 19:17 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Align hyperconverged-ceph.yaml environment and adds some validation https://review.openstack.org/439579 | 19:19 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Change the default for rabbitmq back to ha-mode: all https://review.openstack.org/459998 | 19:20 |
openstackgerrit | Merged openstack/tripleo-quickstart master: Disable gpgcheck for openstack-ocata stable repo https://review.openstack.org/460064 | 19:20 |
*** lblanchard has quit IRC | 19:22 | |
flaper87 | fultonj: is this the template you guys are using to deploy ceph? https://github.com/fultonj/tripleo-ceph-ansible/blob/f6e195142edcb3100e2133ac6a64e84dd2e8bf9c/tht/ceph-ansible-workflow.j2.yaml | 19:22 |
flaper87 | mmh, shouldn't it also have an output ? | 19:22 |
flaper87 | oh, nvm | 19:22 |
fultonj | flaper87: yes, that passes the params to the custom heat resource | 19:23 |
fultonj | then this https://github.com/fultonj/tripleo-ceph-ansible/blob/f6e195142edcb3100e2133ac6a64e84dd2e8bf9c/mistral-ceph-ansible.yaml | 19:23 |
fultonj | (the mistral workflow) gets those params and passes them to ceph-ansible | 19:24 |
flaper87 | yeah, I was looking at the heat side of things | 19:25 |
flaper87 | fultonj: but, IIUC, the resource changed name in gfidente|afk latest patch | 19:25 |
fultonj | flaper87: yes | 19:25 |
*** tellesnobrega has joined #tripleo | 19:26 | |
flaper87 | fultonj: will that ceph-ansible-workflow change too? | 19:26 |
fultonj | flaper87: yes | 19:26 |
fultonj | flaper87: but i'm keeping it updated | 19:26 |
fultonj | in that repo | 19:27 |
fultonj | when the heat change merges it will start to make sense to mv it into tripleo common | 19:27 |
fultonj | flaper87: i thought i had updated the heat in that repo to use the new resource... | 19:27 |
fultonj | i can get it for you | 19:27 |
flaper87 | fultonj: please :) | 19:28 |
flaper87 | fultonj: and the template :D | 19:28 |
*** anshulbehl has quit IRC | 19:29 | |
fultonj | https://review.openstack.org/#/c/458058/2/extraconfig/tasks/ceph-ansible-workflow.j2.yaml | 19:31 |
*** florianf has joined #tripleo | 19:31 | |
fultonj | flaper87: i glue it all together after installing quickstart with https://github.com/fultonj/tripleo-ceph-ansible/blob/master/init.sh | 19:31 |
fultonj | flaper87: it's a hack to pretend i am in the future | 19:31 |
fultonj | flaper87: the on you linked to from my repo should be deleted | 19:32 |
fultonj | flaper87: i directly use what is in https://review.openstack.org/458058 instead | 19:32 |
*** pradk has joined #tripleo | 19:34 | |
rdopiera | I'm trying the devmode.sh from tripleo-quickstart for the first time, using all defaults except for the change id and the commit id, and then it fails with "fatal: repository 'review.openstack.org/openstack/tripleo-heat-templates' does not exist" -- what am I doing wrong? | 19:36 |
*** cylopez has left #tripleo | 19:39 | |
thrash | rdopiera: I prefer using ZUUL_HOST and ZUUL_CHANGES instead | 19:39 |
thrash | just set ZUUL_HOST to review.openstack.org and you can get the ZUUL_CHANGES from any job on your patch. look in _zuul_ansible/vars.yaml | 19:40 |
thrash | rdopiera: for instance... | 19:41 |
thrash | export ZUUL_HOST=review.openstack.org | 19:41 |
thrash | export ZUUL_CHANGES='openstack/tripleo-common:master:refs/changes/04/459704/1' | 19:41 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add VipMap output https://review.openstack.org/460138 | 19:41 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add split-stack environments https://review.openstack.org/459900 | 19:41 |
rdopiera | thrash: certainly, but shouldn't both work? | 19:42 |
thrash | rdopiera: sure... But I don't use the other. :D | 19:42 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP Initial VIP ipv6 minor update code https://review.openstack.org/460724 | 19:45 |
rdopiera | thrash: that seems to have worked, thanks | 19:45 |
thrash | rdopiera: :D | 19:45 |
thrash | rdopiera: I just had better luck with it, so I've stuck with it. | 19:46 |
rdopiera | I wish that non-working options were removed... | 19:46 |
thrash | rdopiera: I'm sure it works, I just don't know how to fix it. | 19:46 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Remove deprecated minor update pcs code https://review.openstack.org/460726 | 19:49 |
rdopiera | how about this? | 19:52 |
rdopiera | ERROR! the file_name '/root/.quickstart/config/general_config/root/.quickstart/config/general_config/containers_minimal.yml.yml' does not exist, or is not readable | 19:52 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: Add ssh tunneling for TripleO-UI https://review.openstack.org/407733 | 19:53 |
* rdopiera tries to specify the config without the .yml | 19:53 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: add steps to enable tripleo_ui https://review.openstack.org/459061 | 19:53 |
*** milan has joined #tripleo | 19:57 | |
*** dbecker has quit IRC | 19:58 | |
*** ooolpbot has joined #tripleo | 20:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 20:10 |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 20:10 |
*** ooolpbot has quit IRC | 20:10 | |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 20:10 |
pabelanger | EmilienM: FYI, centos-7 nodes coming online, no longer running puppet to provision them. So, might be a few bumps | 20:12 |
*** jayg is now known as jayg|g0n3 | 20:18 | |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Cinder-api upgrade: use httpd instead of apachectl https://review.openstack.org/460303 | 20:20 |
openstackgerrit | Merged openstack/tripleo-ui stable/newton: Prepare 1.2.0 release (newton) https://review.openstack.org/460621 | 20:20 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Upgrade to containerized overcloud https://review.openstack.org/448576 | 20:20 |
openstackgerrit | Merged openstack/tripleo-quickstart master: Add featureset011 - upgrade from BM to containerized https://review.openstack.org/450295 | 20:20 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Prepare 6.1.0 (ocata) https://review.openstack.org/460665 | 20:20 |
openstackgerrit | Merged openstack/tripleo-image-elements stable/ocata: Prepare 6.1.0 (ocata) https://review.openstack.org/460666 | 20:21 |
openstackgerrit | Merged openstack/tripleo-puppet-elements stable/ocata: Prepare 6.1.0 (ocata) https://review.openstack.org/460668 | 20:21 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: upgrades: deploy mod_ssl when upgrading apache https://review.openstack.org/460292 | 20:21 |
openstackgerrit | Merged openstack/tripleo-ui stable/ocata: Bump to 3.2.0 (ocata) https://review.openstack.org/460664 | 20:21 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Disable default vhost for apache https://review.openstack.org/460488 | 20:21 |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Support container upgrades in multinode OOOQ CI https://review.openstack.org/450784 | 20:21 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: add steps to enable tripleo_ui https://review.openstack.org/459061 | 20:26 |
*** liverpooler has quit IRC | 20:26 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: Add ssh tunneling for TripleO-UI https://review.openstack.org/407733 | 20:27 |
*** jkilpatr has quit IRC | 20:29 | |
EmilienM | pabelanger: ok, what does it means? | 20:29 |
EmilienM | what is diff with before for us? | 20:29 |
*** jcoufal has quit IRC | 20:29 | |
pabelanger | EmilienM: so far I noticed https://review.openstack.org/#/c/460731/ | 20:32 |
pabelanger | which is a multi node job | 20:32 |
*** ansmith has quit IRC | 20:35 | |
dr_gogeta86 | anyone knows how to configure pcs stonith via yaml file ? | 20:35 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: TEST: Bisect heat https://review.openstack.org/460189 | 20:40 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: TEST: Bisect heat https://review.openstack.org/460188 | 20:40 |
*** trown is now known as trown|outtypewww | 20:43 | |
*** jkilpatr has joined #tripleo | 20:43 | |
*** fragatina has joined #tripleo | 20:45 | |
*** fragatina has quit IRC | 20:45 | |
*** fragatina has joined #tripleo | 20:46 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: aodh-base.yaml uses a hard coded keystone region name https://review.openstack.org/457373 | 20:51 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add missing tag to nova-placement docker image https://review.openstack.org/458064 | 20:51 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Re-enable bmc caching for ci https://review.openstack.org/460747 | 20:56 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Use port-security version of OVB templates https://review.openstack.org/460748 | 20:56 |
*** jlinkes has quit IRC | 20:56 | |
*** jkilpatr has quit IRC | 20:57 | |
*** trozet has joined #tripleo | 20:59 | |
*** rhallisey has quit IRC | 21:00 | |
*** dougbtv_ has joined #tripleo | 21:02 | |
mwhahaha | EmilienM: pabelanger: yea multinode is broken because of the hostkey verification | 21:04 |
mwhahaha | http://logs.openstack.org/75/460175/2/gate/gate-tripleo-ci-centos-7-nonha-multinode-oooq/bb1e587/console.html#_2017-04-27_20_59_21_654262 | 21:04 |
*** flepied has quit IRC | 21:04 | |
pabelanger | ya, once we get a +3 we're going to promote | 21:04 |
*** dougbtv has quit IRC | 21:05 | |
*** dougbtv__ has joined #tripleo | 21:05 | |
*** gfidente|afk has quit IRC | 21:05 | |
EmilienM | good time to drop off | 21:07 |
*** dougbtv_ has quit IRC | 21:08 | |
*** tellesnobrega has quit IRC | 21:09 | |
*** jcoufal has joined #tripleo | 21:09 | |
*** ooolpbot has joined #tripleo | 21:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 21:10 |
*** ooolpbot has quit IRC | 21:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 21:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 21:10 |
*** dprince has quit IRC | 21:12 | |
*** thrash is now known as thrash|g0ne | 21:25 | |
*** abishop has quit IRC | 21:26 | |
*** milan has quit IRC | 21:29 | |
*** zigo has joined #tripleo | 21:32 | |
*** pradk has quit IRC | 21:35 | |
*** yamahata_ has joined #tripleo | 21:36 | |
*** pkovar has quit IRC | 21:39 | |
*** morazi has quit IRC | 21:39 | |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: DO NOT MERGE https://review.openstack.org/460759 | 21:42 |
*** kbyrne has quit IRC | 21:50 | |
*** Nakato has quit IRC | 21:52 | |
*** Nakato has joined #tripleo | 21:53 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add VipMap output https://review.openstack.org/460138 | 21:53 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add split-stack environments https://review.openstack.org/459900 | 21:53 |
*** kbyrne has joined #tripleo | 21:54 | |
*** tellesnobrega has joined #tripleo | 21:55 | |
*** dsariel has quit IRC | 22:04 | |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: DO NOT MERGE https://review.openstack.org/460759 | 22:08 |
*** ooolpbot has joined #tripleo | 22:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 22:10 |
*** ooolpbot has quit IRC | 22:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 22:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 22:10 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Add log capturing support workflows https://review.openstack.org/405002 | 22:11 |
openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Add overcloud support report command https://review.openstack.org/405001 | 22:11 |
*** ianw has quit IRC | 22:13 | |
*** croelandt has quit IRC | 22:13 | |
*** croelandt has joined #tripleo | 22:14 | |
*** mjblack- has joined #tripleo | 22:14 | |
*** mjblack has quit IRC | 22:14 | |
*** rnoriega has quit IRC | 22:14 | |
*** shadower has quit IRC | 22:14 | |
*** rlandy has quit IRC | 22:14 | |
*** mjblack- is now known as mjblack | 22:15 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Move OVB settings to tripleo-quickstart-extras https://review.openstack.org/448805 | 22:15 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Move OVB settings to tripleo-quickstart-extras https://review.openstack.org/448805 | 22:15 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Parameterize OVB stack flavors https://review.openstack.org/445163 | 22:15 |
openstackgerrit | Alex Schultz proposed openstack-infra/tripleo-ci master: Use support report command to collect node logs https://review.openstack.org/418562 | 22:15 |
*** rnoriega has joined #tripleo | 22:15 | |
*** mnaser has quit IRC | 22:16 | |
*** ianw has joined #tripleo | 22:18 | |
*** mgkwill has quit IRC | 22:18 | |
*** rlandy has joined #tripleo | 22:18 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: WIP: Add OVB support to devmode.sh https://review.openstack.org/452249 | 22:20 |
*** mgkwill has joined #tripleo | 22:21 | |
*** mnaser has joined #tripleo | 22:24 | |
*** ansmith has joined #tripleo | 22:25 | |
*** florianf has quit IRC | 22:30 | |
*** jcoufal has quit IRC | 22:31 | |
*** pmannidi has joined #tripleo | 22:35 | |
*** sanagikoki has joined #tripleo | 22:41 | |
*** vkhanna has left #tripleo | 22:43 | |
*** liverpooler has joined #tripleo | 22:44 | |
*** sanagikoki has quit IRC | 22:46 | |
*** rlandy is now known as rlandy|bbl | 22:53 | |
*** jkilpatr has joined #tripleo | 22:53 | |
*** jkilpatr has quit IRC | 22:53 | |
*** jkilpatr has joined #tripleo | 22:54 | |
*** pmannidi has quit IRC | 22:55 | |
*** pmannidi has joined #tripleo | 22:56 | |
*** hamzy has quit IRC | 22:59 | |
*** trozet has quit IRC | 23:08 | |
*** ooolpbot has joined #tripleo | 23:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680259 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 23:10 |
*** ooolpbot has quit IRC | 23:10 | |
openstack | Launchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress] | 23:10 |
openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 23:10 |
*** gbarros has quit IRC | 23:15 | |
pabelanger | EmilienM: mwhahaha: devstack-gate patch merged | 23:15 |
*** tesseract has quit IRC | 23:20 | |
EmilienM | cool | 23:21 |
EmilienM | I'm out | 23:22 |
*** pmannidi has quit IRC | 23:28 | |
pabelanger | Sent a ML post too | 23:39 |
*** tosky has quit IRC | 23:46 | |
*** ykarel has quit IRC | 23:47 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!