Thursday, 2017-08-24

*** bfournie has joined #tripleo00:00
*** limao_ has quit IRC00:01
*** bfournie has quit IRC00:01
*** bfournie has joined #tripleo00:01
*** achadha has joined #tripleo00:06
*** funzo has joined #tripleo00:07
*** leitan has joined #tripleo00:08
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140300:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295500:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243600:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171259900:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262100:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]00:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]00:10
openstackLaunchpad bug 1712599 in tripleo "scenario001 fails because ceph-ansible is trying to install epel-release" [Critical,In progress] - Assigned to Giulio Fidente (gfidente)00:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged]00:10
*** achadha has quit IRC00:10
*** funzo has quit IRC00:11
*** rcernin has quit IRC00:12
*** achadha has joined #tripleo00:14
*** achadha_ has joined #tripleo00:17
*** achadha has quit IRC00:18
*** achadha has joined #tripleo00:20
homeskiHello00:21
homeskiQuestion for anyone :D00:21
homeskiWe're doing an initial overcloud deployment00:21
*** achadha_ has quit IRC00:22
homeskiand see that all the defined NICs for our compute, get assigned the same IP address from ControlPlan00:22
homeskiControlePlane*00:22
homeskiugh00:22
homeskianyways, has anyone seen this behavior?00:22
bnemechomeski: That's very odd.  Are you using network isolation?00:33
homeskiwe are .. but we actually forgot to include the network-isolation.yaml when we saw this behavior00:37
homeskiI'm away from the cluster ATM and will have to try again with that environment file included in the morning00:37
homeskithink that could be the culprit?00:37
bnemechomeski: That would do it.00:38
bnemecnetwork-isolation.yaml is the thing that creates all the separate networks.00:38
bnemecWithout it everything is configured to use control plane.00:38
homeskiwell that is it then :D00:38
homeskiyay for wasting several hours00:38
homeskiappreciate it00:40
*** colonwq has quit IRC00:41
*** garyk has joined #tripleo00:41
*** jianzhu has joined #tripleo00:43
*** colonwq has joined #tripleo00:45
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Fix testenv creation without network isolation  https://review.openstack.org/49696700:46
bnemecNetworking is hard. :-)00:46
*** dmacpher has quit IRC00:47
*** limao has joined #tripleo00:47
*** jianzhu has quit IRC00:49
*** tzumainn has joined #tripleo00:50
*** achadha_ has joined #tripleo00:52
*** achadha has quit IRC00:53
*** achadha has joined #tripleo00:54
*** achadha_ has quit IRC00:54
*** dixiaoli has joined #tripleo00:55
*** cshastri has joined #tripleo00:55
homeskidefinitely, networking is a weak point for me and causes a lot of headaches00:55
*** dixiaoli has quit IRC00:56
*** dixiaoli has joined #tripleo00:56
*** achadha_ has joined #tripleo00:57
*** itlinux has joined #tripleo00:57
*** achadha has quit IRC00:59
*** achadha_ has quit IRC00:59
*** achadha has joined #tripleo01:00
*** achadha has quit IRC01:01
*** achadha has joined #tripleo01:01
*** rbowen has quit IRC01:01
openstackgerritzhongshengping proposed openstack/puppet-tripleo master: Increase minimum puppetlabs-stdlib version requirement  https://review.openstack.org/49697101:03
*** ecerquei has joined #tripleo01:03
*** fzdarsky_ has joined #tripleo01:04
*** achadha has quit IRC01:05
*** fzdarsky|afk has quit IRC01:08
*** itlinux has quit IRC01:09
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140301:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295501:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243601:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171259901:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262101:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]01:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]01:10
openstackLaunchpad bug 1712599 in tripleo "scenario001 fails because ceph-ansible is trying to install epel-release" [Critical,In progress] - Assigned to Giulio Fidente (gfidente)01:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged]01:10
*** cshastri has quit IRC01:12
*** cshastri has joined #tripleo01:13
*** garyk has quit IRC01:17
*** garyk has joined #tripleo01:17
*** ramishra has quit IRC01:19
openstackgerritBen Nemec proposed openstack/instack-undercloud master: Test image builds with I54ea687ee9165baec1ef1b5c27e40c233683d108  https://review.openstack.org/49697401:22
*** tzumainn has quit IRC01:27
*** noslzzp has quit IRC01:29
*** noslzzp has joined #tripleo01:29
*** achadha has joined #tripleo01:31
*** noslzzp has quit IRC01:34
*** rlandy|bbl is now known as rlandy01:35
*** achadha has quit IRC01:35
*** rlandy has quit IRC01:37
*** noslzzp has joined #tripleo01:40
*** noslzzp_ has joined #tripleo01:45
*** noslzzp has quit IRC01:45
*** yamahata has quit IRC01:48
*** funzo has joined #tripleo02:07
*** thrash is now known as thrash|g0ne02:09
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295502:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243602:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171259902:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262102:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]02:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]02:10
openstackLaunchpad bug 1712599 in tripleo "scenario001 fails because ceph-ansible is trying to install epel-release" [Critical,In progress] - Assigned to Giulio Fidente (gfidente)02:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged]02:10
*** funzo has quit IRC02:12
*** ramishra has joined #tripleo02:30
*** leitan has quit IRC02:39
*** leitan has joined #tripleo02:39
*** leitan has quit IRC02:44
*** artom has quit IRC03:07
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169926103:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295503:10
openstackLaunchpad bug 1699261 in tripleo "neutron-ovs-agent container constantly restarting with default configuration" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243603:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171259903:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262103:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]03:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]03:10
openstackLaunchpad bug 1712599 in tripleo "scenario001 fails because ceph-ansible is trying to install epel-release" [Critical,In progress] - Assigned to Giulio Fidente (gfidente)03:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged]03:10
*** dmacpher has joined #tripleo03:18
*** links has joined #tripleo03:18
*** gbarros has joined #tripleo03:20
*** gkadam has joined #tripleo03:24
*** itlinux has joined #tripleo03:42
*** psahoo has joined #tripleo03:47
openstackgerritMerged openstack/tripleo-heat-templates master: Do not install additional CentOS packages via ceph-ansible  https://review.openstack.org/49680603:54
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Release extra-args from multinode environment settings  https://review.openstack.org/49667603:55
*** itlinux has quit IRC04:00
*** ecerquei has quit IRC04:00
*** itlinux has joined #tripleo04:02
*** ykarel has joined #tripleo04:04
*** funzo has joined #tripleo04:05
*** funzo has quit IRC04:09
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169926104:10
openstackLaunchpad bug 1699261 in tripleo "neutron-ovs-agent container constantly restarting with default configuration" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295504:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243604:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262104:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]04:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]04:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged]04:10
*** skramaja has joined #tripleo04:24
*** janki has joined #tripleo04:25
*** yprokule has joined #tripleo04:49
*** itlinux has quit IRC04:54
*** udesale has joined #tripleo04:57
*** Vijayendra has quit IRC05:00
*** shreshtha has joined #tripleo05:06
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Create a IPv6 ctlplane subnet if using IPv6  https://review.openstack.org/49444305:10
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Wrap IPv6 addresses in square brackets  https://review.openstack.org/49444205:10
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Parse DSN strings with regex  https://review.openstack.org/49444105:10
*** ooolpbot has joined #tripleo05:10
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Provide LOCAL_IP_WRAPPED as a instack env variable  https://review.openstack.org/49444005:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169926105:10
openstackLaunchpad bug 1699261 in tripleo "neutron-ovs-agent container constantly restarting with default configuration" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295505:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243605:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262105:10
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Add router for IPv6 ctlplane subnet  https://review.openstack.org/49701405:10
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Update the masquerade script to support IPv6  https://review.openstack.org/49701505:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]05:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]05:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged]05:10
*** rcernin has joined #tripleo05:11
*** Vijayendra has joined #tripleo05:18
matbuo/05:25
*** rcernin has quit IRC05:27
*** dpawar has joined #tripleo05:30
* Tengu applying an ansible playbook in order to upgarde an ocata undercloud to pike05:31
Tengucrossing fingers :/05:31
Tengusomething like 494 packages are updated in the process. just "wow" :)05:32
matbuTengu: good luck :)05:32
Tenguthe playbook mimic the upgrade doc, hopefully all should go well.05:32
*** shreshtha has quit IRC05:32
Tenguonce the undercloud is done, I'll create a new branch for our heat templates, import /usr/share/openstack-tripleo-heat-templates in it, and try to upgrade the overcloud. It *should* go well.05:33
*** shreshtha has joined #tripleo05:33
Tengumatbu: did you already do that job? :)05:33
*** jfrancoa has joined #tripleo05:33
matbuTengu: yep but not nfv, afaik with a simple deployment its working good05:34
Tenguok05:37
Tengufor now, it seems to work as expected.05:37
TenguI see changes in the original configurations of the undercloud, and it sounds pretty good :).05:38
*** iranzo has joined #tripleo05:51
*** iranzo has joined #tripleo05:51
jaosoriorAnybody that could review these two https://review.openstack.org/#/c/496349/ https://review.openstack.org/#/c/496351/  ?05:55
*** mdnadeem has joined #tripleo06:00
*** ratailor has joined #tripleo06:01
Tenguuho. I love that log entry: 2017-08-24 08:01:22,998 INFO: Notice: Applied catalog in 1512.91 seconds06:02
*** _jbadiapa has quit IRC06:03
lvdombrkrmorning guys, i deploy overcloud but there is no overcloudrc anywhere?06:04
lvdombrkrany sugestions?06:04
matbulvdombrkr: the deployment succeed ?06:04
openstackgerritMerged openstack/tripleo-quickstart master: Enable opstools-testing repo  https://review.openstack.org/49692306:05
lvdombrkrmatbu: i think that yes: http://paste.openstack.org/raw/619263/06:06
Tenguduh… crash. undercloud upgrade just failed -.-06:08
Tengu… as expected: at the end. Dunno why, I was pretty sure -.-06:08
*** dparkes has joined #tripleo06:10
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169926106:10
openstackLaunchpad bug 1699261 in tripleo "neutron-ovs-agent container constantly restarting with default configuration" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295506:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243606:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262106:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]06:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]06:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged]06:10
lvdombrkrmatbu: any ideas?06:11
*** rcernin has joined #tripleo06:12
jaosoriorlvdombrkr: did you interrupt the process after that message? that only means that the heat stack completed, but the RC file is created after that.06:14
lvdombrkrjaosorior: i didnt interrupt06:14
lvdombrkrjaosorior: i need to delete and re-create onvercloud it means?06:15
jaosoriorlvdombrkr: that would be one solution. The other one is trying to run the mistral workflow that generates the rc file06:17
jaosoriord0ugal: do you know how to do that? ^^06:17
*** dsariel has quit IRC06:17
lvdombrkrjaosorior: how can i be sure that deployment was seccesfully?06:18
*** pcaruana has joined #tripleo06:21
jaosoriorlvdombrkr: openstack stack list06:22
jaosoriorit should show if it was successful or not06:22
lvdombrkrjaosorior: CREATE COMPLETE06:22
openstackgerritIan Wienand proposed openstack/diskimage-builder master: LVM support for dib-block-device  https://review.openstack.org/47206506:23
lvdombrkrjaosorior: thanks. how than i can create RC file?06:23
jaosoriorlvdombrkr: I just asked d0ugal. I don't really know how to do it manually.06:26
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add /bin to PATH for CRL cronjob  https://review.openstack.org/49710006:27
lvdombrkrjaosorior: thanks. i have second issue that when i try get into undercloud dashboard i get error: Connection to Keystone is not available , maybe some quick ideas?06:28
openstackgerritMatthias Runge proposed openstack/tripleo-quickstart master: Revert "Enable opstools-testing repo"  https://review.openstack.org/49710206:29
jaosoriorlvdombrkr: where do you get that error?06:29
lvdombrkrjaosorior: when enter user and password in undercloud UI06:30
jaosoriorflorianf: any ideas? ^^06:31
*** jtomasek has joined #tripleo06:33
jaosoriorjtomasek: you were working on the UI, right?06:33
jtomasekjaosorior: hi, yes06:34
jaosoriorjtomasek: lvdombrkr is having an issue where, when he logs into the undercloud's dashboard, he gets the error: Connection to Keystone is not available06:34
jaosoriorany idea what that might be?06:34
jtomasekjaosorior: so in general, the GUI runs in browser and connects to undercloud service apis directly from the machine running the browser, so the public undercloud endpoints need to be accessible from that machine06:36
Tenguhmm. I have a weird situation in my undercloud: apparently, a colleague made a new overcloud plan, but I'm unable to see it in both triplO-ui and `openstack overcloud plan list`… But it's present somewhere, and makes the upgrade to pike crash, because, although it's listed somewhere, we can't find it.06:36
*** jprovazn has joined #tripleo06:36
jaosoriorlvdombrkr: ^^06:37
*** fpan has quit IRC06:37
jtomaseklvdombrkr: can you please check browser dev tools to see what address is the GUI trying to connect to?06:38
jtomasekand compare it to openstack endpoint list --interface=public06:38
jtomaseklvdombrkr: then also check sudo cat /var/www/openstack-tripleo-ui/dist/tripleo_ui_config.js06:40
jtomaseklvdombrkr: that's where the GUI is taking the endpoint addresses from06:41
*** masco has joined #tripleo06:41
jtomasekTengu: check 'openstack container list'06:44
jtomasekTengu: that is where the plan is stored (in swift), but it is quite weird that you can't list the plans, did you try to remove it at some point?06:45
lvdombrkrjtomasek: its trying connect 192.168.24.206:52
Tenguoh.06:53
jtomaseklvdombrkr: what kind of setup do you have? rdo cloud?06:54
Tengujtomasek: I see the container. May I drop it? maybe the plan was deleted, but not its container, for some reason?06:54
jtomaseklvdombrkr: you'll need to tunnel from publicly accessible IP the undercloud has (if so) to that 192.168.24.2 to make it work06:55
jtomasekTengu: most likely yes06:55
*** oidgar has joined #tripleo06:55
Tenguok. so I drop it, and re-try the deploy.06:55
jtomasekTengu: yes06:56
lvdombrkrjtomasek: i done this already, without this i cant reach UI at all...06:56
Tenguo_O06:56
TenguConflict (HTTP 409) (Request-ID: txfa8fe0ac94694e26863ed-00599e788b) errr06:56
jtomaseklvdombrkr: ok, so now you just need to change it in /var/www/openstack-tripleo-ui/dist/tripleo_ui_config.js06:57
lvdombrkrjtomasek: change what?06:58
jtomaseklvdombrkr: one sec06:59
*** jpich has joined #tripleo06:59
Tenguah, openstack container delete -r <name>. better.07:01
Tenguthanks jtomasek !07:01
*** bogdando has joined #tripleo07:01
jtomasekTengu: np, hope it helps07:01
Tengusame here :)07:01
jtomaseklvdombrkr: in your undercloud /var/www/openstack-tripleo-ui/dist/tripleo_ui_config.js07:02
jtomaseklvdombrkr: are the addresses for keystone and other services using https or http?07:02
lvdombrkrjtomasek: https07:02
*** ebarrera has joined #tripleo07:03
jtomaseklvdombrkr: can you please paste the contents of that file?07:03
*** aufi has joined #tripleo07:03
lvdombrkrjtomasek: http://paste.openstack.org/raw/619268/07:04
*** florianf_ has joined #tripleo07:04
*** florianf has quit IRC07:05
jtomaseklvdombrkr: change 192.168.24.2 to <THE PUBLIC IP YOURE TUNNELING FROM> everywhere07:05
jtomasekso the GUI is going to be connecting to that ip rather than 192... which is not accessible from outside07:05
*** florianf_ has quit IRC07:05
*** florianf has joined #tripleo07:06
lvdombrkrjtomasek: perfect, thank you!!!07:08
jtomaseklvdombrkr: cool, glad it worked!07:08
lvdombrkrjtomasek: i can create same way tunnel to overcloud dashboard?07:09
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169926107:10
openstackLaunchpad bug 1699261 in tripleo "neutron-ovs-agent container constantly restarting with default configuration" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295507:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243607:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262107:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]07:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]07:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged]07:10
*** cschwede_ has joined #tripleo07:11
jpichjtomasek: Would you happen to know when tripleo-ui is planning to release a RC / create a stable/pike branch?07:13
jtomaseklvdombrkr: I think so, it depends on how you configure the overcloud deployment. The overcloud dashboard (Horizon) is going to run on controller machine - one level deeper so you may need to do 2 tunnels. I've not tried to do that.07:13
openstackgerritAdriano Petrich proposed openstack/instack-undercloud master: Add an hourly cron trigger for tripleo-ui logging  https://review.openstack.org/46960807:14
jtomasekjpich: not sure, I think we'll do it together with other tripleo parts according to schedule07:15
*** jlinkes has joined #tripleo07:15
* jtomasek looks for the schedule07:15
jpichjtomasek: Oh, I see, my bad! I was looking at the client but these get branched earlier, none of the other tripleo deliverables have branched either07:16
jpichThanks!07:16
jtomasekjpich: I think it is after all RCs are out07:16
lvdombrkrjtomasek: Overcloud IP address: 192.168.24.7 , i cant just create tunnel to this ip, i hope07:16
jpichjtomasek: I would have thought it was from the first RC... but ah, well. It's causing a bit of confusion for translators (since branching is reflected in Zanata) but hopefully that'll be sorted with better communication. Thanks for the explanation! :)07:18
*** limao has quit IRC07:18
*** tesseract has joined #tripleo07:20
jtomasekjpich: 'After RC1 is tagged, a stable/$series branch is cut from that same commit.' https://docs.openstack.org/project-team-guide/release-management.html#common-cycle-with-development-milestones07:22
jpichjtomasek: Thanks!07:22
jtomasekjpich: I think it may be wise to do it a bit later though as UI is sort of at the end of chain and we could avoid backporting bugs07:23
jpichjtomasek: Yeah, backporting everything is a pain. Release is in a couple of weeks though so hopefully we'll be stabilised enough shortly!!!07:24
jtomasekright07:24
jpichit could happen07:25
jpichI'll try to follow more closely from now on, thank you for getting me up to date!07:25
*** suuuper has joined #tripleo07:27
jtomasekjpich: Emilien's latest email says 'We'll tag TripleO Pike RC1 on R+O during the week of Aug 28 - Sep 01'07:27
*** cylopez has joined #tripleo07:27
jpichjtomasek: Perfect07:27
jpichjtomasek: Sorry for all the email archaeology work, thank you for the super thorough answer :-)07:27
oidgarhi guys, I"m deploying overcloud with containers and for some reason most of my containers are in unhealthy status (see it by running docker ps)07:29
oidgarfor example: dc540cd45ec3        tripleoupstream/centos-binary-glance-api:latest                  "kolla_start"            15 hours ago        Up 15 hours (unhealthy)                       glance_api07:30
oidgardid someone else encountered this problem also?07:30
jtomasekjpich: np! It was great to clarify that for myself too haha07:32
jpichheh!07:33
*** jpena|off is now known as jpena07:36
mandreoidgar: hey! this status is reported by the healthchecks, https://github.com/openstack/tripleo-common/tree/master/healthcheck07:36
mandreoidgar: I've built new images the other day that contains the healthchecks,that's probably why you're starting seeing the healthy/unhealthy status now07:37
*** limao has joined #tripleo07:37
oidgarmandre: so should I be worry about this unhealthy condition or can I ignore it for now?07:39
mandreoidgar: I haven't yet looked at why some of the containers report unhealthy, maybe larsks and mmagr can help07:39
*** fzdarsky_ is now known as fzdarsky07:39
mandreoidgar: you don't have to worry for now, we first need to confirm it's not a false positive07:39
oidgarmandre: great thanks!07:39
*** gkadam_ has joined #tripleo07:40
*** gkadam has quit IRC07:42
*** gkadam_ has quit IRC07:45
*** dtantsur|afk is now known as dtantsur07:46
*** _jbadiapa has joined #tripleo07:47
Tengu\o/ Undercloud upgrade complete.  thanks jtomasek !07:48
jtomasekTengu: great!07:48
Tengunow my playbook is getting the new overcloud images, and will replace the existing one hopefully.07:49
*** tesseract-RH has joined #tripleo07:49
*** tesseract-RH has quit IRC07:50
*** tesseract-RH has joined #tripleo07:50
*** agurenko has joined #tripleo07:51
*** anshul has joined #tripleo07:52
*** tesseract has quit IRC07:52
*** paramite has joined #tripleo07:55
*** egonzalez has joined #tripleo07:56
*** tesseract-RH has quit IRC08:01
bandinijaosorior: https://review.openstack.org/#/c/496807/ is you have two mins (it's what we discussed the other day)08:01
*** ykarel is now known as ykarel|lunch08:01
bandinione-liner ;)08:01
*** tesseract-RH has joined #tripleo08:02
*** dmacpher has quit IRC08:03
openstackgerritMartin André proposed openstack/puppet-tripleo master: [WIP] Use TLS proxy for Redis' internal TLS  https://review.openstack.org/49661608:05
*** paramite has quit IRC08:06
*** funzo has joined #tripleo08:07
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: [WIP] TLS proxy for redis  https://review.openstack.org/49652008:07
*** skramaja has quit IRC08:08
openstackgerritMartin Kopec proposed openstack/tripleo-quickstart-extras master: Allow removing of options from tempest conf  https://review.openstack.org/47707908:09
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169926108:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295508:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243608:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262108:10
openstackLaunchpad bug 1699261 in tripleo "neutron-ovs-agent container constantly restarting with default configuration" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)08:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]08:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]08:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged]08:10
*** funzo has quit IRC08:11
*** pdeore has joined #tripleo08:17
*** gfidente has joined #tripleo08:21
*** ffiore has joined #tripleo08:21
*** bkopilov has joined #tripleo08:22
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Containarise Barbican API  https://review.openstack.org/48145108:27
*** limao has quit IRC08:27
*** fzdarsky has quit IRC08:29
*** jprovazn has quit IRC08:31
*** limao has joined #tripleo08:31
openstackgerritOr Idgar proposed openstack/tripleo-heat-templates master: Reverting generate MySQL client config for Octavia  https://review.openstack.org/49713808:35
lvdombrkrguys, who can help with tunnel creating to overcloud dashboard?08:35
lvdombrkri have tunnel to undercloud UI its works well08:36
*** spredzy has quit IRC08:36
*** psachin has joined #tripleo08:37
matbufolks, easy review for a +A https://review.openstack.org/496397 thx08:38
lvdombrkr?08:39
*** lucas-afk is now known as lucasagomes08:41
*** pblaho has joined #tripleo08:42
jaosoriorbandini: can you check this out? https://review.openstack.org/497100 finally found the issue :D08:43
*** pdeore has quit IRC08:43
bandinion it ;)08:44
matbujaosorior: gracias08:45
numansbandini, hi, can you please have a look at this patch - https://review.openstack.org/#/c/484373/08:47
*** paramite has joined #tripleo08:48
bandininumans: on it08:48
*** pblaho has quit IRC08:49
*** social has joined #tripleo08:51
*** fzdarsky has joined #tripleo08:55
*** mcornea has joined #tripleo08:55
*** pblaho has joined #tripleo08:56
*** cylopez has quit IRC08:57
Tenguwow. Apparently, the upgrade process for the overcloud seems to be working well. That means I'll be able to get a Pike on my lab :).08:58
*** cylopez has joined #tripleo09:01
*** ykarel|lunch is now known as ykarel09:02
*** cshastri has quit IRC09:06
lvdombrkrguys, who can help with tunnel creating to overcloud dashboard?09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169926109:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295509:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243609:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262109:10
openstackLaunchpad bug 1699261 in tripleo "neutron-ovs-agent container constantly restarting with default configuration" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)09:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]09:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]09:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged]09:10
numansbandini, thanks for the review09:12
*** ebarrera has quit IRC09:14
*** ebarrera has joined #tripleo09:14
*** tosky has joined #tripleo09:15
*** jprovazn has joined #tripleo09:15
bandininumans: np ;)09:16
*** spredzy has joined #tripleo09:16
bandininumans: the host attribute is still ongoing as you saw from the mails, I'll keep you posted in any case09:16
numansbandini, yes I saw the email. thanks09:17
*** _jbadiapa has quit IRC09:18
openstackgerritMerged openstack/diskimage-builder master: LVM support for dib-block-device  https://review.openstack.org/47206509:18
*** tesseract-RH has quit IRC09:18
*** tesseract has joined #tripleo09:23
*** limao has quit IRC09:27
*** psachin has quit IRC09:31
*** sri_ has joined #tripleo09:37
*** athomas has joined #tripleo09:42
*** jbadiapa has joined #tripleo09:42
*** iranzo has quit IRC09:44
*** iranzo1 has joined #tripleo09:44
*** iranzo1 has quit IRC09:47
*** jchhatbar has joined #tripleo09:48
*** iranzo has joined #tripleo09:49
*** iranzo has joined #tripleo09:49
*** janki has quit IRC09:51
*** ffiore has quit IRC09:53
*** ffiore has joined #tripleo09:58
*** jchhatbar_ has joined #tripleo10:01
*** suuuper has quit IRC10:04
*** jchhatbar has quit IRC10:04
openstackgerritMartin Kopec proposed openstack/tripleo-quickstart-extras master: Allow removing of options from tempest conf  https://review.openstack.org/47707910:04
*** zoli is now known as zoli|lunch10:05
*** janki has joined #tripleo10:05
*** zoli|lunch is now known as zoli10:05
*** jchhatbar_ has quit IRC10:07
*** funzo has joined #tripleo10:07
*** achadha has joined #tripleo10:08
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140310:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295510:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243610:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262110:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)10:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]10:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]10:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged]10:10
*** funzo has quit IRC10:12
*** achadha has quit IRC10:12
*** dtantsur is now known as dtantsur|brb10:14
mrungehas anyone seen quickstart failing recently with "Failed to parse dlrn hash" ?10:16
*** rbowen has joined #tripleo10:24
openstackgerritAttila Darazs proposed openstack-infra/tripleo-ci master: Fix the DLRN API URL for non-master branches  https://review.openstack.org/49718410:25
*** egonzalez has quit IRC10:30
*** jkilpatr has quit IRC10:39
*** ykarel is now known as ykarel|away10:39
*** pkovar has joined #tripleo10:40
openstackgerritMerged openstack/tripleo-heat-templates master: Specify the start count to 0 for the update step loop  https://review.openstack.org/49639710:42
*** fzdarsky is now known as fzdarsky|lunch10:46
yolandahi, i'm trying to rebuild an image on newton, with overcloud image build . I added a new element on tripleo-common, in the yaml file, but doesn't seem to be picked. Do i need to change something else?10:49
*** mdnadeem has quit IRC10:49
*** fzdarsky|lunch has quit IRC10:50
*** egonzalez has joined #tripleo10:51
openstackgerritMerged openstack/puppet-tripleo master: Add OVN DBs bundle support for pacemaker HA  https://review.openstack.org/48437310:51
*** dixiaoli has quit IRC10:51
*** fzdarsky|lunch has joined #tripleo10:54
mrungecan someone please mark the bug https://bugs.launchpad.net/tripleo/+bug/1712785 with prio "high" or so, it completely blocks the deployment in devmode10:55
openstackLaunchpad bug 1712785 in tripleo "tripleo quickstart fails with "Failed to parse dlrn hash"" [Undecided,Confirmed]10:55
mrungeI can not do that10:55
*** shreshtha has quit IRC10:58
*** fzdarsky|lunch has quit IRC10:59
jaosoriorsshnaidm, adarazs: could you check this out https://review.openstack.org/#/c/496639/ ?11:03
adarazsjaosorior: looking11:03
*** udesale has quit IRC11:04
*** jpena is now known as jpena|lunch11:05
*** egonzalez has quit IRC11:07
adarazsjaosorior: you have failing gates with relevant looking errors. I left a comment.11:07
*** mdnadeem has joined #tripleo11:07
*** pdeore has joined #tripleo11:08
*** pdeore has quit IRC11:08
*** thrash|g0ne is now known as thrash11:08
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140311:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295511:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243611:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262111:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]11:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]11:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge)11:10
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-quickstart-extras master: Make overcloud trust the undercloud's CA certificate  https://review.openstack.org/49663911:11
jaosorioradarazs: oh, thanks! got it11:11
*** jkilpatr has joined #tripleo11:13
mrungemwhahaha: trown|outtypewww unfortunately, https://review.openstack.org/#/c/496085/ causes this https://bugs.launchpad.net/tripleo/+bug/171278511:13
openstackLaunchpad bug 1712785 in tripleo "tripleo quickstart fails with "Failed to parse dlrn hash"" [Undecided,Confirmed]11:13
jankimandre, hey11:13
mrungecan any of you mark the triage the bug further, shall I submit a revert?11:13
*** ratailor has quit IRC11:14
*** cylopez has quit IRC11:15
*** ffiore has quit IRC11:15
*** egonzalez has joined #tripleo11:18
pabelangermrunge: it is failing to curl https://trunk.rdoproject.org/centos7/current/delorean.repo11:23
pabelangerwhich means you have a networking issue11:23
pabelangermrunge: so we need to figure out why11:24
*** shashi_ has joined #tripleo11:27
shashi_Hi All11:27
shashi_Facing the issue while trying to deploy overcloud11:28
shashi_Can anyone suggest for below issue11:29
shashi_2017-08-24 10:51:07Z [overcloud.Controller.0.UpdateDeployment]: CREATE_FAILED  TypeError: resources.UpdateDeployment: create() takes at least 4 arguments (4 given) 2017-08-24 10:51:07Z [overcloud.Controller.0.ExternalPort]: CREATE_FAILED  CREATE aborted 2017-08-24 10:51:08Z [overcloud.Controller.0.StoragePort]: CREATE_FAILED  CREATE aborted 2017-08-24 10:51:08Z [overcloud.Controller.0]: CREATE_FAILED  Resource CREATE failed: TypeError:11:29
shashi_2017-08-24 10:51:09Z [overcloud.Controller.0]: CREATE_FAILED  TypeError: resources[0].resources.UpdateDeployment: create() takes at least 4 arguments (4 given)11:30
*** dpawar has quit IRC11:30
*** dpawar has joined #tripleo11:30
*** numans has quit IRC11:35
openstackgerritOpenStack Proposal Bot proposed openstack/diskimage-builder master: Updated from global requirements  https://review.openstack.org/49480011:37
mrungepabelanger: I'm not the only one...11:38
openstackgerritOpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements  https://review.openstack.org/49276811:38
pabelangermrunge: okay, so we need to spend a few minutes debugging before a revert. Are people seeing it in the gate or just local environments11:39
*** numans has joined #tripleo11:39
mrungepabelanger: I'm seeing this on local openstack deploys and on rdo cloud11:39
*** numans has quit IRC11:41
*** ykarel|away is now known as ykarel11:41
rookwhen haproxy is in a container and i enable the option httplog, where do these messages go?11:41
rookthey used to hit /var/log/messages11:41
rookbut they don't now.11:42
pabelangermrunge: so, we'll need more information about why you cannot curl http://doproject.org11:42
*** numans has joined #tripleo11:42
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Containarise Barbican API  https://review.openstack.org/48145111:42
jprovazngfidente: hi11:44
gfidentejprovazn hey11:44
pabelangermrunge: are you able to do a test?11:45
*** morazi has joined #tripleo11:45
pabelangermrunge: change http to https for rdoproject.org URL in NODEPOOL_RDO_PROXY11:46
jprovazngfidente: I can't manage to deploy with ceph-ansible, my deployments are failing on overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution, though there are no failed workflow/task executions, but in mistral executor log I found errors like this: http://paste.openstack.org/show/619303/11:46
jprovazngfidente: have you hit something like this?11:46
gfidentejprovazn is ceph-ansible installed in the undercloud?11:47
* jprovazn checks11:47
jprovazngfidente: no :(, out of curiosity, based on what message in the log did you figure out it's missing ceph-ansible? or am I blind?11:49
gfidentejprovazn so why wasn't it installed though, I think we added that code in oooq a while back11:49
gfidentejprovazn anyway this line ERROR! playbooks must be a list of plays11:50
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/48739811:50
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/48814811:50
gfidentejprovazn how did you install the undercloud btw?11:50
jprovazngfidente: I guess ceph-ansible rpm is missing because I use custom oooq config file (not the default one) which creates more nodes11:51
gfidentejprovazn fwiw this is the custom config I use http://ix.io/znD11:52
gfidenteit did get ceph-ansible installed for me11:52
openstackgerritOr Idgar proposed openstack/tripleo-common master: WIP Add Octavia post deployment steps to tripleo workflows  https://review.openstack.org/48745011:53
openstackgerritPaul Belanger proposed openstack/tripleo-quickstart master: Use https for NODEPOOL_RDO_PROXY outside of gate  https://review.openstack.org/49721511:54
jprovazngfidente: weird, now I checkd mine and I don't overried there "undercloud_rpm_dependencies" so I would expect that if I use "-R master-tripleo-ci" with oooq, it should install this package for me too :/11:54
pabelangermrunge: ^can you try11:54
gfidenteyeah11:54
pabelangermrunge: I am guessing the 302 redirect to https is breaking you11:55
jprovazngfidente: my guess would be that because there are multiple packages:11:55
jprovaznundercloud_rpm_dependencies: >-11:55
jprovazn  python-tripleoclient11:55
jprovazn  ceph-ansible11:55
jprovaznand "ceph-ansible" rpm can't be found for me on UC11:55
jprovaznthen yum install silently passed even if one of pkgs was not found11:56
gfidenteso that is something oooq should do as well11:56
gfidenteyou should have the ceph/jewel repos installed11:56
*** bfournie has quit IRC11:56
*** bfournie has joined #tripleo11:56
gfidentehttps://review.openstack.org/#/c/478980/11:56
*** adarazs is now known as adarazs_brb11:57
*** shashi_ has quit IRC11:58
jprovazngfidente: hmmm, I suspect it's because I deployed with "--release master-tripleo-ci" but your patch adds it to tripleo-ci/master11:59
*** bfournie has quit IRC12:00
openstackgerritGiulio Fidente proposed openstack/tripleo-quickstart master: Keep CentOS Ceph repos to be able to install ceph-ansible  https://review.openstack.org/49721812:01
gfidentejprovazn shouldn't that be a link?12:01
*** trown|outtypewww is now known as trown12:01
*** jpena|lunch is now known as jpena12:02
gfidentewes https://review.openstack.org/#/c/497218/12:02
jprovazngfidente: in my case (quite fresh oooq) it's not a link12:02
gfidentejprovazn ah interesting12:03
gfidenteis see it as a symline12:03
gfidentejprovazn it is a symlink in git12:04
*** funzo has joined #tripleo12:05
weshaypabelanger, hrm.. https://review.openstack.org/#/c/496862/ didn't do the trick12:05
*** mdnadeem has quit IRC12:05
jprovazngfidente: interesting12:06
pabelangerweshay: it did, puppet is not running atm12:06
pabelangerweshay: so project-config changes aren't getting applied12:06
weshayoh12:06
pabelangerweshay: hopefully gets fixed in the next hour or so12:06
weshayk12:06
openstackgerritMerged openstack/tripleo-quickstart-extras master: Containerized deployment with pacemaker via OOOQ  https://review.openstack.org/49585012:06
weshaythanks12:06
*** fzdarsky has joined #tripleo12:06
*** fzdarsky has quit IRC12:06
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix unbound variable DELOREAN_LINK  https://review.openstack.org/49722112:07
sshnaidmtrown, adarazs_brb please take a look ^^12:07
sshnaidmtrown, also the question - where do you define DELOREAN_LINK at all? I didn't find it.12:08
sshnaidmtrown, not sure how the rdocloud stuff will work..12:09
*** fzdarsky has joined #tripleo12:09
*** cylopez has joined #tripleo12:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140312:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295512:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243612:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262112:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)12:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]12:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]12:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge)12:10
*** funzo has quit IRC12:10
trownsshnaidm: in the builder https://github.com/rdo-infra/review.rdoproject.org-config/blob/5b7c820b180d0a91596f956b91c75803a9ea225e/jobs/tripleo-upstream.yml#L11212:11
sshnaidmtrown, oh.. another place to search :)12:13
*** ffiore has joined #tripleo12:13
*** sbrzozow has joined #tripleo12:14
Tenguheya! while updating an overcloud to pike, it almost succeeded. I got a Stack overcloud UPDATE_COMPLETE, but right after that: Internal Server Error (HTTP 500). Apparently, there's a service that's not properly configured. Anyone got that lately?12:14
lvdombrkrguys how i can add external network to my overcloud?12:15
mandrejanki: hi! how is the containerized barbican-api service looking?12:15
jankimandre, well its coming up. thanks to you for reviews :)12:15
*** adarazs_brb is now known as adarazs12:16
*** dprince has joined #tripleo12:16
mandrejanki: hey no problemo, let me know if you need reviews... ping me when the CI comes back on your change12:16
adarazssshnaidm: +212:17
jankimandre, will do.12:17
*** cdearborn has joined #tripleo12:18
paramiteflaper87, mandre: Hey, just FYI ... not sure if I'm being obvious here, but after several "docker exec -it .. /bin/bash"  I'm probably hitting https://github.com/moby/moby/issues/24974 on current master ... eg. 'exit' hangs and you cannot do anything about it ... not sure if you guys hit that too12:20
fultonjramishra gfidente: is it possible to get https://bugs.launchpad.net/heat/+bug/1709682 in for pike ?12:22
openstackLaunchpad bug 1709682 in OpenStack Heat "Configuration Updates which used ceph-ansible workflow fail" [High,In progress] - Assigned to Rabi Mishra (rabi)12:22
mandreparamite: haven't seen it myself12:22
gfidentefultonj ramishra yeah we should, I haven't tested it myself and the change while small is pretty deep :D12:23
gfidentefultonj ramishra so I didn't vote on it12:23
ramishrafultonj: yes, we can once it lands on master12:23
fultonjthanks ramishra12:23
gfidentefultonj you tested it?12:23
gfidenteI think we should somehow break the first run and then try an update12:23
fultonjgfidente: no, but i'll test it now12:23
gfidentefultonj cool12:23
gfidente++12:24
jaosoriorgfidente: hey, could you check this out https://review.openstack.org/#/c/497100/ ?12:24
gfidente:D12:24
*** mdnadeem has joined #tripleo12:25
jaosoriorthanks! :D12:25
pabelangertrown: mwhahaha: weshay: mrunge: I have to step away for 2 hrs, but believe https://review.openstack.org/497215/ will fix downstream users of tripleo. I think the 302 redirect is breaking people, if somebody can confirm and merge, that would be great12:25
jaosoriorgfidente: would really appreciate a review for this one as well https://review.openstack.org/#/c/496349/12:25
*** ansmith has joined #tripleo12:25
weshaythanks pabelanger12:26
*** tzumainn has joined #tripleo12:26
openstackgerritAlex Schultz proposed openstack/instack-undercloud master: Test image builds with I54ea687ee9165baec1ef1b5c27e40c233683d108  https://review.openstack.org/49697412:27
gfidentejaosorior I know I know it's in the comments but ...12:28
gfidente... can we fix that and w+1 ?12:28
*** rlandy has joined #tripleo12:28
trownpabelanger: yep my test has gotten past repo setup12:28
jaosoriorgfidente: haha, mind if I do it in a separate commit?12:29
*** bfournie has joined #tripleo12:29
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: TLS-everywhere/libvirt: Make postsave command configurable  https://review.openstack.org/49634912:30
trownsshnaidm: adarazs could one of you merge https://review.openstack.org/49721512:30
gfidentejaosorior++ tks12:31
*** psahoo has quit IRC12:31
*** sri_ has quit IRC12:32
*** jlabarre has joined #tripleo12:32
adarazstrown, sshnaidm: done.12:32
lvdombrkrguys i want to add external network to my overcloud, so i have question why physyical network name in example is datacenter? openstack network create public --external --provider-network-type vlan \12:36
lvdombrkr--provider-physical-network datacentre12:36
*** artom has joined #tripleo12:38
*** brandor5 has joined #tripleo12:39
brandor5Hello everyone: I was curious if anyone has installed designate with tripleo in an HA setup?12:40
*** masco has quit IRC12:43
*** jcoufal has joined #tripleo12:46
*** atoth has joined #tripleo12:47
openstackgerritBob Fournier proposed openstack/tripleo-heat-templates master: Handle failure of carrier check in configure_safe_defaults()  https://review.openstack.org/49723212:47
openstackgerritLukas Bezdicka proposed openstack/python-tripleoclient master: Add minor-update-init option to get heat stack outputs  https://review.openstack.org/49565812:48
*** ecerquei has joined #tripleo12:48
openstackgerritMerged openstack/tripleo-common master: Make Ansible env variables configurable  https://review.openstack.org/49590012:50
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy OpenShift using OOO on the overcloud  https://review.openstack.org/49447012:50
*** abishop has joined #tripleo12:51
*** garyk has quit IRC12:52
*** oidgar has quit IRC12:52
fultonjgfidente: it looks to me like https://review.openstack.org/#/c/497218/1/config/release/tripleo-ci/pike.yml will conflict with https://review.openstack.org/#/c/494056/1/config/release/tripleo-ci/pike.yml12:55
*** udesale has joined #tripleo12:55
fultonjbecause we'll end up with two repos supplying the same package, which will recreate https://bugs.launchpad.net/tripleo/+bug/171100612:55
openstackLaunchpad bug 1711006 in tripleo "tripleo-quickstart creating redundant repositories" [High,Fix released] - Assigned to John Fulton (jfulton-org)12:55
gfidentefultonj so we had that change in master-tripleo-ci12:56
gfidentesee I am pointing to that from the commit message12:56
gfidentethe additional repos for the local mirrors should not conflict given your patch no?12:57
fultonjthat's a different change12:57
fultonjbut yes, they won't conflict as they have diff names12:57
fultonjso it won't create bug 171100612:57
openstackbug 1711006 in tripleo "tripleo-quickstart creating redundant repositories" [High,Fix released] https://launchpad.net/bugs/1711006 - Assigned to John Fulton (jfulton-org)12:57
gfidentefultonj yeah or remove the standard repos from master.yaml as well12:58
fultonjhowever, the change in https://review.openstack.org/#/c/494056 allowed ceph-ansible to be installed12:58
fultonjso why keep the original repos in order to install it? did something break?12:58
gfidentewe used to keep the original .repo files for master.yaml https://review.openstack.org/#/c/478980/12:59
*** pchavva has joined #tripleo12:59
gfidenteand https://review.openstack.org/#/c/497218/1/config/release/tripleo-ci/pike.yml matches what we used to do for the master branch12:59
gfidentenow if we want to use the local repos only, that is also okay I think but then we need to remove the original repos from master.yml as well13:00
mwhahahajust fyi those don't matter because we disable those now13:00
*** Goneri has joined #tripleo13:00
fultonjlooks familiar, but were'nt those repos removed so that we could use the mirrors instead?13:00
fultonjas per https://bugs.launchpad.net/tripleo/+bug/1709327 ?13:00
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Fix released]13:00
*** dtantsur|brb is now known as dtantsur13:00
gfidenteI am not sure if that is the reason, https://review.openstack.org/#/c/478980/ is much older then the bug and the change for the mirrors13:01
*** catintheroof has joined #tripleo13:02
*** dparkes has quit IRC13:02
gfidentebut then again, if we want to remove the original repos I am fine with it, but let's remove them from master.yml as well13:02
gfidenteI am trying to make promotion/master/pike to do the same thing13:02
gfidentedon't have a strong opinion on if we should keep and disable or remove the original repos in favor of mirrors, as long as we do the same thing in the jobs13:03
gfidente(in the branches)13:03
fultonjhttps://review.openstack.org/#/c/492289/13:03
fultonj^ they are removed from master and others, right?13:04
fultonjbut i see that promotion doesn't so i understand the goal of the patch now (thanks)13:05
gfidenteI think they're disabled there not removed13:05
*** amoralej is now known as amoralej|lunch13:05
fultonjtrue13:06
fultonjdon't you think the mirror is better than the original ?13:06
fultonjand if so, should the promotion use the mirror too and not keep the original?13:07
gfidentethere was a problem with the promotion job a couple of days ago https://review.openstack.org/#/c/496822/13:07
gfidentefultonj yeah excatly, it should I suppose13:07
*** brandor5 has left #tripleo13:08
*** artom has quit IRC13:08
fultonjah, so line 80 had problems? https://review.openstack.org/#/c/496822/1/config/release/tripleo-ci/promotion-testing-hash-master.yml13:08
fultonjnow i get it13:08
*** pblaho has quit IRC13:08
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140313:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295513:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243613:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262113:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)13:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]13:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]13:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge)13:10
fultonjgfidente: i think i see the issue w/ promotion vs master: promotion is using the same repos name.13:15
fultonjhttps://review.openstack.org/#/c/496822/1/config/release/tripleo-ci/pike.yml vs https://review.openstack.org/#/c/496822/1/config/release/tripleo-ci/promotion-testing-hash-master.yml13:15
fultonj(view the whole file)13:15
fultonje.g. line 58 should be quickstart-centos-ceph-jewel not centos-ceph-jewel13:15
gfidentefultonj yeah same change you did already for the others13:16
*** dsariel has joined #tripleo13:16
fultonjif that were the case, then it would be ok to disable the original and disalbing it wouldn't take away the mirror and then the package would be installed13:16
fultonjgfidente: if we agree on this approach, then do you want me to make a follow up patch for what I missed? Or do you want to keep going with https://review.openstack.org/#/c/497218 ?13:19
gfidentefultonj you decide, push a new one or update 49721813:20
fultonjgfidente: ok, i'll update 49721813:20
fultonjgfidente: one less thing for you to worry about with all the other stuff going on13:20
*** pblaho has joined #tripleo13:21
*** pblaho has quit IRC13:22
*** pblaho has joined #tripleo13:22
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add manifests to install and configure stunnel  https://review.openstack.org/49724013:22
jaosoriormwhahaha: how does this look? I still need to use it somewhere and document it. But does the overall idea look alright? ^^13:22
*** toure_biab is now known as toure13:22
chandankumarsshnaidm: trown https://review.openstack.org/#/c/493030/13:23
chandankumarplease have a look13:24
*** udesale has quit IRC13:26
*** udesale has joined #tripleo13:26
*** udesale has quit IRC13:26
rooklarsks: in your logging work, did you happen to stumble where haproxy logs in a container?13:28
sshnaidmchandankumar, reviewed13:30
mwhahahajaosorior: i'll take a look in a bit13:30
mwhahahajaosorior: first glance it seems ok13:30
trozetmandre: can you please respond to https://review.openstack.org/#/c/494951/13:33
adarazsEmilienM, trown, sshnaidm, weshay, rlandy, arxcruz, mwhahaha: TripleO CI Squad meeting in an hour, add any agenda items you want to discuss here: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting13:34
sshnaidmpabelanger, ^^13:35
mandretrozet: yep exactly! this is that I had in mind13:36
mandretrozet: you may want to talk to stevebaker too since he's the one who did all the work on the prepare command13:37
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Switch to overcloudrc.v3 for running tempest  https://review.openstack.org/49303013:37
trozetmandre: ok cool.  janki can you propose a patch?13:37
openstackgerritMartin Kopec proposed openstack/tripleo-quickstart-extras master: Allow removing of options from tempest conf  https://review.openstack.org/47707913:37
*** dpawar has quit IRC13:37
chandankumarsshnaidm: mwhahaha https://review.openstack.org/#/c/493030/13:38
chandankumardone13:38
jankitrozet, will do.13:38
jankimandre, ^13:38
trozetjanki: include logic in the j2 as well for the NeutronServer image being overridden to the ODL one13:38
jankitrozet, mandre so we need to define docker images in ooo-common and services using these images13:39
mandrejanki, trozet: please sync up with numans since he has the same issue with ovs in https://review.openstack.org/#/c/468860/13:39
trozetjanki: need new cli option to the prep command to trigger rendering the J2 template with ODL options13:40
*** ffiore has quit IRC13:42
mandrejanki, trozet: on second though, this may not require another option. We may just make it so that when it detects ODL or OVN in the deployment it will pick up the right neutron images13:43
trozetmandre: how does it know in the overcloud prep command you want to include odl?13:43
*** amoralej|lunch is now known as amoralej13:43
*** leitan has joined #tripleo13:44
numansits tricky. Not sure how overcloud prep command would be smarted13:44
numanssmarter13:44
mandretrozet: you pass it environment files, that's how it's able to pull only the container images it needs13:44
mandresec13:44
trozetmandre: oh then that will work too13:44
jankimandre, trozet thats what "services" do, no?13:45
trozetjanki: must be13:45
jankitrozet, mandre numans take this line for instance https://github.com/openstack/tripleo-common/blob/master/container-images/overcloud_containers.yaml.j2#L10413:45
jankiif we have "OS::TripleO::Services::CinderBackup" enabled, its image will be available.13:45
*** links has quit IRC13:46
jankialso image is pulled only while deployment. what "prepare" command does is prepare a file assigning an value to "DockerCinderBackupImage"13:46
jankieven if we add odl images here, it will be like having varibales assigned value and used whenever the evn file is active13:47
mandrejanki, trozet, numans: my bad, the logic lives in python-tripleoclient, https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/container_image.py13:47
jankiI dont see any harm here except that there might a reference to odl docker image even if odl is not deployed. it wont have the image, it iwll just have the info from where to fetch that image13:48
jankitrozet, mandre numans i hope I am able to explain13:48
openstackgerritMartin Kopec proposed openstack/tripleo-quickstart-extras master: Allow removing of options from tempest conf  https://review.openstack.org/47707913:49
trozetjanki: yeah just go ahead with a patch and keep your other patch since we might end up deleting the neturon server image from there13:49
trozetjanki: or maybe even deleting that file i dont know yet13:50
jankitrozet, lets have that one now and see how this goes13:50
*** agurenko has quit IRC13:50
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add manifests to install and configure stunnel  https://review.openstack.org/49724013:51
mandrejanki, trozet, numans: so maybe make it a jinja2 conditional for the neutron image in overcloud_containers.yaml.j2 and pass it a variable when you render the template13:52
numansjanki, are you suggesting something like this - https://paste.fedoraproject.org/paste/ZUxdib7j8iJWETu5fwfEPw ?13:52
*** ffiore has joined #tripleo13:52
jankinumans, i am looking13:52
jankinumans, yes. plus DockerODLApiImage and dockerovnimage*13:53
*** dpawar has joined #tripleo13:53
numansmandre, trown  will that work ?  I will probably try it out13:54
numanstrown, sorry, i meant trozet13:54
janki"prepare" commands creates file having content "DockerODLImageApi = tripleoupstream/odl-image +other images"13:54
jankiso its like a file with values assigned to all variables. you use whichever variables you want. no claims13:55
jankis/claims/complains13:55
jankitrozet, mandre what do you say?13:56
rookok, i must be losing my mind... the container config files should be in /var/lib/config-data/, right?13:56
openstackgerritLee Yarwood proposed openstack/tripleo-specs master: WIP - Introduce skip level upgrades spec  https://review.openstack.org/49725713:57
trozetnumans, janki: it should work but lets see13:58
jankinumans, trozet let me give it a try and will get back to see how it works13:58
fultonjrook: which container are you missing configs for (ceph is the only one that differs AFAICT)13:58
*** dsariel has quit IRC13:59
rookfultonj: not missing, but i made a change to haproxy here : /var/lib/config-data/haproxy/etc/haproxy/haproxy.cfg13:59
rookI jump in the container fultonj and I don't see the changes in the config file there...13:59
rookfultonj: so I get the feeling that it isn't reading from the config-data.13:59
fultonjdid you restart the container?13:59
rookyup13:59
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260714:00
fultonjrook: there's a tool you can run to see how the container was started so you can check if it was mounted as you expect14:01
mandrejanki, trozet, numans: maybe we'll have to resort to something like http://paste.openstack.org/show/619323/14:01
fultonjrook: curl -o tool.py http://git.openstack.org/cgit/openstack/tripleo-heat-templates/plain/docker/docker-toool14:01
*** dpawar has quit IRC14:01
fultonjpython tool.py -c glance_api14:01
fultonj^ for example14:01
fultonjso you can at least see the 'docker run' to see the --volume matches14:02
jankimandre, this is exactly what I was saying except for the if-else. I think we can go without it14:02
*** dpawar has joined #tripleo14:02
mandrerook: you need to change /var/lib/config-data/puppet-generated/haproxy/etc/haproxy/haproxy.cfg14:03
openstackgerritFlavio Percoco proposed openstack/tripleo-common master: Encode stdout/stderr to generate readable logs  https://review.openstack.org/49739514:03
*** derekh has joined #tripleo14:04
mandrejanki: I'm not sure the prepare command can deal with a duplicate image name in params14:05
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud  https://review.openstack.org/47175914:05
numansmandre, this sounds cleaner14:05
jankimandre, ok. that can make sense for Nuetronserver images.14:07
*** dpawar has quit IRC14:07
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140314:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295514:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243614:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262114:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]14:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]14:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge)14:10
openstackgerritRajini Karthik proposed openstack/puppet-tripleo master: Support for Dell EMC VNX Manila Driver  https://review.openstack.org/49064214:10
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: testing ssl  https://review.openstack.org/49740514:10
openstackgerritJohn Fulton proposed openstack/tripleo-quickstart master: Rename CentOS mirror in promotion jobs  https://review.openstack.org/49721814:10
jprovaznjaosorior: gfidente: this is the issue jaosorior helped me yesterday https://bugs.launchpad.net/tripleo/+bug/171283614:12
openstackLaunchpad bug 1712836 in tripleo "overcloud deployment fails if tls is used with ceph-ansible" [Undecided,New]14:12
jprovazngfidente: I'm not sure how is it that ceph-ansible triggers this issue14:13
trozetmandre: can you explain what the services are for again?14:13
openstackgerritDerek Higgins proposed openstack/tripleo-common master: Add health check command for ironic-pxe image  https://review.openstack.org/49089214:14
mandretrozet: that's to know when to pull the images, based on the services that are enabled via your environment files14:14
jaosoriorjprovazn: here's a fix https://review.openstack.org/#/c/496639/14:14
trozetmandre: so if you already know that information, why do you need if statements?14:15
trozetmandre: per your example14:15
gfidentejprovazn jaosorior yeah I am not sure how ceph-ansible is related to that14:16
jprovaznjaosorior: cool, thanks14:16
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use TLS proxy for Redis' internal TLS  https://review.openstack.org/49661614:16
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add manifests to install and configure stunnel  https://review.openstack.org/49724014:16
gfidenteit really doesn't know anything about heat or even mistral14:16
jaosoriorgfidente: it wasn't a ceph-ansible issue.14:16
jaosoriorgfidente: but some hook, for some reason, calls an external endpoint in the undercloud, which is TLS enabled. And then it doesn't trust the cert. So with what I added there, it will trust it.14:16
mandretrozet: I think so, because otherwise the command will not know what value to set for let's say DockerNeutronApiImage14:16
jaosoriormandre: did some updates ^^14:17
trozetmandre: but the code knows if ODL or OVN is listed in services right14:17
trozetmandre: so you can just sub out the imagename14:17
trozetmandre: i guess im saying move the logic into code rather than do it in j214:18
mandretrozet: yeah, but the code really just renders a template14:18
openstackgerritJohn Fulton proposed openstack/tripleo-quickstart master: Rename CentOS mirror in promotion jobs  https://review.openstack.org/49721814:19
mandrejaosorior: ack, ready to try it out14:20
*** yprokule has quit IRC14:21
*** jprovazn has quit IRC14:22
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: [WIP] TLS proxy for redis  https://review.openstack.org/49652014:23
jaosoriormandre: updated that one too ^^14:23
jaosoriormandre: still need to test and add the haproxy configs14:23
jaosoriormandre: and we need to modify the services that access redis14:24
jaosoriormandre: this is the haproxy config that I got working http://paste.openstack.org/show/619328/14:24
*** jcoufal has quit IRC14:25
*** jcoufal has joined #tripleo14:26
mandrejaosorior: alright, it's deploying... you can follow the deployment in the tmate session we used earlier14:27
sshnaidmpabelanger, please join tripleo ci squad meeting, we gonna talk about ci infra and servers14:27
jaosoriormandre: I haven't had time to try it out :/14:28
jaosoriormandre: and I gotta go14:28
jaosoriorbut I'll continue this tomorrow14:28
jaosoriormandre: oh, I haven't changed the container to run stunnel instead of httpd14:28
jaosoriormandre: anyway, I gotta go, lets catch up tomorrow14:28
mandreokay, tty later14:29
*** ffiore has quit IRC14:31
*** ffiore has joined #tripleo14:32
adarazsweshay, EmilienM, rlandy: CI squad meeting.14:32
*** jcoufal has quit IRC14:33
*** artom has joined #tripleo14:33
*** jcoufal has joined #tripleo14:36
*** artom has quit IRC14:39
*** anshul has quit IRC14:45
rookmandre: any reason haproxy is different?14:45
rookmandre: other services don't seem to have that extra directory path14:46
mandrerook: they all do pick their configuration from the puppet-generated dir, with the exception of the init containers14:47
rookmandre: hm - ok. that seems different then what I have seen.14:48
mandrerook: the goal is to eventually get rid of the puppet-generated dir once I migrated the rest of the containers14:48
rookok14:48
openstackgerritRaoul Scarazzini proposed openstack/tripleo-quickstart-extras master: Display output from machine provisioning script  https://review.openstack.org/49302314:49
rookmandre: cool - thanks14:49
mandrerook: that was the commit that changed it for the long lived containers, https://github.com/openstack/tripleo-heat-templates/commit/cf18e865d14adc319b6c2dfafd650f32dad4d85314:49
*** limao has joined #tripleo14:50
*** limao has quit IRC14:55
pabelangersshnaidm: adarazs: where should I join?14:57
*** limao has joined #tripleo14:58
*** mdnadeem has quit IRC14:59
*** ykarel has quit IRC15:01
*** artom has joined #tripleo15:02
adarazspabelanger: https://redhat.bluejeans.com/4113567798/15:02
*** cylopez has quit IRC15:03
jankimandre, finally!!! Barbican Api passing all tests15:06
mandrejanki: awesome! I'll check your review a bit later15:08
jankimandre, ack. thanks :)15:09
*** jistr|trng is now known as jistr15:09
jankijaosorior, Hi. Can you please review https://review.openstack.org/#/c/481451/ - Barbican API one15:09
*** jlabarre has quit IRC15:10
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140315:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295515:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243615:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262115:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]15:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]15:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge)15:10
openstackgerritMerged openstack/tripleo-quickstart master: Add fset030 for OVN with containerized oc  https://review.openstack.org/49062415:12
*** jlabarre has joined #tripleo15:12
*** aufi has quit IRC15:14
gfidentejaosorior shall we close this then https://bugs.launchpad.net/tripleo/+bug/1712836 ?15:15
openstackLaunchpad bug 1712836 in tripleo "overcloud deployment fails if tls is used with ceph-ansible" [Undecided,New]15:15
lvdombrkrguys how can i ssh my overcloud node?15:23
mandrejanki: I see the barbican-api service show some logs but I can't find where it was exercised... do you know?15:24
jankimandre, which logs are you looking for? I didnt quite understand you question, sorry15:25
mandrejanki: here, http://logs.openstack.org/51/481451/25/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container/9164e22/logs/subnode-2/var/log/containers/barbican/main.log.txt.gz, we have some logs for the containerized barbican service but I do not see what makes call to it15:27
mandrejanki: what validates the barbican service in scenario 2?15:27
homeskiHey there. We're doing a overcloud deploy and a heat deployment is failing. Looking at the error we get: Host[storage_mgmt] Invalid IP Address ""15:28
homeskiwe noop'ed all the storage_mgmt settings using network-isolation.yaml15:28
homeskiare we missing a setting somewhere?15:28
jankimandre, these logs are native barbican logs. they should be defined in puppet somewhere.15:29
jankimandre, scenario2 is just a gate job which actually deploys overcloud based on services defined. what do you mean by what validates?15:30
jankimandre, ahh. I think I ma getting your question - you mean how are we testing if barbican is actually working properly or not15:31
mandrejanki: yeah, that :)15:31
rookmandre: any idea where haproxy container is logging?15:32
mandrerook: not sure, I think it logs to journald15:33
openstackgerritBogdan Dobrelya proposed openstack-infra/tripleo-ci master: Rework the getthelogs helper script for wget recursive  https://review.openstack.org/49217815:33
jankimandre, I guess we just have to try using it manually.15:34
*** achadha has joined #tripleo15:34
lvdombrkrguys how can i ssh my overcloud node?15:35
mandrerook: https://docs.docker.com/engine/admin/logging/journald/#retrieving-log-messages-with-journalctl15:35
mandrerook: I've seen jaosorior use a trick earlier today to have it spit logs to stdout, so you can also see them with "docker logs"15:36
*** cylopez has joined #tripleo15:36
mandrerook: he added a "debug" option in the config file and restarted the container IIRC15:36
homeski@lvdombrkr: from undercloud, use heat-admin user15:36
*** paramite has quit IRC15:36
homeskissh heat-admin@ip15:37
lvdombrkrhomeski: i get error:Permission denied (publickey,gssapi-keyex,gssapi-with-mic)15:38
lvdombrkrhomeski: sorry, not its okey15:39
lvdombrkrhomeski: thnaks!!!15:39
*** limao has quit IRC15:41
mwhahahaalright final call for any major blockers for tripleo rc115:43
mwhahahai need to update the release today so if there's anything that has to land before this let me know15:44
mwhahahaor i'm going to take current in a few hours15:44
*** garyk has joined #tripleo15:45
numansmwhahaha, it would be nice if this gets in https://review.openstack.org/#/c/468860 along with its dependent patches - https://review.openstack.org/#/c/496676/ and https://review.openstack.org/#/c/496675/15:46
numansmwhahaha, may be i am too ambitious here :)15:46
mwhahahanumans: k i'll take a look. we will most likely have an rc2 if it doesn't make it15:46
numansmwhahaha, thanks15:47
numansmwhahaha, FYI, the job - gate-tripleo-ci-centos-7-scenario007-multinode-oooq-container-nv has tested it (which is experimental for now)15:48
pabelanger404 on docker.io in gate: http://logs.openstack.org/02/497102/1/gate/gate-tripleo-ci-centos-7-containers-multinode/c6a6c8c/logs/undercloud/home/jenkins/overcloud_prep_containers.log.txt.gz15:49
*** jlinkes has quit IRC15:50
pabelangerwe actually shouldn't be getting that, so I think it is time we landed debug:true for docker/daemon.conf file15:50
pabelangerdaemon.json*15:50
*** iranzo has quit IRC15:51
*** itlinux has joined #tripleo15:52
openstackgerritMichele Baldessari proposed openstack/tripleo-common master: Add clustercheck healthcheck  https://review.openstack.org/49746815:53
*** leitan has quit IRC15:53
*** rcernin has quit IRC15:54
openstackgerritMartin Kopec proposed openstack/tripleo-quickstart-extras master: Allow removing of options from tempest conf  https://review.openstack.org/47707915:55
mwhahahapabelanger: k probably be a bit to get it properly configured15:56
*** rlandy is now known as rlandy|brb15:56
*** cdearborn has quit IRC15:57
*** achadha has quit IRC15:57
*** pcaruana has quit IRC15:57
openstackgerritMerged openstack/tripleo-quickstart master: Use https for NODEPOOL_RDO_PROXY outside of gate  https://review.openstack.org/49721515:58
*** achadha has joined #tripleo16:00
gfidentejaosorior did you see the problem jprovazn was having where deploy_on_server was timing out creating _admin user?16:00
gfidenteknow anything about it?16:00
*** egonzalez has quit IRC16:01
jankimwhahaha, https://review.openstack.org/#/c/494951/ needs to get in. Without this, overcloud deployment won't go through16:01
mwhahahajanki: i don't think that's a blocker and you have a -116:01
*** sasha2 has joined #tripleo16:01
bandinigfidente: https://review.openstack.org/#/c/496807/ a tested one liner if you have 30s ;)16:01
jankimwhahaha, its a blocker because overcloud won't be deployed when you have odl env files specified.16:02
mwhahahajanki: since it's not enabled by default upstream, it's not a blocker16:02
*** jbadiapa has quit IRC16:02
jankimwhahaha, ohk. thanks :)16:03
*** tesseract has quit IRC16:03
mwhahahajanki: also it has no bug refernce16:03
*** itlinux has quit IRC16:03
mwhahahajanki: so create a bug indicating the problem and we can see about getting added in to rc2 or backported later16:03
mwhahahajanki: but rc1 has to be done today and that doesn't look like it's going to land16:03
jankimwhahaha, sure no problem :)16:04
*** openstackgerrit has quit IRC16:04
*** janki has quit IRC16:04
*** leitan has joined #tripleo16:04
*** achadha has quit IRC16:05
*** links has joined #tripleo16:06
*** funzo has joined #tripleo16:06
*** rlandy|brb is now known as rlandy16:08
*** openstackgerrit has joined #tripleo16:08
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Enable config for docker daemon debug  https://review.openstack.org/49747316:08
*** kbyrne has quit IRC16:09
openstackgerritAlex Schultz proposed openstack/instack-undercloud master: Enable docker debug when deployed with debug  https://review.openstack.org/49747716:10
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140316:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295516:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243616:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262116:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)16:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]16:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]16:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge)16:10
*** kbyrne has joined #tripleo16:10
*** garyk has quit IRC16:10
mwhahahapabelanger: https://review.openstack.org/497473 and https://review.openstack.org/497477 should enable if it we are running the undercloud in debug in CI (i think)16:10
*** funzo has quit IRC16:11
*** liverpooler has quit IRC16:11
*** garyk has joined #tripleo16:12
*** itlinux has joined #tripleo16:13
*** cylopez has quit IRC16:15
*** jbadiapa has joined #tripleo16:18
*** ebarrera has quit IRC16:21
*** bogdando has quit IRC16:26
*** tongl has joined #tripleo16:28
openstackgerritTom Barron proposed openstack/tripleo-heat-templates master: manila: set "host" to "hostgroup"  https://review.openstack.org/49748216:29
*** jpich has quit IRC16:29
*** thrash is now known as thrash|biab16:31
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Enable config for docker daemon debug  https://review.openstack.org/49747316:32
*** apuimedo has joined #tripleo16:33
rook[root@overcloud-controller-2 log]# journalctl CONTAINER_HAME=haproxy-bundle-docker-216:35
rook-- No entries --16:35
rookmandre: ^16:35
rooks/HAME/NAME16:35
*** apuimedo has left #tripleo16:36
*** links has quit IRC16:38
*** garyk has quit IRC16:40
*** achadha has joined #tripleo16:41
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Don't pass puppet-pacemaker.yaml to containerized HA envs  https://review.openstack.org/49748516:42
*** dpawar has joined #tripleo16:43
*** achadha_ has joined #tripleo16:44
*** achadha_ has quit IRC16:45
pabelangermwhahaha: great, thanks16:45
*** ykarel has joined #tripleo16:45
*** achadha_ has joined #tripleo16:45
*** achadha has quit IRC16:45
*** garyk has joined #tripleo16:46
*** yamahata has joined #tripleo16:46
*** abishop has quit IRC16:47
*** achadha_ has quit IRC16:47
*** dtantsur is now known as dtantsur|afk16:47
*** achadha has joined #tripleo16:48
*** dpawar has quit IRC16:48
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Add support for deploying RGW with ceph-ansible  https://review.openstack.org/48080416:48
*** lucasagomes is now known as lucas-afk16:51
*** psachin has joined #tripleo16:51
tonglDoes quickstart.sh support pike release yet? I got an "unknown option: --release=pike" error when trying to run quickstart.sh with pike release.16:52
mwhahahatongl: no pike hasn't been cut for tripleo yet16:52
tonglmwhahaha: thanks. does it support --release=master?16:54
mwhahahatongl: yea it should it hink16:54
*** derekh has quit IRC16:55
rookmandre: yeah, so the haproxy process isn't logging to journal it seems16:55
rookah! mandre /var/log/messages16:55
rookphew16:55
tonglI tried with master. However I am getting error "fatal: [root@192.168.2.14]: UNREACHABLE! => {"changed": false, "msg": "SSH Error: data could not be sent to the remote host. Make sure this host can be reached over ssh", "unreachable": true}"16:57
tonglhowever, I can ssh to virthost without password.16:58
tonglDid anyone try quickstart with master release?16:58
openstackgerritBen Nemec proposed openstack/tripleo-image-elements stable/newton: 51-hosts fails if given lots of changes  https://review.openstack.org/49748717:02
*** ykarel has quit IRC17:06
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140317:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295517:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243617:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262117:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]17:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]17:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge)17:10
openstackgerritJoe Talerico proposed openstack/puppet-tripleo master: HAProxy logging  https://review.openstack.org/49752417:13
*** trown is now known as trown|lunch17:15
pabelangermwhahaha: nice full gate pipeline, going to be a good test17:15
* mwhahaha cries17:15
*** thrash|biab is now known as thrash17:22
*** pkovar has quit IRC17:25
*** rcernin has joined #tripleo17:27
*** jtomasek has quit IRC17:27
*** dmsimard is now known as dmsimard|afk17:30
hamzyi'm starting to see: 2017-08-24 17:26:28Z [overcloud.InternalApiVirtualIP.InternalApiPort]: CREATE_FAILED  InvalidIpForNetworkClient: resources.InternalApiPort: IP address 172.16.2.251 is not a valid IP for any of the subnets on the specified network.17:34
*** tosky has quit IRC17:34
hamzywith installation following https://fedoraproject.org/wiki/User:Hamzy/TripleO_mixed_undercloud_overcloud_try317:34
hamzyany idea what might be going wrong?17:34
*** gfidente is now known as gfidente|afk17:35
mwhahahahamzy: (i am not an expert in this) but what is the network range you're specifying for the storage network? that's just ip validation17:35
hamzythey seem to be defined in /usr/share/openstack-tripleo-heat-templates/environments/external-loadbalancer-vip.yaml17:36
hamzywhich hasn't changed recently17:36
hamzyI guess the question is how many of these files is the used expected to modify?17:37
*** ykarel has joined #tripleo17:38
*** ffiore has quit IRC17:43
*** achadha_ has joined #tripleo17:43
*** catinthe_ has joined #tripleo17:44
*** catintheroof has quit IRC17:45
hamzyand, IIRC, it did work a couple of weeks ago without modification17:46
*** achadha has quit IRC17:46
*** achadha has joined #tripleo17:46
*** achadha_ has quit IRC17:48
mwhahahahamzy: sorry got distracted, so the range it's complaing about is in the tenant network17:50
mwhahahahamzy: https://github.com/openstack/tripleo-heat-templates/blob/master/environments/network-environment.yaml#L2717:50
mwhahahahamzy: but it's trying to use it for teh storage entwork which is wrong17:50
hamzyso bug somewhere?17:51
mwhahahano17:51
mwhahahai think we might have fixed validation17:51
mwhahahawhich is why it used to work but now doesn't17:51
mwhahahathe ips from external-loandbalancer-vip do not match network-environment17:51
hamzyah17:51
mwhahahahttps://github.com/openstack/tripleo-heat-templates/blob/master/environments/external-loadbalancer-vip.yaml#L20-L3917:51
*** ykarel has quit IRC17:52
mwhahahavs https://github.com/openstack/tripleo-heat-templates/blob/master/environments/network-environment.yaml#L24-L2817:52
mwhahahaso i guess the bug is that external-loadbalancer-vip needs to be update to match network-environment17:52
mwhahahaby default17:52
hamzy16 -> 18 ?17:53
mwhahahawell there's more than just that one17:53
mwhahahathey are all wrong17:53
mwhahahathey need to be made consistent17:53
hamzyyeah all four17:53
*** tosky has joined #tripleo17:55
openstackgerritMerged openstack-infra/tripleo-ci master: Fix unbound variable DELOREAN_LINK  https://review.openstack.org/49722117:55
hamzymwhahaha, something like: sed -e 's,172[.]16,172.18,' /usr/share/openstack-tripleo-heat-templates/environments/external-loadbalancer-vip.yaml17:55
openstackgerritMerged openstack/puppet-tripleo master: TLS-everywhere/libvirt: Make postsave command configurable  https://review.openstack.org/49634917:56
openstackgerritMerged openstack/tripleo-heat-templates master: Docker: Enable TLS in the internal network for libvirt  https://review.openstack.org/49635117:56
mwhahahano that won't work17:57
mwhahahait needs to get patched or provide your own environment file to override those afterwards17:58
hamzypatched locally with a sed command?17:58
trozetmichapma: we need to rebase the patch, i need to see the ovsv-vsctl list open_vswitch output17:58
trozettrown|lunch: do you know what this vxlan port on br-ex is for?17:59
*** ansmith has quit IRC17:59
*** jbadiapa has quit IRC18:00
hamzymwhahaha, map InternalApiVirtualFixedIPs to use 172.17 and StorageMgmtVirtualFixedIPs to use 172.19... I don't know where StorageVirtualFixedIPs should fit18:02
*** abishop has joined #tripleo18:02
mwhahahahamzy: within the StorageNetCider18:03
mwhahaha172.18 from the network-environment18:03
*** mcornea has quit IRC18:04
*** funzo has joined #tripleo18:07
openstackgerritMerged openstack/tripleo-heat-templates master: Remove baremetal cron jobs on docker upgrade  https://review.openstack.org/49049618:08
*** itlinux has quit IRC18:08
*** mmedvede has joined #tripleo18:09
*** mjturek has joined #tripleo18:09
openstackgerritMerged openstack-infra/tripleo-ci master: Add support for updating initramfs images in CI  https://review.openstack.org/47990018:09
openstackgerritMerged openstack/puppet-tripleo master: Use resource collector for the fencing -> stonith ordering  https://review.openstack.org/49680718:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140318:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295518:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243618:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262118:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]18:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]18:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge)18:10
*** trown|lunch is now known as trown18:10
*** ebarrera has joined #tripleo18:10
*** funzo has quit IRC18:12
*** ffiore has joined #tripleo18:14
*** ansmith has joined #tripleo18:15
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add port security option for OVB with no network isolation  https://review.openstack.org/49683818:20
*** dixiaoli has joined #tripleo18:22
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add conditional check for including network_isolation_args  https://review.openstack.org/49754318:26
*** dixiaoli has quit IRC18:26
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: WIP create default settings for environment types  https://review.openstack.org/49540718:29
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Change devmode to deploy containerized services by default  https://review.openstack.org/47241218:29
*** ffiore has quit IRC18:30
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Add missing CentOS repos to promote releases  https://review.openstack.org/49754518:31
*** jpena is now known as jpena|off18:32
trownsshnaidm: could you look at https://review.openstack.org/497545 ... ideally we could get that in before the next periodic run in 6hrs18:32
sshnaidmtrown, so this should be with same repos we have in tripleo-ci/, right?18:34
trownsshnaidm: the centos ones that are added in that patch were copied from the tripleo-ci ones18:35
sshnaidmtrown, shouldn't we rename all the rest to quickstart-* ?18:35
trownsshnaidm: we could... but it is not needed I think18:36
sshnaidmquickstart-centos-qemu, quickstart-centos-ceph-jewel, quickstart-centos-opstools18:36
sshnaidmtrown, it was something with disabling all current repos iirc..18:37
trownsshnaidm: ya it is needed when we use a pre-built image18:37
sshnaidmtrown, ok.. but I'd remove "quickstart" to be consistent with other repo there18:38
sshnaidmor adding to all18:38
*** dprince has quit IRC18:38
*** ansmith has quit IRC18:41
*** mjturek has quit IRC18:44
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Add missing CentOS repos to promote releases  https://review.openstack.org/49754518:44
*** cschwede_ has quit IRC18:47
*** ramishra has quit IRC18:50
*** ansmith has joined #tripleo18:53
*** sasha2 has left #tripleo18:55
mwhahahai wish we could do include in the ansible yaml stuff18:57
mwhahahatoo much copy-pasta18:57
*** toure is now known as toure_biab18:58
*** ansmith has quit IRC19:00
*** florianf has quit IRC19:00
*** ansmith has joined #tripleo19:00
sshnaidmmwhahaha, on other hand good to see in one place all repos19:02
fultonjtrown: regarding https://review.openstack.org/#/c/497545, i had https://review.openstack.org/#/c/497218 . Your patch seems to have it all and more but not https://review.openstack.org/#/c/497218/3/config/release/tripleo-ci/master.yml19:02
mwhahahait is but having to pull it in 12 times is a bit much19:03
fultonji think i'll update mine to just have 'yum remove' ; sound OK?19:03
*** paramite has joined #tripleo19:04
trownfultonj: sure sounds good19:07
fultonjack19:07
weshaymwhahaha, ya.. I was thinking about where we can combine release files19:08
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Generalize OVB settings to fit feature set pattern  https://review.openstack.org/49540519:08
mwhahahaweshay: at least for the general mirror stuff and base OS. probably could use some yaml trickery to merge the lists and define the base os stuff elsewhere19:08
mwhahahait's one of my pet peeves with ansible is trying to extend stuff19:09
pabelangermwhahaha: +1 too much copypasta. That could be a role for sure19:10
weshaymwhahaha, ya.. actually we've been looking at using roles/common/vars to plug in variables19:10
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140319:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295519:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243619:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262119:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)19:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]19:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]19:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge)19:10
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add conditional check for including network_isolation_args  https://review.openstack.org/49754319:10
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Change devmode to deploy containerized services by default  https://review.openstack.org/47241219:11
*** pchavva has quit IRC19:13
*** achadha_ has joined #tripleo19:13
*** ebarrera has quit IRC19:14
pabelangermwhahaha: we've only failed 1 gate job so far19:15
pabelangerlooks like puppet-glance failed a tempest test19:15
*** achadha__ has joined #tripleo19:16
mwhahahapesky designate19:16
*** achadha has quit IRC19:16
pabelangercompared to last week, we're in great shape19:17
mwhahahaindeed19:18
*** achadha_ has quit IRC19:18
*** rbrady is now known as rbrady-afk19:22
mwhahahapabelanger: looks like gnocchi failed on a mirrors, http://logs.openstack.org/40/497140/1/gate/gate-puppet-gnocchi-puppet-beaker-rspec-centos-7/1642568/console.html#_2017-08-24_19_21_04_37046419:27
pabelangermwhahaha: Ya, we are seeing some issues on inap currently19:27
mgagnepabelanger: is there anything I can do?19:28
pabelangermgagne: possible, I'll send a ping your way in a few19:28
*** sshnaidm is now known as sshnaidm|off19:29
openstackgerritMartin Kopec proposed openstack/tripleo-quickstart-extras master: Allow removing of options from tempest conf  https://review.openstack.org/47707919:34
openstackgerritJohn Fulton proposed openstack/tripleo-quickstart master: Remove original CentOS Ceph repos in tripleo-ci master  https://review.openstack.org/49721819:38
mwhahahahas anyone looked into why the undercloud-oooq job is failing?19:40
openstackgerritJohn Fulton proposed openstack/tripleo-quickstart master: Remove original CentOS Ceph repos in tripleo-ci master  https://review.openstack.org/49721819:40
mwhahahai've noticed it failing on the image build task19:40
mwhahahabut the logs seem to not be catching anything19:41
mwhahahaweshay: do you know where the logs for this ends up? http://logs.openstack.org/08/469608/12/check/gate-tripleo-ci-centos-7-undercloud-oooq/b3114c5/console.html#_2017-08-24_13_28_51_95315819:41
* weshay looks19:42
mwhahahain theory it would be http://logs.openstack.org/08/469608/12/check/gate-tripleo-ci-centos-7-undercloud-oooq/b3114c5/logs/undercloud/home/jenkins/repo_setup.log.txt.gz19:43
mwhahahabut that says complete19:43
rookmwhahaha: i was about to ping ya about the CI -- http://logs.openstack.org/24/497524/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/8b20a5d/console.html#_2017-08-24_19_27_56_44342119:46
* mwhahaha runs away19:47
rooklol19:47
mwhahahadon't we have a known issue about selinux19:47
mwhahahathought i saw an email about that19:47
rookhttps://review.openstack.org/#/c/497524/ <-- all the jobs are throwing up for me.19:48
rookmight be.19:48
trownmwhahaha: it seems like the image build actually failed... there should be image build logs, but I dont see them19:48
trownlooking into it19:48
mwhahaharook: so not sure what's up with that error, but your change seems to need a depends-on something http://logs.openstack.org/24/497524/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/8b20a5d/logs/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2017-08-24_19_37_5319:49
mwhahaharook: option isn't a param for tripleo::haproxy::endpoint19:50
rookah ha19:50
rookok19:50
rookyeah mwhahaha  i wanted that to be a string19:53
rooknot eval'ed19:53
rookfixing that19:53
weshaymwhahaha, two different things, I'm opening a bug19:53
trownseems to be only failing on instack-undercloud patches19:54
trownlooking at http://tripleo.org/cistatus.html19:54
mwhahahatripleo-ui too19:54
mwhahahait's just the undercloud-oooq job19:54
openstackgerritJoe Talerico proposed openstack/puppet-tripleo master: HAProxy logging  https://review.openstack.org/49752419:55
mwhahaharook: that's not how it works19:55
mwhahaharook: commented on where you'd want to add it19:55
*** sbrzozow has quit IRC19:56
rookmwhahaha: ok, not all services have the httpchk... so, just have 'option' pass a list of ['httplog',] (and if there is already option with httpcheck add to that list)19:57
rookok19:57
*** psachin has quit IRC19:57
rookthanks mwhahaha19:58
mwhahaharook: our default is to have httpchk which is where i commented. so if you add it there only the services that are also getting httpchk would also get httplog19:58
rookah default_listen_options19:58
rookok19:58
mwhahaharook: if we update it (which we do in some places), you'd add it to those arrays but it's the same syntax elsewhere19:58
mwhahahago look for listen_options19:58
*** ebarrera has joined #tripleo19:58
mwhahahai think they are consistently named19:58
*** psachin has joined #tripleo19:59
rookyeah, it gets merged in with any additional options mwhahaha19:59
rookthanks19:59
rooknova metadata seems like a outlier.20:00
mwhahahaboo that one should be updated20:00
mwhahahawonder if that one doesn't support ssl which is why it slipped in. i thought there was a patch to enable it20:02
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: add logs for virt-customize  https://review.openstack.org/49759620:03
*** sshnaidm|off has quit IRC20:03
*** sshnaidm has joined #tripleo20:04
openstackgerritJoe Talerico proposed openstack/puppet-tripleo master: HAProxy logging  https://review.openstack.org/49752420:04
weshaytrown, https://bugs.launchpad.net/tripleo/+bug/171291020:04
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [High,In progress] - Assigned to wes hayutin (weshayutin)20:04
*** sshnaidm is now known as sshnaidm|off20:04
rookmwhahaha: based on the config i saw, it should just use the defaults.20:07
mwhahaharook: yea but the defaults include the header stuff for http/https. it should be fine20:07
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140320:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295520:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243620:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262120:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]20:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]20:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge)20:10
*** artom has quit IRC20:11
mwhahahaweshay: did you create a bug for the undercloud-oooq failures?20:16
weshayfor the logging of virt-customize20:17
*** ansmith has quit IRC20:17
mwhahahak probably could create an alert for the job since that appears to be broken (reasons unknown)20:17
weshayI'll try locally20:18
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: WIP create default settings for environment types  https://review.openstack.org/49540720:22
openstackgerritAlex Schultz proposed openstack/tripleo-puppet-elements master: Add stunnel  https://review.openstack.org/49760220:22
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Change devmode to deploy containerized services by default  https://review.openstack.org/47241220:22
weshaytrown, hrm.. lookng at http://logs.openstack.org/08/469608/12/check/gate-tripleo-ci-centos-7-undercloud-oooq/b3114c5/logs/delorean_logs/46/b7/46b7fddf4c772f14e373b32ec4344770d9a85bda_dev/rpmbuild.log.txt.gz20:22
weshayshouldn't we see the dependencies built as well https://review.openstack.org/#/c/469608/20:23
trownweshay: looking20:27
*** itlinux has joined #tripleo20:29
trownweshay: the depends-on are merged20:31
trownweshay: scared me20:31
weshayya20:31
weshayme too20:31
weshayis mistral in our update list?20:31
* weshay looks20:31
*** jkilpatr has quit IRC20:31
trownnope20:31
trownthat is a problem with depends-on to non-tripleo projects :(20:32
weshayincludepkgs=diskimage-builder,instack,instack-undercloud,os-apply-config,os-collect-config,os-net-config,os-refresh-config,python-tripleoclient,openstack-tripleo-common*,openstack-tripleo-heat-templates,openstack-tripleo-image-elements,openstack-tripleo,openstack-tripleo-puppet-elements,openstack-puppet-modules,openstack-tripleo-ui,puppet-*20:32
weshaymwhahaha, ^20:32
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Enable config for docker daemon debug  https://review.openstack.org/49747320:32
weshaytrown, so that patch has to wait for a promotion?20:32
trownweshay: yep20:32
weshaytrown, we do have a voting job on mistral20:33
mwhahahai'm seeing that failure elsewhere tho20:33
weshaywhat's the criteria for the update list20:33
trownwell maybe we should update the list to include mistral then20:33
mwhahahanot on that patch20:33
weshaymwhahaha, where else?20:33
openstackgerritTom Barron proposed openstack/tripleo-heat-templates master: manila: set "neutron_admin_auth_url" correctly  https://review.openstack.org/49760420:33
mwhahahaany instack-undercloud change :D20:33
mwhahahahttps://review.openstack.org/#/c/496851/20:34
trownhmm... ya... and that instack-undercloud patch is not merged yet...20:34
mwhahahahttps://review.openstack.org/#/c/497477/20:34
weshaymwhahaha, I see it on a few but not all20:34
mwhahahaanything from the last ~18 hours20:34
trowni see it on all instack-undercloud patches in the ci status page20:34
weshaymwhahaha, nope20:34
weshayjust https://review.openstack.org/#/c/469608/20:34
*** derekh has joined #tripleo20:34
weshayand https://review.openstack.org/#/c/496851/120:35
weshayis what I see atm20:35
mwhahaha49747720:35
weshaytrown, the second patch depends on openstack/puppet-nova20:35
trownhttps://review.openstack.org/#/c/496564/2 is the last pass20:35
mwhahahahttp://logs.openstack.org/77/497477/1/check/gate-tripleo-ci-centos-7-undercloud-oooq/ff66a37/console.html#_2017-08-24_17_29_06_84633220:35
mwhahahayea but that's not related for the virt-customize20:35
mwhahahaor is it dying because it's got a depends-on20:36
*** psachin has quit IRC20:36
weshaymwhahaha, I think we need to start a discussion to review what's on the pkg update list.. which projects do we take the latest from20:38
weshaymistral seems pretty safe to me20:38
mwhahahak20:38
weshayas we have a voting job20:38
trownwe also have tripleo cores who are mistral cores as well20:38
trownso seems reasonable20:39
mwhahahaif it has a voting job, yea would be safe20:39
*** ecerquei has quit IRC20:40
*** hamzy has quit IRC20:42
*** dsneddon_pto has quit IRC20:44
*** dsneddon_pto has joined #tripleo20:44
*** dsneddon_pto is now known as dsneddon20:44
*** derekh has quit IRC20:46
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Use repo-setup when injecting repos  https://review.openstack.org/46463620:46
openstackgerritJoe Talerico proposed openstack/puppet-tripleo master: HAProxy logging  https://review.openstack.org/49752420:49
weshaymwhahaha, trown I'll send an email to openstack-dev[tripleo]20:49
trownweshay: awesome thanks20:49
*** trown is now known as trown|outtypewww20:49
*** catinthe_ has quit IRC20:53
*** catintheroof has joined #tripleo20:54
*** catintheroof has quit IRC20:58
*** jkilpatr has joined #tripleo21:00
*** itlinux has quit IRC21:03
openstackgerritOpenStack Release Bot proposed openstack/instack-undercloud stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49761921:04
openstackgerritOpenStack Release Bot proposed openstack/instack-undercloud stable/pike: Update UPPER_CONSTRAINTS_FILE for stable/pike  https://review.openstack.org/49762021:04
openstackgerritOpenStack Release Bot proposed openstack/instack-undercloud master: Update reno for stable/pike  https://review.openstack.org/49762121:04
openstackgerritOpenStack Release Bot proposed openstack/puppet-tripleo stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49762221:04
openstackgerritOpenStack Release Bot proposed openstack/puppet-tripleo stable/pike: Update UPPER_CONSTRAINTS_FILE for stable/pike  https://review.openstack.org/49762321:04
openstackgerritOpenStack Release Bot proposed openstack/puppet-tripleo master: Update reno for stable/pike  https://review.openstack.org/49762421:04
openstackgerritOpenStack Release Bot proposed openstack/tripleo-common stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49762521:04
openstackgerritOpenStack Release Bot proposed openstack/tripleo-common stable/pike: Update UPPER_CONSTRAINTS_FILE for stable/pike  https://review.openstack.org/49762621:04
openstackgerritOpenStack Release Bot proposed openstack/tripleo-common master: Update reno for stable/pike  https://review.openstack.org/49762721:04
openstackgerritOpenStack Release Bot proposed openstack/tripleo-heat-templates stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49762821:05
openstackgerritOpenStack Release Bot proposed openstack/tripleo-heat-templates stable/pike: Update UPPER_CONSTRAINTS_FILE for stable/pike  https://review.openstack.org/49762921:05
openstackgerritOpenStack Release Bot proposed openstack/tripleo-heat-templates master: Update reno for stable/pike  https://review.openstack.org/49763021:05
openstackgerritOpenStack Release Bot proposed openstack/tripleo-image-elements stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49763121:05
openstackgerritOpenStack Release Bot proposed openstack/tripleo-image-elements master: Update reno for stable/pike  https://review.openstack.org/49763221:05
openstackgerritOpenStack Release Bot proposed openstack/tripleo-puppet-elements stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49763321:05
openstackgerritOpenStack Release Bot proposed openstack/tripleo-puppet-elements master: Update reno for stable/pike  https://review.openstack.org/49763421:05
openstackgerritOpenStack Release Bot proposed openstack/tripleo-ui stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49763521:05
openstackgerritOpenStack Release Bot proposed openstack/tripleo-ui master: Update reno for stable/pike  https://review.openstack.org/49763621:05
openstackgerritOpenStack Release Bot proposed openstack/tripleo-validations stable/pike: Update .gitreview for stable/pike  https://review.openstack.org/49763721:05
openstackgerritOpenStack Release Bot proposed openstack/tripleo-validations stable/pike: Update UPPER_CONSTRAINTS_FILE for stable/pike  https://review.openstack.org/49763821:05
*** gfidente|afk has quit IRC21:05
openstackgerritOpenStack Release Bot proposed openstack/tripleo-validations master: Update reno for stable/pike  https://review.openstack.org/49763921:05
*** itlinux has joined #tripleo21:05
stevebakertrozet, numans: let me know if you have any questions about overcloud_containers.yaml.j2 and prepare for ovn/odl21:05
trozetstevebaker: ok thanks21:06
*** jkilpatr has quit IRC21:07
*** dbecker has joined #tripleo21:08
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140321:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295521:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243621:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262121:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291021:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]21:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]21:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge)21:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)21:10
*** jfrancoa has quit IRC21:10
*** jtomasek has joined #tripleo21:10
bnemecIs it safe to assume that those release bot reviews qualify for expedited approvals?21:11
*** jtomasek has quit IRC21:11
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: Add conditional check for including network_isolation_args  https://review.openstack.org/49754321:12
pabelangeranybody able to tell me why this failed? http://logs.openstack.org/25/497325/1/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/d0fd0b9/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz21:17
pabelangeror where I should look21:17
pabelangerthat was in the gate21:17
*** jkilpatr has joined #tripleo21:18
mwhahahapabelanger: probably mistral logs since the put failed21:19
*** rcernin has quit IRC21:19
pabelangerWow21:20
pabelangerI see a private key in the logs :)21:20
*** Goneri has quit IRC21:22
weshayapetrich, you on?21:23
weshayprobably not21:23
apetrichweshay, you rang?21:24
pabelangerI see a DEBUG: Client-side error: Environment not found [name=tripleo.undercloud-config] format_exception /usr/lib/python2.7/site-packages/wsme/21:24
pabelangerbut not sure if that would break something21:24
*** itlinux has quit IRC21:24
*** itlinux has joined #tripleo21:25
*** ebarrera has quit IRC21:26
*** morazi has quit IRC21:33
*** ansmith has joined #tripleo21:34
*** dbecker has quit IRC21:39
*** bfournie has quit IRC21:53
*** thrash is now known as thrash|g0ne21:57
*** catintheroof has joined #tripleo21:59
openstackgerritBrent Eagles proposed openstack/puppet-tripleo master: Repair immediate VF configuration for PCI SR-IOV  https://review.openstack.org/49766422:00
*** leitan has quit IRC22:02
*** leitan has joined #tripleo22:02
*** leitan has quit IRC22:02
*** leitan has joined #tripleo22:02
weshaypabelanger, https://review.openstack.org/#/c/497663/22:03
*** leitan has quit IRC22:03
pabelangerweshay: does that affect other branches?22:04
*** ffiore has joined #tripleo22:04
weshayapetrich, ^22:04
pabelangerweshay: apetrich: might want to ask security teams what they recommend. Since it is possible this is happening on production systems.22:06
apetrichpabelanger, I would think so22:06
*** jlabarre has quit IRC22:06
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140322:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295522:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243622:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262122:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291022:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]22:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]22:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge)22:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)22:10
*** dsneddon is now known as dsneddon_away22:11
*** ffiore has quit IRC22:12
*** marrusl has joined #tripleo22:13
*** ffiore has joined #tripleo22:13
*** jcoufal has quit IRC22:18
*** ecerquei has joined #tripleo22:22
*** ecerquei_ has joined #tripleo22:24
*** ecerquei has quit IRC22:27
*** rlandy is now known as rlandy|bbl22:31
openstackgerritBen Nemec proposed openstack/tripleo-docs master: Remove another outdated note  https://review.openstack.org/49768822:40
*** dmsimard|afk is now known as dmsimard22:46
*** bfournie has joined #tripleo22:51
*** bfournie has quit IRC22:53
*** itlinux has quit IRC23:00
*** tosky has quit IRC23:02
rookmwhahaha: still around?23:06
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169140323:10
openstackLaunchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295523:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171243623:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171262123:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171291023:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]23:10
openstackLaunchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged]23:10
openstackLaunchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge)23:10
openstackLaunchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin)23:10
*** bfournie has joined #tripleo23:11
*** jcoufal has joined #tripleo23:17
mwhahaharook: for like 2 minus if you're still here23:18
rookyeah23:18
rookmwhahaha: i think there is a reason why I didn't set option httplog across all services23:19
rooksome are tcp based connections, which would need option tcplog23:19
rookso I need to hvae a ocnditional or something based on the $mode.23:19
mwhahaharook: sec23:19
mwhahaharook:  so https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L827-L84123:20
mwhahaharook: that sets httpchk as the default and your change would add httplog as the default23:20
mwhahaharook: so what you'd want to do is for the services that use tcp, to add tcplog23:21
rookright...23:21
mwhahaharook: those ones generally define listen_options23:21
mwhahahafor example https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L104923:21
mwhahahaso you would add it in there23:21
rookmwhahaha  bingo, but would i want to merge the default options?23:21
mwhahahano23:21
*** jcoufal has quit IRC23:21
rookok, so is it safe to remove that/23:22
mwhahahano23:22
mwhahahathe only tcp services we have are redis, mysql and novnc right?23:23
mwhahahaso for each one of those you'd need to add the tcplog in the appropriate listen_options configuration for those23:23
mwhahahathe other thing is our defaults which covers http based services23:23
mwhahaharook: time for some puppet learning23:24
mwhahaharook: https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L833-L841 basically defines those settings for all declarations of tripleo::haproxy::endpoint unless the instance overrides that config23:24
mwhahaharook: for example https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L86823:24
mwhahaharook: the reason why we merge there is because we want the defaults and the specific httpdchk options23:25
rookright, makes total sense.23:25
mwhahaharook: so for mysql, https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L1280-L131223:26
mwhahahawe specifically don't include default_listen_options anywhere because it's not an http service23:26
mwhahahaso we just ignore those defaults and override it with the mysql specific listen_options23:26
mwhahaharook: same for abbitmq https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L1331-L134723:26
*** abishop has quit IRC23:26
rookright, mwhahaha now that i looked through again, the merge was with the http service23:28
rookmakes sense. thanks for the crash course!23:28
mwhahahasure23:28
mwhahahaif you have further questions, i'll be back on monday :D23:28
rook:D23:28
* mwhahaha gives up23:28
*** abishop has joined #tripleo23:28
*** abishop has quit IRC23:31
openstackgerritJoe Talerico proposed openstack/puppet-tripleo master: HAProxy logging  https://review.openstack.org/49752423:32
*** abishop has joined #tripleo23:32
openstackgerritMerged openstack/puppet-tripleo master: Add /bin to PATH for CRL cronjob  https://review.openstack.org/49710023:35
*** jkilpatr has quit IRC23:40
*** jkilpatr has joined #tripleo23:40
*** noslzzp_ has quit IRC23:40
*** rlandy|bbl is now known as rlandy23:42
*** catintheroof has quit IRC23:46
radezhey EmilienM, I've got a deply issue that I think I've narrowed down to the iterface_for_ip function in puppet not working correctly23:49
radezI did this test: https://paste.fedoraproject.org/paste/yXTOM3n8jMz5MZghjsl1bQ23:50
radezI think it shows my facts arn't resolving when I'm executing the function?23:50
radezif you have a few woudl you mind taking a look at my log there?23:50
radezthe interface_for_ip function uses the ipaddress_{interface_name} and netmask_{interface_name} facts afaict23:52
*** tongl has quit IRC23:53
*** ecerquei_ has quit IRC23:55
*** ecerquei_ has joined #tripleo23:55
*** artom has joined #tripleo23:56
*** artom has quit IRC23:56
*** artom has joined #tripleo23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!