*** [1]cdearborn has joined #tripleo | 00:06 | |
*** bfournie has joined #tripleo | 00:12 | |
*** julim has joined #tripleo | 00:26 | |
*** tzumainn has quit IRC | 00:34 | |
*** dmacpher has joined #tripleo | 00:35 | |
*** xinwu has joined #tripleo | 00:38 | |
*** rwsu has joined #tripleo | 00:39 | |
*** noslzzp has quit IRC | 00:40 | |
*** noslzzp has joined #tripleo | 00:45 | |
*** julim has quit IRC | 00:52 | |
*** xinwu has quit IRC | 00:53 | |
*** limao has joined #tripleo | 01:01 | |
*** xinwu has joined #tripleo | 01:12 | |
*** lblanchard has joined #tripleo | 01:13 | |
*** stendulker has joined #tripleo | 01:17 | |
*** akshai has joined #tripleo | 01:32 | |
*** akshai_ has joined #tripleo | 01:33 | |
*** noslzzp has quit IRC | 01:37 | |
*** akshai has quit IRC | 01:37 | |
*** noslzzp has joined #tripleo | 01:40 | |
*** akshai_ has quit IRC | 01:54 | |
*** lblanchard1 has joined #tripleo | 02:06 | |
*** lblanchard2 has joined #tripleo | 02:09 | |
*** lblanchard has quit IRC | 02:10 | |
*** lblanchard1 has quit IRC | 02:11 | |
*** fragatina has joined #tripleo | 02:18 | |
*** fragatina has quit IRC | 02:18 | |
*** fragatina has joined #tripleo | 02:19 | |
*** lblanchard2 has quit IRC | 02:19 | |
*** akshai has joined #tripleo | 02:23 | |
*** bfournie has quit IRC | 02:24 | |
*** stendulker has quit IRC | 02:28 | |
EmilienM | ok so nonha job is fixed but ha & upgrade look broken | 02:31 |
---|---|---|
*** chlong has quit IRC | 02:37 | |
EmilienM | https://bugs.launchpad.net/tripleo/+bug/1596758 | 02:47 |
openstack | Launchpad bug 1596758 in tripleo "pingtest fails when accessing to OpenStack APIs" [Critical,Confirmed] | 02:47 |
*** chlong has joined #tripleo | 02:49 | |
*** yamahata has quit IRC | 02:52 | |
*** akshai has quit IRC | 02:56 | |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
openstack | Launchpad bug 1596758 in tripleo "pingtest fails when accessing to OpenStack APIs" [Critical,Confirmed] | 03:10 |
*** limao has quit IRC | 03:10 | |
*** [1]cdearborn has quit IRC | 03:11 | |
*** tserong has quit IRC | 03:33 | |
*** limao_ has joined #tripleo | 03:36 | |
*** yamahata has joined #tripleo | 03:44 | |
*** links has joined #tripleo | 03:50 | |
*** numans has quit IRC | 03:53 | |
*** numans has joined #tripleo | 03:56 | |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
openstack | Launchpad bug 1596758 in tripleo "pingtest fails when accessing to OpenStack APIs" [Critical,Confirmed] | 04:10 |
*** ramishra_ has joined #tripleo | 04:18 | |
*** numans has quit IRC | 04:21 | |
*** ramishra has quit IRC | 04:21 | |
*** jtomasek_ has joined #tripleo | 04:32 | |
*** fragatina has quit IRC | 04:39 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Validations new workflow https://review.openstack.org/334770 | 04:39 |
*** numans has joined #tripleo | 04:54 | |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
openstack | Launchpad bug 1596758 in tripleo "pingtest fails when accessing to OpenStack APIs" [Critical,Confirmed] | 05:10 |
*** jtomasek_ has quit IRC | 05:12 | |
*** itamarl has joined #tripleo | 05:13 | |
*** saneax_AFK is now known as saneax | 05:13 | |
*** ayoung has quit IRC | 05:14 | |
*** hanchao has quit IRC | 05:16 | |
*** fragatina has joined #tripleo | 05:20 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Temporarily disable the cached images https://review.openstack.org/334634 | 05:23 |
*** paramite has quit IRC | 05:25 | |
*** hanchao has joined #tripleo | 05:28 | |
*** skramaja has joined #tripleo | 05:42 | |
*** rajinir has quit IRC | 05:44 | |
*** oshvartz has joined #tripleo | 05:52 | |
*** jtomasek has quit IRC | 05:55 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Making element overriding explicit https://review.openstack.org/334785 | 06:00 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add IMAGE_ELEMENT_YAML https://review.openstack.org/334786 | 06:00 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Clear up "already provided" message https://review.openstack.org/290968 | 06:04 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Convert element_dependencies to logging https://review.openstack.org/328072 | 06:04 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add IMAGE_ELEMENT_YAML https://review.openstack.org/334786 | 06:04 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Making element overriding explicit https://review.openstack.org/334785 | 06:04 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 06:05 |
*** tbonds has quit IRC | 06:07 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 06:08 |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
openstack | Launchpad bug 1596758 in tripleo "pingtest fails when accessing to OpenStack APIs" [Critical,Confirmed] | 06:10 |
*** bootsha has joined #tripleo | 06:21 | |
*** tremble has joined #tripleo | 06:23 | |
openstackgerrit | Sanjay Upadhyay proposed openstack/tripleo-specs: tripleo-sriov https://review.openstack.org/313872 | 06:27 |
*** liverpooler has joined #tripleo | 06:29 | |
*** davidlenwell has quit IRC | 06:30 | |
*** rasca has joined #tripleo | 06:33 | |
*** derekh has joined #tripleo | 06:35 | |
derekh | I'm thinking of just merging this, as its holding up CI on rh2, only 3 days left to get it working https://review.openstack.org/#/c/295243/ | 06:36 |
derekh | anybody want to pull the trigger ^^ , if not I will myself in a bit | 06:36 |
*** davidlenwell has joined #tripleo | 06:40 | |
*** ChanServ sets mode: +v davidlenwell | 06:40 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Add infrstucture scripts to prepare rh2 https://review.openstack.org/295243 | 06:43 |
derekh | done | 06:43 |
*** derekh has quit IRC | 06:43 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 06:46 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Fix openstack-tripleo-common package name https://review.openstack.org/334467 | 06:46 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 06:46 |
*** pcaruana has joined #tripleo | 06:46 | |
*** jprovazn has joined #tripleo | 06:48 | |
*** noslzzp has quit IRC | 06:52 | |
*** oneswig has joined #tripleo | 06:57 | |
*** tesseract- has joined #tripleo | 06:59 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 07:00 |
*** ebalduf has quit IRC | 07:00 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add IMAGE_ELEMENT_YAML https://review.openstack.org/334786 | 07:02 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Making element overriding explicit https://review.openstack.org/334785 | 07:02 |
*** olap has joined #tripleo | 07:03 | |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
openstack | Launchpad bug 1596758 in tripleo "pingtest fails when accessing to OpenStack APIs" [Critical,Confirmed] | 07:10 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add a method to wait for messages on the websocket https://review.openstack.org/322611 | 07:13 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Use Mistral for baremetal registration https://review.openstack.org/322612 | 07:13 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Use Mistral for baremetal introspection https://review.openstack.org/327780 | 07:13 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Don't cache and re-use the websocket https://review.openstack.org/331985 | 07:13 |
*** oneswig has quit IRC | 07:14 | |
*** amoralej|off is now known as amoralej | 07:15 | |
*** liverpoo1er has joined #tripleo | 07:16 | |
*** liverpooler has quit IRC | 07:17 | |
*** florianf has joined #tripleo | 07:18 | |
*** oneswig has joined #tripleo | 07:20 | |
*** jpich has joined #tripleo | 07:20 | |
*** oneswig has quit IRC | 07:21 | |
*** fzdarsky has joined #tripleo | 07:23 | |
*** mcornea has joined #tripleo | 07:24 | |
*** athomas has joined #tripleo | 07:30 | |
*** ifarkas has joined #tripleo | 07:31 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 07:31 |
*** zoli_gone-proxy is now known as zoliXXL | 07:32 | |
*** ebarrera has joined #tripleo | 07:35 | |
openstackgerrit | Martin André proposed openstack/instack-undercloud: Add tripleo deployment config file paths to hiera https://review.openstack.org/329016 | 07:36 |
openstackgerrit | Martin André proposed openstack/instack-undercloud: Introduce 'enable_validations' option https://review.openstack.org/322893 | 07:36 |
*** dsariel has joined #tripleo | 07:37 | |
openstackgerrit | Martin André proposed openstack/instack-undercloud: Add tripleo deployment config file paths to hiera https://review.openstack.org/329016 | 07:47 |
openstackgerrit | Martin André proposed openstack/instack-undercloud: Introduce 'enable_validations' option https://review.openstack.org/322893 | 07:47 |
*** chem has joined #tripleo | 07:48 | |
*** dmacpher has quit IRC | 07:50 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: Move nova constraints to tripleo-puppet. https://review.openstack.org/332071 | 07:53 |
*** shardy_afk is now known as shardy | 07:55 | |
*** aufi has joined #tripleo | 08:00 | |
*** olap has quit IRC | 08:01 | |
*** oneswig has joined #tripleo | 08:02 | |
shardy | Morning all | 08:03 |
*** olap has joined #tripleo | 08:03 | |
shardy | Does anyone have an update on where we are wrt getting CI working again? | 08:03 |
shardy | cistatus still looks very red :( | 08:03 |
shardy | anything that needs reviews or other help? | 08:04 |
*** dmk0202 has joined #tripleo | 08:06 | |
ccamacho | morning! | 08:07 |
*** andreas-f has quit IRC | 08:08 | |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
openstack | Launchpad bug 1596758 in tripleo "pingtest fails when accessing to OpenStack APIs" [Critical,Confirmed] | 08:10 |
*** _milan_ has joined #tripleo | 08:14 | |
*** gfidente has joined #tripleo | 08:15 | |
*** dtantsur|afk is now known as dtantsur | 08:15 | |
*** milan has quit IRC | 08:17 | |
*** oneswig has quit IRC | 08:26 | |
*** jtomasek_ has joined #tripleo | 08:33 | |
*** dsariel has quit IRC | 08:33 | |
openstackgerrit | Merged openstack/diskimage-builder: Fix sphinx-build to not depend on diskimage-builder https://review.openstack.org/331911 | 08:34 |
*** fzdarsky has quit IRC | 08:40 | |
*** sshnaidm|afk has quit IRC | 08:41 | |
*** mbound has joined #tripleo | 08:42 | |
*** bootsha has quit IRC | 08:43 | |
shardy | jistr: Hi, thanks for the comment on https://bugs.launchpad.net/tripleo/+bug/1596758 | 08:49 |
openstack | Launchpad bug 1596758 in tripleo "[CI down] RabbitMQ fails to form a cluster" [Critical,Confirmed] | 08:49 |
shardy | Do you have any further analysis on how we might fix it, and/or are you working on it? | 08:50 |
jistr | shardy: morning :) | 08:50 |
jistr | does anyone hit the problem locally? | 08:50 |
jistr | ont their env? | 08:50 |
shardy | jistr: I was about to try, but didn't want to duplicate effort if you're already fixing it ;) | 08:50 |
jistr | i'm not sure how to fix it... | 08:51 |
jistr | it's very similar to a thing we've hit and fixed downstream recently | 08:51 |
jistr | the fix was this https://github.com/ClusterLabs/resource-agents/commit/bbbc52e335967dae3e548fe8c17bb162b001147c.patch | 08:51 |
jistr | it's not in any released packages yet AFAIK | 08:52 |
jistr | i'm not sure how to best try to apply this as a workaround in tripleo | 08:52 |
*** abehl has joined #tripleo | 08:52 | |
jistr | probably should happend during image build phase, but we use cached images... | 08:52 |
*** andreas-f has joined #tripleo | 08:53 | |
shardy | hmm | 08:53 |
* shardy looks around for derekh | 08:53 | |
shardy | jistr: Ok, thanks for the info | 08:53 |
shardy | I guess we can get that into the image somehow until the fix is released | 08:53 |
shardy | any idea what package that ends up in? | 08:54 |
jistr | shardy: i'm not sure if it will fix it, but it might. The issue downstream was that rabbitmq failed to rejoin the cluster, but here it looks like it fails on the first try, so it might be different. But the error message itself looks practically the same. | 08:54 |
jistr | shardy: the package is resource-agents, we get it from CentOS 7 updates repo | 08:55 |
shardy | jistr: Ok, thanks | 08:56 |
*** jistr is now known as jistr|mtg | 09:04 | |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
openstack | Launchpad bug 1596758 in tripleo "[CI down] RabbitMQ fails to form a cluster" [Critical,Confirmed] | 09:10 |
*** bootsha has joined #tripleo | 09:14 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 09:20 |
*** limao_ has quit IRC | 09:24 | |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Add gnocchi profiles https://review.openstack.org/315527 | 09:25 |
*** limao has joined #tripleo | 09:28 | |
*** olap has quit IRC | 09:29 | |
*** olap has joined #tripleo | 09:31 | |
*** jistr|mtg is now known as jistr | 09:31 | |
openstackgerrit | Merged openstack/diskimage-builder: Run RHEL system unregister element earlier https://review.openstack.org/332866 | 09:32 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 09:33 |
*** derekh has joined #tripleo | 09:33 | |
*** fzdarsky has joined #tripleo | 09:36 | |
*** bootsha has quit IRC | 09:38 | |
*** dsariel has joined #tripleo | 09:39 | |
openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci: Workaround for resource-agents bug https://review.openstack.org/334885 | 09:48 |
jistr | shardy, derekh ^^ we'll see | 09:48 |
*** bootsha has joined #tripleo | 09:49 | |
shardy | jistr: ah, thanks | 09:49 |
*** limao has quit IRC | 09:50 | |
shardy | jistr: I was about to do similar, but by customizing the overcloud-full image ;) | 09:50 |
jistr | shardy: that might be a better approach. E.g. if we do it in tripleo.sh we'd get it in dev envs too | 09:50 |
shardy | jistr: Yeah, either is fine to prove if the patch helps tho | 09:51 |
*** sshnaidm|afk has joined #tripleo | 09:51 | |
shardy | jistr: do we have an ETA on the release of that fix? | 09:51 |
jistr | shardy: yea, i wanted something relatively quick to verify if this is fixing the problem and worth pursuing further. I don't think there's an ETA but if it proves helpful for upstream too, i think we can query that from clusterlabs folks. | 09:54 |
* jistr -> lunch | 09:54 | |
*** jpena|off is now known as jpena | 09:55 | |
*** tosky has joined #tripleo | 09:57 | |
*** akrivoka has joined #tripleo | 09:57 | |
*** hanchao has quit IRC | 09:58 | |
openstackgerrit | Saravanan KR proposed openstack/python-tripleoclient: NTP arg should be optional when specified in an environment https://review.openstack.org/332694 | 10:03 |
cmyster | 7/ | 10:04 |
*** bfournie has joined #tripleo | 10:07 | |
*** bfournie has quit IRC | 10:07 | |
*** bfournie has joined #tripleo | 10:07 | |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
openstack | Launchpad bug 1596758 in tripleo "[CI down] RabbitMQ fails to form a cluster" [Critical,Confirmed] | 10:10 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 10:13 |
*** sambetts|afk is now known as sambetts | 10:14 | |
*** _milan_ has quit IRC | 10:22 | |
*** zoliXXL is now known as zoli|afk | 10:25 | |
*** liverpoo1er has quit IRC | 10:25 | |
*** liverpooler has joined #tripleo | 10:25 | |
openstackgerrit | Saravanan KR proposed openstack/python-tripleoclient: NTP arg should be optional when specified in an environment https://review.openstack.org/332694 | 10:25 |
*** weshay has quit IRC | 10:27 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 10:35 |
*** fzdarsky is now known as fzdarsky|lunch | 10:44 | |
*** dtantsur is now known as dtantsur|lunch | 10:48 | |
*** fzdarsky|lunch has quit IRC | 10:50 | |
sshnaidm|afk | derekh, can you please look at this in your time? https://review.openstack.org/#/c/334305 | 10:50 |
derekh | sshnaidm|afk: yup, looking now | 10:51 |
*** sshnaidm|afk is now known as sshnaidm | 10:52 | |
*** hewbrocca-afk is now known as hewbrocca | 10:54 | |
*** jcoufal has joined #tripleo | 10:54 | |
derekh | sshnaidm: do you know where JOB_NAME went too? | 10:56 |
sshnaidm | derekh, sorry? | 10:57 |
hewbrocca | Morning folks | 10:57 |
derekh | sshnaidm: the patch is setting JOB_NAME, do you know why it needs to be set? I curious to know what has changed | 10:58 |
*** zoli|afk is now known as zoli|wfh | 10:58 | |
hewbrocca | CI green? | 10:58 |
*** zoli|wfh is now known as zoliXXL | 10:58 | |
sshnaidm | derekh, https://github.com/openstack-infra/tripleo-ci/blob/master/toci_instack.sh#L324 | 11:00 |
sshnaidm | derekh, http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-nonha/095c4ed/console.html#_2016-06-25_08_10_01_220921 | 11:00 |
derekh | sshnaidm: yes, I know why we need it, but that line used to work, I'm just wondering what has changed | 11:01 |
sshnaidm | derekh, ah, no, I don't know yet | 11:01 |
derekh | hewbrocca: nonha is green, jistr has a patch to fix/workaround a problem with the other 2 jobs | 11:02 |
jistr | derekh, hewbrocca: it's not certain though. The error looked the same as what we've tackled downstream with minor updates so i tried to submit the same fix. I don't have an opportunity to test it locally ATM so we'll see what CI says. | 11:04 |
sshnaidm | derekh, maybe it worked with jenkins, was in global parameters | 11:04 |
jistr | if someone hits the issue locally and can test if https://review.openstack.org/334885 fixes it, that'd be cool | 11:05 |
derekh | sshnaidm: ok | 11:05 |
*** tbonds has joined #tripleo | 11:06 | |
sshnaidm | derekh, yeah, I guessed right, JOB_NAME is one of jenkins parameters :) | 11:06 |
*** weshay has joined #tripleo | 11:06 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Nothing to see here https://review.openstack.org/111011 | 11:06 |
derekh | sshnaidm: ok +2, although it would be nice if there was a similar variable, | 11:07 |
derekh | sshnaidm: that patch ^^ is running env to try and find one | 11:08 |
sshnaidm | derekh, you mean from zuul? I searched, nothing found | 11:08 |
sshnaidm | derekh, yeah, I also ran env in job | 11:08 |
sshnaidm | derekh, http://logs.openstack.org/88/334288/1/check-tripleo/gate-tripleo-ci-centos-7-ha/6317489/console.html#_2016-06-27_05_40_56_840898 | 11:09 |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
openstack | Launchpad bug 1596758 in tripleo "[CI down] RabbitMQ fails to form a cluster" [Critical,Confirmed] | 11:10 |
openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Add 'openstack overcloud node provide' command https://review.openstack.org/334411 | 11:16 |
*** fragatin_ has joined #tripleo | 11:22 | |
*** fragatina has quit IRC | 11:22 | |
*** thrash|g0ne is now known as thrash | 11:25 | |
*** bfournie has quit IRC | 11:27 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 11:29 |
*** fragatin_ has quit IRC | 11:30 | |
hewbrocca | Did we get the swift OOM issue solved, BTW? | 11:31 |
*** rodrigods has quit IRC | 11:32 | |
*** rodrigods has joined #tripleo | 11:32 | |
*** panda has quit IRC | 11:34 | |
*** milan has joined #tripleo | 11:35 | |
*** panda has joined #tripleo | 11:35 | |
derekh | hewbrocca: more avoided then resolved, our glance is temporarily not using swift https://review.openstack.org/#/c/334555/ | 11:37 |
weshay | sshnaidm, can you investigate the last four gate failures on centos-7-nonha.. there are two python-tripleoclient failures and two ci failures | 11:38 |
*** rhallisey has joined #tripleo | 11:38 | |
derekh | trown|outtypewww: you gonna want to change this in tripleo-quickstart http://66.187.229.99/builds/current-tripleo/ ..... | 11:39 |
derekh | trown|outtypewww: that IP address wont exist when the rack goes down next week | 11:39 |
yolanda | hi, can i get some reviews on a change for tripleo-quickstart? https://review.openstack.org/329556 | 11:39 |
derekh | trown|outtypewww: we should make it a DNS entry or something that we can change | 11:39 |
yolanda | it allows to clone and specify custom templates | 11:39 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: Allow to specify templates path on overcloud deployment https://review.openstack.org/329556 | 11:40 |
*** lucasagomes is now known as lucas-hungry | 11:42 | |
*** wfoster is now known as wfoster_afk | 11:43 | |
*** wfoster_afk is now known as wfoster | 11:43 | |
*** jpich has quit IRC | 11:46 | |
openstackgerrit | Damien Ciabrini proposed openstack/tripleo-heat-templates: Dump and restore galera db during major upgrades https://review.openstack.org/325205 | 11:46 |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Add gnocchi profiles https://review.openstack.org/315527 | 11:47 |
EmilienM | hello | 11:51 |
*** fragatina has joined #tripleo | 11:54 | |
*** jpena is now known as jpena|lunch | 11:54 | |
ccamacho | o/ | 11:54 |
ccamacho | Hey EmilienM, man found lot of nits in the gnocchi submission... One of them i.e. service_manage -> manage_service .... I'm fixing and testing one by one.. as that's the issue... | 11:56 |
*** jayg|g0n3 is now known as jayg | 11:56 | |
EmilienM | ccamacho: ok but our CI is still broken isn't? | 11:56 |
ccamacho | the nonha is working | 11:56 |
EmilienM | yeah but the ha & upgrade jobs are broken | 11:57 |
EmilienM | I won't review the gnocchi thing & continue composable work until CI is back | 11:57 |
shardy | EmilienM: we're waiting to see if https://review.openstack.org/#/c/334885/ helps with the HA failures | 11:57 |
*** paramite has joined #tripleo | 11:57 | |
ccamacho | and jistr submitted some patches for fixing it the other jobs. | 11:57 |
ccamacho | EmilienM ^ | 11:58 |
EmilienM | jistr: thanks for looking at it | 11:58 |
shardy | https://github.com/ClusterLabs/resource-agents/commit/bbbc52e335967dae3e548fe8c17bb162b001147c.patch is the patch in question | 11:58 |
ccamacho | jistr ++ | 11:58 |
jistr | shardy, EmilienM, ccamacho: sure thing. The fix didn't work though :( | 11:58 |
shardy | doh! :( | 11:58 |
dciabrin | marios, hey hi, I'm updating https://review.openstack.org/#/c/325205 according to your comments | 11:58 |
EmilienM | shardy: https://github.com/ClusterLabs/resource-agents/commit/bbbc52e335967dae3e548fe8c17bb162b001147c.patch is the patch that caused this failure? | 11:59 |
shardy | EmilienM: No, it's a fix jistr made which hasn't yet been released | 11:59 |
jistr | EmilienM: no that's the one that was supposed to fix it :) | 11:59 |
shardy | we were hoping it might resolve the HA cluster related failures | 11:59 |
jistr | but we must be hitting something else i guess | 11:59 |
chem | jistr: shardy EmilienM last time I looked this morning I was hitting Error: Could not prefetch keystone_tenant provider 'openstack': Command: 'openstack ["project", "list", "--quiet", "--format", "csv", "--long"]' has been running for more then 20 seconds! | 12:00 |
*** bfournie has joined #tripleo | 12:01 | |
ccamacho | jistr, Spain lost against Italy and now you are telling me that, you are breaking my heart.. :P | 12:01 |
EmilienM | chem: it might be related to the cluster | 12:01 |
jistr | hehe | 12:01 |
EmilienM | chem: usually, this thing happens when VIP or service is not ready | 12:01 |
EmilienM | chem: and service is apache, managed by pacemaker | 12:01 |
chem | EmilienM: well, I discussed this withe last week, and it may related to poor performance on the cluster side. So I though I started something to be able to tweek timeout values for keystone provider : https://review.openstack.org/#/c/334011/ | 12:02 |
EmilienM | 20s is not enough? | 12:03 |
chem | EmilienM: well, it timeouts so it's not :) | 12:03 |
*** zoliXXL is now known as zoli|lunch | 12:03 | |
chem | EmilienM: or we are hitting something else, but at least pure timeout would be excluded (the cluster has some low performance node in it I was told) | 12:04 |
*** bfournie has quit IRC | 12:07 | |
slagle | EmilienM: any chance one of the recent puppet-keystone commits might be causing it? | 12:08 |
slagle | i don't see anything obvious | 12:08 |
*** numans has quit IRC | 12:08 | |
slagle | but maybe someone more familiar with it could check | 12:08 |
*** amoralej is now known as amoralej|lunch | 12:09 | |
*** jpich has joined #tripleo | 12:09 | |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
openstack | Launchpad bug 1596758 in tripleo "[CI down] RabbitMQ fails to form a cluster" [Critical,Confirmed] | 12:10 |
hewbrocca | worth grabbing a Rabbit expert to have a look ^^^ | 12:10 |
hewbrocca | ? | 12:10 |
EmilienM | slagle: yes maybe | 12:10 |
EmilienM | slagle: I'm currently investigating | 12:10 |
slagle | https://review.openstack.org/#/c/329807/ maybe? | 12:10 |
jistr | hmm interesting... looking at another CI job, rabbit formed a cluster fine there, and all pacemaker resources are started | 12:10 |
jistr | http://logs.openstack.org/86/334486/2/check-tripleo/gate-tripleo-ci-centos-7-ha/b79b36f/logs/overcloud-controller-0/var/log/host_info.txt.gz | 12:11 |
*** bfournie has joined #tripleo | 12:11 | |
chem | slagle: if you have the timeout error, then I dig into the log and they point to a simple transitional timeout, as later on some keystone provider achieve to create their resource. | 12:11 |
jistr | but still pingtest fails | 12:11 |
*** bfournie has quit IRC | 12:11 | |
*** bfournie has joined #tripleo | 12:11 | |
sshnaidm | weshay, the last failures I think are the patch problems, not CI, as I looked at it briefly | 12:11 |
EmilienM | https://review.openstack.org/#/q/project:openstack/puppet-keystone+status:merged++branch:master | 12:12 |
*** dtantsur|lunch is now known as dtantsur | 12:12 | |
slagle | this is the tb in keystone.log i'm seeing: http://paste.openstack.org/show/523769/ | 12:12 |
EmilienM | chem: recent commits didn't pass tripleo CI (for external reasons, so we might have injected a regression) | 12:12 |
slagle | from when puppet is running the "openstack token issue ..." | 12:13 |
*** lblanchard has joined #tripleo | 12:13 | |
chem | slagle: do you have the associated puppet run log ? | 12:14 |
chem | EmilienM: yep, but this timeout error is not a conection nor an identification problem, as they produce different type of message | 12:15 |
*** trown|outtypewww is now known as trown | 12:15 | |
EmilienM | right | 12:17 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 12:18 |
*** athomas has quit IRC | 12:18 | |
*** [1]cdearborn has joined #tripleo | 12:20 | |
slagle | chem: yes, the puppet logs are in the controller journal | 12:21 |
slagle | chem: you can download, http://logs.openstack.org/93/322893/12/check-tripleo/gate-tripleo-ci-centos-7-ha/0b6a39a/logs/overcloud-controller-0.tar.xz | 12:21 |
chem | slagle: you should check this file for puppet error : http://logs.openstack.org/93/322893/12/check-tripleo/gate-tripleo-ci-centos-7-ha/0b6a39a/logs/postci.txt.gz a bit easier on the eyes | 12:21 |
slagle | uncompress that, then do journalctl --file /var/log/journal/(some-uuid)/system.journal | 12:21 |
marios | dciabrin: ack thanks | 12:22 |
*** tosc_fiberdata has joined #tripleo | 12:22 | |
EmilienM | slagle: I first see Error: unable to connect to nodes ['rabbit@overcloud-controller-1']: nodedown\n\nDIAGNOSTICS\n===========\n\nattempted to contact | 12:22 |
*** athomas has joined #tripleo | 12:23 | |
EmilienM | and then: Error: /Stage[main]/Keystone::Roles::Admin/Keystone_user[admin]: Could not evaluate: Command: 'openstack ["token", "issue", ["--format", "value"]]' has been running for more ... | 12:23 |
EmilienM | but my theory is that it's because pacemaker didn't start httpd | 12:23 |
EmilienM | let me check if it did | 12:23 |
tosc_fiberdata | hello, tripleO and webgui? there was Tuskar-UI earlier, is there anything similar? | 12:25 |
EmilienM | tosc_fiberdata: https://github.com/openstack/tripleo-ui - ping jrist or akrivoka about it | 12:25 |
shardy | tosc_fiberdata: Hi! Yes, there is a new UI currently under development called tripleo-ui | 12:25 |
tosc_fiberdata | shardy, is it ready for production environments? | 12:26 |
*** aufi has quit IRC | 12:26 | |
EmilienM | chem, slagle: mhh, looking at httpd logs & pacemaker logs, httpd seems started | 12:26 |
shardy | tosc_fiberdata: Not yet, the CLI provided via python-tripleoclient is still the primary interface while we develop the UI for the newton cycle | 12:26 |
chem | slagle: EmilienM : httpd is started as latter on you have some resource created : Notice: /Stage[main]/Keystone::Endpoint/Keystone::Resource::Service_identity[keystone]/Keystone_service[keystone::identity]/ensure: created | 12:27 |
tosc_fiberdata | so there's no UI for mitaka? | 12:27 |
shardy | tosc_fiberdata: No, the CLI is the only supported/documented interface for mitaka | 12:27 |
tosc_fiberdata | we do not have a choice than to build the impossible heat-templates? :< | 12:27 |
tosc_fiberdata | ah okey | 12:28 |
shardy | tosc_fiberdata: you just do "openstack overcloud deploy --templates" | 12:28 |
d0ugal | More at http://docs.openstack.org/developer/tripleo-docs/basic_deployment/basic_deployment_cli.html | 12:28 |
shardy | there's some interaction with heat environment files to enable advanced features, but you don't have to hack on templates unless you wish to customize things or integrate stuff we don't yet support | 12:29 |
openstackgerrit | Keith Schincke proposed openstack/tripleo-heat-templates: Add support for deploying RGW on controllers. (Composable) https://review.openstack.org/289027 | 12:29 |
EmilienM | chem: http://paste.openstack.org/show/PV4E2UY2gEbtKHbFZrBQ/ | 12:29 |
EmilienM | it's in Notice, not in Error o_O | 12:30 |
chem | EmilienM: "notice" those are the non created resource, the error is there. If you look L10 of the paste, then you see that Keystone_service[keystone::identity]/ensure: created | 12:30 |
EmilienM | right, even the endpoint | 12:31 |
EmilienM | but look | 12:31 |
chem | EmilienM: they are not "skipped" because they don't depend on user admin | 12:31 |
EmilienM | it tries to create Keystone_user_role[admin@admin] before Keystone_user[admin] | 12:32 |
EmilienM | that's why I did https://review.openstack.org/332440 | 12:32 |
tosc_fiberdata | shardy, it's not alot of "just do". but we'll try to figure it out | 12:32 |
EmilienM | chem: you see Keystone_user in catalog? I don't | 12:33 |
chem | EmilienM: It's not true : /Stage[main]/Keystone::Roles::Admin/Keystone_user_role[admin@admin]: Dependency Keystone_user[admin] has failures: true | 12:33 |
EmilienM | something is skipping Keystone_user | 12:33 |
shardy | tosc_fiberdata: ack, well let us know if you have questions and we'll be happy to help | 12:33 |
EmilienM | so we don't have Keystone_user[admin] | 12:33 |
EmilienM | and everything related to roles & tenant fails, obviousl | 12:34 |
chem | EmilienM: it's in the stderr (they are unfortunatly splitted) | 12:34 |
EmilienM | obviously* | 12:34 |
EmilienM | chem: Keystone_user? | 12:34 |
chem | EmilienM: Error: /Stage[main]/Keystone::Roles::Admin/Keystone_user[admin]: Could not evaluate: Command: 'openstack ["token", "issue", ["--format", "value"]]' has been running for more then 20 seconds! | 12:34 |
EmilienM | ok so Keysne_user[admin] is timeouting and it causes serious damage in the catalog | 12:35 |
chem | EmilienM: I really think it's only a timeout on a very buzy undersized vm | 12:35 |
EmilienM | but keystone is running because we create endpoints & services | 12:35 |
chem | EmilienM: yeap, everything that depends on user admin is skipped | 12:35 |
EmilienM | chem: why wouldn't we have the timeout issue on services/endpoints? | 12:35 |
EmilienM | maybe the admin creation operation takes longer | 12:35 |
chem | EmilienM: because the load decreases | 12:35 |
chem | EmilienM: well ... that's my theory :) | 12:36 |
EmilienM | it's a good theory | 12:36 |
EmilienM | did you have something that works in puppet-keystone, so we can test it on ha job in OOO? | 12:36 |
EmilienM | otherwise I have an other idea | 12:37 |
EmilienM | we can just hardcode a bigger timeout in puppet/provider/openstack.rb | 12:37 |
EmilienM | and use Depends-On, for testing purpose | 12:37 |
chem | EmilienM: I'm going to trigger a test with a openstackcli timeout set to 60 seconds (hardcoded) and if useful, then maybe make one where the user can config timeout | 12:37 |
EmilienM | ok | 12:38 |
yolanda | hi, i have a question about tripleo-quickstart... i see some of the logs are kept on files inside undercloud and overcloud vms. Is there some way inside the script, to make it copy to a local path, so they can be published for example to a log server? if not, is that a feature that would be accepted? | 12:38 |
EmilienM | chem: I continue to read logs just a bit, to make sure it's not an orchestration issue | 12:38 |
*** cdearborn has joined #tripleo | 12:38 | |
*** fzdarsky|lunch has joined #tripleo | 12:38 | |
chem | EmilienM: ack, meanwhile I test my theory ... | 12:38 |
shardy | yolanda: Hi, I'd chat with trown and larsks about it - sounds like a useful option to me | 12:39 |
yolanda | our use case is that we run it on jenkins, and i'd like to have these logs available on the slave, so i can publish to a log server | 12:39 |
trown | yolanda: we have a log collection role external to tripleo-quickstart, just putting out some fires atm, but I could show you how to use it later | 12:39 |
*** links has quit IRC | 12:40 | |
yolanda | trown, thanks | 12:40 |
trown | yolanda: but there is a collect logs script in the ci-scripts dir that shows how we use it | 12:40 |
yolanda | i'll look at it | 12:40 |
EmilienM | chem: ok I found something | 12:41 |
EmilienM | chem: let me paste it | 12:41 |
*** lblanchard1 has joined #tripleo | 12:42 | |
*** bootsha has quit IRC | 12:43 | |
EmilienM | chem: http://paste.openstack.org/show/523773/ | 12:43 |
EmilienM | chem: pacemaker starts httpd AFTER Keysne_user | 12:43 |
EmilienM | so it makes sense to have this timeout, keystone is not ready | 12:43 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: DEBUG: testing increase timeout for tripleo CI. https://review.openstack.org/334997 | 12:43 |
EmilienM | we have this: https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/pacemaker/keystone.pp#L55 | 12:44 |
*** limao has joined #tripleo | 12:44 | |
EmilienM | but I wonder if it's enough | 12:44 |
*** lblanchard has quit IRC | 12:44 | |
chem | EmilienM: hum ... it's in the same minute. The socket is there as we would have a connection error in puppet provider, not a timeout. | 12:46 |
*** lblanchard has joined #tripleo | 12:46 | |
EmilienM | chem: and I just figured that the admin resource is created in a previous puppet run | 12:47 |
*** amoralej|lunch is now known as amoralej | 12:47 | |
*** limao_ has joined #tripleo | 12:48 | |
*** lblanchard1 has quit IRC | 12:48 | |
chem | EmilienM: yeap, in the error I've had, it was a description *modification* of the admin user, so it was there before | 12:48 |
EmilienM | chem: Pacemaker::Resource::Service[$::apache::params::service_name] -> Class['::keystone::roles::admin'] | 12:49 |
EmilienM | so we need to include ::apache::params before? | 12:49 |
*** xinwu has quit IRC | 12:49 | |
EmilienM | chem: yes because 2 things try to manage the admin user: bootstrap (using keystone-manage, doing mysql operation) and then puppet provider | 12:50 |
EmilienM | it's supposed to be idempotent because bootstrap is only triggered once | 12:50 |
jistr | i think we're dealing with 2 separate issues | 12:51 |
EmilienM | jistr: yeah, rabbitmq is still down | 12:51 |
chem | EmilienM: I don't think that ::apache::params:service_name is empty there, that would fails at compilation time I think | 12:51 |
jistr | this log does fail pingtest but it succeeds when clustering rabbitmq http://logs.openstack.org/86/334486/2/check-tripleo/gate-tripleo-ci-centos-7-ha/b79b36f/ | 12:51 |
jistr | EmilienM: ^ | 12:51 |
*** limao has quit IRC | 12:52 | |
*** links has joined #tripleo | 12:52 | |
EmilienM | jistr: ok, so we have the keystone and the rabbit thing | 12:52 |
*** olap has quit IRC | 12:53 | |
jistr | the interesting thing is that pingtest fails when trying to connect to TLS endpoint ports, but the HA and and upgrade jobs are supposed to be non-TLS | 12:53 |
*** [1]cdearborn has quit IRC | 12:53 | |
EmilienM | I thought everything was TLS in our CI | 12:53 |
EmilienM | an upgrade job was the only ipv6 job | 12:54 |
shardy | https://github.com/openstack-infra/tripleo-ci/blob/master/toci_gate_test.sh#L101 | 12:54 |
shardy | EmilienM: No, only the nonha job enables tls | 12:54 |
EmilienM | ok cool | 12:54 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart: Adds missing line continuation and eradown option https://review.openstack.org/334624 | 12:54 |
jistr | i think what might have happened is that this broke the endpoint init https://review.openstack.org/#/c/330096/ | 12:55 |
jistr | funny thing is that the CI is green on it | 12:55 |
jistr | so should i guess further, we may have an issue that changes to python-tripleoclient aren't tested properly? | 12:55 |
EmilienM | oh nice catch | 12:56 |
jistr | not sure what could collide with that patch | 12:56 |
shardy | jistr: can you reproduce locally with that patch applied? | 12:56 |
jistr | shardy: i don't have a master env right now at all :( working on downstream 8/9 | 12:56 |
*** akshai has joined #tripleo | 12:57 | |
openstackgerrit | Damien Ciabrini proposed openstack/tripleo-heat-templates: Dump and restore galera db during major upgrades https://review.openstack.org/325205 | 12:58 |
EmilienM | jistr: can we try to revert it? | 12:58 |
EmilienM | just to see how CI works | 12:58 |
openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient: Revert "Run post deploy config on force" https://review.openstack.org/335008 | 12:58 |
EmilienM | cool | 12:59 |
shardy | sure, I'm about to try it locally too | 12:59 |
*** jprovazn has quit IRC | 13:00 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart: Adds missing line continuation and teardown option https://review.openstack.org/334624 | 13:00 |
EmilienM | jistr: https://review.openstack.org/#/c/334486/2 | 13:00 |
EmilienM | even the backport is not passing CI | 13:01 |
EmilienM | http://logs.openstack.org/86/334486/2/check-tripleo/gate-tripleo-ci-centos-7-ha/b79b36f/console.html#_2016-06-27_17_19_54_532183 | 13:01 |
EmilienM | for the same reason | 13:01 |
EmilienM | so there is an high chance that this patch is the reason of the failures. | 13:01 |
EmilienM | and the thing that chem and I are investigating about keystone, looks like a random issue that our CI also hit sometimes | 13:02 |
jistr | shardy: cool, thanks. If there's an issue with master CI not testing tripleoclient changes for some reason, the CI on the revert will probably stay red. | 13:02 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: DEBUG: testing increase timeout for tripleo CI. https://review.openstack.org/334997 | 13:03 |
shardy | INFO:dlrn:Processing python-tripleoclient a97dc6b1588b6cffc12ed778c787c50865290def | 13:04 |
shardy | there was a dlrn issue last week wasnt there, where it built from master, not the commit from the local branch? | 13:04 |
shardy | that would explain it | 13:04 |
chem | EmilienM: for https://review.openstack.org/#/c/334997/ I set command timeout to 90s! | 13:04 |
EmilienM | chem: ok | 13:04 |
EmilienM | shardy: yes | 13:05 |
EmilienM | shardy: we had similar issue last week with a patch we land | 13:05 |
shardy | Ok, so we tested the wrong commit - at least that explains why CI didn't catch it | 13:05 |
*** egafford has joined #tripleo | 13:07 | |
openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient: [NO MERGE] test tripleoclient CI https://review.openstack.org/335013 | 13:08 |
EmilienM | shardy: that's why we had to revert the ceilometer composable services | 13:08 |
EmilienM | shardy: it seems like we injected a regression | 13:08 |
*** jpena|lunch is now known as jpena | 13:08 | |
*** lucas-hungry is now known as lucasagomes | 13:09 | |
shardy | EmilienM: ack - well that's unfortunate, but at least we know why | 13:09 |
jistr | shardy: ah ok, thanks for the info | 13:09 |
*** ooolpbot has joined #tripleo | 13:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 13:10 |
*** ooolpbot has quit IRC | 13:10 | |
openstack | Launchpad bug 1596758 in tripleo "[CI down] pingtest fails when accessing to OpenStack APIs" [Critical,Confirmed] | 13:10 |
sshnaidm | please, TripleO cores, look a the patch in your time, it fixes some of periodic jobs: https://review.openstack.org/#/c/334305/ | 13:12 |
*** xinwu has joined #tripleo | 13:13 | |
*** xinwu has quit IRC | 13:15 | |
*** tzumainn has joined #tripleo | 13:17 | |
sshnaidm | shardy, hi | 13:21 |
EmilienM | sshnaidm: right now, we're trying to bring master jobs back alive | 13:23 |
EmilienM | sshnaidm: but once it's fixed, we'll probably merge your patch is it's good & passing ci | 13:23 |
sshnaidm | EmilienM, sure, ok | 13:23 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 13:23 |
shardy | +1 getting master jobs working is the priority atm | 13:24 |
*** saneax has quit IRC | 13:25 | |
openstackgerrit | Matt Young proposed openstack/tripleo-quickstart: Fix gate failures due to change in provisioning behavior. https://review.openstack.org/334600 | 13:26 |
*** snecklifter has quit IRC | 13:28 | |
*** fzdarsky|lunch has quit IRC | 13:30 | |
*** jprovazn has joined #tripleo | 13:32 | |
*** bfournie1 has joined #tripleo | 13:35 | |
*** bfournie has quit IRC | 13:35 | |
*** oshvartz has quit IRC | 13:36 | |
jistr | i like that zuul hands out telnet connection info for monitoring pending CI jobs nowadays. very cool | 13:40 |
*** sanjayu has joined #tripleo | 13:40 | |
openstackgerrit | Martin André proposed openstack/tripleo-common: Allow running validation against different plans https://review.openstack.org/318194 | 13:40 |
openstackgerrit | Martin André proposed openstack/tripleo-common: Disable retry files for ansible validations https://review.openstack.org/329039 | 13:40 |
openstackgerrit | Martin André proposed openstack/tripleo-common: Validations actions and workbook https://review.openstack.org/313632 | 13:40 |
openstackgerrit | Martin André proposed openstack/tripleo-common: Deployment workflows for remote execution, etc. https://review.openstack.org/313953 | 13:40 |
hewbrocca | Ugh, so am I reading right that we think this issue may also be related to the delorean bug of last week? | 13:41 |
EmilienM | jistr: yeah, did you see the work that pabelanger did to open the link directly from browser? | 13:41 |
shardy | hewbrocca: yup looks that way | 13:41 |
EmilienM | hewbrocca: yes, we might have failed to catch a broken patch in our CI because of the dlrn bug (fixed now) | 13:41 |
hewbrocca | Ain't that a kick in the head | 13:42 |
jistr | EmilienM: hmm not yet :) i opened it in terminal | 13:42 |
EmilienM | jistr: let me find the procedure again | 13:42 |
hewbrocca | I guess there is a reasonable chance there are other bugs we might have missed this way? | 13:43 |
shardy | EmilienM: FYI I'm hitting a problem related to disabling the swift backend for glance | 13:43 |
shardy | even when a backend doesn't exist, glance won't let you delete images it can no longer access | 13:44 |
shardy | so I think I'll have to drop the DB and re-upload everything | 13:44 |
slagle | jistr: nice tip on the telnet access | 13:44 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart: Fix gate failures due to change in provisioning behavior. https://review.openstack.org/334600 | 13:44 |
slagle | that is hawt | 13:44 |
shardy | something we'll have to document if we leave that disabled | 13:44 |
EmilienM | slagle: https://etherpad.openstack.org/p/google-telnet | 13:44 |
*** zoli|lunch is now known as zoli|wfh | 13:45 | |
*** zoli|wfh is now known as zoliXXL | 13:45 | |
EmilienM | slagle: so you can open telnet directly from chrome | 13:45 |
EmilienM | slagle: https://etherpad.openstack.org/p/firefox-telnet if you use firefox | 13:45 |
weshay | hitting issues w/ newton master and bare metal https://bugs.launchpad.net/tripleo/+bug/1594897 | 13:47 |
openstack | Launchpad bug 1594897 in tripleo "Keystone authentication dies during introspection or deploy on baremetal hardware" [Undecided,New] | 13:47 |
*** r-mibu has quit IRC | 13:48 | |
*** r-mibu has joined #tripleo | 13:48 | |
*** pradk has joined #tripleo | 13:50 | |
EmilienM | tripleo meeting in 10 min, https://wiki.openstack.org/wiki/Meetings/TripleO -- please add One-off items if needed | 13:50 |
*** ayoung has joined #tripleo | 13:52 | |
*** rhallisey has quit IRC | 13:53 | |
*** rhallisey has joined #tripleo | 13:54 | |
sshnaidm | EmilienM, can we have etherpad for one-off items? The wiki doesn't accept new users anymore, it's impossible to add something there.. | 13:54 |
*** ebalduf has joined #tripleo | 13:54 | |
EmilienM | sshnaidm: sure, feel free to create one | 13:55 |
shardy | sshnaidm: yes we could create an etherpad and link it from the wiki | 13:55 |
sshnaidm | EmilienM, shardy how about this? https://etherpad.openstack.org/p/tripleo-meeting-items | 13:55 |
EmilienM | that's good (in puppet project, we have one etherpad per meeting, so we can easily keep track) | 13:56 |
EmilienM | see http://docs.openstack.org/developer/puppet-openstack-guide/meetings.html | 13:56 |
shardy | I think for now one etherpad should be OK, we can just add the latest meeting at the top and keep history from old meetings in the etherpad | 13:57 |
shardy | we generally have quite few one-off items | 13:58 |
*** bfournie has joined #tripleo | 13:58 | |
*** bfournie1 has quit IRC | 13:58 | |
ccamacho | Hey pradk, about the gnocchi submission. The db sync was executed before the service was configured causing the deployment issue, also several nits in the tht manifest, among those, issues like service_manage -> manage_service. All fixed, just finishing the HA deployment and I'll push the last change. | 13:59 |
thrash | /join #openstack-meeting-alt | 14:04 |
thrash | lol | 14:04 |
*** ooolpbot has joined #tripleo | 14:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 14:10 |
*** ooolpbot has quit IRC | 14:10 | |
openstack | Launchpad bug 1596758 in tripleo "[CI down] pingtest fails when accessing to OpenStack APIs" [Critical,Confirmed] | 14:10 |
*** tobias_fiberdata has joined #tripleo | 14:12 | |
*** tosc_fiberdata has quit IRC | 14:15 | |
*** rook_ has quit IRC | 14:18 | |
*** rook_ has joined #tripleo | 14:20 | |
*** rook_ has quit IRC | 14:21 | |
*** limao_ has quit IRC | 14:21 | |
*** limao has joined #tripleo | 14:21 | |
*** rajinir has joined #tripleo | 14:25 | |
*** itamarl has quit IRC | 14:26 | |
*** rhallisey has quit IRC | 14:27 | |
*** rhallisey has joined #tripleo | 14:28 | |
*** limao has quit IRC | 14:29 | |
*** rook_ has joined #tripleo | 14:30 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 14:31 |
*** noslzzp has joined #tripleo | 14:35 | |
beagles | shardy: it's actually pretty decent | 14:37 |
*** tremble has quit IRC | 14:37 | |
EmilienM | jistr: I'm telneting the revert and it fails on ha job | 14:38 |
*** links has quit IRC | 14:38 | |
*** rook_ has quit IRC | 14:39 | |
*** Larion has joined #tripleo | 14:40 | |
*** rook_ has joined #tripleo | 14:41 | |
*** saneax_AFK has joined #tripleo | 14:42 | |
*** saneax_AFK is now known as saneax | 14:42 | |
jrist | bnemec: is this available for general consumption? http://ucw-bnemec.rhcloud.com/ | 14:42 |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Add gnocchi profiles https://review.openstack.org/315527 | 14:43 |
*** tobias_fiberdata has quit IRC | 14:43 | |
*** aufi has joined #tripleo | 14:44 | |
derekh | trown: while I think of it, we're going to need to add a DNS entry for the IP you use when downloading the undercloud images for quickstack | 14:44 |
derekh | trown: that IP will be vanishing next week for a while | 14:44 |
jistr | EmilienM: yea it failed even before it got to pingtest... i wonder how the upgrades job will go | 14:45 |
bnemec | jrist: Yes, although I would like to find a more permanent home for it than my personal OpenShift account. | 14:46 |
trown | derekh: k but the mirror server will still be there with a different IP? | 14:46 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Gnocchi composable roles https://review.openstack.org/318413 | 14:47 |
EmilienM | ccamacho: what is http://mosquito-ccamacho.rhcloud.com/_plugin/tripleo-nit-finder/ ? | 14:47 |
EmilienM | what does it do? where is source code? | 14:47 |
derekh | trown: I can move the images onto rh2 to host them, while rh1 is down | 14:47 |
*** krotscheck_dcm is now known as krotscheck | 14:48 | |
*** mgould is now known as mgould|brb | 14:49 | |
ccamacho | EmilienM Hey is a plugin for elastic search to search in a nit database stored https://github.com/ccamacho/tripleo-nit-db is just a prototype | 14:50 |
d0ugal | jpeeler, rbrady: re: 329163, wont the cache only be invalidated when the mistral API is restarted? | 14:51 |
jpeeler | d0ugal: is there a invalidation comment somewhere else i'm missing? would it matter if the cache is lost when restarting? | 14:53 |
d0ugal | jpeeler, rbrady: sorry, got distracted by a phone call. | 14:55 |
hewbrocca | It was Nicola Sturgeon calling | 14:55 |
d0ugal | jpeeler, rbrady: I am more concerned that the clients will stop working after 4 hours when the token times out | 14:55 |
jpeeler | oh i see... | 14:56 |
d0ugal | jpeeler, rbrady: sorry, not times out, but expires. | 14:56 |
d0ugal | hewbrocca: aye, we will sort things out yet. | 14:56 |
d0ugal | jpeeler: I think 4 hours is the default timeout. | 14:56 |
openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Add 'openstack overcloud node provide' command https://review.openstack.org/334411 | 14:56 |
jpeeler | yeah that's a fair concern | 14:56 |
rbrady | jpeeler, dmatthews: this is where we should extract the same code from heat that deals with this exact issue | 14:57 |
sanjayu | to a noob, what is oooq? | 14:57 |
hewbrocca | LOL | 14:57 |
d0ugal | rbrady: aha, I didn't know heat done this. That sounds useful :) | 14:58 |
rook | shadower working on my first set of validation conversions, however I am concerned with the tripleo-ansible-invetory -- it seem pretty limited. | 14:58 |
rook | shadower, the script works great when you are on the undercloud, but outside of that, no dice. | 14:58 |
rook | shadower: maybe it is my setup that is causing this issue? | 14:58 |
weshay | EmilienM, so I'm trying to think of another service we're bringing up | 15:00 |
EmilienM | weshay: do you mind continuing | 15:00 |
weshay | we're only walking the docs w/ quickstart | 15:00 |
EmilienM | just to make sure I understand | 15:00 |
EmilienM | weshay: wait, I have puppet meeting on IRC also now | 15:00 |
weshay | leifmadsen, rlandy you guys should chat re: https://github.com/redhat-openstack/?utf8=%E2%9C%93&query=baremetal | 15:01 |
EmilienM | we have no topic, I'll cancel it | 15:01 |
weshay | lol | 15:01 |
*** fzdarsky has joined #tripleo | 15:01 | |
trown | I think there also needs to be a distinction between tripleo-quickstart and the external roles folks are developing that use the base it sets up | 15:01 |
leifmadsen | weshay: thanks, checking it out | 15:01 |
rook | weshay leifmadsen can fill a room with hot air, watch out | 15:01 |
leifmadsen | basically, I just have a use case internally for oooq to deploy onto baremetal | 15:01 |
rook | :) | 15:01 |
weshay | lol | 15:01 |
leifmadsen | rook: I will cut you | 15:01 |
leifmadsen | <3 | 15:02 |
weshay | leifmadsen, k.. rlandy is deploying internal jobs w/ it now.. | 15:02 |
rook | back atcha | 15:02 |
*** bfournie1 has joined #tripleo | 15:02 | |
*** bfournie has quit IRC | 15:02 | |
leifmadsen | so this is independent work of oooq? | 15:03 |
*** noslzzp has quit IRC | 15:03 | |
trown | leifmadsen: ya | 15:03 |
weshay | it's outside of the openstack/tripleo-quickstart repo yes.. but it uses quickstart | 15:03 |
leifmadsen | ahhh ok | 15:03 |
leifmadsen | that's fine | 15:03 |
trown | leifmadsen: tripleo-quickstart has been constructed to allow plugging in external ansible roles for added functionality | 15:03 |
*** noslzzp has joined #tripleo | 15:03 | |
leifmadsen | ahhhh ok that makes sense | 15:03 |
weshay | rlandy, can you point leifmadsen at one of your internal jobs on an internal channel | 15:03 |
*** [1]cdearborn has joined #tripleo | 15:04 | |
weshay | leifmadsen, roles are dropped into the role path w/ python setuptools | 15:04 |
leifmadsen | rlandy: you can use #nfvpe internal | 15:04 |
EmilienM | weshay: ok back (no puppet meeting this week) | 15:04 |
trown | there has been a bit of an explosion of said roles as more people try to use it for their particular use case | 15:04 |
weshay | EmilienM, elloo | 15:04 |
myoung | leifmadsen: additional roles via pip install / egg style mechanism(s) | 15:04 |
leifmadsen | I guess that means oooq is useful / extensible? :) | 15:04 |
leifmadsen | +1 | 15:04 |
trown | leifmadsen: that is how I would interpret it :) | 15:04 |
EmilienM | weshay: so I know you don't control IPA role, but I was wondering if oooq would be a new cool place where I can put new roles that can't live on instack-undercloud | 15:04 |
openstackgerrit | Merged openstack/diskimage-builder: Convert element_dependencies to logging https://review.openstack.org/328072 | 15:04 |
EmilienM | and if yes ^ I don't think it's the right thing, we should rather investigate making instack undercloud multi node, so we have consistency in the way we deploy services (puppet, etc) | 15:05 |
weshay | EmilienM, I suppose yes.. I don't want offend anyone w/ roles, but one could do that | 15:05 |
*** bfournie1 has quit IRC | 15:05 | |
*** bfournie has joined #tripleo | 15:05 | |
weshay | EmilienM, certainly we could encourage people to do that if that would help | 15:05 |
weshay | we could create role policy, what is appropriate, what is not | 15:05 |
weshay | etc | 15:05 |
rlandy | leifmadsen: sending links | 15:06 |
leifmadsen | thx | 15:06 |
weshay | EmilienM, I think that is what you are getting at right? | 15:06 |
trown | EmilienM: I think that is a bit putting the cart before the horse in the IPA case though. ie you tell ayoung he has to rework that stuff yet again :P | 15:06 |
ayoung | trown, EmilienM I'm flexible | 15:06 |
ayoung | so long as we have a clear path, I want to do what makes sense long term | 15:07 |
*** bfournie has quit IRC | 15:07 | |
trown | EmilienM: for the developer use case, it makes sense if someone creates a role that sets up the extra pieces of their developer environment they need to test against | 15:07 |
rbrady | jpeeler, dmatthews: this is the code I'm talking about wrt to heat. I think this is something that needs to be in mistral instead of tripleo-common. https://github.com/openstack/heat/blob/master/heat/engine/clients/client_plugin.py#L140-L168 | 15:07 |
EmilienM | no I don't tell anyone to rework anything | 15:07 |
*** bfournie has joined #tripleo | 15:07 | |
EmilienM | I'm trying to understand the scope of oooq | 15:07 |
ayoung | EmilienM, it sounds like they want the roles external to OOOqs. I think I can live with that. The roles I was building were going into Rippowam origianlly | 15:07 |
*** fzdarsky has quit IRC | 15:07 | |
trown | EmilienM: that doesn't mean it needs to go in-tree and muddy the basic case, but it allows them to develop their features for tripleo | 15:08 |
slagle | trown: hey, so how i personally envinsion a potentialy switch to oooq one day in tripleo-ci would be start incrementally, such as maybe replacing tripleo.sh --repo-setup with the oooq equivalent (if there is one) | 15:08 |
EmilienM | to me, it's to easily setup a tripleo dev env | 15:08 |
slagle | trown: or tripleo.sh --undercloud | 15:08 |
ayoung | So I could see packing up our roles in an egg the same way that the tripleo-inventory role is done, and having quickstart call it | 15:08 |
EmilienM | but setting up IPA server is IMHO out of scope | 15:08 |
ayoung | jmiu is actually looking in to that right now | 15:08 |
slagle | trown: i dont know if that is in line with other's ideas or not | 15:08 |
EmilienM | it's like if ayoung would patch tripleo-ci to deploy IPA server | 15:08 |
EmilienM | it does not make sense ^ | 15:08 |
EmilienM | I would rather use instack-undercloud or THT for that | 15:08 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 15:09 |
trown | slagle: ya repo setup is not a great example because oooq is image based | 15:09 |
EmilienM | jistr: Stack overcloud UPDATE_FAILED on the revert | 15:09 |
EmilienM | jistr: damn | 15:09 |
jpeeler | rbrady: well, if the code needs additional work AND needs to be in mistral, i can just abandon the review | 15:09 |
EmilienM | we might have another issue | 15:09 |
trown | slagle: but using the undercloud role via tripleo.sh would be possible | 15:09 |
ayoung | the IPA server is an optional component. I was using the undercloud image to start, and installing IPA on top of that | 15:09 |
EmilienM | jistr: /me analyzing logs now http://logs.openstack.org/08/335008/1/check-tripleo/gate-tripleo-ci-centos-7-ha/5248ea6/ | 15:09 |
EmilienM | ayoung: that's my whole point | 15:09 |
EmilienM | ayoung: why not using instack-undercloud then? | 15:09 |
EmilienM | jistr, chem: I'm hitting the keystone timeout issue :- | 15:10 |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
openstack | Launchpad bug 1596758 in tripleo "[CI down] pingtest fails when accessing to OpenStack APIs" [Critical,Confirmed] | 15:10 |
leifmadsen | rlandy: where should I be expecting said links? | 15:10 |
ayoung | EmilienM, does that install the IPA server on the undercloud? I was just reusing the image | 15:10 |
*** sanjayu has quit IRC | 15:10 | |
EmilienM | http://logs.openstack.org/08/335008/1/check-tripleo/gate-tripleo-ci-centos-7-ha/5248ea6/logs/postci.txt.gz#_2016-06-28_14_32_52_000 | 15:10 |
rbrady | jpeeler: while it should be in mistral, the answer to the questions of where and when are probably in the result of the changes coming from the custom-actions-api we will be working on. | 15:10 |
shardy | EmilienM: IMO we should not be using instack-undercloud to deploy additional custom things | 15:10 |
slagle | trown: or we could even replace the guts of tripleo.sh --undercloud with a call to oooq to do the undercloud role | 15:10 |
shardy | EmilienM: That's the use-case we expect to solve via custom roles in t-h-t | 15:10 |
EmilienM | shardy: why that? | 15:10 |
slagle | trown: then eventually kill all of tripleo.sh | 15:10 |
ayoung | but it is in a separate VM. Swift, Keystone and IPA compete for Web resources, not worth trying to deconflict them | 15:10 |
slagle | if that's the direction we end up | 15:10 |
EmilienM | shardy: 100% agree | 15:10 |
trown | slagle: right that makes sense | 15:10 |
EmilienM | shardy: I could have not said better | 15:11 |
EmilienM | shardy: but it seems sometimes some services are required before deploying overcloud | 15:11 |
EmilienM | shardy: maybe the case of IPA server | 15:11 |
shardy | EmilienM: That's fine, custom roles will include a way to define dependencies | 15:11 |
ayoung | EmilienM, I opened this: https://github.com/redhat-openstack/ansible-role-tripleo-inventory/issues/1 | 15:11 |
social | marios: btw I have pupet-ironic change that conflicts with instack-undercloud puppet, can I just drop the stuff from instack undercloud or make some by-pass change? | 15:11 |
rlandy | leifmadsen: just pinged you on internal | 15:11 |
shardy | so you can say e.g deploy IPAController role before Controller and everything else | 15:11 |
leifmadsen | +1 | 15:11 |
trown | slagle: we could add the repo setup parts too, though I think I would take bnemec's python tool over what is in tripleo.sh for that | 15:12 |
chem | EmilienM: jistr: well, right this https://review.openstack.org/#/c/334997/ has not landed yet, but I'm kind of confident that increase timeout is the solution | 15:12 |
ayoung | live this http://docs.ansible.com/ansible/playbooks_roles.html#role-dependencies? | 15:12 |
*** noslzzp has quit IRC | 15:12 | |
marios | social: comment on the review would be easier (also, on scrum, sorry for slow repsonse) | 15:12 |
trown | slagle: but right now, repo setup is done at image creation, so tripleo-quickstart doesnt do any of that | 15:13 |
marios | social: easier for discussino i mean | 15:13 |
*** jistr is now known as jistr|mtg | 15:13 | |
chem | EmilienM: if it's green I will change my review to hardcore 60 s command timeout, I don't have time currently to make a nice interface in all consumers of puppet-openstackcli (massive change) | 15:13 |
slagle | trown: ok | 15:13 |
EmilienM | chem: it's failing HA job | 15:13 |
shardy | ayoung: no, like this: https://review.openstack.org/#/c/315679/6/overcloud.yaml | 15:13 |
slagle | trown: maybe we could align that somehow | 15:13 |
*** milan has quit IRC | 15:13 | |
EmilienM | chem: you need to depends-on the revert patch ;-) | 15:13 |
slagle | trown: make all the things use dlrn-repo | 15:14 |
shardy | ayoung: you would have a new item added to RoleData that enables building an extra node (or cluster) running whatever you want | 15:14 |
EmilienM | chem: try again with https://review.openstack.org/#/c/335008/ | 15:14 |
EmilienM | chem: depends-on ^ | 15:14 |
trown | slagle: I would like to complete the blueprint for importing tripleo-quickstart that only has a few fixes needed for the developer workflow, and then posting some docs patches for virt environment in tripleo-docs | 15:14 |
shardy | it's not about ansible as tripleo doesn't deploy and manage nodes via ansible | 15:14 |
*** fzdarsky has joined #tripleo | 15:14 | |
ayoung | shardy, ah we were talking quickstar before | 15:14 |
trown | slagle: then I could create a new blueprint for replacing tripleo.sh? | 15:14 |
trown | slagle: +1 to having image building use dlrn-repo | 15:15 |
d0ugal | rbrady: cool, that code looks good. Linked to it from the review. | 15:15 |
ayoung | shardy, I've been focused on getting IPA to run in the undercloud. I see it as an external service | 15:15 |
shardy | ayoung: Yeah, the argument is you shouldn't be using quickstart to deploy anything the deployed overcloud depends on | 15:15 |
slagle | trown: yea, probably worth a ML thread about tripleo.sh future, etc | 15:15 |
shardy | ayoung: that's fine, but it's something completely outside of tripleo | 15:15 |
trown | slagle: k, will start with ML | 15:15 |
slagle | see if there is agreement on a path forward | 15:15 |
ayoung | shardy, so, what Tripleo needs is a CA first off | 15:15 |
chem | EmilienM: can you share you zuulfu so that I can see the log, I'm afraid the depends-on was not correct (I had to change it some time after). Will add the revert in the mix as well. | 15:15 |
rbrady | jpeeler, dmatthews: right now we use the mistral.context to get access to an auth_token. that codes is here: https://github.com/openstack/mistral/blob/master/mistral/context.py | 15:15 |
ayoung | LDAP is a standard integratin, and so Tripleo needs a way to test-setup LDAP integration | 15:16 |
slagle | trown: i think tripleo-docs is part of the discussion as well | 15:16 |
ayoung | its why quickstart..this was starting as a QE/integration effort | 15:16 |
EmilienM | chem: zuul.openstack.org | 15:16 |
chem | hehe | 15:16 |
slagle | trown: somehow get that aligned with what everyone actually uses | 15:16 |
ayoung | for the CA...I'm starting to thing the upstream answer is Anchor | 15:16 |
shardy | ayoung: Ok, cool, if it's only for CI then perhaps it makes sense | 15:16 |
ayoung | we do anchor as a baseline, FreeIPA is an upgrade | 15:16 |
EmilienM | chem: and https://etherpad.openstack.org/p/google-telnet if you want to see zuul logs in one click or https://etherpad.openstack.org/p/firefox-telnet | 15:16 |
shardy | ayoung: the concern, I think, is that folks might abuse that method to "integrate" deployment of additional custom roles | 15:16 |
chem | EmilienM: O_o ... amazed | 15:17 |
trown | slagle: ya, right now tripleo-docs virt instructions are a mess though, so any patches there that describe something that actually works would be an improvement | 15:17 |
chem | EmilienM: thanks | 15:17 |
weshay | hrybacki, ^ | 15:17 |
ayoung | shardy, right now I would settle for a positive thread test of geting IPA and Keycloak integrated with Tripleo | 15:17 |
trown | slagle: and replacing virt section with tripleo-quickstart was already aproved with the spec | 15:17 |
d0ugal | rbrady, jpeeler: if we want to improve this in mistral, I would be happy with a naieve cache for now. Even if we only cache for 30 mins or an hour, we are safe and it will be much better than creating clients on each execution. | 15:17 |
*** aufi has quit IRC | 15:17 | |
*** cdearborn has quit IRC | 15:17 | |
ayoung | we need to sort the TLS/CA Cert story | 15:17 |
slagle | trown: yea, no issue from me with completing the initial plan around replacing virt-setup | 15:17 |
ayoung | Self signed does not work for a multi-node environment | 15:18 |
hrybacki | weshay: beginning travels | 15:18 |
shardy | ayoung: sure, but that's a broader issue vs using quickstart beyond it's original remit, which was to bootstrap virt tripleo environments | 15:18 |
jpeeler | d0ugal: so you mean, simply force refresh at a threshold way under the expiration time? | 15:18 |
weshay | hrybacki, roger.. take care | 15:18 |
hrybacki | weshay++ will keep an eye on the channel and respond when I can | 15:18 |
d0ugal | jpeeler: Yeah, I think that would be a reasonable compromise. | 15:18 |
d0ugal | jpeeler: ... but if it is easy to land a fix in mistral that can help us, we should do that. My guess is that it isn't :) | 15:19 |
ayoung | shardy, so, if an organziation has an IPA server,they should be able to use it. If they don't they need a CA for tripleo. I was going to start by using Quickstart to setup the IPA server to support that first use case | 15:19 |
*** hrybacki is now known as hrybacki|afk | 15:19 | |
ayoung | We can't wait until overcloud deploy as the undercloud would lack a CA | 15:19 |
rbrady | d0ugal: the cache here would be scoped with the lifetime of the action instance, right? | 15:20 |
ayoung | I'd love to stick the IPA server on the undercloud, but the only way I can dothat right now is via containers, and we don't do containers | 15:20 |
*** mgould|brb is now known as mgould | 15:20 | |
shardy | ayoung: what happens if the undercloud goes down when the overcloud is deployed? | 15:20 |
*** jtomasek_ has quit IRC | 15:20 | |
ayoung | shardy, for TLS it is not too catastrophic | 15:20 |
shardy | ayoung: we explicitly avoid any hard dependencies between the overcloud and the undercloud, because it's a single point of failure | 15:21 |
d0ugal | rbrady: Yeah, it will. I missed that. Is a new action instance created for each execution? | 15:21 |
ayoung | Certs tend to be long lived, and so you don't need to fetch the CA cert or issue new certs on a daily bais | 15:21 |
ayoung | basis | 15:21 |
shardy | ayoung: ack, Ok maybe that will work then | 15:21 |
shardy | ayoung: as EmilienM said earlier tho, if it's integrating a new service that will run on the undercloud, the proper integration point is instack-undercloud not tripleo-quickstart | 15:22 |
ayoung | shardy, so...I think that for Upstream, we look to using Anchor. And for the cases where, for whatever reason, IPA is too heavy weight | 15:22 |
d0ugal | rbrady: even if it is, we may hit the issue eventually. We had this problem in the CLI as some deploys took more than 4 hours. | 15:22 |
*** myoung is now known as myoung|brb | 15:22 | |
ayoung | Anchor has the short-term cert approach, so it shouldn';t bee allowed to go down for too long | 15:22 |
ayoung | but for a "better self signed" I think it is appropriate | 15:22 |
ayoung | I build one in a COPR | 15:22 |
ayoung | https://copr.fedorainfracloud.org/coprs/admiyo/anchor/ | 15:23 |
ayoung | and some HP folks were working on a certmonger plugin | 15:23 |
ayoung | https://copr.fedorainfracloud.org/coprs/admiyo/anchor-certmonger-helper/ | 15:23 |
*** mcornea has quit IRC | 15:23 | |
ayoung | the goal here is to say "certmonger is our certificate management interface" with Anchor be a placeholder for an organizations own CA processes | 15:24 |
ayoung | And IPA being the "we need something real and don't have one yet" solution | 15:24 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: DEBUG: testing increase timeout for tripleo CI. https://review.openstack.org/334997 | 15:24 |
EmilienM | shardy: that was my point, thx for confirming | 15:24 |
trown | shardy: EmilienM, for bootstrapping said service, what is the difference between a personal ansible role repo, and a personal fork of instack-undercloud? | 15:25 |
trown | so long as that work is not going into quickstart proper, it feels the same to me | 15:26 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 15:26 |
shardy | trown: the main difference is it'll have to be rewritten if we ever want to land actual support for it in TripleO | 15:26 |
EmilienM | trown: neither of both solutions look clean to me | 15:26 |
shardy | because we can't configure the undercloud services with both puppet and ansible | 15:26 |
EmilienM | if we want the feature in the product, let's make it usable & testable by everyone | 15:26 |
shardy | right now all undercloud services are configured via puppet, so IMO it doesn't make sense to hack extra stuff in via ansible, unless it's temporary dev only stuff | 15:27 |
rbrady | dmatthews, jpeeler: I think this is where the action lifecycle is: https://github.com/openstack/mistral/blob/master/mistral/engine/default_executor.py#L63-L106 | 15:27 |
trown | shardy: right 100% agree, I just saw it as temporary dev only stuff | 15:28 |
shardy | trown: Ok, I thought there was discussion around using it in CI etc | 15:28 |
EmilienM | shardy: right | 15:28 |
sshnaidm | shardy, can I be added to https://launchpad.net/~tripleo-drivers please ? | 15:28 |
rbrady | dmatthews, jpeeler: If there is an error or action is synchronous, it returns immediately after action runs. No idea on how long action can run for. looking for timeout | 15:28 |
EmilienM | as long as we don't teach people to use OOOQ as a place to put stuffs we could do in THT | 15:29 |
EmilienM | that was my whole point ^ | 15:29 |
shardy | sshnaidm: yes, what's your launchpad ID? | 15:29 |
sshnaidm | shardy, sshnaidm | 15:29 |
trown | EmilienM: I dont think that has happened, at least not in the roles I am aware of | 15:29 |
trown | roles being the ansible term "roles" | 15:29 |
shardy | sshnaidm: hehe, I should have tried that :) | 15:29 |
shardy | done | 15:29 |
EmilienM | trown: excellent then | 15:29 |
sshnaidm | shardy, thanks :) | 15:29 |
trown | EmilienM: I do have to admit to not understanding the IPA work at all though :P | 15:30 |
trown | I did not understand it needed anything on the undercloud for instance | 15:31 |
jokke_ | me is really happy that this OOOQ discussion happened as that explained the link between ansible roles vs puppet modules vs. tripleo roles | 15:31 |
trown | I thought it just needed some external servers setup (that would exist as real servers in a production environment0 | 15:31 |
jokke_ | s/me/\/me/ ;) | 15:31 |
trown | jokke_: ya, the overloading of the term roles is pretty confusing | 15:32 |
trown | roles are just the building blocks in ansible equivalent to modules in puppet | 15:32 |
*** jistr|mtg is now known as jistr | 15:32 | |
jokke_ | trown: specially when I spent past year heavily involved in ansible OpenStack deployer before joining RH and tripleO saga | 15:32 |
jistr | EmilienM: i rechecked the tripleoclient revert. Neither of the jobs got far enough to actually show if the revert helps or not. | 15:33 |
trown | jokke_: ah, so it is the reverse that is confusing for you (tripleo use of term roles) | 15:33 |
EmilienM | jistr: I think it's related to the issue we have with keystone (chem has a patch for it) | 15:34 |
jokke_ | trown: yeah ... so this discussion opened the big confusion I had in the tripleO side ;) | 15:34 |
EmilienM | we're currently hitting 2 issues: the tripleoclient and the keystone timeout thing | 15:34 |
*** ebarrera has quit IRC | 15:34 | |
EmilienM | trown: no problem :) | 15:34 |
jistr | EmilienM: i see, reading what chem posted earlier | 15:34 |
jistr | this https://review.openstack.org/#/c/334996/ | 15:34 |
jistr | and the test patch on top. good idea | 15:34 |
*** panda has quit IRC | 15:34 | |
jistr | chem++ | 15:34 |
*** panda has joined #tripleo | 15:35 | |
trown | EmilienM: what is the keystone timeout? is that the same that RDO hits on the slower nodes in centos ci? | 15:35 |
chem | trown: EmilienM I think that's the same, yes | 15:36 |
EmilienM | trown: yes | 15:36 |
trown | chem: so we see that in tripleo-ci? | 15:36 |
chem | trown: yeap | 15:36 |
trown | that is purely resource based, ie I cant reproduce it locally, and it does not happen on the fast nodes in centos ci | 15:36 |
chem | trown: we're testing this https://review.openstack.org/#/c/334996/ in https://review.openstack.org/#/c/334997/ | 15:37 |
*** dsariel has quit IRC | 15:37 | |
trown | so I guess we have once again pushed the limits of tripleo-ci in terms of how many envs we can host per virthost | 15:37 |
chem | trown: making the timeout option available for puppet provider is kind of a big change, and I may tackle ... at a later time :) https://review.openstack.org/334011 | 15:38 |
trown | chem: dont we need to bump request_timeout too? it seems like it is command_timeout x retries? | 15:39 |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add tests for building *-minimal images https://review.openstack.org/181162 | 15:39 |
chem | trown: nope. request_timeout x retries | 15:39 |
trown | oh that is retry_sleep anyways not retries | 15:40 |
chem | trown: If my memory is right ... | 15:40 |
trown | just saw 20,60,3 and seemed like [1] = [0]x[2] | 15:41 |
EmilienM | chem: maybe we can just increase default to 90 and make it configurable in a next iteration | 15:41 |
EmilienM | we might want to bring our CI back asap | 15:42 |
chem | trown: command_timeout if for "openstack" command and request timeout is for "request" command, here, each time we had a timeout it was for the openstack command, not the request one | 15:42 |
chem | EmilienM: that's my thinking as well | 15:42 |
*** myoung|brb is now known as myoung | 15:42 | |
*** dmk0202 has quit IRC | 15:42 | |
chem | EmilienM: I've restarted the test adding the depends-on you pointed to me | 15:42 |
trown | oh, but actually on line 33 it says "retry the command until the request_timeout," so I think that means we will never retry if command_timeout > request_timeout | 15:42 |
trown | not sure if we need retries in that case or not | 15:43 |
EmilienM | chem: ok if https://review.openstack.org/#/c/334997/ pass CI, I propose we merge both patches in Depends-On | 15:44 |
chem | EmilienM: ack | 15:44 |
EmilienM | chem: and in next iteration, you finish your patch on timeout option in puppet-keystone | 15:44 |
EmilienM | chem: and we figure pradk's patch again | 15:44 |
EmilienM | chem: thx | 15:44 |
chem | EmilienM: looks like a good plan.... let's hope it's passing ci as expected now :) | 15:44 |
EmilienM | yeah | 15:44 |
*** rhallisey has quit IRC | 15:45 | |
chem | EmilienM: that's so cool : nc 66.187.229.91 8088 | 15:45 |
EmilienM | chem: I clock on zuul.o.o :) | 15:46 |
EmilienM | chem: with the script pabelanger wrote, you can directly open a terminal from your browser | 15:46 |
*** rhallisey has joined #tripleo | 15:46 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: check the overcloud_deployment_result variable to determine playbook exit https://review.openstack.org/333997 | 15:46 |
*** zoliXXL is now known as zoli|gone | 15:46 | |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Perform a booting test for our images https://review.openstack.org/204639 | 15:47 |
*** zoli|gone is now known as zoli_gone-proxy | 15:47 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 15:53 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart: Fix gate failures due to change in provisioning behavior. https://review.openstack.org/334600 | 15:55 |
openstackgerrit | Merged openstack/tripleo-quickstart: Fix gate failures due to change in provisioning behavior. https://review.openstack.org/334600 | 15:56 |
*** tesseract- has quit IRC | 15:56 | |
*** abehl has quit IRC | 15:57 | |
*** ifarkas has quit IRC | 15:58 | |
pradk | jistr, i think ssl_port might be the cause.. I do the pop before initialize.. perhaps i should do it after | 16:06 |
pradk | jistr, i'll try a test patch and see | 16:06 |
*** ooolpbot has joined #tripleo | 16:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 16:10 |
*** ooolpbot has quit IRC | 16:10 | |
openstack | Launchpad bug 1596758 in tripleo "[CI down] pingtest fails when accessing to OpenStack APIs" [Critical,Confirmed] | 16:10 |
chem | trown: you're right the timeout exclude any retry. That's bad, I'm updating the review with saner default. | 16:11 |
*** fzdarsky has quit IRC | 16:15 | |
openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient: Fix ssl port removal to happen after keystone init https://review.openstack.org/335115 | 16:16 |
pradk | jistr, EmilienM, ^^ lets see what this does | 16:16 |
pradk | we might not have to revert the whole thing if this works | 16:17 |
*** fzdarsky has joined #tripleo | 16:19 | |
*** sshnaidm has quit IRC | 16:22 | |
chem | trown: I've adjusted {comand/request}_timeout to have 8 retries within 3 mins, instead of 3 retries within 66s | 16:22 |
trown | chem: sweet, I guess if it takes more than three minutes to create a tenant in keystone that is a legit problem | 16:23 |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add support for remote element repos https://review.openstack.org/331392 | 16:23 |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Move hook generation in to python https://review.openstack.org/271139 | 16:23 |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Move hook generation in to python https://review.openstack.org/271139 | 16:26 |
chem | trown: hehe. Actually, it's can be any command really, that comes after all pacemaker resource creation. I had it with 'openstack ["token", "issue" ....' | 16:27 |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add support for remote element repos https://review.openstack.org/331392 | 16:28 |
* EmilienM afk lunch | 16:28 | |
*** osp has quit IRC | 16:31 | |
*** derekh has quit IRC | 16:31 | |
*** jpich has quit IRC | 16:31 | |
*** Jabadia has joined #tripleo | 16:36 | |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates: Enable IPv4/IPv6 dual-stack Public API endpoints https://review.openstack.org/289279 | 16:37 |
rook | shadower: happen to be around? | 16:44 |
*** fzdarsky has quit IRC | 16:47 | |
*** noslzzp has joined #tripleo | 16:49 | |
*** noslzzp has quit IRC | 16:49 | |
*** noslzzp has joined #tripleo | 16:49 | |
*** pcaruana has quit IRC | 16:49 | |
*** yamahata has quit IRC | 16:54 | |
*** yamahata has joined #tripleo | 16:55 | |
*** rasca has quit IRC | 16:55 | |
*** noslzzp has quit IRC | 16:56 | |
EmilienM | chem: you sent new patchsets to puppet-openstacklib, so we need to retrigger the tht patch | 16:57 |
EmilienM | 334997 is not in zuul anymore | 16:57 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: DEBUG: testing increase timeout for tripleo CI. https://review.openstack.org/334997 | 16:58 |
EmilienM | doing it ^ | 16:58 |
EmilienM | pradk: can you depends on https://review.openstack.org/#/c/334996/4 ? | 16:59 |
EmilienM | pradk: we're tracking down another CI issue | 16:59 |
EmilienM | so you might need this one to have green jobs | 16:59 |
pradk | EmilienM, sure should i wait for this to be green ? | 17:00 |
EmilienM | pradk: no it's ok | 17:00 |
EmilienM | pradk: go ahead and push with dependson | 17:00 |
pradk | ok | 17:00 |
*** yamahata has quit IRC | 17:00 | |
EmilienM | we'll have early feedback | 17:01 |
marios | shardy: sorry about earlier in meeting have been on the phone for far too long today :( and had an overlap at halfway through the upstream meet. wrt https://blueprints.launchpad.net/tripleo/+spec/overcloud-upgrades-workflow-mitaka-to-newton it is actually in progress already, will update it tomorrow (there is a bunch of pointers to bugs+reviews on the bp )... i just moved to good progress... no blockers at | 17:01 |
marios | m, am currenlty investigating https://bugs.launchpad.net/tripleo/+bug/1596950 | 17:01 |
openstack | Launchpad bug 1596950 in tripleo "undercloud upgrade from stable/mitaka to latest hangs - possibly for swift services yet tbd" [Medium,Triaged] - Assigned to Marios Andreou (marios-b) | 17:01 |
shardy | marios: ack, thanks for the update! | 17:01 |
marios | shardy: lol, i should hit return more often :) | 17:01 |
*** noslzzp has joined #tripleo | 17:02 | |
* marios eod | 17:02 | |
openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient: Fix ssl port removal to happen after keystone init https://review.openstack.org/335115 | 17:02 |
pradk | EmilienM, done | 17:02 |
EmilienM | thx | 17:03 |
*** noslzzp has quit IRC | 17:03 | |
*** noslzzp has joined #tripleo | 17:04 | |
*** tosky has quit IRC | 17:06 | |
*** tosky has joined #tripleo | 17:07 | |
*** ooolpbot has joined #tripleo | 17:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 17:10 |
*** ooolpbot has quit IRC | 17:10 | |
openstack | Launchpad bug 1596758 in tripleo "[CI down] pingtest fails when accessing to OpenStack APIs" [Critical,Confirmed] | 17:10 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: check the overcloud_deployment_result variable to determine playbook exit https://review.openstack.org/333997 | 17:11 |
*** mbound has quit IRC | 17:17 | |
openstackgerrit | Keith Schincke proposed openstack/puppet-tripleo: Add support for cinder::volume::rbd hiera parameters https://review.openstack.org/335137 | 17:18 |
*** cdearborn has joined #tripleo | 17:22 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Fixes for the update image script in dev mode https://review.openstack.org/335140 | 17:23 |
*** julim has joined #tripleo | 17:30 | |
*** Jabadia has quit IRC | 17:31 | |
*** [1]cdearborn has quit IRC | 17:37 | |
*** d0ugal has quit IRC | 17:37 | |
*** d0ugal has joined #tripleo | 17:37 | |
*** d0ugal has quit IRC | 17:37 | |
*** d0ugal has joined #tripleo | 17:37 | |
*** tosky has quit IRC | 17:41 | |
*** d0ugal has quit IRC | 17:41 | |
*** d0ugal has joined #tripleo | 17:42 | |
*** d0ugal has quit IRC | 17:42 | |
*** d0ugal has joined #tripleo | 17:42 | |
*** yamahata has joined #tripleo | 17:49 | |
*** ebarrera has joined #tripleo | 17:49 | |
*** trown is now known as trown|lunch | 17:50 | |
*** dtantsur is now known as dtantsur|afk | 17:51 | |
*** cschwede has quit IRC | 17:52 | |
*** jmiu_ has quit IRC | 17:53 | |
*** fragatin_ has joined #tripleo | 17:55 | |
*** fragatina has quit IRC | 17:55 | |
*** Goneri has joined #tripleo | 17:57 | |
*** jmiu_ has joined #tripleo | 17:57 | |
*** ebarrera has quit IRC | 17:58 | |
*** cschwede has joined #tripleo | 17:59 | |
*** xinwu has joined #tripleo | 18:00 | |
*** jpena is now known as jpena|off | 18:02 | |
*** electrofelix is now known as electrofelix|afk | 18:03 | |
*** sambetts is now known as sambetts|afk | 18:06 | |
*** ooolpbot has joined #tripleo | 18:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 18:10 |
*** ooolpbot has quit IRC | 18:10 | |
openstack | Launchpad bug 1596758 in tripleo "[CI down] pingtest fails when accessing to OpenStack APIs" [Critical,Confirmed] | 18:10 |
*** mbound has joined #tripleo | 18:18 | |
*** ebarrera has joined #tripleo | 18:22 | |
*** mbound has quit IRC | 18:24 | |
*** pcaruana has joined #tripleo | 18:25 | |
*** noslzzp has quit IRC | 18:32 | |
*** chem is now known as chem|off | 18:34 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Fixes for the update image script in dev mode https://review.openstack.org/335140 | 18:35 |
EmilienM | ok pingtest still fails on neutron it seems | 18:35 |
*** colonwq has quit IRC | 18:36 | |
EmilienM | Resource CREATE failed: NotFound: resources.server1_floating_ip: External network dfc925cc-1bf4-4fa2-90c6-bb43f0e45a37 is not reachable from subnet e4a2e92c-4f04-4d59-aff0-89dde526aef9. Therefore, cannot associate Port f1446e4a-2021-4ce8-b202-467f8ce73db | | 18:36 |
EmilienM | but the revert helped to go further | 18:36 |
pradk | EmilienM, i think my fix is working.. the pingtest passes 335115 for ha.. lets wait and see | 18:40 |
EmilienM | looking | 18:40 |
EmilienM | pradk: w00t | 18:41 |
*** athomas has quit IRC | 18:41 | |
*** davidlenwell has quit IRC | 18:42 | |
*** paramite has quit IRC | 18:42 | |
*** amoralej is now known as amoralej|lunch | 18:42 | |
*** ebarrera has quit IRC | 18:43 | |
*** amoralej|lunch is now known as amoralej|off | 18:43 | |
EmilienM | bnemec, slagle: could you review this one please? https://review.openstack.org/335115 it will help to get our CI back alive | 18:46 |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates: Enable IPv4/IPv6 dual-stack Public API endpoints https://review.openstack.org/289279 | 18:46 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 18:48 |
slagle | EmilienM: pradk : could you add the "why/how" in the commit msg | 18:48 |
slagle | it's pretty lacking on details | 18:48 |
pradk | slagle, will do.. waiting on ci to pass | 18:49 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements https://review.openstack.org/335169 | 18:49 |
pradk | EmilienM, so i added depends on https://review.openstack.org/#/c/334996/4 but that fails ci .. should i remove my depends on and you depend yours on mine? | 18:50 |
*** davidlenwell has joined #tripleo | 18:52 | |
*** ChanServ sets mode: +v davidlenwell | 18:52 | |
pradk | oops i meant https://review.openstack.org/#/c/334997/ .. | 18:52 |
EmilienM | pradk: don't do anything now | 18:54 |
openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo: Adds OpenDaylight https://review.openstack.org/335173 | 18:54 |
EmilienM | pradk: when CI passed, we'll update commit message and review it again | 18:54 |
EmilienM | pradk: depends-on is good | 18:55 |
EmilienM | pradk: the patch in puppet-openstacklib is going to land in the next minutes | 18:55 |
EmilienM | so we won't have the timeout issue anymore in our CI | 18:55 |
pradk | EmilienM, cool ok | 18:55 |
EmilienM | we'll revert it once we switch to pacemaker lite | 18:55 |
EmilienM | pradk: ha job passed now waiting on upgrade job | 18:55 |
pradk | yep | 18:56 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/332383 | 18:56 |
EmilienM | pradk: it smells good | 18:56 |
*** trown|lunch is now known as trown | 18:56 | |
*** bootsha has joined #tripleo | 19:01 | |
*** paramite has joined #tripleo | 19:03 | |
*** rook_ has quit IRC | 19:03 | |
*** paramite has quit IRC | 19:09 | |
*** ooolpbot has joined #tripleo | 19:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1596758 | 19:10 |
*** ooolpbot has quit IRC | 19:10 | |
openstack | Launchpad bug 1596758 in tripleo "[CI down] pingtest fails when accessing to OpenStack APIs" [Critical,Confirmed] | 19:10 |
*** rook_ has joined #tripleo | 19:11 | |
EmilienM | pradk: ok ping test is starting... cross finger | 19:12 |
*** jcoufal has quit IRC | 19:12 | |
bnemec | EmilienM: pradk: I left some comments on the change. | 19:13 |
*** florianf has quit IRC | 19:13 | |
bnemec | It looks fine, but I don't think the fix is what the commit message says it is. | 19:13 |
pradk | bnemec, yea i fixed the commit msg.. will push once ci passes | 19:14 |
pradk | bnemec, thx for the commenst | 19:14 |
trozet | hi all. Is there anyway to make os-net-config only run a single time. I see in /var/log/messages it seems to run periodically | 19:15 |
EmilienM | tripleo.sh -- Overcloud pingtest, SUCCESS | 19:15 |
EmilienM | yeah | 19:15 |
EmilienM | pradk: almost done | 19:15 |
bnemec | trozet: No, we rely on the fact that os-net-config is supposed to be idempotent. | 19:16 |
bnemec | If it's not, then that's a bug. | 19:16 |
dsneddon | bnemec, trozet: Yeah, it should be idempotent. I am aware of a bug related to mapping NICs by MAC address that isn't idempotent, because the MAC address changes when the NIC joins the bond. https://bugzilla.redhat.com/show_bug.cgi?id=1341989 | 19:17 |
openstack | dsneddon: Error: Error getting bugzilla.redhat.com bug #1341989: NotPermitted | 19:17 |
trozet | bnemec: heh no bug. I'm trying to "trick" it. | 19:17 |
trozet | bnemec: after i bind dpdk port, the kernel no longer knows that port, so nic mapping gets screwed up | 19:17 |
trozet | then it just ends up tearing apart OVS and the config haha | 19:17 |
dsneddon | trozet, That sounds like a variant of the above bug, but with another trigger (MAC address changing due to DPDK instead of bonding). | 19:18 |
dsneddon | trozet, Are you doing NIC mapping by MAC or by NIC number (nic1, nic2) | 19:18 |
trozet | bnemec, dsneddon: could you maybe point me to the code that triggers os-net-config to run, maybe I can hack it to only run 1 time per node | 19:18 |
trozet | dsneddon: nic number | 19:18 |
trozet | i was trying to avoid adding the code to os-net-config to know what a dpdk port is...so i do the bind in puppet pre-config on the compute node, but then hit this | 19:19 |
*** athomas has joined #tripleo | 19:19 | |
dsneddon | trozet, OK. Any chance I could take a look at a system where this is happening? I want to see if there is something in /sys/class/net that we can read to get the list of NICs after DPDK is enabled. | 19:19 |
trozet | dsneddon: it's a LF server so you have to have VPN access. But there isn't anything there. The port by its name is effectively gone when you bind to dpdk | 19:21 |
trozet | dsneddon: the only way at that point to reference it is via pci address | 19:21 |
dsneddon | trozet, Ugh. I'm not sure how we code around that in os-net-config, we have a similar problem if someone hot-plugs a NIC and it ends up getting names that change the NIC ordering. | 19:22 |
openstackgerrit | Merged openstack/tripleo-quickstart: Adds missing line continuation and teardown option https://review.openstack.org/334624 | 19:22 |
dsneddon | trozet, You might be able to use the MAC mapping to make your config idempotent. | 19:23 |
trozet | dsneddon: is the idea of hacking os-collect-config or whatever to only run os-net-config one time out of hte question? | 19:23 |
bnemec | dsneddon: trozet: In this case, it's possible we could give os-net-config a list of ignored ports. Presumably we don't want os-net-config messing with a port that's about to be configured by something else anyway. | 19:24 |
pradk | EmilienM, success | 19:24 |
EmilienM | pradk: https://review.openstack.org/#/c/335115/ GREEN | 19:24 |
EmilienM | yeah | 19:24 |
EmilienM | pradk: ok you can push | 19:24 |
*** akuznetsov has joined #tripleo | 19:24 | |
dsneddon | trozet, The problem is, the first time os-net-config is run the /etc/os-net-config/config.json doesn't exist yet | 19:24 |
openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient: Fix ssl port removal logic in postconfig https://review.openstack.org/335115 | 19:25 |
bnemec | You also can't guarantee that os-net-config won't need to be run later. | 19:25 |
bnemec | And if it does, BOOM | 19:25 |
trozet | bnemec: heh well at first I tried that. Did not list the nic in the nic template, but I need an ip address. So I assigned an IP to OVS bridge br-phy, and the deployment failed because there is some ping check for IPs | 19:25 |
dsneddon | trozet, Why don't you use NIC names instead of NIC numbers? | 19:26 |
dsneddon | trozet, Although, that won't work for heterogeneous hardware | 19:26 |
trozet | dsneddon: yeah i could do htat for virtual deployments | 19:26 |
trozet | dsneddon: but there is still a problem I think | 19:26 |
EmilienM | pradk: the commit message looks good to me | 19:26 |
EmilienM | bnemec, slagle: could you revisit https://review.openstack.org/#/c/335115/ please ? | 19:26 |
pradk | EmilienM, did the depends already land? | 19:27 |
pradk | ah looks like it did.. cool | 19:27 |
trozet | dsneddon: so what I do now, declare nic2 as a member of OVS bridge br-phy. os-net-config runs, and then verifies the ping. Then in pre-deploy puppet I remove nic2 from the bridge, bind to dpdk, restart OVS with dpdk turned on, and add the dpdk0 port back to OVS br-phy | 19:27 |
EmilienM | ok CI should be in a better shape from now | 19:28 |
EmilienM | I remove the alert on https://bugs.launchpad.net/tripleo/+bug/1596758 | 19:28 |
openstack | Launchpad bug 1596758 in tripleo "[CI down] pingtest fails when accessing to OpenStack APIs" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi) | 19:28 |
trozet | dsneddon: but hte problem is next time os-net-config runs - first it now doesnt have that nic in its nic mapping and thinks nic2 is the next nic on the system - 2nd it hten tries to move it back to the bridge | 19:28 |
*** akuznetsov has quit IRC | 19:28 | |
dsneddon | trozet, Hmm, it seems like we should add DPDK ports to os-net-config. I need a list of the commands that you run to add a DPDK port to the bridge. This shouldn't be too hard to make os-net-config run those commands, just like we do when we add an interface to an OVS bridge with ovs-vsctl. I can put that together. | 19:29 |
trozet | dsneddon: yeah i think someone from the RCIP team filed a request or spec for it | 19:30 |
trozet | dsneddon: it's this https://github.com/trozet/opnfv-tht/blob/stable/colorado/puppet/extraconfig/pre_deploy/compute/manifests/ovs_dpdk.pp | 19:30 |
openstackgerrit | Merged openstack/tripleo-quickstart: check the overcloud_deployment_result variable to determine playbook exit https://review.openstack.org/333997 | 19:31 |
dsneddon | trozet, Is it reasonable to run the dpdk commands from os-net-config without touching selinux enforcing mode? I'd rather that be set outside of os-net-config. | 19:33 |
trozet | dsneddon: yeah I'm not sure. I think that was just in the red hat guide I found online. I'm not sure if it is required | 19:33 |
trozet | dsneddon: the other issue is the dpdk stuff is pretty fragile. I was told not to restart OVS after adding the port. Sometimes it fails | 19:34 |
trozet | dsneddon: but you have the right idea, there should be a dpdk type added as a member port to OVS in the nic template | 19:34 |
*** panda has quit IRC | 19:34 | |
dsneddon | trozet, OK, good to know. I don't think os-net-config will have to restart OVS. | 19:34 |
*** ayoung has quit IRC | 19:35 | |
shadower | rook: hey, sorry, had to leave a little early | 19:35 |
shadower | rook: you around now? | 19:35 |
*** panda has joined #tripleo | 19:35 | |
rook | shadower: heya | 19:35 |
rook | shadower , looking for feedback on : https://github.com/jtaleric/clapper/commit/34afbc9749cc028a81e1900bfc157ea915fdf527 -- not sure if it conforms to how you guys like things. | 19:36 |
*** fragatin_ has quit IRC | 19:36 | |
rook | i suppose I could do a pr and we discuss it there, or here... | 19:36 |
dsneddon | trozet, The bridge has to be set as type: netdev, right? I'm thinking we should create a new object class in os-net-config for "dpdk_bridge" similar to the type "ovs_bridge". Make sense? We may or may not need a dpdk_interface type, interface might do. | 19:36 |
trozet | dsneddon: yeah | 19:37 |
*** bootsha has quit IRC | 19:37 | |
dsneddon | trozet, Will it be necessary for os-net-config to configure OVS patches? If so, then this will depend on dprince's patch to add OVS patch support. | 19:37 |
trozet | dsneddon: so i guess i could do a hack to os-net-config to write a file on its first invoke and then just return if that file exists ;) | 19:37 |
shadower | rook: that would be ideal. But yeah, looks good to me. I'll try to run it through our API and see how well it reports the results | 19:37 |
openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient: Run post deploy config on force https://review.openstack.org/334486 | 19:38 |
shadower | rook: regarding the dynamic inventory. We do need to be able to talk to Heat and such, but there's no reason we can't update it to talk to the openstack APIs remotely | 19:38 |
dsneddon | trozet, Yeah, that'd work. Or just add a simple check to os-net-config to bail if a particular file exists already in /etc/sysconfig/network-scripts | 19:38 |
trozet | dsneddon: oh patch ports? Really that should be done in neutron...but I don't think it currently does it | 19:38 |
shadower | rook: that should make it useful from outside the undercloud, shouldn't it? | 19:38 |
EmilienM | thrash, pradk: tomorrow morning, meeting on composable services ok? | 19:38 |
openstackgerrit | Merged openstack/python-tripleoclient: Fix ssl port removal logic in postconfig https://review.openstack.org/335115 | 19:39 |
trozet | dsneddon: sorry neutorn openvswitch agent I mean.. | 19:39 |
rook | shadower so, with the dynamic inventory tell the client to use the undercloud as a jumphot? | 19:39 |
rook | host* | 19:39 |
pradk | EmilienM, sure I'll try to attend | 19:39 |
dsneddon | trozet, Just wondering, since the ovs_dpdk.pp has a function to add a patch between br-phy and br-tun. | 19:39 |
thrash | EmilienM: ack | 19:39 |
shadower | rook: not sure I understand | 19:40 |
trozet | dsneddon: yeah openvswitch agent will create br-tun I think, but I don't think it will create br-phy and patch them | 19:40 |
*** egafford has quit IRC | 19:40 | |
dsneddon | trozet, You should be able to use virt-customize or similar tools to edit the os-net-config cli.py in the overcloud-full.qcow2 image and reupload it to Glance. | 19:40 |
trozet | dsneddon: we already pull a custom os-net-config that has my changes so that we can hiera nic2 | 19:40 |
rook | shadower so, from the dynamic inventory, it captures the private/pxe/provision network... a host outside of that network wouldn't have access to that network, so we would need to use the undercloud as a jump host to get on that network. | 19:40 |
trozet | dsneddon: https://github.com/openstack/os-net-config/compare/master...trozet:hiera_nic_mapping | 19:41 |
*** egafford has joined #tripleo | 19:41 | |
shadower | rook: aaah, I see. Yeah that would be a problem | 19:41 |
shadower | rook: so right now we're fine running the validations on the undercloud | 19:41 |
rook | shadower i don't think it is impossible... but it would be nice to have that flexibility... We currently have that in our script (which isn't a dynamic inventory)... | 19:42 |
rook | shadower: sure. | 19:42 |
shadower | rook: yeah I see that would be nice and I'm not against it | 19:42 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Fixes for the update image script in dev mode https://review.openstack.org/335140 | 19:42 |
*** [2]cdearborn has joined #tripleo | 19:43 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: First iteration of libvirt and nova-compute as a composable services https://review.openstack.org/329686 | 19:48 |
*** fragatina has joined #tripleo | 19:48 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: compute: deploy composable neutron service https://review.openstack.org/331234 | 19:48 |
EmilienM | ok let's continue composable roles work now :) | 19:48 |
*** colonwq has joined #tripleo | 19:49 | |
trozet | dsneddon: looks like ovs-netdev is written to /sys/class/net/ after ovs is restarted, so i can check for that then bail os-net-config. Thanks | 19:49 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Configure BlockStorage services via resource chains https://review.openstack.org/322858 | 19:49 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Composable Timezone service - Controller https://review.openstack.org/331528 | 19:49 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Composable Timezone service - Compute https://review.openstack.org/331530 | 19:49 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Composable Timezone service - CephStorage https://review.openstack.org/331534 | 19:49 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Composable Timezone service - ObjectStorage https://review.openstack.org/331536 | 19:49 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Wire NTP and Timezone services into BlockStorage nodes https://review.openstack.org/332740 | 19:49 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Switch Ceph Monitor/OSD/Client/External to composable roles https://review.openstack.org/304692 | 19:50 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add a method to wait for messages on the websocket https://review.openstack.org/322611 | 19:50 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Use Mistral for baremetal registration https://review.openstack.org/322612 | 19:50 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Use Mistral for baremetal introspection https://review.openstack.org/327780 | 19:50 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Don't cache and re-use the websocket https://review.openstack.org/331985 | 19:50 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 19:50 |
yolanda | hi, i'm hitting an issue with overcloud-validate and run tempest | 19:50 |
yolanda | it grabs tempest from pacakge, that, has no requirements.txt and test-requirements.txt | 19:50 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Convert SNMP configuration to composable services format https://review.openstack.org/320597 | 19:51 |
yolanda | but then it fails with Could not open requirements file: [Errno 2] No existe el fichero o el directorio: '/home/stack/tempest/requirements.txt' | 19:51 |
yolanda | is that a known issue? | 19:51 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: compute: moving out iscsi bits, now in puppet-tripleo https://review.openstack.org/331247 | 19:51 |
trown | EmilienM++ thanks for all the hard work to get CI back working | 19:51 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Remove NFS bits from overcloud_compute manifest https://review.openstack.org/332955 | 19:51 |
EmilienM | trown: it's a team work | 19:52 |
trown | yolanda: ya there is an RDO BZ about it. 2 actually, because the virtualenv with packages was a workaround for another issue | 19:52 |
yolanda | trown, is there any fix for it, or what's prefered workaround? | 19:53 |
trown | yolanda: https://bugzilla.redhat.com/show_bug.cgi?id=1344339 | 19:53 |
openstack | bugzilla.redhat.com bug 1344339 in tempest "install_venv script fails to open requirements file" [Medium,New] - Assigned to dmellado | 19:53 |
yolanda | ah cool | 19:53 |
yolanda | thx, i was not sure if that was problem with my config | 19:54 |
trown | yolanda: right now my workaround is not to run tempest :P, but you could add another workaround on top of the workaround and manually download requirements.txt from upstream tempest | 19:54 |
yolanda | EmilienM, btw, if you hit some issue with openstack-infra... i've not been very involved recently with all changes, but ping me if you need help at anytime | 19:54 |
trown | I stopped at my workaround for a workaround being broken | 19:54 |
*** akuznetsov has joined #tripleo | 19:54 | |
yolanda | trown, i was experimenting with that tripleo-quickstart for testing... actually i wanted to test tempest and rally | 19:55 |
yolanda | i will ping dmellado tomorrow, to see if we can collaborate fixing that | 19:55 |
trown | yolanda: and I would accept a tripleo-quickstart patch that fixes it (s/fixes/further works around broken tempest rpm/) | 19:55 |
EmilienM | yolanda: ack thx a lot | 19:55 |
yolanda | trown, cool, working on that setup as a priority now, so I could help with that | 19:56 |
*** cdearborn has quit IRC | 19:57 | |
*** gfidente has quit IRC | 19:57 | |
trown | yolanda: hmm I put +2 on https://review.openstack.org/#/c/329556 but then I thought about it... if we had a way to pass in any package we wanted to build from a refspec (or branch) wouldnt that also solve that case? | 20:00 |
trown | yolanda: we are pretty close to that, which then makes that ^ patch a bit redundant | 20:01 |
yolanda | trown, but that's not package, is a git repo | 20:02 |
trown | yolanda: right but we have a tool to build a package from a git repo | 20:02 |
*** athomas has quit IRC | 20:02 | |
yolanda | trown, that would involve an extra step then... | 20:02 |
yolanda | for our direct use case, i think it would be simpler to just consume the git repo | 20:03 |
yolanda | but i'm quite new to that, so I'd like to hear what people thinks... | 20:03 |
trown | k, I suppose it doesnt hurt to have both paths for THT | 20:03 |
trown | it is a bit unique in that it can be consumed directly from git via the deploy command | 20:04 |
*** paramite has joined #tripleo | 20:04 | |
*** ebarrera has joined #tripleo | 20:08 | |
yolanda | trown unique... but it's quite useful | 20:09 |
*** jayg is now known as jayg|g0n3 | 20:09 | |
trown | yolanda: ya, I agree | 20:09 |
openstackgerrit | Merged openstack/diskimage-builder: Release notes for 1.18 https://review.openstack.org/334711 | 20:09 |
trown | yolanda: THT is the easiest tripleo project to test because of that ability | 20:10 |
yolanda | yes... having to create a package is not a blocker, but an extra step | 20:12 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Composable midonet for neutron https://review.openstack.org/333387 | 20:12 |
*** ebalduf has quit IRC | 20:15 | |
*** jprovazn has quit IRC | 20:15 | |
*** bootsha has joined #tripleo | 20:17 | |
*** rook_ has quit IRC | 20:17 | |
trown | yolanda: the package building when integrated into tripleo-quickstart will be very easy, there is already an extra role in RDO that can do it. once we have https://review.gerrithub.io/#/c/277418/ we can actually build any number of packages from open reviews for either packaging or code repos | 20:18 |
trown | yolanda: but given we dont have that yet, and your patch is ready now, I am still +2 on it | 20:18 |
openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo: Adds OpenDaylight https://review.openstack.org/335173 | 20:19 |
yolanda | trown, that's really amazing, and i think we may use that as well | 20:19 |
trown | yolanda: that same mechanism can just replace refspec with a branch name, and even the repo used with a private fork | 20:20 |
*** jcoufal has joined #tripleo | 20:21 | |
yolanda | trown, indeed, one of our interests is to test new features , changes that not even landed, so thanks for that pointers | 20:26 |
yolanda | anyway, leaving for today, have a nice day | 20:26 |
trown | you as well | 20:27 |
*** paramite has quit IRC | 20:27 | |
dsneddon | trozet, You might want to file an RFE BZ for os-net-config writing the NIC mapping to hiera. That wouldn't be too difficult to implement. | 20:29 |
*** ayoung has joined #tripleo | 20:29 | |
trozet | dsneddon: i was going to do it when I get time | 20:29 |
trozet | dsneddon: and write hte dpdk type, but you have volunteered to do that for me ;) | 20:29 |
*** ebalduf has joined #tripleo | 20:29 | |
*** jcoufal has quit IRC | 20:30 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 20:31 |
openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo: Adds OpenDaylight https://review.openstack.org/335173 | 20:37 |
*** jcoufal has joined #tripleo | 20:38 | |
*** jtomasek_ has joined #tripleo | 20:40 | |
*** ebarrera has quit IRC | 20:50 | |
*** Goneri has quit IRC | 20:53 | |
*** fragatina has quit IRC | 20:54 | |
*** fragatina has joined #tripleo | 20:54 | |
*** oneswig has joined #tripleo | 20:56 | |
*** weshay has quit IRC | 21:02 | |
*** akuznetsov has quit IRC | 21:02 | |
*** lblanchard has quit IRC | 21:04 | |
* bnemec is having too much fun watching CI graphs: https://fedorapeople.org/~bnemec/CIMon.png | 21:06 | |
*** trown is now known as trown|outtypewww | 21:08 | |
*** dmk0202 has joined #tripleo | 21:11 | |
openstackgerrit | Ben Nemec proposed openstack/tripleo-docs: Group advanced topics by type https://review.openstack.org/335232 | 21:12 |
*** akshai has quit IRC | 21:13 | |
*** bootsha has quit IRC | 21:13 | |
*** rhallisey has quit IRC | 21:13 | |
openstackgerrit | Bob Fournier proposed openstack/python-tripleoclient: Remove NeutronEnableTunnelling from python-tripleoclient https://review.openstack.org/335234 | 21:19 |
openstackgerrit | Bob Fournier proposed openstack/tripleo-heat-templates: Remove NeutronEnableTunnelling from Heat templates and puppet manifests https://review.openstack.org/335235 | 21:20 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 21:20 |
openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo: Adds OpenDaylight https://review.openstack.org/335173 | 21:26 |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates: Enable IPv4/IPv6 dual-stack Public API endpoints https://review.openstack.org/289279 | 21:28 |
openstackgerrit | Bob Fournier proposed openstack/tripleo-heat-templates: Remove NeutronEnableTunnelling from THT and puppet manifests https://review.openstack.org/335235 | 21:36 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Fixes for dlrn gate repo injection while using devmode https://review.openstack.org/334691 | 21:38 |
*** bfournie has quit IRC | 21:42 | |
*** dmk0202 has quit IRC | 21:42 | |
*** akrivoka has quit IRC | 21:55 | |
*** jtomasek_ has quit IRC | 21:56 | |
*** akshai has joined #tripleo | 21:57 | |
*** davidlenwell has quit IRC | 22:02 | |
*** akshai_ has joined #tripleo | 22:04 | |
*** oneswig has quit IRC | 22:04 | |
*** akshai has quit IRC | 22:07 | |
*** davidlenwell has joined #tripleo | 22:11 | |
*** ChanServ sets mode: +v davidlenwell | 22:11 | |
*** [2]cdearborn has quit IRC | 22:27 | |
*** telnoratti has left #tripleo | 22:31 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 22:32 |
*** mbound_ has joined #tripleo | 22:33 | |
*** akshai_ has quit IRC | 22:36 | |
*** pradk has quit IRC | 22:53 | |
*** yamahata has quit IRC | 23:02 | |
*** rlandy has quit IRC | 23:15 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Add support for OVB based CI https://review.openstack.org/334787 | 23:15 |
*** sanjayu has joined #tripleo | 23:18 | |
*** bfournie has joined #tripleo | 23:21 | |
*** [2]cdearborn has joined #tripleo | 23:25 | |
*** cdearborn has joined #tripleo | 23:31 | |
*** mbound_ has quit IRC | 23:44 | |
*** [2]cdearborn has quit IRC | 23:48 | |
*** numans has joined #tripleo | 23:51 | |
*** cdearborn has quit IRC | 23:51 | |
*** akshai has joined #tripleo | 23:59 | |
*** kbyrne has quit IRC | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!