*** apetrich has quit IRC | 00:02 | |
*** apetrich has joined #tripleo | 00:07 | |
*** ooolpbot has joined #tripleo | 00:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
---|---|---|
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 00:10 |
*** ooolpbot has quit IRC | 00:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 00:10 |
*** lblanchard has joined #tripleo | 00:24 | |
*** limao has joined #tripleo | 00:32 | |
*** coolsvap has joined #tripleo | 00:35 | |
*** dmacpher has joined #tripleo | 00:42 | |
*** social has quit IRC | 00:48 | |
*** shivrao has quit IRC | 00:54 | |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 01:10 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 01:18 |
*** lblanchard has quit IRC | 01:29 | |
*** limao has quit IRC | 01:32 | |
*** limao has joined #tripleo | 01:33 | |
*** akshai has quit IRC | 01:56 | |
dsariel_ | hi, are there any pointers exist to best practices of hardware/system/triplleO configuration to boost TripleO performance? | 01:56 |
*** akshai has joined #tripleo | 02:06 | |
*** akshai_ has joined #tripleo | 02:07 | |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 02:10 |
*** akshai has quit IRC | 02:10 | |
*** dsariel_ has quit IRC | 02:10 | |
*** dsariel has quit IRC | 02:11 | |
*** ramishra has joined #tripleo | 02:27 | |
*** ramishra has quit IRC | 02:42 | |
*** ramishra has joined #tripleo | 02:43 | |
*** ramishra has quit IRC | 03:02 | |
*** ramishra has joined #tripleo | 03:03 | |
*** chandankumar has joined #tripleo | 03:03 | |
*** coolsvap has quit IRC | 03:04 | |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 03:10 |
*** myoung has joined #tripleo | 03:10 | |
*** ramishra has quit IRC | 03:10 | |
*** ramishra has joined #tripleo | 03:12 | |
*** limao has quit IRC | 03:13 | |
*** myoung has quit IRC | 03:14 | |
*** coolsvap has joined #tripleo | 03:17 | |
*** shivrao has joined #tripleo | 03:17 | |
*** julim has quit IRC | 03:22 | |
*** ramishra has quit IRC | 03:28 | |
*** ramishra has joined #tripleo | 03:33 | |
*** ramishra has quit IRC | 03:38 | |
*** ramishra has joined #tripleo | 03:40 | |
*** limao has joined #tripleo | 04:05 | |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 04:10 |
*** chandankumar has quit IRC | 04:29 | |
*** akshai_ has quit IRC | 04:30 | |
*** akshai has joined #tripleo | 04:30 | |
*** akshai has quit IRC | 04:39 | |
openstackgerrit | Babu Shanmugam proposed openstack/puppet-tripleo: Add OVN support for neutron profile https://review.openstack.org/314875 | 04:42 |
*** oshvartz has quit IRC | 04:49 | |
*** masco has joined #tripleo | 05:06 | |
*** skramaja has joined #tripleo | 05:07 | |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 05:10 |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
*** pcaruana has quit IRC | 05:17 | |
*** numans has joined #tripleo | 05:20 | |
*** saneax_AFK is now known as saneax | 05:30 | |
saneax | Hi All | 05:31 |
*** sanjayu|AFK is now known as sanjayu | 05:43 | |
*** dsariel has joined #tripleo | 05:47 | |
*** dsariel_ has joined #tripleo | 05:47 | |
openstackgerrit | Saravanan KR proposed openstack/os-net-config: WIP: Add support for OVS DPDK Bridge and Port https://review.openstack.org/338694 | 05:54 |
*** chandankumar has joined #tripleo | 06:01 | |
*** pgadiya has joined #tripleo | 06:02 | |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 06:10 |
*** ramishra has quit IRC | 06:18 | |
*** ramishra has joined #tripleo | 06:20 | |
*** shivrao has quit IRC | 06:20 | |
*** leanderthal|afk is now known as leanderthal | 06:20 | |
*** rcernin has joined #tripleo | 06:23 | |
*** akuznetsov has joined #tripleo | 06:24 | |
*** tremble has joined #tripleo | 06:24 | |
*** rasca has joined #tripleo | 06:30 | |
*** tremble has quit IRC | 06:40 | |
*** dmacpher has quit IRC | 06:44 | |
*** anshul has joined #tripleo | 06:45 | |
*** ohamada has joined #tripleo | 06:46 | |
*** ohamada has quit IRC | 06:48 | |
*** ohamada has joined #tripleo | 06:49 | |
*** pcaruana has joined #tripleo | 06:51 | |
*** anshul has quit IRC | 06:54 | |
*** oshvartz has joined #tripleo | 06:58 | |
*** limao has quit IRC | 07:02 | |
*** limao has joined #tripleo | 07:03 | |
*** coolsvap has quit IRC | 07:05 | |
*** coolsvap has joined #tripleo | 07:06 | |
*** ebarrera has joined #tripleo | 07:07 | |
*** tesseract- has joined #tripleo | 07:08 | |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 07:10 |
*** anshul has joined #tripleo | 07:11 | |
*** anshul has quit IRC | 07:12 | |
*** anshul has joined #tripleo | 07:12 | |
*** anshul has quit IRC | 07:21 | |
*** anshul has joined #tripleo | 07:21 | |
*** liverpooler has joined #tripleo | 07:25 | |
*** aufi has joined #tripleo | 07:30 | |
*** zoli_gone-proxy is now known as zoliXXL | 07:33 | |
*** anshul has quit IRC | 07:33 | |
*** anshul has joined #tripleo | 07:34 | |
*** jpich has joined #tripleo | 07:39 | |
*** zoliXXL is now known as zoli|wfh | 07:39 | |
zoli|wfh | good morning | 07:40 |
*** ifarkas has joined #tripleo | 07:40 | |
*** fragatina has joined #tripleo | 07:40 | |
*** fragatina has quit IRC | 07:46 | |
*** fragatina has joined #tripleo | 07:46 | |
*** coolsvap has quit IRC | 07:49 | |
*** hjensas has joined #tripleo | 07:50 | |
*** hjensas has joined #tripleo | 07:50 | |
*** jtomasek has quit IRC | 07:52 | |
*** mcornea has joined #tripleo | 07:52 | |
*** akuznetsov has quit IRC | 07:55 | |
*** lucas|afk is now known as lucasagomes | 07:58 | |
*** coolsvap has joined #tripleo | 08:00 | |
openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: [WIP] Add 'openstack overcloud node import' command https://review.openstack.org/339727 | 08:00 |
openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Add 'openstack overcloud node introspect' command https://review.openstack.org/336595 | 08:00 |
openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Add 'openstack overcloud node provide' command https://review.openstack.org/334411 | 08:00 |
*** ramishra has quit IRC | 08:06 | |
*** jistr has quit IRC | 08:06 | |
*** jistr has joined #tripleo | 08:07 | |
*** ramishra has joined #tripleo | 08:08 | |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 08:10 |
*** jistr has quit IRC | 08:11 | |
*** jistr has joined #tripleo | 08:11 | |
remix_auei | hello, is there any doc on how to make planned maintenance on a controller node that has been deployed? | 08:11 |
remix_auei | i have a 3 node controller cluster and i want to stop one node for some time to make some hardware upgrades | 08:12 |
*** remix_auei is now known as remix_tj | 08:14 | |
*** derekh has joined #tripleo | 08:14 | |
*** shardy has joined #tripleo | 08:14 | |
derekh | sshnaidm|afk: we can now use the same image that infra uploads to our cloud, I'm going to edit the instuctions on the etherpad | 08:16 |
*** sshnaidm|afk is now known as sshnaidm | 08:16 | |
sshnaidm | derekh, ok, great | 08:16 |
shardy | 'morning all | 08:20 |
*** electrofelix has joined #tripleo | 08:21 | |
*** hewbrocca is now known as hewbrocca-afk | 08:22 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Change username from stack to $USER in tempest https://review.openstack.org/339118 | 08:22 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE TESTING https://review.openstack.org/316436 | 08:26 |
*** myoung has joined #tripleo | 08:29 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE TESTING https://review.openstack.org/316436 | 08:29 |
*** myoung is now known as myoung|afk | 08:30 | |
*** dbecker has joined #tripleo | 08:30 | |
*** mgould|afk is now known as mgould | 08:37 | |
*** pblaho has joined #tripleo | 08:39 | |
*** tosky has joined #tripleo | 08:47 | |
*** gfidente has joined #tripleo | 08:50 | |
*** hewbrocca-afk is now known as hewbrocca | 08:53 | |
*** chem``` has joined #tripleo | 08:53 | |
*** chem``` is now known as chem | 08:54 | |
*** dtantsur|afk is now known as dtantsur | 08:56 | |
*** chem`` has quit IRC | 08:57 | |
shardy | Two THT reviews required to close this bug https://review.openstack.org/#/q/topic:bug/1595722 | 09:03 |
*** anshul has quit IRC | 09:09 | |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 09:10 |
gfidente | shardy though if as per commit message 4hrs is too long | 09:11 |
gfidente | why do we want it to default to 4hrs? | 09:11 |
openstackgerrit | Giulio Fidente proposed openstack/python-tripleoclient: Install Ansible and the Heat's Ansible hook in the overcloud-full image https://review.openstack.org/339577 | 09:13 |
shardy | gfidente: because it matches the current default stack timeout, and we don't yet know a better default value | 09:14 |
derekh | shardy: did you get a chance to look into the probably with the non HA job on friday? | 09:15 |
derekh | shardy: looks like a problem starting ceph | 09:15 |
shardy | derekh: Hey, I didn't manage to reproduce locally after updating all-the-things, but I didn't add a ceph OSD node | 09:16 |
gfidente | shardy so I thought we'd want it to be shorter | 09:16 |
shardy | will try that now | 09:16 |
gfidente | otherwise we could end up with heat killing the deployment and orc still stuck within its 4hrs | 09:16 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Template param for what command occ runs https://review.openstack.org/337384 | 09:16 |
shardy | gfidente: we probably will, but we'd need to gather some averages from CI to ensure the timeout is well above the longest possible o-r-c/deployment time | 09:16 |
shardy | well o-r-c would still time out wouldn't it? | 09:17 |
derekh | shardy: ok, trying to reproduce it here now also | 09:18 |
shardy | we need to set that to something like double the longest puppet deployment observed in CI, over a large number of runs | 09:18 |
shardy | maybe already have that data in the graphite server dprince is running | 09:19 |
*** anshul has joined #tripleo | 09:19 | |
shardy | gfidente: I agree it's not a good default, but it is safe, and it makes the value configurable, so I was thinking it's OK to fine-tune the value in a subsequent patch | 09:19 |
gfidente | shardy ack | 09:20 |
gfidente | my point is that heat would wait 4hrs for the entire deployment to complete so each execution of orc it's supposed to take less | 09:21 |
*** chandankumar has quit IRC | 09:22 | |
shardy | gfidente: Yes, but that's the current behavior anyway | 09:22 |
shardy | the main improvement here is it's now configurable, and o-r-c won't still be hung after the heat stack gets cancelled due to a timeout | 09:23 |
shardy | which, presumably, means all subsequent updates are broken until the nodes are rebooted | 09:23 |
gfidente | yeah | 09:23 |
d0ugal | Why are they all nonha or ha but never both? http://tripleo.org/cistatus.html | 09:24 |
shardy | gfidente: another optimization we might make is to have a way to have o-r-c get stopped when a stack timeout happens | 09:24 |
shardy | then o-r-c would stop exactly when the stack timeout occurs | 09:25 |
shardy | but that's not possible with the simple timeout value approach these patches implement | 09:25 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-tripleo: Fix retrieval of hostname fact based on network. https://review.openstack.org/332736 | 09:25 |
shardy | d0ugal: because nonha is broken | 09:25 |
d0ugal | shardy: aha :) | 09:26 |
derekh | d0ugal: when I switched the jobs over the rh2, we had to choose a subset of jobs (for capacity reasons), For the tripleo projects I kept the HA job and got rid of the rest, | 09:26 |
derekh | d0ugal: For the non tripleo projects, these had just been running a nonha job, so I left them as is | 09:26 |
d0ugal | derekh: cool, makes sense. thanks | 09:26 |
derekh | d0ugal: it have been better to just use HA test everywhere ...not sure | 09:28 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Set os-refresh-config timeout to 4 hours https://review.openstack.org/337385 | 09:30 |
*** anshul has quit IRC | 09:32 | |
gfidente | marios you checked this before https://review.openstack.org/#/c/338847/ , passed CI now but had to change it slightly | 09:33 |
shardy | We're nearly ready to cut the newton-2 milestone release :) | 09:33 |
shardy | https://launchpad.net/tripleo/+milestone/newton-2 | 09:33 |
shardy | great work everyone! :) | 09:33 |
marios | gfidente: ack, was looking at https://review.openstack.org/#/c/335429 first | 09:34 |
*** coolsvap has quit IRC | 09:34 | |
*** coolsvap has joined #tripleo | 09:35 | |
gfidente | marios thanks :) | 09:38 |
*** florianf has joined #tripleo | 09:40 | |
*** akrivoka has joined #tripleo | 09:40 | |
hewbrocca | wahey! | 09:40 |
*** anshul has joined #tripleo | 09:45 | |
*** pbourke has joined #tripleo | 09:46 | |
marios | gfidente: good to land them? | 09:47 |
pbourke | hi, is it possible to install packages with disk-image-builder? | 09:47 |
marios | gfidente: i +2 they lgtm | 09:47 |
gfidente | I will remember to ask you things only on monday | 09:49 |
derekh | pbourke: you could write an element to install packages or pass in the -p flag to the command i.e. -p package[,package,package] | 09:51 |
*** anshul has quit IRC | 09:51 | |
*** anshul has joined #tripleo | 09:51 | |
pbourke | derekh: -p sounds what Im after | 09:51 |
pbourke | derekh: is this a common pattern? | 09:51 |
derekh | pbourke: I don't think its something we currently call in tripleo but I wouldn't see it as an antipattern | 09:53 |
pbourke | derekh: ok thanks | 09:54 |
*** fragatina has quit IRC | 09:54 | |
derekh | np | 09:54 |
*** pkovar has joined #tripleo | 09:54 | |
*** fragatina has joined #tripleo | 09:58 | |
shardy | pbourke: note that if you're adding elements for tripleo (vs driving d-i-b directly, we have a --builder-extra-args option that helps with that: | 10:03 |
shardy | http://docs.openstack.org/developer/tripleo-docs/advanced_deployment/build_single_image.html#building-a-single-image | 10:03 |
*** fragatina has quit IRC | 10:05 | |
shardy | ccamacho: Hey FYI I think deployment of gnocchi is failing in https://review.openstack.org/#/c/318413 | 10:07 |
shardy | so probably recheck's won't help | 10:07 |
*** anshul has quit IRC | 10:07 | |
*** anshul has joined #tripleo | 10:07 | |
ccamacho | shardy, yeahp I tried to recheck sometimes as locally was working, now im reading logs to see whats going on :) thanks! | 10:08 |
shardy | ccamacho: cool, maybe you need to update puppet-tripleo locally to reproduce? | 10:09 |
*** fragatina has joined #tripleo | 10:09 | |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 10:10 |
ccamacho | shardy, that's the thing the puppet-tripleo patch is already merged, mmm I'm deploying master using the THT submission.. I think the issue is that somewhere I'm passing an empty parameter to the puppet-tripleo code.. | 10:12 |
*** anshul has quit IRC | 10:13 | |
openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Add hyperconverged Ceph to the OVB/HA job https://review.openstack.org/338088 | 10:15 |
*** anshul has joined #tripleo | 10:19 | |
*** rodrigods has quit IRC | 10:21 | |
*** rodrigods has joined #tripleo | 10:21 | |
*** abehl has joined #tripleo | 10:24 | |
*** anshul has quit IRC | 10:24 | |
*** mvc has joined #tripleo | 10:26 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Pass MysqlVirtualIP without brackets to EndpointMap https://review.openstack.org/338847 | 10:26 |
*** mvc has quit IRC | 10:27 | |
*** limao has quit IRC | 10:28 | |
*** zoli|wfh is now known as zoli|lunch | 10:30 | |
*** fragatina has quit IRC | 10:30 | |
*** fragatina has joined #tripleo | 10:31 | |
*** anshul has joined #tripleo | 10:31 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Move keystone::db data within service template https://review.openstack.org/335429 | 10:32 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Move glance::db data within service template https://review.openstack.org/335430 | 10:32 |
*** abehl has quit IRC | 10:32 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Move cinder::db data within service template https://review.openstack.org/335431 | 10:33 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Move heat::db data within service template https://review.openstack.org/335434 | 10:42 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Move sahara::db data within service template https://review.openstack.org/335436 | 10:42 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Move neutron::db data within service template https://review.openstack.org/335438 | 10:44 |
*** anshul has quit IRC | 10:45 | |
*** pino|work has quit IRC | 10:46 | |
*** adarazs is now known as adarazs_lunch | 10:49 | |
*** lucasagomes is now known as lucas-hungry | 10:56 | |
*** abehl has joined #tripleo | 10:57 | |
*** jrist_ has joined #tripleo | 10:57 | |
*** abehl has quit IRC | 10:59 | |
*** abehl has joined #tripleo | 10:59 | |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Move gnocchi clustercheck to step 5 https://review.openstack.org/340301 | 11:02 |
openstackgerrit | Merged openstack/instack-undercloud: Make Ironic httpd port configurable via hiera https://review.openstack.org/339777 | 11:04 |
*** jrist_ has quit IRC | 11:04 | |
*** abehl has quit IRC | 11:04 | |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Gnocchi composable roles https://review.openstack.org/318413 | 11:04 |
*** milan has joined #tripleo | 11:05 | |
hewbrocca | derekh: hey, the rack should be coming back on line pretty soon, shouldn't it? | 11:05 |
derekh | hewbrocca: its ready to be started on since friday, but besides verifying that nothing feel off I havn't started any redeploy yet | 11:06 |
hewbrocca | that is very good news | 11:08 |
hewbrocca | and they got all the busted dracs fixed too I think, right zoli|lunch ? | 11:08 |
derekh | hewbrocca: I think the bastion is the only one still outstanding | 11:09 |
hewbrocca | and it needs a whole new motherboard, doesn't it? | 11:09 |
derekh | hewbrocca: zoli|lunch this week would be a good time to do it | 11:09 |
derekh | hewbrocca: I'm not sure | 11:09 |
hewbrocca | It sure would, I wonder what the status is on that ticket | 11:09 |
hewbrocca | I'll go over and ask zoli|lunch when he gets back | 11:09 |
derekh | hewbrocca: ack] | 11:10 |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 11:10 |
hewbrocca | hmmph why is this ^^^ yelling at us | 11:11 |
shardy | hewbrocca: neutron broke our mitaka CI job | 11:12 |
derekh | hewbrocca: because the mitaka job has a regression since (thursday? I think) | 11:12 |
shardy | I think we're just waiting on a neutron patch to land atm | 11:12 |
hewbrocca | ahh | 11:13 |
derekh | hewbrocca: I've submitted a revert to the stable neutron banch https://review.openstack.org/#/c/340271/ | 11:13 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 11:13 |
hewbrocca | TripleO CI: Catching Every. Single. Damn. Neutron bug, since 2014 | 11:14 |
derekh | lol | 11:14 |
hewbrocca | The Neutron guys should give us a medal, honestly | 11:14 |
shardy | hehe :) | 11:14 |
*** jrist_ has joined #tripleo | 11:15 | |
ccamacho | slagle, good morning! I tried to download the last week session to upload it to YouTube, but the link wasn't working. Do you have it available? | 11:16 |
slagle | ccamacho: no; the link from bluejeans is the only link | 11:16 |
slagle | ccamacho: how wasn't it working? | 11:16 |
slagle | did i put the right link in the etherpad? :) | 11:17 |
*** abehl has joined #tripleo | 11:17 | |
ccamacho | slagle in the weekend I was getting an "ups" message.. Now it is working but no download button. | 11:17 |
slagle | ccamacho: the download button is the down facing error on the Chapter 1 thumbnail | 11:18 |
slagle | s/error/arrow | 11:18 |
slagle | i have it downloaded, i just need to do the upload | 11:18 |
slagle | i was going to do it friday night, but we lost power out here in the sticks | 11:19 |
*** jrist_ has quit IRC | 11:20 | |
ccamacho | slage aaa ok, np then :) But it was weird as when clicking the link it was an error message from bluejeans, but np as you already have it :) | 11:20 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 11:20 |
*** jrist_ has joined #tripleo | 11:20 | |
ccamacho | s/slage/slagle | 11:20 |
*** jrist_ has quit IRC | 11:20 | |
*** jtomasek_ has joined #tripleo | 11:22 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Use already Deployed/Installed servers https://review.openstack.org/222772 | 11:22 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 11:24 |
*** osp has joined #tripleo | 11:26 | |
*** dtrainor has joined #tripleo | 11:27 | |
slagle | ccamacho: i've got it uploading now | 11:31 |
ccamacho | slagle++ | 11:31 |
*** abehl has quit IRC | 11:32 | |
*** florianf has quit IRC | 11:33 | |
*** dtrainor has quit IRC | 11:37 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Use venv for all tempest commands https://review.openstack.org/339118 | 11:39 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE TESTING https://review.openstack.org/316436 | 11:40 |
*** rbartal has joined #tripleo | 11:42 | |
*** jtomasek_ has quit IRC | 11:44 | |
*** chandankumar has joined #tripleo | 11:44 | |
derekh | slagle: btw, you can now use the infra centos7 image on rh2, or download it | 11:48 |
derekh | slagle: you have to boot it with --config-drive=True and ssh in as root | 11:48 |
*** zoli|lunch is now known as zoli|wfh | 11:48 | |
derekh | slagle: some info here https://etherpad.openstack.org/p/tripleo-ci-devenvs | 11:48 |
*** pino|work has joined #tripleo | 11:50 | |
zoli|wfh | hewbrocca, yes, all the iDRACs are OK now - except the one in U37 (I'll involve Dell support ibn coming days - it seems that we cannot sort it our with Fernando) | 11:50 |
hewbrocca | zoli|wfh: cool -- u37 is the bastion host, is it? | 11:51 |
zoli|wfh | exactly | 11:51 |
zoli|wfh | I have to "make some noise" about bastion - case has been opened some time ago - no update at all | 11:51 |
hewbrocca | zoli|wfh: good man | 11:51 |
derekh | zoli|wfh: I thought U1 was the bastion | 11:52 |
zoli|wfh | derekh, U1 is the bastion | 11:53 |
zoli|wfh | U37 was (still is :)) one of the hosts with non-responsive iDRAC | 11:53 |
zoli|wfh | together with U09, 12 and 40 | 11:54 |
hewbrocca | oh, my mistake | 11:54 |
derekh | ack | 11:55 |
rbartal | Hi all, I'm trying to write automatic test for openstack command, and need some example, does anyone have example of using tripleclient in python script I can look at? | 11:56 |
*** florianf has joined #tripleo | 12:03 | |
*** adarazs_lunch is now known as adarazs | 12:03 | |
*** jrist_ has joined #tripleo | 12:04 | |
*** dtrainor has joined #tripleo | 12:04 | |
EmilienM | hello | 12:04 |
*** lucas-hungry is now known as lucasagomes | 12:10 | |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 12:10 |
*** bfournie has quit IRC | 12:11 | |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 12:12 |
*** trown|outtypewww is now known as trown | 12:12 | |
*** jayg|g0n3 is now known as jayg | 12:12 | |
*** weshay has joined #tripleo | 12:14 | |
openstackgerrit | Adriano Petrich proposed openstack/tripleo-quickstart: Add an optional extra parameter for upgrades https://review.openstack.org/340336 | 12:14 |
*** dtrainor has quit IRC | 12:15 | |
*** dtrainor has joined #tripleo | 12:15 | |
openstackgerrit | James Slagle proposed openstack/instack-undercloud: Ensure /etc/puppet/hieradata exists https://review.openstack.org/340337 | 12:17 |
*** coolsvap has quit IRC | 12:18 | |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Configure a different port for httpd ipxe https://review.openstack.org/340339 | 12:20 |
slagle | derekh: ^ | 12:20 |
slagle | i tested that in my multinode patch as well, and it works | 12:20 |
*** ccamacho is now known as ccamacho|lunch | 12:21 | |
dsariel_ | hi, I'm going to buy a desktop with 64 GB RAM and 512 GB SSD to play with TripleO. E.g to deploy 2 overclouds to compare. Are there any pointers exist to best practices of hardware/system/triplleO configuration to boost TripleO performance | 12:21 |
*** pino|work has quit IRC | 12:22 | |
*** rhallisey has joined #tripleo | 12:23 | |
slagle | ccamacho|lunch: the upload is done | 12:24 |
sshnaidm | derekh, when I use image from tripleo, I can't log in to undercloud: Permission denied (publickey). , which user is user there? | 12:26 |
*** pradk has joined #tripleo | 12:26 | |
slagle | ccamacho|lunch: also for some reason the TripleO pages was showing in spanish for me on youtube, so i switched the langauge to English in the settings | 12:26 |
shardy | dsariel_: No docs re hardware that I'm aware of, but FWIW SSD and lots of RAM is a good starting point | 12:27 |
slagle | i am trying to brush up on my spanish, but am still a little rusty :) | 12:27 |
*** pino|work has joined #tripleo | 12:27 | |
shardy | dsariel_: re comparing overclouds, note that at present we don't support multiple overclouds with one undercloud | 12:28 |
EmilienM | shardy: hello sir! how are we for a release today? | 12:29 |
*** sshnaidm is now known as sshnaidm|afk | 12:29 | |
shardy | EmilienM: Hi! I think we're good, I've deferred everything except composable-services-within-roles in launchpad | 12:29 |
shardy | I was about to check if we've had another successful promotion since friday | 12:29 |
pradk | can we merge this please https://review.openstack.org/#/c/339553/ | 12:30 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Move ironic::db data within service template https://review.openstack.org/336451 | 12:30 |
shardy | pradk: we can, but we should probably move that hieradata to the swift-proxy service template (I missed this when creating that) | 12:31 |
shardy | I'll post a follow-up that fixes that | 12:31 |
shardy | approved | 12:31 |
pradk | shardy, i need to backport thids to mitaka .. i can do a follow up patch | 12:32 |
pradk | thx | 12:32 |
shardy | pradk: ack, thanks! | 12:32 |
pradk | also this keeps failing ci - https://review.openstack.org/#/c/339085 any known issues with mitaka ci ? | 12:33 |
pradk | its a backport and should not impact much | 12:33 |
pradk | the error seems to be in starting neutron server in the logs | 12:33 |
shardy | pradk: bug #1600281 | 12:34 |
openstack | bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] https://launchpad.net/bugs/1600281 | 12:34 |
shardy | we're waiting for a regression in neutron to be fixed | 12:34 |
pradk | ah ok | 12:34 |
EmilienM | shardy: what is the csv file url again? | 12:34 |
*** chandankumar_ has joined #tripleo | 12:35 | |
shardy | http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master-tripleo//versions.csv | 12:35 |
shardy | EmilienM: ^^ | 12:35 |
EmilienM | ok thx for confirming | 12:35 |
*** jdob has joined #tripleo | 12:36 | |
*** chandankumar has quit IRC | 12:37 | |
shardy | derekh: Hey the date on that versions.csv is last Wednesday, is that right? | 12:37 |
shardy | I thought we had a good promotion on Friday? | 12:37 |
shardy | EmilienM: I'd maybe hold on for a few mins until we can confirm this with derekh | 12:38 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Include bulk in swift proxy pipeline https://review.openstack.org/339553 | 12:38 |
EmilienM | shardy: ok | 12:38 |
EmilienM | shardy: https://dashboards.rdoproject.org/rdo-dev is also helpful | 12:39 |
shardy | EmilienM: cool! I didn't know about that one :) | 12:39 |
shardy | we should have something similar on tripleo.org so we can more easily see the status of all the periodic jobs | 12:40 |
dsariel_ | shardy, thanks :-) | 12:42 |
*** bfournie has joined #tripleo | 12:44 | |
*** rlandy has joined #tripleo | 12:44 | |
shardy | dsariel_: one other suggestion, if possible stick with CentOS7 for the host OS, other combinations (e.g RHEL, Fedora) can be made to work, but they're more likely to cause you issues | 12:44 |
EmilienM | shardy: https://review.openstack.org/#/c/340350/ ready for review | 12:46 |
*** pradk has quit IRC | 12:47 | |
*** bfournie has quit IRC | 12:48 | |
dsariel_ | shardy, oh thanks, but I need triple O for downstream so RHEL is the must. | 12:49 |
*** chandankumar_ has quit IRC | 12:50 | |
shardy | dsariel_: Ah, if you're testing the downstream builds that will be fine I'm sure, we just don't CI test upstream builds on it | 12:50 |
shardy | dsariel_: Ah, if you're testing the downstream builds that will be fine I'm sure, we just don't CI test upstream builds on it | 12:50 |
shardy | oops | 12:51 |
*** dprince has joined #tripleo | 12:53 | |
*** zephcom has quit IRC | 12:53 | |
shardy | EmilienM: thanks, looks good - it's a shame we don't have a more recent promote though as there's a few things I'll have to move out of n-2 into n-3 in launchpad | 12:55 |
shardy | I guess it could be rebased tomorrow if it's not approved and the periodic job passes | 12:55 |
shardy | I'm not sure if the osc-lib issue is the only problem tho | 12:55 |
*** weshay is now known as weshay_mtg | 12:55 | |
EmilienM | shardy: osc client is broken | 12:55 |
EmilienM | it is for Puppet OpenStack CI | 12:56 |
EmilienM | I'm sure this is the same problem in tripleo | 12:56 |
*** zephcom has joined #tripleo | 12:56 | |
shardy | EmilienM: Yeah - if we can fix that via the specfile revert proposed by apevec, perhaps we'll get a periodic job pass tonight | 12:56 |
shardy | then we could release with a much newer puppet-tripleo, t-h-t and tripleoclient | 12:57 |
shardy | not a big deal if we have to go with this tho I guess | 12:57 |
* shardy doesn't like deferring completed things to the next milestone ;) | 12:57 | |
derekh | slagle: +2 | 12:57 |
*** akshai has joined #tripleo | 12:57 | |
*** masco has quit IRC | 12:59 | |
derekh | shardy: we promoted on thursady night / friday morning is when the promotion happened, but the repo it actually promoted was from wednesday | 12:59 |
EmilienM | I don't think it's a big deal now, it's just a milestone | 12:59 |
EmilienM | it will be more critical by the end of Newton | 12:59 |
shardy | derekh: Ah, Ok that explains it, thanks for confirming | 13:00 |
*** fpan has joined #tripleo | 13:00 | |
*** zaneb has joined #tripleo | 13:01 | |
shardy | EmilienM: Yeah, not a big deal, I just wanted to maximize the number of completed blueprints in n-2, because we released with zero in n-1 | 13:02 |
shardy | It'll be two in n-2 which is an improvement I guess | 13:03 |
EmilienM | shardy: right, this cycle is really busy | 13:03 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Bump up the number of OVB env workers available https://review.openstack.org/340359 | 13:03 |
shardy | there will be 15 remaining for n-3, so I'm going to have to start deferring stuff to beyond newton | 13:03 |
shardy | which I was hoping to avoid :) | 13:03 |
shardy | EmilienM: what should we do about composable-services-within-roles? Shall I defer that to n-3, as it's probably nearly complete, but there's a number of remaining patches? | 13:04 |
EmilienM | newton was very tricky because of the composable roles thing | 13:04 |
EmilienM | shardy: yes a few number of things | 13:04 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Bump up the number of OVB env workers available https://review.openstack.org/340359 | 13:04 |
shardy | the other option is to close the BP (because we've landed the composable architecture now) | 13:04 |
EmilienM | the composable architecture is done | 13:04 |
shardy | and raise bugs for the remaining services that need work on conversion to the new model | 13:05 |
EmilienM | the implementation is almost done | 13:05 |
EmilienM | the next step is what you're prototyping | 13:05 |
EmilienM | shardy: +1 | 13:05 |
shardy | EmilienM: Yeah, that's got a separate bp custom-roles | 13:05 |
derekh | Fix (I think) for testenv env timeouts here, no need to wait for CI https://review.openstack.org/#/c/340359 | 13:05 |
*** rbrady has joined #tripleo | 13:05 | |
shardy | so perhaps I'll mark the composable-services-within-roles complete and we can follow up with bugs for specific services | 13:06 |
*** sshnaidm|afk is now known as sshnaidm | 13:06 | |
EmilienM | shardy: wfm | 13:06 |
openstackgerrit | Merged openstack/instack-undercloud: Increase swift-proxy node_timeout https://review.openstack.org/338456 | 13:06 |
*** jdob has quit IRC | 13:06 | |
*** jdob has joined #tripleo | 13:07 | |
hewbrocca | Out of curiosity, what percentage of the total specific services are we still working on? | 13:07 |
hewbrocca | It sounds to me like we have the lion's share complete | 13:08 |
*** anshul has joined #tripleo | 13:08 | |
shardy | hewbrocca: Yeah, I think we must have at least 80% done now, but tracking it in the etherpad has ended up being a bit unweildy due to the number of services/patches | 13:09 |
shardy | I'm hoping switching to bugs per-service will allow me to give you a more accurate answer to that question ;) | 13:09 |
hewbrocca | *nod* | 13:09 |
hewbrocca | yeah the etherpad has kinda outgrown its usefulness :) | 13:09 |
*** ooolpbot has joined #tripleo | 13:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 13:10 |
*** ooolpbot has quit IRC | 13:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 13:10 |
shardy | It looks like that one blueprint has tracked over 80 patches | 13:10 |
hewbrocca | blearrgh | 13:12 |
hewbrocca | that's kind of the example case for a blueprint that was too big to begin with :) | 13:12 |
*** myoung|afk is now known as myoung | 13:13 | |
*** julim has joined #tripleo | 13:13 | |
EmilienM | shardy: any chance to look ceilometer? https://review.openstack.org/#/c/333498/ | 13:17 |
*** jdob has quit IRC | 13:17 | |
*** jdob has joined #tripleo | 13:17 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Bump up the number of OVB env workers available https://review.openstack.org/340359 | 13:17 |
EmilienM | hewbrocca, shardy: yes this blueprint could have been splited, but really what matters is that we moved everything. It was really tricky and painful, so hopefully we won't have to do this anymore. | 13:17 |
*** fzdarsky has joined #tripleo | 13:18 | |
hewbrocca | Yes indeed | 13:18 |
EmilienM | shardy: they don't want the revert | 13:19 |
EmilienM | I tried... | 13:19 |
EmilienM | shardy: /me tryin gagain on #openstack-sdks | 13:20 |
derekh | <sshnaidm> derekh, when I use image from tripleo, I can't log in to undercloud: Permission denied (publickey). , which user is user there? | 13:20 |
derekh | sshnaidm: root | 13:20 |
sshnaidm | derekh, that only one I didn't try :) | 13:20 |
shardy | EmilienM: Ok (*sigh*) - I guess they're going to have to fix it somehow tho, we can probably go with the RDO package revert in the meantime | 13:21 |
*** pgadiya has quit IRC | 13:21 | |
derekh | sshnaidm: ya, its a little unorthodoxed , but its was the only option https://review.openstack.org/#/c/339856/ and https://review.openstack.org/#/c/339855/ | 13:22 |
*** ccamacho|lunch is now known as ccamacho | 13:22 | |
*** apetrich_ has joined #tripleo | 13:23 | |
*** egafford has joined #tripleo | 13:23 | |
*** lblanchard has joined #tripleo | 13:24 | |
*** apetrich has quit IRC | 13:25 | |
trown | shardy: ya, we are having some issues with some projects that do not share the philosophy that master should be kept working | 13:26 |
gfidente | derekh sshnaidm do you guys know if we ever thought/tried switching the CI image building to the new yaml descriptor mechanism? | 13:26 |
trown | shardy: they think we should only consume releases | 13:26 |
trown | shardy: there are some proposals to deal with that more gracefully in RDO, but for the interim we just have to carry reverts in RDO packaging when one of those projects breaks master | 13:27 |
sshnaidm | gfidente, sorry, I don't know about this | 13:27 |
derekh | gfidente: there is a patch somewhere, ..looking | 13:28 |
gfidente | derekh ah cool | 13:28 |
gfidente | does it need love/votes? | 13:28 |
derekh | gfidente: this one https://review.openstack.org/#/c/336312/ | 13:29 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Repurpose KeystoneWorkers add keystone::wsgi::apache::threads https://review.openstack.org/336472 | 13:31 |
derekh | gfidente: the nonha job has been failing for a few days now, looks like a ceph problem, any idea what might be going on? | 13:31 |
gfidente | derekh nonha? | 13:32 |
derekh | gfidente: ya, the left hand column here http://tripleo.org/cistatus.html | 13:33 |
derekh | gfidente: its running on all of the puppet modules | 13:33 |
*** panda|afk is now known as panda | 13:33 | |
*** anshul has quit IRC | 13:35 | |
shardy | trown: ack, that is disappointing to hear, but I guess we'll just have to work around it | 13:39 |
*** anshul has joined #tripleo | 13:43 | |
gfidente | derekh ah found it, looking | 13:44 |
gfidente | going to build locally to see if I can find anything | 13:45 |
derekh | gfidente: ok | 13:47 |
gfidente | weird it says there was no systemctl unit | 13:49 |
*** r-mibu has quit IRC | 13:49 | |
*** tosky has quit IRC | 13:50 | |
*** Goneri has joined #tripleo | 13:50 | |
*** rbrady has quit IRC | 13:51 | |
*** r-mibu has joined #tripleo | 13:54 | |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 13:54 |
*** zoli|wfh is now known as zoli|mtg | 13:55 | |
*** rbrady has joined #tripleo | 13:55 | |
*** pradk has joined #tripleo | 13:57 | |
pbourke | derekh: another question for disk-image-builder, is it possible to do things like editing a systemd file, ading a user to a group etc? Or do people have to write their own elements for these? | 14:02 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Include bulk in swift proxy pipeline https://review.openstack.org/340385 | 14:03 |
*** anshul has quit IRC | 14:05 | |
*** liverpooler has quit IRC | 14:08 | |
*** jcoufal has joined #tripleo | 14:09 | |
derekh | pbourke: for that you would need an element or if the extra package your hoping to install requires those things then it might be more suitable as part of the package itself | 14:09 |
panda | derekh: how can I get credentials for rh2 ? | 14:10 |
*** ooolpbot has joined #tripleo | 14:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 14:10 |
*** ooolpbot has quit IRC | 14:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 14:10 |
openstackgerrit | Derek Higgins proposed openstack/tripleo-heat-templates: Add a second proxy-logging middleware entry to swift-proxy https://review.openstack.org/340389 | 14:11 |
derekh | panda: I can send them to you, but please keep usage to things specifically to reproduce CI problems not general purpose dev | 14:12 |
panda | derekh: my first task is just to learn how things are working. Second task is fixing bugs. Third task is profit. If you want and have time to walk me through that would be great. | 14:14 |
*** aufi has quit IRC | 14:16 | |
derekh | panda: sure, I've sent you a mail with an etherpad that should get you started, if its lacking just ping me here and we can update the etherpad as we go along | 14:18 |
*** anshul has joined #tripleo | 14:18 | |
panda | derekh: thanks | 14:20 |
*** anshul has quit IRC | 14:22 | |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Re-enable Ceilometer composable roles for controller https://review.openstack.org/333498 | 14:27 |
*** zaneb has quit IRC | 14:29 | |
EmilienM | pradk: last comment on https://review.openstack.org/#/c/333498/ | 14:29 |
pradk | EmilienM, hmm we could.. that would mean we need map_merge, i can look into it if you feel strongly about it | 14:30 |
*** fragatina has quit IRC | 14:32 | |
*** fragatina has joined #tripleo | 14:33 | |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Add Aodh composable roles https://review.openstack.org/333556 | 14:33 |
EmilienM | pradk: yes, this is a central agent specific bit, no need to put it in base | 14:34 |
pradk | EmilienM, kk i'll update it | 14:34 |
EmilienM | pradk: thanks, after that I think we're good | 14:34 |
EmilienM | pradk: I'm looking at the gnocchi patch why it fails now | 14:35 |
EmilienM | pradk: gnocchi db sync fails http://logs.openstack.org/13/318413/56/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/f985af7/logs/postci.txt.gz#_2016-07-11_12_20_25_000 | 14:36 |
pradk | EmilienM, i think thats due to where we're doing db sync .. see ccamacho's fix https://review.openstack.org/#/c/340301/ | 14:37 |
pradk | does it still fail with his fix? | 14:37 |
*** chandankumar has joined #tripleo | 14:38 | |
pradk | EmilienM, is there any way to access gnocchi logs in ci? | 14:38 |
pradk | EmilienM, we use to be able to | 14:38 |
ccamacho | pradk EmilienM, yeahp, and after fixing it I think the mysql and the gnocchi service are living in different places im hitting this http://paste.openstack.org/show/529713/ Im currently rebuilding my env to launch a 3 controller overcloud because I can not reproduce it locally | 14:40 |
shardy | Congratulations everyone, newton-2 has been released :) | 14:41 |
shardy | https://launchpad.net/tripleo/+milestone/newton-2 | 14:41 |
EmilienM | ccamacho: it still fails | 14:41 |
pradk | hmm Access denied for user 'gnocchi'@'192.0.2.6 | 14:41 |
EmilienM | shardy: yeah! | 14:41 |
shardy | Thanks for preparing the release patch EmilienM :) | 14:41 |
pradk | yay! | 14:41 |
EmilienM | shardy: my pleasure | 14:41 |
ccamacho | pradk to see the submission logs im doing this, http://paste.openstack.org/show/529762/ | 14:41 |
EmilienM | shardy: FYI, we also releases N2 for 30 Puppet modules | 14:41 |
shardy | excellent | 14:42 |
EmilienM | released* | 14:42 |
shardy | now to focus on the remaining n-3 stuff ;) | 14:42 |
hewbrocca | woop woop newton2! | 14:42 |
EmilienM | ccamacho: ::gnocchi::db::mysql is required at step 2 IIRC | 14:42 |
*** weshay_mtg is now known as weshay | 14:43 | |
pradk | may be we keep db::sync in step 3 | 14:43 |
pradk | and move galera alone | 14:44 |
ccamacho | EmilienM ACK I will check it | 14:44 |
*** dbecker has quit IRC | 14:45 | |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Move gnocchi clustercheck to step 5 https://review.openstack.org/340301 | 14:47 |
*** dbecker has joined #tripleo | 14:48 | |
EmilienM | shardy: so what needs to be moved: ceilometer, gnocchi (both WIP by ccamacho pradk and me), some bits from nova/neutron (WIP by dprince and me), some galera bits | 14:49 |
*** tosky has joined #tripleo | 14:49 | |
*** tosky has quit IRC | 14:50 | |
shardy | EmilienM: ack - would you mind raising a bug for each missing thing, and link any under review patches? | 14:50 |
EmilienM | sure thing | 14:51 |
*** oshvartz has quit IRC | 14:51 | |
*** tosky has joined #tripleo | 14:51 | |
shardy | if we target those at n-3 we can hopefully track them more easily that the etherpad | 14:51 |
shardy | than the etherpad | 14:51 |
shardy | dprince: Hey, I think we can probably go ahead and land https://review.openstack.org/#/c/322612/ and https://review.openstack.org/#/c/327780 ? | 14:52 |
shardy | I've locally tested and +2'd them both | 14:53 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Re-enable Ceilometer composable roles for controller https://review.openstack.org/333498 | 14:53 |
EmilienM | pradk: just amending commit message ^ | 14:53 |
shardy | I'd like to fix the hang on error problem I hit last week, but we can do that as a followup I think | 14:53 |
shardy | be good to get the mistral API coverage increasing in CI :) | 14:53 |
dprince | shardy: looking... in a meeting today and tomorrow so I may be slow | 14:54 |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Move gnocchi clustercheck to step 5 https://review.openstack.org/340301 | 14:55 |
shardy | dprince: no rush, it's just the first two patches in the tripleoclient series switching to mistral | 14:55 |
shardy | dprince: I'm keen to get the overcloud deploy converted ASAP because I need to wire in jinja2 templating for custom-roles | 14:55 |
d0ugal | +1 | 14:55 |
shardy | I think d0ugal was looking into that | 14:55 |
d0ugal | shardy: with rbrady's help | 14:55 |
shardy | d0ugal: hey, I don't see any patches, did you managed to rebase/test the stuff from dprince's github branch? | 14:55 |
dprince | shardy: yes, very exciting times finally :) | 14:55 |
*** rbrady has quit IRC | 14:56 | |
d0ugal | shardy: rbrady has been working on it, so don't want to duplicate effort but ready to help if I can | 14:56 |
shardy | d0ugal: Ok, no worries | 14:56 |
shardy | I think I looked at the tripleo-common part of that last week | 14:57 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Gnocchi composable roles https://review.openstack.org/318413 | 14:57 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Add Aodh composable roles https://review.openstack.org/333556 | 14:57 |
gfidente | jistr I think $::processorcount comes as a fact not in hiera | 14:57 |
EmilienM | pradk: same here, just commit message ^ | 14:57 |
pradk | kk | 14:57 |
dprince | d0ugal: hi, so I'm working on a patch to python-zaqarclient that will move the base WebsocketClient there. What are your thoughts on this? | 14:57 |
jistr | gfidente: yea i know, but still the question remains valid i think | 14:57 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Gnocchi composable roles https://review.openstack.org/318413 | 14:57 |
EmilienM | ccamacho: same here, commit message ^ | 14:58 |
gfidente | jistr right better to test it anyway | 14:58 |
d0ugal | shardy: Yeah, so my current issue is that I can't figure out how to use the WIP workflows. | 14:58 |
gfidente | we can probably check ci job stuff | 14:58 |
d0ugal | shardy: Which might be an issue with me, but I think some combination of these is needed: https://review.openstack.org/#/q/status:open+project:openstack/tripleo-common+owner:%22Ryan+Brady+%253Crbrady%2540redhat.com%253E%22 | 14:58 |
dprince | d0ugal: I'd like to use the WebsocketClient from other projects in tripleo too | 14:58 |
*** mvc has joined #tripleo | 14:58 | |
*** zoli|mtg is now known as zoli|wfh | 14:59 | |
jistr | gfidente, marios: hiera docs say that the '$' shouldn't be there for puppet vars, which made me wonder -- maybe it shouldn't be there for facts either? | 14:59 |
d0ugal | dprince: +1, that sounds like a good idea. | 14:59 |
EmilienM | shardy: https://bugs.launchpad.net/tripleo/+bugs?field.tag=composable-roles | 14:59 |
EmilienM | shardy: I'll add the tags for all missing work | 15:00 |
d0ugal | dprince: I guess we might need to move this back out then: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/plugin.py#L124-L136 | 15:00 |
d0ugal | dprince: as that is the only bit specific to our workflows | 15:00 |
numans | dprince, Hi, can you please review this when you get some time. You had given +2 before - https://review.openstack.org/#/c/320531/ | 15:01 |
*** lucasagomes has quit IRC | 15:01 | |
shardy | EmilienM: thanks! | 15:01 |
dprince | d0ugal: yes, the generic version I am making doesn't have that | 15:02 |
dprince | d0ugal, shardy: I've got os-collect-config working with zaqarwebsockets finally | 15:02 |
mvc | Hi all, I have been looking into the documentation but I haven't been able to find out if is possible to deploy tripleo undercloud in VM and overcloud in baremetal machines. Based on the docs it should be possible if VM and BM share the same network segment. Is that assumption okay? | 15:02 |
d0ugal | dprince: Thanks for the reviews btw | 15:03 |
*** jeckersb_gone is now known as jeckersb | 15:03 | |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Re-enable Ceilometer composable roles for controller https://review.openstack.org/333498 | 15:03 |
dprince | d0ugal, shardy: I'd like to consider switching to that as a default instead of Swift even... because of the improved polling | 15:03 |
pradk | EmilienM, moved coordination url to central agent ^^ | 15:03 |
dprince | d0ugal: also, this https://review.openstack.org/#/c/339215/ | 15:04 |
EmilienM | pradk: ++ | 15:04 |
d0ugal | dprince: sorry, switch to what instead of Swift? | 15:04 |
dprince | d0ugal: getting the Websocket keystone endpoint will make our code better | 15:04 |
*** rbartal has quit IRC | 15:04 | |
shardy | dprince: ack, we could consider using zaqar for both metadata and signals back to heat I think | 15:04 |
dprince | d0ugal: switch os-collect-config to use zaqar websockets instead of polling swift | 15:04 |
shardy | mvc: yes that should work, we just don't have that combination well documented atm | 15:04 |
d0ugal | dprince: oh, yeah, that would be good. I didn't know it polled switch | 15:05 |
hewbrocca | We've always said we wanted to use zaqar for this... | 15:05 |
d0ugal | dprince: Change looks good, I can't +2 it tho :( | 15:05 |
dprince | d0ugal: now that I figured out websockets I just couldn't help myself from using it in a few extra places | 15:05 |
hewbrocca | chuckle | 15:05 |
dprince | d0ugal: ack, just wanted you to be aware of the incoming endpoint | 15:05 |
*** rbrady has joined #tripleo | 15:05 | |
d0ugal | dprince: +1, they are really neat. I've never really used them from Python before which is cool. | 15:05 |
d0ugal | oops, I am not allowed but I almost +1 workflow'ed that change by mistake. | 15:06 |
*** lucasagomes has joined #tripleo | 15:06 | |
dprince | shardy: you might review this then https://review.openstack.org/#/c/339215/. It will help us improve our websocket client code | 15:07 |
openstackgerrit | Martin André proposed openstack/instack-undercloud: Add tripleo deployment config file paths to hiera https://review.openstack.org/329016 | 15:07 |
openstackgerrit | Martin André proposed openstack/instack-undercloud: Introduce 'enable_validations' option https://review.openstack.org/322893 | 15:07 |
EmilienM | gfidente: fyi, I'm taking care of https://bugs.launchpad.net/tripleo/+bug/1601853 | 15:08 |
openstack | Launchpad bug 1601853 in tripleo "Enable MySQL profiles" [High,New] - Assigned to Emilien Macchi (emilienm) | 15:08 |
EmilienM | gfidente: it wasn't wip, right? | 15:08 |
gfidente | EmilienM go ahead I think now that the submission to relocate galera-ready merged it should be approachable | 15:09 |
EmilienM | ok | 15:09 |
*** ebarrera has quit IRC | 15:10 | |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 15:10 |
*** sanjayu is now known as sanjayu|AFK | 15:11 | |
shardy | EmilienM: FYI I added https://bugs.launchpad.net/tripleo/+bug/1601857 to track the ringbuilder patches I have WIP | 15:13 |
openstack | Launchpad bug 1601857 in tripleo "Convert Swift ringbuilder to composable services format" [High,In progress] - Assigned to Steven Hardy (shardy) | 15:13 |
*** zaneb has joined #tripleo | 15:13 | |
openstackgerrit | Merged openstack/tripleo-puppet-elements: Support for the OpenvSwitch OVN Controller https://review.openstack.org/320531 | 15:14 |
ccamacho | EmilienM quick question, this https://review.openstack.org/#/c/335499/ for Horizon was working and does not have pacemaker, passing CI, I have addressed (I think) your comment on the puppet-tripleo part when having some time can you check it?! | 15:14 |
derekh | bnemec: if you has a minutes can you look over the sanity of https://review.openstack.org/#/c/340359/ | 15:14 |
EmilienM | shardy: ack. There is more than that, also all dprince and I work about nova/neutron that is not finished | 15:14 |
*** pcaruana has quit IRC | 15:15 | |
EmilienM | ccamacho: I will, I'm now working on galera profiles... | 15:15 |
ccamacho | EmilienM np | 15:15 |
dprince | EmilienM: looking into the CI failure again now | 15:15 |
dprince | EmilienM: I may be slow today but I will do what I can to move it forwards | 15:15 |
bnemec | derekh: I've actually got that open on my screen right now. :-) | 15:15 |
derekh | bnemec: nice | 15:15 |
*** numans has quit IRC | 15:16 | |
bnemec | derekh: Although I've had it open for almost an hour and haven't actually voted yet. | 15:16 |
*** ebalduf has joined #tripleo | 15:16 | |
derekh | bnemec: take your time, its monday | 15:17 |
derekh | bnemec: unfortunately this will also mean we may at times be using quota up that isn't being used | 15:17 |
derekh | bnemec: medium term I think we can do way better | 15:18 |
derekh | bnemec: by requesting the testenv after the image build | 15:18 |
derekh | bnemec: But I'll wait until after mutinode stuff has landed to avoid the rebase being a pain in the ass | 15:19 |
bnemec | derekh: Ah, interesting. Makes sense since we're using the Jenkins slave as the undercloud we don't need the full env until we're actually ready to register nodes. | 15:20 |
*** saneax is now known as saneax_AFK | 15:20 | |
marios | jistr: sry man, calls | 15:21 |
bnemec | And slagle's got nothing better to do than rebase his patches, so I'm sure he won't mind. :-P | 15:21 |
derekh | bnemec: exactly, in theory we should then be able to pack a lot more into the cloud, assuming different jobs are all at different stages but that might effect reliability so we'll take that slowly | 15:22 |
openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates: Add hyperconverged-ceph environment to include CephOSD on computes https://review.openstack.org/338113 | 15:23 |
bnemec | derekh: Yeah. Like I said on the review, I think we've got some leeway on rh2 capacity right now so we should be able to pack more in anyway. | 15:24 |
bnemec | The faster boxes are still criminally underutilized. | 15:24 |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Adds action for template processing https://review.openstack.org/337615 | 15:24 |
derekh | bnemec: yup | 15:24 |
openstackgerrit | Merged openstack/instack-undercloud: Create a Keystone endpoint for Zaqar websockets https://review.openstack.org/339215 | 15:28 |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Move gnocchi clustercheck to step 2 https://review.openstack.org/340301 | 15:28 |
shardy | jrist_: Hey, is there a high-res/SVG version of your tripleowl v2.0 around anywhere? | 15:29 |
shardy | there's a discussion re project mascots on openstack-dev, and I'd like to propose we keep that one :) | 15:30 |
*** rajinir has joined #tripleo | 15:30 | |
*** dsariel_ has quit IRC | 15:31 | |
openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates: Add hyperconverged-ceph environment to include CephOSD on computes https://review.openstack.org/338113 | 15:31 |
*** tosky has quit IRC | 15:32 | |
*** dsariel has quit IRC | 15:32 | |
openstackgerrit | Merged openstack/python-tripleoclient: Use Mistral for baremetal registration https://review.openstack.org/322612 | 15:33 |
d0ugal | \o/ | 15:33 |
*** mvc has quit IRC | 15:33 | |
hewbrocca | There definitely is but I don't have the URL handy. | 15:33 |
shardy | nvm, I've replied and someone can follow up with a link to the SVG | 15:34 |
d0ugal | shardy: https://github.com/openstack/tripleo-ui/blob/master/src/img/tripleo-owl.svg | 15:34 |
shardy | Pretty cool, OpenStack foundation ratified TripleOwl! :) | 15:34 |
shardy | d0ugal: thanks! | 15:35 |
hewbrocca | NICE | 15:36 |
hewbrocca | jrist: #winning | 15:36 |
hewbrocca | also dprince and his kids for having the owl idea in the first place | 15:36 |
jrist_ | shardy: yes | 15:37 |
d0ugal | oh, that is great! | 15:37 |
jrist_ | http://wixagrid.com/tripleo/ shardy | 15:37 |
*** leanderthal is now known as leanderthal|afk | 15:37 | |
dprince | shardy: ratified, cool man | 15:38 |
d0ugal | jrist_: Would be good to add them to tripleo.org | 15:38 |
d0ugal | Not sure how we do that :) | 15:38 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Add MySQL profiles https://review.openstack.org/340444 | 15:39 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Move nova::db data within service template https://review.openstack.org/335561 | 15:44 |
openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates: This change adds the CephClientKey parameter to puppet-ceph-devel.yaml and storage-environment.yaml environment files. https://review.openstack.org/340447 | 15:44 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Move nova::db data within service template https://review.openstack.org/335561 | 15:44 |
greghaynes | SpamapS: Hey, I am tracking down some annoying behavior of the -minimal images which is due to the fact that debootstrap does not support using multiple mirrors (and therefore backports/updates) | 15:44 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Move MySQL Galera within composable services https://review.openstack.org/340448 | 15:44 |
greghaynes | SpamapS: and I think I need some deb fu | 15:45 |
EmilienM | gfidente, shardy: can you give early feedback on https://review.openstack.org/340448 and https://review.openstack.org/340444 please? Note I didn't move parameters yet, just puppet code. | 15:45 |
*** aufi has joined #tripleo | 15:45 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Move MySQL Galera within composable services https://review.openstack.org/340448 | 15:46 |
greghaynes | SpamapS: Basically what goes on is we debootstrap without backports/updates, then we upgrade everything so we have two copies of a lot of stuff (and waste a ton of time). apt-get autoremove doesnt actually remove the original copy (I think because it notices we arent running the most recent kernel that we upgraded to) | 15:46 |
openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates: Missing CephClientKey parameter in puppet-ceph-devel and storage-environment https://review.openstack.org/340447 | 15:46 |
greghaynes | SpamapS: so over time our -minimal images just get bigger and bigger | 15:46 |
gfidente | mcornea ^^ that is nice | 15:50 |
gfidente | thanks | 15:50 |
gfidente | we could explain the commit it's needed when not passing ceph scale | 15:50 |
gfidente | as the client won't generate those keys | 15:50 |
mcornea | gfidente: ack, updating | 15:51 |
gfidente | at the same time, sounds like we can also make the client always generate those because it uses parameter_defaults now | 15:51 |
gfidente | commenting this on the BZ | 15:51 |
jrist_ | d0ugal: they are | 15:51 |
jrist_ | d0ugal: well the logo on tripleo.org is svg | 15:51 |
*** dtantsur is now known as dtantsur|bbl | 15:52 | |
d0ugal | jrist_: ah okay, tripleo.org/logos would be nice tho' | 15:52 |
SpamapS | greghaynes: autoremove is pretty dumb | 15:54 |
SpamapS | greghaynes: it's only recently that it knew how to remove kernels at all. | 15:54 |
*** lucasagomes is now known as lucas-afk | 15:55 | |
SpamapS | greghaynes: so I suggest we just assert the one kernel we want. | 15:55 |
greghaynes | SpamapS: Meaning find the most recent after an upgrade and uninstall the other? | 15:57 |
greghaynes | SpamapS: Something else I am looking at is making ubuntu-minimal install the correct thing from the outset | 15:57 |
greghaynes | SpamapS: and that led me to wondering - do you know what germinate is fed in to for making the upstream images? | 15:58 |
SpamapS | yes, the seeds | 15:59 |
greghaynes | I mean, what actually reads in the germinate output | 15:59 |
greghaynes | and grabs the debs it says should go in to an image | 15:59 |
SpamapS | Oh, what goes from germinate -> qcow2? | 15:59 |
*** tosky has joined #tripleo | 15:59 | |
greghaynes | yea | 15:59 |
SpamapS | I believe that is "canonical's special sauce" | 16:00 |
greghaynes | $secret_sauce? | 16:00 |
greghaynes | haha | 16:00 |
greghaynes | ok | 16:00 |
SpamapS | but IIRC, it involves vm-builder | 16:00 |
EmilienM | ccamacho: ok looking now | 16:01 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Gnocchi composable roles https://review.openstack.org/318413 | 16:02 |
EmilienM | ccamacho: rebasing to have your patch in puppet-tripleo ^ | 16:03 |
ccamacho | EmilienM thanks! | 16:03 |
EmilienM | ccamacho: reviewing horzon now | 16:03 |
EmilienM | ccamacho: it looks good for a first iteration. We can improve the networking params later | 16:05 |
openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates: Missing CephClientKey parameter in puppet-ceph-devel and storage-environment https://review.openstack.org/340447 | 16:05 |
EmilienM | to make them composable or something | 16:05 |
EmilienM | ccamacho: did you test it? | 16:05 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Use already Deployed/Installed servers https://review.openstack.org/222772 | 16:05 |
ccamacho | EmilienM, Yeahp, and created this blog entry as I never did it before http://www.anstack.com/blog/2016/07/02/ssh-multi-hop-tripleo.html :) | 16:06 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 16:06 |
EmilienM | \o/ | 16:06 |
*** rwsu has joined #tripleo | 16:06 | |
EmilienM | gfidente: can you review https://review.openstack.org/#/c/335506/ please? | 16:06 |
EmilienM | or shardy (it's horizon composable) | 16:06 |
gfidente | EmilienM derekh so the nonha failure is due to the change in puppet-ceph for jewel | 16:08 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Add MySQL profiles https://review.openstack.org/340444 | 16:09 |
EmilienM | what? | 16:09 |
EmilienM | gfidente: we are bumping puppet-ceph | 16:09 |
EmilienM | https://review.openstack.org/#/c/314311/ | 16:09 |
*** ooolpbot has joined #tripleo | 16:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 16:10 |
*** ooolpbot has quit IRC | 16:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 16:10 |
EmilienM | gfidente: we are pinning I mean | 16:10 |
*** jcoufal has quit IRC | 16:11 | |
*** dprince has quit IRC | 16:11 | |
*** fzdarsky is now known as fzdarsky|lunch | 16:11 | |
*** jcoufal has joined #tripleo | 16:13 | |
openstackgerrit | Merged openstack/python-tripleoclient: Use Mistral for baremetal introspection https://review.openstack.org/327780 | 16:13 |
d0ugal | \o/ | 16:14 |
derekh | EmilienM: we're not pinning anything at the moment in tripleo-ci | 16:15 |
EmilienM | derekh: so what does https://review.openstack.org/#/c/314311/ ? | 16:16 |
*** fzdarsky|lunch has quit IRC | 16:16 | |
shardy | https://github.com/openstack/tripleo-puppet-elements/blob/master/elements/puppet-modules/source-repository-puppet-modules#L7 specifies the stable/hammer branch? | 16:16 |
EmilienM | I thought it would | 16:17 |
gfidente | EmilienM yeah the pinning isn't effective | 16:17 |
shardy | did we switch to using puppet modules from package via delorean-current? | 16:17 |
derekh | EmilienM: shardy crap, I think the chaching logic in tripleo-ci stomps over it | 16:18 |
*** akrivoka has quit IRC | 16:18 | |
shardy | oops | 16:18 |
EmilienM | :( sorry | 16:18 |
EmilienM | I didn't see it | 16:18 |
shardy | we probably should start consuming the packaged modules anyway | 16:19 |
EmilienM | but yeah, puppet-ceph/master is now deploying Jewel | 16:19 |
EmilienM | we're on the edge! | 16:19 |
shardy | how much work is involved in just making jewel work? | 16:19 |
shardy | gfidente: have you looked into that? | 16:19 |
shardy | I know some folks want TripleO support for that anyway | 16:19 |
gfidente | EmilienM shardy so currently the problem is that the packages we have in centos don't ship a systemd unit | 16:20 |
gfidente | while the module assumes if the provider is systemd there will be a ceph unit | 16:20 |
*** dbecker has quit IRC | 16:20 | |
EmilienM | Puppet CI is deploying Ceph Jewel with buildlogs.centos.org/centos/7/storage/x86_64/ceph-jewel/ | 16:21 |
EmilienM | maybe we could use it ^ | 16:21 |
gfidente | yeah it's using the jewel builds | 16:22 |
EmilienM | though I reported https://bugzilla.redhat.com/show_bug.cgi?id=1354488 | 16:22 |
openstack | bugzilla.redhat.com bug 1354488 in Build "Multiple SElinux alerts" [Unspecified,Assigned] - Assigned to branto | 16:22 |
EmilienM | 26 SElinux issues :) | 16:22 |
shardy | ouch | 16:22 |
*** dtrainor has quit IRC | 16:22 | |
EmilienM | but maybe related to our way to deploy Ceph; | 16:22 |
EmilienM | so might be easy to fix | 16:22 |
EmilienM | anyway, Jewel is current LTS, we should use it asap I would say | 16:22 |
EmilienM | should we pin it in tripleo ci repo? | 16:23 |
gfidente | <EmilienM> but maybe related to our way to deploy Ceph ? | 16:24 |
*** cwolferh has joined #tripleo | 16:24 | |
*** jrist_ has quit IRC | 16:24 | |
derekh | So whats happening in the nonha job is that we do through all the puppet modules in /opt/stack/new/puppet-* | 16:25 |
*** jpich has quit IRC | 16:25 | |
*** ebarrera has joined #tripleo | 16:25 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Add environment file to enable DVR https://review.openstack.org/332147 | 16:25 |
derekh | and set the REPOREF to whatever zuul put there, see create_dib_vars_for_puppet here http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/common_functions.sh#n276 | 16:25 |
*** florianf has quit IRC | 16:25 | |
derekh | this overrides whatever is in source-repository-puppet-modules | 16:26 |
derekh | EmilienM: ^^ so ya, I think for the onha job to pass today we gotta pin it there, this is only a problem in ci I think | 16:26 |
derekh | *nonha | 16:26 |
gfidente | EmilienM derekh on the other hand, we'll want to test jewel so I think we want to be able to checkout hammer/master version of puppet-ceph in the stable/master jobs | 16:27 |
*** rhallisey has quit IRC | 16:28 | |
*** dmsimard1 has joined #tripleo | 16:28 | |
*** dmsimard1 is now known as dmsimard|mtl | 16:28 | |
*** trown is now known as trown|lunch | 16:31 | |
derekh | gfidente: for the stable branches we're using the packaged puppet modules, so I think its only master we're concerned with | 16:31 |
EmilienM | For Hammer, we should use puppet-ceph 1.0.0 https://github.com/openstack/puppet-ceph/releases/tag/1.0.0 | 16:32 |
EmilienM | which is the stable/hammer | 16:33 |
EmilienM | for Jewel, we can deploy master and / or 2.0.0 or 2.1.0 | 16:33 |
gfidente | yeah the problem is that which version we should use is coupled with the version of ceph, not with the version of tripleo | 16:33 |
gfidente | which means in mitaka you can only use hammer and in newton you can only use jewel | 16:34 |
EmilienM | right, puppet-ceph is coupled with the version of Ceph. | 16:34 |
EmilienM | gfidente: that's false | 16:34 |
EmilienM | you can use hammer in whatever OpenStack release you want | 16:34 |
gfidente | right but you need to have the older version of the module | 16:35 |
EmilienM | just use stable/hammer | 16:35 |
EmilienM | it's not an abandonned branch, just a stable one | 16:35 |
EmilienM | but you can deploy newton & hammer, it will works fine | 16:35 |
gfidente | yes I think we haven't hit this before because the other puppet-modules for the openstack services are branched with the openstack releases | 16:36 |
EmilienM | since last week, Puppet OpenStack CI is deploying Jewel | 16:36 |
*** yamahata has joined #tripleo | 16:37 | |
EmilienM | and it works perfectly fine module the SElinux alerts that we are currently ignoring | 16:37 |
EmilienM | modulo* | 16:37 |
gfidente | derekh EmilienM so it sounds like what we aim at as shardy pointed is to have jewel in tripleo/master | 16:37 |
*** lucas-afk is now known as lucasagomes | 16:37 | |
gfidente | what do you think? | 16:39 |
EmilienM | maybe we can just deploy buildlogs.centos.org/centos/7/storage/x86_64/ceph-jewel/ in our CI | 16:39 |
EmilienM | short term: pin puppet-ceph to stable/hammer in tripleo-ci | 16:40 |
gfidente | though people deploying tripleo on centos will fail until jewel gets into the centos repos | 16:40 |
EmilienM | middle term use: buildlogs.centos.org/centos/7/storage/x86_64/ceph-jewel/ | 16:40 |
EmilienM | gfidente: this is a centos repo, I don't get your sentence | 16:40 |
EmilienM | outside tripleo-ci? | 16:41 |
gfidente | outside tripleo-ci yes | 16:41 |
EmilienM | gfidente: so we need it in RDO? | 16:41 |
*** ohamada has quit IRC | 16:42 | |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Bump up the number of OVB env workers available https://review.openstack.org/340359 | 16:43 |
EmilienM | derekh, gfidente: I'm afk for lunch - let me know how I can help with the puppet-ceph thing. Sounds like we have 2 options... | 16:45 |
*** tesseract- has quit IRC | 16:49 | |
gfidente | EmilienM derekh so I want to push a change to enable centos' storage repo to install jewel | 16:50 |
gfidente | as that seems the most useful approach for the future | 16:51 |
gfidente | as it will allow us to test puppet-ceph/master as well | 16:51 |
*** rcernin has quit IRC | 16:51 | |
derekh | gfidente: I'm not familiar with ceph at all but if you push the patch we can see if it works at least | 16:51 |
gfidente | right, doing it now | 16:51 |
*** dsariel has joined #tripleo | 16:51 | |
*** dsariel_ has joined #tripleo | 16:52 | |
gfidente | and it should work as puppet-ceph/ci is using it already as pointed by EmilienM | 16:52 |
gfidente | then the actual issue with ci not pinning to the module version should be fixed as well but we won't need it for ceph | 16:52 |
*** ebarrera has quit IRC | 16:54 | |
EmilienM | for mitaka/liberty -> pin to stable/hammer | 16:54 |
EmilienM | for master -> don't pin (jewel) | 16:54 |
EmilienM | is it good? | 16:54 |
*** dtantsur|bbl is now known as dtantsur | 16:55 | |
gfidente | EmilienM yeah and I will use ceph-hammer repos instead of epel for tripleo mitaka/liberty as well | 16:55 |
gfidente | so that is should always match the version expected by the module | 16:56 |
EmilienM | sounds good | 16:57 |
*** bfournie has joined #tripleo | 16:58 | |
*** fzdarsky|lunch has joined #tripleo | 17:05 | |
*** fragatina has quit IRC | 17:05 | |
*** mcornea has quit IRC | 17:06 | |
*** bfournie has quit IRC | 17:06 | |
*** fzdarsky|lunch is now known as fzdarsky | 17:07 | |
*** fzdarsky is now known as fzdarsky|lunch | 17:07 | |
*** fzdarsky|lunch is now known as fzdarsky | 17:07 | |
*** dprince has joined #tripleo | 17:08 | |
*** ooolpbot has joined #tripleo | 17:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 17:10 |
*** ooolpbot has quit IRC | 17:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 17:10 |
*** shivrao has joined #tripleo | 17:11 | |
EmilienM | derekh: do we still need the alert ^ ? | 17:11 |
derekh | EmilienM: the fix just merged in the last hour, so jobs should start passing once the new package is in the trunk repository | 17:12 |
*** apetrich_ has quit IRC | 17:12 | |
EmilienM | ok | 17:12 |
derekh | EmilienM: I'm signing off now but once you see a passing mitaka job it can be closed | 17:12 |
EmilienM | derekh: ack | 17:13 |
*** derekh has quit IRC | 17:13 | |
*** ebarrera has joined #tripleo | 17:15 | |
*** apetrich_ has joined #tripleo | 17:16 | |
*** rasca has quit IRC | 17:16 | |
*** rasca has joined #tripleo | 17:17 | |
*** ebarrera has quit IRC | 17:20 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Use already Deployed/Installed servers https://review.openstack.org/222772 | 17:20 |
*** apetrich_ has quit IRC | 17:22 | |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 17:22 |
*** apetrich_ has joined #tripleo | 17:26 | |
*** yamahata has quit IRC | 17:30 | |
*** akshai has quit IRC | 17:31 | |
*** fragatina has joined #tripleo | 17:31 | |
*** akshai has joined #tripleo | 17:31 | |
*** aufi has quit IRC | 17:34 | |
*** sshnaidm is now known as sshnaidm|afk | 17:36 | |
*** panda is now known as panda|afk | 17:38 | |
*** pcaruana has joined #tripleo | 17:39 | |
*** pkovar has quit IRC | 17:42 | |
*** trown|lunch is now known as trown | 17:47 | |
*** tbonds has quit IRC | 17:49 | |
*** athomas has quit IRC | 17:51 | |
*** yamahata has joined #tripleo | 17:51 | |
*** tosky has quit IRC | 17:53 | |
*** dsariel_ has quit IRC | 17:57 | |
*** dsariel has quit IRC | 17:57 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Move ironic::db data within service template https://review.openstack.org/336451 | 17:58 |
*** dtantsur is now known as dtantsur|afk | 18:01 | |
*** ifarkas has quit IRC | 18:01 | |
*** mgould is now known as mgould|afk | 18:01 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: neutron: remove tenant MTU configuration options https://review.openstack.org/325926 | 18:03 |
dprince | EmilienM: I will rebase the compute neutron patches. I want to change the resource_registry names to better align with the DVR patch from brent | 18:05 |
*** ooolpbot has joined #tripleo | 18:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 18:10 |
*** ooolpbot has quit IRC | 18:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 18:10 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-docs: Remove RHEL from tripleo-docs https://review.openstack.org/340503 | 18:13 |
shardy | All, interested in feedback re ^^ | 18:13 |
shardy | I've got feedback that upstream builds don't work on RHEL anymore, which isn't surprising given we're only CI testing against CentOS repos | 18:14 |
shardy | IMO it's probably best to just focus the upstream docs on what we actually CI test | 18:14 |
openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Install Ceph Hammer and/or Jewel from CentOS Storage SIG repos https://review.openstack.org/340504 | 18:14 |
shardy | next step will be to figure out how we wire the repo related docs in to reflect what's tested in CI | 18:14 |
shardy | (e.g have tripleo.sh consume some docs markup or something) | 18:15 |
*** lucasagomes is now known as lucas|afk | 18:15 | |
bnemec | shardy: My proposal is to stop writing out repo docs long hand and have everyone use the same tool to enable repos: http://lists.openstack.org/pipermail/openstack-dev/2016-June/097221.html | 18:17 |
bnemec | That also avoids the case (like we just had) where the user docs are broken for two weeks because no developers use them. | 18:17 |
shardy | bnemec: ack, yeah that also would work, sorry I do remember that message now | 18:18 |
shardy | bnemec: this is more of a first step e.g don't document platforms we no longer test at all | 18:18 |
shardy | then we can document the one we do better for sure | 18:18 |
slagle | does rdo claim to work on rhel? | 18:19 |
EmilienM | dprince: ok | 18:19 |
*** zoli|wfh is now known as zoli|gone | 18:19 | |
bnemec | shardy: Yeah, I'm not opposed to that. Just taking every opportunity I can to pimp out the tool because it's been kind of damned with faint praise so far. :-) | 18:19 |
EmilienM | dprince: it failed CI though, have you seen the failure? | 18:20 |
bnemec | And we keep running into situations where it would have helped. | 18:20 |
shardy | bnemec: I think I'd be more keen on it if it wasn't yet another CLI interface, what if we had openstack undercloud repo setup? | 18:20 |
*** zoli|gone is now known as zoli_gone-proxy | 18:20 | |
shardy | I'm kind of sad about the image building divergence | 18:20 |
bnemec | shardy: It has to be standalone because it needs to be used before OpenStack packages are available. | 18:21 |
shardy | hmm, yeah good point ;) | 18:21 |
*** electrofelix has quit IRC | 18:21 | |
shardy | slagle: actually I think it's centos only too | 18:21 |
slagle | shardy: the wiki still claims rhel, was just checking | 18:22 |
openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Install Ceph Hammer and/or Jewel from CentOS Storage SIG repos https://review.openstack.org/340504 | 18:22 |
gfidente | tty tomorrow guys | 18:22 |
*** gfidente has quit IRC | 18:22 | |
shardy | slagle: my point was really that nobody is testing some of the stuff we document for RHEL anywhere downstream, because folks are switching to different (as yet undocumented in tripleo-docs) tools | 18:22 |
slagle | they are? | 18:22 |
slagle | oh, quickstart? | 18:23 |
shardy | slagle: quickstart and the image buider thing | 18:23 |
shardy | which is apparently deprecating the old image building CLI | 18:23 |
slagle | shardy: i guess i'm wondering what the message is...do we still support rhel? | 18:23 |
slagle | we have a lot of rhel-only stuff in tree | 18:23 |
shardy | slagle: I've got no problem with rhel integration, it's documenting things which aren't tested, thus by definition don't ever work | 18:24 |
shardy | I've got folks following those docs then emailing me asking why they don't work :( | 18:24 |
*** fragatina has quit IRC | 18:24 | |
shardy | now there are downstream docs covering builds targetted at RHEL, I'm just thinking it's easier to pull the stuff we don't test from the docs | 18:25 |
slagle | ok, so there exists an alternative somewhere, if we remove these? | 18:25 |
shardy | having rhel stuff in t-h-t is no different from all the other vendor specific stuff we have in there | 18:25 |
shardy | slagle: well there are pretty comprehensive docs for OSP director, which is actually tested on RHEL | 18:25 |
shardy | I guess the alternative is to wire in a RHEL CI job, but I'm not sure how feasable that is | 18:27 |
bnemec | Pretty sure it would have to be third-party CI. | 18:27 |
shardy | yeah | 18:27 |
slagle | shardy: i guess i don't think that "not tested" = "doesnt work" | 18:28 |
slagle | while in this case, it may certainly be true | 18:28 |
shardy | slagle: by definition, anything not tested regularly ends up broken | 18:28 |
slagle | yes, but not just rhel | 18:29 |
shardy | look at our CI, it breaks almost every day, often due to packaging/dependency issues | 18:29 |
slagle | i guess the point is...are we removing them b/c they're broken, or b/c we intend not to support rhel any longer | 18:29 |
*** tbonds has joined #tripleo | 18:29 | |
shardy | slagle: my argument is we don't actively support RHEL for upstream builds, because it's never tested on that platform anymore | 18:29 |
shardy | so we either automate testing (even a periodic third-party job would be fine I guess), or remove the docs | 18:30 |
bnemec | Technically I don't know that RHEL has ever been meaningfully supported upstream. | 18:30 |
shardy | my main motivation here is just to enable an easier path for new contributors | 18:30 |
bnemec | The RHEL docs are an artifact of when instack-undercloud was being developed downstream. | 18:30 |
shardy | bnemec: exactly | 18:30 |
shardy | at one time, folks were testing closely related builds on both platforms, but the test workflows have diverged significantly since then | 18:31 |
*** bfournie has joined #tripleo | 18:32 | |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 18:35 |
jeckersb | trown: trying to do devmode quickstart, always fails when trying to inject the additional images into the undercloud | 18:35 |
jeckersb | known bug? unknown bug? me being dumb? | 18:35 |
jeckersb | looks like it never downloads them before it tries to shove them into the image | 18:37 |
jeckersb | i could just grab them manually although i'm guessing that's not quite expected | 18:37 |
trown | jeckersb: let me give it a whirl, that is certainly not expected behavior :) | 18:37 |
jeckersb | trown: ok cool... if it's broken for you too i'd like to try to fix it just so i can learn how | 18:38 |
trown | jeckersb: woot, thanks! | 18:40 |
jeckersb | bit by bit i am understanding how this rube goldberg machine works :) | 18:40 |
trown | jeckersb: I am trying to rework that part of quickstart to just download an overcloud-full image do some basic conversion steps on it, and then inject the original overcloud-full and IPA images back in | 18:41 |
trown | because tripleo is no longer producing an undercloud image, so the one we have will just keep getting older | 18:41 |
jeckersb | makes sense to me! | 18:41 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Mitaka CI test https://review.openstack.org/340511 | 18:42 |
*** akshai has quit IRC | 18:47 | |
trown | jeckersb: are you passing in "--release master-tripleo"? | 18:47 |
jeckersb | trown: yep, copy/pasted out of the README | 18:48 |
jeckersb | bash quickstart.sh --config config/general_config/devmode.yml --release master-tripleo $VIRTHOST | 18:48 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 18:48 |
trown | k... my run just got past that point | 18:48 |
trown | jeckersb: could you try with "--teardown all"? | 18:49 |
jeckersb | sure | 18:50 |
*** akshai has joined #tripleo | 18:50 | |
jeckersb | trown: and make sure you don't already have /home/stack/.quickstart/ironic-python-agent.initramfs and similar on virthost beforehand | 18:51 |
jeckersb | possibly you have old copies of that around or something? | 18:51 |
jeckersb | (i'm not entirely sure how it all works so maybe that is already taken care of) | 18:51 |
dprince | beagles: hi, would you be okay if I switched the names here a bit https://review.openstack.org/#/c/332147/6/overcloud-resource-registry-puppet.yaml | 18:52 |
trown | jeckersb: I ran with "--teardown all", as that will completely delete the stack user and recreate it | 18:52 |
jeckersb | ok | 18:52 |
dprince | beagles: specifically, to ComputeNeutronL3Agent instead of ComputeL3Agent | 18:52 |
jeckersb | trown: i am guessing that completely wipes /home/stack as well | 18:52 |
trown | jeckersb: but you may be on to something none the less... the image cache is in a neutral location | 18:52 |
trown | /var/lib/oooq_image/ by default | 18:52 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Composable OpenContrail compute plugin https://review.openstack.org/338480 | 18:53 |
trown | oooq_images rather | 18:53 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Composable Neutron Core Compute Plugin https://review.openstack.org/338315 | 18:53 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Composable Nuage Compute Plugin https://review.openstack.org/338477 | 18:53 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Composable Plumgrid compute plugin https://review.openstack.org/338479 | 18:53 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Composable Midonet compute plugin https://review.openstack.org/338478 | 18:53 |
jeckersb | yeah something along those lines | 18:53 |
dprince | beagles: I left a comment on the patch | 18:55 |
trown | hmm or not, it is https://github.com/openstack/tripleo-quickstart/blob/master/roles/common/defaults/main.yml#L8 deleting that and rerunning | 18:55 |
*** dsneddon_ has joined #tripleo | 18:58 | |
jeckersb | mine is still going but i see latest-ipa_images.tar under /var/cache | 18:59 |
jeckersb | so it's at least pulled it down to there | 18:59 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Add Aodh composable roles https://review.openstack.org/333556 | 19:00 |
* jeckersb impatiently waits | 19:00 | |
trown | ya it is taking much longer now that it is actually downloading the image | 19:00 |
beagles | dprince: absolutely fine with that :) | 19:01 |
beagles | dprince: I'll fix | 19:01 |
dprince | beagles: awesome, thanks man | 19:02 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Add Aodh composable roles https://review.openstack.org/333556 | 19:03 |
jeckersb | trown: hm appears to be working for me this time | 19:04 |
jeckersb | apparently the teardown fixed it | 19:04 |
trown | jeckersb: interesting... the explicit teardown thing is relatively new, and not well tested in CI (the CI nodes are clean to start) | 19:05 |
EmilienM | dprince: did you look failures in https://review.openstack.org/338315 ? | 19:05 |
dprince | EmilienM: I did, I am. Sadly my undercloud fails to install due to keystone puppet issues :/ | 19:06 |
dprince | EmilienM: the rebase was to rename, the variable and fix merge conflicts only. No other changes yet | 19:07 |
dprince | beagles: I aligned my variable here to match what you are doing as well https://review.openstack.org/#/c/338315/10/overcloud-resource-registry-puppet.yaml | 19:07 |
beagles | dprince: ack | 19:08 |
*** ooolpbot has joined #tripleo | 19:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 19:10 |
*** ooolpbot has quit IRC | 19:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 19:10 |
*** chandankumar has left #tripleo | 19:11 | |
*** dhill_ has joined #tripleo | 19:12 | |
EmilienM | dprince: can you look https://review.openstack.org/#/c/333498/ ? | 19:13 |
dprince | EmilienM: ha, so the reason I never review that is it shows up in my reviews :) | 19:16 |
dprince | EmilienM: I will, yes | 19:16 |
EmilienM | :) | 19:16 |
*** apetrich_ has quit IRC | 19:16 | |
EmilienM | dprince: your patch for neutron/compute worries me I tested it and it fails | 19:16 |
EmilienM | see http://logs.openstack.org/15/338315/9/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/768e454/logs/overcloud-novacompute-0/var/log/nova/nova-compute.txt.gz#_2016-07-10_22_17_25_807 | 19:17 |
dprince | EmilienM: don't worry. fix it | 19:17 |
dprince | EmilienM: possible there is a subtle change we need to make in puppet-tripleo still | 19:17 |
dprince | EmilienM: like I said, I started looking and then got interrupted | 19:17 |
EmilienM | ok | 19:17 |
EmilienM | no prob you're busy :) | 19:17 |
dprince | EmilienM: I think the heat code is good, or at least close | 19:17 |
*** apetrich_ has joined #tripleo | 19:18 | |
dprince | EmilienM: note, my approach was the same as what beagles did for DVR here https://review.openstack.org/#/c/333498/ | 19:18 |
dprince | EmilienM: so I like that the composable approaches are aligning well to enable new features like DVR | 19:18 |
EmilienM | dprince: right | 19:19 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Ceilometer Compute Agent composable service https://review.openstack.org/331802 | 19:20 |
dprince | EmilienM: using trunk. The error I hit in the undercloud is this: | 19:21 |
dprince | EmilienM: Could not evaluate: Execution of '/bin/openstack domain list --quiet --format csv' returned 1 | 19:21 |
dprince | EmilienM: any idea on what changed? No worries if you don't just thought maybe you saw something similar w/ puppet CI | 19:21 |
dprince | EmilienM: perhaps an openstackclient related breakage? | 19:22 |
dprince | EmilienM: I'd be curious to see if puppet-keystone passed w/ RDO trunk | 19:22 |
openstackgerrit | Merged openstack/instack-undercloud: Properly set undercloud_service_certificate when file exists https://review.openstack.org/337904 | 19:23 |
EmilienM | dprince: we are blocked on this thing since Thursday. | 19:23 |
EmilienM | dprince: https://etherpad.openstack.org/p/delorean_master_current_issues | 19:23 |
EmilienM | we'll need https://review.openstack.org/#/c/329189/ to land | 19:23 |
EmilienM | it's blocking TripleO promotion and Puppet CI | 19:23 |
dprince | EmilienM: that is old though. I thought we pinned to avoid it? | 19:24 |
dprince | EmilienM: oh well. if this is the same thing that is sad... Its been a month | 19:25 |
EmilienM | it's another thing | 19:25 |
EmilienM | we used to pin and went back on master when it was fixed | 19:25 |
EmilienM | and it broke again last week | 19:25 |
EmilienM | it's not the same thing you think | 19:25 |
EmilienM | it's something newer | 19:25 |
dprince | right, so is there a new bug? or patch? | 19:25 |
EmilienM | it's a new bug and it was a lot of patches to fix it and the last one will be https://review.openstack.org/#/c/329189/ | 19:26 |
EmilienM | but before this one, they did a bunch of things | 19:26 |
EmilienM | between os-lib and osc | 19:26 |
EmilienM | but to land this patch, we'll need https://review.openstack.org/#/c/340431/ first | 19:27 |
EmilienM | it's a mess, yes | 19:27 |
dprince | ugh, yeah | 19:27 |
dprince | this is what happens when you don't revert | 19:27 |
EmilienM | dprince: https://review.openstack.org/#/c/339554/ | 19:27 |
EmilienM | I proposed the revert ^ | 19:27 |
dprince | like the intial breakage should have just been reverted... instead of all this | 19:27 |
EmilienM | they didn't accept it | 19:27 |
EmilienM | anything else? lol | 19:27 |
dprince | EmilienM: push harder | 19:28 |
dprince | EmilienM: :) | 19:28 |
EmilienM | I'm done here, now I'm waiting for the patch to land | 19:28 |
EmilienM | dprince: what do you prefer for pacemaker service bits: manifests/profile/base/pacemaker.pp or manifests/profile/pacemaker/pacemaker.pp or something else? | 19:30 |
EmilienM | I like manifests/profile/base/pacemaker.pp | 19:30 |
EmilienM | it just aims to deploy pacemaker itself, not all the resources | 19:30 |
dprince | EmilienM: base/pacemaker.pp is fine | 19:31 |
EmilienM | k | 19:31 |
*** rcernin has joined #tripleo | 19:32 | |
*** bfournie has quit IRC | 19:32 | |
*** akshai has quit IRC | 19:32 | |
*** akshai has joined #tripleo | 19:36 | |
openstackgerrit | Merged openstack/os-cloud-config: Updated from global requirements https://review.openstack.org/332333 | 19:38 |
*** panda|afk is now known as panda | 19:40 | |
*** jcoufal_ has joined #tripleo | 19:40 | |
openstackgerrit | Merged openstack/os-collect-config: Updated from global requirements https://review.openstack.org/324844 | 19:41 |
*** jcoufal has quit IRC | 19:43 | |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Implement Pacemaker service profile https://review.openstack.org/340547 | 19:47 |
jeckersb | grrr my db syncs are timing out again... | 19:49 |
jeckersb | slagle: is there anything like the "puppet module hacking" steps from the deep dive, except for the undercloud instead of the overcloud? | 19:50 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Composable Pacemaker service https://review.openstack.org/340548 | 19:51 |
trown | jeckersb: for the undercloud you can just hack directly on the puppet modules in /etc/puppet | 19:51 |
trown | the overcloud case is unique because hacking on the modules inside the overcloud image is a bit painful, so instead we use that mechanism from the deep dive to push hacked modules from the undercloud | 19:53 |
*** trozet has quit IRC | 19:54 | |
jeckersb | trown: so basically just edit them in place and then re-run undercloud-install.sh ? | 19:54 |
trown | jeckersb: yep | 19:54 |
jeckersb | awesome | 19:55 |
slagle | BOOM | 19:59 |
slagle | http://logs.openstack.org/77/324777/67/experimental/gate-tripleo-ci-centos-7-nonha-multinode/704439f/ | 19:59 |
EmilienM | dprince: I let you final +A on https://review.openstack.org/#/c/333498/ so you can have the last eye ;-) | 20:00 |
jeckersb | slagle: is that splitting the controller services apart to multiple nodes? | 20:00 |
EmilienM | slagle: you got it????? | 20:00 |
slagle | EmilienM: yep, with the ping test :) | 20:01 |
EmilienM | 1h05min -> excellent ! | 20:01 |
EmilienM | slagle: wow man | 20:01 |
EmilienM | that's a very very good news for us | 20:01 |
*** jayg is now known as jayg|g0n3 | 20:01 | |
dprince | EmilienM: +2 | 20:03 |
dprince | slagle: nice work man | 20:03 |
EmilienM | yeah, congrats | 20:03 |
EmilienM | slagle: do you need some reviews ? | 20:03 |
slagle | i always need reviews :) i need to remove some debugging info from the tripleo-ci patch though | 20:04 |
jeckersb | trown: ok next question... even if i update the puppet modules inplace on the undercloud, there's still a handful of other tasks that quickstart would have run, had it succeeded | 20:04 |
jeckersb | trown: and if i just run quickstart again, it's going to wipe out the changes that i made to the undercloud, no? | 20:05 |
jeckersb | (blow it away and re-image it) | 20:05 |
*** akshai has quit IRC | 20:05 | |
trown | jeckersb: ya, you wouldnt want to run quickstart again, just the undercloud install from the undercloud itself | 20:06 |
dprince | slagle: any reason you didn't put the environment file in environments here? https://review.openstack.org/#/c/222772/20 | 20:07 |
dprince | slagle: besides a common directory for all environments we don't have a good mechanism to identify them... | 20:07 |
*** akshai has joined #tripleo | 20:08 | |
*** trozet has joined #tripleo | 20:08 | |
slagle | dprince: not really, i can move it np | 20:09 |
dprince | slagle: cool, I looking now but if you do that and EmilienM is still okay I think we could land it | 20:09 |
dprince | slagle: I honestly thought it already landed | 20:09 |
dprince | slagle: its time... | 20:09 |
*** ooolpbot has joined #tripleo | 20:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 20:10 |
*** ooolpbot has quit IRC | 20:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 20:10 |
EmilienM | dprince: I'm ok | 20:14 |
*** pcaruana has quit IRC | 20:17 | |
*** sambetts is now known as sambetts|afk | 20:17 | |
*** lblanchard has quit IRC | 20:18 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Use already Deployed/Installed servers https://review.openstack.org/222772 | 20:20 |
*** fzdarsky has quit IRC | 20:21 | |
EmilienM | dprince: feel free to +A ^ | 20:21 |
dprince | slagle: +2 from me. if CI passes again please feel free to send it | 20:22 |
openstackgerrit | Merged openstack/python-tripleoclient: Deprecate fedora-user image type https://review.openstack.org/331773 | 20:22 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Re-enable Ceilometer composable roles for controller https://review.openstack.org/333498 | 20:23 |
EmilienM | pradk: /me rebasing gnocchi, I'll let you rebase aodh | 20:24 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 20:24 |
pradk | EmilienM, yep on it | 20:24 |
*** dmsimard|mtl has quit IRC | 20:26 | |
*** julim has quit IRC | 20:27 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Gnocchi composable roles https://review.openstack.org/318413 | 20:27 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Composable Pacemaker service https://review.openstack.org/340548 | 20:28 |
*** fzdarsky has joined #tripleo | 20:31 | |
*** julim has joined #tripleo | 20:32 | |
*** fragatina has joined #tripleo | 20:36 | |
*** julim has quit IRC | 20:37 | |
*** chem has quit IRC | 20:42 | |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Add Aodh composable roles https://review.openstack.org/333556 | 20:50 |
*** dprince has quit IRC | 20:51 | |
sshnaidm|afk | EmilienM, dprince hi, can you please merge this today? https://review.openstack.org/#/c/339118/ it will enable tempest jobs again | 20:52 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Combine parameter_default fields https://review.openstack.org/312988 | 20:52 |
*** egafford has left #tripleo | 20:53 | |
*** egafford has joined #tripleo | 20:53 | |
*** trown is now known as trown|outtypewww | 20:57 | |
*** Goneri has quit IRC | 20:57 | |
*** panda is now known as panda|zZ | 21:02 | |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Composable Horizon service - puppet-tripleo https://review.openstack.org/335506 | 21:02 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Add environment file to enable DVR https://review.openstack.org/332147 | 21:05 |
*** apetrich_ has quit IRC | 21:06 | |
*** apetrich_ has joined #tripleo | 21:08 | |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Add MySQL profiles https://review.openstack.org/340444 | 21:09 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Move MySQL Galera within composable services https://review.openstack.org/340448 | 21:10 |
*** ooolpbot has joined #tripleo | 21:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1600281 | 21:10 |
*** ooolpbot has quit IRC | 21:10 | |
openstack | Launchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] | 21:10 |
*** bfournie has joined #tripleo | 21:16 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Composable Horizon service - tripleo-heat-templates https://review.openstack.org/335499 | 21:18 |
EmilienM | ccamacho: rebased ^ | 21:18 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Composable Zaqar services https://review.openstack.org/331682 | 21:19 |
*** akshai has quit IRC | 21:21 | |
openstackgerrit | Merged openstack/puppet-tripleo: Add ironic inspector as a terminated HAProxy endpoint https://review.openstack.org/332640 | 21:23 |
*** jistr has quit IRC | 21:24 | |
*** jcoufal_ has quit IRC | 21:29 | |
*** apetrich_ has quit IRC | 21:32 | |
*** jcoufal has joined #tripleo | 21:33 | |
*** apetrich_ has joined #tripleo | 21:35 | |
*** jcoufal has quit IRC | 21:39 | |
*** apetrich_ has quit IRC | 21:40 | |
*** mbound has joined #tripleo | 21:41 | |
*** apetrich_ has joined #tripleo | 21:42 | |
*** shardy has quit IRC | 21:44 | |
*** ccamacho has quit IRC | 21:45 | |
*** jrist has quit IRC | 21:47 | |
*** akshai has joined #tripleo | 21:48 | |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Gnocchi composable roles https://review.openstack.org/318413 | 21:50 |
*** akshai_ has joined #tripleo | 21:51 | |
*** trozet has quit IRC | 21:52 | |
*** akshai has quit IRC | 21:54 | |
*** tzumainn has joined #tripleo | 22:00 | |
*** penick has joined #tripleo | 22:01 | |
*** bfournie has quit IRC | 22:10 | |
*** dsneddon_ has quit IRC | 22:11 | |
*** fzdarsky has quit IRC | 22:13 | |
*** apetrich_ has quit IRC | 22:16 | |
*** apetrich_ has joined #tripleo | 22:16 | |
*** fpan has quit IRC | 22:24 | |
*** tzumainn has quit IRC | 22:26 | |
*** pradk has quit IRC | 22:40 | |
*** dbecker has joined #tripleo | 22:44 | |
*** yamahata has quit IRC | 22:45 | |
*** apetrich_ has quit IRC | 22:46 | |
*** egafford has quit IRC | 22:46 | |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 22:47 |
*** apetrich_ has joined #tripleo | 22:48 | |
*** spredzy has quit IRC | 22:51 | |
*** spredzy has joined #tripleo | 22:53 | |
*** mbound has quit IRC | 22:53 | |
*** limao has joined #tripleo | 22:55 | |
*** egafford has joined #tripleo | 23:03 | |
*** limao has quit IRC | 23:05 | |
*** limao has joined #tripleo | 23:05 | |
*** yamahata has joined #tripleo | 23:11 | |
*** saneax_AFK is now known as saneax | 23:14 | |
*** dbecker has quit IRC | 23:15 | |
*** egafford has quit IRC | 23:22 | |
*** apetrich_ has quit IRC | 23:28 | |
*** apetrich_ has joined #tripleo | 23:32 | |
*** rdo has quit IRC | 23:35 | |
*** penick has quit IRC | 23:36 | |
*** limao has quit IRC | 23:40 | |
*** apetrich_ has quit IRC | 23:42 | |
*** apetrich_ has joined #tripleo | 23:42 | |
*** rcernin has quit IRC | 23:43 | |
*** akshai_ has quit IRC | 23:50 | |
*** akshai has joined #tripleo | 23:50 | |
*** julim has joined #tripleo | 23:55 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!