| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: add doc to help users with split playbooks https://review.openstack.org/478624 | 00:28 |
|---|---|---|
| *** bfournie has joined #tripleo | 00:57 | |
| *** bfournie has quit IRC | 00:58 | |
| *** bfournie has joined #tripleo | 00:59 | |
| *** leitan has joined #tripleo | 01:09 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 01:10 |
| *** leitan has quit IRC | 01:13 | |
| *** jaganathan has quit IRC | 01:15 | |
| *** thrash is now known as thrash|g0ne | 01:34 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-common master: Add Mistral workbook to call ceph-ansible to install Ceph https://review.openstack.org/469644 | 01:44 |
| *** atheurer has quit IRC | 01:50 | |
| *** yamahata has quit IRC | 01:53 | |
| *** fpan has joined #tripleo | 01:56 | |
| *** rlandy|bbl is now known as rlandy | 01:58 | |
| *** dmacpher has joined #tripleo | 01:58 | |
| *** rhallisey has quit IRC | 02:01 | |
| *** pliu has joined #tripleo | 02:02 | |
| *** rlandy has quit IRC | 02:05 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Deploy Ceph in containers using ceph-ansible via external workflow https://review.openstack.org/465066 | 02:10 |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 02:10 |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| *** bkopilov_ has quit IRC | 02:12 | |
| *** tzumainn has quit IRC | 02:15 | |
| *** atheurer has joined #tripleo | 02:17 | |
| *** rlandy has joined #tripleo | 02:17 | |
| *** rlandy has quit IRC | 02:18 | |
| *** liupe__ has joined #tripleo | 02:19 | |
| *** pliu has quit IRC | 02:22 | |
| *** fpan has quit IRC | 02:24 | |
| *** nyechiel has joined #tripleo | 02:25 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient master: Updated from global requirements https://review.openstack.org/478697 | 02:29 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/478699 | 02:30 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements https://review.openstack.org/478119 | 02:30 |
| openstackgerrit | John Fulton proposed openstack/tripleo-common master: Add Mistral file actions to tripleo-common https://review.openstack.org/477541 | 02:36 |
| *** nyechiel has quit IRC | 02:45 | |
| *** gfidente has quit IRC | 02:51 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 03:10 |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| *** pliu has joined #tripleo | 03:12 | |
| *** dtrainor has quit IRC | 03:16 | |
| *** liupe__ has quit IRC | 03:16 | |
| *** yamahata has joined #tripleo | 03:18 | |
| *** liupe__ has joined #tripleo | 03:19 | |
| *** pliu has quit IRC | 03:23 | |
| *** atheurer has quit IRC | 03:26 | |
| *** bkopilov_ has joined #tripleo | 03:30 | |
| *** dmacpher_ has joined #tripleo | 03:33 | |
| *** dmacpher has quit IRC | 03:35 | |
| *** udesale has joined #tripleo | 03:36 | |
| *** JimR has joined #tripleo | 03:41 | |
| *** JimR has quit IRC | 03:45 | |
| *** ykarel has joined #tripleo | 03:49 | |
| *** gkadam has joined #tripleo | 04:04 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 04:10 |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| *** dixiaoli has joined #tripleo | 04:35 | |
| *** dixiaoli has quit IRC | 04:39 | |
| *** links has joined #tripleo | 04:53 | |
| *** links has quit IRC | 05:03 | |
| *** dparkes has quit IRC | 05:05 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Remove mirror create https://review.openstack.org/478445 | 05:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Default docker-puppet.py logging to INFO https://review.openstack.org/477547 | 05:09 |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 05:10 |
| *** marios has joined #tripleo | 05:11 | |
| *** pcaruana has joined #tripleo | 05:14 | |
| *** links has joined #tripleo | 05:15 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements https://review.openstack.org/478119 | 05:16 |
| *** dixiaoli has joined #tripleo | 05:19 | |
| *** prateek has joined #tripleo | 05:25 | |
| *** dpawar has quit IRC | 05:27 | |
| *** yprokule has joined #tripleo | 05:27 | |
| *** dpawar has joined #tripleo | 05:28 | |
| *** dixiaoli has quit IRC | 05:28 | |
| *** pcaruana has quit IRC | 05:30 | |
| *** pcaruana has joined #tripleo | 05:33 | |
| *** marios has quit IRC | 05:34 | |
| *** lmiccini has joined #tripleo | 05:34 | |
| *** pcaruana has quit IRC | 05:39 | |
| openstackgerrit | kavitha h r proposed openstack/tripleo-heat-templates master: Updated from global requirements https://review.openstack.org/478742 | 05:45 |
| *** iranzo has joined #tripleo | 05:46 | |
| *** iranzo has joined #tripleo | 05:46 | |
| *** ykarel has quit IRC | 05:46 | |
| openstackgerrit | Tony Breeds proposed openstack/diskimage-builder master: Support for Cloud Images on ppc64le for rhel7 and centos7 https://review.openstack.org/456055 | 05:48 |
| *** rcernin_ has joined #tripleo | 05:48 | |
| *** ykarel has joined #tripleo | 05:50 | |
| *** agurenko has joined #tripleo | 05:50 | |
| *** ratailor has joined #tripleo | 05:52 | |
| *** skarthik has joined #tripleo | 05:56 | |
| *** pgadiya has joined #tripleo | 05:56 | |
| *** karts has quit IRC | 05:56 | |
| *** dparkes has joined #tripleo | 05:56 | |
| *** skarthik has quit IRC | 06:00 | |
| *** rcernin_ is now known as rcernin | 06:04 | |
| *** skramaja has joined #tripleo | 06:05 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 06:10 |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| *** skarthik has joined #tripleo | 06:12 | |
| *** artom has joined #tripleo | 06:13 | |
| *** jprovazn has joined #tripleo | 06:14 | |
| *** leseb has quit IRC | 06:25 | |
| *** ashishb has quit IRC | 06:26 | |
| *** michapma has quit IRC | 06:44 | |
| *** michapma has joined #tripleo | 06:44 | |
| openstackgerrit | Jan Provaznik proposed openstack/tripleo-docs master: Add note about NeutronNetworkVLANRanges for manila provider net https://review.openstack.org/478761 | 06:45 |
| *** aufi has joined #tripleo | 06:50 | |
| *** cschwede has joined #tripleo | 06:53 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/diskimage-builder master: elements: pip-and-virtualenv: Install python3 on openSUSE if necessary https://review.openstack.org/478648 | 06:56 |
| *** dmacpher_ has quit IRC | 06:56 | |
| *** ebarrera has joined #tripleo | 06:57 | |
| *** jlinkes has joined #tripleo | 06:58 | |
| *** Goneri has joined #tripleo | 06:59 | |
| *** ebarrera has quit IRC | 07:01 | |
| *** ebarrera has joined #tripleo | 07:01 | |
| *** Goneri has quit IRC | 07:04 | |
| *** shardy has joined #tripleo | 07:06 | |
| *** iranzo has quit IRC | 07:06 | |
| *** dmacpher_ has joined #tripleo | 07:08 | |
| *** bogdando has joined #tripleo | 07:09 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 07:10 |
| *** dsariel has joined #tripleo | 07:15 | |
| *** jpich has joined #tripleo | 07:20 | |
| *** anshul has joined #tripleo | 07:22 | |
| *** marios has joined #tripleo | 07:24 | |
| bogdando | o/ folks | 07:24 |
| *** oidgar has joined #tripleo | 07:24 | |
| bogdando | do you know what logic cli wants for the mistral environment named overcloud? The command overcloud deploy fails for me with "Environment not found [name=overcloud]". I suppose it should create one, isn't it? why stops? | 07:25 |
| *** dmacpher_ has quit IRC | 07:26 | |
| bogdando | so it creates the stack, uploads the plan, then fails with that msg... | 07:26 |
| *** tobias_fiberdata has joined #tripleo | 07:27 | |
| mhenkel | shardy: thanks for the link. Any instructions on how to run the test? | 07:28 |
| d0ugal | bogdando: The mistral environment shouldn't be used anymore | 07:28 |
| bogdando | needed to say, I'm using a hacked client for testing overcloud deploy from nova/glance/ironic-less UC. But the issue I hope should not be related to that change... my WIP branch is https://github.com/bogdando/python-tripleoclient/commit/22483fef9deb24e496622efde5b44a82636d59d9#diff-43ea6c744a480f40dd3ea271c43d5c9d and please ignore the "test" - it's a pure mess as I have no idea how to test this yet | 07:28 |
| bogdando | d0ugal: um. that's odd | 07:29 |
| bogdando | d0ugal: for how long? | 07:29 |
| bogdando | perhaps I shall rebase then, thanks | 07:29 |
| d0ugal | bogdando: it was moved in master a month ago maybe. Work by akrivoka and jpich | 07:29 |
| d0ugal | bogdando: the "plan" should be all in Swift now. | 07:29 |
| bogdando | yeah, it seems I missed that bit | 07:29 |
| *** tesseract has joined #tripleo | 07:31 | |
| dpawar | Hi, overcloud deploy is failing with recent capabilities-map.yaml because "root_template" is removed. do i need to specify extra parametes to the command ? here is error http://paste.openstack.org/show/614006/ | 07:31 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud https://review.openstack.org/471759 | 07:32 |
| *** jkilpatr has quit IRC | 07:33 | |
| jaosorior | dpawar: is that from master? | 07:33 |
| dpawar | jaosorior: you mean undercloud ? | 07:34 |
| dpawar | jaosorior: i am runnign this command from undercloud | 07:34 |
| jaosorior | dpawar: master branch | 07:35 |
| jaosorior | dpawar: or what release is it? | 07:35 |
| *** pcaruana has joined #tripleo | 07:35 | |
| dpawar | jaosorior: yes, it is master branch | 07:35 |
| *** hjensas has joined #tripleo | 07:35 | |
| *** hjensas has quit IRC | 07:35 | |
| *** hjensas has joined #tripleo | 07:35 | |
| jaosorior | dpawar: maybe you gotta update tripleoclient and tripleo-common | 07:35 |
| *** jpena|off is now known as jpena | 07:37 | |
| *** amoralej|off is now known as amoralej | 07:38 | |
| dpawar | jaosorior: do you mean python-tripleoclient-6.1.0-6.el7ost.noarch and openstack-tripleo-common-6.0.0-8.el7ost.noarch ? | 07:38 |
| jaosorior | dpawar: well, I don't really know the versions by heart. But if you're getting that error message, most likely tripleo-common is not setting " | 07:39 |
| jaosorior | "root_template" where it should have | 07:39 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Automatically retry introspection for failing nodes https://review.openstack.org/462916 | 07:40 |
| *** ccamacho has quit IRC | 07:40 | |
| *** ccamacho has joined #tripleo | 07:40 | |
| ccamacho | morning folks! | 07:41 |
| dpawar | jaosorior: i'll try updateing both the packages. | 07:42 |
| *** yprokule_ has joined #tripleo | 07:45 | |
| *** tesseract has quit IRC | 07:47 | |
| *** openstackgerrit has quit IRC | 07:47 | |
| *** yprokule has quit IRC | 07:47 | |
| *** yprokule_ is now known as yprokule | 07:47 | |
| *** tesseract has joined #tripleo | 07:48 | |
| *** egonzalez has joined #tripleo | 07:52 | |
| *** skarthik has quit IRC | 07:53 | |
| *** skarthik has joined #tripleo | 07:53 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #tripleo | 08:00 | |
| *** agurenko has quit IRC | 08:01 | |
| *** gfidente has joined #tripleo | 08:02 | |
| *** gfidente has quit IRC | 08:02 | |
| *** gfidente has joined #tripleo | 08:02 | |
| *** openstackgerrit has joined #tripleo | 08:03 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Avoid hanging endlessly on unreachable cache urls https://review.openstack.org/476981 | 08:03 |
| *** yprokule_ has joined #tripleo | 08:04 | |
| *** aufi has quit IRC | 08:06 | |
| *** jaganathan has joined #tripleo | 08:06 | |
| *** yprokule has quit IRC | 08:07 | |
| *** yprokule_ is now known as yprokule | 08:07 | |
| *** mcornea has joined #tripleo | 08:09 | |
| openstackgerrit | Michael Henkel proposed openstack/puppet-tripleo master: Contrail: Fix controlplane/dataplane network asignments & enable optional dpdk https://review.openstack.org/475045 | 08:09 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 08:10 |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| *** dtantsur|afk is now known as dtantsur | 08:11 | |
| *** chem has joined #tripleo | 08:12 | |
| *** derekh has joined #tripleo | 08:15 | |
| openstackgerrit | Merged openstack/tripleo-common master: Use six to correctly handle text in Python 2 and 3 in the Role schema https://review.openstack.org/476896 | 08:16 |
| gfidente | jaosorior morning | 08:16 |
| gfidente | thanks for checking the cidr stuff, posted a long comment in the submission | 08:16 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/diskimage-builder master: elements: pip-and-virtualenv: Install python3 on openSUSE if necessary https://review.openstack.org/478648 | 08:20 |
| *** aufi has joined #tripleo | 08:21 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Copy only generated puppet files into the container https://review.openstack.org/476153 | 08:28 |
| *** agurenko has joined #tripleo | 08:29 | |
| *** tesseract has quit IRC | 08:30 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/diskimage-builder master: elements: openstack-ci-mirrors: Use openSUSE mirrors for gating jobs https://review.openstack.org/478443 | 08:30 |
| openstackgerrit | Martin André proposed openstack/puppet-tripleo master: Leverage kolla config_files to copy config into containers https://review.openstack.org/477535 | 08:32 |
| *** tesseract has joined #tripleo | 08:32 | |
| gfidente | jaosorior basically my point is that it might not be organizing data in the more obvious way but to do that we'd have to make changes into many service templates | 08:36 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Setting LOG_PATH for RDO projects in sendmailtool https://review.openstack.org/478799 | 08:37 |
| *** aufi has quit IRC | 08:42 | |
| gfidente | d0ugal https://review.openstack.org/#/c/477541/ looks good to me now | 08:45 |
| d0ugal | gfidente: cool, I'll take a look in a min | 08:47 |
| gfidente | d0ugal thanks! | 08:47 |
| gfidente | jistr if you have an opinion about https://review.openstack.org/#/c/478659/ vs https://review.openstack.org/#/c/478660/ that'd help | 08:50 |
| *** snecklifter has joined #tripleo | 08:51 | |
| *** aufi has joined #tripleo | 08:54 | |
| *** athomas has joined #tripleo | 08:55 | |
| *** tvignaud has quit IRC | 08:56 | |
| *** karimb has joined #tripleo | 08:57 | |
| *** fandrieu has quit IRC | 08:59 | |
| *** skarthik has quit IRC | 09:01 | |
| *** skarthik has joined #tripleo | 09:01 | |
| *** skarthik is now known as karthiks | 09:01 | |
| *** karthiks has quit IRC | 09:02 | |
| *** karthiks has joined #tripleo | 09:03 | |
| *** iranzo has joined #tripleo | 09:07 | |
| *** salmankhan has joined #tripleo | 09:08 | |
| *** tvignaud has joined #tripleo | 09:09 | |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 09:10 |
| *** salmankhan has quit IRC | 09:12 | |
| *** ckyriakidou has joined #tripleo | 09:14 | |
| *** ykarel has quit IRC | 09:15 | |
| *** salmankhan has joined #tripleo | 09:15 | |
| *** yamahata has quit IRC | 09:23 | |
| *** ebarrera has quit IRC | 09:24 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-puppet-elements master: Add ansible-pacemaker to the overcloud image https://review.openstack.org/478815 | 09:24 |
| *** ykarel has joined #tripleo | 09:24 | |
| *** ebarrera has joined #tripleo | 09:24 | |
| *** salmankhan has quit IRC | 09:24 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-puppet-elements master: Add ansible-pacemaker to the overcloud image https://review.openstack.org/478815 | 09:25 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/diskimage-builder master: elements: openstack-ci-mirrors: Use openSUSE mirrors for gating jobs https://review.openstack.org/478443 | 09:26 |
| *** paramite has quit IRC | 09:26 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add ServerIdMap output https://review.openstack.org/478622 | 09:32 |
| *** akrivoka has joined #tripleo | 09:32 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-validations master: Add deploy_server_id and bootstrap_node_id to inventory https://review.openstack.org/478623 | 09:34 |
| *** dixiaoli has joined #tripleo | 09:34 | |
| *** salmankhan has joined #tripleo | 09:35 | |
| *** tesseract has quit IRC | 09:38 | |
| *** tesseract has joined #tripleo | 09:40 | |
| *** tosky has joined #tripleo | 09:40 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Install ansible-pacemaker on O->P upgrade https://review.openstack.org/478830 | 09:40 |
| gfidente | jistr hehe I am waiting to see if you add it into tripleo-common overcloud-images.yaml or tripleo-puppet-elements now | 09:43 |
| jistr | fgfidente: i actually did that :D https://review.openstack.org/478815 | 09:44 |
| jistr | gfidente: ^ | 09:44 |
| gfidente | so puppet-elements | 09:44 |
| gfidente | spare a vote on https://review.openstack.org/#/c/478659/ :D | 09:44 |
| jistr | gfidente: yea looking now, sorry, etoomanypings | 09:45 |
| gfidente | I know | 09:45 |
| gfidente | but I wasn't sure if we wanted ansible "stuff" in puppet-elements | 09:45 |
| gfidente | though I agree with bnemec it's better to have a single list | 09:45 |
| *** pgadiya has quit IRC | 09:45 | |
| jistr | gfidente: do package installs work with dashes too? https://review.openstack.org/#/c/478659/1/elements/overcloud-base/install.d/package-installs-overcloud-base | 09:46 |
| jistr | gfidente: it's breaking a convention sorta... :/ | 09:46 |
| gfidente | jistr ok moving to _ | 09:47 |
| jistr | gfidente: haha thanks :) my stress level just dropped to a manageable level | 09:48 |
| gfidente | so I can ping you more | 09:48 |
| *** pgadiya has joined #tripleo | 09:50 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-puppet-elements master: Install python-docker-py in the baremetal image https://review.openstack.org/478659 | 09:50 |
| *** fandrieu has joined #tripleo | 09:51 | |
| *** dmacpher has joined #tripleo | 09:52 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Add a new role for ComputeOvsDpdk and clean-up parameters https://review.openstack.org/478427 | 09:53 |
| *** dparkes has quit IRC | 09:55 | |
| ccamacho | hey gfidente :) | 09:56 |
| ccamacho | man quick question | 09:56 |
| gfidente | hi ccamacho | 09:57 |
| ccamacho | the fix for https://bugs.launchpad.net/tripleo/+bug/1700755 -> https://review.openstack.org/#/c/478198/ | 09:57 |
| openstack | Launchpad bug 1700755 in tripleo "Upgrade jobs in CI fail with - "Unknown Property stack_name" error" [High,Fix released] - Assigned to Giulio Fidente (gfidente) | 09:57 |
| ccamacho | is already merged so, we shouldnt getting it any more, right? | 09:57 |
| jaosorior | jistr: got time to check these two out ? https://review.openstack.org/#/c/478617/ https://review.openstack.org/#/c/474135/ | 09:57 |
| gfidente | ccamacho right | 09:57 |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Add a new role for ComputeOvsDpdk and clean-up parameters https://review.openstack.org/478427 | 09:57 |
| ccamacho | gfidente, cool so Ill recheck then ;) thanks man | 09:58 |
| shardy | dtantsur: Hey, I'm regularly seeing nodes go to error state/maintenance mode when deleting an overcloud - what state transition is valid from error provisioning state? | 09:58 |
| *** b00tcat has quit IRC | 09:59 | |
| shardy | It seems I can't just set it to provide after making maintenance mode false? | 09:59 |
| dtantsur | shardy: I think it's worth figuring out why the nodes get there, and during which transition | 10:00 |
| *** b00tcat has joined #tripleo | 10:00 | |
| shardy | dtantsur: sure, that would also be good http://paste.openstack.org/show/614020/ shows the error | 10:00 |
| *** dixiaoli has quit IRC | 10:01 | |
| shardy | I can dig in the logs if that would be helpful | 10:01 |
| *** dparkes has joined #tripleo | 10:01 | |
| shardy | dtantsur: it doesn't happen every time - 4 nodes deleted and only one hit this problem, the other 3 were fine | 10:01 |
| shardy | and sometimes they all delete OK | 10:01 |
| dtantsur | shardy: vbmc or ovb? also, what is target_provision_state there? | 10:02 |
| shardy | target_provision_state | None | 10:02 |
| shardy | dtantsur: vbmc configured via quickstart | 10:02 |
| dtantsur | shardy: mm, maybe something in vbmc logs (/var/log/virtualbmc, I hope) | 10:03 |
| * shardy looks | 10:03 | |
| owalsh | skramaja: hi, just wondering... does the cpu isolation, hugepages, etc... for DPDK work with containers? | 10:03 |
| jistr | jaosorior: +2'd the one where i gave +1 before at least. I'll leave the CI job judging to you and get back to BZ fixing :) | 10:03 |
| shardy | dtantsur: I don't see any errors in there | 10:04 |
| jistr | jaosorior: i saw gfidente +2'd the other :) | 10:04 |
| jaosorior | jistr, gfidente thanks! | 10:04 |
| dtantsur | shardy: Oo damn | 10:04 |
| gfidente | I only take the easy ones as usual | 10:04 |
| shardy | I see a bunch of DEBUG VirtualBMC [-] Get power state called for domain control_0 lines, but that's the same for the nodes that worked | 10:05 |
| sshnaidm|afk | EmilienM, could you please vote when you're around: https://review.openstack.org/#/c/477879/ | 10:07 |
| shardy | dtantsur: some clues in the conductor log : http://paste.openstack.org/show/614022/ | 10:07 |
| skramaja | owalsh: DPDK is not containerized and it is moved to Q cycle AFAIK. and we have not analyzed on that yet. | 10:07 |
| dtantsur | shardy: will the same command (modulo providing a password) call locally? | 10:08 |
| shardy | http://paste.openstack.org/show/614023/ | 10:08 |
| shardy | dtantsur: it looks like the vbmc for control_0 isn't running? | 10:08 |
| owalsh | skramaja: ack, I'm thinking it *might* just work but having looked very closely yet | 10:09 |
| owalsh | s/haveing/haven't/ | 10:09 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Add missing tags in iscsid upgrade_tasks https://review.openstack.org/478842 | 10:09 |
| dtantsur | shardy: fun.. I wonder why it might die | 10:10 |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 10:10 |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| shardy | dtantsur: Ok so back to my original question, after restarting the vbmc how do I get the node out of error state? | 10:12 |
| dtantsur | shardy: 'ironic node-set-provision-state UUID deleted' | 10:12 |
| shardy | dtantsur: thanks! IIRC I raised a bug about this a while back, it'd be good if ironicclient or the API response told you what valid state transitions are | 10:14 |
| shardy | vs The requested action $foo cannot be peformed, unlucky! | 10:14 |
| dtantsur | yeah, fair call | 10:14 |
| dtantsur | not sure if/when we get to it, though :/ | 10:14 |
| dtantsur | ETOOMUCHWORK combined with ETOOFEWPEOPLE | 10:14 |
| shardy | fair enough, probably a quick fix at some point | 10:15 |
| shardy | is there any valid transition other than deleted from error state? | 10:15 |
| dtantsur | shardy: a good link to bookmark: https://docs.openstack.org/developer/ironic/_images/states.svg | 10:16 |
| dtantsur | as you see there, deleted and rebuild | 10:16 |
| shardy | aha - thanks that is very useful - any idea what code generates that? | 10:17 |
| dtantsur | shardy: there is a tox environment in ironic's tox.ini | 10:17 |
| shardy | I guess to solve the bug I raised we need a text representation of each transition on that graph | 10:17 |
| dtantsur | shardy: 'tox -egenstates' | 10:17 |
| shardy | dtantsur: nice, thanks for the help! | 10:17 |
| dtantsur | np. in the end, it's generated from an automaton state machine declaration | 10:18 |
| shardy | cool, so I guess it would be possible to implement a valid_states_from($state) | 10:19 |
| * shardy may take a look if he ever finds time | 10:19 | |
| dtantsur | shardy: there was a spec up to expose the whole state machine, but the contributor behind it has left the project apparently | 10:20 |
| jaosorior | flaper87: here https://review.openstack.org/#/c/471759/5/coe/kubernetes-master.yaml where are you getting kargo/cluster.yml from? | 10:27 |
| jaosorior | shardy: got time to check this out https://review.openstack.org/#/c/478528/ ? | 10:28 |
| *** karimb has quit IRC | 10:29 | |
| shardy | jaosorior: as I said in the backport, I think we should remove those completely | 10:30 |
| shardy | they were added back to work around a puppet-heat bug which I then fixed | 10:30 |
| flaper87 | jaosorior: I'm setting that manually for now, I'm working on integrating that better | 10:30 |
| jaosorior | shardy: ah, I hadn't noticed you commented on the backport | 10:30 |
| flaper87 | jaosorior: I created a symlink in the right location where the playbook is created | 10:30 |
| shardy | jaosorior: I'll comment on this patch and link the backport | 10:30 |
| jaosorior | flaper87: I added this directory. Maybe it's useful for you https://github.com/openstack/tripleo-common/tree/master/playbooks ? | 10:30 |
| flaper87 | now, I need to make it include the role or just copy the entire playbook in my patch | 10:31 |
| flaper87 | jaosorior: mmh, that could actually work, although I think I'd prefer pointing to the kargo install path directly | 10:31 |
| jaosorior | flaper87: so, maybe you could put the playbook in tripleo-common, and just reference it from there. | 10:31 |
| flaper87 | yeah | 10:32 |
| jaosorior | flaper87: or whatever you want. Just thought it would be useful | 10:32 |
| flaper87 | jaosorior: that dir is useful, though | 10:32 |
| flaper87 | yeah, thanks for the heads up | 10:32 |
| flaper87 | it's a good addition | 10:32 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove manual heat metadata URL setting https://review.openstack.org/478528 | 10:33 |
| jaosorior | shardy: done ^^ | 10:33 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Make containerized nova-api run with httpd https://review.openstack.org/475366 | 10:33 |
| *** dsneddon has quit IRC | 10:34 | |
| *** dsneddon has joined #tripleo | 10:35 | |
| dpawar | shardy: regarding https://review.openstack.org/471759 , I have used ‘ocata’ bits to create tripleo setup. Because don’t have pike bits yet. Is there any way where I can upgrade my setup to ‘master’ ? | 10:35 |
| openstackgerrit | Merged openstack/tripleo-common master: Add Mistral file actions to tripleo-common https://review.openstack.org/477541 | 10:36 |
| *** dsneddon has quit IRC | 10:36 | |
| shardy | dpawar: you can't mix master t-h-t with an ocata environment - do you need to upgrade or just install current trunk? | 10:36 |
| shardy | dpawar: there are docs on the upgrade process, and it's tested in CI, but the docs haven't yet been updated for upgrades to pike | 10:37 |
| shardy | https://docs.openstack.org/developer/tripleo-docs/post_deployment/upgrade.html | 10:37 |
| *** yprokule has quit IRC | 10:38 | |
| dpawar | shardy: if only installing current trunk solve the issue then that is also fine. | 10:38 |
| *** liupe__ has quit IRC | 10:38 | |
| *** artom has quit IRC | 10:38 | |
| shardy | dpawar: Ok, did you use tripleo-quickstart to setup your environment, or something else? | 10:38 |
| *** artom has joined #tripleo | 10:38 | |
| dpawar | shardy: not used quickstart referred OSP11 install guide | 10:39 |
| shardy | dpawar: basically you have two options I think - use stable/ocata templates or deploy master tripleo if you need to chase trunk | 10:39 |
| *** artom_ has joined #tripleo | 10:40 | |
| shardy | dpawar: Ok, the docs I linked above also have details on manual deployment, and the tripleo-quickstart docs are here: | 10:40 |
| shardy | if you want a VM based setup | 10:40 |
| *** artom_ has quit IRC | 10:41 | |
| shardy | https://docs.openstack.org/developer/tripleo-quickstart/ | 10:41 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove manual heat metadata URL setting https://review.openstack.org/478528 | 10:41 |
| jaosorior | shardy: done ^^ | 10:41 |
| *** artom_ has joined #tripleo | 10:41 | |
| shardy | jaosorior: thanks! | 10:42 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/diskimage-builder master: elements: openstack-ci-mirrors: Use openSUSE mirrors for gating jobs https://review.openstack.org/478443 | 10:42 |
| dpawar | shardy: Thanks. That means i have to re-create setup. | 10:42 |
| shardy | dpawar: you could probably adjust the repos and run openstack undercloud upgrade, but you might prefer to start from scratch | 10:43 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add network/cidr mapping into ServiceNetMap https://review.openstack.org/476602 | 10:43 |
| shardy | dpawar: if you only need to upgrade the undercloud, it's easier that upgrading a deployed overcloud | 10:43 |
| *** udesale has quit IRC | 10:44 | |
| *** dhill_ has quit IRC | 10:44 | |
| *** florianf has joined #tripleo | 10:44 | |
| *** atoth has joined #tripleo | 10:44 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Adds network/cidr mapping into a new service property https://review.openstack.org/476602 | 10:45 |
| *** artom has quit IRC | 10:45 | |
| dpawar | shardy: i need to upgrade undercloud only. i'll give a try by changing yum repo. | 10:45 |
| gfidente | jaosorior ^^ fwiw, passes tox pep8 and py27 here and I added it into validations | 10:46 |
| gfidente | hopefully that is enough | 10:46 |
| jaosorior | gfidente: that looks about right. I'll wait for CI before +2ing | 10:47 |
| dpawar | shardy: Thanks ! | 10:47 |
| gfidente | jaosorior ack, thanks | 10:47 |
| *** shardy has quit IRC | 10:49 | |
| *** dsneddon has joined #tripleo | 10:50 | |
| *** karimb has joined #tripleo | 10:51 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Adds network/cidr mapping into a new service property https://review.openstack.org/476602 | 10:54 |
| *** fandrieu has quit IRC | 10:56 | |
| *** jkilpatr has joined #tripleo | 10:56 | |
| *** jpena is now known as jpena|lunch | 10:56 | |
| *** jkilpatr has quit IRC | 10:56 | |
| *** jkilpatr has joined #tripleo | 10:57 | |
| *** artom has joined #tripleo | 10:58 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Deploy Ceph in containers using ceph-ansible via external workflow https://review.openstack.org/465066 | 10:58 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Adds network/cidr mapping into a new service property https://review.openstack.org/476602 | 10:58 |
| *** artom has quit IRC | 10:58 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Remove unused function "unbracket_ipv6" https://review.openstack.org/478860 | 10:59 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Remove unused function "check_hypervisor_stats" https://review.openstack.org/478861 | 10:59 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Remove the unused, but well tested, function "check_nodes_count" https://review.openstack.org/478862 | 10:59 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Remove some unused attributes and methods from the deploy command https://review.openstack.org/478863 | 10:59 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Remove the unused function reset_parameters https://review.openstack.org/478864 | 10:59 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Remove the unused function "create_default_plan" https://review.openstack.org/478865 | 10:59 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Remove the unused action wrapper for processing templates https://review.openstack.org/478866 | 10:59 |
| *** artom has joined #tripleo | 10:59 | |
| *** artom has quit IRC | 10:59 | |
| *** artom_ has quit IRC | 10:59 | |
| *** artom has joined #tripleo | 10:59 | |
| *** artom has quit IRC | 11:01 | |
| *** artom has joined #tripleo | 11:01 | |
| *** bkopilov_ has quit IRC | 11:02 | |
| *** ebarrera has quit IRC | 11:03 | |
| *** ebarrera has joined #tripleo | 11:03 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: Disable telemetry template exist only from ocata. https://review.openstack.org/478871 | 11:08 |
| *** zoli is now known as zli | 11:09 | |
| *** zli is now known as zoli | 11:09 | |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 11:10 |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| *** morazi has quit IRC | 11:10 | |
| openstackgerrit | Martin André proposed openstack/puppet-tripleo master: Leverage kolla config_files to copy config into containers https://review.openstack.org/477535 | 11:10 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Deploy Ceph in containers using ceph-ansible via external workflow https://review.openstack.org/465066 | 11:10 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Adds network/cidr mapping into a new service property https://review.openstack.org/476602 | 11:10 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: Disable telemetry template exist only from ocata. https://review.openstack.org/478871 | 11:11 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove the unused scale module https://review.openstack.org/478872 | 11:11 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove the unused package tripleo_common.filters https://review.openstack.org/478873 | 11:11 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove the unused exception PlanOperationError https://review.openstack.org/478874 | 11:11 |
| jkilpatr | d0ugal, how's that patch coming? need anything? | 11:11 |
| d0ugal | jkilpatr: I think it is in good shape now, I had to do a bunch of updates to it. I am looking for reviewers ATM | 11:11 |
| d0ugal | jkilpatr: if you are able to test the latest version with some decent hardware that would be useful. | 11:12 |
| jkilpatr | did the default timeout get addressed? waiting one hour for nodes to go into inspect failed is a little harsh. | 11:12 |
| d0ugal | jkilpatr: I shortened it down to 20 mins | 11:12 |
| jkilpatr | perfect | 11:12 |
| d0ugal | jkilpatr: and it is now a workflow input, so it should be customisable from the CLI eventually (I have not written a patch for that yet) | 11:13 |
| jkilpatr | the 99th percentile for a success is like 16 min on dell hardware at least. | 11:13 |
| jkilpatr | of course if you have things like an super long pxe server timeout on one nic then you have issues | 11:13 |
| jkilpatr | but from what I understand a setup with multiple pxe servers (one on each nic) is really strange | 11:14 |
| d0ugal | jkilpatr: right, and I guess in that case they can just extend the timeout | 11:15 |
| *** artom has quit IRC | 11:15 | |
| * jkilpatr imagines printing an assci flow chart with the inspection failed message | 11:16 | |
| *** artom has joined #tripleo | 11:16 | |
| *** artom has quit IRC | 11:16 | |
| jkilpatr | "does pxe work at all?" -> "is the timeout long enough" | 11:16 |
| *** artom has joined #tripleo | 11:16 | |
| jkilpatr | IMO default workflows should be highly opinionated and make assumptions about the user and their env. Then when people want to go off the beaten path you expose more granular commands and tell them to have at it. | 11:17 |
| *** artom has quit IRC | 11:18 | |
| dtantsur | ++ | 11:18 |
| dtantsur | though we are definitely too opinionated in certain areas | 11:18 |
| *** katkapilatova has joined #tripleo | 11:18 | |
| *** artom has joined #tripleo | 11:19 | |
| jkilpatr | I would phrase that as too opinionated without clarifying exactly what those opinions are | 11:19 |
| dtantsur | there are certain problems with the fact that we build a very opinionated framework on top of ironic | 11:20 |
| dtantsur | particularly, when people try to ask upstream ironic people for help | 11:21 |
| dtantsur | we're getting better fwiw, it used to be much worse back in ~ newton | 11:21 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Adds network/cidr mapping into a new service property https://review.openstack.org/476602 | 11:21 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: disable gateway ping test https://review.openstack.org/478878 | 11:23 |
| *** iranzo has quit IRC | 11:24 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Copy only generated puppet files into the container https://review.openstack.org/476153 | 11:24 |
| *** skramaja has quit IRC | 11:27 | |
| *** iranzo has joined #tripleo | 11:27 | |
| owalsh | EmilienM, sshnaidm|afk: for https://bugs.launchpad.net/tripleo/+bug/1680167, how about disabling the gateway ping test in the affected jobs using the t-h-t param in https://review.openstack.org/478878? | 11:27 |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 11:27 |
| *** hjensas is now known as hjensas|lunch | 11:27 | |
| owalsh | EmilienM, sshnaidm|afk: aslo I think the timeout logic is crazy, retries for 50 miuntes | 11:28 |
| *** salmankhan has quit IRC | 11:29 | |
| *** salmankhan has joined #tripleo | 11:30 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Enable nova-api to run over httpd again https://review.openstack.org/474135 | 11:30 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: disable gateway ping test https://review.openstack.org/478878 | 11:30 |
| *** ckyriakidou has quit IRC | 11:31 | |
| *** karimb has quit IRC | 11:33 | |
| *** pkovar has joined #tripleo | 11:33 | |
| *** egonzalez has quit IRC | 11:33 | |
| *** iranzo has quit IRC | 11:34 | |
| *** fpan has joined #tripleo | 11:43 | |
| *** jjung has joined #tripleo | 11:47 | |
| *** egonzalez has joined #tripleo | 11:50 | |
| dpawar | Hi, https://review.openstack.org/#/c/475765/ , got -1 from jenkins but from log, failure does not seems to be related. how to resolve it ? http://logs.openstack.org/65/475765/7/check/gate-tripleo-ci-centos-7-undercloud-containers/6381487/console.html | 11:51 |
| dpawar | mwhahaha: Hi, https://review.openstack.org/#/c/475765/ , got -1 from jenkins but from log, failure does not seems to be related. how to resolve it ? http://logs.openstack.org/65/475765/7/check/gate-tripleo-ci-centos-7-undercloud-containers/6381487/console.html | 11:52 |
| tosky | uhm | 11:52 |
| *** ckyriakidou has joined #tripleo | 11:52 | |
| tosky | I was going to ask the same for https://review.openstack.org/478530 | 11:53 |
| *** ecerquei has joined #tripleo | 11:53 | |
| *** ansmith has quit IRC | 11:56 | |
| *** amoralej is now known as amoralej|lunch | 11:56 | |
| *** rhallisey has joined #tripleo | 11:57 | |
| *** thrash|g0ne is now known as thrash | 11:57 | |
| *** ecerquei has quit IRC | 11:57 | |
| *** ecerquei_ has joined #tripleo | 11:57 | |
| *** abishop has joined #tripleo | 11:58 | |
| *** fpan has quit IRC | 11:58 | |
| *** jpena|lunch is now known as jpena | 12:00 | |
| *** rlandy has joined #tripleo | 12:01 | |
| *** bfournie has quit IRC | 12:01 | |
| gfidente | d0ugal nice cleanup | 12:01 |
| d0ugal | gfidente: thanks :) | 12:02 |
| d0ugal | it was fun | 12:02 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-heat-templates master: scenario001: containerize services for CI https://review.openstack.org/476693 | 12:02 |
| thrash | ccamacho: the patches landed. Did that fix your issue? | 12:04 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Enable TLS for the HAProxy stats interface https://review.openstack.org/478894 | 12:05 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove the unused exception PlanOperationError https://review.openstack.org/478874 | 12:05 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove the unused scale module https://review.openstack.org/478872 | 12:05 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove unused functions from the _stack_update module https://review.openstack.org/478896 | 12:05 |
| ccamacho | thrash yeah man! thanks a lot | 12:07 |
| ccamacho | thrash++ | 12:08 |
| *** prateek has quit IRC | 12:08 | |
| *** dixiaoli has joined #tripleo | 12:09 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 12:10 |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| *** sbrzozow has joined #tripleo | 12:10 | |
| honza | oooq completely freezes on me during the "setup" task --- is that something new? | 12:12 |
| honza | (in devmode with ovb) | 12:12 |
| sshnaidm|afk | owalsh, I don't think it's good solution, all multinode jobs are affected and we need to solve it with infra folks imho | 12:13 |
| *** sshnaidm|afk is now known as sshnaidm | 12:14 | |
| owalsh | sshnaidm: ok, probably just a config issue on the gateway/subnet/hosts, FW maybe? | 12:16 |
| owalsh | sshnaidm: retry logic is wrong though, isn't it? 50 minutes of pinging? | 12:16 |
| *** morazi has joined #tripleo | 12:17 | |
| sshnaidm | owalsh, may be, we don't have access to this host I suppose.. | 12:17 |
| sshnaidm | owalsh, where do you see 50 mins? | 12:17 |
| owalsh | ping -w 300 -c 1 will wait 300 seconds and we retry 10 times | 12:17 |
| owalsh | sshnaidm: I set it to 1 times here https://review.openstack.org/#/c/478878/2/validation-scripts/all-nodes.sh@6 | 12:18 |
| owalsh | sshnaidm: don't see why we need to retry when ping already does (-c with -w means how many replys to wait for) | 12:19 |
| *** pgadiya has quit IRC | 12:19 | |
| *** hjensas|lunch has quit IRC | 12:19 | |
| thrash | d0ugal: did you take tripleoclient into account for those dead code patches? | 12:20 |
| d0ugal | thrash: I think so! | 12:20 |
| sshnaidm | owalsh, seems weird, but I don't know which consequences it may lead to..so leaving this for others to review :) | 12:20 |
| thrash | d0ugal: just making sure. :) | 12:20 |
| *** artom has quit IRC | 12:20 | |
| d0ugal | thrash: tripleoclient only has a couple of -common imports now | 12:20 |
| d0ugal | thankfully | 12:20 |
| owalsh | sshnaidm: only has consequences if ping fails :-) | 12:21 |
| thrash | d0ugal: for queens we should try to eliminate those. :) | 12:21 |
| *** artom has joined #tripleo | 12:21 | |
| d0ugal | +1 | 12:21 |
| sshnaidm | owalsh, yeah, but it doesn't solve the problem actually.. | 12:21 |
| thrash | d0ugal: and did you see the fix I did on the migrations on the newton branch? | 12:21 |
| *** ratailor has quit IRC | 12:21 | |
| sshnaidm | owalsh, if this host is really blocks icmp, we need to find another way to check connectivity.. | 12:22 |
| *** cdearborn has joined #tripleo | 12:22 | |
| *** leitan has joined #tripleo | 12:22 | |
| thrash | d0ugal: we can't backport migrations out of order. It will mess up upgrades. | 12:22 |
| owalsh | sshnaidm: well, do we care for a CI host? I'd leave this enabled by default but disable it in the CI jobs only | 12:22 |
| d0ugal | thrash: yeah, in mistral - thanks for that | 12:22 |
| thrash | d0ugal: see my comment here (https://bugs.launchpad.net/tripleo/+bug/1699515/comments/2) for a full explanation. :) | 12:23 |
| openstack | Launchpad bug 1699515 in tripleo "Newton - Ocata Undercloud Upgrade fails" [Critical,Fix committed] - Assigned to Brad P. Crochet (brad-9) | 12:23 |
| d0ugal | thrash: will do! | 12:23 |
| thrash | d0ugal: :) | 12:23 |
| *** tzumainn has joined #tripleo | 12:23 | |
| adarazs | jistr: Error: Evaluation Error: Error while evaluating a Function Call, Could not find data item ceph::profile::params::client_keys in any Hiera data file and no default supplied at /etc/puppet/modules/tripleo/manifests/profile/base/nova/compute/libvirt.pp:36:22 on node overcloud-novacompute-0.localdomain\u001b[0m", "", "2017-06-29 12:24:36,241 | 12:26 |
| adarazs | ERROR: Failed running docker-puppet.py for nova_libvirt", "2017-06-29 12:24:36,242 ERROR: ERROR configuring nova_libvirt", "2017-06-29 12:24:36,242 | 12:26 |
| adarazs | jistr: any quick guess about what the heck this is? | 12:26 |
| jistr | hah | 12:26 |
| jistr | no quick guess, but looks like sc001 is broken much more than the rest | 12:27 |
| adarazs | yeah. | 12:27 |
| jistr | i'll just post one upgrade fix and then i can take a look | 12:27 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Fix files actions run() method https://review.openstack.org/478908 | 12:27 |
| gfidente | d0ugal I think we missed ^^ https://review.openstack.org/478908 :( | 12:27 |
| adarazs | jistr: ack, I'll look around meanwhile. | 12:27 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Make ceilometer crontab removal idempotent https://review.openstack.org/478909 | 12:28 |
| openstackgerrit | Michael Henkel proposed openstack/puppet-tripleo master: Contrail: Fix controlplane/dataplane network asignments & enable optional dpdk https://review.openstack.org/475045 | 12:29 |
| d0ugal | gfidente: ah, good spot | 12:30 |
| *** artom has quit IRC | 12:32 | |
| *** artom has joined #tripleo | 12:32 | |
| *** bfournie has joined #tripleo | 12:33 | |
| jtomasek | gfidente: I am going through capabilities-map.yaml trying to ensure all storage related environments are included there. Do you know about any needed to be added? | 12:33 |
| gfidente | jtomasek well, not new ones, but things might change with ceph-ansible | 12:34 |
| *** fpan has joined #tripleo | 12:34 | |
| *** bkopilov_ has joined #tripleo | 12:34 | |
| *** janki has joined #tripleo | 12:34 | |
| jtomasek | gfidente: ok, is that coming this cycle? are the patches up now? | 12:34 |
| gfidente | jtomasek https://review.openstack.org/#/c/465066/ is adding the env file to deploy with ceph-ansible , it updates the existing storage-environment.yaml too though | 12:35 |
| *** chlong_ has joined #tripleo | 12:35 | |
| gfidente | jtomasek basically I think our references to puppet-ceph.yaml should be changed to ceph-ansible.yaml | 12:36 |
| gfidente | these aim at doing the same thing, but differetly | 12:36 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-common master: Include cron in container images https://review.openstack.org/478915 | 12:36 |
| gfidente | jtomasek the contents of the environments is very similar, except they map the ceph resources to different templates | 12:37 |
| sshnaidm | owalsh, maybe it's worth to add another IP to ping in case default gw is not responsible | 12:37 |
| sshnaidm | owalsh, of course not after 50 mins.. | 12:37 |
| *** egonzalez has quit IRC | 12:38 | |
| owalsh | sshnaidm: hmm, maybe... good old good DNS servers? | 12:39 |
| owalsh | pah, google DNS servers | 12:39 |
| * owalsh has lost the ability to type | 12:39 | |
| *** amoralej|lunch has quit IRC | 12:39 | |
| jtomasek | gfidente: ok, so when I look at various storage environments we currently have, the storage-environment.yaml is the same as puppet-ceph.yaml | 12:39 |
| *** trown|outtypewww is now known as trown | 12:40 | |
| gfidente | jtomasek yeah it includes documentation on how to do different things, but by default it has the same values | 12:40 |
| jtomasek | gfidente: can we remove one of them or better, rename storage-environment.yaml to something like puppet-ansible.yaml? | 12:40 |
| *** MVenesio has joined #tripleo | 12:40 | |
| *** karimb has joined #tripleo | 12:40 | |
| gfidente | jtomasek the submission I pointed you to will update storage-environment.yaml to behave like ceph-ansible.yaml instead of puppet-ceph.yaml | 12:40 |
| panda | owalsh: the same DNS that is rate limiting us ? | 12:40 |
| *** amoralej has joined #tripleo | 12:41 | |
| gfidente | so that by default the same env file continues to have the same effect, but using the newer method | 12:41 |
| panda | owalsh: why are we pinging that ip ? just to understand if internet is reachable ? | 12:41 |
| gfidente | but we also have references to puppet-ceph itself and those should be changed to ceph-ansible.yaml | 12:41 |
| sshnaidm | owalsh, no :) better not dns | 12:41 |
| owalsh | panda: rate limiting, that's evil :-) we are not pinging them yet | 12:41 |
| owalsh | panda: they probably just rate limit DNS queries too, but lest find something else... | 12:42 |
| sshnaidm | owalsh, git.openstack.org | 12:42 |
| * owalsh still can't type | 12:42 | |
| jtomasek | gfidente: so you re saying that all references to puppet-ceph should change to ceph-ansible? | 12:42 |
| panda | owalsh: is that ping log shown in case of success ? I'd like to check the logs of that | 12:42 |
| jtomasek | gfidente: which means also changing or removing puppet-ceph.yaml? | 12:42 |
| gfidente | jtomasek yes because we want to switch to that in the cycle | 12:42 |
| gfidente | jtomasek no puppet-ceph isn't going away, the pre-existing stuff continues to woerk | 12:43 |
| gfidente | but we "prefer" ceph-ansible to it because of containers | 12:43 |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: Create /etc/ssh/ssh_known_hosts on base image https://review.openstack.org/478918 | 12:44 |
| jtomasek | gfidente: so that means that we are just adding another ceph setup alternative. we currently have puppet-ceph.yaml, puppet-ceph-external.yaml and newly we're adding ceph-ansible | 12:44 |
| gfidente | correct | 12:44 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Copy only generated puppet files into the container https://review.openstack.org/476153 | 12:45 |
| gfidente | and if you want containers, you need to use ceph-ansible | 12:45 |
| *** noslzzp has joined #tripleo | 12:45 | |
| gfidente | so that is our default for pike | 12:45 |
| jtomasek | gfidente: ok, so I think it would be nice to rename storage-environment.yaml to define ceph-ansible and add it to capabilities map under 'Ceph' group | 12:45 |
| gfidente | there are a lot of references to storage-environment.yaml so I was worried about renaming it | 12:46 |
| *** jcoufal has joined #tripleo | 12:46 | |
| gfidente | it also contains commented lines describing how to configure different backends for different services | 12:46 |
| *** thrash is now known as thrash|biab | 12:46 | |
| gfidente | while ceph-ansible (and puppet-ceph) just default what can use ceph to use it | 12:47 |
| *** dprince has joined #tripleo | 12:47 | |
| gfidente | so storage-environment.yaml is probably staying and people can be pointed to it in the docs | 12:47 |
| gfidente | while capabilities-map should probably refer to ceph-ansible env | 12:48 |
| gfidente | wdyt? | 12:48 |
| owalsh | panda: which log? | 12:48 |
| openstackgerrit | John Fulton proposed openstack/tripleo-common master: Add Mistral workbook to call ceph-ansible to install Ceph https://review.openstack.org/469644 | 12:48 |
| fultonj | gfidente: ^ | 12:48 |
| gfidente | fultonj ack | 12:48 |
| owalsh | sshnaidm: how about we add a param to allow an external IP to be set, if it's not set then we ping the default gateways? | 12:48 |
| *** leitan has quit IRC | 12:49 | |
| *** jkilpatr has quit IRC | 12:49 | |
| *** jkilpatr has joined #tripleo | 12:49 | |
| sshnaidm | owalsh, hmm.. I don't know. In usual case gw should be pingable in customers network, when internet is not always available | 12:50 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests https://review.openstack.org/403731 | 12:50 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations https://review.openstack.org/403576 | 12:50 |
| owalsh | sshnaidm: pinging git.openstack.org might looks a bit odd to customers | 12:50 |
| *** egonzalez has joined #tripleo | 12:51 | |
| fultonj | d0ugal: i think https://review.openstack.org/#/c/469644 is finally ready. would you mind reviewing? thanks | 12:51 |
| sshnaidm | owalsh, yeah, although it's openstack :) parameter is better | 12:51 |
| fultonj | rbrady: ^ if you could review that would be great. thanks | 12:52 |
| jtomasek | gfidente: yes, sounds good. That means that you create a new environment ceph-ansible.yaml which we'll add to capabilities-map.yaml and we'll remove storage-environment.yaml from there as it is a general sample environment | 12:52 |
| owalsh | sshnaidm: but yea, gateways need to respond to ICMP for MTU path discovery IIRC so this is really just a workaround for a bad gateway | 12:52 |
| jtomasek | gfidente: sounds good? | 12:52 |
| rbrady | fultonj: ack | 12:52 |
| gfidente | jtomasek++ | 12:52 |
| *** trozet has joined #tripleo | 12:53 | |
| fultonj | thanks | 12:53 |
| jtomasek | gfidente: nice, I am going to do the updates to capabilities-map.yaml now and send the patch up as WIP and will keep updating it as I go through other environments | 12:53 |
| owalsh | sshnaidm: I gotta gotta grab some lunch, I'll propose a new patch when I'm back unless you beat me to it :-) | 12:53 |
| gfidente | jtomasek thanks! ceph-ansible.yaml environment is added in https://review.openstack.org/#/c/465066 | 12:54 |
| sshnaidm | owalsh, no, it's fine :) thanks | 12:54 |
| jtomasek | gfidente: nice! | 12:54 |
| *** shardy has joined #tripleo | 12:54 | |
| jtomasek | gfidente: ceph-ansible.yaml depends on having also docker.yaml enabled, right? | 12:54 |
| gfidente | jtomasek actually no | 12:55 |
| gfidente | because it only deals with the ceph daemons | 12:55 |
| jtomasek | gfidente: ok, cool | 12:55 |
| gfidente | the clients can be in containers or not | 12:55 |
| gfidente | depending on docker.yaml | 12:55 |
| *** prateek has joined #tripleo | 12:57 | |
| rook | any peeps familiar with how we launch containers? I am curious if we mount /etc in the container to read in the configuration file? | 12:58 |
| rook | For example, I see /etc/neutron/neutron.conf is empty : https://gist.github.com/jtaleric/52dbcbbb1dac7d3d49fe4f03c0a3d63c -- however neutron is up and running just fine.. | 12:58 |
| rook | So, I suspect we don't mount /etc in the container? | 12:59 |
| mandre | rook: we generate config files with puppet inside the containers and extract them in /var/lib/config-data/ | 12:59 |
| *** pchavva has joined #tripleo | 13:00 | |
| *** jmelvin has joined #tripleo | 13:00 | |
| rook | ah ha, mandre thanks! | 13:00 |
| mandre | rook: if you look at https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/neutron-api.yaml#L136, this is how we mount the files in the container | 13:01 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: add service crontab containers https://review.openstack.org/478919 | 13:01 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-docs master: Adds docs about the pre-upgrade validations https://review.openstack.org/478920 | 13:01 |
| b00tcat | Hi, is it possible to only deploy 1 overcloud node without updating the rest? | 13:02 |
| mandre | rook: though we're changing that a little bit to stop direct bind-mounting, this is more or less the idea | 13:02 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations https://review.openstack.org/403576 | 13:02 |
| d0ugal | fultonj: great - I'll take a look | 13:02 |
| *** pchavva has quit IRC | 13:02 | |
| fultonj | thanks d0ugal | 13:02 |
| rook | mandre: ok, so the direction of /var/lib/config-data shoul stick? | 13:03 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Enable TLS for the HAProxy stats interface https://review.openstack.org/478894 | 13:03 |
| *** pchavva has joined #tripleo | 13:03 | |
| mandre | rook: yes | 13:03 |
| d0ugal | rbrady: https://review.openstack.org/#/c/478908/ | 13:03 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: [newton only] Ensure cinder services are cleanup during upgrade. https://review.openstack.org/478922 | 13:03 |
| d0ugal | rbrady: could you take a look at that tiny change? | 13:03 |
| rbrady | d0ugal: ack | 13:04 |
| mandre | rook: I'm in the process of copying just the files that have been modified by puppet (and not all of /etc) in /var/lib/config-data | 13:04 |
| rook | mandre: This just impacts some of our performance testing as we capture the configuration files as metadata... | 13:05 |
| rook | so I just need to be up-to-date if they move | 13:05 |
| mandre | rook: currently, this lives in a 'puppet-generated' sub directory, but I want to ultimately have it be /var/lib/config-data | 13:05 |
| *** fandrieu has joined #tripleo | 13:05 | |
| rook | I think it could make debugging tricky -- we just need to tell people configuration files for service containers are *here* not the traditional /etc/<service>/ | 13:05 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-docs master: Adds docs about the pre-upgrade validations https://review.openstack.org/478920 | 13:06 |
| mandre | rook: the end result for you, is that you would have less files in each of the directory, not the entire /etc tree | 13:06 |
| rook | right mandre -- that makes sense. | 13:06 |
| rook | less duplication. | 13:06 |
| *** jjung has quit IRC | 13:06 | |
| *** idlemind has quit IRC | 13:07 | |
| *** idlemind has joined #tripleo | 13:07 | |
| dprince | mandre: fire when ready? https://review.openstack.org/#/c/476970/ | 13:09 |
| openstackgerrit | Michael Henkel proposed openstack/puppet-tripleo master: Contrail: Fix controlplane/dataplane network asignments & enable optional dpdk https://review.openstack.org/475045 | 13:09 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 13:10 |
| *** ansmith has joined #tripleo | 13:10 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/diskimage-builder master: elements: openstack-ci-mirrors: Use openSUSE mirrors for gating jobs https://review.openstack.org/478443 | 13:10 |
| mandre | dprince: let's do this! | 13:10 |
| trozet | shardy: CI looks good now after fixing the typo: https://review.openstack.org/#/c/466920/ | 13:11 |
| dprince | mandre: ++ | 13:11 |
| shardy | trozet: ack, looking | 13:11 |
| trozet | dprince: if you could also review https://review.openstack.org/#/c/466920/ please | 13:11 |
| dprince | mandre: I've got your other large patch up now too. I think I need new containers to test it with the new Kolla feature. https://review.openstack.org/#/c/476153/ | 13:11 |
| dprince | mandre: have you rebuilt containers and pushed since that landed? | 13:11 |
| dprince | trozet: ack | 13:12 |
| mandre | dprince: yep, the containers images are fine | 13:12 |
| dprince | mandre: awesome | 13:12 |
| shardy | trozet: out of interest, what gets configured under /opt? | 13:12 |
| mandre | dprince: there was an issue with /etc/ssh/ssh_known_hosts, that is normally fixed in latest patchset | 13:12 |
| trozet | shardy: all of ODL is installed to /opt/opendaylight | 13:12 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-quickstart master: Add featureset25 for scenario006 https://review.openstack.org/478510 | 13:12 |
| dprince | mandre: ack, will try to remember this. My memory buffer is a bit full this morning | 13:13 |
| *** liverpooler has joined #tripleo | 13:13 | |
| trozet | shardy: ive asked ODL guys to move the config and logging out of that directory and into /etc/opendaylight and /var/log/opendaylight | 13:13 |
| shardy | trozet: but shouldn't that be built into the image, and only the config bind mounted in? | 13:13 |
| shardy | trozet: ah, yeah that sounds better | 13:13 |
| shardy | Ok thanks for clarifying | 13:13 |
| trozet | shardy: those files that you see mountd | 13:14 |
| trozet | shardy: are all the config files | 13:14 |
| shardy | trozet: yeah, it just looks weird ;) | 13:14 |
| trozet | shardy: one is a database that holds user/pass information which we configure in puppet-odl | 13:14 |
| trozet | shardy: yeah I agree | 13:14 |
| trozet | shardy: hopefully we can get that fixed by OSP13/ODL Nitrogen release | 13:15 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-quickstart master: Add featureset25 for scenario006 https://review.openstack.org/478510 | 13:15 |
| sshnaidm | adarazs, trown panda weshay I don't know if it's good name - I'm open for suggestions, please vote: https://review.openstack.org/#/c/478924/ | 13:16 |
| *** artom has quit IRC | 13:16 | |
| *** sshnaidm is now known as sshnaidm|afk | 13:16 | |
| *** liverpooler has quit IRC | 13:17 | |
| fultonj | gfidente: want me to add the context to the unit test for https://review.openstack.org/#/c/478908/ ? | 13:18 |
| adarazs | sshnaidm|afk: I think it's time we start introducing "featureset" in the names, no reason to keep these weird names. | 13:18 |
| weshay | sshnaidm|afk, nice.. do you have a test job on that? | 13:18 |
| adarazs | sshnaidm|afk: I'd call it "ovb-featureset024-oooq" | 13:18 |
| trown | adarazs: :) I commented the same on the patch | 13:18 |
| gfidente | fultonj yes I will | 13:18 |
| fultonj | ok, all yours | 13:19 |
| adarazs | trown: good to agree. :) | 13:19 |
| *** hjensas|lunch has joined #tripleo | 13:19 | |
| *** liverpooler has joined #tripleo | 13:19 | |
| panda | I don't like mixed naming schemes, unless we decide that is the one we're going to use for the rest of our lives | 13:24 |
| dprince | mandre: Slower and I started hacking on simplifying the images yesterday https://review.openstack.org/#/c/478628/ | 13:25 |
| *** dhill_ has joined #tripleo | 13:25 | |
| *** jkilpatr has quit IRC | 13:26 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/diskimage-builder master: elements: openstack-ci-mirrors: Use openSUSE mirrors for gating jobs https://review.openstack.org/478443 | 13:26 |
| *** dhill_ has quit IRC | 13:26 | |
| *** dhill_ has joined #tripleo | 13:27 | |
| *** gkadam has quit IRC | 13:28 | |
| *** jkilpatr has joined #tripleo | 13:28 | |
| *** toure|gone is now known as toure | 13:30 | |
| openstackgerrit | Or Idgar proposed openstack/tripleo-docs master: WIP Post deployment installation instructions for container-based Octavia https://review.openstack.org/472242 | 13:31 |
| mandre | dprince: I saw, it's great! so what happens if we define a heat parameter and don't set a default? | 13:32 |
| adarazs | EmilienM, trown, sshnaidm|afk, weshay, hrybacki, panda, rlandy, arxcruz: CI squad meeting in 60 minutes! https://etherpad.openstack.org/p/tripleo-ci-squad-meeting <-- agenda goes here | 13:32 |
| dprince | mandre: it fails fast | 13:33 |
| *** karimb has quit IRC | 13:33 | |
| mandre | dprince: excellent | 13:33 |
| dprince | mandre: we think not having a default makes everything more explicit... and a better user experience. | 13:33 |
| dprince | mandre: some of stevebaker's work in tripleoclient should help generate the needed files too | 13:34 |
| dprince | mandre: so all of this align's nicely I think | 13:34 |
| mandre | dprince: agreed, it's hard to debug otherwise | 13:34 |
| *** jkilpatr_ has joined #tripleo | 13:34 | |
| EmilienM | adarazs: on PTO | 13:34 |
| dprince | jschluet: https://review.openstack.org/#/c/478628/ | 13:35 |
| dprince | jschluet: I think you were interested in that... | 13:35 |
| *** lblanchard has joined #tripleo | 13:35 | |
| adarazs | EmilienM: have fun! :) I'll be on PTO next week FYI. | 13:35 |
| *** lblanchard has quit IRC | 13:35 | |
| *** jkilpatr_ has quit IRC | 13:36 | |
| *** jkilpatr_ has joined #tripleo | 13:36 | |
| *** jkilpatr has quit IRC | 13:37 | |
| *** karimb has joined #tripleo | 13:37 | |
| *** artom has joined #tripleo | 13:38 | |
| *** artom has quit IRC | 13:39 | |
| *** pchavva has quit IRC | 13:39 | |
| *** artom has joined #tripleo | 13:40 | |
| sshnaidm|afk | adarazs, featureset24 seems completely meaningless though, I think job name should have a hint for its functionality | 13:41 |
| *** sshnaidm|afk is now known as sshnaidm | 13:41 | |
| adarazs | sshnaidm: you should have said that when we started to give meaningless names to featuresets :) | 13:41 |
| honza | What's the easiest way to turn off node introspection in oooq devmode? | 13:41 |
| adarazs | that was exactly the point. | 13:41 |
| sshnaidm | adarazs, no, that was job type, not name :) | 13:42 |
| sshnaidm | people from other projects like nova or neutron which have our our jobs running there should understand a little what runs.. | 13:42 |
| adarazs | sshnaidm: it is *extremely* confusing when I'm trying to reproduce upstream jobs to find the proper featureset for them. | 13:42 |
| adarazs | sshnaidm: I strongly disagree. | 13:42 |
| jaosorior | EmilienM: hey dude, any idea what I did wrong here http://logs.openstack.org/94/478894/2/check/gate-puppet-tripleo-puppet-unit-4.5-centos-7/8d17b0c/console.html#_2017-06-29_13_32_08_454304 https://review.openstack.org/#/c/478894/2/spec/classes/tripleo_haproxy_stats_spec.rb :/ | 13:42 |
| adarazs | sshnaidm: they won't understand it if you have "updates" or if you improve it to "ipv6-ceph" it still hides 80% of what's being tested. | 13:43 |
| sshnaidm | adarazs, I have a bit different problem - when I look at fs file I don't know which job run it | 13:43 |
| adarazs | sshnaidm: that's why we should rename all our jobs to include only the featureset number. | 13:43 |
| adarazs | sshnaidm: that's the same problem. | 13:44 |
| sshnaidm | adarazs, not 80%, it has only a few main features | 13:44 |
| sshnaidm | adarazs, I don't think so, job names should be meaningful imho | 13:44 |
| sshnaidm | adarazs, for featureset we have already joci_type | 13:44 |
| sshnaidm | adarazs, each job has type where featureset is mentioned | 13:45 |
| adarazs | sshnaidm: except if you're interested in network isolation, ssl undercloud, introspection, ping vs. tempest, etc. | 13:45 |
| sshnaidm | adarazs, I look at other projects and they all have mostly meaningful names.. | 13:46 |
| adarazs | sshnaidm: I don't think they are dealing with the test matrix we do. | 13:46 |
| adarazs | sshnaidm: we could do the same but then it would be gate-centos-7-ovb-master-tripleo-ci-ipv6-ssl_undercloud-ni_mn_introsp-ceph-oooq | 13:48 |
| sshnaidm | adarazs, I think they have their own matrix.. for example neutron job: gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-nv | 13:48 |
| adarazs | well yeah, we can go back and forth between short meaningless names and super long descriptive names but we pretty much decided on the former when we adopted featuresets. | 13:49 |
| * adarazs calls in panda for reinforcement. :) | 13:49 | |
| *** pchavva has joined #tripleo | 13:50 | |
| *** dmsimard is now known as dmsimard|afk | 13:50 | |
| adarazs | also trown ^: didn't we agree that eventually we'll call the jobs by their respective featureset names? | 13:50 |
| adarazs | I'm really uncomfortable with the current lame naming situation FWIW. | 13:51 |
| sshnaidm | adarazs, and ovb-featureset024 is actually ugly, not only meaningless | 13:51 |
| trown | sshnaidm: adarazs yes we did agree to name by featureset | 13:52 |
| adarazs | heh, ugly? :) | 13:52 |
| trown | any other name will eventually be meaningless when we change what is in the freatureset | 13:52 |
| adarazs | yup. | 13:52 |
| sshnaidm | trown, so seems like I didn't.. | 13:52 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Enable the HA deployment by default https://review.openstack.org/359060 | 13:52 |
| trown | even now if someone wants to run ovb-ha locally... they have to lookup what featureset that maps to | 13:53 |
| trown | that is not the point | 13:53 |
| adarazs | sshnaidm: the only question was when we are going to change it, we decided to do it in two steps, after we transitioned the jobs. | 13:53 |
| trown | the idea is someone wants to run job xyz, they specify config xyz | 13:53 |
| adarazs | yup. | 13:53 |
| trown | and we have a table that shows what is run in job xyz | 13:53 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Make containerized nova-api run with httpd https://review.openstack.org/475366 | 13:53 |
| sshnaidm | adarazs, trown if somebody from neutron project wants to see what failed in tripleo-ci job he has no chance to find this featureset.. | 13:53 |
| adarazs | yeah, otherwise we should have just called them with the name in upstream to make it easy to identify. | 13:53 |
| trown | sshnaidm: lets worry about making tripleo-ci useful for tripleo devs first... then we can worry about other projects | 13:54 |
| trown | sshnaidm: also I disagree with that statement | 13:54 |
| adarazs | sshnaidm: https://www.google.cz/search?q=tripleo+quickstart+featureset -> 3rd hit in my search bubble. :) | 13:54 |
| sshnaidm | trown, tripleo devs lived well with those names a long time | 13:54 |
| trown | sshnaidm: your premise is that tripleo-ci has a long history of being able to exactly reproduce CI? | 13:55 |
| trown | sshnaidm: I think that means we should all go work on something else then | 13:55 |
| sshnaidm | trown, how is it related to reproducing CI? | 13:55 |
| adarazs | :) | 13:55 |
| jschluet | dprince: thanks looking | 13:56 |
| jschluet | mburned: https://review.openstack.org/#/c/478628/ | 13:56 |
| adarazs | sshnaidm: I look at the job, I see "featureset024", I run --config featureset024 with quickstart.sh and it will reproduce the upstream job for me. | 13:56 |
| adarazs | that's the whole idea. | 13:56 |
| jschluet | tvignaud: ^^ | 13:56 |
| trown | sshnaidm: it is entirely relevant to reproducing ci... that is the point of featuresets | 13:56 |
| *** dhill_ has quit IRC | 13:56 | |
| sshnaidm | trown, I'm talking about naming only | 13:56 |
| adarazs | sshnaidm: the naming is what will tell tripleo/other developers how to reproduce it. | 13:57 |
| *** pchavva has quit IRC | 13:57 | |
| adarazs | ovb-ha won't tell them. | 13:57 |
| trown | sshnaidm: we just didnt change job names in transition to ease things... though I actually think that may not have worked since I have already answered "how do I reproduce ovb-ha" at least 5 times | 13:57 |
| *** pchavva has joined #tripleo | 13:57 | |
| *** pliu has joined #tripleo | 13:57 | |
| trown | whereas how do I reproduce featureset001 is trivial | 13:58 |
| *** dhill_ has joined #tripleo | 13:58 | |
| sshnaidm | so you prefer to sacrifice meaningfulness and features list for more easy configuration finding | 13:58 |
| adarazs | yep. | 13:58 |
| trown | ya that was always the point | 13:59 |
| panda | or we can add all the features short names to the job name | 13:59 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Fix files actions run() method https://review.openstack.org/478908 | 13:59 |
| trown | we can not name all the features tested in a job in the job name | 13:59 |
| sshnaidm | trown, we can, why not | 13:59 |
| panda | gate-ovb-ui-NIMN-sc001-und-redun-pop-matt | 13:59 |
| adarazs | we can, it's just unpractical. | 13:59 |
| trown | also, even if we could... any time we want to change what features run in a job we have to make a change to project-config rather than just changing the featureset table and config | 14:00 |
| adarazs | yeah, that too, and we don't want to mess with project-config all the time. | 14:00 |
| trown | or just let the job name no longer represent what runs in the job, causing further confusion | 14:00 |
| hewbrocca | I feel like we should put the features the job *doesn't* test in the name | 14:01 |
| trown | lol | 14:01 |
| * shardy likes scenario00N with an easily discoverable matrix documented | 14:02 | |
| *** pliu has quit IRC | 14:02 | |
| adarazs | or just add yes and now after them and use the whole matrix. :) "ipv6-yes-ssl-uc-no-introspec-yes-..." :) | 14:02 |
| * adarazs would like to have that finally too. | 14:03 | |
| sshnaidm | or just to mention the main features that unlikely to be changed, like ha, ipv6, etc | 14:03 |
| trown | ya that is the whole point | 14:03 |
| hewbrocca | I think we should name the jobs for Icelandic volcanoes | 14:03 |
| trown | we currently have 19 features in the table | 14:03 |
| sshnaidm | trown, not all of them are relevant for job name | 14:03 |
| sshnaidm | trown, actually only 4-5 of them | 14:04 |
| adarazs | hewbrocca: good point, that's already proven to work. | 14:04 |
| sshnaidm | hewbrocca, even volcanoes are more remember-able than featureset024.. | 14:04 |
| panda | we map letters to features | 14:04 |
| panda | ifoejg;pirjgirioeegjp erpiog is featureset024 | 14:04 |
| *** mandre is now known as mandre|away | 14:05 | |
| hewbrocca | Assign each feature a prime number | 14:05 |
| hewbrocca | and then multiply the numbers together to get the job number | 14:05 |
| trown | sshnaidm: ok, so you are correct that we would only need 5 strings per job max currently to describe the features running in said job... that is still a really long job name and it does not solve the other problems featuresets are trying to solve | 14:05 |
| trown | listed above | 14:05 |
| gfidente | and most importanly change it every now and then because after a while one starts to remember the mapping | 14:05 |
| sshnaidm | I hate numbers in names.. jobs are like pets, you don't call your pet Cat-010123 | 14:06 |
| panda | featureset-aaa | 14:07 |
| panda | featureset-aab | 14:07 |
| *** lblanchard has joined #tripleo | 14:07 | |
| jistr | adarazs: interesting.. So the error probably comes from here | 14:08 |
| jistr | https://github.com/openstack/puppet-tripleo/blob/8ca7a1e390ce50ac66a6861dae59bb44fbf0324a/manifests/profile/base/nova/compute/libvirt.pp#L36 | 14:08 |
| adarazs | sshnaidm: we should really start naming them like tripleo-rex, tripleo-daisy, then, ovb-ha is not pet-like enough ;) | 14:08 |
| jistr | which seems as if this wasn't included: | 14:08 |
| jistr | https://github.com/openstack/tripleo-heat-templates/blob/aeb11f384fe8e221c9bd62b8b86ecb1da4003777/puppet/services/ceph-base.yaml#L128 | 14:08 |
| jistr | but it should be, as sc001 does have Ceph... | 14:08 |
| sshnaidm | adarazs, I think I proposed it in one of meetings ) | 14:08 |
| adarazs | jistr: yeah, I'm really confused by that one. I'm waiting for the upstream job to finish, it might be something with my libvirt virthost reproducer again. | 14:09 |
| *** thrash|biab is now known as thrash | 14:09 | |
| adarazs | jistr: so far the overcloud deploy takes a lot longer than it did on my setup, so maybe it will succeed?! | 14:10 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 14:10 |
| adarazs | or just time out :P | 14:10 |
| jistr | adarazs: ack yea it would be good if we can get further validation from CI, and it would be great if it actually works. But i don't get my hopes high just yet :D | 14:10 |
| adarazs | yeah... | 14:11 |
| adarazs | this scenario001-container is uncharted territory. Here be dragons. | 14:11 |
| adarazs | I mean, featureset016 ;) | 14:12 |
| * adarazs accidentally ran featureset017 in the beginning because he couldn't pair the job names and featuresets properly. | 14:13 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-validations master: Add role_name to inventory https://review.openstack.org/478944 | 14:16 |
| *** atheurer has joined #tripleo | 14:17 | |
| *** fpan has quit IRC | 14:18 | |
| *** ebarrera_ has joined #tripleo | 14:21 | |
| *** jpich has left #tripleo | 14:22 | |
| *** jpich has joined #tripleo | 14:22 | |
| openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo master: Do not fail if PCI device is missing https://review.openstack.org/478503 | 14:25 |
| adarazs | sshnaidm: why do we have this line here? https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/quickstart/multinode-settings.yml#L20 | 14:25 |
| sshnaidm | adarazs, this file is not used, btw | 14:26 |
| *** jkilpatr_ has quit IRC | 14:26 | |
| adarazs | sshnaidm: hmm, so what env file are we using? :) | 14:26 |
| *** jkilpatr has joined #tripleo | 14:27 | |
| sshnaidm | adarazs, https://github.com/openstack-infra/tripleo-ci/blob/master/toci-quickstart/config/testenv/multinode.yml | 14:27 |
| panda | sshnaidm: how close we are in removing that old dir ? | 14:27 |
| adarazs | yeah, that's confusing. is there anything else using it? I thought we migrated everything to featuresets. | 14:27 |
| sshnaidm | adarazs, panda waiting for arxcruz to transit his periodic tempest job and we can remove all this, I have already a patch :) | 14:27 |
| *** atheurer has quit IRC | 14:27 | |
| adarazs | \o/ | 14:27 |
| adarazs | sshnaidm++ | 14:28 |
| adarazs | sshnaidm: still, same question, why are we removing all the flavor_args? https://github.com/openstack-infra/tripleo-ci/blob/master/toci-quickstart/config/testenv/multinode.yml#L16 :) | 14:29 |
| arxcruz | waiting reviews btw | 14:29 |
| arxcruz | adarazs: sshnaidm ^ | 14:29 |
| arxcruz | I even have a +1 from sshnaidm | 14:29 |
| adarazs | arxcruz: link plz. | 14:29 |
| arxcruz | adarazs: https://review.openstack.org/#/c/477879/ | 14:29 |
| sshnaidm | adarazs, I think because the flavors in quickstart are "--control" and kind of, but we use the default ones "--baremetal" | 14:30 |
| sshnaidm | adarazs, so we just zeroize this var for using default flavors | 14:31 |
| sshnaidm | adarazs, there are no "--control" or "--oooq-control" flavors upstream.. | 14:31 |
| adarazs | sshnaidm, hrybacki: CI squad meeting. | 14:31 |
| *** jmelvin has quit IRC | 14:32 | |
| *** jmelvin has joined #tripleo | 14:32 | |
| *** jmelvin has quit IRC | 14:35 | |
| *** jmelvin_ has joined #tripleo | 14:35 | |
| dpawar | Hi, while testing my patches i am getting errors with command 'openstack deploy --templates' any idea what is wrong here ? http://paste.openstack.org/show/614074/ | 14:37 |
| shardy | chem, marios, dciabrin: https://etherpad.openstack.org/p/tripleo-ansible-updates has some notes on how I've started testing running the deploy steps directly via ansible-playbook | 14:38 |
| chem | shardy: ack, looking. Thanks | 14:38 |
| marios | shardy: thanks | 14:38 |
| shardy | it's pretty early and I've not yet got it working end-to-end for all steps, but feedback welcome | 14:38 |
| shardy | I think we probably need the patch referenced from mandre|away to make it work, but I've not yet tried the latest version of that | 14:38 |
| chem | dciabrin: would you like to follow up from the discussion yesterday ? | 14:39 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates stable/ocata: Disable swift middleware ceilometer pipeline by default https://review.openstack.org/478953 | 14:41 |
| dpawar | shardy: could you please review https://review.openstack.org/#/c/475765/ ? | 14:42 |
| weshay | fultonj, did you have a topic you wanted discussed in the ci mtg? | 14:43 |
| shardy | dpawar: ack, added to my list | 14:43 |
| owalsh | sshnaidm: looks like we have other infra issues: | 14:43 |
| owalsh | 2017-06-29 11:53:49.168248 | Setting up the workspace | 14:44 |
| owalsh | 2017-06-29 11:53:49.168375 | ... this takes 3 - 5 minutes (logs at logs/devstack-gate-setup-workspace-new.txt.gz) | 14:44 |
| fultonj | hi weshay: no topic, i was just curious. i wasn't sure what type of meeting it was. | 14:44 |
| owalsh | 2017-06-29 14:12:01.976558 | WARNING: setup workspace took > 10 minutes, this is a very slow node. | 14:44 |
| fultonj | i'm on the "demystifying ci" trello card so i imagine that's more of what i was after | 14:45 |
| shardy | jistr: further to the discussion around migrating yum_update.sh to ansible tasks, do you think it'd be reasonable to move them to host_prep_tasks, and make the tasks conditional on a new StackUpdateType? | 14:45 |
| shardy | vs a new interface like upgrade_tasks | 14:46 |
| shardy | I'm thinking the requirements around host update are fairly simple, so we probably don't need to run multiple steps | 14:46 |
| shardy | we just need to do some tasks before starting the container/puppet update steps | 14:46 |
| openstackgerrit | Petr Blaho proposed openstack/tripleo-quickstart master: Escapes username and password in repo_setup script template https://review.openstack.org/478959 | 14:49 |
| jaosorior | q/away I'm off | 14:52 |
| *** jmelvin_ has quit IRC | 14:52 | |
| *** agurenko has quit IRC | 14:59 | |
| ccamacho | Hey EmilienM does this error looks familiar? http://logs.openstack.org/06/477606/6/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/7437e80/logs/var/log/undercloud_upgrade.txt.gz#_2017-06-29_11_11_40_000 | 14:59 |
| ccamacho | Error: Evaluation Error: Error while evaluating a Function Call, create_resources(): second argument must be a hash at /etc/puppet/modules/tripleo/manifests/profile/base/kernel.pp:39:5 on node centos-7-osic-cloud1-s3500-9576509 | 14:59 |
| dpawar | shardy: you are also added as a reviewer on related patch https://review.openstack.org/#/c/475762/ | 15:00 |
| dpawar | shardy: please review it | 15:00 |
| bnemec | ccamacho: I noticed yesterday that that seems to be killing a lot of the undercloud upgrade jobs. :-/ | 15:01 |
| bnemec | I was planning to dig further today. | 15:01 |
| bnemec | I believe EmilienM is on PTO until next week. | 15:02 |
| *** ecerquei_ has quit IRC | 15:02 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-common master: Add Mistral workbook to call ceph-ansible to install Ceph https://review.openstack.org/469644 | 15:03 |
| ccamacho | bnemec ack ajaja man error after error ¯\_(ăƒ„)_/¯ | 15:03 |
| ccamacho | bnemec have you seen it randomly or in all undercloud jobs, I believe is like 90% of time | 15:04 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Handle failed resources in heat-deploy-times.py https://review.openstack.org/478963 | 15:05 |
| ccamacho | as bnemec this https://review.openstack.org/#/c/477606/ passed like 2 days ago and now have that error | 15:05 |
| bnemec | ccamacho: Yeah, it was most but not all. Which will probably make it harder to track down. :-/ | 15:05 |
| bnemec | ccamacho: Although looking again today I don't see any passed undercloud-upgrade jobs at all. | 15:06 |
| *** kbyrne has quit IRC | 15:06 | |
| *** jmelvin has joined #tripleo | 15:07 | |
| *** kbyrne has joined #tripleo | 15:07 | |
| shardy | bnemec, ccamacho: this looks possibly related? | 15:08 |
| shardy | https://github.com/openstack/instack-undercloud/commit/b3cfb20e0cae837400fba57817684ed5bcb16de3 | 15:08 |
| shardy | previously sysctl_settings was a yaml map, now it's a json serialized map | 15:08 |
| shardy | which doesn't appear to be what puppet-tripleo expects? | 15:08 |
| bnemec | shardy: Could be. I wonder why it isn't failing on new installations though. | 15:10 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,Triaged] | 15:10 |
| ccamacho | shardy well that's the parameter with the offending sintax sysctl_settings so yeahp might be | 15:10 |
| shardy | bnemec: yeah, I can't explain that | 15:10 |
| *** cdearborn has quit IRC | 15:10 | |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud master: CHECK DO NOT MERGE https://review.openstack.org/478965 | 15:11 |
| bnemec | Heh, beat me to it. | 15:11 |
| *** zaneb has quit IRC | 15:11 | |
| *** akane has joined #tripleo | 15:11 | |
| ccamacho | let's see if the revert does not fail, hopefully.. | 15:12 |
| shardy | If anyone else is testing HA w/containers, I think something may have broken today | 15:12 |
| shardy | this morning it was working, but this afternoon with latest t-h-t and pulling latest images, it fails on step3 doing the heat db_sync repeatedly | 15:12 |
| shardy | nonha seems OK | 15:12 |
| shardy | dciabrin: ^^ FYI | 15:13 |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Fix undercloud-upgrade job for Newton to Ocata https://review.openstack.org/477606 | 15:14 |
| openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo stable/newton: Decouple swift-proxy from ceilometer packages https://review.openstack.org/478966 | 15:14 |
| *** jkilpatr has quit IRC | 15:16 | |
| akane | Emilien: could you please review https://review.openstack.org/#/c/475765/ ? | 15:17 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Deploy Ceph in containers using ceph-ansible via external workflow https://review.openstack.org/465066 | 15:18 |
| *** aufi has quit IRC | 15:19 | |
| *** jistr is now known as jistr|afk | 15:20 | |
| *** cdearborn has joined #tripleo | 15:22 | |
| *** ffiore has joined #tripleo | 15:22 | |
| *** ebarrera_ has quit IRC | 15:22 | |
| ccamacho | FYI shardy bnemec checking the revert here https://review.openstack.org/#/c/477606/ | 15:23 |
| *** cdearborn_ has joined #tripleo | 15:24 | |
| *** yamahata has joined #tripleo | 15:26 | |
| *** cdearborn__ has joined #tripleo | 15:26 | |
| dciabrin | shardy, oh ... | 15:27 |
| *** yamahata has quit IRC | 15:27 | |
| *** yamahata has joined #tripleo | 15:27 | |
| *** akane has quit IRC | 15:27 | |
| *** rcernin has quit IRC | 15:28 | |
| dciabrin | shardy, I'll redeploy locally and see if I spot something obvious | 15:28 |
| shardy | dciabrin: ack thanks | 15:28 |
| shardy | FYI I also updated https://etherpad.openstack.org/p/tripleo-ansible-updates if you want to give that a try | 15:28 |
| *** katkapilatova has left #tripleo | 15:29 | |
| *** jkilpatr has joined #tripleo | 15:29 | |
| *** dpawar has left #tripleo | 15:29 | |
| adarazs | jistr|afk, EmilienM: gate-tripleo-ci-centos-7-scenario001-multinode-oooq-containerSUCCESS in 1h 47m 14s \o/ -- https://review.openstack.org/476693 | 15:32 |
| *** oidgar has quit IRC | 15:33 | |
| *** dsariel has quit IRC | 15:34 | |
| EmilienM | adarazs: nice, make it voting! | 15:34 |
| adarazs | EmilienM: okay. | 15:34 |
| EmilienM | jaosorior: yeah, I'm on PTO until Tuesday | 15:35 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: use a non-default virthost_user for the basic test https://review.openstack.org/441560 | 15:35 |
| *** ffiore has quit IRC | 15:35 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-docs master: Document need of ceph-ansible in the undercloud https://review.openstack.org/478975 | 15:39 |
| *** cdearborn has quit IRC | 15:40 | |
| *** cdearborn_ has quit IRC | 15:42 | |
| *** fpan has joined #tripleo | 15:44 | |
| openstackgerrit | abdul nizamuddin proposed openstack/tripleo-common master: Drop MANIFEST.in - it's not needed by pbr https://review.openstack.org/478976 | 15:44 |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci master: Install ceph-ansible in the undercloud https://review.openstack.org/478977 | 15:46 |
| gfidente | adarazs can you point me at the best place where to make this edit for oooq https://review.openstack.org/#/c/478977/1 ? | 15:47 |
| gfidente | it's basically installing a new package in the undercloud, assumes the repos are configured | 15:47 |
| adarazs | gfidente: why isn't tripleo client installing it? | 15:48 |
| *** trozet has quit IRC | 15:48 | |
| gfidente | adarazs so the general idea is to keep it losely coupled with ceph | 15:48 |
| sshnaidm | owalsh, add me as reviewer please to your patch when it's ready | 15:49 |
| gfidente | people don't necessarily have to install the ceph repo if they don't need ceph | 15:49 |
| adarazs | gfidente: so I see a bunch of these ceph-jewel related stuff in the release files, like this :https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/master.yml#L78 | 15:49 |
| gfidente | in theory this could have been a dependency of tripleo-common, which ships the workflow itself | 15:49 |
| gfidente | but the decision was to not enforce it and document the need | 15:49 |
| gfidente | adarazs yep the repo is correct | 15:50 |
| *** fpan has quit IRC | 15:50 | |
| adarazs | gfidente: I would assume it goes in the "repo_cmd_after" variable. | 15:50 |
| adarazs | at line 85... also check for the other releases where this is needed. | 15:50 |
| adarazs | but I'm not sure in which exact case you want it installed. | 15:51 |
| adarazs | I mean removed. :) | 15:51 |
| gfidente | yeah why is it removing the .repo even? | 15:51 |
| gfidente | I don't want it removed | 15:51 |
| gfidente | I want it available on the undercloud to install the package | 15:52 |
| adarazs | I am somewhat unclear what all this serves here, maybe weshay or trown can answer? | 15:52 |
| adarazs | weshay, trown: i.e. why we have all these ceph jewel removal in here: https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/master.yml#L90-L91 | 15:53 |
| gfidente | adarazs thanks for helping :D | 15:54 |
| *** jlinkes has quit IRC | 15:54 | |
| weshay | https://github.com/openstack/tripleo-quickstart/blame/master/config/release/tripleo-ci/master.yml#L90-L91 | 15:54 |
| weshay | adarazs, check EmilienM's comments | 15:54 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: [WIP]Check repository availability https://review.openstack.org/477006 | 15:55 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: Allow default gateways to be excluded from ping test https://review.openstack.org/478878 | 15:55 |
| openstackgerrit | Ben Nemec proposed openstack/instack-undercloud master: Fix logging with direct tripleoclient call https://review.openstack.org/478609 | 15:55 |
| owalsh | sshnaidm: looking at it a bit more I think an exclude list might be better | 15:58 |
| adarazs | gfidente: so it seems you should discuss it with EmilienM that we don't want to be that drastic :) you could try to propose a change where you only remove the package and not the repo. /o\ and then discuss it. | 15:58 |
| gfidente | yeah and where do I install ceph-ansible itself? | 15:58 |
| *** panda is now known as panda|off | 15:59 | |
| weshay | gfidente, that is a good question, I wonder if that is in delorean-deps or centos channels | 15:59 |
| owalsh | sshnaidm: just updated the WIP patch to do this and enabled it on one of the multinode scenarios | 15:59 |
| gfidente | weshay that is in the centos storage repo | 15:59 |
| owalsh | sshnaidm: /me needs to go afk to pick up kid, biab | 16:00 |
| gfidente | weshay that is why I need the repo | 16:00 |
| gfidente | in the undecloud | 16:00 |
| weshay | gfidente, ack | 16:00 |
| *** ecerquei has joined #tripleo | 16:00 | |
| weshay | so let's get a review in to add it and put EmilienM on the review | 16:00 |
| gfidente | weshay like https://review.openstack.org/478977 | 16:00 |
| weshay | makes sense to me | 16:00 |
| gfidente | ack, I can't find where oooq is installing python-tripleoclient though? | 16:01 |
| gfidente | I just wanted to append ceph-ansible to that list | 16:01 |
| adarazs | weshay: woot, scenario001-container is passing btw, mission accomplished \o/ :) | 16:01 |
| *** cylopez has joined #tripleo | 16:02 | |
| weshay | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/undercloud-setup/files/install_packages.sh | 16:02 |
| weshay | gfidente, ^ | 16:02 |
| gfidente | weshay++ thanks | 16:02 |
| gfidente | so it's in another repo | 16:02 |
| *** dparkes has quit IRC | 16:03 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-quickstart master: Keep CentOS Ceph repos to be able to install ceph-ansible https://review.openstack.org/478980 | 16:03 |
| *** egonzalez has quit IRC | 16:04 | |
| weshay | that package list should be a variable defined in defaults and I think what you need is to override it for master | 16:04 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates master: Ping more often in all-nodes validation https://review.openstack.org/478981 | 16:04 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Force mtime for tar used in container config md5sums https://review.openstack.org/478982 | 16:06 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-docs master: Document need of ceph-ansible in the undercloud https://review.openstack.org/478975 | 16:06 |
| *** jistr|afk is now known as jistr | 16:07 | |
| jistr | adarazs: whohoo \o/ great | 16:08 |
| jistr | adarazs: nice work! | 16:08 |
| *** prateek_ has joined #tripleo | 16:08 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Check repository availability https://review.openstack.org/477006 | 16:09 |
| *** prateek has quit IRC | 16:09 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-quickstart-extras master: Install ceph-ansible in the undercloud https://review.openstack.org/478986 | 16:09 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 16:10 |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec) | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| * bnemec hates having alert bugs assigned to him | 16:10 | |
| shardy | IMO it's reasonable to remove the alert if it's assigned and you're working on it | 16:11 |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-common master: DPDK and Host derive parameters workflows https://review.openstack.org/468989 | 16:11 |
| openstackgerrit | Joe Talerico proposed openstack/tripleo-heat-templates master: Adding Tuned Service https://review.openstack.org/454123 | 16:12 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Split quickstart-extras.yml into sub-playbooks https://review.openstack.org/475813 | 16:14 |
| *** iranzo has joined #tripleo | 16:16 | |
| *** iranzo has joined #tripleo | 16:16 | |
| *** jaganathan has quit IRC | 16:19 | |
| *** dixiaoli has quit IRC | 16:22 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Check repository availability https://review.openstack.org/477006 | 16:24 |
| *** pkovar has quit IRC | 16:25 | |
| *** sshnaidm is now known as sshnaidm|afk | 16:28 | |
| *** jpich has quit IRC | 16:28 | |
| *** snecklifter has quit IRC | 16:28 | |
| *** karimb has quit IRC | 16:29 | |
| *** cschwede has quit IRC | 16:29 | |
| *** lmiccini has quit IRC | 16:30 | |
| hjensas|lunch | Anyone with deep knowledge on CI here? I need to know which resource creates the ControlPlanePort for overcloud nodes in the gate-tripleo-ci-centos-7-nonha-multinode-updates-nv job. | 16:31 |
| hjensas|lunch | I get this error: http://logs.openstack.org/44/437544/64/check/gate-tripleo-ci-centos-7-nonha-multinode-updates-nv/ee5aaa3/logs/subnode-2/var/log/journal-text.txt.gz#_Jun_29_10_22_10_990532 | 16:31 |
| hjensas|lunch | We had the same in multiple other jobs and know that adding fixed_ips to the port request help. It work for the other jobs. | 16:32 |
| mcornea | shardy: I'm trying to upgrade an ha environment but I'm failing with the following error message: | 16:32 |
| mcornea | u'message': u"Failed to run action [action_ex_id=b7b021fa-7988-4e31-afdc-26b2523c934c, action_cls='<class 'mistral.actions.action_factory.DeployStackAction'>', attributes='{}', params='{u'skip_deploy_identifier': False, u'container': u'overcloud', u'timeout': 240}']\n ERROR: Failed to validate: : resources.AllNodesDeploySteps: : Property error: resources.AllNodesPostUpgradeSteps.properties: Unknown Property | 16:32 |
| mcornea | stack_name", | 16:32 |
| mcornea | shardy: does it look familiar? | 16:32 |
| hjensas|lunch | mcornea: https://bugs.launchpad.net/tripleo/+bug/1700755 | 16:34 |
| openstack | Launchpad bug 1700755 in tripleo "Upgrade jobs in CI fail with - "Unknown Property stack_name" error" [High,Fix released] - Assigned to Giulio Fidente (gfidente) | 16:34 |
| mcornea | hjensas|lunch: cool, thanks! and enjoy lunch | 16:34 |
| *** hjensas|lunch is now known as hjensas | 16:34 | |
| hjensas | mcornea: lunch was hours ago. :D | 16:34 |
| *** chhavi has joined #tripleo | 16:35 | |
| *** ykarel has quit IRC | 16:36 | |
| *** zaneb has joined #tripleo | 16:37 | |
| *** marios has quit IRC | 16:37 | |
| mcornea | hjensas: it looks that I have that patch on my env but it's still failing | 16:38 |
| *** prateek has joined #tripleo | 16:38 | |
| chhavi | Hi All, Can we use Triple-O based on mitaka to manage Power Compute. | 16:39 |
| *** sshnaidm|afk has quit IRC | 16:39 | |
| mcornea | actually my error is slightly different: Property error: resources.AllNodesPostUpgradeSteps.properties: Unknown Property stack_name | 16:39 |
| openstackgerrit | John Fulton proposed openstack/tripleo-common master: Add Mistral workbook to call ceph-ansible to install Ceph https://review.openstack.org/469644 | 16:39 |
| *** prateek_ has quit IRC | 16:40 | |
| *** trown is now known as trown|lunch | 16:41 | |
| *** florianf has quit IRC | 16:41 | |
| *** jschluet is now known as jschlueter | 16:43 | |
| shardy | mcornea: I think I see the problem, sec | 16:45 |
| *** dmacpher is now known as dmacpher-afk | 16:45 | |
| * shardy grumbles about merging things with broken CI | 16:45 | |
| *** chhavi has quit IRC | 16:46 | |
| *** pcaruana has quit IRC | 16:48 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add stack_name into post-upgrade.j2.yaml https://review.openstack.org/478999 | 16:49 |
| shardy | mcornea: ^^ I think that may fix it? | 16:50 |
| *** dtantsur is now known as dtantsur|afk | 16:50 | |
| *** derekh has quit IRC | 16:50 | |
| ccamacho | ajaj ;( shardy bnemec now it fails with http://logs.openstack.org/06/477606/7/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/11ba776/console.html#_2017-06-29_16_39_04_249197 | 16:53 |
| mcornea | shardy: checking it | 16:53 |
| ccamacho | at least the error is different now | 16:53 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: LVM in cinder-volume container without udev https://review.openstack.org/478164 | 16:54 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Reintroduce containerized Cinder https://review.openstack.org/479001 | 16:54 |
| bnemec | ccamacho: I wonder if something puppet-related is not getting upgraded properly. | 16:54 |
| bnemec | ccamacho: Also, I think the actual failure is http://logs.openstack.org/06/477606/7/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/11ba776/console.html#_2017-06-29_16_39_04_249404 | 16:54 |
| bnemec | Another function call... | 16:55 |
| ccamacho | bnemec yeahp I copied the wrong line | 16:55 |
| ccamacho | the str2bool call | 16:55 |
| ccamacho | indeen | 16:55 |
| ccamacho | **indeed | 16:55 |
| *** artom has quit IRC | 16:56 | |
| *** salmankhan has quit IRC | 16:56 | |
| *** artom has joined #tripleo | 16:57 | |
| *** leseb has joined #tripleo | 16:57 | |
| *** artom has quit IRC | 16:57 | |
| atoth | shardy, re: review comments on https://review.openstack.org/#/c/313933/, I also should update capabilities-map.yaml, correct? | 16:57 |
| *** tesseract has quit IRC | 16:58 | |
| *** artom has joined #tripleo | 16:58 | |
| ccamacho | bnemec shardy question, in the case of the revert https://review.openstack.org/#/c/478965/ (I never reverted anything before) is it better to fix the bug here: https://review.openstack.org/#/c/478965/1/elements/puppet-stack-config/puppet-stack-config.yaml.template or the revert? | 16:58 |
| *** artom has quit IRC | 16:58 | |
| bnemec | ccamacho: If you can fix it quickly, then that's the way to go. If it's going to take time then it's best to do a quick revert and re-propose the patch with the fix. | 16:59 |
| atoth | shardy, with the details of the added environment file that is | 16:59 |
| shardy | atoth: yup, I forgot to mention that one | 16:59 |
| *** artom has joined #tripleo | 16:59 | |
| *** artom has quit IRC | 17:00 | |
| *** jpena is now known as jpena|off | 17:00 | |
| *** artom has joined #tripleo | 17:00 | |
| *** artom has quit IRC | 17:02 | |
| *** artom has joined #tripleo | 17:03 | |
| mcornea | shardy: I guess it worked, now it failed with something else: Property error: resources.AllNodesPostUpgradeSteps.properties: Unknown Property ctlplane_service_ips | 17:03 |
| shardy | ugh we really need that upgrade job voting | 17:03 |
| shardy | mcornea: looking | 17:03 |
| *** bogdando has quit IRC | 17:04 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add stack_name/ctlplane_service_ips into post-upgrade.j2.yaml https://review.openstack.org/478999 | 17:05 |
| shardy | mcornea: ^^ | 17:05 |
| *** ykarel has joined #tripleo | 17:09 | |
| *** artom has quit IRC | 17:09 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec) | 17:10 |
| mcornea | shardy: worked, thanks! | 17:10 |
| gfidente | mcornea wait identical bug and fix | 17:12 |
| shardy | mcornea: great! | 17:12 |
| gfidente | https://review.openstack.org/#/c/478439/ | 17:12 |
| shardy | gfidente: it's not a duplicate patch though, there were missing parameters also in post-upgrade.j2.yaml | 17:13 |
| gfidente | shardy :( | 17:13 |
| *** ykarel has quit IRC | 17:13 | |
| gfidente | tks | 17:13 |
| shardy | gfidente: np - we missed it because the upgrade CI failed during create, before attempting the upgrade | 17:15 |
| gfidente | voting! | 17:15 |
| shardy | yeah we need to make it work again first | 17:15 |
| atoth | shardy, file naming question, for the environments file which do you think is better, neutron-lbaas.yaml or neutron-lbaasv2.yaml? | 17:16 |
| shardy | atoth: personally I'd be explicit and say v2, since the original lbaas was a different and incompatible API IIRC? | 17:16 |
| ccamacho | bnemec check for sysctl_settings in: | 17:17 |
| ccamacho | (passing sysctl error) http://logs.openstack.org/06/477606/7/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/11ba776/logs/etc/puppet/hieradata/puppet-stack-config.yaml.txt.gz | 17:17 |
| ccamacho | (not passing) http://logs.openstack.org/06/477606/6/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/7437e80/logs/etc/puppet/hieradata/puppet-stack-config.yaml.txt.gz | 17:17 |
| ccamacho | In the error case is None, so maybe the issue is here as shardy said https://github.com/openstack/instack-undercloud/blob/4de8226a6ddbabed909c74993851c441a44fbd94/instack_undercloud/undercloud.py#L1047 we need to generate the map correctly so puppet like it | 17:17 |
| atoth | shardy, that was my inclination as well especially with octavia also being in the mix, thanks | 17:17 |
| ccamacho | Ill test it | 17:19 |
| *** cylopez has quit IRC | 17:21 | |
| fultonj | anyone want to +1 workflow for this double +2'd review https://review.openstack.org/#/c/476602 ? | 17:21 |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud master: Return sysctl_settings as yaml instead of json https://review.openstack.org/479009 | 17:23 |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Fix undercloud-upgrade job for Newton to Ocata https://review.openstack.org/477606 | 17:25 |
| mcornea | shardy: gfidente now I'm seeing a different issue but I don't deploy any block storage node: resources.AllNodesDeploySteps: The specified reference "WorkflowTasks_Step1_Execution" (in BlockStorageDeployment_Step1) is incorrect. | 17:25 |
| gfidente | mcornea no I haven't found it | 17:26 |
| *** rhallisey is now known as rhallisey-lunch | 17:26 | |
| gfidente | but if this is a problem with the deps and conditions I think we have seen it elsewhere | 17:27 |
| gfidente | mcornea shardy let me try something | 17:27 |
| *** rhallisey-lunch has quit IRC | 17:28 | |
| bnemec | fultonj: That patch failed the ovb-updates job. | 17:28 |
| mcornea | gfidente: sure | 17:29 |
| shardy | Yeah upgrades are clearly completely broken, we may yet have to revert things so lets hold off laning any huge patches for a moment I think | 17:32 |
| shardy | landing | 17:32 |
| *** tosky has quit IRC | 17:33 | |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud master: Return sysctl_settings as yaml instead of json https://review.openstack.org/479009 | 17:34 |
| *** atheurer has joined #tripleo | 17:36 | |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud master: Return sysctl_settings as yaml instead of json https://review.openstack.org/479009 | 17:37 |
| weshay | arxcruz, fyi https://bugs.launchpad.net/nova/+bug/1694666 | 17:38 |
| openstack | Launchpad bug 1694666 in OpenStack Compute (nova) "metadata service PicklingError: Can't pickle <class 'sqlalchemy.orm.session.Session'> when using memcached" [Medium,In progress] - Assigned to Dan Smith (danms) | 17:38 |
| ccamacho | shardy Ill vote for landing only the fixes ajajaa | 17:39 |
| *** anshul has quit IRC | 17:39 | |
| *** atheurer has quit IRC | 17:43 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Use templated network-environment file for OVB https://review.openstack.org/474781 | 17:44 |
| shardy | mcornea, gfidente: So provided heat has https://review.openstack.org/#/c/419588/ that error should not happen, but https://bugs.launchpad.net/heat/+bug/1700569 could still cause some issues | 17:45 |
| openstack | Launchpad bug 1700569 in heat "Resources depending on conditioned resources are created before the dependencies of the conditioned resources are completed" [Undecided,New] | 17:45 |
| arxcruz | weshay: cool, that's the proof that we must run tempest :) | 17:46 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Remove conditions on _Execution resources https://review.openstack.org/479016 | 17:47 |
| gfidente | shardy so for that error we can eventually remove conditions https://review.openstack.org/#/c/479016/ | 17:47 |
| gfidente | not sure if it is tracked by a bug, nor why mcornea is hitting that given the fix is in heat from a long time now | 17:48 |
| mcornea | shardy: gfidente I confirm that I have the heat patch | 17:48 |
| mcornea | going to try 479016 | 17:48 |
| *** yamahata has quit IRC | 17:48 | |
| gfidente | for the other error, I kept the dependencies in both the conditioned resources and the Deployment_Step resource so that we aren't affected (and left a comment in the code) | 17:48 |
| *** trown|lunch is now known as trown | 17:49 | |
| *** prateek has quit IRC | 17:50 | |
| mcornea | gfidente: moving forward with a new one: Failed to validate: : resources.AllNodesDeploySteps: : Failed to validate: resources.AllNodesPostUpgradeSteps: The specified reference "WorkflowTasks_Step3" (in WorkflowTasks_Step3_Execution.Properties.actions.CREATE.workflow) is incorrect. | 17:51 |
| gfidente | mcornea yeah I have to disable those conditions too, updating | 17:52 |
| openstackgerrit | AndrewToth proposed openstack/tripleo-heat-templates master: Enable Neutron LBaaS Integration https://review.openstack.org/313933 | 17:53 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Remove conditions on _Execution resources https://review.openstack.org/479016 | 17:54 |
| gfidente | mcornea thanks! updated | 17:54 |
| atoth | shardy, just pushed updates for https://review.openstack.org/#/c/313933/, | 17:55 |
| *** jaganathan has joined #tripleo | 17:55 | |
| atoth | EmilienM, ^^ as well | 17:55 |
| gfidente | mcornea let me know how it goes | 17:59 |
| mcornea | gfidente: yep, just launched it | 18:00 |
| *** ansmith has quit IRC | 18:01 | |
| *** flepied has quit IRC | 18:05 | |
| *** cdearborn has joined #tripleo | 18:05 | |
| *** tosky has joined #tripleo | 18:05 | |
| mcornea | gfidente: hm, now I got resources.AllNodesDeploySteps: The specified reference "WorkflowTasks_Step1_Execution" (in CephStorageDeployment_Step1) is incorrect. | 18:10 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 18:10 |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec) | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| mcornea | gfidente: there are no ceph nodes in the deployment | 18:10 |
| *** ckyriakidou has quit IRC | 18:10 | |
| gfidente | mcornea this seems the same error | 18:12 |
| gfidente | sec | 18:12 |
| mcornea | gfidente: yeah, it's the same | 18:13 |
| dmsimard|afk | Slower: thanks for testing out https://review.openstack.org/#/c/478628/2/environments/docker-centos-rdo.yaml | 18:13 |
| dmsimard|afk | cheers | 18:13 |
| *** dmsimard|afk is now known as dmsimard | 18:13 | |
| gfidente | mcornea I mean I suppose there weren't BlockStorage nodes either | 18:14 |
| mcornea | gfidente: no, there aren't. only a controller and a compute | 18:15 |
| *** amoralej is now known as amoralej|off | 18:15 | |
| *** cylopez has joined #tripleo | 18:15 | |
| Slower | dmsimard: testing which? | 18:16 |
| dmsimard | Slower: dprince mentioned you tested containers from the new registry ? | 18:16 |
| *** ansmith has joined #tripleo | 18:16 | |
| Slower | dmsimard: oh ya! it was great ;) | 18:16 |
| Slower | dmsimard: did he point you at the patch we did up? | 18:17 |
| dmsimard | Slower: that's what I linked, yeah ? | 18:17 |
| gfidente | mcornea so I think this is because you got heat into a state from what is different to recover | 18:17 |
| Slower | dmsimard: ya that's part of it | 18:17 |
| gfidente | mcornea and should try an upgrade using a version of the templates which include the changes from the start | 18:18 |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud master: Return sysctl_settings as yaml instead of json https://review.openstack.org/479009 | 18:18 |
| gfidente | not from the initial deployment, but from the initial upgrade attempt | 18:18 |
| openstackgerrit | Sandhya Dasu proposed openstack/tripleo-heat-templates master: cisco nexus: keep OVS on the Compute https://review.openstack.org/476238 | 18:18 |
| *** flepied has joined #tripleo | 18:18 | |
| mcornea | gfidente: ack, makes sense. I'll give it a try tomorrow | 18:18 |
| Slower | dmsimard: https://review.openstack.org/#/c/478628/ | 18:18 |
| *** cdearborn__ has quit IRC | 18:18 | |
| Slower | dmsimard: when is a good time to have another meeting re CI? | 18:19 |
| dmsimard | Slower: I've been head deep in moving tripleo stuff to review.rdo, I've done nothing but that this week | 18:19 |
| dmsimard | I hope to be able to catch up on containers tomorrow at the latest.. | 18:19 |
| Slower | dmsimard: ok, so maybe early next week? | 18:20 |
| *** mcornea has quit IRC | 18:20 | |
| dmsimard | like wednesday perhaps | 18:20 |
| Slower | ok cool | 18:20 |
| *** dsneddon has quit IRC | 18:20 | |
| *** dsneddon has joined #tripleo | 18:20 | |
| gfidente | tty l! | 18:21 |
| *** gfidente is now known as gfidente|afk | 18:21 | |
| *** yamahata has joined #tripleo | 18:23 | |
| *** anshul has joined #tripleo | 18:24 | |
| *** fandrieu has quit IRC | 18:25 | |
| *** anshul has quit IRC | 18:28 | |
| *** anshul has joined #tripleo | 18:28 | |
| *** rhallisey has joined #tripleo | 18:30 | |
| *** janki has quit IRC | 18:30 | |
| *** dprince has quit IRC | 18:32 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Revert "Revert "Blacklist support for ExtraConfig"" https://review.openstack.org/477542 | 18:32 |
| openstackgerrit | Ben Nemec proposed openstack/instack-undercloud stable/newton: Clear any previous environment in stackrc https://review.openstack.org/479033 | 18:40 |
| openstackgerrit | Ben Nemec proposed openstack/instack-undercloud stable/newton: Remove backslash from awk command in stackrc https://review.openstack.org/479034 | 18:40 |
| *** sbrzozow has left #tripleo | 18:41 | |
| *** sbrzozow has joined #tripleo | 18:41 | |
| *** atheurer has joined #tripleo | 18:44 | |
| ansiwen | can someone please +2 this trivial one-line-fix? thanks! https://review.openstack.org/#/c/475779/ | 18:45 |
| ansiwen | it's waiting since one week already | 18:45 |
| *** dprince has joined #tripleo | 18:48 | |
| *** pchavva has quit IRC | 18:49 | |
| *** ebarrera_ has joined #tripleo | 18:54 | |
| openstackgerrit | Dan Prince proposed openstack/puppet-tripleo master: Zaqar: support configurable backends https://review.openstack.org/477554 | 18:55 |
| *** ebarrera_ has quit IRC | 19:00 | |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud master: Return sysctl_settings as yaml instead of json https://review.openstack.org/479009 | 19:00 |
| *** ansmith has quit IRC | 19:05 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 19:10 |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Ben Nemec (bnemec) | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| *** atheurer has quit IRC | 19:11 | |
| *** ansmith has joined #tripleo | 19:19 | |
| *** rhallisey has quit IRC | 19:20 | |
| *** atheurer has joined #tripleo | 19:22 | |
| *** atheurer has quit IRC | 19:23 | |
| *** rhallisey has joined #tripleo | 19:23 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: update bm/ovb jobs to use --environment https://review.openstack.org/478273 | 19:23 |
| *** pchavva has joined #tripleo | 19:28 | |
| * bnemec needs to add a few more resources to OVB stacks so they qualify as "large" | 19:39 | |
| *** dparkes has joined #tripleo | 19:42 | |
| *** atheurer has joined #tripleo | 19:43 | |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud master: Return sysctl_settings as yaml instead of json https://review.openstack.org/479009 | 19:48 |
| *** atheurer has quit IRC | 19:48 | |
| openstackgerrit | John Eckersberg proposed openstack/tripleo-heat-templates master: WIP docker qdr https://review.openstack.org/479049 | 19:51 |
| *** abishop_ has joined #tripleo | 19:55 | |
| openstackgerrit | Merged openstack/tripleo-puppet-elements master: Add ansible-pacemaker to the overcloud image https://review.openstack.org/478815 | 19:55 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Allow depending on changes we dont actually build https://review.openstack.org/453326 | 19:55 |
| *** cschwede has joined #tripleo | 19:56 | |
| *** abishop has quit IRC | 19:58 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Split quickstart-extras.yml into sub-playbooks https://review.openstack.org/475813 | 19:58 |
| *** atheurer has joined #tripleo | 19:58 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations https://review.openstack.org/403576 | 20:01 |
| *** toure is now known as toure|gone | 20:03 | |
| openstackgerrit | John Eckersberg proposed openstack/tripleo-heat-templates master: WIP docker qdr https://review.openstack.org/479049 | 20:03 |
| *** MVenesio has quit IRC | 20:08 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] | 20:10 |
| *** cschwede has quit IRC | 20:10 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add heat parameter for all of config_volume images https://review.openstack.org/476970 | 20:13 |
| *** sbrzozow has quit IRC | 20:15 | |
| *** atheurer has quit IRC | 20:21 | |
| *** ebarrera_ has joined #tripleo | 20:23 | |
| *** asbishop has joined #tripleo | 20:24 | |
| *** ebarrera has quit IRC | 20:25 | |
| *** liverpooler has quit IRC | 20:25 | |
| *** abishop_ has quit IRC | 20:26 | |
| *** atheurer has joined #tripleo | 20:30 | |
| *** ansmith has quit IRC | 20:32 | |
| *** dougbtv__ is now known as dougbtv | 20:32 | |
| openstackgerrit | John Eckersberg proposed openstack/tripleo-heat-templates master: WIP docker qdr https://review.openstack.org/479049 | 20:33 |
| *** jcoufal has quit IRC | 20:34 | |
| *** karimb has joined #tripleo | 20:34 | |
| *** cylopez has left #tripleo | 20:36 | |
| *** cdearborn has quit IRC | 20:38 | |
| *** atheurer has quit IRC | 20:39 | |
| *** jprovazn has quit IRC | 20:41 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: Keep CentOS Ceph repos to be able to install ceph-ansible https://review.openstack.org/478980 | 20:43 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Install ceph-ansible in the undercloud https://review.openstack.org/478986 | 20:43 |
| *** trown is now known as trown|pto | 20:43 | |
| *** dprince has quit IRC | 20:44 | |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-common master: Derive deployment parameters for HCI https://review.openstack.org/471462 | 20:44 |
| *** hamzy has quit IRC | 20:44 | |
| *** pblaho has quit IRC | 20:45 | |
| *** nyechiel has joined #tripleo | 20:47 | |
| *** lblanchard has quit IRC | 20:49 | |
| *** anshul has quit IRC | 20:51 | |
| *** yamahata has quit IRC | 20:56 | |
| *** yamahata has joined #tripleo | 20:57 | |
| *** hewbrocca is now known as hewbrocca_afk | 20:58 | |
| *** nyechiel has quit IRC | 20:59 | |
| *** nyechiel_ has joined #tripleo | 20:59 | |
| openstackgerrit | Ben Nemec proposed openstack/python-tripleoclient master: Revert "Call undercloud install function directly" https://review.openstack.org/479063 | 20:59 |
| bnemec | slagle: ccamacho: ^ | 21:00 |
| bnemec | I'm pretty sure that's what is breaking undercloud upgrades. | 21:00 |
| *** nyechiel_ has quit IRC | 21:02 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/478699 | 21:06 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements https://review.openstack.org/478119 | 21:06 |
| *** iranzo has quit IRC | 21:06 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: Add docker templates to configure Ironic inspector https://review.openstack.org/457822 | 21:08 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 21:10 |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1701362 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec) | 21:10 |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud master: Return sysctl_settings as yaml instead of json https://review.openstack.org/479009 | 21:11 |
| ccamacho | hey bnemec thanks for the update there Ill check it | 21:11 |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud master: Return sysctl_settings as a yaml map instead of json https://review.openstack.org/479009 | 21:12 |
| *** pchavva has quit IRC | 21:12 | |
| bnemec | ccamacho: Yeah, the original patch failed on the same error we've been looking at. | 21:12 |
| bnemec | We need to make the undercloud-upgrades job voting. | 21:13 |
| ccamacho | right there | 21:13 |
| bnemec | ccamacho: I don't think we need that patch anymore. It actually works fine as json as long as the value is populated. | 21:13 |
| bnemec | The problem is it's getting set to None on upgrade because of the old instack-undercloud module. | 21:13 |
| ccamacho | bnemec ack thanks man | 21:14 |
| *** asbishop has quit IRC | 21:15 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Remove centos and rhel elements https://review.openstack.org/478344 | 21:16 |
| openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud master: Return sysctl_settings as a yaml map instead of json https://review.openstack.org/479009 | 21:17 |
| * ccamacho going to sleep.. ZzZz | 21:17 | |
| ccamacho | sy tomorrow | 21:17 |
| *** f13o has joined #tripleo | 21:21 | |
| *** paramite has joined #tripleo | 21:22 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Use the dib python to do cleanup https://review.openstack.org/476302 | 21:22 |
| *** pchavva has joined #tripleo | 21:25 | |
| stevebaker | morning | 21:26 |
| Slower | stevebaker: ! | 21:27 |
| *** akrivoka has quit IRC | 21:27 | |
| stevebaker | Slower: howdy | 21:28 |
| Slower | stevebaker: we didn't duplicate your work with prepare command I hope? | 21:28 |
| * Slower needs to look | 21:28 | |
| Slower | looks like the config it generates is slightly different? | 21:29 |
| *** pradk has quit IRC | 21:33 | |
| *** ecerquei has quit IRC | 21:34 | |
| stevebaker | Slower: I think its ok to have manually maintained env files while we handle the transition to removing DockerNamespace, but I'm hoping we can replace those with 'prepare' generated files rather than maintaining them manually in tht | 21:34 |
| Slower | stevebaker: totally agree | 21:34 |
| bnemec | Merged openstack/diskimage-builder master: Remove centos and rhel elements https://review.openstack.org/478344 | 21:35 |
| bnemec | I am both pleased and terrified by this change. | 21:35 |
| Slower | stevebaker: the first step is to get CI to use this guy: https://review.openstack.org/#/c/478625/ | 21:35 |
| Slower | stevebaker: ah I see you commented already | 21:35 |
| Slower | stevebaker: yeah that's a transition step for CI | 21:35 |
| bnemec | I hate maintaining those untested distros, but on the other hand people are actually using them.... | 21:35 |
| Slower | stevebaker: then we get the Namespace patch in, then your prepare command | 21:35 |
| Slower | then we update quickstart | 21:36 |
| Slower | then CI can start consuming it | 21:36 |
| Slower | or maybe the other way around | 21:36 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Fix 1ctlr deployment. https://review.openstack.org/471835 | 21:36 |
| Slower | mostly it's a bunch of trickery to keep CI up | 21:37 |
| *** morazi has quit IRC | 21:37 | |
| *** athomas has quit IRC | 21:38 | |
| Slower | hmm | 21:38 |
| stevebaker | Slower: as long as all the CI things do -e docker-centos-tripleoupstream.yaml then we should be in a good position to transition without breakage | 21:38 |
| Slower | right | 21:39 |
| Slower | is that the -e we want though? | 21:39 |
| Slower | like.. we're going to move to RDO soon I hope | 21:39 |
| Slower | maybe we just call it docker-containers.yaml? | 21:39 |
| *** jaganathan has quit IRC | 21:39 | |
| Slower | and get it generating for tripleoupstream or RDO depending where we're at at the time | 21:40 |
| *** dsariel has joined #tripleo | 21:40 | |
| stevebaker | Slower: maybe what CI should do is copy environments/{whatever}.yaml locally and -e that. Then later the copy can be replaced with a call to prepare | 21:40 |
| Slower | ya that could work | 21:41 |
| Slower | I have a meeting with wes on wednesday, we'll figure it out | 21:41 |
| Slower | or I'll bug him on irc :) | 21:41 |
| stevebaker | Slower: actually | 21:41 |
| stevebaker | Slower: that file already exists, its {{ working_dir }}/containers-default-parameters.yaml | 21:42 |
| stevebaker | Slower: see https://review.openstack.org/#/c/475975/2/roles/overcloud-prep-containers/templates/overcloud-prep-containers.sh.j2 | 21:42 |
| *** paramite has quit IRC | 21:43 | |
| Slower | stevebaker: hmm | 21:44 |
| Slower | stevebaker: that's good | 21:46 |
| *** ansmith has joined #tripleo | 21:46 | |
| openstackgerrit | Ben Nemec proposed openstack/instack-undercloud master: Add pre-upgrade entrypoint https://review.openstack.org/479081 | 21:47 |
| openstackgerrit | Ben Nemec proposed openstack/python-tripleoclient master: Call undercloud pre-upgrade hook https://review.openstack.org/479082 | 21:47 |
| Slower | stevebaker: so we submit a patch for overcloud_containers.yaml for now that's empty.. CI starts using it in quickstart.. the namespace patch can happen any time I guess, your patch can happen anytime too so long as quickstart runs it before launch | 21:51 |
| stevebaker | Slower: yes | 21:52 |
| *** f13o has quit IRC | 21:53 | |
| *** zaneb has quit IRC | 21:56 | |
| *** sshnaidm has joined #tripleo | 21:56 | |
| *** sshnaidm is now known as sshnaidm|off | 21:57 | |
| Slower | stevebaker: ok I'll update that patch to rename that file then | 21:59 |
| Slower | unless you already have that | 22:00 |
| stevebaker | Slower: go for it | 22:02 |
| *** bfournie has quit IRC | 22:04 | |
| *** shardy has quit IRC | 22:09 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1701362 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] | 22:10 |
| openstack | Launchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec) | 22:10 |
| *** pchavva has quit IRC | 22:13 | |
| *** cdearborn has joined #tripleo | 22:23 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Adds network/cidr mapping into a new service property https://review.openstack.org/476602 | 22:33 |
| *** gfidente|afk has quit IRC | 22:35 | |
| *** cdearborn has quit IRC | 22:40 | |
| *** tosky has quit IRC | 22:45 | |
| *** chem has quit IRC | 23:01 | |
| *** ebarrera_ has quit IRC | 23:01 | |
| *** bfournie has joined #tripleo | 23:05 | |
| *** atheurer has joined #tripleo | 23:08 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 23:10 |
| openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1701362 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1701362 in tripleo "undercloud-upgrade from O->P broken" [Critical,In progress] - Assigned to Ben Nemec (bnemec) | 23:10 |
| *** chem has joined #tripleo | 23:14 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Use templated network-environment file for OVB https://review.openstack.org/474781 | 23:19 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Use templated network-environment file for OVB https://review.openstack.org/474781 | 23:19 |
| *** tobias-fiberdata has joined #tripleo | 23:20 | |
| *** tobias_fiberdata has quit IRC | 23:23 | |
| *** hexo has quit IRC | 23:26 | |
| *** hexo_ has joined #tripleo | 23:41 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
