| EmilienM | ovsdbapp==0.8.0 | 00:00 |
|---|---|---|
| EmilienM | http://logs.openstack.org/72/522872/1/gate/legacy-tempest-dsvm-neutron-full/b54c59a/logs/pip2-freeze.txt.gz | 00:00 |
| *** pradk has quit IRC | 00:00 | |
| ihrachys | EmilienM, how come? resources are stretched. | 00:01 |
| EmilienM | ok so it works in devstack | 00:01 |
| *** pradk_ has quit IRC | 00:01 | |
| EmilienM | ihrachys: we could run at least one | 00:01 |
| mwhahaha | i assume it's a service startup thing but i have no idea what services are out of order | 00:01 |
| EmilienM | mwhahaha: I checked the timestamps and it looks good | 00:02 |
| EmilienM | mwhahaha: agents started after neutron-server container | 00:04 |
| mwhahaha | yea but what is triggering the first not-connected error | 00:04 |
| mwhahaha | because it works sometimes | 00:04 |
| mwhahaha | so it's a race of something | 00:04 |
| ihrachys | EmilienM, yeah it works of course. there is something in deployment code. | 00:04 |
| ihrachys | I am sending the email to my team with relevant folks in to / cc (you too) | 00:05 |
| ihrachys | ok sent | 00:06 |
| mwhahaha | so in def stack the agents don't get starrted at teh same time as the service | 00:06 |
| mwhahaha | they start 10mins later | 00:06 |
| EmilienM | it makes me think about... | 00:06 |
| ihrachys | I will need to bail out. if for some reason you don't get help before I am back tomorrow in the morning, please ping me again. though I would think you should have some more eyes looking at it tomorrow morning. | 00:06 |
| EmilienM | https://review.openstack.org/#/c/522872/ | 00:07 |
| EmilienM | but probably unrelated | 00:07 |
| EmilienM | ihrachys: thx | 00:07 |
| ihrachys | mwhahaha, in theory it should work either way but there is always place for a bug | 00:07 |
| EmilienM | mwhahaha: see the commit message | 00:07 |
| mwhahaha | ihrachys: yea it should but it doesn't seem to be :) we'll see what falls out | 00:07 |
| EmilienM | it sounds related | 00:07 |
| EmilienM | maybe we could force a sleep | 00:07 |
| EmilienM | lol | 00:07 |
| ihrachys | EmilienM, that's for high loaded fullstack environment. that being said, I asked Jakub why we get it so slow and he was not sure, assuming it's just parallelism of tests | 00:07 |
| mwhahaha | sleep driven development | 00:07 |
| EmilienM | probably time to leave as well | 00:08 |
| EmilienM | ihrachys: our jobs are pretty highly loaded | 00:08 |
| mwhahaha | but adding a sleep is not ok | 00:08 |
| mwhahaha | anyway we'll see | 00:08 |
| ihrachys | ok let me drop it into the thread just in case someone has a eureka moment | 00:08 |
| EmilienM | ihrachys: thx for your email, it's excellent | 00:09 |
| mwhahaha | oh no it's not 10 mins, they start 4 seconds | 00:09 |
| mwhahaha | stupid time format | 00:09 |
| mwhahaha | so in dev stack they start at the same time like we have with containers now | 00:09 |
| EmilienM | mwhahaha: well, that's what they do in their functional tests https://review.openstack.org/#/c/522872/1/neutron/tests/fullstack/resources/environment.py | 00:09 |
| mwhahaha | right so we'd have to wait for the deploy to settle before running tempest | 00:10 |
| mwhahaha | though we do run tempest like 5 mins later | 00:10 |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 00:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 00:10 |
| EmilienM | very true | 00:10 |
| mwhahaha | at least 5 mins later because it's step3 when we start neutron | 00:10 |
| ihrachys | ok I really need to go. sorry for the situation, we'll try to help. | 00:11 |
| ihrachys | ciao | 00:11 |
| *** ihrachys has quit IRC | 00:11 | |
| EmilienM | sure no worries | 00:11 |
| *** aputtur_ has joined #tripleo | 00:26 | |
| openstackgerrit | James E. Blair proposed openstack-infra/tripleo-ci master: Zuul: add file extension to playbook path https://review.openstack.org/523611 | 00:30 |
| *** Goneri has quit IRC | 00:34 | |
| *** zshi has joined #tripleo | 00:35 | |
| openstackgerrit | James E. Blair proposed openstack-infra/tripleo-ci master: Zuul: add file extension to playbook path https://review.openstack.org/523611 | 00:40 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Use qemu-img in bindep https://review.openstack.org/523285 | 00:41 |
| *** liverpooler has quit IRC | 00:42 | |
| *** liverpooler has joined #tripleo | 00:42 | |
| *** dmacpher-afk has quit IRC | 00:45 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: DNM: Test to see if this fixes gnocchi upgrade scenario001 failure https://review.openstack.org/523632 | 00:49 |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient stable/pike: Use qemu-img in bindep https://review.openstack.org/523635 | 00:56 |
| *** moshele has quit IRC | 00:59 | |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Render NIC config templates with jinja2 https://review.openstack.org/523638 | 01:03 |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 01:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 01:10 |
| *** gbarros has joined #tripleo | 01:14 | |
| *** qwebirc46570 has joined #tripleo | 01:17 | |
| openstackgerrit | Tony Breeds proposed openstack/tripleo-heat-templates master: Add ComputeAlt role and environment https://review.openstack.org/523547 | 01:17 |
| *** Tripleo-user has joined #tripleo | 01:18 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: Fix SSL certs creation for ipv6 https://review.openstack.org/523477 | 01:20 |
| openstackgerrit | Tony Breeds proposed openstack/tripleo-heat-templates master: Add ComputeAlt role and environment https://review.openstack.org/523547 | 01:22 |
| *** dparkes has quit IRC | 01:23 | |
| *** Lokesh_Jain__ has quit IRC | 01:23 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: include nova::compute::pci in compute.pp https://review.openstack.org/521232 | 01:27 |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Add exclude list to not override user data https://review.openstack.org/523398 | 01:27 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove hardcoded skydive container image https://review.openstack.org/518095 | 01:43 |
| *** zshi has quit IRC | 01:55 | |
| *** hamzy has joined #tripleo | 02:03 | |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient stable/ocata: Use qemu-img in bindep https://review.openstack.org/523651 | 02:05 |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient stable/newton: Use qemu-img in bindep https://review.openstack.org/523652 | 02:05 |
| *** qwebirc46570 has quit IRC | 02:05 | |
| *** dmacpher has joined #tripleo | 02:07 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 02:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 02:10 |
| *** Tripleo-user has quit IRC | 02:11 | |
| openstackgerrit | Tony Breeds proposed openstack/tripleo-heat-templates master: Add ComputeAlt role and environment https://review.openstack.org/523547 | 02:29 |
| *** daidv has joined #tripleo | 02:33 | |
| *** fzdarsky_ has joined #tripleo | 02:40 | |
| *** fzdarsky|afk has quit IRC | 02:42 | |
| openstackgerrit | Tony Breeds proposed openstack/tripleo-heat-templates master: Add ComputeAlt role and environment https://review.openstack.org/523547 | 02:45 |
| *** gbarros has quit IRC | 02:47 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add ui_validate_simple to the logs collected https://review.openstack.org/523461 | 02:54 |
| *** yamahata has quit IRC | 03:02 | |
| *** threestrands has joined #tripleo | 03:05 | |
| *** threestrands has quit IRC | 03:05 | |
| *** threestrands has joined #tripleo | 03:05 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 03:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 03:10 |
| *** gvrangan has joined #tripleo | 03:23 | |
| openstackgerrit | Tony Breeds proposed openstack/tripleo-heat-templates master: Add ComputeAlt role and environment https://review.openstack.org/523547 | 03:28 |
| *** psahoo has joined #tripleo | 03:31 | |
| *** ramishra has joined #tripleo | 03:31 | |
| *** links has joined #tripleo | 03:42 | |
| *** gvrangan has quit IRC | 03:42 | |
| *** mdnadeem has joined #tripleo | 04:00 | |
| *** zshi has joined #tripleo | 04:02 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 04:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 04:10 |
| *** fragatina has quit IRC | 04:11 | |
| *** fragatina has joined #tripleo | 04:12 | |
| *** stevebaker has quit IRC | 04:12 | |
| *** dmellado has quit IRC | 04:13 | |
| *** stevebaker has joined #tripleo | 04:13 | |
| *** fragatin_ has joined #tripleo | 04:14 | |
| *** dmellado has joined #tripleo | 04:15 | |
| *** fragatina has quit IRC | 04:16 | |
| *** shreshtha_ has joined #tripleo | 04:17 | |
| *** d0ugal has quit IRC | 04:18 | |
| *** ykarel|away has joined #tripleo | 04:18 | |
| *** fragatin_ has quit IRC | 04:19 | |
| *** ykarel_ has joined #tripleo | 04:20 | |
| *** rlandy|rover has quit IRC | 04:22 | |
| *** ykarel|away has quit IRC | 04:23 | |
| *** gkadam_ has joined #tripleo | 04:23 | |
| *** dbecker has quit IRC | 04:24 | |
| *** d0ugal has joined #tripleo | 04:26 | |
| *** threestrands has quit IRC | 04:29 | |
| *** janki has joined #tripleo | 04:33 | |
| *** dbecker has joined #tripleo | 04:36 | |
| *** ykarel_ has quit IRC | 04:36 | |
| *** ykarel_ has joined #tripleo | 04:38 | |
| *** dpawar has joined #tripleo | 04:38 | |
| *** threestrands has joined #tripleo | 04:41 | |
| *** threestrands has quit IRC | 04:41 | |
| *** threestrands has joined #tripleo | 04:41 | |
| *** pgadiya has joined #tripleo | 04:43 | |
| *** pgadiya has quit IRC | 04:45 | |
| *** fragatina has joined #tripleo | 04:47 | |
| *** fragatina has quit IRC | 04:48 | |
| *** fragatina has joined #tripleo | 04:48 | |
| *** ratailor has joined #tripleo | 05:03 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 05:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 05:10 |
| *** janki has quit IRC | 05:23 | |
| *** jaganathan has joined #tripleo | 05:26 | |
| *** threestrands has quit IRC | 05:32 | |
| *** nyechiel has joined #tripleo | 05:34 | |
| *** zshi has quit IRC | 05:36 | |
| Tengu | hello there :) | 05:40 |
| bandini | mwhahaha: the end up in /var/log/pacemaker/bundles/rabbitmq-bundle-0/ | 05:40 |
| bandini | *they | 05:41 |
| *** psahoo has quit IRC | 05:46 | |
| *** psahoo has joined #tripleo | 05:50 | |
| *** marios has joined #tripleo | 05:58 | |
| *** akane has joined #tripleo | 06:01 | |
| *** akane_ has joined #tripleo | 06:01 | |
| Tengu | jbadiapa: uhu, apparently my epel stuff isn't dead :D | 06:05 |
| Tengu | hello bandini | 06:05 |
| *** cshastri has joined #tripleo | 06:06 | |
| *** yamahata has joined #tripleo | 06:09 | |
| jaosorior | good morning folks! | 06:09 |
| bandini | morning jaosorior Tengu & * | 06:09 |
| Tengu | hello jaosorior :) | 06:09 |
| jaosorior | bandini: the morning goes to the background and then glob? | 06:10 |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 06:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 06:10 |
| *** udesale has joined #tripleo | 06:10 | |
| Tengu | jaosorior: XD was about to say something like that XD | 06:10 |
| jaosorior | :P | 06:10 |
| bandini | jaosorior: lol | 06:10 |
| *** jfrancoa has joined #tripleo | 06:12 | |
| *** janki has joined #tripleo | 06:18 | |
| *** masco has joined #tripleo | 06:19 | |
| *** abregman has joined #tripleo | 06:23 | |
| jbadiapa | Tengu, it seems so, We will see what EmilienM has to say | 06:29 |
| Tengu | jbadiapa: yup :). It's a nice "case" | 06:30 |
| jbadiapa | jaosorior, could you take another look at https://review.openstack.org/#/c/500935/? | 06:31 |
| *** marios has quit IRC | 06:31 | |
| jaosorior | jbadiapa: will do | 06:32 |
| *** marios has joined #tripleo | 06:32 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: DNM: Test gate. https://review.openstack.org/523700 | 06:39 |
| Tengu | jbadiapa: added a small remark/comment on the fluentd patch | 06:44 |
| jbadiapa | Tengu, thx | 06:44 |
| *** jtomasek has joined #tripleo | 06:46 | |
| *** skramaja has joined #tripleo | 06:48 | |
| *** tvignaud has quit IRC | 06:48 | |
| openstackgerrit | Merged openstack/python-tripleoclient stable/newton: Use qemu-img in bindep https://review.openstack.org/523652 | 06:48 |
| openstackgerrit | Merged openstack/python-tripleoclient stable/ocata: Use qemu-img in bindep https://review.openstack.org/523651 | 06:48 |
| openstackgerrit | Juan Badia Payno proposed openstack/puppet-tripleo master: logging: support service_config_settings configuration mechanism https://review.openstack.org/500935 | 06:49 |
| *** dmacpher has quit IRC | 06:53 | |
| *** nyechiel has quit IRC | 06:55 | |
| openstackgerrit | Merged openstack/python-tripleoclient stable/pike: Use qemu-img in bindep https://review.openstack.org/523635 | 06:57 |
| *** gkadam_ has quit IRC | 06:58 | |
| *** agurenko has joined #tripleo | 06:58 | |
| *** anilvenkata has joined #tripleo | 07:04 | |
| *** tvignaud has joined #tripleo | 07:05 | |
| *** abregman has quit IRC | 07:07 | |
| *** pmannidi has quit IRC | 07:07 | |
| *** sai_ has quit IRC | 07:08 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 07:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 07:10 |
| *** dparkes has joined #tripleo | 07:10 | |
| *** iranzo has joined #tripleo | 07:11 | |
| *** gfidente has joined #tripleo | 07:11 | |
| *** moshele has joined #tripleo | 07:13 | |
| *** cylopez has joined #tripleo | 07:22 | |
| *** dsariel has joined #tripleo | 07:26 | |
| moshele | janki: hi can you review the odl changes https://review.openstack.org/#/c/518715/ and https://review.openstack.org/#/c/518712/ ? | 07:26 |
| janki | moshele, looking | 07:27 |
| *** psahoo has quit IRC | 07:28 | |
| *** psahoo has joined #tripleo | 07:31 | |
| *** jaosorior has quit IRC | 07:33 | |
| *** iranzo has quit IRC | 07:34 | |
| *** jaosorior has joined #tripleo | 07:35 | |
| *** iranzo has joined #tripleo | 07:36 | |
| *** oidgar has joined #tripleo | 07:43 | |
| *** rcernin has quit IRC | 07:43 | |
| *** cylopez has quit IRC | 07:44 | |
| *** ykarel_ is now known as ykarel|lunch | 07:49 | |
| *** florianf|afk is now known as florianf | 07:52 | |
| jaosorior | bandini: does the puppet code for pacemaker resources delete resources that are not in the resource catalog? | 07:53 |
| *** dpawar has quit IRC | 07:54 | |
| *** shardy has joined #tripleo | 07:56 | |
| *** holser has joined #tripleo | 07:56 | |
| *** oidgar has quit IRC | 07:56 | |
| *** sshnaidm|off is now known as sshnaidm | 07:57 | |
| sshnaidm | do you know if PublicVirtualFixedIPs should work for ipv6 too? | 07:57 |
| jaosorior | sshnaidm: it should. It currently doesn't cause this is missing https://review.openstack.org/#/c/522714/ | 07:58 |
| jaosorior | sshnaidm: if it doesn't work then it's a bug | 07:58 |
| *** yprokule has joined #tripleo | 07:59 | |
| sshnaidm | jaosorior, I tried in my patch, and it seems not working..maybe I miss something: http://logs.openstack.org/18/522618/13/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq-ipv6/34ca203/job-output.txt.gz#_2017-11-29_02_24_25_527142 | 08:00 |
| sshnaidm | jaosorior, oc endpoint has different address: http://logs.openstack.org/18/522618/13/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq-ipv6/34ca203/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-11-29_03_37_12 | 08:00 |
| sshnaidm | jaosorior, oh, no.. this templates isn't included | 08:02 |
| sshnaidm | arghh | 08:02 |
| *** stendulker has joined #tripleo | 08:04 | |
| *** pcaruana has joined #tripleo | 08:04 | |
| *** suuuper has joined #tripleo | 08:05 | |
| *** aufi has joined #tripleo | 08:07 | |
| jaosorior | well, that explains | 08:09 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 08:10 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Introduce fs035, ovb-ha-ipv6 https://review.openstack.org/522615 | 08:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 08:10 |
| *** ebarrera has joined #tripleo | 08:11 | |
| *** sshnaidm is now known as sshnaidm|afk | 08:11 | |
| *** ccamacho has joined #tripleo | 08:12 | |
| *** abregman_ has joined #tripleo | 08:13 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-docs master: Add composable networks documentation https://review.openstack.org/521493 | 08:15 |
| *** jpich has joined #tripleo | 08:17 | |
| *** dpawar has joined #tripleo | 08:18 | |
| *** gfidente has quit IRC | 08:21 | |
| *** chkumar|404 is now known as chandankumar | 08:22 | |
| *** gkadam_ has joined #tripleo | 08:22 | |
| *** gfidente has joined #tripleo | 08:23 | |
| bandini | jaosorior: no it does not touch them | 08:25 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Revert "Set file mode permission for Ceph keyrings in containers" https://review.openstack.org/523709 | 08:26 |
| *** bogdando has joined #tripleo | 08:28 | |
| *** ebarrera has quit IRC | 08:28 | |
| *** ebarrera has joined #tripleo | 08:29 | |
| *** nyechiel has joined #tripleo | 08:29 | |
| jaosorior | bandini: cool cool | 08:29 |
| *** dsneddon has quit IRC | 08:31 | |
| *** amoralej|off is now known as amoralej | 08:35 | |
| *** ykarel|lunch is now known as ykarel | 08:35 | |
| *** ffiore has joined #tripleo | 08:36 | |
| *** matbu has quit IRC | 08:36 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: DNM: Test gate. https://review.openstack.org/523700 | 08:37 |
| arxcruz | jaosorior: hey, by any chance, do you know if I make a dummy patch on THT or oooq that depends on a patch in openstack/ovsdbapp for example that still in review, will the rpm be generated? | 08:38 |
| *** matbu has joined #tripleo | 08:38 | |
| *** rcernin has joined #tripleo | 08:40 | |
| *** kristaps_ is now known as lvdombrkr | 08:40 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Aodh] https://review.openstack.org/516616 | 08:42 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Manila] https://review.openstack.org/517325 | 08:43 |
| jaosorior | arxcruz: I think it does. | 08:43 |
| arxcruz | dalvarez: ^ | 08:44 |
| marios | jfrancoa: o/ hey man do you wana add all the cherrypicked from ^^^ to those? | 08:44 |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-quickstart-extras master: DNM: Testing ovsdbapp patch https://review.openstack.org/523712 | 08:45 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Ovn] https://review.openstack.org/517326 | 08:45 |
| gfidente | bandini | 08:46 |
| gfidente | I have been pointed to an enviroment upgrading from o>p | 08:46 |
| gfidente | with custom roles | 08:46 |
| gfidente | where the upgrade fails because the three cluster nodes don't see each other | 08:47 |
| gfidente | in corosync.conf it looks like the hostnames are wrong | 08:47 |
| gfidente | there I see stuff like controller-0 vs overcloud-controller-0 | 08:47 |
| gfidente | is this known thing? | 08:47 |
| *** jpena|off is now known as jpena | 08:48 | |
| jfrancoa | marios: ok, I'll do it. I cherry picked it via gerrit and it didn't add it to the commit message | 08:49 |
| marios | jfrancoa: ack i updated 3 of them but -1 the rest at https://etherpad.openstack.org/p/validation-steps-pike | 08:49 |
| bandini | gfidente: no. but if the hostnames do change in the upgrade then things will break | 08:49 |
| marios | jfrancoa: yeah it adds it when you cherrypick after master merged. if you do it before you have to add it yourself from the master commit | 08:50 |
| jfrancoa | marios: ok...so that's the reason why it was not added. I'll take care of it, thanks for doing those 3 | 08:50 |
| *** aditya_r has joined #tripleo | 08:50 | |
| gfidente | bandini ah that's interesting, I am not sure why they would change though | 08:50 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: DNM: debug gnocchi-upgrade https://review.openstack.org/523715 | 08:51 |
| *** oidgar has joined #tripleo | 08:52 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements https://review.openstack.org/523728 | 08:56 |
| *** akrivoka has joined #tripleo | 09:02 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Mixed-2] https://review.openstack.org/517328 | 09:03 |
| *** spectr has joined #tripleo | 09:03 | |
| *** fzdarsky_ is now known as fzdarsky | 09:03 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Neutron] https://review.openstack.org/516612 | 09:04 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Gnocchi] https://review.openstack.org/516617 | 09:06 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Mistral] https://review.openstack.org/516618 | 09:07 |
| *** zshi has joined #tripleo | 09:07 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Mixed-3] https://review.openstack.org/517329 | 09:08 |
| *** agurenko has quit IRC | 09:09 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Nova] https://review.openstack.org/516628 | 09:10 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 09:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 09:10 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Ironic] https://review.openstack.org/517265 | 09:11 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Sahara] https://review.openstack.org/517267 | 09:11 |
| *** agurenko has joined #tripleo | 09:12 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-collect-config master: Updated from global requirements https://review.openstack.org/520473 | 09:13 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Octavia] https://review.openstack.org/517266 | 09:14 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Ceilometer] https://review.openstack.org/513335 | 09:15 |
| *** nyechiel has quit IRC | 09:19 | |
| openstackgerrit | Merged openstack/tripleo-docs master: Document deployment with Ansible and config-download https://review.openstack.org/523603 | 09:21 |
| sri_ | Hi , did anyone tried Service subnets in pike ? | 09:22 |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates master: Implements management of `/etc/login.defs` https://review.openstack.org/457985 | 09:23 |
| openstackgerrit | Thomas Herve proposed openstack/tripleo-common master: Consume resource-registry in ProcessTemplatesAction https://review.openstack.org/523802 | 09:24 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/519189 | 09:24 |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-quickstart master: Enable OVN HA profile in fset28 https://review.openstack.org/523804 | 09:24 |
| *** lucas-afk is now known as lucasagomes | 09:25 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-validations master: Updated from global requirements https://review.openstack.org/523807 | 09:25 |
| *** dtantsur|afk is now known as dtantsur | 09:26 | |
| *** cylopez has joined #tripleo | 09:28 | |
| jaosorior | florianf, mandre: Could you check this out https://review.openstack.org/#/c/521731/ ? | 09:29 |
| *** etingof has quit IRC | 09:29 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Mixed-1] https://review.openstack.org/516627 | 09:29 |
| jaosorior | or whoever wants to do tripleo-validation reviews | 09:29 |
| *** moshele has quit IRC | 09:31 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [Heat] https://review.openstack.org/516613 | 09:32 |
| florianf | jaosorior: lgtm | 09:34 |
| jaosorior | florianf: thanks! | 09:37 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: DNM: debug gnocchi-upgrade https://review.openstack.org/523715 | 09:38 |
| *** mcornea has joined #tripleo | 09:40 | |
| *** sonali8555 has joined #tripleo | 09:40 | |
| *** aditya_r has quit IRC | 09:41 | |
| *** salmankhan has joined #tripleo | 09:42 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Catch zaqar exception when no message to claim https://review.openstack.org/523500 | 09:42 |
| *** suuuper1 has joined #tripleo | 09:42 | |
| *** fzdarsky has quit IRC | 09:43 | |
| *** derekh has joined #tripleo | 09:43 | |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates master: Implements AIDE Intrusion Detection System https://review.openstack.org/483028 | 09:43 |
| *** suuuper has quit IRC | 09:43 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates stable/pike: Select first node as bootstrap node not using name https://review.openstack.org/523822 | 09:45 |
| *** salmankhan has quit IRC | 09:46 | |
| sonali8555 | hi all | 09:47 |
| sonali8555 | i have deployed openstack with 3 controller | 09:48 |
| *** fzdarsky has joined #tripleo | 09:48 | |
| flaper87 | jistr: https://review.openstack.org/#/c/523824/ <- this should fix my networking issue from yday. We'll see | 09:48 |
| *** gfidente has quit IRC | 09:48 | |
| sonali8555 | but now after firing # openstack overcloud profiles list | 09:48 |
| flaper87 | erm s/OUTPUT/INPUT/ | 09:49 |
| *** etingof has joined #tripleo | 09:49 | |
| sonali8555 | not able to see any profiles which i have set for all nodes | 09:49 |
| sonali8555 | is anybody knows how to set it back | 09:50 |
| sonali8555 | ? | 09:50 |
| sri_ | sonali8555: what is output off, openstack overcloud profiles list | 09:51 |
| sonali8555 | nothing | 09:51 |
| sri_ | did you tag the node's with profile | 09:51 |
| sonali8555 | not its not returning | 09:51 |
| sonali8555 | yes i didi | 09:51 |
| *** gfidente has joined #tripleo | 09:51 | |
| *** gfidente has quit IRC | 09:51 | |
| *** gfidente has joined #tripleo | 09:51 | |
| sonali8555 | before it was showing | 09:51 |
| bogdando | jistr, shardy: o/ PTAL https://review.openstack.org/#/c/516894/ latest comments | 09:52 |
| sonali8555 | sr1_ : after time openstack overcloud deploy --templates -r /home/stack/packages/packages/beta/roles_data.yaml -e /home/stack/packages/packages/beta/os_config.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/veritas-hyperscale/veritas-hyperscale-config.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/veritas-hyperscale/cinder-veritas-hyperscale-config.yaml --validation-errors 2>&1 | tee deploy.log1vim /home/stack/pac | 09:52 |
| sonali8555 | kages/packages/beta/os_config.yaml | 09:52 |
| sonali8555 | this cmd | 09:52 |
| bogdando | I think I found the root cause of failures, and need some help with composable networks dances | 09:52 |
| sonali8555 | im facing this profile issue | 09:52 |
| *** fzdarsky has quit IRC | 09:54 | |
| sonali8555 | <sri_>: is there any way to get back all the profiles | 09:54 |
| sri_ | hhmm, are you saying after you deploy your overcloud all nodes lose the profiles ? | 09:54 |
| sonali8555 | yes right | 09:54 |
| sonali8555 | was geeting foolowing error on consol | 09:55 |
| sri_ | do you have any custom roles ? | 09:55 |
| sonali8555 | Waiting for messages on queue '2a8d6c23-76ed-4a43-9608-c05c36333193' with no timeout. | 09:55 |
| sonali8555 | Configuration has 2 errors, fix them before proceeding. Ignoring these errors is likely to lead to a failed deploy. | 09:55 |
| sonali8555 | The environment is not a valid YAML mapping data type. | 09:55 |
| sonali8555 | Started Mistral Workflow tripleo.validations.v1.check_pre_deployment_validations. Execution ID: eb9d5133-f542-4406-900b-741e3d03101a | 09:55 |
| sonali8555 | {u'errors': [u'Error: There are no nodes in an available or active state and with maintenance mode off.'], u'warnings': []} | 09:55 |
| sonali8555 | ERRORS | 09:55 |
| sonali8555 | [u'Error: There are no nodes in an available or active state and with maintenance mode off.', u'Error: There are no nodes in an available or active state and with maintenance mode off.'] | 09:55 |
| sonali8555 | Removing the current plan files | 09:55 |
| sonali8555 | Uploading new plan files | 09:55 |
| sonali8555 | Started Mistral Workflow tripleo.plan_management.v1.update_deployment_plan. Execution ID: 89cf8dfa-e33d-4f64-8dc0-bcf5634a3860 | 09:55 |
| sonali8555 | Plan updated. | 09:55 |
| sonali8555 | Processing templates in the directory /tmp/tripleoclient-cxGRHk/tripleo-heat-templates | 09:55 |
| sonali8555 | real 0m59.652s | 09:55 |
| sonali8555 | user 0m2.184s | 09:55 |
| sonali8555 | sys 0m0.366s | 09:55 |
| sonali8555 | <sri_> yes i do have constum roles | 09:55 |
| sri_ | sonali8555, can you use http://paste.openstack.org/ to show your configuration | 09:56 |
| jistr | flaper87: interesting :) if i get some time i'll circle back to the iptables you posted yday and try to parse why this is needed :D | 09:56 |
| sonali8555 | sri_ : which configuration ? | 09:56 |
| flaper87 | jistr: that's set by zuul | 09:56 |
| flaper87 | jistr: it's the default. In the VM created Zuul drops everything but port 22/80 and a few others | 09:57 |
| flaper87 | the calico rules are created after that one and they basically never run | 09:57 |
| jistr | flaper87: ah ok. Yea i can see how that broke the world. Nice catch. | 09:57 |
| sri_ | sonali8555, general . custom roles , deploy command ,errorss | 09:58 |
| flaper87 | jistr: bogdando it'd be interesting to be able to tell kubespray to create the rules above that one but *shrugs* | 09:58 |
| flaper87 | slagle: thanks for the review on the Openshift patch :) | 09:58 |
| sonali8555 | sri_ hi please fine the attachement http://paste.openstack.org/show/627682/ | 10:01 |
| amoralej | gfidente, it seems we are having problems deploying ceph with ceph-ansible in periodic job | 10:01 |
| amoralej | i've created https://bugs.launchpad.net/tripleo/+bug/1735139 | 10:01 |
| openstack | Launchpad bug 1735139 in tripleo "Error when deploying ceph in overcloud with containers using ceph-ansible" [Undecided,New] | 10:01 |
| sri_ | sonali8555: what is the state of vms before you run overcloud deploy ? | 10:04 |
| sonali8555 | sri_ they all were running active state | 10:05 |
| *** hewbrocca_afk is now known as hewbrocca | 10:06 | |
| sri_ | hhmm, they are all suppose to be in power off state ? , are you new to tripleo ? | 10:07 |
| sonali8555 | sri_ what could be the reason for "openstack overcloud profiles list " that its not showing its current profiles ? | 10:07 |
| *** cylopez1 has joined #tripleo | 10:07 | |
| sonali8555 | yes i'm new to tripleo | 10:08 |
| sri_ | those are baremetal nodes ? | 10:08 |
| sonali8555 | yes | 10:08 |
| *** cylopez has quit IRC | 10:08 | |
| sri_ | with IPMI support ? | 10:09 |
| sonali8555 | how to check that ? | 10:10 |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 10:10 |
| *** fzdarsky has joined #tripleo | 10:10 | |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 10:10 |
| sri_ | those are blade servers ? | 10:11 |
| sonali8555 | no | 10:12 |
| sonali8555 | we dont | 10:12 |
| *** yamahata has quit IRC | 10:13 | |
| sri_ | sonali8555: what kinda of hardware you are using, server model numbers , are u using fake_pxe ? | 10:13 |
| sonali8555 | sri_ we are usin pxe_ilo | 10:14 |
| sri_ | ok, is those hp servers has dedicated ilo nic ? or is it shared ilo nic ? | 10:14 |
| sonali8555 | its dedicated | 10:16 |
| sri_ | ok good, what is output off this command , openstack overcloud node import --introspect --provide instackenv.json | 10:20 |
| sri_ | sonali8555: ^^ , if everything went successfully , then u can run , openstack overcloud node provide --all-manageable , | 10:22 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Set coe_ facts for APBs https://review.openstack.org/523451 | 10:23 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Don't fail Kubespray scenario if swap is enabled https://review.openstack.org/523836 | 10:23 |
| *** tosky has joined #tripleo | 10:24 | |
| sonali8555 | sri_ output for introspect cmd http://paste.openstack.org/show/627686/ | 10:24 |
| sonali8555 | its showing errors | 10:24 |
| sri_ | did you upload the overcloud images , what is output off , openstack image list | 10:25 |
| sonali8555 | yes i have | 10:26 |
| sonali8555 | (undercloud) (undercloud) [root@director stack]# openstack image list | 10:26 |
| sonali8555 | +--------------------------------------+------------------------+--------+ | 10:26 |
| sonali8555 | | ID | Name | Status | | 10:26 |
| sonali8555 | +--------------------------------------+------------------------+--------+ | 10:26 |
| sonali8555 | | 60ca2e08-0fad-4ca0-9d87-ecc45e961a64 | bm-deploy-kernel | active | | 10:26 |
| sonali8555 | | aaec0a76-f0ae-4aae-bbca-bdc7b5cbd431 | bm-deploy-ramdisk | active | | 10:26 |
| sonali8555 | | 08ff54d0-fe49-4ae0-8815-eaffe4ba78c0 | overcloud-full | active | | 10:26 |
| sonali8555 | | f89ee910-abde-4fbd-b22b-ae73b8f9e959 | overcloud-full-initrd | active | | 10:26 |
| sonali8555 | | cc480695-0e93-4056-9c92-e6b2acfc2c87 | overcloud-full-vmlinuz | active | | 10:26 |
| sonali8555 | +--------------------------------------+------------------------+--------+ | 10:26 |
| sonali8555 | do i need to shutdown all the vms | 10:26 |
| sri_ | ok, looks good , yes before you run "openstack overcloud node import --introspect --provide instackenv.json" all node should be in power-off state | 10:27 |
| sri_ | can you get the power state of you're from your undercloud ? | 10:28 |
| sonali8555 | sorry i dint get what your trying to say here | 10:30 |
| sri_ | sonali8555: you can look into ironic inspector logs to see what went wrong | 10:30 |
| sri_ | this is the command , we can verify you're IPMI configuration: ipmitool -I lanplus -U admin -P password -H 192.168.15.16 -p 6242 power status | 10:31 |
| sri_ | change username and passwords to match your env | 10:32 |
| *** spectr has quit IRC | 10:33 | |
| jfrancoa | jaosorior: do you have a minute for a doubt? | 10:36 |
| *** daidv has quit IRC | 10:39 | |
| openstackgerrit | Merged openstack/tripleo-common master: Prevent apache from listening on default ports https://review.openstack.org/523404 | 10:39 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Fix typo in tempest-results https://review.openstack.org/523839 | 10:39 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-common stable/pike: [DO NOT MERGE] Testing upgrade. https://review.openstack.org/523408 | 10:41 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-common stable/pike: [DO NOT MERGE] Testing upgrade. https://review.openstack.org/523408 | 10:41 |
| sonali8555 | sri_ manually i had oweroff the vm | 10:41 |
| sonali8555 | but in nova list command | 10:41 |
| sonali8555 | (undercloud) (undercloud) [root@director stack]# nova list | 10:41 |
| sonali8555 | +--------------------------------------+--------------------------+--------+------------+-------------+------------------------+ | 10:41 |
| sonali8555 | | ID | Name | Status | Task State | Power State | Networks | | 10:41 |
| sonali8555 | +--------------------------------------+--------------------------+--------+------------+-------------+------------------------+ | 10:41 |
| sonali8555 | | 0576c6ec-2664-4fba-8d95-2fd0a9cc495e | overcloud-blockstorage-0 | ACTIVE | - | Running | ctlplane=192.168.24.11 | | 10:41 |
| sonali8555 | | 36f62568-7858-4e9f-8242-9763da684ed7 | overcloud-compute-0 | ACTIVE | - | Running | ctlplane=192.168.24.9 | | 10:41 |
| sonali8555 | | c1f81f0e-5c0e-4f79-9dce-e75ae05f6caa | overcloud-compute-1 | ACTIVE | - | Running | ctlplane=192.168.24.12 | | 10:41 |
| sonali8555 | | 74e350ce-ced0-470d-9169-6967c75ae13d | overcloud-controller-0 | ACTIVE | - | Running | ctlplane=192.168.24.15 | | 10:41 |
| sonali8555 | | 4bfd5ce9-d428-4878-b8b0-6610a200612c | overcloud-controller-1 | ACTIVE | - | Running | ctlplane=192.168.24.18 | | 10:41 |
| sonali8555 | | 51e0bc53-3aad-400f-ac63-7e64415d5783 | overcloud-controller-2 | ACTIVE | - | Running | ctlplane=192.168.24.16 | | 10:42 |
| sonali8555 | +--------------------------------------+--------------------------+--------+------------+-------------+------------------------+ | 10:42 |
| sonali8555 | (undercloud) (undercloud) [root@director stack]# | 10:42 |
| *** matbu has quit IRC | 10:42 | |
| sonali8555 | "openstack overcloud node import --introspect --provide instackenv.json " giveing same error as previously it was giving | 10:42 |
| *** matbu has joined #tripleo | 10:43 | |
| *** dciabrin_ has quit IRC | 10:43 | |
| *** dciabrin_ has joined #tripleo | 10:44 | |
| sri_ | sonali8555: ok first delete all baremetal nodes , and try again , you should be able to power off and power on those nodes remotely ! | 10:44 |
| *** ffiore has quit IRC | 10:44 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-common stable/pike: [DO NOT MERGE] Testing upgrade. https://review.openstack.org/523408 | 10:45 |
| *** sshnaidm|afk is now known as sshnaidm | 10:47 | |
| *** ffiore has joined #tripleo | 10:49 | |
| *** abregman_ is now known as abregman|mtg | 10:50 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Fix typo in tempest-results https://review.openstack.org/523839 | 10:51 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-validations master: Add role_data* keys to inventory https://review.openstack.org/513761 | 10:52 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Introduce fs035, ovb-ha-ipv6 https://review.openstack.org/522615 | 10:57 |
| *** ebarrera has quit IRC | 11:00 | |
| *** matbu has quit IRC | 11:01 | |
| *** matbu has joined #tripleo | 11:03 | |
| *** paramite has quit IRC | 11:08 | |
| *** pblaho has joined #tripleo | 11:10 | |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 11:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 11:10 |
| *** moshele has joined #tripleo | 11:11 | |
| *** gfidente has quit IRC | 11:12 | |
| *** haint_ has joined #tripleo | 11:16 | |
| *** haint has quit IRC | 11:21 | |
| *** mrch has joined #tripleo | 11:22 | |
| *** stendulker_ has joined #tripleo | 11:25 | |
| *** paramite has joined #tripleo | 11:25 | |
| *** stendulker_ has quit IRC | 11:26 | |
| *** stendulker_ has joined #tripleo | 11:27 | |
| *** stendulker has quit IRC | 11:28 | |
| *** gfidente has joined #tripleo | 11:28 | |
| *** gfidente has quit IRC | 11:28 | |
| *** gfidente has joined #tripleo | 11:28 | |
| *** shreshtha_ has quit IRC | 11:32 | |
| *** stendulker_ has quit IRC | 11:32 | |
| *** hjensas has quit IRC | 11:34 | |
| *** salmankhan has joined #tripleo | 11:35 | |
| *** cylopez1 has quit IRC | 11:36 | |
| *** tvignaud has quit IRC | 11:38 | |
| *** tvignaud has joined #tripleo | 11:41 | |
| d0ugal | gfidente: You got a moment for a quick review? Something I wanted when debugging the step 2 workflow failures. https://review.openstack.org/#/c/523372/ | 11:44 |
| gfidente | d0ugal sec | 11:44 |
| d0ugal | jpich: did you get a chance to try out https://review.openstack.org/#/c/523332/ ? | 11:45 |
| *** jkilpatr has quit IRC | 11:46 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: WIP Enable loadbalancer for kubernetes masters https://review.openstack.org/516894 | 11:47 |
| jpich | d0ugal: Didn't in the end, as I found a solution to my problem and was vaguely concerned adding other patches may bring in other issues to that environment... Keeping it on my list for after I've succeeded at my current task! | 11:48 |
| *** morazi has quit IRC | 11:51 | |
| *** tvignaud has quit IRC | 11:51 | |
| *** tvignaud has joined #tripleo | 11:52 | |
| *** rhallisey has joined #tripleo | 11:53 | |
| *** mdnadeem has quit IRC | 11:58 | |
| *** lucasagomes is now known as lucas-hungry | 12:00 | |
| *** tvignaud has quit IRC | 12:02 | |
| *** pkovar has joined #tripleo | 12:04 | |
| *** hjensas has joined #tripleo | 12:04 | |
| *** hjensas has quit IRC | 12:04 | |
| *** hjensas has joined #tripleo | 12:04 | |
| *** moshele has quit IRC | 12:06 | |
| *** moshele has joined #tripleo | 12:07 | |
| *** atoth has joined #tripleo | 12:09 | |
| *** rbowen has joined #tripleo | 12:10 | |
| *** ratailor has quit IRC | 12:10 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 12:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 12:10 |
| *** abregman|mtg is now known as abregman | 12:10 | |
| d0ugal | jpich: no worries, thanks. I am just spinning up an env to test it now. | 12:11 |
| *** athomas has quit IRC | 12:11 | |
| *** athomas has joined #tripleo | 12:14 | |
| *** ebarrera has joined #tripleo | 12:15 | |
| jistr | flaper87, bogdando, shardy: we got much further now | 12:16 |
| jistr | http://logs.openstack.org/36/523836/1/experimental/tripleo-ci-centos-7-scenario006-multinode-oooq/e7f62ee/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-11-29_11_44_58 | 12:16 |
| jistr | failed on "wait for the apiserver to be running" though | 12:17 |
| *** moshele has quit IRC | 12:17 | |
| flaper87 | jistr: niiiice | 12:17 |
| flaper87 | well done | 12:17 |
| *** jkilpatr has joined #tripleo | 12:17 | |
| * jistr looking for the cause now, not seeing much yet | 12:17 | |
| *** pkovar has quit IRC | 12:17 | |
| flaper87 | jistr: fwiw, I've seen that before and sometimes it's just a matter of rechecking | 12:17 |
| flaper87 | not saying that's the cause now | 12:17 |
| *** bfournie has quit IRC | 12:17 | |
| jistr | flaper87: i'll try it and keep looking in the mean time, thanks | 12:18 |
| *** bfournie has joined #tripleo | 12:18 | |
| *** liverpooler has quit IRC | 12:18 | |
| *** bfournie has quit IRC | 12:22 | |
| *** sshnaidm is now known as sshnaidm|afk | 12:22 | |
| *** aputtur_ has quit IRC | 12:30 | |
| *** ffiore has quit IRC | 12:30 | |
| *** rbowen_ has joined #tripleo | 12:31 | |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Collect /etc/kubernetes/ from CI jobs https://review.openstack.org/523857 | 12:32 |
| *** cylopez has joined #tripleo | 12:34 | |
| *** rbowen has quit IRC | 12:35 | |
| *** raildo has joined #tripleo | 12:39 | |
| *** threestrands has joined #tripleo | 12:42 | |
| *** threestrands has quit IRC | 12:42 | |
| *** threestrands has joined #tripleo | 12:42 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Don't fail Kubespray scenario if swap is enabled https://review.openstack.org/523836 | 12:42 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Set coe_ facts for APBs https://review.openstack.org/523451 | 12:42 |
| *** abishop has joined #tripleo | 12:45 | |
| *** tvignaud has joined #tripleo | 12:45 | |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-quickstart-extras master: DNM: Testing ovsdbapp patch https://review.openstack.org/523712 | 12:46 |
| *** dtantsur is now known as dtantsur|brb | 12:47 | |
| *** morazi has joined #tripleo | 12:48 | |
| *** jaganathan has quit IRC | 12:48 | |
| *** psachin has joined #tripleo | 12:48 | |
| *** Tripleo-User has joined #tripleo | 12:53 | |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Catch zaqar exception when no message to claim https://review.openstack.org/523500 | 12:54 |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Catch zaqar exception when no message to claim https://review.openstack.org/523500 | 12:54 |
| *** suuuper1 has quit IRC | 12:55 | |
| *** jlabarre has joined #tripleo | 12:55 | |
| *** bfournie has joined #tripleo | 12:56 | |
| *** mburned is now known as mburned_out | 12:56 | |
| *** ansmith has quit IRC | 12:57 | |
| Tripleo-User | i want to access undercloud swift by the cloudberry ， but have a " api key " para , how to get the swift api key | 12:57 |
| *** rbowen_ has quit IRC | 12:58 | |
| *** rlandy has joined #tripleo | 12:58 | |
| *** dprince has joined #tripleo | 12:58 | |
| *** thrash|g0ne is now known as thrash | 12:59 | |
| *** rbrady-afk is now known as rbrady | 12:59 | |
| oidgar | hi guys, usually I ran "openstack overcloud container image prepare --namespace tripleoupstream --tag latest --env-file ~/docker-centos-tripleoupstream.yaml" and it gave me the list for all/relevant container images. I know the command has changed a bit | 13:01 |
| oidgar | now it returns an empty list. what am I missign? | 13:01 |
| oidgar | *missing? | 13:01 |
| *** threestrands has quit IRC | 13:01 | |
| oidgar | I also tried to replace namespace to --namespace trunk.registry.rdoproject.org/master but it didn't work | 13:01 |
| oidgar | (by: https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/overcloud.html) | 13:02 |
| shardy | oidgar: Hi, does https://review.openstack.org/#/c/522790/ help? | 13:02 |
| *** rbowen has joined #tripleo | 13:02 | |
| sileht | gfidente, hi are you around ? | 13:02 |
| oidgar | shardy: trying | 13:03 |
| *** pkovar has joined #tripleo | 13:03 | |
| shardy | oidgar: if you see that problem without any ~/.tripleo/environments directory perhaps you could comment on the review as I've not had time to re-test yet | 13:03 |
| sileht | gfidente, I have listed the content of /etc/ceph here: http://logs.openstack.org/15/523715/2/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/4c43b7d/logs/undercloud/home/zuul/failed_deployment_list.log.txt.gz | 13:03 |
| oidgar | shardy: yup :) | 13:03 |
| oidgar | shardy: I'll comment out | 13:03 |
| sileht | gfidente, file are owned by root:root and not gnocchi:gnocchi | 13:03 |
| oidgar | shardy: I do have ~/.tripleo/environments with one file for puppet module override | 13:04 |
| shardy | oidgar: Ok, see the bug mandre referenced, sounds like you have the same issue I encountered | 13:04 |
| *** mburned_out is now known as mburned | 13:04 | |
| oidgar | shardy: by the way, usign --namespace tripleoupstream vs --namespace trunk.registry.rdoproject.org/master should bring the same results? | 13:04 |
| oidgar | shardy: it works with -e | 13:05 |
| shardy | oidgar: ack, yes I just added the -e and it worked for me too | 13:05 |
| *** pradk has joined #tripleo | 13:05 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: DNM: debug gnocchi-upgrade https://review.openstack.org/523715 | 13:05 |
| shardy | so that's probably a needed workaround until the environment dir bug gets assigned/fixed | 13:05 |
| oidgar | shardy: the -e parameter should be optional? | 13:06 |
| shardy | oidgar: yes we should generate all images by default | 13:06 |
| shardy | like was previously the case | 13:06 |
| oidgar | shady: thanks man! | 13:06 |
| shardy | np :) | 13:07 |
| *** lucas-hungry is now known as lucasagomes | 13:08 | |
| *** skramaja has quit IRC | 13:09 | |
| gfidente | sileht permissions are set by kolla when copying files into the container | 13:10 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 13:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 13:10 |
| sileht | gfidente, yeah but gnocchi-upgrade is not run under kolla context | 13:10 |
| sileht | gfidente, that why it can't access to the keyring | 13:10 |
| beagles | shardy: probably a dumb question, but what's the best way to incorporate a heat template parameter into an external deployment task | 13:11 |
| *** moshele has joined #tripleo | 13:12 | |
| gfidente | sileht I think it does run in a container https://review.openstack.org/#/c/508975/20/docker/services/gnocchi-api.yaml check line 139 | 13:12 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: DNM: Test to see if this fixes gnocchi upgrade scenario001 failure https://review.openstack.org/523632 | 13:13 |
| beagles | shardy, just use a get_param in a with_items or similar? | 13:13 |
| gfidente | sileht it's weird because https://review.openstack.org/#/c/522630/ is failing with the same error indeed | 13:14 |
| pradk | sileht, gfidente, ^^ is the test to see if revert of gnocchi perms helps | 13:14 |
| gfidente | sileht I wonder if the issue isn't in the keyring itself, as in not having credentials to work on the pool | 13:14 |
| gfidente | instead of a basic problem of permissions on the file | 13:14 |
| *** lblanchard has joined #tripleo | 13:14 | |
| sileht | gfidente, because kolla_config is not run for gnocchi-upgrade | 13:14 |
| pradk | i looked at the error last night, the exception is raised by rados, not gnocchi | 13:15 |
| *** lblanchard has quit IRC | 13:15 | |
| pradk | so i'm not fully convinced its gnocchi issue yet. | 13:15 |
| beagles | shardy, ne'er mind think I got it | 13:15 |
| *** pchavva has joined #tripleo | 13:16 | |
| shardy | beagles: yup you can use get_param etc, potentially combined with e.g str_replace if you want to generate e.g json for ansible | 13:17 |
| sileht | pradk, it's not, it's because when gnocchi-upgrade run the keyring is owned by root instead of gnocchi | 13:17 |
| *** amoralej is now known as amoralej|lunch | 13:17 | |
| sileht | pradk, the keyring permission have changed recently | 13:17 |
| shardy | beagles: example https://review.openstack.org/#/c/516894/7/extraconfig/services/kubernetes-master.yaml | 13:17 |
| pradk | right, with a patch from john recently | 13:18 |
| beagles | shardy, oddly enough still getting used to the fact that it's just embedded ansible :) | 13:18 |
| sileht | pradk, and gnocchi-upgrade is run by docker directly without kolla environnmene | 13:18 |
| sileht | t | 13:18 |
| beagles | it's a brave new world! | 13:18 |
| pradk | correct | 13:18 |
| shardy | beagles: hehe yeah | 13:18 |
| pradk | we run in step 4 i think | 13:18 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: WIP Enable loadbalancer for kubernetes masters https://review.openstack.org/516894 | 13:20 |
| *** links has quit IRC | 13:21 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: DNM: debug gnocchi-upgrade https://review.openstack.org/523715 | 13:22 |
| gfidente | sileht why do you say step4 db_sync runs without kolla_config ? | 13:23 |
| sileht | gfidente, I fount it I think | 13:24 |
| *** ffiore has joined #tripleo | 13:24 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: gnocchi: mount the correct volume for /etc/ceph https://review.openstack.org/523715 | 13:25 |
| sileht | gfidente, pradk ^ | 13:25 |
| *** sshnaidm|afk is now known as sshnaidm | 13:26 | |
| *** liverpooler has joined #tripleo | 13:26 | |
| pradk | cool, hope lets see what ci says | 13:26 |
| gfidente | sileht ah! | 13:27 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Deploy OpenShift using OOO on the overcloud https://review.openstack.org/494470 | 13:32 |
| *** liverpooler has quit IRC | 13:32 | |
| *** liverpooler has joined #tripleo | 13:32 | |
| *** udesale has quit IRC | 13:33 | |
| gfidente | fwiw, the revert also passed https://review.openstack.org/523709 | 13:34 |
| gfidente | so that confirms it is an issue with permissions on the file, not on the pools | 13:34 |
| *** vpickard_ is now known as vpickard | 13:37 | |
| openstackgerrit | Merged openstack/tripleo-validations master: Add VipMap to inventory variables https://review.openstack.org/521731 | 13:39 |
| *** artom has quit IRC | 13:39 | |
| *** moshele has quit IRC | 13:39 | |
| *** aputtur_ has joined #tripleo | 13:41 | |
| *** openstackstatus has quit IRC | 13:43 | |
| *** openstack has joined #tripleo | 13:44 | |
| *** ChanServ sets mode: +o openstack | 13:44 | |
| *** openstackstatus has joined #tripleo | 13:45 | |
| *** ChanServ sets mode: +v openstackstatus | 13:45 | |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Run enable_ssh_admin also for Nova+Ironic deployments https://review.openstack.org/523877 | 13:47 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: WIP: use one var for undercloud external network https://review.openstack.org/523878 | 13:47 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: Fix SSL certs creation for ipv6 https://review.openstack.org/523477 | 13:48 |
| *** trown|outtypewww is now known as trown | 13:48 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Catch zaqar exception when no message to claim https://review.openstack.org/523500 | 13:53 |
| *** ansmith has joined #tripleo | 13:56 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: Fix up fence_compute with latest keystone v3 changes https://review.openstack.org/522527 | 13:59 |
| *** toure_biab is now known as toure | 13:59 | |
| *** tzumainn has joined #tripleo | 14:00 | |
| *** salmankhan has quit IRC | 14:00 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add pike as release using old deps repo. https://review.openstack.org/523480 | 14:00 |
| *** holser has quit IRC | 14:00 | |
| *** udesale has joined #tripleo | 14:01 | |
| *** Goneri has joined #tripleo | 14:03 | |
| *** oidgar has quit IRC | 14:04 | |
| *** sonali8555 has quit IRC | 14:04 | |
| *** gbarros has joined #tripleo | 14:05 | |
| *** tvignaud has quit IRC | 14:06 | |
| *** tvignaud has joined #tripleo | 14:06 | |
| *** pblaho has quit IRC | 14:07 | |
| *** pblaho has joined #tripleo | 14:07 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 14:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Mehdi Abaakouk (sileht) | 14:10 |
| *** shardy has quit IRC | 14:14 | |
| chem | owalsh: hey, do you have a minute. I wonder why https://review.openstack.org/#/q/change:I3c2a7921426bcd99d6340a913787edfb9bbd8bbd (LibvirtTLSPassword) wasn't backported to ocata as, it seems it create an error during p->o upgrade https://bugs.launchpad.net/tripleo/+bug/1735171 | 14:15 |
| openstack | Launchpad bug 1735171 in tripleo "P->O upgrade fails on Property error: resources.NovaLibvirtBase.properties: Property LibvirtTLSPassword not assigned" [Critical,New] | 14:15 |
| owalsh | chem: hey /me looking | 14:16 |
| chem | owalsh: thanks | 14:16 |
| *** rbowen has quit IRC | 14:17 | |
| jaosorior | owalsh, chem: cause you can't really do TLS everywhere in ocata | 14:17 |
| owalsh | chem: you mean N->O yea | 14:18 |
| *** psahoo has quit IRC | 14:18 | |
| *** pradk has quit IRC | 14:18 | |
| *** holser has joined #tripleo | 14:18 | |
| chem | owalsh: no pike to ocata | 14:18 |
| *** moshele has joined #tripleo | 14:18 | |
| jaosorior | owalsh, chem: there was code around, cause I've been working for too long on this... but you can't really deploy it without a huge pain. | 14:18 |
| *** amoralej|lunch is now known as amoralej | 14:18 | |
| chem | jaosorior: owalsh so we can have tls everywhere on pike/master but not ocata ? | 14:18 |
| jaosorior | chem: correct. | 14:19 |
| jaosorior | or you can...ish, but it's not supported and I would be VERY impressed. | 14:19 |
| owalsh | chem: ah... have we had promotion yet | 14:20 |
| chem | jaosorior: owalsh ack, but then what happen on an pike tls everywhere upgraded to ocata (currently it fails :)) ? | 14:20 |
| *** dsariel has quit IRC | 14:20 | |
| *** oidgar has joined #tripleo | 14:20 | |
| owalsh | chem: guessing we don't have the pike tripleo-common change that generates the password | 14:20 |
| *** holser has quit IRC | 14:21 | |
| jaosorior | chem: ok, now I'm confused. what do you mean "upgraded to ocata"? you mean downgrading? | 14:21 |
| jaosorior | pike > ocata | 14:21 |
| chem | jaosorior: oh, no it's just me being confusing | 14:21 |
| *** holser has joined #tripleo | 14:21 | |
| chem | jaosorior: the testing upgrade env is ocata -> pike | 14:22 |
| jaosorior | chem: right | 14:22 |
| jaosorior | chem: we don't support upgrades with TLS everywhere (there is a matrix that says what's supported, I think noslzzp has a link)( | 14:22 |
| *** jmelvin has joined #tripleo | 14:22 | |
| chem | jaosorior: ack, noted. | 14:23 |
| noslzzp | chem, jaosorior: https://docs.google.com/document/d/1lo7RApWAvgdclrlxG6E2Hc-8-vU5TK38tkjGCTwXrbU/edit | 14:23 |
| chem | noslzzp: thanks | 14:23 |
| jaosorior | noslzzp: thanks dude | 14:23 |
| noslzzp | we don't show upgrades explicitly there though.. | 14:24 |
| chem | owalsh: looking into tripleo-common :) | 14:24 |
| *** dtantsur|brb is now known as dtantsur | 14:24 | |
| owalsh | chem: https://review.openstack.org/522846 | 14:24 |
| owalsh | chem: once that's promoted the password should be generated when upgrading | 14:25 |
| owalsh | chem: IIRC at least, updates do not generate passwords but upgrades do | 14:26 |
| *** rcernin has quit IRC | 14:27 | |
| *** psachin has quit IRC | 14:28 | |
| chem | owalsh: oki, going to investiagte with that information. But all those patches landed at the same time so it would surprising to have some but not this other (the tripleo-common one) | 14:28 |
| chem | owalsh: thanks for the pointers and clarification :) | 14:28 |
| owalsh | chem: thinks it's using checked out t-h-t with packages tripleo-common | 14:32 |
| owalsh | packaged tripleo-common | 14:32 |
| *** milan has joined #tripleo | 14:32 | |
| chem | owalsh: yeap, it does the version is 7.6.5-0.20171122034430.37f3f45.el7 | 14:32 |
| owalsh | chem: yup, unfortunatly couldn't wait for promotion | 14:32 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud master: Add ctlplane hiera key that contains local IP https://review.openstack.org/523885 | 14:33 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud master: Add ctlplane hiera key that contains local IP https://review.openstack.org/523885 | 14:34 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: Fix up fence_compute with latest keystone v3 changes https://review.openstack.org/522527 | 14:35 |
| *** moshele has quit IRC | 14:35 | |
| jistr | flaper87, bogdando: all green!! http://logs.openstack.org/36/523836/2/experimental/tripleo-ci-centos-7-scenario006-multinode-oooq/270ce43/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-11-29_14_00_05 | 14:36 |
| jistr | now we just have to land all the patches and we can pull the job out of experimental into -nv | 14:36 |
| bogdando | jistr: well done! | 14:36 |
| flaper87 | jistr: w0000h000 | 14:36 |
| bogdando | jistr: note, we should deploy netcheker | 14:37 |
| *** lblanchard has joined #tripleo | 14:37 | |
| bogdando | flaper87: has an example CI job | 14:37 |
| * jistr looks for it | 14:37 | |
| *** cshastri has quit IRC | 14:37 | |
| milan | dprince, dtantsur, folks, looking at https://github.com/openstack/tripleo-heat-templates/commit/19ef017f319e883c612aac60a6149abd78a49834 to add a new config option, say [pxe_filter]driver=dnsmasq, is it enough to insert new parameter into parameters and a "merge step" in outputs.roledata.value.config_settings.map_merge? | 14:38 |
| dtantsur | milan: you have to support it in puppet-ironic | 14:39 |
| dtantsur | milan: I can do the change for you, if you don't want to learn puppet out of sudden :) | 14:39 |
| milan | dtantsur, no magic then I suspect | 14:39 |
| dtantsur | nope | 14:39 |
| *** lblanchard has quit IRC | 14:40 | |
| milan | dtantsur, that'd be nice! | 14:40 |
| * milan looks at the puppet-ironic; which repo | 14:40 | |
| milan | ? | 14:40 |
| dprince | milan: yes. puppet-ironic is usually the place to start for config changes. | 14:40 |
| dtantsur | dprince: yo! do you know how to make ironic-inspector run in the undercloud-containers job? | 14:40 |
| *** mdnadeem has joined #tripleo | 14:40 | |
| dprince | milan: add it there, then you can update your puppet/services/ironic-* templates in t-h-t to use the appropriate new puppet-ironic hiera setting | 14:40 |
| milan | dprince, dtantsur thx! | 14:41 |
| dtantsur | milan: let me do something, I have a good experience with puppet-ironic | 14:41 |
| dprince | dtantsur: I do. Should be as simple as adding the environments/services-docker/ironic-inspector.yaml environment to the deploy command | 14:41 |
| dtantsur | dprince: where are the deploy commands for the CI located? | 14:42 |
| dprince | dtantsur: noting you may also need to setup a few extra parameters | 14:42 |
| milan | dtantsur, ack, yes please, I'm cargoculting some docker parts of the t-h-t right now | 14:42 |
| dtantsur | milan: do you have upstream blueprint or RFE? | 14:42 |
| milan | so I can put up that patch | 14:42 |
| milan | nope | 14:42 |
| jistr | bogdando: do you have a link for the netchecker stuff? | 14:42 |
| weshay | jistr, as we make jobs voting we should also be covering the scenario in promotion.. I'll take the 006 scneario task | 14:42 |
| jistr | weshay: ack, just i don't think we're ready for voting there yet | 14:46 |
| dprince | dtantsur: actually, I think the job already uses 'openstack install' now | 14:46 |
| dprince | dtantsur: http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/undercloud-deploy/templates/undercloud-install.sh.j2 | 14:46 |
| jistr | weshay: but would be nice to go from experimental to non-voting | 14:46 |
| weshay | k.. thanks | 14:46 |
| weshay | ah k | 14:46 |
| dtantsur | dprince: I'm a bit confused, isn't it the old method of installing undercloud? | 14:46 |
| *** oidgar has quit IRC | 14:46 | |
| *** cylopez1 has joined #tripleo | 14:46 | |
| *** cylopez has quit IRC | 14:46 | |
| *** openstack has quit IRC | 14:46 | |
| *** openstack has joined #tripleo | 14:47 | |
| *** ChanServ sets mode: +o openstack | 14:47 | |
| *** ramishra has quit IRC | 14:50 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart master: Make FreeIPA supplemental node DNS server configureable https://review.openstack.org/495899 | 14:50 |
| *** fpan has quit IRC | 14:51 | |
| milan | dtantsur, what I'd like to achieve in t-h-t is http://paste.openstack.org/show/627724/ | 14:51 |
| * milan unsure about whether to have the path/driver configurable | 14:52 | |
| milan | maybe OK to hardcode? | 14:52 |
| *** gbarros has quit IRC | 14:53 | |
| dprince | dtantsur: the new 'openstack install --use-heat' is meant to be what we are using | 14:54 |
| dprince | dtantsur: I'm going to sync with some of Ian Mains latest patches which enable this | 14:54 |
| dprince | dtantsur: Slower | 14:54 |
| *** akane has quit IRC | 14:54 | |
| *** akane_ has quit IRC | 14:54 | |
| dtantsur | milan: maybe, yes | 14:54 |
| EmilienM | jistr: ok | 14:55 |
| milan | dtantsur, dprince how to best hardcode that then? ^^^ | 14:55 |
| slagle | jistr: i think this may fix that: https://review.openstack.org/#/c/523237/ | 14:56 |
| *** d0ugal has quit IRC | 14:56 | |
| dtantsur | milan: I don't quite get the question.. also, what about we start with undercloud inspector? it's at least CI-tested.. | 14:57 |
| milan | dtantsur, cool, point me to where to faceroll it | 14:57 |
| jistr | slagle: yea that looks like it, perfect! | 14:57 |
| milan | dtantsur, my question: how to best modify the docker file so it contains a (hard-coded) default | 14:57 |
| dprince | milan: I think we'd want t-h-t to use normal project defaults for the inspector templates in general | 14:57 |
| *** ramishra has joined #tripleo | 14:57 | |
| dprince | milan: for CI we can hardcode some the values in quickstart however so long as they are also overridable | 14:58 |
| *** gbarros has joined #tripleo | 14:58 | |
| milan | dprince, so I'd better set that in upstream ironic-inspector? | 14:58 |
| *** oidgar has joined #tripleo | 14:58 | |
| dprince | milan: I usually prefer it if TripleO's defaults match the projects (Ironic, Keystone, etc.) but we don't always because we are oppinionated | 14:59 |
| milan | dprince, there's a default already (not a nice one maybe) but I need to push the same value into dnsmasq.conf | 14:59 |
| dprince | milan: our defaults IMO should target real environments though and not just CI (fake environments) | 14:59 |
| milan | the parameter would be path to the dhcp hostsdir | 14:59 |
| milan | dprince, I see | 14:59 |
| jistr | bogdando: thanks for the links | 14:59 |
| * milan wishes there was a default in dnsmasq.conf but there's none | 14:59 | |
| milan | * for dhcp hostsdir | 15:00 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 15:00 |
| bogdando | jistr I think there is a job example as well | 15:00 |
| dtantsur | milan: we set up dnsmasq.conf in puppet-ironic as well | 15:00 |
| dtantsur | which makes the patch I'm working on a bit more curious | 15:00 |
| dtantsur | I guess I won't rush it in | 15:01 |
| bogdando | jistr: http://logs.openstack.org/24/523824/3/check/ansible-role-k8s-mariadb-kubernetes-centos/e66e0e1/job-output.txt.gz#_2017-11-29_11_04_07_412372 | 15:01 |
| milan | dtantsur, push and let's discuss? | 15:02 |
| dtantsur | milan: yeah, but I may not finish it tomorrow | 15:02 |
| dtantsur | * until | 15:02 |
| milan | dtantsur, k, needn't be perfect tho | 15:02 |
| dtantsur | yeah, but I have to make up my mind | 15:02 |
| *** rbowen has joined #tripleo | 15:03 | |
| *** aditya_r has joined #tripleo | 15:04 | |
| *** d0ugal has joined #tripleo | 15:04 | |
| d0ugal | rbrady,d0ugal,apetrich,thrash,toure,jpich,jtomasek - Workflow Squad meeting time. https://etherpad.openstack.org/p/tripleo-workflows-squad-status | 15:04 |
| d0ugal | rbrady,d0ugal,apetrich,thrash,toure,jpich,jtomasek - Workflow Squad meeting time. https://etherpad.openstack.org/p/tripleo-workflows-squad-status | 15:04 |
| d0ugal | rbrady,d0ugal,apetrich,thrash,toure,jpich,jtomasek - Workflow Squad meeting time. https://etherpad.openstack.org/p/tripleo-workflows-squad-status | 15:05 |
| d0ugal | (sorry, connection issues!) | 15:05 |
| *** anilvenkata has quit IRC | 15:06 | |
| *** adarazs|ruck is now known as adarazs | 15:06 | |
| *** rlandy is now known as rlandy|ruck | 15:06 | |
| *** pradk has joined #tripleo | 15:07 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: Add Octavia API endpoint to haproxy https://review.openstack.org/490082 | 15:08 |
| d0ugal | jaosorior: do you need https://review.openstack.org/522252 ? | 15:09 |
| jaosorior | d0ugal: thanks! | 15:09 |
| jaosorior | d0ugal: had missed +2ing i5 | 15:09 |
| jaosorior | *it | 15:10 |
| d0ugal | jaosorior: np, just checking :) | 15:10 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 15:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Mehdi Abaakouk (sileht) | 15:10 |
| *** janki has quit IRC | 15:10 | |
| *** janki has joined #tripleo | 15:10 | |
| jaosorior | mwhahaha: I hadn't +Aed the enabled_drivers patch cause I wanted fresher CI results | 15:10 |
| jaosorior | I had rechecked it | 15:10 |
| jaosorior | but I guess it'll be fine | 15:11 |
| mwhahaha | it'd fail in the gate if there's a problem | 15:11 |
| *** rbowen_ has joined #tripleo | 15:11 | |
| dtantsur | ++ | 15:11 |
| dtantsur | I'd be less insistive, but we're only half way through the hardware type switch | 15:12 |
| dtantsur | and we're close to Q-2 | 15:12 |
| jaosorior | dtantsur: understandable | 15:12 |
| *** rbowen has quit IRC | 15:12 | |
| *** psachin has joined #tripleo | 15:13 | |
| *** thrash is now known as thrash|biab | 15:15 | |
| *** sshnaidm is now known as sshnaidm|rover | 15:16 | |
| *** aditya_r has quit IRC | 15:16 | |
| *** fpan has joined #tripleo | 15:17 | |
| *** anilvenkata has joined #tripleo | 15:17 | |
| *** d0ugal_ has joined #tripleo | 15:17 | |
| *** yamahata has joined #tripleo | 15:17 | |
| *** d0ugal has quit IRC | 15:20 | |
| *** toure has quit IRC | 15:23 | |
| *** rbowen has joined #tripleo | 15:23 | |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: logging: use service_config_settings for fluentd https://review.openstack.org/501458 | 15:23 |
| *** toure has joined #tripleo | 15:24 | |
| *** dsariel has joined #tripleo | 15:24 | |
| *** toure is now known as toure_biab | 15:24 | |
| *** dmacpher has joined #tripleo | 15:25 | |
| *** toure_biab is now known as toure | 15:26 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Use IPv6 PublicVirtualFixedIps when needed https://review.openstack.org/522714 | 15:26 |
| *** rbowen_ has quit IRC | 15:26 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT MERGE: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 15:31 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart master: Update README to make add_repos use clearer https://review.openstack.org/501851 | 15:31 |
| *** Slower has quit IRC | 15:31 | |
| *** anilvenkata has quit IRC | 15:33 | |
| *** masco has quit IRC | 15:34 | |
| *** agurenko has quit IRC | 15:34 | |
| *** toure is now known as toure_biab | 15:34 | |
| openstackgerrit | Milan Kováčik proposed openstack/tripleo-heat-templates master: Enable inspector dnsmasq dhcp filter https://review.openstack.org/523909 | 15:34 |
| *** toure_biab is now known as toure | 15:34 | |
| *** toure has quit IRC | 15:34 | |
| *** d0ugal has joined #tripleo | 15:35 | |
| *** d0ugal_ has quit IRC | 15:37 | |
| *** toure has joined #tripleo | 15:37 | |
| *** psachin has quit IRC | 15:37 | |
| *** mrch has quit IRC | 15:38 | |
| *** dsariel has quit IRC | 15:42 | |
| *** dsariel has joined #tripleo | 15:42 | |
| *** Slower has joined #tripleo | 15:42 | |
| *** toure has quit IRC | 15:43 | |
| *** toure has joined #tripleo | 15:44 | |
| *** artom has joined #tripleo | 15:45 | |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: [WIP] logging: use service_config_settings for fluentd https://review.openstack.org/501458 | 15:45 |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: [WIP] logging: remove fluentd integration from common/services.yaml https://review.openstack.org/502180 | 15:45 |
| *** moshele has joined #tripleo | 15:46 | |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: logging: remove fluentd integration from common/services.yaml https://review.openstack.org/502180 | 15:47 |
| *** rfolco is now known as rfolco_biab | 15:49 | |
| *** gbarros_ has joined #tripleo | 15:49 | |
| mwhahaha | pradk, sileht: new failures with that gnocchi-api /etc/ceph location switch http://logs.openstack.org/15/523715/5/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/6838de3/logs/subnode-2/var/log/containers/gnocchi/gnocchi-upgrade.log.txt.gz | 15:49 |
| *** janki has quit IRC | 15:50 | |
| *** gbarros has quit IRC | 15:50 | |
| pradk | with mount changed, did we loose ceph.conf? | 15:51 |
| mwhahaha | seems like it | 15:51 |
| *** abregman has quit IRC | 15:51 | |
| sileht | mwhahaha, pradk I will fix it, that the same kind of root cause | 15:54 |
| *** aufi has quit IRC | 15:56 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: gnocchi: mount the correct volume for /etc/ceph https://review.openstack.org/523715 | 15:58 |
| sileht | pradk, did we put he static uid in gnocchi package ? | 15:58 |
| sileht | he/a | 15:58 |
| pradk | sileht, no we dont have one reserved for gnocchi yet | 15:59 |
| pradk | but kolla does i believe | 15:59 |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: logging: use service_config_settings for fluentd https://review.openstack.org/501458 | 15:59 |
| EmilienM | sshnaidm|rover: hey, what's up with ipv6? | 16:00 |
| *** dpawar has quit IRC | 16:00 | |
| *** abregman has joined #tripleo | 16:01 | |
| *** dpawar has joined #tripleo | 16:02 | |
| *** thrash|biab is now known as thrash | 16:02 | |
| jbadiapa | EmilienM, have you seen my answer on https://review.openstack.org/#/c/521629/? | 16:03 |
| *** psachin has joined #tripleo | 16:04 | |
| *** artom_ has joined #tripleo | 16:05 | |
| EmilienM | jbadiapa: I haven't yet, but I will have a look today | 16:05 |
| jbadiapa | EmilienM, there is no hurry, thx | 16:06 |
| *** artom has quit IRC | 16:07 | |
| *** psachin has quit IRC | 16:08 | |
| *** toure has quit IRC | 16:09 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 16:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Mehdi Abaakouk (sileht) | 16:10 |
| *** psachin has joined #tripleo | 16:10 | |
| dtantsur | milan: https://review.openstack.org/#/c/523922/ | 16:11 |
| *** rbowen_ has joined #tripleo | 16:11 | |
| sshnaidm|rover | EmilienM, hi, in progress, waiting for jobs to see.. | 16:11 |
| EmilienM | sshnaidm|rover: ok i'll look at your patches to see what you found, thanks for your help | 16:12 |
| *** rbowen has quit IRC | 16:13 | |
| *** oidgar has quit IRC | 16:15 | |
| *** oidgar has joined #tripleo | 16:16 | |
| *** agurenko has joined #tripleo | 16:17 | |
| *** toure has joined #tripleo | 16:17 | |
| *** dpawar has quit IRC | 16:19 | |
| dtantsur | dprince: to be honest, I still cannot figure out which magical place I have to change.. https://github.com/openstack/tripleo-quickstart-extras/blob/d41abb0ae27e80e9a94a0682c1e11f58be424057/roles/undercloud-deploy/templates/undercloud-deploy.sh.j2#L136 looks a candidate | 16:19 |
| dtantsur | but it's only for containerized.. or should we care about non-containerized u-c in this particular case? | 16:19 |
| *** rfolco_biab is now known as rfolco | 16:20 | |
| *** dougbtv_ has joined #tripleo | 16:20 | |
| ansiwen | mwhahaha: do you know if someone already works on https://bugs.launchpad.net/tripleo/+bug/1733897 ? If you could give me a happy pointer I could start working on that. (You mentioned it's probably a simple thing to fix.) | 16:21 |
| openstack | Launchpad bug 1733897 in tripleo "quickstart doesn't use packaged python-tempestconf for tempest runs in CI" [High,Triaged] | 16:21 |
| mwhahaha | ansiwen: no i don't. i looked at it breifly and it seems to be an odd one because the ovb jobs do use the packaging but the multinode jobs don't | 16:21 |
| mwhahaha | ansiwen: it might just be a CI config thing | 16:21 |
| *** dougbtv has quit IRC | 16:22 | |
| *** dougbtv_ is now known as dougbtv | 16:22 | |
| mwhahaha | ansiwen: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-tempest/templates/configure-tempest.sh.j2#L132 is where it's done. | 16:23 |
| ansiwen | mwhahaha: ok, and given that it works as expected, should the "tempest_format: venv" setting be set or not? I don't understand the impact of it. | 16:23 |
| *** sai_ has joined #tripleo | 16:23 | |
| mwhahaha | ansiwen: it may just be splitting out tempest_format with a tempestconf_format variable so they can be controlled independently | 16:24 |
| mwhahaha | ansiwen: in CI we should always be using packages for tempestconf if available (i think since queens?) | 16:24 |
| EmilienM | sshnaidm|rover: there is a problem | 16:25 |
| *** ykarel has quit IRC | 16:25 | |
| EmilienM | sshnaidm|rover: in https://review.openstack.org/523903 - you depends-on https://review.openstack.org/#/c/522714 - not https://review.openstack.org/#/c/523477 | 16:25 |
| EmilienM | sshnaidm|rover: you should depends-on https://review.openstack.org/#/c/523477/ to try with the fix, right? | 16:25 |
| *** dsariel has quit IRC | 16:26 | |
| EmilienM | gfidente: I took the liberty to assign https://bugs.launchpad.net/tripleo/+bug/1735139 to you because this is the exact same bug we had in my env the last day (cc amoralej ) | 16:27 |
| openstack | Launchpad bug 1735139 in tripleo "Error when deploying ceph in overcloud with containers using ceph-ansible" [Critical,Triaged] - Assigned to Giulio Fidente (gfidente) | 16:27 |
| *** cylopez1 has quit IRC | 16:28 | |
| *** dsariel has joined #tripleo | 16:28 | |
| gfidente | EmilienM that is fixed by https://review.openstack.org/#/c/523375/ | 16:29 |
| gfidente | landed in master, not pike yet | 16:29 |
| ansiwen | mwhahaha: ok, that code in the venv case just checks out master no matter what, IIUC, so that is wrong in any case. but before I didn't have it set to venv and it also didn't work... however it _did_ make a difference, it used another version. but I didn't set it to "packages" explicitly, I just didn't set it at all. | 16:30 |
| *** psachin has quit IRC | 16:31 | |
| EmilienM | gfidente: approved | 16:32 |
| EmilienM | gfidente: thank you | 16:32 |
| gfidente | EmilienM oh thanks! | 16:32 |
| openstackgerrit | Sven Anderson proposed openstack/tripleo-quickstart master: TEST DON'T MERGE - Enabling EC2-API Tempest tests. https://review.openstack.org/515139 | 16:32 |
| *** moshele has quit IRC | 16:33 | |
| EmilienM | gfidente: amoralej reported the issue 6 hours ago, but your master patch landed on 27 | 16:34 |
| EmilienM | weshay: for how long will we run both RH1 & RDO CI OVB jobs? | 16:35 |
| *** ramishra has quit IRC | 16:35 | |
| mwhahaha | EmilienM: https://review.openstack.org/#/c/523822/ | 16:36 |
| weshay | EmilienM, so sshnaidm|rover and I have been reviewing that. Previously we thought we needed rdo-cloud to be upgraded to ocata, now we're not so sure | 16:37 |
| *** rbowen_ has quit IRC | 16:37 | |
| *** toure has quit IRC | 16:37 | |
| weshay | the failure rates are still a little lower in rdo-cloud | 16:37 |
| weshay | EmilienM, some of this should be covered in the squad status that arxcruz is currently writing up | 16:37 |
| *** toure has joined #tripleo | 16:38 | |
| EmilienM | mwhahaha: approved. | 16:38 |
| EmilienM | sshnaidm|rover, weshay: the only thing that worries me is the zuul layout for ovb that we did in tripleo-ci | 16:39 |
| EmilienM | and all the rules to when/how run the jobs | 16:39 |
| EmilienM | do you see what I mean? | 16:39 |
| *** psachin has joined #tripleo | 16:39 | |
| chem | matbu: around ? | 16:40 |
| weshay | EmilienM, ah.. ya.. that would need to migrated to the zuul config in rdo project.. Everyone needs notice and a window before we bring down rh1 jobs | 16:40 |
| *** fpan has quit IRC | 16:40 | |
| amoralej | EmilienM, gfidente the job failed with https://review.openstack.org/#/c/520152/ | 16:41 |
| EmilienM | weshay: right. I'm happy to help but I don't know who is working on that | 16:41 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-heat-templates master: Update capabilities-map.yaml to include latest storage environments https://review.openstack.org/523927 | 16:41 |
| amoralej | it's running again right now | 16:41 |
| EmilienM | amoralej: bad news | 16:41 |
| gfidente | EmilienM amoralej so I think this is a misconfiguration on how hostnames are assigned | 16:41 |
| gfidente | amoralej is the environment up? can we login into it? | 16:41 |
| EmilienM | is it RDO cloud I guess? (it was for me) | 16:42 |
| amoralej | yes | 16:42 |
| EmilienM | gfidente: I can kick off something for you | 16:42 |
| amoralej | i can log in | 16:42 |
| EmilienM | oh he can too | 16:42 |
| amoralej | gfidente, if you give me your public keys i'll install it | 16:42 |
| gfidente | amoralej great thanks https://github.com/gfidente.keys | 16:42 |
| *** ffiore has quit IRC | 16:42 | |
| gfidente | EmilienM ^ thanks | 16:42 |
| amoralej | i'll hold the node also | 16:42 |
| *** moshele has joined #tripleo | 16:44 | |
| weshay | EmilienM, ya.. we'll have to organize this on the tripleo-ci trello board | 16:44 |
| EmilienM | sshnaidm|rover: the dependencies won't work, I'm fixing it now | 16:44 |
| weshay | EmilienM, looks like pradk fixed the upgrade issue | 16:44 |
| weshay | pradk++ | 16:44 |
| gfidente | EmilienM amoralej there is a known workaround https://bugzilla.redhat.com/show_bug.cgi?id=1507888#c5 | 16:44 |
| openstack | bugzilla.redhat.com bug 1507888 in instack-undercloud "Deployment with ceph and TLS everywhere fails with: "WorkflowTasks_Step2_Execution: ERROR "cannot stat '/var/run/ceph/ceph-mon.overcloud-controller-2.asok': No such file or directory""" [High,Post] - Assigned to gfidente | 16:44 |
| pradk | yep patches should be merged now | 16:44 |
| gfidente | but it shouldn't happen when the hostnames are set correctly | 16:45 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: WIP: use one var for undercloud external network https://review.openstack.org/523878 | 16:45 |
| *** psachin has quit IRC | 16:45 | |
| EmilienM | sshnaidm|rover: why did you duplicate all the patches, it's very confusing now | 16:47 |
| *** ffiore has joined #tripleo | 16:49 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: WIP: Fix SSL certs creation for ipv6 https://review.openstack.org/523477 | 16:49 |
| *** salmankhan has joined #tripleo | 16:49 | |
| *** moshele has quit IRC | 16:49 | |
| rlandy|ruck | pradk: wrt https://bugs.launchpad.net/tripleo/+bug/1733672 -looking at your comment, I will mark this a dup of https://bugs.launchpad.net/tripleo/+bug/1734134. | 16:49 |
| openstack | Launchpad bug 1733672 in tripleo "tripleo-ci-centos-7-scenario001-multinode-oooq-container is failing on deploying the overcloud - master release only" [Critical,Triaged] - Assigned to Ronelle Landy (rlandy) | 16:49 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Mehdi Abaakouk (sileht) | 16:49 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: DONT MERGE: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 16:51 |
| *** marios has quit IRC | 16:52 | |
| EmilienM | sshnaidm|rover: when you're back, please check ^ and dependencies... I tried to fix it | 16:52 |
| *** oidgar has quit IRC | 16:54 | |
| *** fragatina has quit IRC | 16:57 | |
| *** dprince has quit IRC | 16:59 | |
| milan | dtantsur, thx | 16:59 |
| *** udesale has quit IRC | 17:00 | |
| *** weshay is now known as weshay_mtg | 17:00 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/522618 | 17:02 |
| *** pradk_ has joined #tripleo | 17:03 | |
| *** moshele has joined #tripleo | 17:03 | |
| jbadiapa | any core reviewers can take a look at https://review.openstack.org/#/c/500935/? | 17:04 |
| *** pradk has quit IRC | 17:05 | |
| *** lucasagomes is now known as lucas-afk | 17:06 | |
| *** Guest78_ has joined #tripleo | 17:08 | |
| *** dsariel has quit IRC | 17:09 | |
| *** sshnaidm|rover is now known as sshnaidm|rover|m | 17:10 | |
| *** sshnaidm|rover|m is now known as sshnaidm|rover | 17:10 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 17:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Mehdi Abaakouk (sileht) | 17:10 |
| *** holser has quit IRC | 17:14 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/522618 | 17:15 |
| *** moshele has quit IRC | 17:17 | |
| *** fragatina has joined #tripleo | 17:20 | |
| *** moshele has joined #tripleo | 17:22 | |
| *** jfrancoa has quit IRC | 17:22 | |
| *** thrash is now known as thrash|biab | 17:25 | |
| *** florianf is now known as florianf|afk | 17:26 | |
| *** abregman has quit IRC | 17:26 | |
| openstackgerrit | Juan Badia Payno proposed openstack/puppet-tripleo master: Let collectd manage repo and added unit test https://review.openstack.org/521629 | 17:26 |
| *** rbowen has joined #tripleo | 17:27 | |
| *** gkadam_ has quit IRC | 17:27 | |
| *** artom_ is now known as artom | 17:27 | |
| *** jpich has quit IRC | 17:29 | |
| *** dougbtv_ has joined #tripleo | 17:32 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud master: [WIP] Use the new dnsmasq PXE filter in ironic-inspector https://review.openstack.org/523944 | 17:32 |
| dtantsur | milan: ^^^ | 17:33 |
| milan | dtantsur, thx, /me looks | 17:33 |
| dtantsur | milan: now I also realize that we have to update RDO packaging to create the hostsdir directory | 17:33 |
| dtantsur | milan: feel free to propose an update to https://github.com/rdo-packages/ironic-inspector-distgit/blob/rpm-master/openstack-ironic-inspector.spec#L179 for that | 17:33 |
| milan | dtantsur, yeah I wanted to have it created by the python package of inspector but somehow was defered | 17:34 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-quickstart-extras master: Remove mon_use_fqdn from cloud-names.yaml https://review.openstack.org/523945 | 17:34 |
| milan | dtantsur, thx. Will look into it | 17:34 |
| chem | EmilienM: hi, do you know who should I ask to for a question about delorean-current ? | 17:34 |
| *** iranzo has quit IRC | 17:34 | |
| *** dciabrin__ has joined #tripleo | 17:35 | |
| EmilienM | chem: yeah, here, or on #rdo, to me, amoralej, jpena for example | 17:35 |
| *** moshele has quit IRC | 17:35 | |
| chem | EmilienM: hum, amoralej send me here, so I guess, I'll ask you. It very quick, delorean-current is only for master right ? | 17:36 |
| EmilienM | chem: no, there is a current for each release | 17:37 |
| EmilienM | https://trunk.rdoproject.org/centos7-pike/current/ | 17:37 |
| EmilienM | current means: latest packages from upstream, that managed to be built | 17:37 |
| amoralej | EmilienM, the point is that in a upgrade job | 17:37 |
| EmilienM | they aren't tested by any CI job | 17:37 |
| amoralej | o->p | 17:37 |
| amoralej | in pike there is only delorean and delorean-deps repos configured | 17:37 |
| amoralej | not delorean-current | 17:37 |
| amoralej | is that expected? | 17:37 |
| *** gbarros has joined #tripleo | 17:38 | |
| *** salmankhan has quit IRC | 17:38 | |
| *** dciabrin_ has quit IRC | 17:38 | |
| *** gbarros_ has quit IRC | 17:38 | |
| chem | EmilienM: amoralej said it all :) | 17:38 |
| *** mdnadeem has quit IRC | 17:40 | |
| EmilienM | amoralej: I don't know | 17:40 |
| EmilienM | amoralej: configured where? | 17:40 |
| amoralej | in the undercloud | 17:40 |
| EmilienM | ah in tripleo ok | 17:41 |
| amoralej | yes | 17:41 |
| amoralej | in tripleo-ci | 17:41 |
| EmilienM | amoralej: I don't know | 17:41 |
| EmilienM | amoralej: imho, we should test upgrades between tested repos only | 17:41 |
| EmilienM | amoralej: except for tripleo project, use current | 17:41 |
| amoralej | yeah, i agree | 17:41 |
| EmilienM | like we do in master | 17:41 |
| amoralej | yes | 17:41 |
| EmilienM | does it make sense? | 17:41 |
| amoralej | in this case | 17:41 |
| amoralej | as chem explained me | 17:41 |
| amoralej | job is gating a tht review | 17:42 |
| *** aufi has joined #tripleo | 17:42 | |
| amoralej | which needs tripleo-common newer that promoted | 17:42 |
| amoralej | that's why it needs delorean-current with includepkgs | 17:42 |
| amoralej | for tripleo and family | 17:42 |
| amoralej | i think that's done in master | 17:42 |
| amoralej | but apparently not in upgrade jobs | 17:42 |
| *** pkovar has quit IRC | 17:44 | |
| EmilienM | amoralej: I would +2 a patch that fix it | 17:44 |
| *** yprokule has quit IRC | 17:44 | |
| EmilienM | chem: are you working on upgrade jobs in RDO Third party CI? | 17:44 |
| chem | EmilienM: yeah, trying to get to the bottom of it | 17:44 |
| EmilienM | chem: I'm very happy to hear that :D | 17:45 |
| EmilienM | chem: we can take a look at tripleo ci config and fix the repos if you like | 17:45 |
| EmilienM | chem: I think it's something configured in tripleo-quickstart project | 17:45 |
| *** ffiore has quit IRC | 17:45 | |
| chem | EmilienM: yeah, was looking into that https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-upgrade/templates/upgrade-repo-tripleo-ci.sh.j2 | 17:46 |
| *** ffiore has joined #tripleo | 17:46 | |
| chem | EmilienM: I think that's the right one. I compare with my env. I'll ask more question if needed. The code looks ok and include delorean-current ... so investigating | 17:47 |
| EmilienM | chem: we need to patch this file and stop hardcoding "pike" | 17:48 |
| EmilienM | and find a way to use variables | 17:48 |
| *** milan has quit IRC | 17:49 | |
| chem | EmilienM: hum ... but right now it's not matching what I have in my undercloud/etc/yum.repos.d/ so not sure it's the right one. | 17:50 |
| *** derekh has quit IRC | 17:51 | |
| chem | EmilienM: will ping you when I have a better story. For the moment I have all I need to continue debugging | 17:51 |
| chem | EmilienM: amoralej thanks guys | 17:51 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Don't run functional test jobs for requirements changes https://review.openstack.org/523947 | 17:53 |
| EmilienM | chem: I use codesearch.openstack.org all the time, if it can help you | 17:55 |
| openstackgerrit | Emilien Macchi proposed openstack/os-collect-config master: Updated from global requirements https://review.openstack.org/520473 | 17:55 |
| chem | EmilienM: yummy | 17:56 |
| chem | EmilienM: the grep I was looking for :) | 17:56 |
| EmilienM | chem: this tool is life :D | 17:57 |
| *** cshastri has joined #tripleo | 17:57 | |
| chem | EmilienM: oh boy, it's super fast .. | 17:57 |
| EmilienM | chem: sometimes they have to restart it when it's slow, just mention it on #openstack-infra | 17:58 |
| EmilienM | chem: note, it's not branch aware :( | 17:58 |
| *** ebarrera has quit IRC | 17:59 | |
| *** moshele has joined #tripleo | 18:00 | |
| *** ansmith has quit IRC | 18:02 | |
| *** cshastri has quit IRC | 18:06 | |
| *** nyechiel has joined #tripleo | 18:07 | |
| *** dsneddon has joined #tripleo | 18:07 | |
| *** yamahata has quit IRC | 18:09 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 18:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Mehdi Abaakouk (sileht) | 18:10 |
| *** dtantsur is now known as dtantsur|afk | 18:10 | |
| *** moshele has quit IRC | 18:10 | |
| *** jmelvin has quit IRC | 18:12 | |
| *** fzdarsky is now known as fzdarsky|afk | 18:14 | |
| *** holser has joined #tripleo | 18:14 | |
| *** fpan has joined #tripleo | 18:15 | |
| chem | EmilienM: I need to drop, but I have a lead, will post review later today or tomorrow. I'll add you to the reviewer list. | 18:15 |
| EmilienM | chem: cool, ping me on irc when you have patch I'll take a look asap. Thanks!! | 18:15 |
| *** bogdando has quit IRC | 18:16 | |
| *** jpena is now known as jpena|away | 18:17 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Prepare 8.1.0 release (queens-m2) https://review.openstack.org/523952 | 18:17 |
| *** dprince has joined #tripleo | 18:19 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ui master: Prepare 8.1.0 release (queens-m2) https://review.openstack.org/523953 | 18:19 |
| *** hewbrocca is now known as hewbrocca_afk | 18:20 | |
| EmilienM | jrist: we don't have any test for tripleo-ui that create a tarball | 18:21 |
| *** salmankhan has joined #tripleo | 18:21 | |
| jrist | you mean like a release test? | 18:21 |
| EmilienM | something that we have with build-openstack-puppet-tarball for Puppet modules | 18:21 |
| EmilienM | jrist: yeah just the tarball part | 18:21 |
| *** fpan has quit IRC | 18:21 | |
| EmilienM | we have legacy-nodejs6-npm-run-test and nodejs-npm-run-lint | 18:21 |
| *** ansmith has joined #tripleo | 18:21 | |
| EmilienM | but they don't create tarballs afik | 18:22 |
| jrist | do we need a test that can create a tarball? | 18:22 |
| EmilienM | jrist: yep so we know it works when we have to release | 18:22 |
| jrist | is there a bug for this? | 18:22 |
| EmilienM | jrist: I'm looking at existing jobs in zuul-jobs and see if we could re-use a template | 18:22 |
| EmilienM | jrist: nope, I just realized it | 18:22 |
| *** fpan has joined #tripleo | 18:22 | |
| EmilienM | jrist: no big deal, I'm jus trying to improve our coverage on the go | 18:23 |
| *** sri_ has quit IRC | 18:23 | |
| jrist | cool well let me know if I can or the team can do anything to help | 18:23 |
| EmilienM | jrist: yeah I will. I'm investigating right now | 18:23 |
| *** tosky has quit IRC | 18:24 | |
| *** ansmith has quit IRC | 18:25 | |
| EmilienM | jrist: I found something that exists, i'm going to push a change and let you know | 18:26 |
| EmilienM | build-javascript-tarball exists and is only used in post release | 18:26 |
| jrist | ok thanks | 18:26 |
| *** salmankhan has quit IRC | 18:29 | |
| *** artom has quit IRC | 18:30 | |
| *** bfournie has left #tripleo | 18:30 | |
| *** artom has joined #tripleo | 18:30 | |
| *** bfournie has joined #tripleo | 18:32 | |
| *** gkadam_ has joined #tripleo | 18:35 | |
| *** dhill_ has quit IRC | 18:36 | |
| EmilienM | jrist: https://review.openstack.org/#/q/status:open+branch:master+topic:js-tarball - need to be reviewed carefully | 18:40 |
| jrist | ok | 18:40 |
| EmilienM | jrist: I'm not sure I can test it but i'll give it a try | 18:41 |
| jrist | wow ok | 18:42 |
| jrist | thanks! | 18:42 |
| EmilienM | sshnaidm|rover: one ipv6 job failed to run networking bits | 18:42 |
| jrist | we are pretty busy with pike testing | 18:42 |
| EmilienM | jrist: pabelanger gave a review already I need to change something | 18:42 |
| mwhahaha | sileht, pradk_: http://logs.openstack.org/15/523715/6/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/17d62cb/logs/subnode-2/var/log/journal.txt.gz#_Nov_29_18_00_48 cannot access /etc/ceph. So i don't think we're properly exposing the /etc/ceph config | 18:42 |
| *** weshay_mtg is now known as weshay | 18:42 | |
| sshnaidm|rover | EmilienM, looking.. | 18:44 |
| *** ffiore has quit IRC | 18:44 | |
| *** yamahata has joined #tripleo | 18:44 | |
| EmilienM | sshnaidm|rover: I think it's yours | 18:44 |
| EmilienM | http://logs.openstack.org/03/523903/2/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq-ipv6/dec8291/logs/undercloud/home/zuul/overcloud_prep_network.log.txt.gz | 18:45 |
| EmilienM | sshnaidm|rover: ^ see | 18:45 |
| EmilienM | sshnaidm|rover: probably in https://review.openstack.org/#/c/523477 | 18:46 |
| sshnaidm|rover | EmilienM, it's piece of code with iptables.. it should be ip6tables there.. | 18:47 |
| *** rbowen has quit IRC | 18:48 | |
| *** rbowen has joined #tripleo | 18:48 | |
| *** ansmith has joined #tripleo | 18:50 | |
| EmilienM | sshnaidm|rover: we're making progress :D | 18:51 |
| sshnaidm|rover | EmilienM, it's strange actually.. we have already working ipv6 job, shouldn't fail like that.. I'll fix it tomorrow | 18:52 |
| EmilienM | sshnaidm|rover: we don't test external access | 18:54 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ui master: DNM - javascript tarball test https://review.openstack.org/523964 | 18:54 |
| *** mcornea has quit IRC | 18:55 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ui master: DNM - javascript tarball test https://review.openstack.org/523964 | 18:56 |
| EmilienM | jrist: I'm testing my changes now ^ and see if tarballs are really created | 18:57 |
| EmilienM | pabelanger: ^ fyi | 18:57 |
| *** oidgar has joined #tripleo | 18:57 | |
| *** jmelvin has joined #tripleo | 18:57 | |
| *** paramite has quit IRC | 18:58 | |
| jrist | EmilienM: cool | 19:01 |
| jrist | EmilienM: I really appreciate it | 19:01 |
| *** dhill_ has joined #tripleo | 19:04 | |
| EmilienM | my pleasure | 19:04 |
| *** amoralej is now known as amoralej|off | 19:05 | |
| *** lblanchard has joined #tripleo | 19:05 | |
| *** pblaho has quit IRC | 19:07 | |
| zzzeek | weshay: I'm having doubts that this is a valid ansible syntax: https://review.openstack.org/#/c/514794/1/playbooks/quickstart-extras-validate.yml e.g. { role: validate-ui, when: validate_ui_simple|bool }. that flag is not making this feature not occur for me and i dont see this syntax at http://docs.ansible.com/ansible/latest/playbooks_reuse_roles.html | 19:07 |
| *** fpan_ has joined #tripleo | 19:08 | |
| *** fpan has quit IRC | 19:08 | |
| *** Goneri has quit IRC | 19:08 | |
| *** aufi has quit IRC | 19:08 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 19:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Mehdi Abaakouk (sileht) | 19:10 |
| *** lblanchard has quit IRC | 19:10 | |
| *** pradk_ is now known as pradk | 19:10 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: gnocchi: mount the correct volume for /etc/ceph https://review.openstack.org/523715 | 19:11 |
| sileht | mwhahaha, we didn't expose any kolla config for gnocchi_db_sync | 19:12 |
| Tengu | EmilienM: hello! | 19:12 |
| sileht | mwhahaha, I have added /var/lib/kolla/config_files/gnocchi_db_sync.json | 19:12 |
| * sileht wait next run to finish | 19:12 | |
| Tengu | EmilienM: small remark regarding jbadiapa patch for collectd: allowing to enable EPEL without and safe-guard will most probably break tripleo at some point due to library version issues if some of them are taken from EPEL | 19:13 |
| *** akrivoka has quit IRC | 19:13 | |
| pradk | sileht, hmm isnt the api json enough as its running db sync in same container? just after one more step.. well lets see | 19:13 |
| pradk | and why do we need to run httpd for gnocchi-db-sync? | 19:14 |
| sileht | pradk, you mean renaming gnocchi_db_sync: or gnocchi_api: ? | 19:14 |
| sileht | pradk, I haven't touch the httpd think, but htat only logging | 19:15 |
| EmilienM | Tengu: so we can't use hiera for that? | 19:15 |
| Tengu | EmilienM: well, the EPEL wrapper I created can help for that ;). really. | 19:15 |
| *** fpan_ has quit IRC | 19:15 | |
| EmilienM | Tengu: I haven't taken time to have a look tbh | 19:16 |
| Tengu | EmilienM: i.e. if one sets tripleo::profile::base::metrics::collectd::manage_repo to true, it might be good to ensure only collectd-related packages are taken from epel | 19:16 |
| *** fpan has joined #tripleo | 19:16 | |
| Tengu | that's really important - I had some issues when I wanted to install certbot from epel on my deploy. | 19:16 |
| Tengu | ended in a "duh.... ok, re-deploy from zero" | 19:17 |
| Tengu | EmilienM: https://review.openstack.org/#/c/522720/ it's now abandonned, but I think we can re-activate it - else I can do a new review if needed. | 19:17 |
| *** holser has quit IRC | 19:18 | |
| weshay | sshnaidm|rover, https://review.openstack.org/#/c/517445/ | 19:18 |
| *** tosky has joined #tripleo | 19:18 | |
| EmilienM | Tengu: we should never deploy EPEL | 19:19 |
| EmilienM | Tengu: EPEL is not compatible with RDO, since 2 years | 19:20 |
| Tengu | EmilienM: true. but puppet-collectd deploys epel repository if we let it manage it | 19:20 |
| EmilienM | it deploys it in the unit tests | 19:20 |
| Tengu | EmilienM: my patch call the puppet-epel but deactivate by default epel repostories | 19:20 |
| EmilienM | not in reality | 19:20 |
| Tengu | EmilienM: oh. ok. but that means the reality doesn't match the unit tests | 19:21 |
| Tengu | or the contrary | 19:21 |
| Tengu | EmilienM: thus the module installed in the units should be the same version in the rpm package - thus the old one, lagging over 600 commits I guess? | 19:22 |
| *** fpan_ has joined #tripleo | 19:24 | |
| EmilienM | Tengu: probably | 19:24 |
| *** fpan has quit IRC | 19:25 | |
| Tengu | ok. or we might consider updating the old module :Þ | 19:25 |
| Tengu | not sure the lagging version has the manage_repo param | 19:25 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Don't run functional test jobs for requirements changes https://review.openstack.org/523947 | 19:27 |
| *** fpan has joined #tripleo | 19:28 | |
| *** fpan_ has quit IRC | 19:29 | |
| *** nyechiel has quit IRC | 19:31 | |
| Tengu | EmilienM: do you think I might open an issue in order to update the puppet-collectd module? Apparently it's in the RDO project tree, not tripleO | 19:31 |
| EmilienM | Tengu: go for it | 19:32 |
| EmilienM | larsks: ^ can you or someone from your team assist if needed? | 19:32 |
| Tengu | EmilienM: where should I open that issue? trying to get a hand on the right location | 19:32 |
| EmilienM | Tengu: in the fork? | 19:33 |
| Tengu | EmilienM: directly on github? | 19:33 |
| openstackgerrit | Merged openstack/tripleo-ui master: Prepare 8.1.0 release (queens-m2) https://review.openstack.org/523953 | 19:33 |
| larsks | EmilienM: Sure. I suspect we're the only consumers of it, right? | 19:33 |
| larsks | At least within tripleo... | 19:33 |
| Tengu | larsks: hmm, woudln't it be easier to take upstream directly then? or is this repository/project (https://github.com/rdo-puppet-modules/puppet-module-collectd) "the" source for all the rpms? | 19:34 |
| Tengu | EmilienM: ah, seems it's directly on github. ook. | 19:34 |
| Tengu | ok, redhat bugzilla, code on github and reviews on review.rdoproject.org. got it :) | 19:35 |
| larsks | Tengu: I don't know what the story is w/r/t packaging, but we do need to consume it in packaged form. It shouldn't be too difficult to get the RDO packages up to date. | 19:35 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Disable tls for redis https://review.openstack.org/523969 | 19:35 |
| Tengu | larsks: it's only lagging, apparently. BUT there's the epel part, and this one must be managed in a proper way in order to avoid any issue. Two ways for that. I'll open a bug on the Zilla, and we might discuss it. Just have to create my account. | 19:36 |
| larsks | Okay. I am happy to help with testing, but I'll probably direct packaging questions to the rdo folks... | 19:37 |
| Tengu | :) | 19:37 |
| *** salmankhan has joined #tripleo | 19:40 | |
| jtomasek | honza, EmilienM: that job builds only deps? What is it exactly used for? | 19:40 |
| Tengu | larsks: so I open an issue on redhat's bugzilla, in rdo product, asking for an update of the puppet-collectd module. I think it's the right way to do things… ? | 19:41 |
| EmilienM | jtomasek: used to test what happens when you run "npm pack" command in the root directory | 19:41 |
| EmilienM | jtomasek: so before producing a release, we know we can create a tarball correctly | 19:41 |
| EmilienM | jtomasek: does it make sense? | 19:41 |
| *** myoung is now known as myoung|bbl | 19:43 | |
| * EmilienM out for lunch | 19:44 | |
| jtomasek | honza, EmilienM I think it is clearer now. it is completely. new job, right? we didn't run anything like that before | 19:44 |
| EmilienM | jtomasek: any feedback is welcome in the review | 19:45 |
| EmilienM | jtomasek: yep exactly | 19:45 |
| EmilienM | it's a new thing | 19:45 |
| EmilienM | and we don't change anything from before | 19:45 |
| jtomasek | ok | 19:45 |
| *** fpan has quit IRC | 19:47 | |
| *** fpan has joined #tripleo | 19:48 | |
| *** jpena|away is now known as jpena|off | 19:48 | |
| *** rwsu has quit IRC | 19:49 | |
| Tengu | EmilienM, larsks : opened issue on bugzilla - will wait for feedback on that. Now I'm off, it's starting to be late in here :). | 19:49 |
| *** fpan has quit IRC | 19:50 | |
| Tengu | EmilienM: oh… you probably got a mail pointing to the issue in fact. Hope I did it right -.-'. | 19:50 |
| *** thrash|biab is now known as thrash | 19:53 | |
| *** gfidente is now known as gfidente|afk | 19:53 | |
| *** dprince has quit IRC | 19:53 | |
| *** fpan has joined #tripleo | 19:55 | |
| *** moshele has joined #tripleo | 19:55 | |
| *** sshnaidm|rover is now known as sshnaidm|off | 20:01 | |
| *** rfolco is now known as rfolco|off | 20:04 | |
| *** dougbtv_ has quit IRC | 20:06 | |
| *** paramite has joined #tripleo | 20:07 | |
| *** oidgar has quit IRC | 20:08 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 20:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Mehdi Abaakouk (sileht) | 20:10 |
| openstackgerrit | Toure Dunnon proposed openstack/tripleo-common master: Migrate the ansible actions from tripleo-common to mistral-extra. https://review.openstack.org/523540 | 20:13 |
| *** salmankhan has quit IRC | 20:14 | |
| *** salmankhan has joined #tripleo | 20:15 | |
| openstackgerrit | Toure Dunnon proposed openstack/tripleo-common master: Migrate the ansible actions from tripleo-common to mistral-extra. https://review.openstack.org/523540 | 20:15 |
| *** trown is now known as trown|brb | 20:18 | |
| *** spectr has joined #tripleo | 20:18 | |
| *** spectr has quit IRC | 20:20 | |
| *** hjensas has quit IRC | 20:22 | |
| *** morazi has quit IRC | 20:23 | |
| *** gfidente|afk has quit IRC | 20:23 | |
| *** dprince has joined #tripleo | 20:26 | |
| *** salmankhan1 has joined #tripleo | 20:26 | |
| *** salmankhan has quit IRC | 20:27 | |
| *** salmankhan1 is now known as salmankhan | 20:27 | |
| *** milan has joined #tripleo | 20:29 | |
| *** rwsu has joined #tripleo | 20:30 | |
| *** atoth has quit IRC | 20:32 | |
| *** moshele has quit IRC | 20:32 | |
| *** milan has quit IRC | 20:35 | |
| *** Goneri has joined #tripleo | 20:39 | |
| *** artom has quit IRC | 20:40 | |
| *** rbowen_ has joined #tripleo | 20:41 | |
| *** ansmith has quit IRC | 20:41 | |
| *** ebarrera has joined #tripleo | 20:42 | |
| *** rbowen has quit IRC | 20:44 | |
| *** trown|brb is now known as trown | 20:44 | |
| *** threestrands has joined #tripleo | 20:47 | |
| *** rbowen_ has quit IRC | 20:47 | |
| *** dprince has quit IRC | 20:47 | |
| *** agurenko has quit IRC | 20:50 | |
| *** gbarros has quit IRC | 20:51 | |
| *** salmankhan has quit IRC | 20:52 | |
| *** holser has joined #tripleo | 20:56 | |
| *** pcaruana has quit IRC | 21:00 | |
| *** salmankhan has joined #tripleo | 21:01 | |
| *** aputtur_ has quit IRC | 21:03 | |
| *** hjensas has joined #tripleo | 21:04 | |
| *** hjensas has quit IRC | 21:04 | |
| *** hjensas has joined #tripleo | 21:04 | |
| *** moshele has joined #tripleo | 21:04 | |
| *** dprince has joined #tripleo | 21:05 | |
| *** morazi has joined #tripleo | 21:05 | |
| *** d0ugal has quit IRC | 21:07 | |
| *** fpan has quit IRC | 21:07 | |
| *** fpan has joined #tripleo | 21:07 | |
| *** liverpooler has quit IRC | 21:08 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 21:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Mehdi Abaakouk (sileht) | 21:10 |
| *** gbarros has joined #tripleo | 21:12 | |
| EmilienM | cores: https://review.openstack.org/#/c/523947/ | 21:15 |
| *** fpan has quit IRC | 21:17 | |
| *** fpan has joined #tripleo | 21:17 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add ui_validate_simple to the logs collected https://review.openstack.org/523461 | 21:17 |
| EmilienM | sshnaidm|off: the bug is here: https://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/overcloud-prep-network/templates/overcloud-prep-network.sh.j2#n35 | 21:18 |
| *** rbowen has joined #tripleo | 21:19 | |
| *** rbowen has joined #tripleo | 21:19 | |
| *** raildo has quit IRC | 21:20 | |
| *** jtomasek has quit IRC | 21:21 | |
| *** holser has quit IRC | 21:21 | |
| *** myoung|bbl is now known as myoung | 21:22 | |
| *** rbowen has quit IRC | 21:24 | |
| *** tvignaud has quit IRC | 21:24 | |
| *** rbowen has joined #tripleo | 21:24 | |
| openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add multiple secret store backends for barbican https://review.openstack.org/523539 | 21:27 |
| mwhahaha | so what gate failures are we having today | 21:30 |
| mwhahaha | cause the top patch is 6 hours and looks to have just been restarted | 21:30 |
| mwhahaha | https://review.openstack.org/#/c/521650/ | 21:31 |
| mwhahaha | stupid TIMED_OUT | 21:31 |
| mwhahaha | and of course no logs | 21:32 |
| openstackgerrit | wes hayutin proposed openstack/python-tripleoclient master: Generate undercloud-passwords.conf and fix output dir. https://review.openstack.org/523511 | 21:32 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: DNM: Update quickstart extras with undercloud install for containers https://review.openstack.org/517444 | 21:33 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: DNM: Update undercloud install options for containers https://review.openstack.org/517445 | 21:33 |
| *** ccamacho has quit IRC | 21:33 | |
| openstackgerrit | wes hayutin proposed openstack/instack-undercloud master: DNM, TESTING ONLY https://review.openstack.org/518118 | 21:34 |
| *** dprince has quit IRC | 21:34 | |
| *** aputtur_ has joined #tripleo | 21:37 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: gnocchi: mount the correct volume for /etc/ceph https://review.openstack.org/523715 | 21:37 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: IPv6 various fixes https://review.openstack.org/523477 | 21:37 |
| EmilienM | sshnaidm|off: ^ | 21:37 |
| EmilienM | sshnaidm|off: in fact I'm going to split the patches | 21:39 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: WIP: Fix SSL certs creation for ipv6 https://review.openstack.org/523477 | 21:41 |
| *** tvignaud has joined #tripleo | 21:41 | |
| *** gbarros has quit IRC | 21:44 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Add ipv6 support to overcloud-prep-network https://review.openstack.org/523997 | 21:46 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: WIP: Fix SSL certs creation for ipv6 https://review.openstack.org/523477 | 21:47 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: WIP: Fix SSL certs creation for ipv6 https://review.openstack.org/523477 | 21:47 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Use IPv6 PublicVirtualFixedIps when needed https://review.openstack.org/522714 | 21:47 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/522618 | 21:48 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: gnocchi: mount the correct volume for /etc/ceph https://review.openstack.org/523715 | 21:49 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: DONT MERGE: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 21:49 |
| *** ccamacho has joined #tripleo | 21:50 | |
| *** rwsu has quit IRC | 21:51 | |
| *** paramite has quit IRC | 21:53 | |
| *** aputtur_ has quit IRC | 21:55 | |
| weshay | EmilienM, Slower https://review.openstack.org/#/q/topic:undercloud_container+(status:open+OR+status:merged) | 21:58 |
| weshay | Slower, anything missing from that? | 21:59 |
| *** fpan has quit IRC | 22:00 | |
| EmilienM | weshay: lgtm, thanks | 22:00 |
| *** rcernin has joined #tripleo | 22:03 | |
| rlandy|ruck | weshay: pls see the latest master promotion run - we're looking at the same fs016 and fs019 errors as we have been seeing in pike. The rest is green | 22:03 |
| weshay | rlandy|ruck, ok.. the issues are escalated for both releases ya? | 22:04 |
| rlandy|ruck | weshay: we have https://bugs.launchpad.net/tripleo/+bug/1734747 as the related bug | 22:04 |
| openstack | Launchpad bug 1734747 in tripleo "YAQLEvaluationException in workflow error message for create_admin" [Critical,Triaged] | 22:04 |
| rlandy|ruck | which is not very clear | 22:05 |
| rlandy|ruck | but yes, both releases are on the escalation board | 22:05 |
| *** rbowen has quit IRC | 22:05 | |
| weshay | rlandy|ruck, thanks | 22:05 |
| *** jkilpatr has quit IRC | 22:05 | |
| *** abishop has quit IRC | 22:09 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 22:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Mehdi Abaakouk (sileht) | 22:10 |
| *** pchavva has quit IRC | 22:11 | |
| *** Goneri has quit IRC | 22:13 | |
| *** Goneri has joined #tripleo | 22:13 | |
| *** salmankhan has quit IRC | 22:16 | |
| openstackgerrit | Tony Breeds proposed openstack/tripleo-heat-templates stable/pike: Add ComputeAlt role and environment https://review.openstack.org/524008 | 22:20 |
| *** athomas has quit IRC | 22:24 | |
| matbu | mwhahaha: looks like this patch is stuck in the queue | 22:26 |
| matbu | https://review.openstack.org/523802 | 22:26 |
| mwhahaha | it's not stuck | 22:26 |
| mwhahaha | gate failures | 22:26 |
| matbu | mwhahaha: ha ok, so fast man :) | 22:26 |
| mwhahaha | matbu: specifically https://review.openstack.org/#/c/521650/ the TIMED_OUT caused the gate to be backed up for 6 hours and then reset the queue when it failed | 22:27 |
| mwhahaha | so, patience is all i can advise | 22:27 |
| matbu | mwhahaha: ack thx, i was just about going to bed, so patience is fine ;) | 22:27 |
| mwhahaha | matbu: i'll try and keep an eye on it and maybe get the backport started later tonight | 22:28 |
| matbu | great thank you very much | 22:28 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Redis replication does not work with TLS https://review.openstack.org/524009 | 22:29 |
| *** jkilpatr has joined #tripleo | 22:29 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates stable/pike: Redis replication does not work with TLS https://review.openstack.org/524010 | 22:30 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Redis replication does not work with TLS https://review.openstack.org/524012 | 22:31 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Set notification_format to 'unversioned' https://review.openstack.org/522644 | 22:32 |
| *** rlandy|ruck is now known as rlandy|ruck|brb | 22:33 | |
| *** pmannidi has joined #tripleo | 22:36 | |
| *** etingof has quit IRC | 22:37 | |
| *** Goneri has quit IRC | 22:40 | |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-docs master: Update docs to reflect updates to os-net-config mechanism https://review.openstack.org/521197 | 22:42 |
| bugzy | dtantsur|afk, dsneddon, bnemec: I am running into a network issue with deploying multiple overclouds with HA + HCI, and I am hoping that one of you can help resolve the problem or point me in the right direction. | 22:43 |
| bugzy | The primary issue is that networks need to be renamed per overcloud and that services on each overcloud must be remapped to their respective renamed network. See https://bugs.launchpad.net/tripleo/+bug/1632327 (particularly https://bugs.launchpad.net/tripleo/+bug/1632327/comments/3) | 22:43 |
| openstack | Launchpad bug 1632327 in tripleo "Defining networks inconvenient when deploying multiple overclouds" [Medium,Triaged] | 22:43 |
| bugzy | Based on a modification of the instructions in the now abandoned documentation for deploying multiple overclouds by dtantsur (See https://review.openstack.org/#/c/368840/2/doc/source/advanced_deployment/multiple_overclouds.rst), I copied all the service to network maps in https://github.com/openstack/tripleo-heat-templates/blob/stable/pike/network/service_net_map.j2.yaml and remapped them accordingly. | 22:43 |
| bugzy | When the default networks are used, overcloud deployment succeeds. However, when the renaming and remapping is added to the environment file, the deployment fails when bringing up the galera cluster for the control nodes. | 22:44 |
| bugzy | The relevant parts of the environment file are posted here: https://paste.fedoraproject.org/paste/cbsXB3iX2xUTJbnEsH9a5Q | 22:44 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Redis replication does not work with TLS https://review.openstack.org/524009 | 22:44 |
| bugzy | and the error log is posted here: https://paste.fedoraproject.org/paste/rYMTQAaz1Hc272G9GziVaQ | 22:44 |
| bugzy | This is being attempted on Pike stable | 22:46 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Redis replication does not work with TLS https://review.openstack.org/524012 | 22:47 |
| dsneddon | bugzy, In order to diagnose this, I'll need to see the custom network_data.yaml and the NIC configs. I suspect that the hosts aren't getting the intended IP addresses from the custom networks. | 22:48 |
| *** paramite has joined #tripleo | 22:48 | |
| dsneddon | bugzy, You need to add the resource definitions for any custom networks to the top of the NIC config files. I have a review in progress which will do this automatically when it lands: https://review.openstack.org/#/c/523638/ | 22:48 |
| *** bfournie has quit IRC | 22:49 | |
| bugzy | hrmm, I did not post that portion but here you go https://cloud.nixserve.net/index.php/s/fS40RlF0oslxhxl | 22:52 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-ui master: Allow .tgz format for plan upload https://review.openstack.org/524014 | 22:55 |
| *** rlandy|ruck|brb is now known as rlandy|ruck | 22:55 | |
| bugzy | dsneddon: the above linked zip file contains network templates and nic-configs for the entire setup. They were generated using bnemec's tool and customized to work with the ComputeCHI role | 22:56 |
| *** Goneri has joined #tripleo | 22:56 | |
| bugzy | s/CHI/HCI/ | 22:56 |
| dsneddon | bugzy, OK, but maybe I'm missing something but I don't see any custom networks. | 22:56 |
| dsneddon | bugzy, Just the built-in ones. | 22:56 |
| *** etingof has joined #tripleo | 22:56 | |
| bnemec | They aren't custom networks though, are they? Just renames of the default ones. | 22:57 |
| bugzy | dsneddon: sorry. I misspoke, there are no custom networks, just renamed builtin networks | 22:57 |
| dsneddon | bugzy, OK, that should be fine, I'll look again with that in mind. | 22:58 |
| bugzy | bnemec: right | 22:58 |
| *** Guest78_ has quit IRC | 22:59 | |
| EmilienM | mwhahaha, weshay: just an FYI but in Rocky, OpenStack projects might move to Storyboard | 23:03 |
| dsneddon | bugzy, So, by renamed, do you mean you are using the default networks, just for different purposes than they were originally used for in ServiceNetMap? | 23:03 |
| EmilienM | mwhahaha, weshay: it might be a community goal for Rocky but still under discussion | 23:03 |
| mwhahaha | EmilienM: so how's the import process from LP | 23:03 |
| EmilienM | mwhahaha, weshay: on tripleo, we have some tools pulling from launchpad, we might need to update them in the future for storyboard | 23:03 |
| * mwhahaha would prefer not to as much as I hate LP | 23:03 | |
| EmilienM | mwhahaha: there is an import process AFIK | 23:04 |
| EmilienM | but I haven't tested myself | 23:04 |
| *** ccamacho has quit IRC | 23:04 | |
| EmilienM | I could ask | 23:04 |
| weshay | fun | 23:04 |
| weshay | I wonder when openstack is going to rewrite linux | 23:04 |
| mwhahaha | weshay: containers. | 23:04 |
| weshay | :) | 23:04 |
| *** d0ugal has joined #tripleo | 23:05 | |
| weshay | jk.. I don't really have a big preference | 23:05 |
| weshay | but trolling EmilienM is fun | 23:05 |
| mwhahaha | always | 23:05 |
| bugzy | dsneddon: not at all, they are being used for the same purposes. However, if I wish to manage a second overcloud from the same undercloud, the network names for the second overcloud should not match the first; otherwise, the deployment will fail | 23:05 |
| bugzy | dsneddon: that is the bug reported at https://bugs.launchpad.net/tripleo/+bug/1632327 | 23:06 |
| openstack | Launchpad bug 1632327 in tripleo "Defining networks inconvenient when deploying multiple overclouds" [Medium,Triaged] | 23:06 |
| dsneddon | bugzy, Right, which is why I assumed that you'd be creating a bunch of custom networks for the second deployment, and replacing all the names in the ServiceNetMap with different (custom) network names. | 23:06 |
| bugzy | I see | 23:06 |
| *** ipsecguy has quit IRC | 23:06 | |
| dsneddon | bugzy, Which will only work in Pike+, and you will need to customize your NIC configs, since I don't think bnemec's tool has been updated to support custom networks. | 23:07 |
| dsneddon | bugzy, Another approach, especially in older versions, is to use only a limited number of the built-in networks for each deployment, but just split the built-in networks between the envs. | 23:07 |
| bnemec | It has not, unfortunately | 23:08 |
| dsneddon | bugzy, I don't see anything wrong with your current setup that would make deployments fail for Galera | 23:08 |
| EmilienM | mwhahaha, weshay: be careful when trolling french canadians | 23:09 |
| mwhahaha | EmilienM: because you might appologize in french? | 23:09 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci master: DNM: Test minimum unbound TTL for TripleO jobs https://review.openstack.org/524018 | 23:10 |
| weshay | is that talking shit in french canadian? | 23:10 |
| EmilienM | mwhahaha: french people don't apologize. | 23:10 |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1734134 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] - Assigned to Daniel Alvarez (dalvarezs) | 23:10 |
| openstack | Launchpad bug 1734134 in tripleo "Pike periodic promotion job multinode-1ctlr-featureset016 fail with error running docker 'gnocchi_db_sync' - rados.Rados.connect PermissionDeniedError: error connecting to the cluster" [Critical,In progress] - Assigned to Mehdi Abaakouk (sileht) | 23:10 |
| dmsimard | EmilienM is french *and* canadian, I'm french canadian :P | 23:10 |
| EmilienM | dmsimard: I'm not canadian (yet) but I wish to be one day :-) | 23:10 |
| dmsimard | gotta swear allegiance to the queen! | 23:11 |
| mwhahaha | while playing hockey | 23:11 |
| bugzy | dsneddon: I see, the solution was more involved than I thought. It seems like the custom network route is the more reasonable path. | 23:11 |
| EmilienM | lol | 23:11 |
| dsneddon | EmilienM, I tried to become a Canadian. It's not as easy as one might expect. | 23:11 |
| weshay | Please be careful when choosing your words manfrair or will be force into a kerfuffle | 23:11 |
| EmilienM | dsneddon: did you? wow | 23:11 |
| EmilienM | dsneddon: did you spend time in Canada? | 23:12 |
| bugzy | dsneddon: is there doncumentation on "use only a limited number of the built-in networks for each deployment, but just split the built-in networks between the envs." | 23:12 |
| bugzy | documentation* | 23:12 |
| dsneddon | EmilienM, I lived in Vancouver for 7 months, but after waiting for 6 months for my work permit to be processed, I gave up and moved to Seattle. | 23:12 |
| EmilienM | dsneddon: ok, it's short indeed | 23:12 |
| EmilienM | dsneddon: I plan to apply after 5 years on the canadian ground | 23:13 |
| bugzy | or is that what I seem to be doing in my current setup | 23:13 |
| EmilienM | dsneddon: which is 2019 for me | 23:13 |
| dmsimard | weshay, mwhahaha, EmilienM: storyboard probably has a better API than launchpad FWIW | 23:13 |
| dsneddon | EmilienM, I was married to a Canadian at the time, and even that didn't make it easy | 23:13 |
| EmilienM | dmsimard: definitly | 23:13 |
| EmilienM | dsneddon: I can you could have staid with work permit and then applied for PR | 23:14 |
| *** jmelvin has quit IRC | 23:14 | |
| dsneddon | EmilienM, Yeah, that's the way it's supposed to work. This was in '97, and at the time the job market was hotter in Seattle. | 23:15 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Revert "Fix #1627402: fix grub2 element for ubuntu xenial" https://review.openstack.org/524019 | 23:16 |
| *** salmankhan has joined #tripleo | 23:16 | |
| EmilienM | dsneddon: nice, I live close to Seattle now, I need to visit this city | 23:17 |
| dsneddon | bugzy, I don't know if there is actually any documentation about how to do split-stack with only the built-in networks, but I know it's been done because I've come up with some custom templates for people doing that before. | 23:19 |
| dsneddon | bugzy, But part of the motivation behind Composable Networks is that you should be able to assign custom networks to a split stack. | 23:20 |
| bugzy | dsneddon: I see. It looks like I best start down the trail of custom networks. Thanks for the info, that should give me something to do for the time. | 23:21 |
| dsneddon | bugzy, I'm glad to help. I'm on West Coast time, so I'll be here for a few hours at least. | 23:23 |
| dsneddon | bugzy, Basic steps are to add the custom networks to network_data.yaml, with vip:true only on these networks: InternalApi2, Storage2, StorageMgmt2, and External2. Tenant2 and Management2 (if needed) won't have VIPs. | 23:25 |
| dsneddon | bugzy, Basically just duplicate the existing networks and add "2" or another suffix. | 23:25 |
| dsneddon | bugzy, Then add those <network>IpSubnet parameters to the NIC configs for both environments. | 23:26 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Use the network-environment file for all overcloud deployments https://review.openstack.org/521664 | 23:26 |
| dsneddon | bugzy, The custom networks have to have resource definitions in the NIC config files for both environments reflecting all networks due to Heat config. | 23:26 |
| bugzy | dsneddon: That makes sense. Also, glad to hear that you are available to help. Regrettably, I have to go teach class in about 30 minutes, so I will be unable to finish up and note the results until sometime tomorrow. Nevertheless, your guidance is greatly appreciated. | 23:29 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-ui master: Allow .tgz format for plan upload https://review.openstack.org/524014 | 23:29 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Add ipv6 support to overcloud-prep-network https://review.openstack.org/523997 | 23:29 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: WIP: Fix SSL certs creation for ipv6 https://review.openstack.org/523477 | 23:30 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Use IPv6 PublicVirtualFixedIps when needed https://review.openstack.org/522714 | 23:30 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/522618 | 23:30 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: DONT MERGE: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 23:31 |
| dsneddon | bugzy, Here is an example of a modified Controller.yaml that will work for environment A, then for environment B you will use the <network>2IpSubnet and <network>2NetworkVlanID instead of the original network names. | 23:32 |
| dsneddon | http://paste.openstack.org/show/627773/ | 23:32 |
| dsneddon | bugzy, So the parameter definitions at the top of the NIC configs can be the same between both environments, but you assign different VLAN IDs and IPs from different networks to the interfaces. | 23:33 |
| *** dparkes has quit IRC | 23:35 | |
| *** rbrady has quit IRC | 23:35 | |
| *** pradk has quit IRC | 23:36 | |
| *** fpan has joined #tripleo | 23:38 | |
| *** ipsecguy has joined #tripleo | 23:40 | |
| bugzy | dsneddon: I see, basically include all the networks definitions (default and custom) in both sets of nic-configs but specify VLAN ID IPs by overcloud environment | 23:41 |
| bugzy | which appears to be the case in the pasted controler config. | 23:42 |
| bugzy | dsneddon: oksy. gotta run. Thanks again! | 23:42 |
| *** salmankhan has quit IRC | 23:42 | |
| dsneddon | bugzy, See you around. | 23:42 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Make tripleo-buildimage-overcloud-full-centos-7 voting https://review.openstack.org/524025 | 23:44 |
| openstackgerrit | Merged openstack/diskimage-builder master: Fix grub2 dependency on arm64 https://review.openstack.org/512174 | 23:47 |
| openstackgerrit | Merged openstack/diskimage-builder master: Add debian minimal requirement for arm64 https://review.openstack.org/512175 | 23:47 |
| *** tesseract has joined #tripleo | 23:48 | |
| *** tesseract has quit IRC | 23:49 | |
| *** rbrady has joined #tripleo | 23:51 | |
| *** absubram has joined #tripleo | 23:55 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates master: WIP Designate Integration https://review.openstack.org/518998 | 23:56 |
| *** aputtur_ has joined #tripleo | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!