| *** tosky has quit IRC | 00:04 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
|---|---|---|
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 00:10 |
| *** lblanchard has joined #tripleo | 00:30 | |
| *** lblanchard has quit IRC | 00:45 | |
| *** dmacpher has joined #tripleo | 00:50 | |
| *** dhill_ has quit IRC | 01:06 | |
| *** psahoo has joined #tripleo | 01:06 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 01:10 |
| *** dhill_ has joined #tripleo | 01:11 | |
| *** bfournie has joined #tripleo | 01:18 | |
| *** dhill_ has quit IRC | 01:23 | |
| *** dhill_ has joined #tripleo | 01:23 | |
| *** fzdarsky_ has joined #tripleo | 01:49 | |
| *** tonyb has joined #tripleo | 01:50 | |
| *** fzdarsky__ has quit IRC | 01:53 | |
| *** fzdarsky_ has quit IRC | 01:54 | |
| *** fzdarsky_ has joined #tripleo | 01:58 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 02:10 |
| *** slaweq has joined #tripleo | 02:10 | |
| *** ramishra has joined #tripleo | 02:14 | |
| *** slaweq has quit IRC | 02:15 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Revert "Run containerized mistral-api eventlet" https://review.openstack.org/558557 | 02:22 |
| *** mdnadeem has joined #tripleo | 03:05 | |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: containerized/undercloud: disable verbosity by default https://review.openstack.org/559140 | 03:06 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: DNM - Test fs027 with --debug https://review.openstack.org/559179 | 03:07 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: DNM - Test fs027 with --debug https://review.openstack.org/559179 | 03:07 |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 03:10 |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| *** ykarel has joined #tripleo | 03:11 | |
| *** ykarel has quit IRC | 03:21 | |
| *** skramaja has joined #tripleo | 03:25 | |
| *** SlickNik has quit IRC | 03:30 | |
| *** SlickNik has joined #tripleo | 03:44 | |
| *** tzumainn has quit IRC | 03:53 | |
| *** SlickNik has quit IRC | 03:53 | |
| *** SlickNik has joined #tripleo | 03:53 | |
| *** janki has joined #tripleo | 03:53 | |
| *** mdnadeem has quit IRC | 04:04 | |
| *** pdeore has joined #tripleo | 04:08 | |
| *** pdeore has quit IRC | 04:08 | |
| *** shreshtha has joined #tripleo | 04:10 | |
| *** anilvenkata has joined #tripleo | 04:16 | |
| *** udesale has joined #tripleo | 04:17 | |
| *** psachin has joined #tripleo | 04:20 | |
| *** links has joined #tripleo | 04:25 | |
| *** karthiks has quit IRC | 04:26 | |
| *** jchhatbar has joined #tripleo | 04:30 | |
| *** ykarel has joined #tripleo | 04:32 | |
| *** janki has quit IRC | 04:33 | |
| *** fragatina has quit IRC | 04:35 | |
| *** fragatina has joined #tripleo | 04:42 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add ability to set protocol in endpoint_data.yaml file https://review.openstack.org/558423 | 04:42 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Default NodeTLSData to always attempt setting TLS cert https://review.openstack.org/556817 | 04:42 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add endpoint map environment without TLS https://review.openstack.org/559322 | 04:42 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Change default endpoint map entries to use TLS https://review.openstack.org/558424 | 04:42 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove empty default for SSLKey https://review.openstack.org/559279 | 04:42 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Default CertmongerUser to be defined for undercloud setup https://review.openstack.org/559620 | 04:42 |
| jaosorior | bandini: If you have some time to review. It would be very appreciated ^^ | 04:45 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Default CertmongerUser to be defined for undercloud setup https://review.openstack.org/559620 | 04:47 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Default NodeTLSData to always attempt setting TLS cert https://review.openstack.org/556817 | 04:47 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add endpoint map environment without TLS https://review.openstack.org/559322 | 04:47 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Change default endpoint map entries to use TLS https://review.openstack.org/558424 | 04:47 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove empty default for SSLKey https://review.openstack.org/559279 | 04:47 |
| *** nguyenhai has quit IRC | 04:55 | |
| *** nguyenhai has joined #tripleo | 04:56 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers https://review.openstack.org/551441 | 05:00 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Added enable_tempest flag for installing tempest on undercloud https://review.openstack.org/558510 | 05:01 |
| Tengu | hello there | 05:01 |
| *** artom has quit IRC | 05:02 | |
| *** artom has joined #tripleo | 05:02 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Run tempest on fs027 using containerized tempest https://review.openstack.org/551442 | 05:03 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Run tempest on undercloud on fs003 https://review.openstack.org/554522 | 05:03 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Rename test_regex to test_white_regex https://review.openstack.org/559281 | 05:04 |
| openstackgerrit | Chandan Kumar proposed openstack/python-tripleoclient master: Added fake tempest docker service to undercloud config https://review.openstack.org/551271 | 05:05 |
| *** ratailor has joined #tripleo | 05:09 | |
| *** pdeore has joined #tripleo | 05:16 | |
| *** pgadiya has joined #tripleo | 05:21 | |
| *** aufi has joined #tripleo | 05:22 | |
| *** skramaja has quit IRC | 05:26 | |
| *** waleedm has joined #tripleo | 05:28 | |
| *** skramaja has joined #tripleo | 05:28 | |
| *** hanish has joined #tripleo | 05:30 | |
| *** udesale_ has joined #tripleo | 05:30 | |
| *** udesale has quit IRC | 05:33 | |
| hanish | hi all, in my overcloud deployment with ovn, i get the following error The following mechanism drivers were not found: set(['ovn']), did anyone face the same issue | 05:34 |
| openstackgerrit | yatin proposed openstack/tripleo-heat-templates stable/queens: Set ulimit for neutron agent containers https://review.openstack.org/559631 | 05:37 |
| openstackgerrit | Saravanan KR proposed openstack/puppet-tripleo stable/newton: vhostuser socket dir shall be created for vhostuserclient mode https://review.openstack.org/559633 | 05:43 |
| *** jtomasek has joined #tripleo | 05:48 | |
| ykarel | hanish, when you see this Error? How are you deploying it? | 05:53 |
| hanish | ykarel: my overlcoud deployment is successful, but neutron_api server is not coming up, so i checked the logs. i am deploying ovn in non ha mode | 05:54 |
| ykarel | hanish, Ok, | 05:54 |
| ykarel | hanish, can you share your overcloud deploy command | 05:55 |
| ykarel | looks like some config is missing | 05:55 |
| *** radeks has joined #tripleo | 05:56 | |
| hanish | ykarel: please find here http://paste.openstack.org/show/718702/ | 05:59 |
| *** skramaja has quit IRC | 05:59 | |
| *** jbadiapa has joined #tripleo | 06:00 | |
| *** anande has joined #tripleo | 06:02 | |
| *** karthiks has joined #tripleo | 06:02 | |
| *** jfrancoa has joined #tripleo | 06:04 | |
| *** SlickNik has quit IRC | 06:05 | |
| hanish | ykarel: did i miss anything | 06:06 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Expand jinja variables in one place only https://review.openstack.org/558369 | 06:07 |
| ykarel | hanish, looks correct. what is there in lio_roles.yaml | 06:08 |
| ykarel | and which release you are installing | 06:09 |
| hanish | ykarel: lio_roles is my roles file, i did not change anything from standard controller services and i am trying out master | 06:10 |
| *** slaweq has joined #tripleo | 06:12 | |
| *** d0ugal has quit IRC | 06:12 | |
| *** holser__ has joined #tripleo | 06:13 | |
| *** SlickNik has joined #tripleo | 06:15 | |
| ykarel | hanish, can you check on controller if ovn is configured, and it's containers are running | 06:16 |
| *** slaweq has quit IRC | 06:17 | |
| hanish | yarkel: yes ovn containers are running on controller node | 06:17 |
| *** holser__ has quit IRC | 06:18 | |
| ykarel | and networking-ovn confituration exists under: /var/lib/config-data/neutron/etc/neutron/plugins/ | 06:20 |
| *** hamdyk has joined #tripleo | 06:21 | |
| *** agurenko has joined #tripleo | 06:22 | |
| ykarel | and sudo docker ps|grep neutron | 06:22 |
| *** yprokule has joined #tripleo | 06:22 | |
| numans | hanish, hi | 06:24 |
| numans | hanish, i see you are having some issues with neutron server and ovn | 06:24 |
| hanish | numans: yes | 06:25 |
| *** kopecmartin has joined #tripleo | 06:25 | |
| hanish | numans: i resolved the previous config file not found, by changing ovn from baremetal to container | 06:25 |
| numans | hanish, ok. your overcloud deploy command looks good to me. | 06:25 |
| *** holser__ has joined #tripleo | 06:26 | |
| hanish | numans: i am now facing an issue in the neutron server | 06:26 |
| hanish | numans ykarel: i do not see plugin configuration in /var/lib/config-data/neutron/etc/neutron/plugins/ml2 | 06:26 |
| hanish | numans, ykarel: only ml2_conf.ini and sriov_agent.ini | 06:27 |
| numans | hanish, you should see in /var/lib/config-data/puppet/generated/.. | 06:27 |
| numans | hanish, its /var/lib/config-data/puppet-generated/ | 06:27 |
| numans | hanish, do you see something there ? | 06:27 |
| ykarel | ahh that's the correct place to look for, i shared wrong one | 06:28 |
| numans | hanish, also you can get inside the neutron container ... docker exec <neutron-server> /bin/bash | 06:28 |
| numans | and see the value of /etc/neutron/plugins/ml2/ml2_conf.ini | 06:28 |
| hanish | numans: yes the configuration is good, i see ovn section in it | 06:29 |
| numans | hanish, if you can share the contents of ml2_conf.ini | 06:29 |
| numans | hanish, so you see the error when ? when creating a neutron resource ? | 06:30 |
| hanish | numans: yes when i tried to create neutron resource, then it said service unavailable, so i started debugging it | 06:31 |
| *** dmacpher has quit IRC | 06:31 | |
| numans | hanish, can you share the neutron-server logs in paste ? | 06:31 |
| openstackgerrit | Hamdy Khader proposed openstack/tripleo-heat-templates master: Add support for NVMeOF cinder backend https://review.openstack.org/559572 | 06:31 |
| numans | hanish, also verify on your controller node if all the ovn db services are running - docker ps | grep ovn | 06:32 |
| hanish | numans: ml2 conf http://paste.openstack.org/show/718703/ | 06:32 |
| numans | hanish, thanks. it looks good. can you run "ovn-nbctl --db=tcp:192.168.24.17:6641 show" and "ovn-sbctl --db=tcp:192.168.24.17:6642 show" and see if you get proper results | 06:33 |
| hanish | numans: server log http://paste.openstack.org/show/718704/ | 06:35 |
| *** pcaruana has joined #tripleo | 06:35 | |
| hanish | numans: south db shows my controller and compute but north db is empty | 06:36 |
| numans | hanish, yeah its expected, because you have not created any neutron resource | 06:36 |
| ykarel | so neutron-server-ovn is not there? | 06:36 |
| numans | hanish, seems to me the networking-ovn code is missing | 06:36 |
| hanish | numans: am i missing any step | 06:37 |
| numans | hanish, i got it what the problem is | 06:37 |
| numans | hanish, one sec | 06:37 |
| numans | hanish, when you run "sudo docker images | grep neutron-server" what output you see ? | 06:37 |
| ykarel | hanish, can you check: overcloud_containers.yaml on undercloud | 06:37 |
| numans | ykarel, the issue is his overcloud_containers.yml is pointing to neutron-server instead of neutron-server-ovn | 06:38 |
| ykarel | yes | 06:38 |
| hanish | olla/centos-binary-neutron-server-opendaylight 6.0.0-0.20180320091851.021dec0.el7.centos 7d58325d54ef 10 days ago 873 MB kolla/centos-binary-neutron-server 6.0.0-0.20180320091851.021dec0.el7.centos 677997647321 10 days ago 841 MB | 06:39 |
| numans | hanish, ideally you should have the below in containers-default-parameters.yaml in your undercloud | 06:40 |
| numans | DockerNeutronApiImage: 192.168.24.1:8787/tripleomaster/centos-binary-neutron-server-ovn:ad1779c561edabdd6446c5fa39f05e121a327d7f_710b9460 | 06:40 |
| numans | DockerNeutronConfigImage: 192.168.24.1:8787/tripleomaster/centos-binary-neutron-server-ovn:ad1779c561edabdd6446c5fa39f05e121a327d7f_710b9460 | 06:40 |
| Tengu | o_O apparently, my bm->container migration inside a Pike deploy seems to work. For real. | 06:40 |
| numans | hanish, i bet it is ../centos/binary/neutron-server now | 06:40 |
| hanish | numans yes | 06:40 |
| *** cylopez has joined #tripleo | 06:40 | |
| numans | hanish, either you can redeploy :( | 06:41 |
| numans | hanish, or try to hack a bit, may be pull neutron-server-ovn container in your controller, stop the existing neutron-server container and start again pointing to neutron-server-ovn | 06:41 |
| hanish | numans ykarel: thanks, i got my mistake | 06:42 |
| numans | hanish, safest option is edit your container-default-parameters and set neutron-server-ovn for DockerNeutronApiImage and DockerNeutronConfigImage and redeploy | 06:42 |
| numans | hanish, welcome :) | 06:43 |
| hanish | numans: ok | 06:43 |
| ykarel | hanish, ack | 06:44 |
| *** bogdando has joined #tripleo | 06:44 | |
| bandini | jaosorior: morning. done! | 06:46 |
| jaosorior | bandini: thanks! | 06:46 |
| *** udesale__ has joined #tripleo | 06:46 | |
| *** anande_ has joined #tripleo | 06:48 | |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-quickstart master: Enable OVN DB HA profile in fset30 https://review.openstack.org/523804 | 06:49 |
| *** udesale_ has quit IRC | 06:49 | |
| *** anande has quit IRC | 06:51 | |
| *** avivgt has joined #tripleo | 06:52 | |
| *** cylopez has left #tripleo | 06:54 | |
| *** slaweq has joined #tripleo | 06:56 | |
| *** chem has quit IRC | 06:58 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Correct the InternalTLSVncCAFile to comply with selinux policy https://review.openstack.org/559371 | 07:01 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Expose overcloud_ssh_user var to infrared options https://review.openstack.org/559448 | 07:01 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Fix tag for rolling upgrade compute task https://review.openstack.org/559449 | 07:01 |
| openstackgerrit | Harald Jensås proposed openstack/puppet-tripleo master: Ironic Inspector - disjoint ip range(s) for HA https://review.openstack.org/557459 | 07:06 |
| *** hjensas has joined #tripleo | 07:06 | |
| *** hjensas has quit IRC | 07:06 | |
| *** hjensas has joined #tripleo | 07:06 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Ironic Inspector - disjoint ip range(s) for HA https://review.openstack.org/557465 | 07:06 |
| *** rodolof has joined #tripleo | 07:08 | |
| *** florianf has joined #tripleo | 07:08 | |
| *** agopi_ has quit IRC | 07:09 | |
| *** jaganathan has joined #tripleo | 07:09 | |
| *** tesseract has joined #tripleo | 07:14 | |
| *** masco has joined #tripleo | 07:14 | |
| *** SlickNik- has joined #tripleo | 07:14 | |
| *** SlickNik has quit IRC | 07:15 | |
| *** rcernin has quit IRC | 07:16 | |
| *** skramaja has joined #tripleo | 07:17 | |
| *** SlickNik- has quit IRC | 07:19 | |
| *** SlickNik has joined #tripleo | 07:20 | |
| *** zoli is now known as zoli|wfh | 07:29 | |
| *** zoli|wfh is now known as zoli | 07:29 | |
| *** ukalifon has joined #tripleo | 07:29 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Enable inspector dnsmasq dhcp filter https://review.openstack.org/523909 | 07:31 |
| *** radeks has quit IRC | 07:31 | |
| *** radeks has joined #tripleo | 07:31 | |
| *** d0ugal has joined #tripleo | 07:32 | |
| *** d0ugal has quit IRC | 07:32 | |
| *** d0ugal has joined #tripleo | 07:32 | |
| *** jistr is now known as jistr|dentist | 07:34 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add Ironic Networking Baremetal Templates https://review.openstack.org/547318 | 07:34 |
| *** tosky has joined #tripleo | 07:37 | |
| *** athomas has joined #tripleo | 07:37 | |
| *** amoralej|off is now known as amoralej | 07:37 | |
| *** ccamacho has joined #tripleo | 07:41 | |
| *** psahoo has quit IRC | 07:44 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: Allow uploading big files to swift (5GB) https://review.openstack.org/559024 | 07:45 |
| Tengu | hmmm. does anyone know if gfidente will be available later today? or fultonj maybe? | 07:46 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add Ironic Networking Baremetal Templates https://review.openstack.org/547318 | 07:47 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add Ironic Networking Baremetal Templates https://review.openstack.org/547318 | 07:48 |
| jaosorior | Tengu: no idea. But fultonj is in the US. So it might take him a bit still. | 07:50 |
| *** radeks has quit IRC | 07:50 | |
| *** jpena|off is now known as jpena | 07:50 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add Ironic Networking Baremetal Templates https://review.openstack.org/547318 | 07:51 |
| *** radeks has joined #tripleo | 07:51 | |
| Tengu | jaosorior: yup. I stumbled once again with the ceph part for my migration: apparently, the converge steps wants to see ceph-mon containers. But I don't have them on the controllers. | 07:55 |
| *** lucas-afk is now known as lucasagomes | 07:56 | |
| *** psahoo has joined #tripleo | 07:58 | |
| *** shardy has joined #tripleo | 08:05 | |
| *** shardy has quit IRC | 08:05 | |
| *** jpich has joined #tripleo | 08:05 | |
| *** shardy has joined #tripleo | 08:06 | |
| jaosorior | Hey folks! would really use some reviews for these https://review.openstack.org/#/q/topic:public-tls-default+status:open | 08:08 |
| *** dparkes has joined #tripleo | 08:08 | |
| *** suuuper has joined #tripleo | 08:10 | |
| Tengu | duh… ok. no ceph docker image has been pulled. that, of course, is bad. | 08:14 |
| Tengu | -.-' | 08:14 |
| *** dsariel has joined #tripleo | 08:17 | |
| *** dbecker has joined #tripleo | 08:20 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers https://review.openstack.org/551441 | 08:21 |
| chandankumar | arxcruz|ruck: ^^ if needed update on this one | 08:22 |
| arxcruz|ruck | chandankumar: you mean the ansible variable error? | 08:23 |
| chandankumar | arxcruz|ruck: yup | 08:23 |
| arxcruz|ruck | chandankumar: so you fix it? cool | 08:23 |
| chandankumar | arxcruz|ruck: let see this run works or not | 08:23 |
| * arxcruz|ruck cross fingers | 08:23 | |
| jaosorior | d0ugal: thanks! | 08:24 |
| jaosorior | lhinds: if you have some time, can you check these out https://review.openstack.org/#/q/topic:public-tls-default+status:open ? | 08:24 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Expand jinja variables at one place only https://review.openstack.org/558369 | 08:28 |
| jtomasek | mandre: you were looking into how to make wait for stack workflow send messages so clients wouldn't have to poll stack status? | 08:31 |
| *** juriarte has quit IRC | 08:31 | |
| *** juriarte has joined #tripleo | 08:31 | |
| *** derekh has joined #tripleo | 08:32 | |
| *** mdnadeem has joined #tripleo | 08:33 | |
| mandre | jtomasek: barely scratched the surface, but yeah that was something I was interested in | 08:35 |
| *** shardy has quit IRC | 08:36 | |
| mandre | jtomasek: hey, did we reach a conclusion last week if we're going to update the plan_latest.yaml file from the messaging workflow or if we delegate this to a state machine? | 08:36 |
| *** shardy has joined #tripleo | 08:37 | |
| jtomasek | mandre: the conclusion for now is that we're going to use messaging workflow to explicitly set plan_state string + message contents | 08:39 |
| jtomasek | mandre: in deployment related workflows | 08:39 |
| jtomasek | mandre: getting the plan state is as simple as reaching for the object in swift | 08:39 |
| *** akrivoka has joined #tripleo | 08:40 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Add roles-data into overcloud upgrade prepare. https://review.openstack.org/555370 | 08:40 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/queens: Add roles-data into overcloud upgrade prepare. https://review.openstack.org/555389 | 08:40 |
| jtomasek | mandre: regarding avoiding polling, I think we could start with sending zaqar messages with every status check here https://github.com/openstack/tripleo-common/blob/master/workbooks/stack.yaml#L18 | 08:41 |
| mandre | jtomasek: right, thanks for confirming | 08:41 |
| jtomasek | mandre: that way we would at least be polling form single place and clients would just listen to messages | 08:41 |
| jtomasek | d0ugal: what do you think? ^^^ | 08:41 |
| *** skramaja has quit IRC | 08:42 | |
| shardy | jtomasek, d0ugal: I don't have a strong opinion on the messaging solution vs the state machine, but I want to agree the way forward so the UI isn't blocked on this :) | 08:43 |
| shardy | I think there are pros and cons to both approaches but we just need to agree something workable and move forward I think | 08:44 |
| jtomasek | shardy: I think the current solution we have is fine. Only thing which requires update is my comment on line 209 here https://review.openstack.org/#/c/425060/28/workbooks/deployment.yaml | 08:44 |
| shardy | jtomasek: I agree, but the most recent comment from d0ugal made me concerned we did not have consensus and that this maybe needed further discussion | 08:45 |
| jtomasek | shardy: ah, I didn't see that one | 08:46 |
| * jtomasek reads | 08:46 | |
| *** waleedm has left #tripleo | 08:51 | |
| *** ledo_ has joined #tripleo | 08:52 | |
| *** waleedm has joined #tripleo | 08:52 | |
| *** ledo_ has quit IRC | 08:52 | |
| d0ugal | jtomasek, shardy, mandre - I am updating to remove the default plan_status | 08:53 |
| d0ugal | I'm not sure if I should make it required or default to null? | 08:53 |
| d0ugal | i.e. do we want to make it a requirement of every workflow path? erroring if it is missing | 08:54 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/instack-undercloud master: Replace LOG.warn with LOG.warning https://review.openstack.org/558815 | 08:54 |
| jtomasek | d0ugal: plan_status should be set only by workflows which update state of the deployment, so I think it should not be required (IIUC your guestion) | 08:54 |
| d0ugal | jtomasek: I mean required within that workflow. | 08:55 |
| d0ugal | $.get('plan_status') vs $.plan_status - which has the same semantics as Python dict get method | 08:55 |
| jtomasek | d0ugal: plan_status should always end up being set to one of the known deployment states, so client can react to it correctly | 08:57 |
| d0ugal | jtomasek: okay, so there is no time that this workflow should not update the plan_status? | 08:58 |
| chandankumar | mandre: Hello | 08:59 |
| d0ugal | Double negative for easy readability ;) | 08:59 |
| shardy | d0ugal: I was thinking we could use the status we already have, e.g a conditional on the default or something, vs updating every possible error path with a potentially duplicate status? | 08:59 |
| d0ugal | jtomasek: to put it another way - This workflow should always update the plan_status in every outcome? | 08:59 |
| shardy | d0ugal: yes the reason we're adding it is to always have a definitive status for the plan | 08:59 |
| shardy | which means one way or another we need to always set it to something | 09:00 |
| shardy | but the reason I split the status from the workflow, is not every workflow modifies the deployment state of the plan | 09:00 |
| shardy | so just saying the $.status of the most recently run workflow isn't enough | 09:01 |
| chandankumar | mandre: How can i use the default tempest image available on from local tripleo registery https://review.openstack.org/#/c/551441/41/roles/validate-tempest/defaults/main.yml@27 ? | 09:01 |
| openstackgerrit | Bharat Kunwar proposed openstack/diskimage-builder master: Fix yaml dependency issue with dracut-regenerate for python3 https://review.openstack.org/558497 | 09:01 |
| chandankumar | mandre: another question how to use tempest user defined in the tempest kolla image while running tempest container? | 09:01 |
| *** paramite has joined #tripleo | 09:02 | |
| shardy | d0ugal: if you think it'd be easier to remove plan_status completely and copy the state machine from jtomasek that's also fine by me | 09:02 |
| shardy | I just want to agree a solution to enable progress on the UI side :) | 09:02 |
| d0ugal | I'm not sure, I've not looked at that :) | 09:02 |
| *** jistr|dentist is now known as jistr | 09:02 | |
| d0ugal | shardy: sure, that is fine. I am just unsure how I should be updating this workflow | 09:02 |
| shardy | <% $.get('plan_status', 'DEPLOYED') %> | 09:03 |
| d0ugal | "not looked at that" that=the UI state machine. | 09:03 |
| shardy | d0ugal: jtomasek linked a patch on friday, sec I'll find it | 09:03 |
| shardy | d0ugal: I was thinking a quick fix would be to have a conditional on that DEPLOYED default | 09:04 |
| shardy | so it's something different if $.get('status') is not SUCCESS ? | 09:04 |
| jtomasek | d0ugal: https://review.openstack.org/#/c/559021/5/src/js/selectors/deployment.js | 09:04 |
| shardy | the issue atm is some other error paths exist besides the set_deployment_failed | 09:04 |
| shardy | which I missed when I updated the patch | 09:05 |
| shardy | the other possibility is to ensure all error paths go via set_deployment_failed I guess | 09:05 |
| shardy | vs just setting $.status to something then relying on send_message? | 09:05 |
| shardy | Like in some places we're using on-success but really there was an error | 09:05 |
| jtomasek | right, simplest change is every time we publish status: FAILED, we should also publish plan_status: DEPLOY_FAILED | 09:06 |
| shardy | cell_v2_discover_hosts_failed is one such example | 09:06 |
| d0ugal | shardy: really we should remove the tasks that only publish - they are not needed. | 09:06 |
| *** juriarte has quit IRC | 09:06 | |
| shardy | d0ugal: Ok that would also work, e.g all error paths would go via set_deployment failed | 09:07 |
| *** juriarte has joined #tripleo | 09:07 | |
| d0ugal | I have an idea which I think should be easy to follow... | 09:08 |
| *** juriarte has quit IRC | 09:08 | |
| *** juriarte has joined #tripleo | 09:08 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Added enable_tempest flag for installing tempest on undercloud https://review.openstack.org/558510 | 09:08 |
| *** skramaja has joined #tripleo | 09:09 | |
| *** anande_ has quit IRC | 09:10 | |
| *** anande has joined #tripleo | 09:11 | |
| hjensas | arxcruz|ruck: I see quota issues in RDO jobs: https://logs.rdoproject.org/65/557465/4/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zb6ea79f88d404b02b5b35aa25277193b/console.txt.gz#_2018-04-09_08_07_39_234 | 09:11 |
| arxcruz|ruck | hjensas: thanks, i'll take a look on this | 09:12 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates stable/queens: [queens] Put back (now empty) fluentd-client.yaml https://review.openstack.org/559365 | 09:12 |
| hjensas | arxcruz|ruck: thanks! | 09:12 |
| jtomasek | shardy: btw. I've already switched UI code to use status from plan_state.yaml so the state machine in UI code is getting removed | 09:13 |
| *** gfidente has joined #tripleo | 09:13 | |
| *** gfidente has quit IRC | 09:13 | |
| *** gfidente has joined #tripleo | 09:13 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Standardise Workflow messaging and optionally persist messages https://review.openstack.org/425060 | 09:23 |
| d0ugal | shardy, jtomasek: ^ how about that pattern? The idea being that every tasks should end with calling set_deployment_failed or set_deployment_success (which then calls send_message and nothing else does directly) | 09:24 |
| d0ugal | whoops, I need to remove the default. 1 min. | 09:24 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Standardise Workflow messaging and optionally persist messages https://review.openstack.org/425060 | 09:25 |
| d0ugal | I think I may have the state names wrong... checking the UI now. | 09:26 |
| jtomasek | d0ugal: it looks good to me, note that plan_status: FAILED should be DEPLOY_FAILED as it can be UNDEPLOY_FAILED in future too | 09:26 |
| shardy | d0ugal: ack yeah that looks good but we may want to change the plan status strings | 09:26 |
| Tengu | gfidente: hello! wdo you have a few minutes for me? :) | 09:27 |
| d0ugal | jtomasek: ah okay, I'll change that. | 09:27 |
| d0ugal | jtomasek: that isn't something you have in the UI now? | 09:27 |
| d0ugal | jtomasek: should it also be "DEPLOY_SUCCESS"? | 09:27 |
| jtomasek | https://review.openstack.org/#/c/559021/5/src/js/constants/DeploymentConstants.js | 09:28 |
| *** pblaho has joined #tripleo | 09:28 | |
| jtomasek | d0ugal: line 24 deploymenStates is what I used | 09:28 |
| jtomasek | shardy, d0ugal feel free to suggest better naming | 09:28 |
| jtomasek | I've also added STARTING_DEPLOYMENT which is UI internal and is used when user sends request to start the deploy workflow and waits for a response | 09:29 |
| d0ugal | jtomasek: the workflow currently sets "plan_status: DEPLOYING" when it starts. | 09:30 |
| *** sshnaidm|off is now known as sshnaidm | 09:30 | |
| jtomasek | d0ugal: yes, that's fine | 09:30 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add Ironic Networking Baremetal Templates https://review.openstack.org/547318 | 09:31 |
| d0ugal | jtomasek: so you want DEPLOY_FAILED, do you also want DPLOY_SUCCESS or just SUCCESS? | 09:31 |
| d0ugal | DEPLOY* | 09:31 |
| jtomasek | d0ugal: lets use DEPLOY_SUCCESS, DEPLOY_FAILED, UNDEPLOY_FAILED | 09:32 |
| d0ugal | jtomasek: sounds good - we should probably document this somewhere... | 09:33 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Add keystone only update job https://review.openstack.org/559675 | 09:33 |
| shardy | yeah just SUCCESS isn't enough as we need to expose the state transition as well as the status | 09:33 |
| jtomasek | DEPLOYING and UNDEPLOYING for transition states | 09:33 |
| jtomasek | UNDEPLOY_SUCCESS is not needed as that should be UNDEPLOYED imho | 09:33 |
| *** gyankum has joined #tripleo | 09:34 | |
| d0ugal | when DEPLOY_SUCCESS should be DEPLOYED | 09:34 |
| jtomasek | I am hesitating between 'DEPLOYED' and 'DEPLOY | 09:34 |
| jtomasek | _SUCCESS | 09:34 |
| d0ugal | then DEPLOY_SUCCESS should be DEPLOYED | 09:34 |
| d0ugal | :) | 09:34 |
| jtomasek | d0ugal: yes, right | 09:34 |
| Tengu | gfidente: in case you read later: I kind of could do the first two steps of my (horrible) migration (pike bm -> pike containers + puppet-ceph ->ceph-ansible). Controllers were update OK as well as the computes (first and second steps of a standard "upgrade" process), but apparently the third one (converge) doesn't find what it expect. After a small check on the controllers, they don't have the "ceph-mon" | 09:34 |
| Tengu | docker container running. Care to provide some help so that I can understand when it should be started in the "ocata -> pike" upgrade process? | 09:34 |
| *** salmankhan has joined #tripleo | 09:35 | |
| d0ugal | jtomasek: I like <stage>_<status> and then a single word for transitions | 09:35 |
| d0ugal | jtomasek: makes it easier to identify | 09:35 |
| d0ugal | but then maybe always having two words is best. DEPLOY_STARTED or DEPLOY_RUNNING. | 09:36 |
| d0ugal | so many colours available | 09:36 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Standardise Workflow messaging and optionally persist messages https://review.openstack.org/425060 | 09:38 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Migrate to the new Mistral context class https://review.openstack.org/506186 | 09:40 |
| jtomasek | d0ugal: I am ok with it if we also figure out a 2 word name for UNDEPLOYED state (again it is internal for UI and indicates a state when there is no plan_state.yaml) :)) | 09:41 |
| jtomasek | d0ugal: it is also the state which undeploy workflow should end up in on success | 09:41 |
| d0ugal | jtomasek: DEPLOY_NADA :P | 09:41 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-heat-templates stable/newton: Change ovs user and fix permissions on ovs upgrade https://review.openstack.org/558471 | 09:41 |
| jtomasek | lol | 09:42 |
| d0ugal | jtomasek: so undeploy means "never deployed" and "overcloud deleted"? | 09:42 |
| jtomasek | d0ugal: I thought so. If we want to differentiate, then we can have UNDEPLOYED (ui internal) and UNDEPLOY_SUCCESS. I am fine with both, no big deal | 09:43 |
| d0ugal | jtomasek: do you have any states for the planning phase? I feel like PLAN_READY makes sense for a plan that is ready to be deployed but isn't | 09:44 |
| bogdando | PTAL https://review.openstack.org/#/c/556516/ | 09:46 |
| waleedm | hi guys, I'm trying to deploy baremetal deployment, firstly I had an issue with cinder config in step1 as it trying to configure it using docker, so adding these lines OS::TripleO::Services::CinderApi: ../puppet/services/cinder-api.yaml | 09:46 |
| waleedm | OS::TripleO::Services::CinderScheduler: ../puppet/services/cinder-scheduler.yaml | 09:46 |
| waleedm | OS::TripleO::Services::CinderVolume: ../puppet/services/cinder-volume.yaml | 09:46 |
| waleedm | solve the issue but now I'm facing dependacies error at step 4 , anyone can help with that ? | 09:46 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-heat-templates stable/newton: Change ovs user and fix permissions on ovs upgrade https://review.openstack.org/558471 | 09:48 |
| Tengu | aaahhh! I think I have it. ok. hmm. | 09:48 |
| jtomasek | d0ugal: we don't | 09:48 |
| jtomasek | d0ugal: good point though | 09:48 |
| bogdando | PTAL https://review.openstack.org/#/q/topic:containers-default+(status:open+OR+status:merged) | 09:49 |
| Tengu | gfidente: do you have any idea how I can run this playbook prior doing the converge step (or, maybe, IN that step, prior any other actions for ceph)? https://github.com/ceph/ceph-ansible/blob/master/infrastructure-playbooks/switch-from-non-containerized-to-containerized-ceph-daemons.yml (it's /usr/share/ceph-ansible/infrastructure-playbooks/switch-from-non-containerized-to-containerized-ceph-daemons.yml) | 09:49 |
| *** karthiks has quit IRC | 09:51 | |
| openstackgerrit | Hamdy Khader proposed openstack/tripleo-heat-templates master: Add support for NVMeOF cinder backend https://review.openstack.org/559572 | 09:52 |
| Tengu | hmm ok. still digging. called in step2 in ceph-base heat thing. so… should be called as expected. MAYBE there's a weird thing again with the inclusion order. for a change. | 09:52 |
| gfidente | Tengu you can pass the name of the playbook to use as a heat parameter CephAnsiblePlaybook | 09:53 |
| gfidente | Tengu from one of the environment files | 09:54 |
| gfidente | Tengu it should be in environments/major-upgrade-converge-docker.yaml | 09:54 |
| Tengu | gfidente: hmm ok. I saw it was included by default, with some conditions, in fact. | 09:55 |
| Tengu | indeed | 09:55 |
| *** jchhatbar has quit IRC | 09:55 | |
| Tengu | gfidente: I suspect I, once again, got some include order issues -.-. | 09:55 |
| d0ugal | jtomasek: maybe we need to take a moment and come up with plan statuses from start to end? | 09:55 |
| Tengu | it's horrible, really. | 09:55 |
| *** pblaho has quit IRC | 09:56 | |
| *** pblaho has joined #tripleo | 09:57 | |
| jtomasek | d0ugal: I am thinking whether plan status (plan configuration status) and deployment status should be kept separately | 09:57 |
| Tengu | gfidente: I'm THAT close of having a working migration :). will dig further, but at least it seems I'm on the right track. thanks for the pointers! | 09:57 |
| jtomasek | d0ugal: because for example when user deployed successfully and continues with configuration with a goal to scale up/down | 09:58 |
| gyankum | ping tripleo, in pike release "mistral environment-get overcloud" is not working.any equivalent command? | 09:59 |
| d0ugal | jtomasek: I was thinking DEPLOY_* for the deployment statuses and PLAN_* for plan configuration | 09:59 |
| d0ugal | do the first part is almost like a namespace or overall stage | 09:59 |
| d0ugal | jtomasek: oh yeah | 09:59 |
| d0ugal | jtomasek: damn :) | 09:59 |
| d0ugal | jtomasek: maybe plan_status needs to have more than just one value in it. | 09:59 |
| jtomasek | d0ugal: or having 2 objects would be fine, but at that stage we would probably want to handle this separately from sending the messages, I don't know | 10:00 |
| jpich | gyankum: Hi! From Pike onwards the plan information is stored in swift in plan-environment.yaml ($ openstack object save overcloud plan-environment.yaml - or along these lines should get you the file with that info) | 10:00 |
| gyankum | jpich++, got it, thank you. | 10:03 |
| gyankum | jpich, any specific reason why it is moved from mistral to swift | 10:04 |
| jpich | gyankum: It's so we can have all the plan information in one place, rather than spread out over both Swift and Mistral | 10:04 |
| jpich | this enables features like plan export :) | 10:04 |
| gyankum | jpich , ok..thanks | 10:05 |
| d0ugal | gyankum: and swift is just a better tool at long term storage - Mistral was never really designed for it. | 10:06 |
| shardy | waleedm: Hi, so yes you're right it looks like Cinder is missing from https://github.com/openstack/tripleo-heat-templates/blob/master/environments/baremetal-services.yaml | 10:06 |
| shardy | jaosorior: did we decide to have CI coverage for that in the end? | 10:06 |
| gyankum | d0ugal, thanks | 10:06 |
| waleedm | <shardy>: Do I need to have any extra services for that ? | 10:08 |
| jpich | gyankum: More gritty details at https://specs.openstack.org/openstack/tripleo-specs/specs/pike/deployment-plan-management.html too | 10:08 |
| d0ugal | jtomasek: maybe for now we should rename plan_status.yaml to deploy_status.yaml? | 10:09 |
| openstackgerrit | Lukas Bezdicka proposed openstack/python-tripleoclient master: Add upgrade-[prepare|converge].yaml into upgrade cli https://review.openstack.org/558866 | 10:09 |
| openstackgerrit | Lukas Bezdicka proposed openstack/python-tripleoclient master: WIP - ffwd-upgrade cli adds ffwd-upgrade [prepare|run|converge] https://review.openstack.org/557937 | 10:09 |
| jtomasek | d0ugal: +1 | 10:09 |
| shardy | waleedm: I'd say at least api, scheduler and volume ref https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml#L113..L116 | 10:09 |
| shardy | waleedm: did you try adding those already? | 10:09 |
| waleedm | shardy: I did else this one I didn't add it OS::TripleO::Services::CinderBackup: OS::Heat::None | 10:10 |
| waleedm | and it failed now at step4 with failed dependacies | 10:11 |
| shardy | waleedm: Ok what is the error? | 10:12 |
| mdnadeem | #tripleo Hello, Team i am trying to install HA queen setup via quickstart , it fails at gnocchi_db_sync command, not sure why it configured gnocchi though i have passed diable-telemetry file in deployment command, can some one please have a look at http://paste.openstack.org/show/718724/ | 10:12 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Fix mode for openstack services https://review.openstack.org/557511 | 10:14 |
| shardy | mdnadeem: I think it's because you're including the docker.yaml and docker-ha.yaml files twice, and the second time it's after the disable-telemetry one | 10:14 |
| shardy | the order is important as the last -e option wins | 10:15 |
| gyankum | jpich, ack | 10:15 |
| waleedm | shardy: three is these errors "Error: Cannot allocate memory - fork(2)", | 10:15 |
| waleedm | "Error: /Stage[main]/Swift::Storage::Object/Swift::Storage::Generic[object]/Swift::Service[swift-object-replicator]/Service[swift-object-replicator]/ensure: change from stopped to running failed: Cannot allocate memory - fork(2)", | 10:15 |
| waleedm | "Error: /Stage[main]/Swift::Storage::Object/Swift::Storage::Generic[object]/Swift::Service[swift-object-replicator]/Service[swift-object-replicator]: Failed to call refresh: Cannot allocate memory - fork(2)", | 10:15 |
| waleedm | "Error: /Stage[main]/Swift::Storage::Object/Swift::Storage::Generic[object]/Swift::Service[swift-object-replicator]/Service[swift-object-replicator]: Cannot allocate memory - fork(2)", | 10:15 |
| waleedm | "Error: /Stage[main]/Swift::Storage::Object/Swift::Storage::Generic[object]/Swift::Service[swift-object-auditor]/Service[swift-object-auditor]: Could not evaluate: Cannot allocate memory - fork(2)", | 10:16 |
| waleedm | "Error: /Stage[main]/Swift::Storage::Object/Swift::Storage::Generic[object]/Swift::Service[swift-object-auditor]/Service[swift-object-auditor]: Failed to call refresh: Cannot allocate memory - fork(2)", | 10:16 |
| waleedm | "Error: /Stage[main]/Swift::Storage::Object/Swift::Storage::Generic[object]/Swift::Service[swift-object-auditor]/Service[swift-object-auditor]: Cannot allocate memory - fork(2)", | 10:16 |
| mdnadeem | shardy, ack, i update and re-try it | 10:16 |
| shardy | waleedm: do you think it could be something related to not having enough memory perhaps? | 10:17 |
| shardy | waleedm: and please use paste.openstack.org for future pastes, thanks! | 10:17 |
| waleedm | shardy: no I don't think so, I did many deployment before the latest changes, and also I tried it on differnet environments and the same error | 10:21 |
| shardy | waleedm: That error definitely means you're running out of memory IME | 10:21 |
| shardy | waleedm: try running vmstat on the nodes during the deploy to check | 10:22 |
| shardy | and/or add some swap and see if it starts swapping | 10:22 |
| shardy | waleedm: also check the syslog, I'd bet the OOM killer has killed a bunch of stuff which will be visible in the logs | 10:22 |
| shardy | waleedm: how much memory do the nodes have? | 10:23 |
| *** chem has joined #tripleo | 10:24 | |
| waleedm | shardy: 16G | 10:24 |
| shardy | waleedm: Ok that should be enough but I think you need to do a basic health check on the nodes, TripleO can't help if swift is failing to start due to lack of memory | 10:26 |
| *** gyankum has quit IRC | 10:27 | |
| waleedm | mmm but with containerized deloyment it success | 10:27 |
| shardy | waleedm: understood, but the only way to debug this is to understand why swift doesn't have enough memory to start | 10:28 |
| shardy | in theory the memory usage should be similar to the containerized case, but it sounds like that is not the case | 10:28 |
| *** salmankhan has quit IRC | 10:29 | |
| waleedm | shardy: aha I see | 10:29 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart master: Make sure we keep using tripleo-admin as ssh user in CI https://review.openstack.org/558855 | 10:31 |
| *** psahoo has quit IRC | 10:32 | |
| *** slaweq has quit IRC | 10:32 | |
| *** pblaho has quit IRC | 10:33 | |
| *** pblaho has joined #tripleo | 10:33 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Add keystone only update job https://review.openstack.org/559675 | 10:34 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Add keystone only update job https://review.openstack.org/559675 | 10:35 |
| *** slaweq has joined #tripleo | 10:35 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Add keystone only update job https://review.openstack.org/559675 | 10:36 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Add upgrade-[prepare|converge].yaml into upgrade cli https://review.openstack.org/558866 | 10:36 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: WIP - ffwd-upgrade cli adds ffwd-upgrade [prepare|run|converge] https://review.openstack.org/557937 | 10:36 |
| *** sri_ has joined #tripleo | 10:39 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-common master: Activate another set of healthchecks https://review.openstack.org/550508 | 10:42 |
| openstackgerrit | hanish proposed openstack/tripleo-heat-templates master: Removed unnecessary services from the LiquidioCompute role OVNcontroller service along with openvswitch runs in Liquidio Smart NIC https://review.openstack.org/559696 | 10:46 |
| *** dmacpher has joined #tripleo | 10:48 | |
| *** cshastri has joined #tripleo | 10:49 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Upgrade webpack to 4.5.0 https://review.openstack.org/559699 | 10:52 |
| *** thrash|g0ne is now known as thrash | 10:57 | |
| *** pkovar has joined #tripleo | 10:59 | |
| *** karthiks has joined #tripleo | 11:03 | |
| *** lucasagomes is now known as lucas-hungry | 11:05 | |
| *** masco has quit IRC | 11:06 | |
| *** shreshtha has quit IRC | 11:07 | |
| *** cshastri has quit IRC | 11:09 | |
| *** assassin has joined #tripleo | 11:10 | |
| chandankumar | arxcruz|ruck: sshnaidm something wrong is happening tempest jobs | 11:11 |
| chandankumar | with my patch | 11:11 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-heat-templates master: WIP: running dstat in overcloud nodes https://review.openstack.org/557476 | 11:13 |
| sshnaidm | chandankumar, ? | 11:13 |
| chandankumar | sshnaidm: roles are not getting created in oooq-containers job | 11:13 |
| sshnaidm | chandankumar, which roles? | 11:14 |
| chandankumar | sshnaidm: http://logs.openstack.org/42/551442/20/check/tripleo-ci-centos-7-undercloud-containers/178420e/logs/undercloud/home/zuul/tempest_container.sh.txt.gz | 11:15 |
| *** salmankhan has joined #tripleo | 11:15 | |
| chandankumar | sshnaidm: http://logs.openstack.org/42/551442/20/check/tripleo-ci-centos-7-undercloud-containers/178420e/logs/undercloud/home/zuul/tempest_output.log.txt.gz#_2018-04-09_09_13_47 | 11:15 |
| chandankumar | in the tempest.log, it is not creating openstack member role | 11:15 |
| sshnaidm | chandankumar, are you sure this script executes? | 11:17 |
| *** fragatina has quit IRC | 11:17 | |
| chandankumar | sshnaidm: yup | 11:18 |
| chandankumar | sshnaidm: earlier i was installing openstackclient with in container | 11:19 |
| chandankumar | let me update the patch and let me see | 11:19 |
| sshnaidm | chandankumar, need logs from container | 11:19 |
| *** anande has quit IRC | 11:20 | |
| *** udesale__ has quit IRC | 11:20 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates stable/queens: Correct the InternalTLSVncCAFile to comply with selinux policy https://review.openstack.org/559708 | 11:21 |
| *** pgadiya has quit IRC | 11:22 | |
| *** bfournie has quit IRC | 11:22 | |
| *** anande has joined #tripleo | 11:23 | |
| *** pblaho has quit IRC | 11:24 | |
| *** anande has quit IRC | 11:24 | |
| *** zoli is now known as zoli|lunch | 11:25 | |
| *** dhill_ has quit IRC | 11:26 | |
| *** dparkes has quit IRC | 11:26 | |
| *** mburned_out is now known as mburned | 11:29 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Run the dispatch script for vlans as well https://review.openstack.org/559712 | 11:29 |
| *** ansmith has quit IRC | 11:30 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Handle special characters when parsing roles. https://review.openstack.org/559713 | 11:31 |
| *** pdeore has quit IRC | 11:33 | |
| *** salmankhan has quit IRC | 11:37 | |
| *** anande has joined #tripleo | 11:38 | |
| *** pkovar has quit IRC | 11:41 | |
| *** jpena is now known as jpena|lunch | 11:42 | |
| *** anande has quit IRC | 11:43 | |
| chandankumar | sshnaidm: http://logs.openstack.org/22/554522/16/check/tripleo-ci-centos-7-undercloud-oooq/4544b59/job-output.txt.gz#_2018-04-09_09_18_57_030716 | 11:44 |
| chandankumar | sshnaidm: regarding this one, in containers it is working but on packages it is not working need help | 11:44 |
| sshnaidm | chandankumar, what doesn't work? | 11:44 |
| *** atoth has joined #tripleo | 11:44 | |
| chandankumar | sshnaidm: review link https://review.openstack.org/#/c/551441/ tempest_init set_facts for containers it is working but for packages it is not working | 11:45 |
| *** gyankum has joined #tripleo | 11:45 | |
| chandankumar | sshnaidm: https://review.openstack.org/#/c/551441/41/roles/validate-tempest/tasks/tempest-rpm.yml@30 is called here | 11:45 |
| *** pblaho has joined #tripleo | 11:46 | |
| *** artom has quit IRC | 11:46 | |
| Tengu | gfidente: hmm. apparently, there's something missing. Unless I had to apply the listed ansible playbook to the first migration step (I doubt it), it still doesn't seem to fetch the docker image for ceph. And fails. | 11:47 |
| chandankumar | sshnaidm: it is working on overcloud but not on undercloud | 11:47 |
| sshnaidm | chandankumar, as I understand from logs - it's just not defined | 11:47 |
| *** dprince has joined #tripleo | 11:47 | |
| sshnaidm | chandankumar, check if you call tempest-rpm.yml in this jobs, if not - you need some default value for it | 11:49 |
| *** rfolco has joined #tripleo | 11:50 | |
| *** rfolco is now known as rfolco|rover | 11:50 | |
| sshnaidm | chandankumar, http://logs.openstack.org/22/554522/16/check/tripleo-ci-centos-7-undercloud-oooq/4544b59/job-output.txt.gz#_2018-04-09_09_18_56_510354 | 11:50 |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: WIP Optionally run config download at the end of stack create/update https://review.openstack.org/554224 | 11:51 |
| sshnaidm | chandankumar, this task is skipped | 11:51 |
| jaosorior | shardy: could you check this out ? | 11:52 |
| jaosorior | shardy: https://review.openstack.org/#/c/558768/ | 11:52 |
| chandankumar | sshnaidm: checking | 11:52 |
| Tengu | duh... ONE controller has the monitor. ook. | 11:52 |
| *** psachin has quit IRC | 11:53 | |
| *** masco has joined #tripleo | 11:54 | |
| *** florianf has quit IRC | 11:55 | |
| *** lucas-hungry is now known as lucasagomes | 11:56 | |
| mandre | chandankumar: you'd have to point your tempest image to the one you uploaded into the local registry, I imagine we already have a variable for that in quickstart | 12:00 |
| Tengu | gfidente: ah, apparently the ceph-mon container on the only controller with it has some issues decrypting the messages: cephx: verify_authorizer could not decrypt ticket info: error: NSS AES final round failed: -8190… Does it ring anything to you? | 12:00 |
| *** leanderthal has joined #tripleo | 12:00 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers https://review.openstack.org/551441 | 12:01 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Run tempest on undercloud on fs003 https://review.openstack.org/554522 | 12:01 |
| chandankumar | sshnaidm: tempest_config: true will fix it ^^ | 12:01 |
| Tengu | gfidente: this issue prevent the container to join the quorum, and makes the migration fail. I'll just revert my lab to a "more stable" state and retry from there. | 12:03 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers https://review.openstack.org/551441 | 12:03 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Run tempest on undercloud on fs003 https://review.openstack.org/554522 | 12:04 |
| chandankumar | now it will work | 12:04 |
| *** gyankum has quit IRC | 12:04 | |
| *** raildo has joined #tripleo | 12:04 | |
| *** bfournie has joined #tripleo | 12:05 | |
| arxcruz|ruck | chandankumar: what's happening ? | 12:07 |
| sshnaidm | chandankumar, tempest_format: packages , not package | 12:08 |
| *** mmethot has joined #tripleo | 12:09 | |
| sshnaidm | chandankumar, compare: https://review.openstack.org/#/c/551441/41/roles/validate-tempest/tasks/main.yml https://review.openstack.org/#/c/554522/18/config/general_config/featureset003.yml | 12:09 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: Allow uploading big files to swift (5GB) https://review.openstack.org/559024 | 12:10 |
| *** florianf has joined #tripleo | 12:10 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers https://review.openstack.org/551441 | 12:12 |
| *** fultonj has joined #tripleo | 12:12 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Run tempest on undercloud on fs003 https://review.openstack.org/554522 | 12:12 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: Allow uploading big files to swift (5GB) https://review.openstack.org/559024 | 12:12 |
| *** ykarel has quit IRC | 12:12 | |
| *** psachin has joined #tripleo | 12:14 | |
| *** rlandy has joined #tripleo | 12:14 | |
| *** dparkes has joined #tripleo | 12:18 | |
| *** pkovar has joined #tripleo | 12:18 | |
| arxcruz|ruck | chandankumar: sshnaidm yup, the default is packages, at least in the readme and in defaults/main.yml | 12:21 |
| bogdando | folks, what applies net config on nodes, in current architecture? I can't trace os-net-config in journalctl. so what is it?.. | 12:21 |
| bogdando | struggling to figure out some working network config for all in one undercloud... | 12:21 |
| bogdando | beagles: ^^ here perchance? | 12:22 |
| bogdando | hjensas: ^^ | 12:22 |
| bogdando | I've also tried to define static routes for UC, https://github.com/bogdando/oooq-warp/blob/d5013ca766caa69e313a04b629c7d0704a79ce9c/tht/config/general_config/featureset127.yml#L97 but can't see it's applied | 12:23 |
| bogdando | any help with that please? | 12:23 |
| bogdando | for that example vars file, UC ends-up disconnected w/o a proper static route created. What is the missing step? | 12:24 |
| bogdando | looking into http://blog.johnlikesopenstack.com/2016/02/troubleshoot-tripleo-os-net-config-with.html, I understood that something changed, as I still see no traces of os-net-config in logs, but the config is still applied :) | 12:26 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Run the dispatch script for vlans as well https://review.openstack.org/559712 | 12:26 |
| bogdando | PTAL https://review.openstack.org/#/c/556797/ docker-defaults | 12:27 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Add roles-data into overcloud upgrade prepare. https://review.openstack.org/555370 | 12:27 |
| *** tzumainn has joined #tripleo | 12:27 | |
| *** udesale has joined #tripleo | 12:28 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/queens: Add roles-data into overcloud upgrade prepare. https://review.openstack.org/555389 | 12:29 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Use the standard messaging in the package_update workbook https://review.openstack.org/554594 | 12:29 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Use the standard messaging in the derive_parameters workbook https://review.openstack.org/554548 | 12:29 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Use the standard messaging in the plan_management workbook https://review.openstack.org/554595 | 12:29 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Use the standard messaging in the fernet-key-rotate workbook https://review.openstack.org/554552 | 12:29 |
| *** morazi has joined #tripleo | 12:29 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Use the standard messaging in the baremetal workbook https://review.openstack.org/552460 | 12:29 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Use the standard messaging in the networks workbook https://review.openstack.org/554593 | 12:29 |
| *** colonwq has joined #tripleo | 12:31 | |
| *** udesale has quit IRC | 12:31 | |
| *** udesale has joined #tripleo | 12:32 | |
| *** ykarel has joined #tripleo | 12:32 | |
| *** jpena|lunch is now known as jpena | 12:32 | |
| *** ohochman has joined #tripleo | 12:32 | |
| jaosorior | jistr: could you take a look at https://review.openstack.org/#/c/558423/ , https://review.openstack.org/#/c/559620/ and https://review.openstack.org/#/c/556817/ ? | 12:33 |
| jistr | jaosorior: ack i'll add myself | 12:38 |
| *** ratailor has quit IRC | 12:39 | |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Adjust 'overcloud upgrade prepare' call for P->Q upgrade. https://review.openstack.org/559722 | 12:39 |
| openstackgerrit | waleed mousa proposed openstack/tripleo-heat-templates master: Removing the deprecated environment files for hw offloading in containers https://review.openstack.org/559723 | 12:41 |
| *** liverpooler has joined #tripleo | 12:42 | |
| *** pcaruana has quit IRC | 12:46 | |
| openstackgerrit | Christian Schwede proposed openstack/instack-undercloud master: Enable missing support for large objects in Swift https://review.openstack.org/559349 | 12:47 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Adjust 'overcloud upgrade prepare' call for P->Q upgrade. https://review.openstack.org/559722 | 12:48 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers https://review.openstack.org/551441 | 12:50 |
| *** Goneri has joined #tripleo | 12:52 | |
| *** ansmith has joined #tripleo | 12:54 | |
| Tengu | fultonj: hello! do you have a few minutes? I still have some issues with my awful migration (pike bm -> pike container + puppet-ceph -> ceph-ansible). Currently at step 3 of a standard "upgrade", apparently there's an issue with cephx (auth) when the first ceph-mon container is launched on a controller - it can't join the quorum, making the "converge" fail :(. | 12:54 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Run tempest on undercloud on fs003 https://review.openstack.org/554522 | 12:55 |
| chandankumar | arxcruz|ruck: sshnaidm thanks :-) | 12:55 |
| chandankumar | fingers crossed | 12:55 |
| *** leanderthal has quit IRC | 12:55 | |
| jaosorior | mwhahaha: could you check this out https://review.openstack.org/#/c/558768/ ? | 12:56 |
| *** chlong has joined #tripleo | 12:56 | |
| *** jcoufal has joined #tripleo | 12:57 | |
| *** pchavva has joined #tripleo | 12:57 | |
| hanish | numans ykarel i changed my docker registry file and it worked, Thanks for the help. | 13:01 |
| numans | hanish, great to hear that :) | 13:02 |
| ykarel | hanish, glad to hear | 13:02 |
| numans | you are welcome | 13:02 |
| *** dtrainor has joined #tripleo | 13:03 | |
| *** psachin has quit IRC | 13:04 | |
| *** zoli|lunch is now known as zoli|wfh | 13:10 | |
| *** zoli|wfh is now known as zoli | 13:10 | |
| *** pcaruana has joined #tripleo | 13:11 | |
| *** anilvenkata has quit IRC | 13:11 | |
| *** udesale has quit IRC | 13:12 | |
| *** udesale has joined #tripleo | 13:13 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Add keystone only update job https://review.openstack.org/559675 | 13:15 |
| *** leanderthal has joined #tripleo | 13:16 | |
| derekh | Anybody around to give another set of eyes on a CI patch https://review.openstack.org/#/c/555737/ ? | 13:20 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Define overcloud_docker_registry_namespace for rdocloud https://review.openstack.org/557035 | 13:21 |
| *** Goneri has quit IRC | 13:21 | |
| *** janki has joined #tripleo | 13:22 | |
| skramaja | EmilienM: https://review.openstack.org/#/c/555661/ - rdo passed, could you take a look? | 13:22 |
| openstackgerrit | Christian Schwede proposed openstack/instack-undercloud master: Enable missing support for large objects in Swift https://review.openstack.org/559349 | 13:23 |
| *** lvdombrkr has joined #tripleo | 13:23 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-common master: [WIP] Add health checks for Swift services https://review.openstack.org/559737 | 13:26 |
| *** rpioso|afk is now known as rpioso | 13:27 | |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient stable/pike: [pike] Increase message timeout in package_update https://review.openstack.org/559738 | 13:29 |
| *** mcornea has joined #tripleo | 13:30 | |
| *** jmelvin has joined #tripleo | 13:35 | |
| *** rodolof has quit IRC | 13:39 | |
| *** rodolof has joined #tripleo | 13:39 | |
| EmilienM | skramaja: sure | 13:40 |
| sai1 | mwhahaha: with osp13, 25 mins into deploy is see this esources.OsNetConfigImpl.properties.config: "str_replace" params must be strings or numbers, param $network_config is not valid | 13:43 |
| sai1 | Heat Stack create failed.. most likely template issue, how do i debug further? | 13:43 |
| sai1 | 13:43 | |
| bogdando | PTAL https://review.openstack.org/#/c/556797 folks | 13:45 |
| mwhahaha | sai1: sounds like a question for bfournie or dsneddon | 13:45 |
| sai1 | mwhahaha: ack, thanks | 13:45 |
| *** abishop has joined #tripleo | 13:46 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: Revert "Deploy container-multinode (fs010) with a containerized undercloud" https://review.openstack.org/559740 | 13:48 |
| *** jchhatbar has joined #tripleo | 13:50 | |
| bfournie | sai - are you using old style nic config files? you can tell if the nic config has "os-apply-config" in it. There is a script that will convert the old-style to new-style - https://github.com/openstack/tripleo-heat-templates/blob/master/tools/yaml-nic-config-2-script.py | 13:50 |
| bfournie | sai - if you show me the nic config files you are using I can take a loook | 13:50 |
| *** ansmith has quit IRC | 13:51 | |
| bogdando | folks, need help to debug run-os-net-config. It doesn't create a static route and deployments cuts if self isolated | 13:52 |
| bogdando | while I have next hop defined in config.json | 13:52 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-heat-templates stable/newton: Change ovs user and fix permissions on ovs upgrade https://review.openstack.org/558471 | 13:52 |
| *** janki has quit IRC | 13:52 | |
| *** ansmith has joined #tripleo | 13:53 | |
| bogdando | never-mind, I forgot to add OS::TripleO::Services::Kernel | 13:59 |
| fultonj | hi Tengu: it's my first day back from PTO and i'm playing catch up | 14:00 |
| chandankumar | sshnaidm: arxcruz|ruck please have a look at this review https://review.openstack.org/#/c/559281/ and tempest installation is failing requires root permission i think it is handled by ansible na http://logs.openstack.org/81/559281/3/check/tripleo-ci-centos-7-containers-multinode/ed694b9/job-output.txt.gz#_2018-04-09_10_56_24_749507 | 14:02 |
| *** liverpooler has quit IRC | 14:02 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates stable/queens: Fixes ceph-external docker service name https://review.openstack.org/559744 | 14:02 |
| arxcruz|ruck | chandankumar: can you add become: true on that task ? | 14:03 |
| *** skramaja has quit IRC | 14:03 | |
| arxcruz|ruck | chandankumar: or you want me to do it ? | 14:03 |
| chandankumar | arxcruz|ruck: adding | 14:03 |
| *** liverpooler has joined #tripleo | 14:04 | |
| *** holser__ has quit IRC | 14:04 | |
| *** holser__ has joined #tripleo | 14:04 | |
| *** dsariel has quit IRC | 14:05 | |
| *** bnemec has joined #tripleo | 14:05 | |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Stop persisting previous configuration on update/upgrade prepare https://review.openstack.org/559746 | 14:07 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Adjust 'overcloud upgrade prepare' call for P->Q upgrade. https://review.openstack.org/559722 | 14:07 |
| arxcruz|ruck | hjensas: so, i clean up our rdo cloud tenant, it should be working fine now :) | 14:07 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers https://review.openstack.org/551441 | 14:08 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1762422 | 14:10 |
| openstack | Launchpad bug 1762422 in tripleo "ci: containerized undercloud does not test tripleo-common" [Critical,In progress] - Assigned to James Slagle (james-slagle) | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| *** tosky has quit IRC | 14:10 | |
| hjensas | bogdando: os-collect-config I belive? | 14:11 |
| hjensas | arxcruz|ruck: thanks! | 14:11 |
| openstackgerrit | Rafael Folco proposed openstack/tripleo-quickstart-extras master: Fix dstat time penalty for failed runs https://review.openstack.org/558908 | 14:11 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Stop persisting previous configuration on update/upgrade prepare https://review.openstack.org/559746 | 14:13 |
| *** tosky has joined #tripleo | 14:14 | |
| *** DrBacchus is now known as rbowen | 14:14 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Hard link http boot contents for Ironic https://review.openstack.org/556516 | 14:18 |
| Tengu | fultonj: oh, no problem ;). I'm still trying to figure out why this situation happens | 14:19 |
| *** rodolof has quit IRC | 14:20 | |
| bfournie | sai1: I think I responded to wrong nic, see above ^ | 14:20 |
| *** artom has joined #tripleo | 14:20 | |
| *** rodolof has joined #tripleo | 14:21 | |
| sai1 | bfournie: i made tempaltes by hand and might have botched it, let me try the script and tell u how it goes, thank you! | 14:22 |
| *** artom_ has joined #tripleo | 14:23 | |
| bfournie | sai1: ok thanks, yes try the script | 14:23 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/queens: [DNM]: Apply workaround for P->Q upgrades. https://review.openstack.org/552084 | 14:24 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/queens: Adjust 'overcloud upgrade prepare' call for P->Q upgrade. https://review.openstack.org/559722 | 14:24 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/queens: DNM: Testing P->Q from queens branch. https://review.openstack.org/552080 | 14:24 |
| *** liverpooler has quit IRC | 14:24 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/queens: DNM: Testing P->Q from queens branch. https://review.openstack.org/552080 | 14:26 |
| *** liverpooler has joined #tripleo | 14:26 | |
| *** artom has quit IRC | 14:26 | |
| sri_ | Hi, is it possible to deploy two independent overcloud stack from one undercloud ? | 14:26 |
| *** rbrady-afk has quit IRC | 14:26 | |
| sshnaidm | chem, hi | 14:29 |
| chem | sshnaidm: hey | 14:30 |
| sri_ | never mind, I think it is doable using split-stack, https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/split_stack.html | 14:31 |
| *** paramite has quit IRC | 14:33 | |
| sshnaidm | chem, need to talk with you about branches cloning and reproducer scripts | 14:35 |
| openstackgerrit | Jose Luis Franco proposed openstack/python-tripleoclient stable/queens: Stop persisting previous configuration on update/upgrade prepare https://review.openstack.org/559753 | 14:35 |
| sshnaidm | chem, I need to make sure we are on the same page there and confirm that it works | 14:35 |
| chem | sshnaidm: well, I didn't capture the output in the lp, sorry about that. And you need involving depends-on to trigger the problem | 14:36 |
| sshnaidm | chem, currently I update only trello cards while it's WIP, I want to make sure we have a problem at all | 14:37 |
| chem | sshnaidm: maybe best to make a dummy review that is able to reproduce the error we saw (I think jfrancoa had the same) and work from there | 14:37 |
| chem | sshnaidm: yeah, saw your review | 14:37 |
| chem | sshnaidm: I think we have, but no log doesn't help | 14:38 |
| jaosorior | mwhahaha: by requirement update do you mean in RDO? the spec file? | 14:38 |
| mwhahaha | jaosorior: yes | 14:38 |
| chem | sshnaidm: so maybe first step is to have a review able to retrigger the error, WDYT ? | 14:38 |
| mwhahaha | jaosorior: tripleo-common currently doesn't require the cryto package | 14:38 |
| *** ayoung has joined #tripleo | 14:38 | |
| jaosorior | mwhahaha: ok, will do. | 14:38 |
| sshnaidm | chem, I'd like to clarify our expectations from Ci firstly | 14:39 |
| sshnaidm | chem, before we take any review | 14:39 |
| *** nyechiel has quit IRC | 14:39 | |
| chem | sshnaidm: dou you want a quick meeting, I feel it's going to be faster ? | 14:41 |
| sshnaidm | chem, sure, maybe jfrancoa want join too? | 14:41 |
| jfrancoa | sshnaidm: sure, joining | 14:42 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Pass env-files and roles-data file to update/upgrade prepare cli. https://review.openstack.org/559755 | 14:43 |
| sshnaidm | jfrancoa, chem https://bluejeans.com/u/sshnaidm/ | 14:43 |
| honza | jtomasek: what kind of network selectors do you think we'll need? | 14:44 |
| *** paramite has joined #tripleo | 14:45 | |
| *** hamdyk has quit IRC | 14:47 | |
| *** lvdombrkr has quit IRC | 14:48 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: Add Neutron L3 agent failover check during upgrade https://review.openstack.org/559410 | 14:49 |
| *** masco has quit IRC | 14:53 | |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Add upgrade-[prepare|converge].yaml into upgrade cli https://review.openstack.org/558866 | 14:54 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: WIP - ffwd-upgrade cli adds ffwd-upgrade [prepare|run|converge] https://review.openstack.org/557937 | 14:54 |
| *** Goneri has joined #tripleo | 14:54 | |
| *** pblaho has quit IRC | 14:55 | |
| sai1 | bfournie: so question, i used the script for templates and deploy went further but shouldnt an error like https://gist.github.com/smalleni/bba8f7d2aa4bc02d8beeabba4886f5d3 be caught much earlier during validations than 25 mins into deploy...thoughts? | 14:55 |
| *** waleedm has quit IRC | 14:55 | |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Stop persisting previous configuration on update/upgrade prepare https://review.openstack.org/559746 | 14:55 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Add upgrade-[prepare|converge].yaml into upgrade cli https://review.openstack.org/558866 | 14:55 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: WIP - ffwd-upgrade cli adds ffwd-upgrade [prepare|run|converge] https://review.openstack.org/557937 | 14:55 |
| bfournie | sai1: there was a recent change in the validation to fail early if an old style nic config is being used https://review.openstack.org/#/c/554521/ | 14:57 |
| *** stendulker has joined #tripleo | 14:57 | |
| *** masco has joined #tripleo | 14:58 | |
| jaosorior | bnemec: could you check this one out https://review.openstack.org/#/c/558423/ ? | 14:58 |
| sai1 | bfournie: it wasnt old style, it was new style except the indentation on line 83 here https://gist.github.com/smalleni/7357768a41407171414c6469d87d6d1c#L83 | 14:58 |
| sai1 | so i would expect it to fail much earleir | 14:58 |
| jaosorior | bnemec: I'm using that here https://review.openstack.org/#/c/558424/ | 14:58 |
| openstackgerrit | Jose Luis Franco proposed openstack/python-tripleoclient stable/queens: Stop persisting previous configuration on update/upgrade prepare https://review.openstack.org/559753 | 14:59 |
| bfournie | sai1: there isn't really a validation that would check improperly formatted yaml nic config files I don't believe | 14:59 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/queens: DNM: Testing P->Q from queens branch. https://review.openstack.org/552080 | 14:59 |
| sai1 | bfournie: ok, thanks | 15:00 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Update converge CLI to remove no-ops https://review.openstack.org/558536 | 15:00 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Update prepare using an environment file https://review.openstack.org/559760 | 15:00 |
| ykarel | mwhahaha, EmilienM we would also need Release for paunch in queens/master for https://review.openstack.org/#/q/I0cfcf4e3e3e13578ec42e12f459732992fb3a760 as it's pinned to 2.4.0 in RDO | 15:01 |
| mwhahaha | k | 15:01 |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Implement fetching of networks https://review.openstack.org/548685 | 15:02 |
| *** zoli is now known as zoli|afk | 15:03 | |
| openstackgerrit | Doug Hellmann proposed openstack/python-tripleoclient master: add lower-constraints job https://review.openstack.org/556195 | 15:03 |
| *** rbrady has joined #tripleo | 15:04 | |
| *** rbrady has quit IRC | 15:04 | |
| *** rbrady has joined #tripleo | 15:04 | |
| EmilienM | ykarel, mwhahaha : I'll take care of it now. | 15:04 |
| mwhahaha | EmilienM: you need to wait for it to merge but yea | 15:05 |
| mwhahaha | EmilienM: https://review.openstack.org/#/c/559462/ | 15:05 |
| EmilienM | mwhahaha: ok, I'll depends-on this one | 15:05 |
| *** rodolof has quit IRC | 15:07 | |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: WIP - ffwd-upgrade cli adds ffwd-upgrade [prepare|run|converge] https://review.openstack.org/557937 | 15:07 |
| ykarel | mwhahaha, EmilienM one query about THT patch for ulimit | 15:08 |
| *** ramishra has quit IRC | 15:09 | |
| ykarel | currently 1024 is set as ulimit, and if sometime it found that for some Env is not sufficient, what can be done in that case | 15:09 |
| ykarel | Better to add some parameter for it and default to 1024 | 15:09 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1762422 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1762422 in tripleo "ci: containerized undercloud does not test tripleo-common" [Critical,In progress] - Assigned to James Slagle (james-slagle) | 15:10 |
| *** radeks has quit IRC | 15:11 | |
| ykarel | and i mean to do it subsequent patches as i found performance issue in other services also | 15:11 |
| *** radeks has joined #tripleo | 15:11 | |
| mwhahaha | ykarel: yea it probably should be configurable | 15:12 |
| mwhahaha | ykarel: we should be able to expose it as a tht parameter | 15:12 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Default environment/services/* to docker https://review.openstack.org/556799 | 15:12 |
| openstackgerrit | Merged openstack/paunch stable/queens: Add ulimit option for run action https://review.openstack.org/559462 | 15:12 |
| ykarel | mwhahaha, yeah that what i meant, so let's get this fixed and decide the parameters | 15:13 |
| mwhahaha | ykarel: where's your tht patch and i can comment | 15:13 |
| ykarel | mwhahaha, https://review.openstack.org/#/c/559268/ | 15:13 |
| ykarel | we can add tech-debt for it | 15:13 |
| mwhahaha | ykarel: yea create a tech-debt bug. we would need to add a service specific param for the nofile limit. Since i assume we'd want to tune it on a per container basis | 15:14 |
| mwhahaha | ykarel: so liek neutron-dhcp.yaml would need something like NeutronDhcpContainerUlimit: ['nofile=1024'] | 15:15 |
| mwhahaha | ykarel: we could either expose the 1024 or the entire ulimit setting itself. I think exposing the ulimit might be more flexible | 15:15 |
| mwhahaha | so if we need to tune something other than nofile | 15:15 |
| ykarel | mwhahaha, Ok will create the bug, yes and some container may need other ulimit like nproc, so NeutronDhcpContainerUlimitNoproc NeutronDhcpContainerUlimitNofile | 15:16 |
| chem | jfrancoa: hey so we went further in the upgrade workflow :) | 15:16 |
| chem | jfrancoa: https://logs.rdoproject.org/80/552080/21/openstack-check/gate-tripleo-ci-centos-7-container-to-container-upgrades-queens-nv/Zf66050539abf4f4ea8d5d8e14528d554/undercloud/home/jenkins/overcloud_upgrade_run_Controller.log.txt.gz | 15:16 |
| mwhahaha | ykarel: i think we should just expose ulimit instead rather than the specific settings | 15:16 |
| chem | jfrancoa: what is that mistral user ? | 15:16 |
| ykarel | mwhahaha, Ok | 15:16 |
| EmilienM | slagle: I'm a bit embarrassed for https://review.openstack.org/#/c/559740/ but I guess it's the best option to avoid regressions in the workflows? | 15:16 |
| ykarel | That would save from multiple parameters | 15:16 |
| jfrancoa | chem: I believe it's related to this patch from jistr https://review.openstack.org/#/c/558855/ | 15:17 |
| jfrancoa | chem: we need to use tripleo-admin to run the ansible-playbooks, and Jirka added some option within tripleo-upgrade to pass the specific user | 15:17 |
| jfrancoa | chem: but the patch is not merged yet | 15:18 |
| chem | jfrancoa: oh, that's great we have the solution then ... upgrade jobs is coming :) | 15:18 |
| *** ukalifon has quit IRC | 15:19 | |
| jfrancoa | sshnaidm: I think this was the patch I was refering to in the meeting (unfortunetely there are no logs for it anymore) https://review.openstack.org/#/c/548974/18 | 15:20 |
| *** yprokule has quit IRC | 15:20 | |
| sshnaidm | jfrancoa, thanks, will look into | 15:20 |
| jfrancoa | sshnaidm: it's a tripleo-ci patch with a depends-on a queens tripleo-upgrade one, and it was downloading master | 15:21 |
| sshnaidm | jfrancoa, cool, I see there backports: https://review.openstack.org/#/q/Iae680d97eeef52b9145c290b0b988cb267af3b3d | 15:21 |
| sshnaidm | jfrancoa, so which upgrades job should I look at..? | 15:22 |
| chem | jfrancoa: it will be merged in queen in some hours :) | 15:24 |
| jfrancoa | sshnaidm: I tried to access to the reproducer-quickstart from that review #18, but the logs were already erased | 15:24 |
| ykarel | mwhahaha, created https://bugs.launchpad.net/tripleo/+bug/1762455 | 15:24 |
| openstack | Launchpad bug 1762455 in tripleo "Make setting for ulimit configurable via THT parameter" [Undecided,New] | 15:24 |
| *** dsariel has joined #tripleo | 15:24 | |
| mwhahaha | ykarel: thanks | 15:24 |
| EmilienM | mwhahaha: https://review.openstack.org/#/c/559740/ FYI | 15:25 |
| *** chlong has quit IRC | 15:25 | |
| ykarel | mwhahaha, will assign myself and propose patch for it | 15:25 |
| jfrancoa | sshnaidm: we could try to force a similar situation creating a dummy patch in tripleo-ci and add a depends-on this https://review.openstack.org/#/c/559722/, for example | 15:25 |
| mwhahaha | EmilienM: stupid containers | 15:26 |
| *** slaweq has quit IRC | 15:26 | |
| EmilienM | mwhahaha: I'm working on the bug, fyi | 15:26 |
| EmilienM | mwhahaha: https://review.openstack.org/#/q/topic:undercloud/cont/update+(status:open+OR+status:merged) | 15:26 |
| *** slaweq has joined #tripleo | 15:26 | |
| mwhahaha | EmilienM: weshay_pto had a patch i thought | 15:26 |
| EmilienM | mwhahaha: for overcloud | 15:26 |
| mwhahaha | k | 15:27 |
| EmilienM | slagle: I hope not but have you seen a regression in the workflows or anything else so far? | 15:27 |
| *** morazi has quit IRC | 15:27 | |
| *** rpioso is now known as rpioso|eat | 15:27 | |
| *** jfrancoa has quit IRC | 15:29 | |
| *** lblanchard has joined #tripleo | 15:30 | |
| *** slaweq has quit IRC | 15:30 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: Allow uploading big files to swift (5GB) https://review.openstack.org/559024 | 15:31 |
| slagle | EmilienM: nothing specific I'm aware of | 15:34 |
| slagle | EmilienM: the container-check patch was throwing a python traceback. that's why i proposed a revert | 15:34 |
| slagle | EmilienM: if we can prove that actually works today, then i'm happy to go with that instead of a revert | 15:34 |
| EmilienM | slagle: on my patches? yeah I'm on it | 15:35 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Sanitize the uuid string https://review.openstack.org/559770 | 15:37 |
| *** links has quit IRC | 15:37 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: Allow uploading big files to swift (5GB) https://review.openstack.org/559024 | 15:39 |
| *** jpena is now known as jpena|brb | 15:41 | |
| *** pradk has joined #tripleo | 15:41 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: Allow uploading big files to swift (5GB) https://review.openstack.org/559024 | 15:42 |
| *** leanderthal has quit IRC | 15:43 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Switch Zaqar to use Redis https://review.openstack.org/558874 | 15:45 |
| *** timothyb89_ is now known as timothyb89 | 15:46 | |
| *** stendulker has quit IRC | 15:46 | |
| *** pkovar has quit IRC | 15:47 | |
| mwhahaha | bogdando: looks like https://review.openstack.org/#/c/556794/ might be in conflcit | 15:52 |
| mwhahaha | conflict | 15:52 |
| *** dsariel has quit IRC | 15:52 | |
| bogdando | mwhahaha: yupp | 15:53 |
| *** agopi_ has joined #tripleo | 15:54 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 15:55 |
| *** pradk has quit IRC | 15:55 | |
| EmilienM | slagle: the problem won't be solved today I think, the issue is that 'container-check' tool doesn't work when a remote docker registry is used (which is the case of the undercloud containers for now). So revert is good. Can we keep fs001 though? | 15:56 |
| EmilienM | I would try to keep at least one job deploying an overcloud | 15:56 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Delete not-used services-docker files https://review.openstack.org/556794 | 15:56 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: Allow uploading big files to swift (5GB) https://review.openstack.org/559024 | 15:57 |
| *** agopi_ has quit IRC | 15:57 | |
| *** agopi_ has joined #tripleo | 15:57 | |
| *** agurenko has quit IRC | 15:59 | |
| jaosorior | EmilienM, mwhahaha: what's the difference between /var/lib/config-data/nova/ and /var/lib/puppet-generated/nova ? do they get generated differently? | 15:59 |
| slagle | EmilienM: sure, since it's ovb. i'm not as concerned about ovb | 16:00 |
| mwhahaha | jaosorior: that's a good question. i'm unsure which is the authoritative. I noticed once that it seems that the puppet-generated was getting mounted | 16:00 |
| *** pradk has joined #tripleo | 16:00 | |
| openstackgerrit | Merged openstack/tripleo-common master: Deprecates tripleo.roles.list action https://review.openstack.org/544751 | 16:01 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Apply the vhost group parameter for the vhost_sockets directory creation https://review.openstack.org/555661 | 16:01 |
| owalsh | mwhahaha, jaosorior: I *think* /var/lib/config-data/nova is checksummed to deteremine if the container needs to be restarted | 16:02 |
| jaosorior | owalsh: does it get updated every time? | 16:02 |
| owalsh | jaosorior: when we run puppet? Yea, think so... | 16:02 |
| jaosorior | owalsh: alee saw a strange issue where, if you change the NovaPassword parameter to use a new one, the rest of the containers get the new password.... but not the discover_hosts one; which ends up failing with wrong credentials. The only difference I can see is that that specific container uses /var/lib/config-data/nova instead of /var/lib/config-data/puppet-generated/nova | 16:03 |
| *** jcoufal has quit IRC | 16:04 | |
| owalsh | jaosorior: yea, that sounds wrong | 16:04 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-upgrade master: DNM: Add a temp change to spin tripleo-upgrades-check tests https://review.openstack.org/556621 | 16:04 |
| owalsh | jaosorior: checksum generated here https://github.com/openstack/tripleo-heat-templates/blob/master/docker/docker-puppet.py#L274 | 16:05 |
| bnemec | jaosorior: Done | 16:05 |
| bnemec | slagle: Bite your tongue, man! :-P | 16:06 |
| jaosorior | bnemec: thanks! | 16:06 |
| jaosorior | owalsh: was there a reason why config-data/nova was used instead of puppet-generated? | 16:06 |
| owalsh | jaosorior: cutnpasta I expect | 16:06 |
| jaosorior | owalsh: that's alright | 16:06 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-upgrade stable/queens: DNM: Add a temp change to spin tripleo-upgrades-check tests https://review.openstack.org/556627 | 16:06 |
| *** jmelvin has quit IRC | 16:06 | |
| EmilienM | dprince, mwhahaha : please review again https://review.openstack.org/#/c/558893/ when you have time this week. Comments addressed. | 16:07 |
| jaosorior | alee after you test cinder, we could give a try to changing the bind-mount to use puppet-generated instead and seeing if that fixes the issue. | 16:07 |
| jaosorior | thanks for the info owalsh | 16:07 |
| slagle | bnemec: i'll qualify ovb as "3rd party ovb jobs running on rdo cloud" :). that are providing a certain conditioned response | 16:08 |
| owalsh | jaosorior: hrmm, I think it should work as it is though | 16:08 |
| *** dparkes has quit IRC | 16:08 | |
| jaosorior | owalsh: it doesn't; for a strange reason | 16:08 |
| *** fragatina has joined #tripleo | 16:09 | |
| jaosorior | owalsh: if you want to to test it out, it's not to hard, so let me know. | 16:09 |
| *** dparkes has joined #tripleo | 16:09 | |
| bnemec | slagle: I should probably stop trolling or someone is going to tell me to go fix them. | 16:09 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1762422 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1762422 in tripleo "ci: containerized undercloud does not test tripleo-common" [Critical,In progress] - Assigned to James Slagle (james-slagle) | 16:10 |
| *** jchhatbar has quit IRC | 16:10 | |
| jaosorior | EmilienM, mwhahaha could you check this out https://review.openstack.org/#/c/559620/ ? | 16:11 |
| owalsh | jaosorior: can't right now, do we have an LP? | 16:11 |
| jaosorior | owalsh: not yet. Soon :D | 16:11 |
| jaosorior | alee: ^^ | 16:11 |
| *** artom_ is now known as artom | 16:12 | |
| EmilienM | jaosorior: done | 16:14 |
| *** shadower has quit IRC | 16:15 | |
| EmilienM | dprince, Sl0w: I would appreciate if you could take a look at my notes on https://bugs.launchpad.net/tripleo/+bug/1762422 - I'll also talk with stevebaker today when he's up. | 16:15 |
| openstack | Launchpad bug 1762422 in tripleo "ci: containerized undercloud does not test tripleo-common" [Critical,In progress] - Assigned to James Slagle (james-slagle) | 16:15 |
| jaosorior | EmilienM: thanks | 16:15 |
| jaosorior | EmilienM: and this, if you have a chance https://review.openstack.org/#/c/559322/3 | 16:17 |
| *** zoli|afk is now known as zoli|wfh | 16:17 | |
| *** zoli|wfh is now known as zoli | 16:17 | |
| *** lucasagomes is now known as lucas-afk | 16:19 | |
| *** aufi has quit IRC | 16:20 | |
| *** dparkes has quit IRC | 16:21 | |
| *** shadower has joined #tripleo | 16:22 | |
| *** jpena|brb is now known as jpena | 16:24 | |
| bogdando | https://bugs.launchpad.net/tripleo/+bug/1762475 | 16:27 |
| openstack | Launchpad bug 1762475 in tripleo "Docker debug puppet augeas fails to apply" [Medium,Triaged] | 16:27 |
| bogdando | I'm really tired of that augeas thing. Fixed it twice so far | 16:27 |
| *** dparkes has joined #tripleo | 16:27 | |
| bogdando | and as always, not sure why CI passes :) | 16:27 |
| bogdando | the w/a is to remove the puppet augeas snippet | 16:28 |
| *** pradk has quit IRC | 16:29 | |
| *** suuuper has quit IRC | 16:30 | |
| *** liverpooler has quit IRC | 16:31 | |
| openstackgerrit | Merged openstack/instack-undercloud master: Always include certmonger_user https://review.openstack.org/558768 | 16:31 |
| openstackgerrit | Merged openstack/puppet-tripleo master: firewall/masquerading: configure state and proto https://review.openstack.org/559259 | 16:31 |
| *** jpich has quit IRC | 16:33 | |
| *** pradk has joined #tripleo | 16:33 | |
| jaosorior | EmilienM: when you have time https://review.openstack.org/#/c/559323/ | 16:38 |
| *** trown is now known as trown|lunch | 16:38 | |
| *** dhill_ has joined #tripleo | 16:39 | |
| *** shadower has quit IRC | 16:41 | |
| mwhahaha | arxcruz|ruck, trown|lunch, sshnaidm: https://review.openstack.org/#/c/559107/ is passing CI can we merge it to unblock pike | 16:43 |
| arxcruz|ruck | mwhahaha: fine by me :) | 16:43 |
| arxcruz|ruck | but i'm not core need to check with sshnaidm rlandy | 16:43 |
| mwhahaha | thanks | 16:44 |
| *** shadower has joined #tripleo | 16:44 | |
| *** udesale has quit IRC | 16:46 | |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates master: Fixes the OvsVhostuserMode heat parameter https://review.openstack.org/559789 | 16:46 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/puppet-tripleo master: Fix docker debug JSON augeas changes https://review.openstack.org/559790 | 16:46 |
| *** dhill_ has quit IRC | 16:48 | |
| *** dhill_ has joined #tripleo | 16:48 | |
| *** tesseract has quit IRC | 16:48 | |
| *** jgwentworth is now known as melwitt | 16:51 | |
| -openstackstatus- NOTICE: zuul was restarted to update to the latest code; please recheck any changes uploaded within the past 10 minutes | 16:53 | |
| *** florianf has quit IRC | 16:58 | |
| *** derekh has quit IRC | 16:59 | |
| *** avivgt has quit IRC | 17:01 | |
| *** masco has quit IRC | 17:01 | |
| *** dhill__ has joined #tripleo | 17:02 | |
| *** dhill_ has quit IRC | 17:03 | |
| rlandy | chem: hi - https://github.com/openstack/tripleo-upgrade/blob/master/defaults/main.yml#L64 - is this meant to point to the original (non upgrade) overcloud deploy script? (looking at the error: https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-container-to-container-upgrades-queens-nv/44/consoleFull) | 17:05 |
| rlandy | if so, it's https://logs.rdoproject.org/89/555389/9/openstack-check/gate-tripleo-ci-centos-7-container-to-container-upgrades-queens-nv/Zb53f055673624326bedf019f5c295475/undercloud/home/jenkins/overcloud-deploy.sh | 17:06 |
| rlandy | (not underscore) | 17:06 |
| *** holser__ has quit IRC | 17:09 | |
| chem | rlandy: the underscore comes after the transformation https://github.com/openstack/tripleo-upgrade/blob/master/templates/oooq_deploy_transformation.sh.j2#L1..L23 | 17:09 |
| chem | rlandy: that what make us comptatible with infrared | 17:09 |
| chem | rlandy: hi :) | 17:09 |
| chem | rlandy: (past eod here ...) | 17:10 |
| chem | rlandy: as for the error ... | 17:10 |
| *** kopecmartin has quit IRC | 17:10 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1762422 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1762422 in tripleo "ci: containerized undercloud does not test tripleo-common" [Critical,In progress] - Assigned to James Slagle (james-slagle) | 17:10 |
| rlandy | chem: k - I see | 17:11 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers https://review.openstack.org/551441 | 17:11 |
| rlandy | thanks for the explanation | 17:11 |
| *** chlong has joined #tripleo | 17:14 | |
| *** bogdando has quit IRC | 17:14 | |
| chem | rlandy: maybe it's late or something but I can't find that register.*content task in tripleo-upgrade, could you point me to it ? | 17:15 |
| *** jpena is now known as jpena|away | 17:18 | |
| *** fzdarsky__ has joined #tripleo | 17:20 | |
| chem | jistr: we have to invert the dependencies in https://review.openstack.org/#/c/559746/ and https://review.openstack.org/#/c/559755/ if we want to test it | 17:21 |
| *** fzdarsky_ has quit IRC | 17:21 | |
| chem | jistr: maybe I'll find time later today | 17:21 |
| rlandy | chem: https://review.openstack.org/#/c/555389/9/tasks/upgrade/overcloud_upgrade_prepare.yml | 17:22 |
| *** fzdarsky__ has quit IRC | 17:25 | |
| rlandy | chem: not to worry - I see these are reviews in progress | 17:26 |
| chem | rlandy: strange ... that file should be there at that point ... will look into it tomorrow (but it seems we're going with the more generic way to import role, sshnaidm can says more about https://review.openstack.org/#/c/555389/) | 17:26 |
| *** fzdarsky__ has joined #tripleo | 17:26 | |
| chem | oki, need to be somewhere else ... bye | 17:27 |
| *** zoli is now known as zoli|gone | 17:27 | |
| *** chem is now known as chem|eod | 17:27 | |
| *** zoli|gone is now known as zoli | 17:27 | |
| *** fzdarsky__ has quit IRC | 17:31 | |
| *** trown|lunch is now known as trown | 17:37 | |
| *** fzdarsky__ has joined #tripleo | 17:37 | |
| *** mdnadeem has quit IRC | 17:38 | |
| *** paramite has quit IRC | 17:44 | |
| *** rpioso|eat is now known as rpioso | 17:46 | |
| *** jcoufal has joined #tripleo | 17:50 | |
| *** anilvenkata has joined #tripleo | 17:51 | |
| *** fragatina has quit IRC | 17:53 | |
| *** paramite has joined #tripleo | 17:57 | |
| mwhahaha | akrivoka, jtomasek: what's the status of the network management UI bits? The blueprints don't have assignee's for rocky | 17:57 |
| *** liverpooler has joined #tripleo | 17:58 | |
| *** holser__ has joined #tripleo | 17:58 | |
| mwhahaha | jrist: do you know -^ | 17:59 |
| *** vineet has joined #tripleo | 18:01 | |
| *** thrash is now known as thrash|bbl | 18:02 | |
| *** amoralej is now known as amoralej|off | 18:03 | |
| openstackgerrit | venkata anil proposed openstack/tripleo-heat-templates master: Fix typo in ovn_cms_options config https://review.openstack.org/559806 | 18:07 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Generate and mount wrappers for neutron agent processes https://review.openstack.org/550823 | 18:08 |
| mwhahaha | slagle: do you know who might be working on the skydive stuff for https://blueprints.launchpad.net/tripleo/+spec/skydive-external-deploy-tasks | 18:08 |
| slagle | mwhahaha: sdoran | 18:09 |
| mwhahaha | k thanks | 18:09 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1762422 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1762422 in tripleo "ci: containerized undercloud does not test tripleo-common" [Critical,In progress] - Assigned to James Slagle (james-slagle) | 18:10 |
| openstackgerrit | venkata anil proposed openstack/tripleo-heat-templates master: Fix typo in ovn_cms_options config https://review.openstack.org/559806 | 18:10 |
| *** chlong has quit IRC | 18:11 | |
| *** mcornea has quit IRC | 18:12 | |
| *** mcornea has joined #tripleo | 18:14 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: WIP Change put_object by upload https://review.openstack.org/559809 | 18:24 |
| *** pchavva has quit IRC | 18:25 | |
| *** jpena|away is now known as jpena|off | 18:27 | |
| EmilienM | jaosorior: question for you | 18:28 |
| jtomasek | mwhahaha: I'll get them updated, sorry | 18:28 |
| EmilienM | jaosorior: in https://review.openstack.org/#/c/548554/ | 18:28 |
| mwhahaha | jtomasek: k if i moved it out, feel free to move it back when it has an owner/milestones | 18:28 |
| EmilienM | jaosorior: can you explain OS::TripleO::Docker::NeutronMl2PluginBase: puppet/services/neutron-plugin-ml2.yaml ? | 18:28 |
| *** slaweq has joined #tripleo | 18:28 | |
| *** ykarel has quit IRC | 18:28 | |
| * mwhahaha is doing some spring cleaning | 18:28 | |
| EmilienM | jaosorior: and your comment: "# Default Neutron ML2 puppet plugin to use when NeutronCorePlugin is set to ML2" | 18:28 |
| jtomasek | mwhahaha: ok | 18:29 |
| cgoncalves | EmilienM: if all looks good to you, please +W https://review.openstack.org/#/c/559166/ & https://review.openstack.org/#/c/559165/ & https://review.openstack.org/#/c/559153/ | 18:34 |
| mwhahaha | dsneddon, hjensas: is https://blueprints.launchpad.net/tripleo/+spec/tripleo-routed-networks-templates implemented? i saw https://review.openstack.org/#/c/473817/ | 18:34 |
| *** pradk has quit IRC | 18:36 | |
| *** waleedm has joined #tripleo | 18:39 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Update OS::TripleO::Services::ComputeNeutronCorePlugin for containers https://review.openstack.org/559812 | 18:40 |
| cgoncalves | EmilienM, thanks! you may have missed https://review.openstack.org/#/c/559165/ :) | 18:40 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-puppet-elements master: Remove Openstack and Ceph packages https://review.openstack.org/521172 | 18:40 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-puppet-elements master: Remove Openstack and Ceph packages https://review.openstack.org/521172 | 18:40 |
| EmilienM | cgoncalves: dude let me time please | 18:41 |
| mwhahaha | trozet: https://blueprints.launchpad.net/tripleo/+spec/onos-integration ? | 18:41 |
| EmilienM | mwhahaha: doing depends-on on the patch ^ let's see how that works | 18:41 |
| mwhahaha | k | 18:41 |
| trozet | mwhahaha: we can abandon that. There is no more interest in doing it from the community | 18:42 |
| mwhahaha | k | 18:42 |
| mwhahaha | jaosorior: https://blueprints.launchpad.net/tripleo/+spec/shared-x509-certficates ? | 18:43 |
| *** radeks has quit IRC | 18:51 | |
| *** radeks has joined #tripleo | 18:51 | |
| dsneddon | mwhahaha, No, I need to update the tripleo-routed-networks-templates spec for Rocky. | 18:51 |
| mwhahaha | dsneddon: k | 18:51 |
| dsneddon | mwhahaha, It's on my TODO list for this week. | 18:52 |
| *** Goneri has quit IRC | 18:52 | |
| *** gfidente has quit IRC | 18:54 | |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates master: Fix missing allowed network type 'flat' for ODL OVS https://review.openstack.org/559816 | 18:56 |
| *** morazi has joined #tripleo | 18:57 | |
| mwhahaha | slagle: do we have blueprints for the ui bits required for https://blueprints.launchpad.net/tripleo/+spec/config-download-default ? | 19:00 |
| *** atoth has quit IRC | 19:02 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Revert "Deploy container-multinode (fs010) with a containerized undercloud" https://review.openstack.org/559740 | 19:03 |
| *** atoth has joined #tripleo | 19:04 | |
| slagle | mwhahaha: yes. if you look at https://blueprints.launchpad.net/tripleo/+spec/non-config-download-deprecate you can see all the deps off of that one | 19:04 |
| slagle | it's https://blueprints.launchpad.net/tripleo/+spec/config-download-ui fwiw | 19:04 |
| mwhahaha | slagle: ok but shouldn't config download by default depend on thatone? | 19:05 |
| * mwhahaha would really like it not to be rocky-3 | 19:05 | |
| mwhahaha | jtomasek: anyway we can get https://blueprints.launchpad.net/tripleo/+spec/config-download-ui for rocky-2? it would be a really good idea for us to switch config-download as the default early in upstream CI | 19:05 |
| jtomasek | mwhahaha: I am actively working on it currently. I'd like to have the work done by the end of this week | 19:06 |
| slagle | mwhahaha: i didn't put that target on there iirc. i didn't make the default one depend on the ui for various reasons | 19:06 |
| mwhahaha | k | 19:07 |
| slagle | mwhahaha: mostly so we could move forward with the new default w/o being blocked on the ui | 19:07 |
| slagle | mwhahaha: in the email i sent to the list i mentioned that i'll be including an environment that can restore the old behavior when we make the config-download mappings the default in the resource-registry | 19:07 |
| *** atoth has quit IRC | 19:07 | |
| slagle | as well as a --no-config-download for the client | 19:07 |
| mwhahaha | ok | 19:08 |
| slagle | so you'll be able to opt-out. which the ui may need to do for a time being | 19:08 |
| *** waleedm has quit IRC | 19:09 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1762422 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1762422 in tripleo "ci: containerized undercloud does not test tripleo-common" [Critical,In progress] - Assigned to James Slagle (james-slagle) | 19:10 |
| *** radeks has quit IRC | 19:12 | |
| *** radeks has joined #tripleo | 19:13 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: containerized-undercloud: don't manage stackrc https://review.openstack.org/559818 | 19:17 |
| EmilienM | slagle: removing alert on 1762422 | 19:17 |
| EmilienM | ah you did it already | 19:17 |
| EmilienM | cool | 19:17 |
| EmilienM | slagle: I'll assign the bug to myself from now, as I'm working on fixing the situation for the container updates | 19:18 |
| slagle | EmilienM: sounds good, thx | 19:18 |
| *** salmankhan has joined #tripleo | 19:19 | |
| jaosorior | EmilienM: that was part of the docker.yaml file\ | 19:21 |
| jaosorior | EmilienM: so... the comment was there already, I merely moved it. | 19:21 |
| EmilienM | jaosorior: ah, ok | 19:21 |
| jaosorior | mwhahaha: prooobably won't have time to work on that. | 19:22 |
| *** pkovar has joined #tripleo | 19:22 | |
| mwhahaha | jaosorior: k i moved it to the furture | 19:22 |
| jaosorior | mwhahaha: cool cool | 19:22 |
| *** salmankhan has quit IRC | 19:24 | |
| *** mcornea has quit IRC | 19:25 | |
| *** akrivoka has quit IRC | 19:26 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Default environment/services/* to docker https://review.openstack.org/556797 | 19:30 |
| *** radeks has quit IRC | 19:31 | |
| *** radeks has joined #tripleo | 19:31 | |
| *** mcornea has joined #tripleo | 19:33 | |
| *** dsariel has joined #tripleo | 19:37 | |
| *** ipsecguy has quit IRC | 19:40 | |
| *** fzdarsky__ is now known as fzdarsky|afk | 19:43 | |
| *** ipsecguy has joined #tripleo | 19:45 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Don't set deployments as hostvars https://review.openstack.org/559433 | 19:46 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Use hostnames in inventory https://review.openstack.org/558550 | 19:46 |
| *** yamahata has quit IRC | 19:47 | |
| openstackgerrit | Merged openstack/tripleo-common master: Add passwords and images for separate messaging backends https://review.openstack.org/508259 | 19:48 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Remove extra spaces and fix README for bmu role https://review.openstack.org/521617 | 19:48 |
| *** jtomasek has quit IRC | 19:49 | |
| openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo master: Fixes incorrect license for certmonger haproxy dirs https://review.openstack.org/559824 | 19:51 |
| *** marrusl has quit IRC | 19:59 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers https://review.openstack.org/551441 | 19:59 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Added enable_tempest flag for installing tempest on undercloud https://review.openstack.org/558510 | 20:00 |
| *** radek has quit IRC | 20:00 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Run tempest on fs027 using containerized tempest https://review.openstack.org/551442 | 20:01 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Run tempest on undercloud on fs003 https://review.openstack.org/554522 | 20:02 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Rename test_regex to test_white_regex https://review.openstack.org/559281 | 20:02 |
| *** pchavva has joined #tripleo | 20:02 | |
| openstackgerrit | Rafael Folco proposed openstack/tripleo-quickstart-extras master: Fix dstat time penalty for failed runs https://review.openstack.org/558908 | 20:02 |
| *** chlong has joined #tripleo | 20:07 | |
| *** salmankhan has joined #tripleo | 20:14 | |
| *** waleedm has joined #tripleo | 20:18 | |
| *** dprince has quit IRC | 20:27 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: masquerade: configure FORWARD rules https://review.openstack.org/559830 | 20:28 |
| *** lblanchard has quit IRC | 20:35 | |
| *** pcaruana has quit IRC | 20:36 | |
| *** assassin has quit IRC | 20:36 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: masquerade-networks: update defaults https://review.openstack.org/559833 | 20:36 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Remove nat/masquerading config workarounds. https://review.openstack.org/557851 | 20:37 |
| *** chlong has quit IRC | 20:47 | |
| *** fragatina has joined #tripleo | 20:47 | |
| *** Goneri has joined #tripleo | 20:48 | |
| *** fragatina has quit IRC | 20:48 | |
| *** fragatina has joined #tripleo | 20:49 | |
| *** ansmith has quit IRC | 20:50 | |
| *** trown is now known as trown|outtypewww | 20:50 | |
| *** paramite has quit IRC | 20:51 | |
| *** pchavva has quit IRC | 20:52 | |
| *** waleedm has quit IRC | 20:54 | |
| *** liverpooler has quit IRC | 20:55 | |
| *** rfolco|rover is now known as rfolco|off | 20:55 | |
| *** dsavineau has quit IRC | 20:59 | |
| *** dsavineau has joined #tripleo | 20:59 | |
| *** dparkes has quit IRC | 21:00 | |
| *** dparkes has joined #tripleo | 21:00 | |
| *** slaweq has quit IRC | 21:01 | |
| *** salmankhan has quit IRC | 21:01 | |
| *** slaweq has joined #tripleo | 21:02 | |
| *** slaweq has quit IRC | 21:06 | |
| *** artom has quit IRC | 21:15 | |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: [WIP]logging: read non-containerized logs https://review.openstack.org/545841 | 21:22 |
| *** panda is now known as panda|off | 21:22 | |
| *** waleedm has joined #tripleo | 21:25 | |
| openstackgerrit | Merged openstack/tripleo-docs master: fix error url https://review.openstack.org/540218 | 21:28 |
| *** pkovar has quit IRC | 21:43 | |
| *** ansmith has joined #tripleo | 21:47 | |
| *** dbecker has quit IRC | 21:47 | |
| *** dbecker has joined #tripleo | 21:48 | |
| *** raildo has quit IRC | 21:50 | |
| *** rlandy has quit IRC | 21:55 | |
| *** shreshtha has joined #tripleo | 21:57 | |
| *** tosky has quit IRC | 22:08 | |
| *** bfournie has quit IRC | 22:11 | |
| *** rcernin has joined #tripleo | 22:14 | |
| *** ffiore has joined #tripleo | 22:19 | |
| *** ffiore has quit IRC | 22:20 | |
| *** rpioso is now known as rpioso|afk | 22:24 | |
| *** jcoufal has quit IRC | 22:26 | |
| mwhahaha | tbarron: is https://blueprints.launchpad.net/tripleo/+spec/nfs-ganesha implemented or is there still open work for it? | 22:30 |
| *** shreshtha has quit IRC | 22:30 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Correct the InternalTLSVncCAFile to comply with selinux policy https://review.openstack.org/559708 | 22:37 |
| *** mcornea has quit IRC | 22:39 | |
| tbarron | mwhahaha: w.r.t. https://blueprints.launchpad.net/tripleo/+spec/nfs-ganesha there'll be more work as bugs I'm sure but we landed the feature patches | 22:53 |
| mwhahaha | tbarron: sounds good, i'll mark it implemented then | 22:53 |
| tbarron | mwhahaha: ty! | 22:53 |
| *** holser__ has quit IRC | 22:54 | |
| *** Goneri has quit IRC | 22:57 | |
| dtrainor | I'm pulling up Horizon on a downstream build of Pike, and I see some errors I'm not familiar with. Do they sound like they would be indicative of a larger problem? Anything coming to mind? Overview says "Error: Unable to retrieve usage information.", Images says "Error: Unable to retrieve the images.", Networks says "Error: Network list can not be retrieved." | 22:57 |
| dtrainor | ....before I start digging :) | 22:57 |
| dtrainor | I see nothing in the Horizon logs to indicate a problem | 22:58 |
| *** yamahata has joined #tripleo | 23:01 | |
| *** waleedm has quit IRC | 23:02 | |
| *** waleedm has joined #tripleo | 23:02 | |
| *** slaweq has joined #tripleo | 23:02 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add ability to set protocol in endpoint_data.yaml file https://review.openstack.org/558423 | 23:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Default CertmongerUser to be defined for undercloud setup https://review.openstack.org/559620 | 23:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Default NodeTLSData to always attempt setting TLS cert https://review.openstack.org/556817 | 23:06 |
| *** slaweq has quit IRC | 23:07 | |
| *** chem|eod has quit IRC | 23:22 | |
| *** radeks has quit IRC | 23:22 | |
| *** radeks has joined #tripleo | 23:30 | |
| *** radeks has quit IRC | 23:34 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 23:55 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!