| *** liverpooler has joined #tripleo | 00:01 | |
| openstackgerrit | Merged openstack/tripleo-common master: Remove references to the current task from task() in stack.yaml https://review.openstack.org/513677 | 00:02 |
|---|---|---|
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 00:10 |
| *** rwsu has joined #tripleo | 00:13 | |
| rlandy | weshay|ruck: one successful job :) ... http://logs.openstack.org/65/514465/1/check/legacy-tripleo-ci-centos-7-scenario003-multinode-oooq-container/c1fc9da/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz | 00:13 |
| *** tzumainn has quit IRC | 00:14 | |
| *** rlandy is now known as rlandy|bbl | 00:15 | |
| *** bobh has quit IRC | 00:23 | |
| *** fragatina has quit IRC | 00:31 | |
| *** fragatina has joined #tripleo | 00:31 | |
| *** fragatina has quit IRC | 00:32 | |
| *** fragatina has joined #tripleo | 00:32 | |
| *** ecerquei has quit IRC | 00:39 | |
| *** liverpooler has quit IRC | 00:45 | |
| *** leitan has quit IRC | 00:46 | |
| *** fragatina has quit IRC | 01:05 | |
| *** fragatina has joined #tripleo | 01:06 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 01:10 |
| *** fragatina has quit IRC | 01:10 | |
| EmilienM | stevebaker: can you review https://review.openstack.org/#/c/514261/1 please ? | 01:15 |
| *** daidv has joined #tripleo | 01:16 | |
| *** fzdarsky_ has joined #tripleo | 01:25 | |
| *** leitan has joined #tripleo | 01:25 | |
| *** bobh has joined #tripleo | 01:25 | |
| *** fzdarsky has quit IRC | 01:28 | |
| *** bobh has quit IRC | 01:28 | |
| *** pkovar has quit IRC | 01:42 | |
| *** leitan has quit IRC | 01:46 | |
| *** amodi has joined #tripleo | 01:49 | |
| *** psachin has joined #tripleo | 01:59 | |
| *** rlandy|bbl is now known as rlandy | 02:06 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 02:10 |
| *** rbrady has quit IRC | 02:12 | |
| *** zshi has quit IRC | 02:14 | |
| *** zshi has joined #tripleo | 02:16 | |
| stevebaker | EmilienM: sure | 02:25 |
| *** rbrady has joined #tripleo | 02:27 | |
| *** yamahata has quit IRC | 02:41 | |
| *** shreshtha has joined #tripleo | 02:46 | |
| *** shreshtha has quit IRC | 02:48 | |
| *** shreshtha has joined #tripleo | 02:49 | |
| *** fragatina has joined #tripleo | 02:52 | |
| EmilienM | stevebaker: thx | 02:59 |
| EmilienM | weshay|ruck: approved https://review.openstack.org/#/c/514261/ - combined with https://review.openstack.org/#/c/513760/ - I don't see any more blocker in our pipe | 03:01 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] start at templating out the zuulv3 jobs https://review.openstack.org/512450 | 03:09 |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 03:10 |
| *** fragatina has quit IRC | 03:14 | |
| *** fragatina has joined #tripleo | 03:15 | |
| *** fragatina has quit IRC | 03:19 | |
| *** rlandy has quit IRC | 03:24 | |
| *** amodi has quit IRC | 03:27 | |
| *** mdnadeem has joined #tripleo | 03:27 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Override target_upgrade_version to the right version https://review.openstack.org/512886 | 03:29 |
| *** fragatina has joined #tripleo | 03:33 | |
| *** abregman has quit IRC | 03:39 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Transform mongodb::server::bind_ip in an array https://review.openstack.org/514116 | 03:39 |
| *** pdeore has joined #tripleo | 03:48 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] start at templating out the zuulv3 jobs https://review.openstack.org/512450 | 03:50 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] start at templating out the zuulv3 jobs https://review.openstack.org/512450 | 03:52 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] start at templating out the zuulv3 jobs https://review.openstack.org/512450 | 03:54 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Do not rely on openstack-puppet-modules https://review.openstack.org/512774 | 03:55 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Do not rely on openstack-puppet-modules in Queens and beyond https://review.openstack.org/512772 | 03:55 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Remove deprecation handling from custom roles https://review.openstack.org/512445 | 03:55 |
| *** gkadam_ has joined #tripleo | 03:56 | |
| *** pdeore_ has joined #tripleo | 04:04 | |
| *** bkopilov has quit IRC | 04:05 | |
| *** pdeore has quit IRC | 04:06 | |
| *** newmember has joined #tripleo | 04:07 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 04:10 |
| *** chlong has joined #tripleo | 04:13 | |
| EmilienM | weshay|ruck: https://review.openstack.org/511568 failed in gate, not sure https://review.openstack.org/513760 will be reset | 04:17 |
| weshay|ruck | EmilienM, I think it timed out | 04:17 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] start at templating out the zuulv3 jobs https://review.openstack.org/512450 | 04:17 |
| EmilienM | yeah | 04:18 |
| EmilienM | weshay|ruck: I think puppet-cinder will merge | 04:18 |
| EmilienM | I don't see dependency | 04:18 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] start at templating out the zuulv3 jobs https://review.openstack.org/512450 | 04:19 |
| *** masco has joined #tripleo | 04:21 | |
| *** udesale has joined #tripleo | 04:22 | |
| EmilienM | weshay|ruck: ok puppet-cinder was reseted :( it's in gate again (first this time). Once https://review.openstack.org/#/c/514261/ merges as well, we should have progress. Will catch-up tomorrow. GN | 04:25 |
| EmilienM | I don't understand these resets | 04:25 |
| EmilienM | i'll ask pabelanger later | 04:25 |
| weshay|ruck | EmilienM, ya.. the dependencies seem off | 04:26 |
| weshay|ruck | tempest timed out | 04:26 |
| weshay|ruck | yay | 04:26 |
| weshay|ruck | l8rs | 04:26 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] start at templating out the zuulv3 jobs https://review.openstack.org/512450 | 04:26 |
| *** mburned is now known as mburned_out | 04:42 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] start at templating out the zuulv3 jobs https://review.openstack.org/512450 | 04:43 |
| *** gvrangan has joined #tripleo | 04:45 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] start at templating out the zuulv3 jobs https://review.openstack.org/512450 | 04:47 |
| *** skramaja has joined #tripleo | 04:47 | |
| Tengu | hello fellow stackers :) | 04:47 |
| *** dparkes has quit IRC | 04:51 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] start at templating out the zuulv3 jobs https://review.openstack.org/512450 | 04:55 |
| *** janki has joined #tripleo | 04:55 | |
| *** ykarel has joined #tripleo | 05:04 | |
| *** ykarel_ has joined #tripleo | 05:04 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] start at templating out the zuulv3 jobs https://review.openstack.org/512450 | 05:04 |
| *** ykarel_ has quit IRC | 05:05 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 05:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 05:10 |
| *** shreshtha has quit IRC | 05:12 | |
| *** udesale has quit IRC | 05:12 | |
| *** udesale has joined #tripleo | 05:13 | |
| *** shreshtha has joined #tripleo | 05:13 | |
| *** udesale has quit IRC | 05:13 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] start at templating out the zuulv3 jobs https://review.openstack.org/512450 | 05:13 |
| *** shreshtha has quit IRC | 05:14 | |
| *** shreshtha has joined #tripleo | 05:14 | |
| *** abregman has joined #tripleo | 05:16 | |
| *** udesale has joined #tripleo | 05:17 | |
| *** shreshtha has quit IRC | 05:17 | |
| *** shreshtha has joined #tripleo | 05:19 | |
| *** shreshtha has quit IRC | 05:19 | |
| *** shreshtha has joined #tripleo | 05:20 | |
| *** janki has quit IRC | 05:23 | |
| *** janki has joined #tripleo | 05:23 | |
| *** zzzeek has quit IRC | 05:24 | |
| *** zzzeek has joined #tripleo | 05:26 | |
| *** jtomasek has quit IRC | 05:27 | |
| *** janki has quit IRC | 05:28 | |
| *** janki has joined #tripleo | 05:30 | |
| *** eck` is now known as eck`gone | 05:31 | |
| *** hanish has joined #tripleo | 05:32 | |
| *** gvrangan has quit IRC | 05:33 | |
| hanish | hi all i am building the overcloud images, but when i boot these images i am facing an error "dracut init timing out", i updated the images with latest kernel before built, any help would be much appreciated | 05:35 |
| *** pdeore__ has joined #tripleo | 05:36 | |
| *** pdeore_ has quit IRC | 05:39 | |
| *** pdeore_ has joined #tripleo | 05:41 | |
| *** pdeore__ has quit IRC | 05:43 | |
| *** florianf has joined #tripleo | 05:44 | |
| *** yolanda has joined #tripleo | 05:44 | |
| jaosorior | yolanda: hanish was seeing an issue with dracut init timing out after updating the overcloud images. Any clue what it might be? | 05:46 |
| hanish | thanks jaosorior | 05:47 |
| *** dparkes has joined #tripleo | 05:47 | |
| *** cshastri has joined #tripleo | 05:47 | |
| yolanda | jaosorior, just for the overcloud? i'm not aware of changes in the overcloud images that can cause it, do you have logs? | 05:47 |
| openstackgerrit | Merged openstack/diskimage-builder master: Change to install a package in 'proliant-tools' https://review.openstack.org/501568 | 05:48 |
| jaosorior | hanish: ^^ | 05:50 |
| hanish | yolanda: does log means image built logs | 05:50 |
| yolanda | hanish, is a problem when building the image or when booting from it? | 05:51 |
| openstackgerrit | Merged openstack/paunch master: Add option to configure uts namespace https://review.openstack.org/511234 | 05:52 |
| *** dsariel has joined #tripleo | 05:53 | |
| *** chlong has quit IRC | 05:53 | |
| hanish | yolanda: when i built the image there were no errors, but when i am booting it it gave dracut timeout problem | 05:53 |
| Tengu | ah, thanks jaosorior for the `recheck' order on the apache base profile review. Hopefully it will go through now. | 05:54 |
| jaosorior | no biggie | 05:55 |
| yolanda | hanish, can you enable dracut debug by console? rd.debug=1 i guess | 05:59 |
| yolanda | and then see the errors? | 05:59 |
| *** achadha has joined #tripleo | 05:59 | |
| *** achadha has quit IRC | 05:59 | |
| *** achadha has joined #tripleo | 06:00 | |
| *** iranzo has joined #tripleo | 06:02 | |
| *** yamahata has joined #tripleo | 06:04 | |
| janki | mandre, hey. can you have a look at https://review.openstack.org/#/c/508478/ please | 06:06 |
| *** ratailor has joined #tripleo | 06:08 | |
| *** ratailor has quit IRC | 06:08 | |
| *** ratailor has joined #tripleo | 06:08 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 06:10 |
| *** akane has joined #tripleo | 06:12 | |
| *** jprovazn has joined #tripleo | 06:14 | |
| *** ykarel has quit IRC | 06:17 | |
| *** spectr has quit IRC | 06:20 | |
| *** spectr has joined #tripleo | 06:21 | |
| *** gvrangan has joined #tripleo | 06:21 | |
| *** spectr has quit IRC | 06:22 | |
| *** spectr has joined #tripleo | 06:24 | |
| *** stendulker has joined #tripleo | 06:26 | |
| *** tvignaud has joined #tripleo | 06:30 | |
| *** abregman has quit IRC | 06:32 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Dont install python-virtualenv for py3k in deb https://review.openstack.org/513168 | 06:33 |
| *** ykarel has joined #tripleo | 06:35 | |
| *** abregman has joined #tripleo | 06:39 | |
| *** yolanda has quit IRC | 06:40 | |
| *** jfrancoa has joined #tripleo | 06:41 | |
| *** jbadiapa_ has joined #tripleo | 06:41 | |
| mandre | janki: i'm not very enthusiastic about renaming volumes, see my comment in the review | 06:42 |
| *** jbadiapa has quit IRC | 06:44 | |
| jaosorior | mandre: does the host's keystone user have the same UID as the container's keystone user? | 06:44 |
| *** jfrancoa has quit IRC | 06:45 | |
| *** Goneri has joined #tripleo | 06:46 | |
| *** jlinkes has joined #tripleo | 06:47 | |
| *** rodolof has joined #tripleo | 06:48 | |
| *** dmacpher has joined #tripleo | 06:48 | |
| janki | mandre, ack. have commented on gerrit | 06:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui stable/pike: Imported Translations from Zanata https://review.openstack.org/514533 | 06:53 |
| *** gfidente has joined #tripleo | 06:55 | |
| *** gfidente has quit IRC | 06:55 | |
| *** gfidente has joined #tripleo | 06:55 | |
| mandre | jaosorior: no, they're supposed to be different, isn't what you observed? | 06:59 |
| *** pdeore_ has quit IRC | 06:59 | |
| *** pdeore_ has joined #tripleo | 06:59 | |
| jaosorior | mandre: right. that's what I had understood. | 07:00 |
| *** jfrancoa has joined #tripleo | 07:01 | |
| *** pcaruana has joined #tripleo | 07:02 | |
| *** iranzo has quit IRC | 07:03 | |
| *** bkopilov has joined #tripleo | 07:05 | |
| *** pdeore__ has joined #tripleo | 07:06 | |
| *** ebarrera has joined #tripleo | 07:07 | |
| *** iranzo has joined #tripleo | 07:07 | |
| *** pdeore_ has quit IRC | 07:09 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 07:10 |
| jprovazn | gfidente: hi | 07:10 |
| gfidente | morning jpena|off | 07:10 |
| gfidente | auch :D | 07:10 |
| gfidente | jprovazn | 07:10 |
| *** tesseract has joined #tripleo | 07:11 | |
| jprovazn | gfidente: :) https://review.openstack.org/#/c/510108/ - I think there is a problem | 07:11 |
| jprovazn | gfidente: it looks like openstack release pkg depends on ceph-jewel, I wonder if it's easy enough to change this dependency? | 07:12 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-common master: chown fernet keys to match container's keystone user and group https://review.openstack.org/514543 | 07:12 |
| jaosorior | mandre: ^^ | 07:12 |
| *** pdeore__ has quit IRC | 07:13 | |
| *** pdeore has joined #tripleo | 07:13 | |
| mandre | jaosorior: wdyt of adding a check to see if keystone is running in a container or not? | 07:14 |
| gfidente | jprovazn ah you mean there are packages which explicitly depend on ceph = 10.0 ? | 07:15 |
| gfidente | well 10.x ? | 07:15 |
| *** dmacpher has quit IRC | 07:16 | |
| jprovazn | gfidente: I think that centos-release-openstack-pike depends on centos-release-ceph-jewel - at least based on the error I got with the patch | 07:16 |
| jprovazn | mandre: ^ hi, I wonder if you hit the jewel dependency issue with https://review.openstack.org/#/c/510108/ ? | 07:16 |
| gfidente | jprovazn that might be okay though, we'll probably want -queens to depend on jewel? | 07:17 |
| gfidente | dah on luminous I meant, sorry | 07:17 |
| *** colonwq has quit IRC | 07:17 | |
| *** colonwq has joined #tripleo | 07:18 | |
| jprovazn | gfidente: yes, I thought this would be an option, when can be this -queens available? | 07:18 |
| Tengu | grmbl… ovb timeout :'( | 07:19 |
| Tengu | ah, maybe not ovb in fact. | 07:19 |
| gfidente | jprovazn I guess we should ask on centos-devel | 07:20 |
| gfidente | jprovazn or apevac on #rdo ? | 07:21 |
| gfidente | apevec | 07:21 |
| jaosorior | mandre: there is a check already | 07:23 |
| jprovazn | gfidente: cool | 07:23 |
| jaosorior | mandre: or what do you mean | 07:23 |
| *** morazi has joined #tripleo | 07:25 | |
| mandre | jaosorior: d'oh! I missed this is in a block just for containers | 07:25 |
| *** mcornea has joined #tripleo | 07:25 | |
| mandre | jaosorior: all good | 07:25 |
| *** ccamacho has joined #tripleo | 07:25 | |
| *** yprokule has joined #tripleo | 07:26 | |
| *** chem has joined #tripleo | 07:29 | |
| *** dmacpher has joined #tripleo | 07:30 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for keystone containers to log to stdout/stderr https://review.openstack.org/508517 | 07:30 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Glance API containers to log to stdout/stderr https://review.openstack.org/510411 | 07:30 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova containers to log to stdout/stderr https://review.openstack.org/509157 | 07:30 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove log-dir option from neutron-dhcp execution https://review.openstack.org/510463 | 07:30 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Neutron containers to log to stdout/stderr https://review.openstack.org/510464 | 07:30 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr https://review.openstack.org/510537 | 07:30 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova https://review.openstack.org/510561 | 07:30 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova-libvirt container to log to stdout/stderr https://review.openstack.org/510562 | 07:30 |
| jprovazn | gfidente: it seems apevec is not online yet though | 07:31 |
| *** aufi has joined #tripleo | 07:32 | |
| *** jaosorior has quit IRC | 07:33 | |
| *** ebarrera has quit IRC | 07:36 | |
| *** ebarrera has joined #tripleo | 07:36 | |
| *** oidgar has joined #tripleo | 07:37 | |
| openstackgerrit | Radomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable all horizon plugins by default https://review.openstack.org/514421 | 07:40 |
| *** ffiore has joined #tripleo | 07:41 | |
| *** ykarel is now known as ykarel|lunch | 07:42 | |
| *** amoralej|off is now known as amoralej | 07:42 | |
| *** pdeore has quit IRC | 07:42 | |
| *** pdeore has joined #tripleo | 07:44 | |
| *** yolanda has joined #tripleo | 07:46 | |
| *** jpena|off is now known as jpena | 07:47 | |
| *** shreshtha has quit IRC | 07:47 | |
| *** spectr has quit IRC | 07:48 | |
| *** spectr has joined #tripleo | 07:48 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Set meta container-attribute-target=host attribute https://review.openstack.org/509824 | 07:50 |
| mandre | jprovazn: I'm curious where the centos-release-openstack-pike comes from? is that something you've added yourself to base_centos_yum_repo_packages_append? | 07:54 |
| akane | hi. wat is the corresponding file for roles_data.yaml in containers? | 07:55 |
| mandre | akane: we're using the same roles_data.yaml file for containers | 07:55 |
| mandre | akane: however, if you want to deploy a containerized service instead of a BM one, you need to point the heat resource to the docker version of the service | 07:56 |
| *** jaosorior has joined #tripleo | 07:57 | |
| akane | mandre: I have this hook inside rabbitmq.pp to call Veritas’ puppet module. https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/rabbitmq.pp#L173 I have modified quickstart.sh to include Veritas’ environment files in https://github.com/openstack/tripleo-heat-templates/tree/master/environments/veritas-hyperscale | 07:57 |
| jaosorior | Tengu: damn... those timeouts are brutal :/ | 07:57 |
| jprovazn | mandre: nope, it's in kolla-build, sec | 07:57 |
| akane | I need to add "OS::TripleO::Services::VRTSHyperScale" under controller role in roles_data.yaml in order to make it work on regular setup | 07:58 |
| akane | wondering which file should be changed for quickstart | 07:58 |
| jprovazn | mandre: /usr/share/kolla/docker/base/Dockerfile.j2 | 07:58 |
| Tengu | jaosorior: indeed :/ | 07:59 |
| akane | I copy /usr/share/openstack-tripleo-heat-templates/roles_data.yaml to some location and then add the additional service | 07:59 |
| *** dbecker has joined #tripleo | 07:59 | |
| akane | and specify it using '-r' option in 'overcloud deploy' command | 07:59 |
| akane | shouold I modify the original /usr/share/openstack-tripleo-heat-templates/roles_data.yaml file in case of quickstart? | 08:00 |
| *** marios has joined #tripleo | 08:03 | |
| *** achadha has quit IRC | 08:03 | |
| *** karthiks has quit IRC | 08:04 | |
| mandre | jprovazn: right, i found the stable/pike only commit in kolla, https://github.com/openstack/kolla/commit/2dbf624be3ae209c4f402f03c258e560e022b590 | 08:06 |
| *** jpich has joined #tripleo | 08:07 | |
| mandre | akane: back at your issue | 08:07 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 08:10 |
| mandre | akane: so if you're running rabbitmq in a container, then puppet will run the catalog with a selected list of tags to restrict it to only the tasks that generate configuration files | 08:10 |
| *** bogdando has joined #tripleo | 08:10 | |
| *** achadha has joined #tripleo | 08:10 | |
| *** achadha has quit IRC | 08:10 | |
| *** achadha has joined #tripleo | 08:11 | |
| *** cylopez has joined #tripleo | 08:11 | |
| *** dtantsur|afk is now known as dtantsur | 08:12 | |
| mandre | akane: by default, only these tags, https://github.com/openstack/tripleo-heat-templates/blob/master/docker/docker-puppet.py#L341 | 08:12 |
| mandre | akane: see also https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/rabbitmq.yaml#L199-L208 | 08:13 |
| *** pgadiya has joined #tripleo | 08:14 | |
| akane | mandre: right. I have the hook present in the 'include ::tripleo::profile::base::rabbitmq' puppet module | 08:15 |
| *** Goneri has quit IRC | 08:16 | |
| akane | but it requires https://github.com/openstack/tripleo-heat-templates/blob/master/environments/veritas-hyperscale/veritas-hyperscale-config.yaml to be included, which in turn sets the 'veritas_hyperscale_controller_enabled' as true in hieradata via https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/veritas-hyperscale-controller.yaml#L88 | 08:17 |
| akane | now, although I have added this envt file in quickstart's config file | 08:17 |
| mandre | akane: if the module generates configuration file, and it's using some non standard puppet resources to do so, you'll need to add the tags to https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/rabbitmq.yaml#L94-L97 with puppet_tags | 08:17 |
| akane | https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/rabbitmq.yaml#L199-L208 already calls the parent module | 08:18 |
| mandre | and if you're module requires some initialization steps, then you should add the right puppet tags in https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/rabbitmq.yaml#L203 | 08:18 |
| akane | but the if condition fails in https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/rabbitmq.pp#L172 | 08:19 |
| akane | veritas_hyperscale_controller_enabled gets set to true only if I include OS::TripleO::Services::VRTSHyperScale in roles_data.yaml in non-container setup | 08:20 |
| *** karthiks has joined #tripleo | 08:20 | |
| *** anshul has joined #tripleo | 08:20 | |
| akane | Do I need to somehow add OS::TripleO::Services::VRTSHyperScale to https://github.com/openstack/tripleo-heat-templates/blob/master/environments/docker.yaml | 08:22 |
| akane | to make it work? | 08:22 |
| *** achadha has quit IRC | 08:23 | |
| mandre | akane: you should already have an environment file that sets OS::TripleO::Services::VRTSHyperScale, right? | 08:23 |
| *** achadha has joined #tripleo | 08:23 | |
| mandre | akane: you need to include environments/veritas-hyperscale/veritas-hyperscale-config.yaml in your deployment | 08:24 |
| *** achadha has quit IRC | 08:28 | |
| akane | mandre: I have already included this envt file | 08:31 |
| *** tosky has joined #tripleo | 08:31 | |
| *** pmannidi has quit IRC | 08:31 | |
| *** lucas-afk is now known as lucasagomes | 08:32 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack-infra/tripleo-ci master: Match console and job-output logs for getthelogs https://review.openstack.org/514560 | 08:33 |
| *** assassin has quit IRC | 08:33 | |
| akane | Using command: export virsh_host=`hostname -f` ; bash tripleo-quickstart/quickstart.sh -v -n --tags all --config containers_minimal.yml -T all --release "master" --extra-vars test_ping=False --extra-vars run_tempest=False $virsh_host | 08:33 |
| akane | and containers_minimal.yml file looks like http://paste.openstack.org/show/624438/ | 08:34 |
| akane | but yet the hook isn't getting executed | 08:35 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in access.yaml https://review.openstack.org/513694 | 08:35 |
| *** Pranav has joined #tripleo | 08:35 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in package_update.yaml https://review.openstack.org/513690 | 08:35 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in baremetal.yaml https://review.openstack.org/513693 | 08:35 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in plan_management.yaml https://review.openstack.org/513689 | 08:35 |
| akane | veritas_hyperscale_controller_enabled is not set to true in hieradata on the overcloud controller node | 08:35 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in deployment.yaml https://review.openstack.org/513691 | 08:35 |
| mandre | akane: try 'sudo grep -R veritas_hyperscale_controller_enabled /etc/puppet/hieradata' on your controller to see if it's enabled or not | 08:37 |
| *** derekh has joined #tripleo | 08:37 | |
| mandre | akane: containers are normally no different from BM services when it comes to roles | 08:38 |
| *** masco has quit IRC | 08:38 | |
| akane | mandre: nope. It's not set | 08:38 |
| *** ykarel|lunch is now known as ykarel | 08:38 | |
| akane | it gets set only when OS::TripleO::Services::VRTSHyperScale is included | 08:38 |
| akane | OS::TripleO::Services::RabbitMQ is included in https://github.com/openstack/tripleo-heat-templates/blob/master/environments/docker.yaml#L33 | 08:39 |
| mandre | akane: right, but you said you include it in containerized deployment | 08:39 |
| akane | by same logic | 08:39 |
| akane | windering how to add OS::TripleO::Services::VRTSHyperScale to it | 08:39 |
| akane | or rather | 08:39 |
| akane | whether adding it there makes sense and will it work | 08:40 |
| mandre | akane: I do not follow... OS::TripleO::Services::VRTSHyperScale is added via environments/veritas-hyperscale/veritas-hyperscale-config.yaml, you do not need to add it to docker.yaml unless it is a containerized service | 08:43 |
| *** jtomasek has joined #tripleo | 08:44 | |
| Tengu | jaosorior: duh… I'll correct my patch for the apache listener. | 08:47 |
| openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Create dedicated "apache" base profile https://review.openstack.org/513274 | 08:48 |
| Tengu | jaosorior: -^ | 08:49 |
| Tengu | good catch | 08:49 |
| jaosorior | Tengu: commented. | 08:49 |
| Tengu | jaosorior: should be better with the default to false. | 08:49 |
| *** pdeore has quit IRC | 08:49 | |
| Tengu | darn -.- | 08:50 |
| jaosorior | lol, sorry | 08:50 |
| *** masco has joined #tripleo | 08:50 | |
| *** jtomasek has quit IRC | 08:50 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Create dedicated "apache" base profile https://review.openstack.org/513274 | 08:50 |
| *** assassin has joined #tripleo | 08:50 | |
| Tengu | np. I'm a bit annoyed by other things at work… | 08:50 |
| akane | on non-container setup, veritas_hyperscale_controller_enabled gets set to true only if I add OS::TripleO::Services::VRTSHyperScale in roles_data.yaml | 08:51 |
| akane | mandre: I am just mapping it logically to the situation | 08:51 |
| *** jtomasek has joined #tripleo | 08:51 | |
| Tengu | jaosorior: should be far, far better now :). Let's hope we won't get any timeout now :) | 08:51 |
| akane | i don't know details about container systems | 08:51 |
| *** salmankhan has joined #tripleo | 08:52 | |
| *** akane is now known as akane_afk | 08:52 | |
| *** suuuper has joined #tripleo | 08:53 | |
| jaosorior | Tengu: yeah. I'm personally struggling with timeouts in my commits :/ | 08:53 |
| Tengu | ^^ | 08:53 |
| Tengu | I'm struggling doing some really old stuff in there in //, and, well, it's far less fun than openstack :]. | 08:54 |
| openstackgerrit | Noam Angel proposed openstack/diskimage-builder master: cloud-init element systemctl support https://review.openstack.org/512489 | 08:55 |
| *** hewbrocca_afk is now known as hewbrocca | 08:57 | |
| *** sri_ has quit IRC | 08:57 | |
| mandre | akane_afk: depends if you want to run the hyperscale service in a container or not. The architecture allows to run some services in containers and other on BM, this is what you'll do by including environments/veritas-hyperscale/veritas-hyperscale-config.yaml together with environments/docker.yaml | 08:57 |
| *** Goneri has joined #tripleo | 08:58 | |
| *** assassin has quit IRC | 08:58 | |
| *** jaganathan has joined #tripleo | 09:01 | |
| *** daidv has quit IRC | 09:03 | |
| *** daidv has joined #tripleo | 09:03 | |
| *** daidv_ has joined #tripleo | 09:04 | |
| *** daidv_ has quit IRC | 09:04 | |
| *** daidv has quit IRC | 09:04 | |
| *** karthiks has quit IRC | 09:04 | |
| *** daidv has joined #tripleo | 09:04 | |
| *** daidv has quit IRC | 09:05 | |
| *** daidv has joined #tripleo | 09:06 | |
| *** milan has joined #tripleo | 09:07 | |
| *** assassin has joined #tripleo | 09:08 | |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 09:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 09:10 |
| *** gkadam_ has quit IRC | 09:11 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-docs master: Change mistral commands to use the openstack CLI instead https://review.openstack.org/514575 | 09:11 |
| jaosorior | d0ugal: could you check this out https://review.openstack.org/#/c/514575/ ? | 09:12 |
| *** gkadam has joined #tripleo | 09:13 | |
| openstackgerrit | Martin André proposed openstack/puppet-tripleo master: Make docker network configurable https://review.openstack.org/514576 | 09:13 |
| lvdombrkr | hello folks, i have 3 nodes controller HA setup, now i want stop some service on controller ( for example glance) and start it after some time.. how can i do that on all cluster? | 09:14 |
| *** pdeore has joined #tripleo | 09:16 | |
| lvdombrkr | so how can i stop service on all cluster? | 09:19 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-common master: chown fernet keys to match container's keystone user and group https://review.openstack.org/514543 | 09:19 |
| *** karthiks has joined #tripleo | 09:20 | |
| *** salmankhan has quit IRC | 09:20 | |
| *** salmankhan has joined #tripleo | 09:21 | |
| jaosorior | mandre: can you revisit this? https://review.openstack.org/#/c/514543/ Did a change in it. | 09:21 |
| *** akane_afk is now known as akane | 09:21 | |
| jaganathan | d0ugal, hi, regarding https://review.openstack.org/#/c/511411/, this patch is needed for stable pike, ci is not passing, is that fine to merge? | 09:22 |
| *** pgadiya has quit IRC | 09:23 | |
| *** pgadiya has joined #tripleo | 09:24 | |
| *** milan is now known as milano | 09:25 | |
| akane | mandre: I see. I have different hooks for rabbitmq, keystone and mysql. The envt file https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/veritas-hyperscale-controller.yaml sets the parameters for all these hooks and each hook checks for 'veritas_hyperscale_controller_enabled' hiera flag. | 09:25 |
| akane | how do i create similar setting in docker? | 09:26 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Add option to disable running mistral-api via wsgi https://review.openstack.org/513402 | 09:26 |
| akane | i want to make config changes on different containers- rabbitmq, keystone and mysql | 09:26 |
| akane | I am also working on containerizing the core veritas services | 09:26 |
| akane | these services need the things like rabbitmq user, keystone endpoints, mysql database, etc | 09:27 |
| akane | all the hooks take care of these settings | 09:27 |
| *** zzzeek has quit IRC | 09:30 | |
| lvdombrkr | folks any ideas? | 09:30 |
| *** athomas has quit IRC | 09:32 | |
| *** zzzeek has joined #tripleo | 09:32 | |
| *** ffiore has quit IRC | 09:34 | |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Do not return the config download path but only print it https://review.openstack.org/514580 | 09:37 |
| *** tosky has quit IRC | 09:38 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Configure docker0 bridge address https://review.openstack.org/514581 | 09:38 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Configure docker0 bridge address https://review.openstack.org/514581 | 09:39 |
| *** ffiore has joined #tripleo | 09:44 | |
| lvdombrkr | hello folks, i have 3 nodes controller HA setup, now i want stop some service on controller ( for example glance) and start it after some time.. how can i do that on all cluster? | 09:46 |
| d0ugal | jaosorior: looking | 09:50 |
| d0ugal | jaganathan: looking | 09:50 |
| d0ugal | jaganathan: I think it is safe, but I am a little confused with the multiple CI reports ATM | 09:52 |
| d0ugal | jaosorior: LGTM, thanks! | 09:52 |
| lvdombrkr | folks how to disable service in all controller cluster? | 09:55 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common stable/pike: Use ANSIBLE_HOST_KEY_CHECKING var instead of ssh-common-args https://review.openstack.org/514584 | 09:56 |
| *** dsariel has quit IRC | 09:57 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test containers update https://review.openstack.org/511175 | 10:00 |
| jaganathan | d0ugal, ok, zuul ovb is passed and jenkins ovb is failing | 10:01 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Update CephPools format in the docker templates to fit ceph-ansible https://review.openstack.org/508859 | 10:02 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Support for Satellite Capsule in rhel-registration https://review.openstack.org/513239 | 10:03 |
| *** dsariel has joined #tripleo | 10:03 | |
| *** yamahata has quit IRC | 10:05 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-heat-templates master: Start using nic-configs from THT repo instead of tripleo-ci https://review.openstack.org/476708 | 10:08 |
| openstackgerrit | Radomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable all horizon plugins by default https://review.openstack.org/514421 | 10:08 |
| *** spectr has quit IRC | 10:10 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 10:10 |
| jaganathan | d0ugal, thanks, please look into this patch also https://review.openstack.org/#/c/511410/ for stable/pike | 10:10 |
| *** spectr has joined #tripleo | 10:10 | |
| d0ugal | jaganathan: sure | 10:12 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Use playbook from tripleo-quickstart-extras for OVB https://review.openstack.org/513508 | 10:12 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Make provision/remote role safe to include statically https://review.openstack.org/513765 | 10:14 |
| *** daidv has quit IRC | 10:14 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Disable SwiftDispersion when using docker https://review.openstack.org/513244 | 10:16 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Adding LBaaSv2 testing https://review.openstack.org/513005 | 10:19 |
| lvdombrkr | Tengu:im trying pinging everyone but without success ( maybe you can help ... i have 3 controllers HA setup, and i want stop glance or cinder service on all cluster...how can i do that? | 10:21 |
| *** mburned_out is now known as mburned | 10:23 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Allow pre-installed DLRN https://review.openstack.org/499117 | 10:24 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Set empty default for network_isolation_args https://review.openstack.org/497543 | 10:26 |
| *** yprokule has quit IRC | 10:35 | |
| *** salmankhan has quit IRC | 10:35 | |
| *** brault has joined #tripleo | 10:35 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Make UI accessable by default on OVB https://review.openstack.org/507969 | 10:37 |
| *** shreshtha has joined #tripleo | 10:38 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: use a non-default virthost_user for the basic test https://review.openstack.org/441560 | 10:40 |
| jaosorior | jistr|mtgs, mandre: could you check this commit out https://review.openstack.org/#/c/509157/ ? | 10:40 |
| *** jprovazn has quit IRC | 10:41 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-heat-templates master: Start using ipv6 nic-configs from THT repo instead of tripleo-ci https://review.openstack.org/512554 | 10:42 |
| *** akrivoka has quit IRC | 10:42 | |
| mandre | jaosorior: I'll make a pass over your logging patches this afternoon, if not keep harassing me | 10:42 |
| *** akrivoka has joined #tripleo | 10:42 | |
| openstackgerrit | Or Idgar proposed openstack/tripleo-common master: WIP Add Octavia post deployment steps to tripleo workflows https://review.openstack.org/487450 | 10:43 |
| *** salmankhan has joined #tripleo | 10:44 | |
| *** pgadiya has quit IRC | 10:46 | |
| *** fzdarsky_ has quit IRC | 10:47 | |
| jaosorior | mandre: lol, sorry for the constant poking | 10:48 |
| *** pgadiya has joined #tripleo | 10:48 | |
| openstackgerrit | Or Idgar proposed openstack/tripleo-common master: WIP Add Octavia post deployment steps to tripleo workflows https://review.openstack.org/487450 | 10:49 |
| *** bkopilov has quit IRC | 10:50 | |
| *** salmankhan has quit IRC | 10:51 | |
| *** psachin has quit IRC | 10:51 | |
| *** udesale has quit IRC | 10:53 | |
| *** dtantsur is now known as dtantsur|brb | 10:53 | |
| *** salmankhan has joined #tripleo | 10:53 | |
| *** psachin has joined #tripleo | 10:54 | |
| *** yolanda has quit IRC | 10:55 | |
| *** adarazs is now known as adarazs_lunch | 10:56 | |
| *** mcornea has quit IRC | 10:58 | |
| openstackgerrit | Luke Hinds proposed openstack/puppet-tripleo master: [WIP] Implements AIDE Intrusion Detection System https://review.openstack.org/483025 | 10:58 |
| *** gvrangan has quit IRC | 11:00 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: switch to RDO Queens deps repo https://review.openstack.org/508870 | 11:00 |
| *** jprovazn has joined #tripleo | 11:01 | |
| *** jprovazn has quit IRC | 11:01 | |
| *** jprovazn has joined #tripleo | 11:01 | |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates master: [WIP] Implements AIDE Intrusion Detection System https://review.openstack.org/483028 | 11:01 |
| *** oidgar has quit IRC | 11:04 | |
| *** fzdarsky has joined #tripleo | 11:07 | |
| *** newmember has quit IRC | 11:10 | |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 11:10 |
| *** atoth has joined #tripleo | 11:12 | |
| lvdombrkr | folks how to disable service (glance/cinder etc) in all controller cluster? | 11:12 |
| *** lucasagomes is now known as lucas-hungry | 11:14 | |
| *** stendulker_ has joined #tripleo | 11:14 | |
| *** stendulker has quit IRC | 11:18 | |
| *** oidgar has joined #tripleo | 11:19 | |
| *** stendulker_ has quit IRC | 11:20 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: refactor cellv2 host discovery logic to avoid races https://review.openstack.org/513867 | 11:20 |
| *** abishop has quit IRC | 11:23 | |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient stable/pike: Do not return the config download path but only print it https://review.openstack.org/514609 | 11:24 |
| *** dbecker has quit IRC | 11:30 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-heat-templates master: Start using ipv6 nic-configs from THT repo instead of tripleo-ci https://review.openstack.org/512554 | 11:31 |
| *** fragatina has quit IRC | 11:35 | |
| *** fragatina has joined #tripleo | 11:36 | |
| *** milano is now known as milan0 | 11:40 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add a lookup plugin for nova servers https://review.openstack.org/514307 | 11:42 |
| openstackgerrit | Radomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable all horizon plugins by default https://review.openstack.org/514421 | 11:43 |
| *** pgadiya has quit IRC | 11:43 | |
| *** udesale has joined #tripleo | 11:46 | |
| *** oidgar has quit IRC | 11:49 | |
| *** jpena is now known as jpena|lunch | 11:50 | |
| *** mrch has joined #tripleo | 11:53 | |
| *** abishop has joined #tripleo | 11:55 | |
| sshnaidm | is tripleo-incubator repo not active anymore? | 11:55 |
| *** ansmith has quit IRC | 11:56 | |
| *** pkovar has joined #tripleo | 11:56 | |
| openstackgerrit | Lee Yarwood proposed openstack/tripleo-heat-templates master: WIP - Introduce fast-forward upgrade tasks and playbooks https://review.openstack.org/499221 | 11:57 |
| openstackgerrit | Lee Yarwood proposed openstack/tripleo-heat-templates master: DNM ffu: Introduce keystone fast-forward upgrade tasks https://review.openstack.org/514621 | 11:57 |
| *** adarazs_lunch is now known as adarazs | 11:58 | |
| *** milan0 is now known as milan | 11:58 | |
| *** ratailor has quit IRC | 11:59 | |
| *** amoralej is now known as amoralej|lunch | 12:01 | |
| *** oidgar has joined #tripleo | 12:02 | |
| *** sri_ has joined #tripleo | 12:02 | |
| *** fultonj has quit IRC | 12:04 | |
| *** trown|outtypewww has quit IRC | 12:04 | |
| *** trown has joined #tripleo | 12:05 | |
| *** fultonj has joined #tripleo | 12:05 | |
| *** jlabarre has joined #tripleo | 12:05 | |
| openstackgerrit | Keith Schincke proposed openstack/tripleo-heat-templates master: Set file ACLs for Ceph keyrings for non-containerized deployment https://review.openstack.org/509020 | 12:06 |
| *** trown|brb has joined #tripleo | 12:07 | |
| *** trown|brb has quit IRC | 12:07 | |
| trown | sshnaidm: ya that has not been used in a long time | 12:08 |
| sshnaidm | trown, ack | 12:08 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 12:10 |
| *** raildo has joined #tripleo | 12:11 | |
| *** jaganathan has quit IRC | 12:12 | |
| *** rbrady has quit IRC | 12:13 | |
| *** rbrady has joined #tripleo | 12:13 | |
| lvdombrkr | folks how to disable services (glance/cinder etc) in all controller cluster? | 12:13 |
| *** liverpooler has joined #tripleo | 12:13 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: [WIP] Add lookup plugin for ironic nodes https://review.openstack.org/514308 | 12:15 |
| *** lucas-hungry is now known as lucasagomes | 12:15 | |
| *** dprince has joined #tripleo | 12:16 | |
| lvdombrkr | one by one on each controller? | 12:18 |
| *** ffiore has quit IRC | 12:18 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 12:20 |
| *** bfournie has quit IRC | 12:22 | |
| *** bfournie has joined #tripleo | 12:22 | |
| *** fzdarsky has quit IRC | 12:22 | |
| *** pchavva has joined #tripleo | 12:24 | |
| *** ffiore has joined #tripleo | 12:24 | |
| *** tvignaud has quit IRC | 12:25 | |
| *** bkopilov has joined #tripleo | 12:26 | |
| *** bfournie has quit IRC | 12:26 | |
| *** ffiore has quit IRC | 12:30 | |
| mandre | jaosorior: do my comments make sense on https://review.openstack.org/#/c/508517/? there is no need to stop the gate job, we can fix in a subsequent patch if needed | 12:30 |
| *** rlandy has joined #tripleo | 12:30 | |
| jaosorior | mandre: I just answered. Thanks for checking it out. | 12:32 |
| *** milan is now known as milan_ | 12:33 | |
| *** mcornea has joined #tripleo | 12:33 | |
| *** tvignaud has joined #tripleo | 12:34 | |
| *** dbecker has joined #tripleo | 12:34 | |
| *** tvignaud has quit IRC | 12:34 | |
| *** tvignaud has joined #tripleo | 12:35 | |
| *** milan_ is now known as milan | 12:35 | |
| *** eck`gone is now known as eck` | 12:36 | |
| *** yprokule has joined #tripleo | 12:36 | |
| mandre | jaosorior: so why logging to stderr if that ends up in a file anyway? why not log to error_log directly in that case? | 12:37 |
| jaosorior | mandre: that's actually a pretty good questino | 12:37 |
| jaosorior | *question | 12:37 |
| *** leitan has joined #tripleo | 12:37 | |
| *** dtantsur|brb is now known as dtantsur | 12:38 | |
| *** fzdarsky has joined #tripleo | 12:38 | |
| jaosorior | mandre: gonna spawn another deployment and start testing that out to submit a subsequent patch. What mattered the most to me was to get the base going, and unblock the rest of the chain. | 12:39 |
| *** Pranav_ has joined #tripleo | 12:40 | |
| mandre | jaosorior: right, I was just genuinely curious, also maybe we could remove those /bin/true for the healthchecks, unless you have a use for them | 12:41 |
| *** suuuper has quit IRC | 12:41 | |
| jaosorior | mandre: I don't. I actually didn't know they weren't needed anymore. | 12:41 |
| *** suuuper has joined #tripleo | 12:41 | |
| jaosorior | mandre: I'm gonna do a new deployment in a bit. Wanna see how it would look like? | 12:41 |
| Pranav_ | Hello good folks. Facing issues with container based deployment for OSP12 | 12:42 |
| Pranav_ | Errors at http://paste.openstack.org/show/624462/ | 12:42 |
| mandre | jaosorior: sure! | 12:42 |
| *** milan has quit IRC | 12:42 | |
| Pranav_ | Failed to pull image: 192.168.24.1:8787/master/centos-binary-cron:tripleo-ci-testing | 12:42 |
| jaosorior | mandre: ok, I'll let you know when it's ready (I'm only gonna deploy a minimal environment to show how keystone would look like) | 12:43 |
| mandre | Pranav_: what documentation have you followed to deploy your overcloud? it looks to me you're missing a step to upload images to your local registry | 12:44 |
| *** dsariel has quit IRC | 12:44 | |
| Pranav_ | mandre: https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/overcloud.html | 12:45 |
| *** pkovar has quit IRC | 12:45 | |
| Pranav_ | mandre: Followed the steps ditto. But I am suspecting that perhaps the namespace or tag is wrong. Not sure which | 12:46 |
| Pranav_ | The registry has the images though @ '/var/lib/registry/docker/registry/v2/repositories/master/centos-binary-ceilometer-central/' | 12:47 |
| *** agurenko has joined #tripleo | 12:48 | |
| *** jmelvin has joined #tripleo | 12:50 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Rename options to the prepare command for clarity https://review.openstack.org/511514 | 12:50 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Add --environment-directory to the prepare command https://review.openstack.org/511521 | 12:50 |
| mandre | Pranav_: can you share your vercloud_containers.yaml and docker_registry.yaml files? | 12:50 |
| *** ffiore has joined #tripleo | 12:50 | |
| *** pkovar has joined #tripleo | 12:52 | |
| *** tvignaud has quit IRC | 12:52 | |
| *** tvignaud_ has joined #tripleo | 12:52 | |
| *** pradk has joined #tripleo | 12:52 | |
| Pranav_ | mandre: Both files output @ http://paste.openstack.org/show/624465/ | 12:53 |
| *** tvignaud_ is now known as tvignaud | 12:54 | |
| Pranav_ | One thing i noticed was that the tag is different when doing image prepare vs image upload | 12:54 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Support for Satellite Capsule in rhel-registration https://review.openstack.org/513240 | 12:55 |
| *** yolanda has joined #tripleo | 12:56 | |
| *** dhill_ has quit IRC | 12:58 | |
| mandre | Pranav_: yep sounds like the tags are wrong... can you do just one more quick test? log in one of your overcloud nodes and do a 'sudo docker pull 192.168.24.1:8787/master/centos-binary-aodh-api:tripleo-ci-testing" | 13:01 |
| jaosorior | mandre: done | 13:01 |
| *** bobh has joined #tripleo | 13:01 | |
| *** ansmith has joined #tripleo | 13:02 | |
| openstackgerrit | Lee Yarwood proposed openstack/tripleo-heat-templates master: DNM ffu: Introduce keystone fast-forward upgrade tasks https://review.openstack.org/514621 | 13:02 |
| openstackgerrit | Lee Yarwood proposed openstack/tripleo-heat-templates master: DNM ffu: tripleo-repos wokraround https://review.openstack.org/514641 | 13:02 |
| *** dparkes has quit IRC | 13:02 | |
| *** fragatina has quit IRC | 13:03 | |
| *** fragatina has joined #tripleo | 13:03 | |
| *** amoralej|lunch is now known as amoralej|mtg | 13:03 | |
| *** dparkes has joined #tripleo | 13:04 | |
| *** iranzo has quit IRC | 13:04 | |
| Pranav_ | mandre: ack. checking | 13:04 |
| *** iranzo has joined #tripleo | 13:06 | |
| *** iranzo has quit IRC | 13:06 | |
| *** iranzo has joined #tripleo | 13:06 | |
| Pranav_ | mandre: you are right! from the overcloud controller the docker pull failed | 13:06 |
| *** tzumainn has joined #tripleo | 13:06 | |
| *** hanish has quit IRC | 13:07 | |
| Pranav_ | mandre: The network seems to be the suspect? Should the IP 192.168.24.1 be pingable from overcloud node? | 13:09 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 13:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 13:10 |
| *** jcoufal has joined #tripleo | 13:11 | |
| *** athomas has joined #tripleo | 13:12 | |
| *** cdearborn_ has joined #tripleo | 13:12 | |
| *** cdearborn__ has joined #tripleo | 13:13 | |
| *** bfournie has joined #tripleo | 13:14 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Add steps needed when using OVB with a testenv broker https://review.openstack.org/512798 | 13:15 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Make roles safe to include statically https://review.openstack.org/513871 | 13:15 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Add ability to build images to baremetal playbook https://review.openstack.org/513503 | 13:15 |
| Pranav_ | mandre: output @http://paste.openstack.org/show/624469/ | 13:15 |
| *** rodolof has quit IRC | 13:16 | |
| *** rodolof has joined #tripleo | 13:16 | |
| *** cdearborn_ has quit IRC | 13:16 | |
| *** ecerquei has joined #tripleo | 13:17 | |
| mandre | Pranav_: cool, so we've confirmed that we got the wrong tags in your docker_registry.yaml file. | 13:17 |
| *** pdeore_ has joined #tripleo | 13:18 | |
| Pranav_ | So is the last image prepare step the culprit here? | 13:18 |
| mandre | Pranav_: you can s/latest/tripleo-ci-testing/g in that file and restart the deployment, I'll update the doc | 13:18 |
| Pranav_ | mandre: Sure. I will give it a try. | 13:19 |
| *** lblanchard has joined #tripleo | 13:19 | |
| *** lblanchard has quit IRC | 13:19 | |
| *** pdeore has quit IRC | 13:20 | |
| *** skramaja has quit IRC | 13:21 | |
| *** ykarel is now known as ykarel|away | 13:25 | |
| *** _milan_ has joined #tripleo | 13:25 | |
| *** _milan_ has quit IRC | 13:25 | |
| *** milan has joined #tripleo | 13:26 | |
| *** pdeore_ has quit IRC | 13:28 | |
| *** milan has left #tripleo | 13:29 | |
| *** ykarel|away has quit IRC | 13:29 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Use rdoproject-based settings for containers https://review.openstack.org/514668 | 13:29 |
| weshay|ruck | EmilienM, fyi.. the latest master run just missed the latest rpm for puppet-cinder, new set of jobs are queued up | 13:30 |
| EmilienM | weshay|ruck: ok | 13:30 |
| bandini | q/go 32 | 13:31 |
| *** jpena|lunch is now known as jpena | 13:33 | |
| jtomasek | jrist, honza, florianf, akrivoka, jpich: feel free to update the ui/cli squad status etherpad https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status | 13:33 |
| jrist | yes sir | 13:33 |
| *** pdeore has joined #tripleo | 13:36 | |
| *** toure_biab is now known as toure | 13:36 | |
| lvdombrkr | folks how to disable services (glance/cinder etc) in all controller cluster? | 13:38 |
| *** pdeore has quit IRC | 13:41 | |
| *** pdeore has joined #tripleo | 13:42 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs10: deploy steps with ansible https://review.openstack.org/508307 | 13:43 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs10: deploy steps with ansible https://review.openstack.org/508307 | 13:43 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: refactor cellv2 host discovery logic to avoid races https://review.openstack.org/513867 | 13:44 |
| *** cdearborn__ is now known as cdearborn | 13:45 | |
| EmilienM | weekly meeting in 15 min https://etherpad.openstack.org/p/tripleo-meeting-items | 13:46 |
| openstackgerrit | Bogdan Dobrelya proposed openstack-infra/tripleo-ci master: Match job-output as console logs for getthelogs https://review.openstack.org/514560 | 13:47 |
| *** pdeore has quit IRC | 13:47 | |
| *** akane has quit IRC | 13:48 | |
| Pranav_ | mandre: that did not work either. Same issue. | 13:49 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add a lookup plugin for nova servers https://review.openstack.org/514307 | 13:50 |
| fultonj | gfidente: are you joining the tripleo meeting this week or do you have the UA call? | 13:53 |
| trozet | Anyone can help me with this error in nova scheduler when deploying? No valid hosts found.... Starting with 0 host(s) get_filtered_objects /usr/lib/python2.7/site-packages/nova/filters.py | 13:53 |
| trozet | it never gets to the filters because it thinks there are 0 nodes, even though i see 5 in nova hypervisor-list (im using baremetal deployment, but skipping introspection) | 13:53 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add lookup plugin for ironic nodes https://review.openstack.org/514308 | 13:54 |
| mandre | Pranav_: can you paste the heat environment file you've used for your second test? | 13:55 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Update default cell_v2 cell when it already exists https://review.openstack.org/506595 | 13:58 |
| *** yamahata has joined #tripleo | 13:58 | |
| *** bogdando has quit IRC | 13:59 | |
| florianf | akrivoka, gchamoul: can you check if I missed something for this week's status? https://etherpad.openstack.org/p/tripleo-validations-squad-status | 14:00 |
| *** pkovar has quit IRC | 14:00 | |
| gfidente | fultonj hey meeting! | 14:01 |
| fultonj | yay | 14:01 |
| *** masco has quit IRC | 14:01 | |
| EmilienM | hello | 14:02 |
| EmilienM | yeah sorry | 14:02 |
| bfournie | trozet: you're probably seen this… https://docs.openstack.org/ironic/latest/admin/troubleshooting.html. Can you paste the output of "openstack baremetal node show" for all the nodes? | 14:02 |
| EmilienM | #startmeeting tripleo | 14:02 |
| openstack | Meeting started Tue Oct 24 14:02:08 2017 UTC and is due to finish in 60 minutes. The chair is EmilienM. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:02 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:02 |
| *** openstack changes topic to " (Meeting topic: tripleo)" | 14:02 | |
| openstack | The meeting name has been set to 'tripleo' | 14:02 |
| EmilienM | * Review past action items | 14:02 |
| EmilienM | * One off agenda items | 14:02 |
| EmilienM | * Squad status | 14:02 |
| EmilienM | * Bugs & Blueprints | 14:02 |
| EmilienM | * Projects releases or stable backports | 14:02 |
| EmilienM | * Specs | 14:02 |
| EmilienM | * open discussion | 14:02 |
| EmilienM | Anyone can use the #link, #action and #info commands, not just the moderatorǃ | 14:02 |
| EmilienM | Hi everyone! who is around today? | 14:02 |
| gchamoul | florianf: done | 14:02 |
| jtomasek | o/ | 14:02 |
| beagles | o/ | 14:02 |
| fultonj | o/ | 14:02 |
| cdearborn | o/ | 14:02 |
| dprince | hi | 14:02 |
| dpeacock | o/ | 14:02 |
| owalsh | o/ | 14:02 |
| gchamoul | o/ | 14:02 |
| jpich | o/ | 14:03 |
| jkilpatr | o/ | 14:03 |
| pradk | o/ | 14:03 |
| EmilienM | #topic review past action items | 14:03 |
| *** openstack changes topic to "review past action items (Meeting topic: tripleo)" | 14:03 | |
| slagle | hi | 14:03 |
| EmilienM | marios and matbu to provide an upgrade workflow status in next week | 14:03 |
| EmilienM | document deprecate baremetal in queens and remove full support in rocky | 14:04 |
| florianf | o/ | 14:04 |
| EmilienM | merge https://review.openstack.org/#/c/512569 in Queens | 14:04 |
| Pranav_ | mandre: http://paste.openstack.org/show/624482/ | 14:04 |
| mandre | o/ | 14:04 |
| EmilienM | https://review.openstack.org/#/c/512569 isn't merged, I just checked | 14:04 |
| Pranav_ | for now I am trying to deploy with pushing to local registry | 14:04 |
| EmilienM | document that upgrades on baremetal aren't tested in Pike and Queens | 14:04 |
| fultonj | w.r.t document deprecate baremetal in queens, https://review.openstack.org/#/c/512782/ | 14:04 |
| EmilienM | and team to review stable policy proposal https://review.openstack.org/511968 : still in progress | 14:04 |
| Pranav_ | without* pushing to local registry | 14:04 |
| EmilienM | fultonj: oh cool, thanks for the update | 14:04 |
| EmilienM | any other updates regarding the actions? | 14:05 |
| EmilienM | i'll postpone otherwise | 14:05 |
| jrist | /o | 14:05 |
| *** dparkes has quit IRC | 14:06 | |
| EmilienM | #action (postponed) marios and matbu to provide an upgrade workflow status | 14:06 |
| openstackgerrit | Dan Prince proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 14:06 |
| EmilienM | #action (postponed) merge https://review.openstack.org/#/c/512569 (gfidente) | 14:06 |
| EmilienM | #action (postponed) document that upgrades on baremetal aren't tested in Pike and Queens | 14:06 |
| fultonj | postponed ? | 14:07 |
| EmilienM | postpone? | 14:07 |
| fultonj | patch merged | 14:07 |
| fultonj | i.e. doc change merged | 14:07 |
| EmilienM | fultonj: the upgrade? | 14:07 |
| fultonj | not the upgrade | 14:07 |
| EmilienM | ah ok good | 14:07 |
| *** mdnadeem has quit IRC | 14:07 | |
| fultonj | sorry my bad | 14:07 |
| EmilienM | anything else? | 14:07 |
| EmilienM | fultonj: you made me google translate postponed | 14:08 |
| EmilienM | #topic one off agenda items | 14:08 |
| *** openstack changes topic to "one off agenda items (Meeting topic: tripleo)" | 14:08 | |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-meeting-items | 14:08 |
| fultonj | :) | 14:08 |
| EmilienM | someone wrote something about mistral, without name | 14:08 |
| EmilienM | who is blue? | 14:08 |
| fultonj | o/ | 14:08 |
| *** dparkes has joined #tripleo | 14:08 | |
| *** pkovar has joined #tripleo | 14:08 | |
| fultonj | we used to have mistral logs | 14:08 |
| fultonj | http://logs.openstack.org/69/512569/3/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container-upgrades/f270dd1/logs/subnode-2/var/log/ | 14:09 |
| gfidente | for the undercloud | 14:09 |
| EmilienM | it's the overcloud ^ | 14:09 |
| fultonj | never mind | 14:09 |
| fultonj | sorry | 14:09 |
| EmilienM | http://logs.openstack.org/69/512569/3/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container-upgrades/f270dd1/logs/undercloud/ | 14:09 |
| EmilienM | that's the right link | 14:09 |
| EmilienM | ok anything else? | 14:10 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 14:10 |
| EmilienM | #topic Squad status | 14:10 |
| *** openstack changes topic to "Squad status (Meeting topic: tripleo)" | 14:10 | |
| EmilienM | ci | 14:10 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-ci-squad-scrum | 14:10 |
| EmilienM | upgrade | 14:11 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status | 14:11 |
| EmilienM | containers | 14:11 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-containers-squad-status | 14:11 |
| EmilienM | integration | 14:11 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-integration-squad-status | 14:11 |
| EmilienM | ui/cli | 14:11 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status | 14:11 |
| EmilienM | validations | 14:11 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-validations-squad-status | 14:11 |
| EmilienM | networking | 14:11 |
| Tengu | -.- coool. so now gate is happy, but I get a nice "cannot merge" -.- | 14:11 |
| EmilienM | workflows | 14:11 |
| gfidente | EmilienM problem with logs is that zuul jobs don't seem to be collecting the entire /var/log anymore | 14:11 |
| gfidente | from the undercloud | 14:12 |
| gfidente | so we don't have mistral logs | 14:12 |
| EmilienM | gfidente: it's not zuul | 14:12 |
| EmilienM | it's the oooq config | 14:12 |
| EmilienM | we select which logs we want to collect | 14:12 |
| gfidente | oh but the legacy jobs seem to have those thoug? | 14:12 |
| EmilienM | sshnaidm / weshay|ruck was working on a patch | 14:12 |
| gfidente | ah | 14:12 |
| EmilienM | gfidente: everything runs legacy now | 14:12 |
| EmilienM | all tripleo jobs are "legacy" | 14:12 |
| EmilienM | gfidente: show us a link without logs? | 14:13 |
| sshnaidm | gfidente, I think we still collect all from /var/log | 14:13 |
| sshnaidm | gfidente, but we don't collect from /tmp anymore, there were some mistral related files | 14:13 |
| EmilienM | anything special to mention about the squad reports? | 14:14 |
| EmilienM | I forgot some links | 14:14 |
| gfidente | like this guy http://logs.openstack.org/75/508975/13/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/728f094/logs/undercloud/var/log/ | 14:14 |
| EmilienM | #link https://etherpad.openstack.org/p/tripleo-networking-squad-status | 14:14 |
| EmilienM | the workflows squad doesn't have an etherpad afik | 14:15 |
| gfidente | anyway maybe I can ping sshnaidm later in the chan, thanks for helping | 14:15 |
| *** shardy has joined #tripleo | 14:15 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-heat-templates stable/pike: DNM, TESTING ONLY https://review.openstack.org/514465 | 14:15 |
| EmilienM | gfidente: see https://review.openstack.org/#/c/508975/ | 14:15 |
| EmilienM | gfidente: undercloud wasn't deployed. | 14:15 |
| EmilienM | it's the iptables error from this weekend maybe | 14:15 |
| EmilienM | so yeah, no mistral logs, since mistral isn't even deployed | 14:16 |
| EmilienM | ok moving on | 14:16 |
| EmilienM | #topic bugs & blueprints | 14:16 |
| *** openstack changes topic to "bugs & blueprints (Meeting topic: tripleo)" | 14:16 | |
| EmilienM | #link https://launchpad.net/tripleo/+milestone/queens-2 | 14:17 |
| EmilienM | queens-1 tag isn't pushed yet because of zuul v3 | 14:17 |
| EmilienM | it should be done by today | 14:17 |
| EmilienM | but I moved all bugs / blueprints to queens-2 | 14:17 |
| EmilienM | we closed only one blueprint in queens-1 | 14:17 |
| EmilienM | and 233 Fix Released | 14:17 |
| EmilienM | eternal reminder but please update your blueprints | 14:18 |
| EmilienM | it's a lot of work and it would be great to have some help from assignees | 14:18 |
| EmilienM | any critical bug to discuss this week? | 14:18 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add the option to run the container-check script https://review.openstack.org/501028 | 14:19 |
| bandini | EmilienM: I'd like to rais a bit of attention on https://review.openstack.org/#/c/511509/ | 14:19 |
| openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Create dedicated "apache" base profile https://review.openstack.org/513274 | 14:19 |
| bandini | just as a heads up, we are currently ignoring puppet errors due to the above | 14:19 |
| EmilienM | ouch | 14:19 |
| *** shreshtha has quit IRC | 14:19 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: [WIP] Introduce DIB_USE_CACHE and use it in zypper-minimal https://review.openstack.org/514689 | 14:19 |
| bandini | mandre and I are trying to fix all the fallouts from this before merging it | 14:20 |
| EmilienM | bandini: ok good to know | 14:20 |
| EmilienM | #action team to review https://review.openstack.org/#/c/511509/ asap | 14:20 |
| EmilienM | bandini: thanks | 14:20 |
| EmilienM | it sounds critical | 14:20 |
| bandini | yeah | 14:20 |
| EmilienM | bandini: please backport all the fallouts fix and this one of course | 14:20 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add the option to run the container-check script https://review.openstack.org/501028 | 14:20 |
| bandini | yeah | 14:21 |
| EmilienM | bandini: https://review.openstack.org/#/c/513082/ isn't in gate | 14:21 |
| EmilienM | while dep is merged | 14:21 |
| *** udesale has quit IRC | 14:21 | |
| EmilienM | bandini: maybe you can -A +A | 14:21 |
| bandini | EmilienM: I think the last issue is around fluentd and scenario001 | 14:21 |
| mandre | so bandini's patch highlighted an error in scenario001-containers with fluentd | 14:22 |
| Ng | speaking of the gate, is there a known issue with it? the job at the front seems to be about 15 hours old | 14:22 |
| EmilienM | paramite, larsks ^ if you can help with the fluentd issue | 14:22 |
| paramite | EmilienM, probably, but after mtg | 14:22 |
| EmilienM | yup | 14:22 |
| bandini | EmilienM: let me try -A +A that one | 14:22 |
| EmilienM | ok in gate now | 14:23 |
| EmilienM | perfect | 14:23 |
| *** rodolof has quit IRC | 14:24 | |
| EmilienM | bandini: and https://review.openstack.org/#/c/511509/ as well | 14:24 |
| EmilienM | all good | 14:24 |
| bandini | so the last known issue around fluentd and scenario001 is due to missing fluentd image (aka due to lack of master promotion) | 14:24 |
| mandre | EmilienM: I'd be careful about merging https://review.openstack.org/#/c/511509/ right now | 14:24 |
| EmilienM | oh, we want to wait? | 14:24 |
| bandini | yeah it would break scenario001 | 14:24 |
| EmilienM | ok | 14:24 |
| mandre | because it highlighted an issue with fluentd in scenario001 | 14:24 |
| EmilienM | I blocked it | 14:25 |
| EmilienM | ping me when you want to unbluck | 14:25 |
| EmilienM | unblock even | 14:25 |
| mandre | would it be an option to disable the fluentd service in scenario001? | 14:25 |
| bandini | +1 from me ^ | 14:25 |
| EmilienM | mandre: if we can't fix it, yes | 14:25 |
| EmilienM | but let's try to fix it first | 14:26 |
| EmilienM | workarounds tend to be forgotten | 14:26 |
| bandini | the fix requires a mast promotion (aka flutend container image) | 14:26 |
| bandini | *master even | 14:26 |
| EmilienM | and increasing tech debt | 14:26 |
| EmilienM | ah... | 14:26 |
| EmilienM | so yeah | 14:26 |
| EmilienM | disable and comment in the file please | 14:26 |
| EmilienM | with a bug report or something | 14:26 |
| mandre | i believe the issue we're seeing is caused by us using a mix of BM and containers services, and we're waiting for a promoted fluentd image we can use in scenario001 to re-enable the containerized fluentd service | 14:26 |
| *** mcornea has quit IRC | 14:26 | |
| EmilienM | so it's not lost | 14:26 |
| EmilienM | bandini, mandre: sounds good? | 14:27 |
| mandre | ack, will do | 14:27 |
| EmilienM | thx | 14:27 |
| EmilienM | and thanks for this work | 14:27 |
| EmilienM | #topic projects releases or stable backports | 14:27 |
| *** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)" | 14:27 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add workflow for deployment via config-download https://review.openstack.org/512876 | 14:28 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Add --config-download https://review.openstack.org/514701 | 14:28 |
| EmilienM | not much update on project release & stable backport for now - queens-1 tag should be pushed today | 14:28 |
| EmilienM | any question? | 14:28 |
| bandini | ack | 14:28 |
| EmilienM | #topic specs | 14:28 |
| *** openstack changes topic to "specs (Meeting topic: tripleo)" | 14:28 | |
| EmilienM | #link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open | 14:28 |
| EmilienM | we could see a good progress in the spec review, great | 14:29 |
| EmilienM | do we need to discuss about specs today? | 14:29 |
| *** psachin has quit IRC | 14:30 | |
| EmilienM | moving on to the end | 14:30 |
| EmilienM | #topic open discussion | 14:30 |
| *** openstack changes topic to "open discussion (Meeting topic: tripleo)" | 14:30 | |
| EmilienM | if you have any question / request / feedback please go ahead | 14:30 |
| EmilienM | just a heads-up, we're working to prepare the OpenStack Summit | 14:31 |
| EmilienM | we have 2 sessions : | 14:31 |
| EmilienM | 1) Project updates that me and stevebaker will do together | 14:31 |
| EmilienM | we're working on the slides and will share with the team very soon for feedback | 14:31 |
| *** cshastri has quit IRC | 14:31 | |
| dprince | EmilienM: might be nice to etherpad it first, but sharing slides is cool | 14:31 |
| EmilienM | 2) Project onboarding - I wasn't there in Boston, but I would like some feedback from these who went there (shardy, dprince, slagle maybe?) | 14:32 |
| EmilienM | dprince: yeah i'll just google share the slides | 14:32 |
| EmilienM | dprince: so anyone can contribute | 14:32 |
| EmilienM | dprince: slides are empty now | 14:32 |
| * dprince can help with onboarding too | 14:32 | |
| *** dsariel has joined #tripleo | 14:32 | |
| EmilienM | awesome | 14:32 |
| EmilienM | #action EmilienM to prepare an etherpad for tripleo onboarding session in Sydney | 14:32 |
| slagle | EmilienM: i found the onboarding was most useful by just allowing participants to drive the agenda | 14:33 |
| EmilienM | slagle: like a "ask me anything" session? | 14:33 |
| dprince | slagle: agree. I don't think there is a lot of prep other than having a few of us show up and interactively help answer questions, etc. | 14:33 |
| EmilienM | and then drive the session depending on what is being asked | 14:33 |
| slagle | EmilienM: i'd keep it related to TripleO :) | 14:33 |
| dprince | but we could anticipate some questions | 14:33 |
| EmilienM | sounds excellent | 14:33 |
| EmilienM | anything for this week? | 14:34 |
| slagle | EmilienM: otherwise, you may get something like "How many pullups can you do?" | 14:34 |
| openstackgerrit | Dan Prince proposed openstack/python-tripleoclient master: Don't install packages as part of undercloud deploy. https://review.openstack.org/510239 | 14:34 |
| EmilienM | slagle: I did 8 this weekend | 14:34 |
| EmilienM | slagle: target is 10 by Sydney | 14:34 |
| EmilienM | thanks everyone | 14:35 |
| EmilienM | have a great week | 14:35 |
| EmilienM | #endmeeting | 14:35 |
| *** openstack changes topic to "CI status: RED - do not recheck - all multinode jobs red | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 14:35 | |
| openstack | Meeting ended Tue Oct 24 14:35:06 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:35 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-10-24-14.02.html | 14:35 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-10-24-14.02.txt | 14:35 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-10-24-14.02.log.html | 14:35 |
| *** hamzy has quit IRC | 14:35 | |
| Tengu | arf… | 14:35 |
| Tengu | of course I just sent a job in the CI, correcting a merge conflict. | 14:35 |
| Tengu | didn't see the topic until now… | 14:36 |
| jkilpatr | well drat. that's what I get for reading email during a meeting I guess. I had wanted to discuss this patch | 14:36 |
| EmilienM | Ng: sorry I just processed your question | 14:36 |
| jkilpatr | https://review.openstack.org/#/c/497950/ | 14:36 |
| jkilpatr | and it's appropriateness for tqe | 14:36 |
| EmilienM | Ng: the gate is very busy yeah | 14:36 |
| openstackgerrit | Radomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable all horizon plugins by default https://review.openstack.org/514421 | 14:36 |
| Ng | EmilienM: just noticed the topic change after the meeting, so I guess it is known :) | 14:37 |
| EmilienM | Ng: tbh, I don't know why but I guess it's the # of jobs | 14:37 |
| EmilienM | Ng: I need to update | 14:37 |
| sshnaidm | EmilienM, don't we have ci session in triple meeting anymore? | 14:37 |
| EmilienM | sshnaidm: maybe I screwed up | 14:37 |
| dmsimard | EmilienM, weshay|ruck, trown: Just sharing an interesting discussion sshnaidm and I were having back in #rdo. tl;dr, booting nodepool VMs in review.rdo directly with pre-built undercloud images | 14:37 |
| *** EmilienM changes topic to "CI status: Orange - gate is very busy | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 14:37 | |
| EmilienM | sshnaidm: you can go ahead here and speak if you have an update | 14:38 |
| dmsimard | In zuul v3 (and nodepool v3) we have the ability to use "static" images, images that aren't built through nodepool-builder but are instead in the provider/tenant | 14:38 |
| trown | dmsimard: maybe after the meeting? | 14:39 |
| dmsimard | trown: I see a "meeting ended" note | 14:39 |
| trown | dmsimard: indeed :p | 14:39 |
| dmsimard | ಠ_ಠ| 14:39 |
| EmilienM | ... | 14:39 |
| trown | dmsimard: how would you keep the static image updated? | 14:39 |
| dmsimard | trown: out of band, we would upload it after every promotion or something like that | 14:39 |
| *** abregman has quit IRC | 14:40 | |
| trown | dmsimard: ya... that part is not trivial though | 14:40 |
| dmsimard | there's still some kinks to iron out, like it could be weird if there's a "race" that makes half the jobs run on one version of an image and the other half of the jobs run on an updated image if the jobs happen to fire just when the image is uploaded | 14:40 |
| panda|rover|off | is the update atomic ? | 14:40 |
| *** abregman has joined #tripleo | 14:40 | |
| trown | it has to be atomic | 14:40 |
| weshay|ruck | dmsimard, nice | 14:40 |
| Tengu | jaosorior, EmilienM, shardy care to vote +2 for code review on that one? https://review.openstack.org/#/c/513274/ - I had to correct a merge conflict preventing it to be merged in master. I explained in a comment how I did it, so that you can tell me if I did wrong. Main goal: I didn't want to produce a second commit, and that wasn't possible with 'git rebase master'. | 14:41 |
| Tengu | ah, still in meeting. sorry. | 14:41 |
| sai | bnemec: trying to delete a stack and see this DELETE_FAILED Resource DELETE failed: IndexError: resources.Controller.resources[2].resources.Controller: list index out of range | 14:41 |
| sai | what do i do abt it | 14:41 |
| Tengu | or not? well. | 14:41 |
| dmsimard | anyway, was just throwing this out there, it's probably an interesting opportunity to explore for *review.rdoproject.org* jobs -- because upstream -infra is not interested in maintaining project customized images | 14:42 |
| sshnaidm | EmilienM, trown, weshay|ruck the main idea is to run upgrades job on pre-populated tripleo installation for stable branch, to save the initial install | 14:42 |
| sshnaidm | I'm not sure it's suitable for master, because it changes too fast | 14:43 |
| *** ecerquei_ has joined #tripleo | 14:43 | |
| EmilienM | that would be awesome | 14:43 |
| sshnaidm | but it may also to save undercloud install, if nothing changes in undercloud.. | 14:44 |
| bnemec | sai: That sounds like a Heat bug. You'll probably need to talk to them about how to debug it. | 14:44 |
| *** ecerquei has quit IRC | 14:44 | |
| bnemec | sai: The first thing they'll probably need is debug heat-engine logs. | 14:44 |
| sai | bnemec: ack, thanks! | 14:44 |
| dmsimard | sshnaidm: so, btw I guess I forgot to mention -- it's possible in nodepool v3 to use "static" images https://docs.openstack.org/infra/nodepool/feature/zuulv3/configuration.html#cloud-images | 14:46 |
| EmilienM | slagle: hey, maybe you could add my oooq patch in depends-on in https://review.openstack.org/#/c/512876/ so we test all the patches together and see if it actually works | 14:47 |
| EmilienM | slagle: and if the end user workflow change, we need re re-patch oooq I guess, to iterate | 14:47 |
| sshnaidm | dmsimard, great | 14:48 |
| *** tosky has joined #tripleo | 14:50 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Temporarily disable fluentd from scenario001-multinode-containers https://review.openstack.org/514706 | 14:52 |
| paramite | EmilienM, so what is wrong with fluentd in scenario001? | 14:56 |
| EmilienM | paramite: ask bandini / mandre - I'm not working on that | 14:56 |
| paramite | bandini, mandre ^ ? | 14:57 |
| chandankumar | EmilienM: weshay|ruck is this bug https://bugs.launchpad.net/tripleo/+bug/1725305 still poping up? | 14:57 |
| openstack | Launchpad bug 1725305 in tripleo "Quickstart Tempest whitelist isn't addressed" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 14:57 |
| EmilienM | chandankumar: I don't know | 14:57 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add NetIpMap to hieradata for *ExtraConfig overrides https://review.openstack.org/514707 | 14:57 |
| sshnaidm | bnemec, can you please look at something weird? http://logs.openstack.org/42/507642/4/experimental-tripleo/legacy-tripleo-ci-centos-7-ovb-ha-tempest-oooq/123ea18/job-output.txt.gz#_2017-10-24_11_38_49_237773 | 14:57 |
| EmilienM | chandankumar: let me check logs now | 14:57 |
| sshnaidm | bnemec, this tempest ovb job always fails on this step, when all other ovb are fine.. | 14:58 |
| bandini | paramite: https://bugs.launchpad.net/tripleo/+bug/1726891 | 14:58 |
| openstack | Launchpad bug 1726891 in tripleo "fluentd on BM fails on scenario001" [High,Triaged] | 14:58 |
| weshay|ruck | chandankumar, ya | 14:58 |
| EmilienM | weshay|ruck: what? | 14:58 |
| sshnaidm | bnemec, no idea why it happens.. do we use job names anywhere in te-broker..? | 14:58 |
| * paramite checking | 14:58 | |
| EmilienM | weshay|ruck: do you have logs handy? we were supposed to have it fixed with a testr bump | 14:58 |
| sshnaidm | bnemec, it's in experimental pipeline | 14:59 |
| *** spectr has quit IRC | 15:00 | |
| weshay|ruck | https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset006-master/563f8bb/undercloud/home/jenkins/tempest_output.log.txt.gz | 15:00 |
| EmilienM | weshay|ruck: it's scenario002-multinode.yaml | 15:01 |
| EmilienM | weshay|ruck: not scenario004 | 15:01 |
| EmilienM | weshay|ruck: the filter works well | 15:01 |
| EmilienM | chandankumar: yes I think this is fixed. | 15:01 |
| *** ccamacho has quit IRC | 15:02 | |
| EmilienM | weshay|ruck: see in your link, zaqar tests aren't run anymore for ex | 15:02 |
| *** brault has quit IRC | 15:02 | |
| EmilienM | same for ec2api | 15:02 |
| *** brault has joined #tripleo | 15:03 | |
| bnemec | sshnaidm: Something is very wrong with that job: http://logs.openstack.org/42/507642/4/experimental-tripleo/legacy-tripleo-ci-centos-7-ovb-ha-tempest-oooq/123ea18/job-output.txt.gz#_2017-10-24_11_38_47_220608 | 15:03 |
| bnemec | Apparently it's running on rax instead of rh1. | 15:03 |
| bnemec | They may not support the metadata service. | 15:03 |
| bnemec | In fact the evidence suggests that they do not. | 15:04 |
| EmilienM | Ng: the number of jobs in gate is high because we have an high rate of failure, so jobs are reset. AFIK nobody is looking at why the jobs are failing | 15:04 |
| openstackgerrit | Merged openstack/tripleo-specs master: tripleo-ovs-hw-offload https://review.openstack.org/502313 | 15:04 |
| openstackgerrit | Merged openstack/tripleo-specs master: tripleo-messaging specification https://review.openstack.org/504054 | 15:04 |
| EmilienM | Ng: so as long as no progress in made on fixing the timeouts, etc the gate will remain huge | 15:04 |
| EmilienM | dmsimard: if you have time, https://review.openstack.org/#/c/514671/ | 15:05 |
| EmilienM | bandini: can you get https://review.openstack.org/#/c/513767/ please? | 15:05 |
| *** shreshtha has joined #tripleo | 15:05 | |
| slagle | EmilienM: https://review.openstack.org/#/c/512876/ doesn't depend on your oooq patch | 15:05 |
| slagle | EmilienM: at this stage, i'd recommend doing an additional oooq patch on top of the one you already have to move it over to use the workflow | 15:06 |
| slagle | EmilienM: e.g., let's try and land what we've already seen passing, then iterate | 15:07 |
| slagle | EmilienM: not keep changing what's under review | 15:07 |
| EmilienM | slagle: ok good! | 15:07 |
| EmilienM | slagle: I'll look at your work and propose a patch on top of my oooq - and send you for review before we do Depends-On in your patches. Sounds ok? | 15:08 |
| slagle | sure | 15:08 |
| *** dbecker has quit IRC | 15:09 | |
| *** oidgar has quit IRC | 15:09 | |
| Ng | EmilienM: ack. I'll see if we have any cycles to spare for that (but I have low hopes) | 15:09 |
| EmilienM | Ng: like everyone :-) | 15:10 |
| Ng | yep | 15:10 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 15:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 15:10 |
| EmilienM | if nobody actually helps, situation will never improve | 15:10 |
| EmilienM | and folks will complain because gate is slow etc | 15:10 |
| openstackgerrit | Andy Smith proposed openstack/tripleo-heat-templates master: WIP Separate rpc and notify messaging backends https://review.openstack.org/507963 | 15:10 |
| *** gvrangan has joined #tripleo | 15:11 | |
| *** dparkes has quit IRC | 15:14 | |
| sshnaidm | bnemec, it should run on rh1 | 15:14 |
| *** dmarlin has joined #tripleo | 15:15 | |
| EmilienM | sshnaidm, weshay|ruck, dmsimard : would we have the capacity to run all upgrade jobs in rdo-ci? that would reduce our usage of openstack-infra | 15:15 |
| bnemec | sshnaidm: Well, it's not. Or something configured the mirror address incorrectly. | 15:15 |
| bnemec | But since there's no metadata server available I'm thinking it's actually running in rax. | 15:16 |
| sshnaidm | EmilienM, currently unknown, I have a patch to run all ovb jobs and containers-multinode-upgrade job for now | 15:16 |
| sshnaidm | EmilienM, we'll see how it goes | 15:16 |
| dmsimard | EmilienM: sshnaidm is working on moving all the OVB jobs, see my comment here https://review.rdoproject.org/r/#/c/10249/1/nodepool/nodepool.yaml | 15:17 |
| EmilienM | cool | 15:17 |
| sshnaidm | bnemec, maybe it's problem with experimental-tripleo pipeline.. | 15:17 |
| *** jmelvin has quit IRC | 15:17 | |
| dmsimard | EmilienM: after that increase, there isn't much buffer to increase further unless we go from CPU overcommit 2 to 4 | 15:17 |
| dmsimard | until RH1 gets incorporated in rdo cloud | 15:17 |
| sshnaidm | bnemec, you're right: ansible_nodename: centos-7-rax-dfw-0000419638 | 15:18 |
| bnemec | I don't know if that's still going to happen. The rh1 hardware is very old and almost out of warranty. I'm not sure RDO cloud will even want it at this point. | 15:18 |
| dmsimard | bnemec: I thought the whole point was to send rh1 hardware to rdo cloud :/ | 15:19 |
| dmsimard | bnemec: I even remember your comment in a spreadsheet about it I think | 15:19 |
| *** tosky has quit IRC | 15:19 | |
| *** shreshtha has quit IRC | 15:19 | |
| *** lblanchard has joined #tripleo | 15:20 | |
| *** aufi has quit IRC | 15:20 | |
| bnemec | dmsimard: It was, but that was like a year ago when we were supposed to have migrated to RDO cloud in February or something. | 15:20 |
| bnemec | Now the rh1 warranty runs out in (I think) January, so by the time it got integrated we'd probably be running on unsupported hardware. | 15:21 |
| *** hamzy has joined #tripleo | 15:21 | |
| bnemec | It may still happen, but we probably need to revisit that discussion before making any plans based on it. | 15:22 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Update CephPools format in the docker templates to fit ceph-ansible https://review.openstack.org/508859 | 15:22 |
| dmsimard | bnemec: ok | 15:23 |
| bnemec | Although, theoretically we could point the RDO cloud nodepool at the existing rh1 and start using it right away, I suppose. | 15:23 |
| *** ccamacho has joined #tripleo | 15:23 | |
| bnemec | We'd need to drop the infra max-servers to compensate. | 15:23 |
| slagle | thrash: d0ugal : is there a replacement for the deprecated ansible actions in tripleo-common? | 15:23 |
| d0ugal | slagle: which actions are deprecated? | 15:24 |
| thrash | slagle: they will move to mistral-extra | 15:24 |
| *** anshul has quit IRC | 15:24 | |
| weshay|ruck | EmilienM, yes we're moving upgrade jobs down to rdo sf | 15:24 |
| EmilienM | great | 15:24 |
| thrash | slagle: https://review.openstack.org/#/c/514360/ | 15:24 |
| slagle | d0ugal: tripleo.ansible-playbook | 15:24 |
| *** athomas has quit IRC | 15:25 | |
| slagle | thrash: ok, i see | 15:25 |
| d0ugal | slagle: right, so as thrash said. | 15:25 |
| *** pgrist has joined #tripleo | 15:25 | |
| *** dtrainor has quit IRC | 15:25 | |
| d0ugal | thrash, slagle, toure, social - we need to actually figure out how https://review.openstack.org/511254 and https://review.openstack.org/#/c/514360/ work together | 15:25 |
| *** dtrainor has joined #tripleo | 15:25 | |
| d0ugal | because toure's patch doesn't include the new changes ATM, but they also make it much more tripleo (and openstack specific) | 15:26 |
| *** pgrist has left #tripleo | 15:26 | |
| d0ugal | I don't really have a good answer for this, but we might end up with actions in tripleo-common that are not compatible with those in Mistral | 15:26 |
| slagle | d0ugal: yes, well, i was also kind of asking b/c i was going to propose adding a logfile to the ansibleaction | 15:27 |
| d0ugal | Right | 15:27 |
| EmilienM | weshay|ruck: periodic promotion jobs didn't start yet (queued), so we'll have the puppet-cinder patch for sure | 15:28 |
| d0ugal | These actions are also often updated, if we move them to mistral-extra and need a release each time it could be painful | 15:28 |
| EmilienM | weshay|ruck: also question for you, have we removed the periodic jobs in openstack-infra, since we have them in rdo-infra now? | 15:28 |
| d0ugal | slagle: yeah, I would continue updating the tripleo-common action for now. | 15:28 |
| *** tosky has joined #tripleo | 15:28 | |
| slagle | ok | 15:29 |
| d0ugal | It probably shouldn't have been marked as deprecated until an alternative had landed tbh | 15:29 |
| d0ugal | but I guess that was done to speed up the deprecation | 15:29 |
| social | d0ugal: will I have zaqar client there? | 15:29 |
| *** amodi has joined #tripleo | 15:29 | |
| *** jlinkes has quit IRC | 15:29 | |
| d0ugal | social: that is one of the potential problems :) | 15:29 |
| d0ugal | social: no, you wont and Mistral probably doesn't want an ansible action that requires Zaqar (or anything in Openstack - many mistral users are using it without OpenStack) | 15:30 |
| thrash | shouldn't that be done from the workflow, not the action? | 15:30 |
| weshay|ruck | EmilienM, ya.. they are gone | 15:30 |
| d0ugal | thrash: the action is long running and needs to provide output | 15:30 |
| social | d0ugal: well I could override the callback? | 15:31 |
| social | d0ugal: in my review? | 15:31 |
| thrash | d0ugal: hmm... | 15:31 |
| d0ugal | thrash: ansible streaming output over zaqar, should be cool | 15:31 |
| thrash | d0ugal: but optionally, right? | 15:31 |
| EmilienM | weshay|ruck++ | 15:31 |
| d0ugal | thrash: I guess it should be optional, yes. | 15:31 |
| *** pgrist__ has joined #tripleo | 15:31 | |
| d0ugal | thrash, social: I think maybe we need to make sure the version in mistral-extra can be easily extended | 15:32 |
| thrash | d0ugal: that's what I'm thinking... Needs to be able to take things like these callback plugins | 15:32 |
| d0ugal | Yeah | 15:32 |
| thrash | d0ugal: then it's up to the caller to supply those. | 15:32 |
| thrash | d0ugal: from what I can tell, matbu's patch does that? | 15:33 |
| d0ugal | thrash: yeah, it is optional | 15:34 |
| *** Goneri has quit IRC | 15:34 | |
| d0ugal | but I think there is an update coming with the zaqar support | 15:35 |
| d0ugal | but I'm not sure | 15:35 |
| social | d0ugal: can this wait 2 days, I'm in whole week meetings and hopefully I'll have someting useable for my review and we can go from there? | 15:38 |
| d0ugal | social: sure | 15:38 |
| d0ugal | toure: ^ | 15:38 |
| * toure catching up on convo | 15:40 | |
| *** Pranav_ has quit IRC | 15:40 | |
| *** dhill_ has joined #tripleo | 15:44 | |
| *** amodi has quit IRC | 15:45 | |
| *** newmember has joined #tripleo | 15:46 | |
| *** jmelvin has joined #tripleo | 15:47 | |
| *** pkovar1 has joined #tripleo | 15:47 | |
| *** pkovar has quit IRC | 15:47 | |
| *** yprokule has quit IRC | 15:48 | |
| *** marios has quit IRC | 15:48 | |
| *** ccamacho has quit IRC | 15:51 | |
| toure | d0ugal thrash social I could rebase around the newly incoming change in mistral-extra and then also propose my new changes to tripleo-common once that lands? | 15:52 |
| toure | thoughts? | 15:52 |
| *** jfrancoa has quit IRC | 15:52 | |
| *** toure is now known as toure|biab | 15:53 | |
| *** yolanda has quit IRC | 15:54 | |
| d0ugal | toure|biab: I'm not sure. I guess we should wait and see how social updates the patch, but I'm not sure it is worth landing yours yet | 15:54 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Add container update to feature set files https://review.openstack.org/514435 | 15:54 |
| *** toure|biab is now known as toure | 15:54 | |
| toure | d0ugal right, I propose waiting for social's patch to land first | 15:55 |
| *** agurenko has quit IRC | 15:55 | |
| d0ugal | toure: or, at least, stabalise a bit. | 15:55 |
| toure | d0ugal in the meanwhile I could pull in those changes and be at the ready | 15:55 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates stable/pike: Disable MongoDB in scenario002 https://review.openstack.org/514727 | 15:56 |
| *** iranzo has quit IRC | 15:56 | |
| d0ugal | toure: sure, if you like - but I would probably wait :) | 15:56 |
| toure | aw | 15:56 |
| toure | k | 15:56 |
| toure | ack | 15:56 |
| d0ugal | (or help test the tripleo-common patch etc. and make sure the design is good) | 15:56 |
| *** toure is now known as toure|lunch | 15:56 | |
| toure|lunch | will do | 15:57 |
| d0ugal | (good for tripleo and what Mistral would want) | 15:57 |
| *** cylopez has quit IRC | 15:57 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo stable/pike: Add option to disable running mistral-api via wsgi https://review.openstack.org/514728 | 15:57 |
| *** chem has quit IRC | 16:00 | |
| *** yamahata has quit IRC | 16:00 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Allow installing multiple-node Kubernetes https://review.openstack.org/514730 | 16:00 |
| social | toure|lunch: issue there is ansible it's self, we need to talk about binding tripleo_common/mistral to some version of ansible | 16:01 |
| *** amoralej|mtg is now known as amoralej | 16:05 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-heat-templates master: Start using ipv6 nic-configs from THT repo instead of tripleo-ci https://review.openstack.org/512554 | 16:05 |
| *** agurenko has joined #tripleo | 16:07 | |
| *** oidgar has joined #tripleo | 16:08 | |
| d0ugal | social: Can't that be done via requirements.txt? | 16:08 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Create default settings for environment types https://review.openstack.org/495407 | 16:09 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Change devmode to deploy containerized services by default https://review.openstack.org/472412 | 16:09 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 16:10 |
| *** dparkes has joined #tripleo | 16:10 | |
| *** dtantsur is now known as dtantsur|afk | 16:10 | |
| *** gvrangan has quit IRC | 16:11 | |
| *** ffiore has quit IRC | 16:14 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs010: use --config-download from tripleoclient https://review.openstack.org/514736 | 16:17 |
| *** shreshtha has joined #tripleo | 16:20 | |
| *** shreshtha has quit IRC | 16:20 | |
| *** shreshtha has joined #tripleo | 16:20 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: nova-placement: switch auth_uri to keystone versionless endpoint https://review.openstack.org/514739 | 16:21 |
| *** lucasagomes is now known as lucas-afk | 16:22 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates stable/pike: nova-placement: switch auth_uri to keystone versionless endpoint https://review.openstack.org/514741 | 16:22 |
| *** tesseract has quit IRC | 16:22 | |
| *** abregman has quit IRC | 16:25 | |
| *** fragatina has quit IRC | 16:25 | |
| *** pcaruana has quit IRC | 16:25 | |
| sai | bnemec: got another one for ya, as soon as i fire the deploy command i get Exception raised: cannot import name baremetal, surely something im doing wrong? | 16:26 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: nova-placement: switch auth_uri to keystone versionless endpoint https://review.openstack.org/514739 | 16:27 |
| *** gvrangan has joined #tripleo | 16:28 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: nova-placement: switch auth_uri to keystone versionless endpoint https://review.openstack.org/514739 | 16:28 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates stable/pike: nova-placement: switch auth_uri to keystone versionless endpoint https://review.openstack.org/514741 | 16:28 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: config-download: use workflow supported in Queens https://review.openstack.org/514745 | 16:29 |
| EmilienM | slagle: this is not tested at all yet, but at least you can provide early feedback on https://review.openstack.org/#/q/status:open+topic:queens/config-download | 16:29 |
| slagle | EmilienM: ack, will have a look | 16:31 |
| EmilienM | merci | 16:32 |
| *** shardy has quit IRC | 16:33 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: config-download: use workflow supported in Queens https://review.openstack.org/514745 | 16:34 |
| sai | bnemec: https://gist.githubusercontent.com/smalleni/8ca57528ba73dfd60716db8d69d82034/raw/862c48b8636bf58f8b33de00bc40f57088899f04/gistfile1.txt | 16:34 |
| *** janki has quit IRC | 16:37 | |
| bnemec | sai: Can you add --debug to that command? It might be helpful to have a full stack trace. | 16:37 |
| bnemec | Which I think --debug will give you. | 16:37 |
| bnemec | It _sounds_ like there may be a mismatch between tripleoclient and tripleo-common. | 16:38 |
| bnemec | But that's just an educated guess. | 16:38 |
| sai | oops | 16:39 |
| sai | https://gist.githubusercontent.com/smalleni/97a86547dc87807e293d4395736ea2a0/raw/1726ab37159bb294f70035e621a23d0cc4311fd9/gistfile1.txt | 16:39 |
| *** jpich has quit IRC | 16:40 | |
| *** ramishra has quit IRC | 16:41 | |
| *** yamahata has joined #tripleo | 16:42 | |
| *** dmacpher has quit IRC | 16:44 | |
| *** oidgar has quit IRC | 16:45 | |
| *** achadha has joined #tripleo | 16:46 | |
| *** gvrangan_ has joined #tripleo | 16:46 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: update the tripleo-ui when condition https://review.openstack.org/514757 | 16:47 |
| *** gvrangan has quit IRC | 16:47 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: update tripleo_ui_secure_access to true by default https://review.openstack.org/514758 | 16:48 |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: Add missing IronicInspector service https://review.openstack.org/514759 | 16:48 |
| *** achadha_ has joined #tripleo | 16:50 | |
| *** trown is now known as trown|lunch | 16:50 | |
| *** achadha has quit IRC | 16:51 | |
| *** derekh has quit IRC | 16:52 | |
| *** achadha has joined #tripleo | 16:53 | |
| *** achadha_ has quit IRC | 16:54 | |
| *** jtomasek has quit IRC | 16:56 | |
| *** dsariel has quit IRC | 16:58 | |
| *** tosky is now known as re | 17:00 | |
| *** re is now known as tosky | 17:00 | |
| *** gvrangan_ has quit IRC | 17:01 | |
| *** mrch has quit IRC | 17:01 | |
| *** gvrangan has joined #tripleo | 17:02 | |
| *** suuuper has quit IRC | 17:02 | |
| *** itlinux has joined #tripleo | 17:02 | |
| *** fzdarsky is now known as fzdarsky|afk | 17:05 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common master: Adds Workflow to List Available Roles https://review.openstack.org/509832 | 17:06 |
| *** dhill_ has quit IRC | 17:06 | |
| *** brian83 has joined #tripleo | 17:07 | |
| *** hewbrocca is now known as hewbrocca_afk | 17:08 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: update tripleo_ui_secure_access to true by default https://review.openstack.org/514758 | 17:09 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 17:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| honza | dprince: I'm getting this error when running the latest run.sh (new env from scratch) Please set --local-ip to the correct ipaddress/cidr for this machine. | 17:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 17:10 |
| *** dhill_ has joined #tripleo | 17:11 | |
| *** fragatina has joined #tripleo | 17:11 | |
| *** salmankhan has quit IRC | 17:12 | |
| *** pgrist__ has quit IRC | 17:12 | |
| *** apetrich has quit IRC | 17:12 | |
| *** apetrich has joined #tripleo | 17:13 | |
| *** salmankhan has joined #tripleo | 17:15 | |
| *** thrash is now known as thrash|biab | 17:17 | |
| *** raildo has quit IRC | 17:17 | |
| EmilienM | slagle: I updated https://etherpad.openstack.org/p/tripleo-config-download as well, please update if I missed something, thx | 17:18 |
| *** ebarrera has quit IRC | 17:18 | |
| *** salmankhan has quit IRC | 17:20 | |
| *** cylopez has joined #tripleo | 17:21 | |
| *** shreshtha has quit IRC | 17:26 | |
| *** gkadam has quit IRC | 17:30 | |
| *** raildo has joined #tripleo | 17:32 | |
| *** gvrangan_ has joined #tripleo | 17:33 | |
| *** raildo has quit IRC | 17:34 | |
| *** gvrangan has quit IRC | 17:34 | |
| *** raildo has joined #tripleo | 17:35 | |
| *** toure|lunch is now known as toure | 17:36 | |
| *** ludovic has joined #tripleo | 17:37 | |
| ludovic | Hello everybody | 17:38 |
| ludovic | someone there | 17:40 |
| ludovic | ? | 17:40 |
| *** gvrangan_ has quit IRC | 17:40 | |
| *** chlong has joined #tripleo | 17:41 | |
| bnemec | sai: Whoops, sorry. Missed your link. | 17:41 |
| bnemec | sai: What version is this? | 17:42 |
| *** ebarrera has joined #tripleo | 17:42 | |
| *** chlong is now known as chlong|lnch | 17:42 | |
| bnemec | nova-baremetal hasn't been a thing for quite a while so I'm surprised to see the client trying to import it. | 17:43 |
| sai | bnemec: 10 | 17:45 |
| sai | suspecting some kind of yum induced funkiness at this point | 17:45 |
| *** gvrangan has joined #tripleo | 17:45 | |
| ludovic | I would like to know if it's possible to modify the range of IP in TripleO without breaking the link between the undercloud and the overcloud ? | 17:46 |
| dprince | honza: can you add local_ip in your undercloud.conf and retry? | 17:47 |
| honza | dprince: the value is already there | 17:47 |
| honza | that was my first thought | 17:47 |
| ludovic | range of IP for internal api , external, tenant network, dhcp and introspection ironic | 17:48 |
| bnemec | sai: That would be my guess as well. I'm thinking you have a newer novaclient since the baremetal module is still there in Newton: https://github.com/openstack/python-novaclient/blob/stable/newton/novaclient/v2/contrib/baremetal.py | 17:48 |
| *** thrash|biab is now known as thrash | 17:49 | |
| bnemec | But it went away in Pike. | 17:49 |
| sai | bnemec: thanks for looking into this..ill bring the hammer down on this system | 17:49 |
| sai | lol | 17:49 |
| sai | best way to deal with yum | 17:49 |
| sai | start fresh | 17:49 |
| sai | lesosn learnt | 17:49 |
| *** trown|lunch is now known as trown | 17:50 | |
| gregwork | when doing a vxlan based overcloud deploy, how soon after the overcloud image is the br-tun device configured ? | 17:50 |
| gregwork | i am at [overcloud.AllNodesDeploySteps.ControllerDeployment_Step4.1]: CREATE_COMPLETE and im still only seeing br-ex and br-tenant from ovs-vsctl | 17:52 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud master: heat-dbsync: increase timeout to 15 minutes https://review.openstack.org/514777 | 17:52 |
| *** tvignaud has quit IRC | 17:53 | |
| Tengu | jaosorior: erf… now the check fails becaue I didn't update the unit-tests on my tripleo::profile::base::apache :Þ. | 17:54 |
| ludovic | After a failed deploy, no status reason or output is available | 17:56 |
| ludovic | stack@noeyycu6 ~]$ openstack stack failures list --long overcloud overcloud.Controller.0.UpdateDeployment: resource_type: OS::Heat::SoftwareDeployment physical_resource_id: 8cd00c9b-937f-4c4f-a35c-d6915cd9f65f status: CREATE_FAILED status_reason: | CREATE aborted deploy_stdout: | None deploy_stderr: | None | 17:56 |
| *** tosky has quit IRC | 18:01 | |
| ludovic | i don't know why my deploy stuck on 2017-10-24 18:02:24Z [ComputeIpListMap]: UPDATE_COMPLETE state changed | 18:03 |
| *** dparkes has quit IRC | 18:05 | |
| Tengu | ludovic: hmm, I think you can list resources in the failed stack as well. | 18:05 |
| *** dparkes has joined #tripleo | 18:07 | |
| openstackgerrit | Moshe Levi proposed openstack/puppet-tripleo master: Add support for switchdev mode in SR-IOV https://review.openstack.org/507100 | 18:08 |
| openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Create dedicated "apache" base profile https://review.openstack.org/513274 | 18:08 |
| Tengu | and Voilà . | 18:08 |
| openstackgerrit | Moshe Levi proposed openstack/tripleo-heat-templates master: Adds environment file for OVS Hardware Offload https://review.openstack.org/507401 | 18:08 |
| Tengu | that should make the zuul happy. | 18:08 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 18:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 18:10 |
| *** social has quit IRC | 18:11 | |
| *** gvrangan_ has joined #tripleo | 18:11 | |
| *** social has joined #tripleo | 18:11 | |
| *** gvrangan has quit IRC | 18:11 | |
| openstackgerrit | Alan Pevec proposed openstack/tripleo-quickstart master: switch to RDO Queens deps repo https://review.openstack.org/508870 | 18:12 |
| *** jpena is now known as jpena|off | 18:13 | |
| *** morazi has quit IRC | 18:14 | |
| *** amoralej is now known as amoralej|off | 18:14 | |
| *** chem has joined #tripleo | 18:14 | |
| *** gvrangan_ has quit IRC | 18:19 | |
| *** achadha has quit IRC | 18:22 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 18:22 |
| *** gvrangan has joined #tripleo | 18:24 | |
| *** rbrady is now known as rbrady-afk | 18:28 | |
| *** achadha has joined #tripleo | 18:29 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add workflow for deployment via config-download https://review.openstack.org/512876 | 18:29 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Log Ansible actions to ansible.log https://review.openstack.org/514783 | 18:29 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add work_dir for some actions https://review.openstack.org/514784 | 18:30 |
| vkmc | core reviewers, could you take a look at https://review.openstack.org/#/c/490974/? | 18:33 |
| vkmc | it's an easy one, already has a +2 | 18:33 |
| openstackgerrit | Andy Smith proposed openstack/tripleo-heat-templates master: WIP Separate rpc and notify messaging backends https://review.openstack.org/507963 | 18:33 |
| *** pkovar1 has quit IRC | 18:36 | |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Add --output-dir https://review.openstack.org/514789 | 18:36 |
| *** tosky has joined #tripleo | 18:38 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: TLS everywhere: Only generate ssh key if it's not there https://review.openstack.org/514152 | 18:38 |
| *** atoth has quit IRC | 18:39 | |
| fultonj | Do we know if the gnocchi user on ovb nodes has a consistent UID? | 18:42 |
| fultonj | colonwq: ^ ? | 18:42 |
| EmilienM | fultonj: we shouldn't deploy gnocchi on ovb | 18:44 |
| EmilienM | we should only use scenario001 | 18:44 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - Import TripleO legacy zuul jobs https://review.openstack.org/514793 | 18:47 |
| fultonj | EmilienM: ok | 18:47 |
| fultonj | do we know how the gnocchi user is added in scenario001 ? | 18:48 |
| EmilienM | dmsimard: https://review.openstack.org/#/q/topic:tripleo/migrate-to-zuulv3+(status:open+OR+status:merged) | 18:48 |
| EmilienM | fultonj: which kind of user? | 18:48 |
| EmilienM | fultonj: posix? | 18:48 |
| fultonj | yes | 18:48 |
| EmilienM | it's in rpm | 18:48 |
| fultonj | the type you'd find in /etc/passwd | 18:48 |
| fultonj | ok, thanks | 18:48 |
| fultonj | colonwq: ^ | 18:48 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - Import TripleO legacy zuul jobs https://review.openstack.org/514793 | 18:52 |
| *** gvrangan has quit IRC | 18:55 | |
| *** salmankhan has joined #tripleo | 18:56 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: add a very simple tripleo-ui validation https://review.openstack.org/514794 | 18:57 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: add basic/simple tests for the tripleo-ui https://review.openstack.org/514795 | 19:01 |
| *** salmankhan has quit IRC | 19:01 | |
| weshay|ruck | Slower, ok.. so we're running container update in a test change | 19:04 |
| weshay|ruck | Slower, detecting some issues w/ the yum proxies we think | 19:04 |
| weshay|ruck | Slower, 514435 in the zuul queue now | 19:05 |
| weshay|ruck | mwhahaha, EmilienM fyi.. container updates under test to allow changes to be integrated and updates included | 19:05 |
| weshay|ruck | https://review.openstack.org/#/c/514465/ | 19:06 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 19:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 19:10 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - Import TripleO legacy zuul jobs https://review.openstack.org/514793 | 19:14 |
| *** agurenko has quit IRC | 19:18 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Update CephPools format in the docker templates to fit ceph-ansible https://review.openstack.org/508859 | 19:20 |
| openstackgerrit | Bob Fournier proposed openstack/tripleo-common master: Accept glance image ID in addition to name https://review.openstack.org/498978 | 19:22 |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 19:27 |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: WIP: Pre-run validations and verifications for the undercloud https://review.openstack.org/513856 | 19:27 |
| openstackgerrit | Keith Schincke proposed openstack/tripleo-heat-templates master: Set file ACLs for Ceph keyrings for non-containerized deployment https://review.openstack.org/509020 | 19:28 |
| *** chlong|lnch has quit IRC | 19:29 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Run containerized mistral-api eventlet https://review.openstack.org/513082 | 19:30 |
| EmilienM | bandini: nice etherpad, https://etherpad.openstack.org/p/tripleo-puppet-error-recap | 19:30 |
| EmilienM | bandini: thanks - everything is reviewed or merged | 19:30 |
| bandini | EmilienM: ;) my brain is too small to keep track of everything | 19:31 |
| EmilienM | bandini: don't be modest. | 19:31 |
| bandini | lol | 19:31 |
| *** pkovar has joined #tripleo | 19:33 | |
| bandini | alrighty. /me gone. 'night folks | 19:33 |
| *** gfidente has quit IRC | 19:35 | |
| *** chlong|lnch has joined #tripleo | 19:36 | |
| *** ebarrera has quit IRC | 19:37 | |
| sshnaidm | does anybody know how to see quota usage in tenant with openstack cli? | 19:41 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Switch cinder_catalog_info from v2 to v3 https://review.openstack.org/514261 | 19:45 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Create short lived ssh key for enable-ssh-admin.sh https://review.openstack.org/514363 | 19:46 |
| *** rodolof has joined #tripleo | 19:48 | |
| EmilienM | weshay|ruck: ^ https://review.openstack.org/514261 merged, let's see how it goew | 19:52 |
| *** ludovic has quit IRC | 19:53 | |
| weshay|ruck | EmilienM, thanks | 19:53 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Add undercloud cinder roles and environment files https://review.openstack.org/514809 | 19:55 |
| *** achadha_ has joined #tripleo | 19:56 | |
| *** achadha has quit IRC | 20:00 | |
| *** achadha_ has quit IRC | 20:00 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: ci-ovn: Disable Swift services in scenario 007 container job https://review.openstack.org/513245 | 20:03 |
| EmilienM | weshay|ruck: http://logs.openstack.org/77/514777/1/check/legacy-tripleo-ci-centos-7-undercloud-oooq/aa0117f/logs/undercloud/home/zuul/repo_setup.log.txt.gz#_2017-10-24_18_14_08 | 20:05 |
| EmilienM | have you seen that? | 20:05 |
| EmilienM | it looks random | 20:06 |
| EmilienM | 5 hits in 7 days, not a big deal | 20:08 |
| * weshay|ruck looks | 20:08 | |
| EmilienM | but still, if we want a query or not | 20:08 |
| weshay|ruck | hrm.. that may be from unmerged code | 20:08 |
| * weshay|ruck checks w/ query | 20:08 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 20:10 |
| *** liverpooler has quit IRC | 20:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 20:10 |
| weshay|ruck | EmilienM, https://review.openstack.org/#/c/512855/ | 20:10 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Fix standalone ControllerOpenstack vars https://review.openstack.org/512466 | 20:10 |
| EmilienM | weshay|ruck: awesome | 20:11 |
| EmilienM | weshay|ruck: reviewing it now | 20:11 |
| weshay|ruck | sshnaidm, we have to chat about https://review.openstack.org/#/c/511526/ | 20:12 |
| weshay|ruck | sshnaidm, we have to play nice w/ infra | 20:12 |
| EmilienM | he wanted to actually test it (not a bad idea heh) | 20:12 |
| sshnaidm | weshay|ruck, ok, we need to have possibility to investigate jobs failures too | 20:12 |
| *** dsariel has joined #tripleo | 20:13 | |
| weshay|ruck | sshnaidm, yes indeed a balance must be struck :) | 20:13 |
| sshnaidm | weshay|ruck, I'm fine to exclude big and not necessary logs with exclude list | 20:13 |
| weshay|ruck | sshnaidm, help me find that balance | 20:13 |
| weshay|ruck | sshnaidm, so the feedback I'm getting from infra is that they don't even want us specifying directories | 20:13 |
| weshay|ruck | they've moved onto files | 20:14 |
| weshay|ruck | which is not fun | 20:14 |
| sshnaidm | weshay|ruck, what does it mean? | 20:14 |
| weshay|ruck | sshnaidm, so they would be requesting that we specify each file we want to log | 20:14 |
| weshay|ruck | so I'd rather take some steps to reduce the size and inode count | 20:14 |
| weshay|ruck | and get them off our backs | 20:15 |
| sshnaidm | weshay|ruck, but it's not devstack *facepalm* | 20:15 |
| weshay|ruck | ya | 20:15 |
| sshnaidm | weshay|ruck, well, good news that we are moving to rdo cloud, where we can control it, maybe to ask them to wait until we move | 20:16 |
| weshay|ruck | sshnaidm, so I'd ask one of two things... keep the -2 and productive comments until you are satisifed | 20:16 |
| weshay|ruck | sshnaidm, we're not moving all the jobs to rdo-cloud | 20:16 |
| sshnaidm | weshay|ruck, ovb are most space consuming | 20:16 |
| weshay|ruck | sshnaidm, but ya that will help | 20:16 |
| weshay|ruck | yes | 20:16 |
| sshnaidm | weshay|ruck, it will decrease logs in 3 times at least | 20:17 |
| sshnaidm | weshay|ruck, the problem is - when new log file is added, you'll never know about it and won't be able to detect its failures | 20:18 |
| weshay|ruck | sshnaidm, do we have an override for rdo-cloud jobs? | 20:18 |
| weshay|ruck | sshnaidm, exactly | 20:18 |
| sshnaidm | weshay|ruck, wasting hours and days on useless investigations | 20:18 |
| weshay|ruck | sshnaidm, yes | 20:18 |
| weshay|ruck | agree | 20:18 |
| weshay|ruck | I am in violent agreement but at the same time we really depend on infra | 20:18 |
| sshnaidm | weshay|ruck, override? | 20:18 |
| weshay|ruck | sshnaidm, https://github.com/openstack-infra/tripleo-ci/blob/master/toci-quickstart/config/collect-logs.yml for rdo-cloud jobs | 20:19 |
| weshay|ruck | we can keep more logs there w/ an override | 20:19 |
| sshnaidm | weshay|ruck, well, with configs it was understandable, but logs are different, everything that was running - was impacting tripleo | 20:19 |
| weshay|ruck | and then people will ask.. why is tq so confusing :) | 20:19 |
| sshnaidm | weshay|ruck, exactly | 20:20 |
| weshay|ruck | sshnaidm, anyhoo.. I'd still like to more forward w/ the patch and working w/ infra | 20:20 |
| sshnaidm | right now it's nightmare, but without logs it'll be nearly impossible.. | 20:20 |
| weshay|ruck | sshnaidm, so help me specify which logs we need | 20:20 |
| weshay|ruck | EmilienM, scen001 in tempest now on master | 20:21 |
| weshay|ruck | EVERYONE CROSS YOUR FINGERS | 20:21 |
| EmilienM | yeah pleace | 20:21 |
| sshnaidm | weshay|ruck, well, if we just do "ls *" on /var/log and put it into logs collection, will it be ok? | 20:21 |
| weshay|ruck | ha.. | 20:21 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add workflow for deployment via config-download https://review.openstack.org/512876 | 20:21 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Log Ansible actions to ansible.log https://review.openstack.org/514783 | 20:21 |
| EmilienM | please even | 20:21 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add work_dir for some actions https://review.openstack.org/514784 | 20:21 |
| weshay|ruck | sshnaidm, it doesn't collect anything that is not there :) | 20:21 |
| sshnaidm | weshay|ruck, or we need to fight now for every file and prove that it could be useful for investigation and it can break? | 20:22 |
| *** itlinux has quit IRC | 20:22 | |
| weshay|ruck | sshnaidm, well.. I think us moving this patch forward also shows a little good will | 20:22 |
| EmilienM | https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset007-master/256/console | 20:22 |
| EmilienM | it passed | 20:22 |
| EmilienM | scenario003-multinode.yaml | 20:23 |
| weshay|ruck | sshnaidm, leave your -2 while you help improve it.. but you have to be helping it along | 20:23 |
| EmilienM | :D | 20:23 |
| weshay|ruck | EmilienM, nice | 20:23 |
| EmilienM | scenario004-multinode.yaml as well | 20:23 |
| sshnaidm | weshay|ruck, let's start with ovb jobs at least, we have them mirrored now in rdo cloud and can investigate there in case of failure | 20:23 |
| weshay|ruck | sshnaidm, we can do the same w/ multinode | 20:24 |
| sshnaidm | weshay|ruck, and they are most space consuming, so the difference will be seen | 20:24 |
| * EmilienM sees the light of the tunnel's end | 20:24 | |
| sshnaidm | weshay|ruck, to mirror everything to rdo cloud? | 20:24 |
| * weshay|ruck just see's the light.. | 20:24 | |
| * EmilienM wonders if it's light of another tunnel | 20:24 | |
| * sshnaidm sees just a tunnel with lights of arriving train | 20:25 | |
| *** raildo has quit IRC | 20:25 | |
| weshay|ruck | bugs bunny style | 20:25 |
| *** raildo has joined #tripleo | 20:25 | |
| EmilienM | the train is queens-1 and just derailed :P | 20:25 |
| *** toure is now known as toure_biab | 20:26 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 20:27 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add workflow for deployment via config-download https://review.openstack.org/512876 | 20:29 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Log Ansible actions to ansible.log https://review.openstack.org/514783 | 20:29 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add work_dir for some actions https://review.openstack.org/514784 | 20:29 |
| *** jcoufal has quit IRC | 20:29 | |
| EmilienM | sshnaidm: can you review https://review.openstack.org/#/c/511907/3 please? | 20:29 |
| *** raildo has quit IRC | 20:29 | |
| *** itlinux has joined #tripleo | 20:30 | |
| *** abishop has quit IRC | 20:30 | |
| sshnaidm | EmilienM, it's for all jobs, right?> | 20:31 |
| EmilienM | sshnaidm: yeah | 20:31 |
| sshnaidm | very good | 20:31 |
| EmilienM | oh yeah :D | 20:31 |
| *** cylopez has quit IRC | 20:31 | |
| weshay|ruck | telemetry failed | 20:31 |
| EmilienM | oops | 20:32 |
| weshay|ruck | ceilometer.tests.tempest.scenario.test_telemetry_integration.TestTelemetryIntegration.test_autoscaling | 20:32 |
| EmilienM | ok | 20:32 |
| EmilienM | pradk: we'll maybe need your help if I can't find why it failed | 20:32 |
| EmilienM | it's collecting logs now | 20:32 |
| pradk | ok | 20:32 |
| *** jprovazn has quit IRC | 20:33 | |
| *** apetrich has quit IRC | 20:34 | |
| *** cylopez has joined #tripleo | 20:35 | |
| *** ansmith has quit IRC | 20:35 | |
| *** apetrich has joined #tripleo | 20:37 | |
| weshay|ruck | volume boot pattern | 20:38 |
| weshay|ruck | https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset005-master/ba7414d/undercloud/home/jenkins/tempest_output.log.txt.gz#_2017-10-24_20_20_53 | 20:38 |
| *** bobh has quit IRC | 20:38 | |
| weshay|ruck | EmilienM, ^ so jenkins console is hard to read, so far it's just volume boot pattern | 20:39 |
| *** pchavva has quit IRC | 20:40 | |
| pradk | thats not telemetry though? | 20:40 |
| EmilienM | maybe because we need https://review.openstack.org/#/c/514261/ | 20:40 |
| EmilienM | pradk: not | 20:40 |
| EmilienM | no | 20:40 |
| pradk | k | 20:40 |
| EmilienM | brb lunch | 20:40 |
| weshay|ruck | pradk, ya.. sorry jenkins consoles are hard to read | 20:44 |
| *** dprince has quit IRC | 20:45 | |
| *** paramite has quit IRC | 20:46 | |
| pradk | np | 20:48 |
| *** chem has quit IRC | 20:50 | |
| *** dsariel has quit IRC | 20:51 | |
| EmilienM | weshay|ruck: back. looking | 20:52 |
| *** achadha has joined #tripleo | 20:57 | |
| *** raildo has joined #tripleo | 20:58 | |
| EmilienM | volume is created successfuly: https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset005-master/ba7414d/subnode-2/var/log/cinder/volume.log.txt.gz#_2017-10-24_20_20_49_529 | 20:58 |
| EmilienM | but sounds like nova can't find it, looking for logs now | 20:58 |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: WIP: Pre-run validations and verifications for the undercloud https://review.openstack.org/513856 | 20:58 |
| *** raildo has quit IRC | 20:59 | |
| EmilienM | I found this: https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset005-master/ba7414d/subnode-2/var/log/nova/nova-compute.log.txt.gz#_2017-10-24_20_04_15_580 | 21:00 |
| EmilienM | but this is just a warning | 21:00 |
| EmilienM | oh found it | 21:01 |
| *** achadha has quit IRC | 21:01 | |
| EmilienM | see https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset005-master/ba7414d/subnode-2/var/log/nova/nova-api.log.txt.gz#_2017-10-24_20_20_51_291 | 21:01 |
| EmilienM | I'm pretty sure we need https://review.openstack.org/#/c/514261/ | 21:02 |
| EmilienM | weshay|ruck: ^ 99% sure this patch will help to get tempest tests working for volume tests | 21:02 |
| EmilienM | nova tried to use cinder v2 | 21:03 |
| *** tbarron is now known as tbarron|bbl | 21:03 | |
| EmilienM | (wrong config) | 21:03 |
| weshay|ruck | EmilienM, ok | 21:03 |
| weshay|ruck | EmilienM, I'm going to update getthelogs to work w/ rdo infra | 21:03 |
| *** lblanchard has quit IRC | 21:04 | |
| EmilienM | ok | 21:04 |
| EmilienM | weshay|ruck: and me patching puppet-nova to update parameters for queens - a bunch of deprecations... | 21:05 |
| EmilienM | owalsh: ^ fyi | 21:05 |
| owalsh | EmilienM: what up? | 21:06 |
| *** cylopez has quit IRC | 21:06 | |
| EmilienM | owalsh: we need to do https://review.openstack.org/#/c/513760/ for nova | 21:08 |
| *** cylopez has joined #tripleo | 21:08 | |
| EmilienM | exactly the same thing, for nova::compute | 21:08 |
| *** ecerquei_ has quit IRC | 21:08 | |
| owalsh | EmilienM: ack, need me to take a look at this tomorrow? | 21:09 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 21:10 |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 21:10 |
| EmilienM | owalsh: would be awesome | 21:10 |
| EmilienM | owalsh: I have a bug for that, a sec | 21:11 |
| EmilienM | owalsh: https://bugs.launchpad.net/tripleo/+bug/1725298 | 21:11 |
| openstack | Launchpad bug 1725298 in tripleo "TripleO doesn't use latest key_manager parameter from Cinder in Queens" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 21:11 |
| EmilienM | owalsh: thanks | 21:11 |
| EmilienM | owalsh: let me know if you need help | 21:11 |
| openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 21:14 |
| owalsh | EmilienM: same default for nova I assume? | 21:14 |
| EmilienM | owalsh: we need to see what nova recommands | 21:15 |
| EmilienM | but yeah | 21:15 |
| owalsh | EmilienM: ok, cool. I'll take a look tomorrow. ttyl | 21:15 |
| *** itlinux has quit IRC | 21:18 | |
| *** cylopez has quit IRC | 21:19 | |
| *** achadha has joined #tripleo | 21:20 | |
| *** achadha has quit IRC | 21:20 | |
| *** cylopez has joined #tripleo | 21:20 | |
| *** achadha has joined #tripleo | 21:21 | |
| *** tvignaud has joined #tripleo | 21:24 | |
| *** thrash is now known as thrash|g0ne | 21:26 | |
| *** itlinux has joined #tripleo | 21:26 | |
| *** ansmith has joined #tripleo | 21:26 | |
| *** bobh has joined #tripleo | 21:29 | |
| *** rodolof has quit IRC | 21:31 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: refactor cellv2 host discovery logic to avoid races https://review.openstack.org/513867 | 21:37 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Update default cell_v2 cell when it already exists https://review.openstack.org/506595 | 21:37 |
| itlinux | hello has anyone done the mutliregions with OOO | 21:47 |
| itlinux | or it's better to adopt the Cell2? | 21:47 |
| itlinux | thanks | 21:47 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: upgrades: manage quickstart-centos-base repository https://review.openstack.org/512708 | 21:48 |
| openstackgerrit | Merged openstack/puppet-pacemaker master: Pin jwt to 1.5.6 and rubocop to 0.50.0 https://review.openstack.org/514270 | 21:48 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first https://review.openstack.org/513530 | 21:50 |
| *** jmelvin has quit IRC | 21:57 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 21:57 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 22:00 |
| *** florianf has quit IRC | 22:07 | |
| openstackgerrit | Radomir Dopieralski proposed openstack/tripleo-heat-templates master: Enable all horizon plugins by default https://review.openstack.org/514421 | 22:08 |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724093 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 22:10 |
| openstack | Launchpad bug 1724093 in tripleo "tripleo releases are promoted prior to the image upload" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 22:10 |
| *** bfournie has quit IRC | 22:12 | |
| *** bobh has quit IRC | 22:14 | |
| *** cdearborn has quit IRC | 22:22 | |
| *** achadha has quit IRC | 22:23 | |
| *** achadha has joined #tripleo | 22:24 | |
| EmilienM | weshay|ruck: do we have actual actions on the 2 alerts? if no, let's remove them | 22:26 |
| *** achadha has quit IRC | 22:26 | |
| *** achadha has joined #tripleo | 22:27 | |
| *** achadha_ has joined #tripleo | 22:29 | |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 22:29 |
| *** achadha has quit IRC | 22:31 | |
| *** dmarlin has quit IRC | 22:32 | |
| *** achadha_ has quit IRC | 22:33 | |
| *** achadha has joined #tripleo | 22:34 | |
| weshay|ruck | EmilienM, ack.. I'll remove the promotion one | 22:37 |
| *** achadha has quit IRC | 22:39 | |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 22:39 |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Pre-run validations and verifications for the undercloud https://review.openstack.org/513856 | 22:42 |
| *** bkopilov has quit IRC | 22:46 | |
| weshay|ruck | rlandy, we may need find that review that creates a local yum repo in a container | 22:48 |
| * weshay|ruck looking for it now | 22:48 | |
| weshay|ruck | I wonder how far panda|rover|off got w/ that | 22:48 |
| weshay|ruck | rlandy, the other thing to try.. is just for giggles ... can we inject a sleep to slow the yum updates down | 22:49 |
| weshay|ruck | rlandy, I want to see if we're clobbering something by updating all the containers at once so quickly | 22:49 |
| weshay|ruck | rlandy, this is all done on a mounted container | 22:50 |
| rlandy | weshay|ruck: possible - the retry should address that - to view source https://github.com/imain/container-check/blob/master/container-check#L122 | 22:50 |
| *** bkopilov has joined #tripleo | 22:51 | |
| rlandy | the randomness of the failures makes debug harder | 22:52 |
| weshay|ruck | rlandy, so the retry is in progress, I just see it logging the failure | 22:53 |
| weshay|ruck | EmilienM, I think the ping tests is catching an error too | 22:54 |
| weshay|ruck | EmilienM, /me checks it out | 22:54 |
| rlandy | weshay|ruck: Slower is working on retry logic for the failures only -only failure logging in master and python package in use now | 22:54 |
| weshay|ruck | k k | 22:54 |
| rlandy | I think retry will do better than a sleep | 22:54 |
| rlandy | as we will only be retrying failures | 22:55 |
| rlandy | to quote ... | 22:55 |
| rlandy | Slower> I'll just retry the specific failures | 22:55 |
| rlandy | <Slower> without commiting the change | 22:55 |
| rlandy | <Slower> so it'll be a fresh yum update | 22:55 |
| *** bkopilov has quit IRC | 22:56 | |
| rlandy | we just can't fail jobs on random update corruptions | 22:56 |
| weshay|ruck | EmilienM, this job is fairly easy to recreate https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/4a00d26/undercloud/home/jenkins/tempest_output.log.txt.gz | 22:57 |
| weshay|ruck | will bring it up | 22:57 |
| EmilienM | weshay|ruck: logs? pingtest is I think testing boot from volume | 22:57 |
| EmilienM | let me check | 22:57 |
| weshay|ruck | this one is tempest | 22:57 |
| * weshay|ruck gets ping test | 22:57 | |
| weshay|ruck | not much there | 22:57 |
| weshay|ruck | https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset002-master-upload/bfc8dbe/undercloud/home/jenkins/overcloud_validate.log.txt.gz | 22:57 |
| weshay|ruck | looking for more | 22:58 |
| *** cylopez has quit IRC | 22:58 | |
| EmilienM | weshay|ruck: I found it! | 22:58 |
| EmilienM | 2017-10-24 21:06:00 | <class 'nova.exception.UnsupportedCinderAPIVersion'> | 22:58 |
| EmilienM | so yeah, this is what I thought | 22:58 |
| EmilienM | next round of jobs should be better I think | 22:58 |
| *** achadha has joined #tripleo | 22:58 | |
| weshay|ruck | EmilienM, ok.. I'll hold off on bugs until the next one kicks | 22:58 |
| EmilienM | weshay|ruck: please | 22:58 |
| *** itlinux has quit IRC | 22:59 | |
| weshay|ruck | EmilienM, you may want to become a little familiar w/ https://github.com/imain/container-check | 22:59 |
| EmilienM | weshay|ruck: we can't swing a cat this month | 23:00 |
| EmilienM | imain/container-check looks really cool | 23:01 |
| weshay|ruck | EmilienM, what kind of back woods french saying is that | 23:01 |
| EmilienM | weshay|ruck: it's an expression from Texas I just learnt today | 23:01 |
| *** achadha has quit IRC | 23:02 | |
| EmilienM | I can't google it | 23:03 |
| weshay|ruck | EmilienM, hrm.. now the containerized master jobs are failing | 23:10 |
| weshay|ruck | weeee | 23:10 |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722864 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 23:10 |
| EmilienM | weshay|ruck: logs please | 23:10 |
| weshay|ruck | hrm.. this looks like a missing setting https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/0c1149a/undercloud/home/jenkins/failed_deployment_list.log.txt.gz | 23:10 |
| EmilienM | ouch | 23:11 |
| EmilienM | in WorkflowTasks_Step2_Execution | 23:11 |
| EmilienM | let's see mistral logs | 23:11 |
| weshay|ruck | jrist, ya.. it's something we can easily build on while we get the other tests in | 23:12 |
| EmilienM | https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/0c1149a/undercloud/var/log/mistral/ceph-install-workflow.log.txt.gz#_2017-10-24_22_56_58_858 | 23:12 |
| jrist | weshay|ruck: yeah exactly | 23:12 |
| EmilienM | that's weird | 23:12 |
| EmilienM | fultonj: ^ have you seen that right? | 23:12 |
| EmilienM | weshay|ruck: for this one ^ we need to ping ceph guys | 23:13 |
| EmilienM | I thought it was fixed but it doesn't sounds like it | 23:13 |
| honza | anyone know what could cause docker pull issues on the containerized undercloud? | 23:14 |
| EmilienM | https://review.openstack.org/#/c/509001/ should have fixed it I hoped | 23:14 |
| EmilienM | see https://bugs.launchpad.net/tripleo/+bug/1720793 | 23:14 |
| openstack | Launchpad bug 1720793 in tripleo "create_admin_via_nova returns before the ssh key is installed on all nodes" [High,Fix released] - Assigned to Giulio Fidente (gfidente) | 23:14 |
| EmilienM | it's exactly this trace ^ | 23:14 |
| weshay|ruck | EmilienM, that didn't happen in the last build | 23:14 |
| weshay|ruck | honza, is it pulling from docker.io or rdo registry | 23:15 |
| EmilienM | weshay|ruck: what do you mean sorry? | 23:15 |
| honza | weshay|ruck: 2017-10-24 18:57:25,920 ERROR: 11739 -- Failed to pull image: 172.19.0.2:8787/tripleoupstream/centos-binary-neutron-server:latest connection refused | 23:15 |
| weshay|ruck | EmilienM, just checking if that ceph issue was happening previously.. it wasn't | 23:15 |
| EmilienM | weshay|ruck: ah ok | 23:15 |
| EmilienM | weshay|ruck: but to which step did we go previously? | 23:16 |
| weshay|ruck | honza, oh.. from the undercloud.. so that error is in the deploy | 23:16 |
| weshay|ruck | overcloud | 23:16 |
| EmilienM | weshay|ruck: did we reach the overcloud step 2? | 23:16 |
| weshay|ruck | EmilienM, it hit tempest this morning at 3am | 23:16 |
| weshay|ruck | EmilienM, previous build https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/106/console | 23:16 |
| EmilienM | weshay|ruck: weird | 23:17 |
| *** bobh has joined #tripleo | 23:17 | |
| EmilienM | weshay|ruck: did you have https://review.openstack.org/#/c/513031 ? | 23:17 |
| * weshay|ruck looks | 23:18 | |
| EmilienM | yeah let me look as well | 23:18 |
| *** bobh has quit IRC | 23:19 | |
| EmilienM | weshay|ruck: yes we did | 23:19 |
| EmilienM | weshay|ruck: i'm about to compare rpms | 23:20 |
| *** bobh has joined #tripleo | 23:21 | |
| *** liverpooler has joined #tripleo | 23:22 | |
| EmilienM | weshay|ruck: ansible 2.3 to ansible 2.4 | 23:22 |
| weshay|ruck | EmilienM, ah fack | 23:22 |
| EmilienM | docker upgrade | 23:22 |
| EmilienM | https://www.diffchecker.com/A6tho1sf | 23:22 |
| EmilienM | a bunch of things since 3am :D | 23:22 |
| weshay|ruck | that just hit pike, they have it fixed internal | 23:23 |
| EmilienM | weshay|ruck: I would file a bug now | 23:23 |
| EmilienM | weshay|ruck: and email fultonj + gfidente at minimum | 23:23 |
| EmilienM | weshay|ruck: with the links I pasted | 23:23 |
| weshay|ruck | EmilienM, ya.. looking for the issue | 23:23 |
| EmilienM | https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/0c1149a/undercloud/var/log/mistral/ceph-install-workflow.log.txt.gz#_2017-10-24_22_56_58_858 | 23:24 |
| EmilienM | that's the issue ^ | 23:24 |
| *** tosky has quit IRC | 23:33 | |
| weshay|ruck | need reviews https://review.openstack.org/#/c/514584/ | 23:36 |
| *** weshay|ruck is now known as weshay|PTO | 23:38 | |
| honza | aha, switching to rdo images (containers-rdo.yaml) works | 23:39 |
| *** bobh has quit IRC | 23:49 | |
| *** bfournie has joined #tripleo | 23:54 | |
| *** bfournie has quit IRC | 23:56 | |
| *** tbarron|bbl is now known as tbarron | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!