*** rbrady-afk has quit IRC | 00:01 | |
*** ooolpbot has joined #tripleo | 00:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
---|---|---|
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 00:10 |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 00:10 |
*** ooolpbot has quit IRC | 00:10 | |
*** bana_k has quit IRC | 00:18 | |
*** flepied has joined #tripleo | 00:19 | |
*** thrash is now known as thrash|g0ne | 00:31 | |
*** zoli|gone is now known as zoli_gone-proxy | 00:36 | |
*** lblanchard has joined #tripleo | 00:45 | |
*** bfournie has joined #tripleo | 00:53 | |
*** limao has joined #tripleo | 00:56 | |
*** jkilpatr has quit IRC | 01:04 | |
*** [1]cdearborn has quit IRC | 01:05 | |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 01:10 |
*** cwolferh has quit IRC | 01:22 | |
*** jerrygb_ has joined #tripleo | 01:30 | |
*** jerrygb has quit IRC | 01:31 | |
*** maticue has quit IRC | 01:32 | |
*** spredzy has quit IRC | 01:41 | |
*** spredzy has joined #tripleo | 01:42 | |
*** jerrygb has joined #tripleo | 01:45 | |
*** jerrygb_ has quit IRC | 01:45 | |
*** rhallisey has quit IRC | 01:52 | |
*** jerrygb has quit IRC | 01:59 | |
*** jerrygb has joined #tripleo | 01:59 | |
*** lblanchard has quit IRC | 02:04 | |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 02:10 |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
*** michapma_alt has joined #tripleo | 02:11 | |
*** fzdarsky_ has joined #tripleo | 02:15 | |
*** bana_k has joined #tripleo | 02:16 | |
*** jerrygb has quit IRC | 02:17 | |
*** jerrygb has joined #tripleo | 02:18 | |
*** fzdarsky has quit IRC | 02:18 | |
*** jerrygb has quit IRC | 02:22 | |
*** dmacpher-afk is now known as dmacpher | 02:33 | |
openstackgerrit | zhongshengping proposed openstack/puppet-tripleo: Fix puppet version for requirements in metadata https://review.openstack.org/393048 | 02:37 |
*** artom has quit IRC | 02:47 | |
*** bkopilov has quit IRC | 02:51 | |
*** kjw3 has joined #tripleo | 02:52 | |
*** bana_k has quit IRC | 02:55 | |
*** jerrygb has joined #tripleo | 02:59 | |
*** dmacpher has quit IRC | 03:07 | |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 03:10 |
*** saneax-_-|AFK is now known as saneax | 03:15 | |
openstackgerrit | Ben Kero proposed openstack/diskimage-builder: useless test commit. Cubs win. https://review.openstack.org/393059 | 03:18 |
openstackgerrit | Ben Kero proposed openstack/diskimage-builder: useless test commit. Cubs win. https://review.openstack.org/393059 | 03:19 |
*** dmacpher has joined #tripleo | 03:20 | |
openstackgerrit | Ben Kero proposed openstack/diskimage-builder: useless test commit. Cubs win. https://review.openstack.org/393059 | 03:23 |
openstackgerrit | Ben Kero proposed openstack/diskimage-builder: useless test commit. Cubs win. https://review.openstack.org/393059 | 03:25 |
openstackgerrit | Ben Kero proposed openstack/diskimage-builder: useless test commit. Cubs win. https://review.openstack.org/393059 | 03:26 |
*** limao has quit IRC | 03:28 | |
*** limao has joined #tripleo | 03:29 | |
bkero | Sorry guys | 03:32 |
openstackgerrit | Ben Kero proposed openstack/diskimage-builder: useless test commit. Cubs win. https://review.openstack.org/393059 | 03:32 |
*** limao has quit IRC | 03:33 | |
openstackgerrit | Ben Kero proposed openstack/diskimage-builder: useless test commit. Cubs win. https://review.openstack.org/393059 | 03:33 |
*** rbrady-afk has joined #tripleo | 03:53 | |
*** coolsvap has joined #tripleo | 03:55 | |
beagles | I guess someone's happy with the outcome of a certain game | 03:58 |
*** jerrygb has quit IRC | 03:59 | |
*** jerrygb has joined #tripleo | 04:01 | |
*** links has joined #tripleo | 04:01 | |
bkero | >_> | 04:02 |
openstackgerrit | zhongshengping proposed openstack/puppet-tripleo: Fix puppet version for requirements in metadata https://review.openstack.org/393081 | 04:03 |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 04:10 |
*** bkopilov has joined #tripleo | 04:10 | |
*** rlandy has quit IRC | 04:12 | |
*** bana_k has joined #tripleo | 04:19 | |
*** absubram_ has joined #tripleo | 04:25 | |
*** saneax is now known as saneax-_-|AFK | 04:27 | |
*** jerrygb_ has joined #tripleo | 04:28 | |
*** absubram_ is now known as absubram | 04:28 | |
*** jerrygb has quit IRC | 04:29 | |
*** Vijayendra has joined #tripleo | 04:43 | |
*** jerrygb has joined #tripleo | 04:44 | |
*** jerrygb_ has quit IRC | 04:45 | |
*** bana_k has quit IRC | 04:46 | |
*** absubram has quit IRC | 04:46 | |
jidar | just got this: checkmodule: Module name ironic-ipxe is different than the output base filename ipxe | 04:48 |
jidar | :( | 04:48 |
*** akshai has quit IRC | 04:54 | |
*** sudipto has joined #tripleo | 04:55 | |
*** sudipto_ has joined #tripleo | 04:55 | |
*** jerrygb_ has joined #tripleo | 04:59 | |
*** jerrygb has quit IRC | 04:59 | |
*** cwolferh has joined #tripleo | 05:04 | |
*** rlandy has joined #tripleo | 05:07 | |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 05:10 |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
*** tzumainn has quit IRC | 05:13 | |
*** jerrygb_ has quit IRC | 05:15 | |
*** jerrygb has joined #tripleo | 05:15 | |
*** ramishra has quit IRC | 05:19 | |
*** ramishra has joined #tripleo | 05:28 | |
*** masco has joined #tripleo | 05:28 | |
*** jerrygb has quit IRC | 05:33 | |
*** jerrygb has joined #tripleo | 05:33 | |
*** jerrygb has quit IRC | 05:33 | |
*** openstackgerrit has quit IRC | 05:48 | |
*** openstackgerrit has joined #tripleo | 05:48 | |
*** limao has joined #tripleo | 05:50 | |
*** limao has quit IRC | 05:56 | |
*** numans has joined #tripleo | 05:56 | |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 06:10 |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
*** rlandy has quit IRC | 06:14 | |
*** masco has quit IRC | 06:20 | |
*** ealcaniz has joined #tripleo | 06:21 | |
*** masco has joined #tripleo | 06:36 | |
*** afazekas has quit IRC | 06:40 | |
*** afazekas has joined #tripleo | 06:40 | |
*** saneax-_-|AFK is now known as saneax | 06:43 | |
*** yolanda has joined #tripleo | 06:51 | |
*** yolanda_ has joined #tripleo | 06:51 | |
*** yolanda_ has quit IRC | 06:52 | |
*** ebalduf has quit IRC | 06:54 | |
*** ealcaniz__ has joined #tripleo | 06:56 | |
*** florianf has joined #tripleo | 06:58 | |
*** ealcaniz has quit IRC | 06:58 | |
*** flaper87 has joined #tripleo | 07:00 | |
*** flaper87 has joined #tripleo | 07:00 | |
*** jtomasek has joined #tripleo | 07:01 | |
*** oshvartz has joined #tripleo | 07:04 | |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 07:10 |
*** chandankumar has joined #tripleo | 07:11 | |
*** cmyster has quit IRC | 07:13 | |
*** cmyster has joined #tripleo | 07:13 | |
*** tesseract has joined #tripleo | 07:14 | |
*** eggmaster has quit IRC | 07:14 | |
*** tesseract is now known as Guest25209 | 07:14 | |
*** chandankumar has quit IRC | 07:17 | |
*** chandankumar has joined #tripleo | 07:19 | |
*** lmiccini has joined #tripleo | 07:22 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Enable proxy headers parsing for Neutron https://review.openstack.org/393130 | 07:27 |
*** jprovazn has joined #tripleo | 07:28 | |
*** milan has joined #tripleo | 07:28 | |
*** jaosorior has joined #tripleo | 07:28 | |
openstackgerrit | Merged openstack/tripleo-validations: Validate rogue DHCP servers https://review.openstack.org/392858 | 07:32 |
openstackgerrit | Merged openstack/tripleo-validations: Add a validation-specific Ansible output callback https://review.openstack.org/392859 | 07:33 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Fixup the start of swift services https://review.openstack.org/392680 | 07:33 |
openstackgerrit | Merged openstack/tripleo-validations: Add the NoopFirewallDriver validation https://review.openstack.org/392860 | 07:34 |
openstackgerrit | Merged openstack/tripleo-validations: Validate haproxy configuration values https://review.openstack.org/392861 | 07:34 |
openstackgerrit | Merged openstack/tripleo-validations: Validation to verify connectivity to overcloud https://review.openstack.org/392862 | 07:34 |
openstackgerrit | Merged openstack/tripleo-validations: Validation to detect if undercloud disks use 512e https://review.openstack.org/392863 | 07:34 |
*** jerrygb has joined #tripleo | 07:34 | |
openstackgerrit | Merged openstack/tripleo-validations: Validate the IP range for the control plane https://review.openstack.org/392864 | 07:34 |
openstackgerrit | Merged openstack/tripleo-validations: Use custom CA cert with tripleo-ansible-inventory https://review.openstack.org/392867 | 07:34 |
*** rcernin has joined #tripleo | 07:34 | |
*** abehl has joined #tripleo | 07:35 | |
*** mhenkel has joined #tripleo | 07:39 | |
*** jerrygb has quit IRC | 07:39 | |
*** jtomasek_ has joined #tripleo | 07:41 | |
*** jtomasek has quit IRC | 07:41 | |
*** milan has quit IRC | 07:43 | |
*** liverpooler has joined #tripleo | 07:46 | |
*** openstackgerrit has quit IRC | 07:48 | |
*** openstackgerrit has joined #tripleo | 07:48 | |
*** fragatina has joined #tripleo | 07:53 | |
*** fragatina has quit IRC | 07:53 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Ensure heat-domain hiera is in nodes that contain keystone https://review.openstack.org/392519 | 07:53 |
*** fragatina has joined #tripleo | 07:53 | |
*** ccamacho has joined #tripleo | 07:54 | |
*** cylopez has joined #tripleo | 07:54 | |
*** chem has joined #tripleo | 07:59 | |
chem | marios: hi, for https://review.openstack.org/#/c/391873/6 (puppet haproxy orchestration) do you think the error is related, or is it good to go ? | 08:00 |
matbu | chem: hey, what's new ? | 08:00 |
jaosorior | chem: the error was unrelated | 08:00 |
jaosorior | chem: and that fix has been tested manually by Omri, that's why I did the +A | 08:01 |
*** penick has joined #tripleo | 08:01 | |
chem | jaosorior: ack, so just waiting for workflow then :) | 08:01 |
jaosorior | chem: there is a workflow already | 08:02 |
marios | o/ chem will look in a bit but don't think it is related no | 08:02 |
marios | (from yesterday when i looked i mean) | 08:02 |
chem | jaosorior: hehe, needed a refresh :) | 08:03 |
marios | chem: am looking at https://review.openstack.org/#/c/392593/ for the overcloudrc fix dougal did a great job yesterday but i am scared by +104 lines :( | 08:03 |
chem | matbu: the password world is destroying us ^ | 08:03 |
*** penick has quit IRC | 08:04 | |
matbu | marios: chem what's the news ? every things is burning during 3 days of ptos ? | 08:04 |
d0ugal | marios: Yeah, me too | 08:04 |
chem | matbu: yep | 08:04 |
d0ugal | marios: it is mostly comments at least. | 08:04 |
marios | matbu: the roof the roof the roof is on fire | 08:04 |
chem | marios: matbu YEAH !! | 08:04 |
matbu | marios: hehe i know this song | 08:04 |
matbu | burn mother fu**** burn | 08:04 |
jaosorior | well | 08:05 |
marios | lol good morning upgrades team | 08:05 |
d0ugal | lol | 08:05 |
jaosorior | the ovb gate ha gate has been broken for a few days | 08:05 |
jaosorior | and now it's broken with a different error as of today | 08:05 |
*** milan has joined #tripleo | 08:05 | |
d0ugal | jaosorior: Yeah, I was just looking at that and feeling confused. | 08:05 |
jaosorior | d0ugal: indeed | 08:06 |
chem | d0ugal: marios so I've to check my env to make sure patches were applied and all, but it look I still have the issue. We let you know in a few minutes. | 08:06 |
chem | d0ugal: for the passwords | 08:07 |
d0ugal | chem: damn :/ | 08:07 |
chem | d0ugal: nobody else could infirm or confirm ? | 08:07 |
d0ugal | chem: not that I know of | 08:08 |
marios | chem: ack thanks for check yeah we need to get this exercised asap (i may reset my env later, want to keep it for a bit longer to poke some more at the pingtest... for one, it has surfaced an important issue with the swift services https://review.openstack.org/#/c/392680/ | 08:08 |
chem | d0ugal: oki, I'll check the env to make sure the patch was applied and if you have 5 then I'll give you a screen to check it out ? | 08:08 |
d0ugal | chem: Sure, that would be useful - thanks. | 08:09 |
matbu | btw i will test the d0ugal review too | 08:09 |
marios | d0ugal: thanks very much for getting on this and sharing some of our pain | 08:09 |
chem | marios: hum ... nice that remind me of bz error about swift api trying to reach out another api, could it be related ? | 08:10 |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 08:10 |
*** jlinkes has joined #tripleo | 08:10 | |
marios | chem: could be i guess yu mean the gnochi swift backend one? but that is slightly different since it is before the swift services would normally be started | 08:11 |
chem | marios: nope I was thinking at https://bugzilla.redhat.com/show_bug.cgi?id=1389040#c11 | 08:12 |
openstack | bugzilla.redhat.com bug 1389040 in rhel-osp-director "[OSP-Director-10] upgrade from OSP 9 to OSP 10 fails because of stopped resources on the cluster failure when Overcloud with SSL ( during: UPGRADE CONTROLLER AND BLOCKSTORAGE)." [Urgent,Assigned] - Assigned to sathlang | 08:12 |
jaosorior | does anybody know how to query logs in logstash | 08:14 |
jaosorior | ? | 08:14 |
marios | chem: ah so it could be (your comment points at the swift services) but the bug is for cluster services being down and swift wouldn't be in pcs status anyway | 08:14 |
chem | marios: oki, nevermind | 08:15 |
marios | chem: i don't think we're checking for the swift services started so it wouldn't fail for it (i mean it went udpate complete for the controllers upgrade for me, just that the pingtest fails and that is what lead me to discover swift was down) | 08:15 |
*** ebarrera has joined #tripleo | 08:16 | |
*** aufi has joined #tripleo | 08:19 | |
*** jpena|off is now known as jpena | 08:20 | |
chem | d0ugal: so it seems the patch was applied ok and that the password from mistral and triple-undercloud-password are still different | 08:20 |
*** abregman has joined #tripleo | 08:22 | |
*** athomas has joined #tripleo | 08:22 | |
chem | marios: ack | 08:22 |
*** pblaho has joined #tripleo | 08:28 | |
*** yamahata has quit IRC | 08:32 | |
openstackgerrit | Merged openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/375125 | 08:32 |
*** jpena is now known as jpena|off | 08:32 | |
*** pblaho has quit IRC | 08:33 | |
*** amoralej|off is now known as amoralej | 08:35 | |
*** jpena|off is now known as jpena | 08:35 | |
openstackgerrit | Merged openstack/instack-undercloud: Increase the timeout for the default plan creation https://review.openstack.org/391373 | 08:36 |
openstackgerrit | Merged openstack/tripleo-heat-templates: gnocchi statsd should be able to send data to port 8125 https://review.openstack.org/392287 | 08:36 |
*** shardy has joined #tripleo | 08:36 | |
openstackgerrit | Merged openstack/instack-undercloud: Fix generated sample config https://review.openstack.org/391476 | 08:38 |
*** zoli_gone-proxy is now known as zoli|wfh | 08:38 | |
jaosorior | shardy: seems we now have a different CI failure | 08:39 |
jaosorior | mysql failing to stat | 08:39 |
jaosorior | *start | 08:39 |
* shardy sighs | 08:40 | |
shardy | Ok, any idea on the fix yet? | 08:40 |
jaosorior | shardy: no dude, I've been looking at it but I have no idea why this is happening | 08:40 |
jaosorior | shardy: actually, there is stuff in the logs for mysql... and no indication of an error there | 08:40 |
jaosorior | (the usual GSSAPI errors) | 08:41 |
jaosorior | shardy: http://logs.openstack.org/47/392647/6/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/bd3c40d/logs/postci.txt.gz#_2016-11-03_07_42_37_000 | 08:41 |
jaosorior | bandini: are there any logs generated by the clustercheck? | 08:42 |
bandini | jaosorior: well you usually will see that it failed via the pacemaker logs. what's the issue? | 08:44 |
jaosorior | see ^^ | 08:44 |
*** mandre has joined #tripleo | 08:44 | |
*** nyechiel has joined #tripleo | 08:45 | |
jaosorior | bandini: http://logs.openstack.org/47/392647/6/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/bd3c40d/logs/overcloud-controller-0/var/log/cluster/corosync.txt.gz | 08:45 |
* bandini looks | 08:46 | |
openstackgerrit | Merged openstack/puppet-tripleo: Make sure keepalived is restarted before haproxy. https://review.openstack.org/391873 | 08:47 |
jaosorior | bandini: this http://logs.openstack.org/47/392647/6/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/bd3c40d/logs/overcloud-controller-0/var/log/messages shows some suspicious stuff too | 08:47 |
jaosorior | Nov 3 07:09:36 localhost crmd[28923]: notice: Operation galera_start_0: unknown error (node=overcloud-controller-0, call=34, rc=1, cib-update=80, confirmed=true) | 08:48 |
bandini | jaosorior: what is the issue though, is galera not coming up? | 08:48 |
jaosorior | Nov 3 07:09:36 localhost crmd[28923]: notice: overcloud-controller-0-galera_start_0:34 [ cat: /var/lib/mysql/grastate.dat: No such file or directory\nocf-exit-reason:Unable to detect last known write sequence number\n ] | 08:48 |
jaosorior | Nov 3 07:09:36 localhost crmd[28923]: warning: Action 31 (galera_start_0) on overcloud-controller-0 failed (target: 0 vs. rc: 1): Error | 08:48 |
jaosorior | Nov 3 07:09:36 localhost crmd[28923]: warning: Action 31 (galera_start_0) on overcloud-controller-0 failed (target: 0 vs. rc: 1): Error | 08:48 |
jaosorior | Nov 3 07:09:36 localhost crmd[28923]: notice: Transition 16 (Complete=3, Pending=0, Fired=0, Skipped=0, Incomplete=2, Source=/var/lib/pacemaker/pengine/pe-input-16.bz2): Complete | 08:48 |
jaosorior | bandini: that appears to be the issue, yes | 08:48 |
bandini | ack | 08:48 |
jaosorior | Nov 3 07:09:18 localhost galera(galera)[7004]: INFO: MySQL is not running | 08:49 |
jaosorior | which is strange, cause I see mariadb logs O_o | 08:49 |
*** zoli|wfh is now known as zoli_gone-proxy | 08:49 | |
jaosorior | dciabrin: hey dude, does this say anything to you? http://paste.openstack.org/show/587727/ | 08:51 |
*** ohamada has joined #tripleo | 08:51 | |
bandini | jaosorior: so the "/var/lib/mysql/grastate.dat: No such file or directory\nocf-exit-reason:Unable to detect last known w" is actually harmless (although a bit misleading) | 08:52 |
jaosorior | bandini: alright, thanks for the clarification... but it still seems to be the issue that galera doesn't start :/ | 08:52 |
bandini | jaosorior: oh yes absolutely, am still looking | 08:52 |
*** jpich has joined #tripleo | 08:54 | |
bandini | dciabrin: around? | 08:55 |
*** hjensas has joined #tripleo | 08:56 | |
dciabrin | bandini, yep sorry was on a call | 08:57 |
bandini | dciabrin: bluejeans? | 08:57 |
dciabrin | yeah the "grastate.dat not there" is harmless. | 08:57 |
dciabrin | bandini, i'm calling you | 08:57 |
bandini | coming | 08:57 |
*** paramite has joined #tripleo | 09:00 | |
*** zoli_gone-proxy has quit IRC | 09:02 | |
*** jtomasek_ is now known as jtomasek | 09:02 | |
*** _milan_ has joined #tripleo | 09:04 | |
*** milan has quit IRC | 09:04 | |
*** tosky has joined #tripleo | 09:04 | |
*** hjensas has quit IRC | 09:05 | |
*** abehl has quit IRC | 09:06 | |
*** nijaba has quit IRC | 09:06 | |
*** hewbrocca_afk is now known as hewbrocca | 09:07 | |
bandini | jaosorior: am looking with dciabrin, will report back (note that also redis is not starting at all) | 09:07 |
jaosorior | bandini: panda|Zz was looking at that yesterday. | 09:08 |
jaosorior | bandini: that's a SELinux issue AFAIK | 09:08 |
bandini | jaosorior: ah yeah I thought that selinux was in permissive already | 09:08 |
bandini | I thought the workaround got merged. ok. | 09:09 |
jaosorior | bandini: it isn't yet | 09:09 |
bandini | can I blame it on lack of coffee? | 09:09 |
jaosorior | shardy: if you have time can you check this out? https://review.openstack.org/#/q/status:open+branch:master+topic:barbican-integration | 09:09 |
jaosorior | bandini: you can always blame it on the lack of coffee, that's what I do too :P | 09:09 |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 09:10 |
bandini | jaosorior: :) | 09:10 |
bandini | jaosorior: do we have some more info about when this galera issue has started to be observed? | 09:11 |
*** pblaho has joined #tripleo | 09:12 | |
shardy | jaosorior: None of the patches reference the blueprint :( | 09:13 |
shardy | https://blueprints.launchpad.net/tripleo/+spec/overcloud-barbican | 09:13 |
shardy | otherwise looks good | 09:13 |
jaosorior | shardy: I honestly didn't know there even was a blueprint | 09:13 |
shardy | Since https://review.openstack.org/#/c/352458/ landed can we declare that one complete? | 09:13 |
shardy | All features should have a blueprint (or a bug, or some way for us to track what is going into the release) | 09:14 |
jaosorior | shardy: well... kinda, there is still no configuration for cinder volume encryption | 09:14 |
jaosorior | which is the next in the list | 09:14 |
jaosorior | shardy: then we need a real backend for barbican, cause right now it's not for use in production | 09:14 |
*** nijaba has joined #tripleo | 09:15 | |
*** nijaba has quit IRC | 09:15 | |
*** nijaba has joined #tripleo | 09:15 | |
jaosorior | shardy: Ade is working on puppet manifests for dogtag, which is the most straight forward thing we could add as a backend as of now. | 09:15 |
shardy | jaosorior: if you have a moment could you please copy the list of patches into the BP whiteboard and perhaps link some list of what work remains? | 09:15 |
shardy | an etherpad or something would be fine, it's just so we have some chance of understanding the status | 09:15 |
jaosorior | shardy: will do | 09:16 |
jaosorior | shardy: added the patches to the whiteboard | 09:18 |
shardy | jaosorior: thanks! | 09:19 |
*** lucas-afk is now known as lucasagomes | 09:22 | |
jaosorior | shardy: updated the work items too | 09:22 |
shardy | great, thanks | 09:22 |
*** hjensas has joined #tripleo | 09:23 | |
*** hjensas has joined #tripleo | 09:23 | |
*** mcornea has joined #tripleo | 09:28 | |
*** dtantsur|afk is now known as dtantsur | 09:30 | |
*** derekh has joined #tripleo | 09:31 | |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Fix password handling for users upgrading from Mitaka https://review.openstack.org/392593 | 09:31 |
d0ugal | marios, chem: ^ updated, just tested and it worked. Doing another manual clean test now. | 09:33 |
bandini | jaosorior: so the issue is due to mariadb 10.1.18 (they changed the output of certain commands). still looking though | 09:34 |
chem | d0ugal: great :), will be able to do an upgrade test in ~30min | 09:35 |
*** jerrygb has joined #tripleo | 09:35 | |
jaosorior | bandini: seems that this issue is affecting stable/newton also | 09:35 |
jaosorior | shardy: ^^ | 09:35 |
* jaosorior is seriously considering just getting a morning beer given the circumstances | 09:36 | |
marios | d0ugal: thanks | 09:37 |
marios | jaosorior: breakfast blend | 09:37 |
jaosorior | lol | 09:37 |
bandini | jaosorior: did we push 10.1.18 in the stable/newton repos as well maybe? | 09:37 |
jaosorior | bandini: seems that yes mariadb-10.1.18-1.el7.x86_64 | 09:38 |
bandini | jaosorior: ok that would explain it. let us look a bit more in detail a little more and then I will recap | 09:39 |
jaosorior | bandini: you da man | 09:39 |
*** jerrygb has quit IRC | 09:41 | |
*** jaosorior is now known as jaosorior_lunch | 09:41 | |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Pass clients to get the get_password function https://review.openstack.org/393192 | 09:42 |
*** jpich has quit IRC | 09:45 | |
*** HoloIRCUser7 has joined #tripleo | 09:49 | |
openstackgerrit | Carl proposed openstack/os-cloud-config: Update homepage with developer documentation page https://review.openstack.org/393195 | 09:49 |
*** jpich has joined #tripleo | 09:49 | |
*** HoloIRCUser7 is now known as gfidente | 09:50 | |
*** limao has joined #tripleo | 09:50 | |
*** akrivoka has joined #tripleo | 09:52 | |
*** jerrygb has joined #tripleo | 09:58 | |
shadower | shardy: re: your comment in https://review.openstack.org/#/c/390854/ I'm for it but how would be do that? Can we pass a list as a param? | 09:58 |
sshnaidm | does anybody know when we stop running liberty jobs? | 09:59 |
shardy | shadower: yeah I was thinking just changing the type may work | 09:59 |
shardy | not a blocker, just wanted to ask the question before we commit to the interface :) | 09:59 |
shadower | shardy: yeah. To what? Is there a list type in Heat now? | 09:59 |
shardy | shadower: yes either comma_delimited_list or json types will accept lists (I'd suggest the former) | 10:00 |
shadower | right, I'll give it a go | 10:01 |
bandini | jaosorior_lunch: is there a bug where we can write our findings? | 10:02 |
*** jerrygb has quit IRC | 10:03 | |
bandini | I'll just go ahead and file one | 10:03 |
*** gfidente has quit IRC | 10:05 | |
openstackgerrit | Merged openstack/puppet-tripleo: Fix default for barbican documentation https://review.openstack.org/392119 | 10:07 |
*** panda|Zz is now known as panda | 10:08 | |
openstackgerrit | Anshul Jain proposed openstack/diskimage-builder: DIB element to support cinder local attach/detach functionality https://review.openstack.org/393206 | 10:09 |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 10:10 |
bandini | jaosorior_lunch, shardy: the galera breakage is recapped here: https://bugs.launchpad.net/tripleo/+bug/1638864 | 10:10 |
openstack | Launchpad bug 1638864 in tripleo "mariadb-10.1.18 breaks the resource agent" [Critical,New] | 10:10 |
bandini | I will ping haikel/alan on #rdo now | 10:11 |
openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient: Do not try to "provide" updated nodes not in "manageable" state https://review.openstack.org/392653 | 10:12 |
*** [1]cdearborn has joined #tripleo | 10:13 | |
chem | bandini: everyday mysql :) let's switch to postgres \o/ | 10:15 |
bandini | chem: ahaha amen to that ;) | 10:15 |
panda | bandini: is this the error message caused by the bug ? Could not prefetch mysql_user provider 'mysql': Execution of '/usr/bin/mysql -NBe SELECT CONCAT(User, '@',Host) AS User FROM mysql.user' returned 1: ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2 "No such file or directory")m | 10:16 |
bandini | panda: it could be, but that error is misleading in newton because you can see it in step1 as well there (and it is harmless) | 10:17 |
bandini | in ocata it got fixed, i.e. if you see it, it is serious | 10:17 |
panda | I see it in gate logs from 20 minutes ago for master | 10:19 |
*** _milan_ is now known as milan | 10:23 | |
chem | who is the swift master around here ? | 10:28 |
*** kjw3 has quit IRC | 10:29 | |
*** mgould|afk is now known as mgould | 10:29 | |
*** akrivoka has quit IRC | 10:31 | |
openstackgerrit | Anshul Jain proposed openstack/diskimage-builder: DIB element to support cinder local attach/detach functionality https://review.openstack.org/385880 | 10:31 |
jpich | If folks have time for a short review, https://review.openstack.org/#/c/390612/ adds a missing password to the generated list in tripleo-common. This blocks deployments with Ceph from the UI | 10:37 |
*** thrash|g0ne is now known as thrash | 10:38 | |
*** links has quit IRC | 10:40 | |
bandini | panda: then it is related to the galera breakage we are working on | 10:42 |
*** mburned_out is now known as mburned | 10:44 | |
*** limao has quit IRC | 10:46 | |
*** ramishra has quit IRC | 10:50 | |
*** ramishra has joined #tripleo | 10:52 | |
*** rhallisey has joined #tripleo | 10:53 | |
*** akrivoka has joined #tripleo | 10:54 | |
*** milan has quit IRC | 10:54 | |
*** sudipto has quit IRC | 10:56 | |
*** sudipto_ has quit IRC | 10:56 | |
jtomasek | shardy: Heat is now able to accept list of environments rather single one, right? | 10:56 |
d0ugal | matbu: Hey, I seen your comment on https://review.openstack.org/#/c/392593 | 10:56 |
d0ugal | matbu: The Heat stack doesn't exist? | 10:56 |
d0ugal | in an upgrade does it get re-created? or am I just confused? | 10:57 |
shardy | jtomasek: yes it is, but I think we've got a bug in tripleoclient atm which means they still get merged in the client | 11:00 |
jtomasek | shardy: yep, ok | 11:01 |
*** adarazs is now known as adarazs_lunch | 11:01 | |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Fix password handling for users upgrading from Mitaka https://review.openstack.org/392593 | 11:01 |
shardy | jtomasek: https://review.openstack.org/#/c/390064/ may have helped with that, I'll recheck https://review.openstack.org/#/c/384618/ to find out | 11:02 |
shardy | regardless we do want to allow server side merging of environments, so we'll need to figure out the fix pretty soon | 11:02 |
*** tremble has joined #tripleo | 11:04 | |
*** akshai has joined #tripleo | 11:08 | |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638864 | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 11:10 |
openstack | Launchpad bug 1638864 in tripleo "mariadb-10.1.18 breaks the resource agent" [Critical,New] - Assigned to Michele Baldessari (michele) | 11:10 |
*** akshai_ has joined #tripleo | 11:11 | |
*** absubram has joined #tripleo | 11:13 | |
*** absubram_ has joined #tripleo | 11:14 | |
*** akshai has quit IRC | 11:14 | |
chem | d0ugal: hum ... I would contradict matbu comment ... the stack is not none at this point and it seems to be the decent thing to make sure we're doing an upgrade ... | 11:16 |
chem | d0ugal: doing pdb using patch 10 | 11:16 |
*** dprince has joined #tripleo | 11:16 | |
*** absubram has quit IRC | 11:17 | |
*** absubram_ is now known as absubram | 11:17 | |
tosky | ccamacho: question about https://review.openstack.org/#/c/392670/ and more generally about the values specified for configuration keys | 11:18 |
tosky | ccamacho: right now, and also after the patch, a value is always passed to the key; also with an empty list, does it mean that the key will have an empty value? | 11:19 |
tosky | And more important, is it possible to say "do not override the existing value" or is it the general pattern (always write a value)? | 11:19 |
*** akrivoka has quit IRC | 11:21 | |
*** mburned is now known as mburned_out | 11:21 | |
*** jkilpatr has joined #tripleo | 11:24 | |
*** mburned_out is now known as mburned | 11:25 | |
ccamacho | hey tosky, in https://github.com/openstack/puppet-sahara/blob/master/manifests/init.pp#L40 the plugin list is defaulted to $::os_service_default so it wont be configured at all by puppet if not defined, now in THT we have hardwired the plugin list so it will always be configured, now the new parameter added in https://review.openstack.org/#/c/392670/ enables you to override it in case you want to customize it. | 11:25 |
ccamacho | tosky but im not getting this "also with an empty list" | 11:26 |
leifmadsen | trying to deploy to some baremetal with TripleO Newton (via RDO) and running into this issue: https://paste.fedoraproject.org/469424/72038147/ | 11:26 |
ccamacho | the list is filled with ["ambari","cdh","mapr","vanilla","spark","storm"] | 11:26 |
ccamacho | right? | 11:26 |
tosky | ccamacho: if I override it, and I pass an empty list, will it end up with 'plugins=' ? | 11:26 |
*** jerrygb has joined #tripleo | 11:26 | |
leifmadsen | Message: No valid host was found. There are not enough hosts available., Code: 500 | 11:27 |
ccamacho | tosky aaa yeahp | 11:27 |
tosky | ccamacho: and is there a way to override that so that the final result is like $::os_service_default (aka untouched)? | 11:27 |
ccamacho | tosky I see your point now | 11:27 |
ccamacho | let me check | 11:27 |
shardy | leifmadsen: that's a catch-all error Nova gives when it can't find a node to schedule, you need to figure out why it can't schedule a node: | 11:28 |
shardy | http://docs.openstack.org/developer/tripleo-docs/troubleshooting/troubleshooting.html#no-valid-host-found-error | 11:28 |
shardy | normally it's a problem with the node tagging or flavors | 11:28 |
leifmadsen | shardy: thanks! will continue debugging (I wasn't sure where to really start debugging) | 11:28 |
shardy | looking at the nova log on the undercloud may give you some clues | 11:29 |
leifmadsen | shardy: yea that was my first thought, but everything "looks" legit... | 11:29 |
*** links has joined #tripleo | 11:30 | |
leifmadsen | hrmmm... well this is basically all the things I looked at yesterday... nodes are marked available, nodes have capabilities set to the proper flavor, nothing in maintenance, and the properties indicate all resources are above the flavor requirements | 11:32 |
*** ealcaniz__ has quit IRC | 11:33 | |
*** akrivoka has joined #tripleo | 11:34 | |
chem | d0ugal: matbu with the patchset 10 I've got consistent result. ie, the mistral environment and the tripleo-overcloud-password are in sync | 11:37 |
ccamacho | tosky I was trying to get a workaround but the param will be defaulted as a general pattern.. Ill add a note to see if when making some tests I can try to get it untouched. | 11:42 |
tosky | ccamacho: what is the general pattern about this? I mean, are there other keys where it is possible to force the default value, or is it simply something that does not happen? | 11:43 |
*** jaosorior_lunch is now known as jaosorior | 11:44 | |
*** zoliXXL is now known as zoli|lunch | 11:44 | |
jaosorior | panda: hey dude, did you get the selinux patch to work? | 11:47 |
*** kjw3 has joined #tripleo | 11:48 | |
*** ealcaniz__ has joined #tripleo | 11:49 | |
slagle | bandini: are the rdo crew working on an updated mariadb package? | 11:49 |
bandini | slagle: I will be submitting a pull request for the revert in a couple of mins | 11:50 |
bandini | just testing the new package now | 11:50 |
slagle | cool, thx | 11:50 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Hiera optimization: use a new hiera hook https://review.openstack.org/384757 | 11:50 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Horizon service cleanups for hiera json hook https://review.openstack.org/393258 | 11:50 |
ccamacho | tosky IMHO that logic should live in the puppet modules, i.e. if we define a list to configure the parameter then use that list, then if configured to i.e "" then default to $::os_service_default | 11:51 |
ccamacho | might be working like that when defaulting to "" use $::os_service_default but to be sure we need to check how sahara/p-sahara is handling that parameter | 11:53 |
d0ugal | chem: Great! | 11:54 |
chem | d0ugal: hold on I'm adding a review with a slight refactoring ... | 11:54 |
tosky | ccamacho: this is the (usual?) problem of having "" and NULL that represent different behaviors | 11:55 |
EmilienM | hello | 11:55 |
tosky | ccamacho: now, in this case having "plugins=" means no plugins => useless sahara, so probably it's not a realistic scenario and we could decide to remap that value to ::os_service_default | 11:55 |
*** oshvartz has quit IRC | 11:55 | |
tosky | ccamacho: but in general, how can it be solved? | 11:55 |
EmilienM | do we have progress on CI and ovb-ha job? | 11:56 |
openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Pass clients to get the get_password function https://review.openstack.org/393192 | 11:57 |
*** jpena is now known as jpena|lunch | 11:57 | |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Horizon service cleanups for hiera json hook https://review.openstack.org/393258 | 11:57 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Hiera optimization: use a new hiera hook https://review.openstack.org/384757 | 11:57 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Neutron L3 service cleanups for hiera json hook https://review.openstack.org/393262 | 11:57 |
*** bfournie has quit IRC | 12:00 | |
*** oshvartz has joined #tripleo | 12:00 | |
*** oshvartz has quit IRC | 12:01 | |
*** oshvartz has joined #tripleo | 12:01 | |
*** mburned is now known as mburned_out | 12:01 | |
*** bfournie1 has joined #tripleo | 12:02 | |
*** bkopilov has quit IRC | 12:02 | |
panda | EmilienM: on the contrary | 12:03 |
*** absubram has quit IRC | 12:06 | |
chem | d0ugal: I've put my review ... maybe we let matbu answer before doing anything ? | 12:08 |
*** maticue has joined #tripleo | 12:08 | |
EmilienM | panda: what? more things are broken? | 12:09 |
jaosorior | EmilienM: there was an issue with the newer version of mariadb | 12:09 |
jaosorior | EmilienM: it's being worked on, and there will be a another release of mariadb soon. | 12:09 |
jaosorior | EmilienM: https://bugs.launchpad.net/tripleo/+bug/1638864 | 12:10 |
openstack | Launchpad bug 1638864 in tripleo "mariadb-10.1.18 breaks the resource agent" [Critical,New] - Assigned to Michele Baldessari (michele) | 12:10 |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638864 | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 12:10 |
*** jayg|g0n3 is now known as jayg | 12:10 | |
EmilienM | panda: ok I see the mariadb thing now | 12:11 |
panda | jaosorior: testing locally .. but it's taking some time .. | 12:12 |
jaosorior | panda: what are you testing locally? | 12:12 |
panda | jaosorior: selinux patch | 12:13 |
jaosorior | panda: aa right! | 12:15 |
matbu | d0ugal: chem back from lunch | 12:18 |
matbu | d0ugal: chem /me reads back | 12:18 |
jkilpatr | anyone else seeing this on newton Exception registering nodes: No valid host was found. Reason: No conductor service registered which supports driver pxe_ipmitool | 12:18 |
matbu | chem: d0ugal when i do a orchestration_client.stacks.get('overcloud') | 12:19 |
matbu | it return a ** HTTPNotFound: ERROR: The Stack (overcloud) could not be found. | 12:20 |
matbu | chem: does the #10 patchset works on your env ? | 12:20 |
chem | matbu: yep so it seems. I'm reverting a backup of a non upgraded env to make sure | 12:20 |
EmilienM | beagles: re: backports - are you going to submit them or/and do you need help? | 12:21 |
chem | matbu: and if you look down the file the exactly the code they use to check if creation vs upgrade. | 12:21 |
matbu | chem: hmm i think if you stack is not None, it because you already make an upgrade step | 12:21 |
*** adarazs_lunch is now known as adarazs | 12:21 | |
matbu | chem: i tried the review just right after the UC upgrade | 12:22 |
*** gfidente has joined #tripleo | 12:23 | |
bandini | slagle: I have updated the mariadb LP bug and created a pull request. haikel is looking at it | 12:23 |
chem | matbu: hum ... so give me some time (~5min) to have my env reverted to the undercloud upgrade step and I will test it again. | 12:23 |
chem | d0ugal: ^ | 12:23 |
bandini | slagle: I am not sure what I need to do once the package is built and ready to get them in the right repos/images though | 12:23 |
beagles | EmilienM: I'll do it. I initially sent the email thinking folks might chime in on whether they were necessary, but realized right after I hit send that if someone felt that it wasn't appropriate they can just nix the patch on review :) | 12:23 |
matbu | chem: k | 12:24 |
chem | matbu: d0ugal actually gives me 15 min I have to grab some food | 12:24 |
*** kjw3 has quit IRC | 12:24 | |
EmilienM | beagles: excellent | 12:24 |
EmilienM | panda, bandini: is it why stable/newton also fail? (mariadb) | 12:25 |
bandini | EmilienM: yes. mariadb-10.1.18 is broken and was pushed to newton as well | 12:25 |
matbu | chem: no pb | 12:25 |
EmilienM | bandini: :( | 12:26 |
*** fultonj_ has quit IRC | 12:26 | |
*** pkovar has joined #tripleo | 12:26 | |
bandini | EmilienM: I sent haikel a pull request to fix things up and he is on it | 12:26 |
bandini | https://github.com/rdo-common/mariadb/pull/2 ftr | 12:26 |
EmilienM | bandini: yeah I saw, nice. Thanks! | 12:27 |
bandini | EmilienM: I am not sure if anything else needs to be done once we have the package? | 12:28 |
weshay | sshnaidm, can you please rekick the master periodic to see where we are at w/ a new pin | 12:28 |
EmilienM | bandini: is the package build in cbs and synced in buildlogs? | 12:29 |
*** masco has quit IRC | 12:29 | |
*** rbrady-afk is now known as rbrady | 12:29 | |
EmilienM | bandini: http://buildlogs.centos.org/centos/7/cloud/x86_64/openstack-ocata/common/?C=M;O=D | 12:29 |
sshnaidm | weshay, yeah, sure | 12:29 |
EmilienM | bandini: what package is it again? | 12:29 |
weshay | looks like the last non-ha master job passed | 12:30 |
*** rbrady has quit IRC | 12:30 | |
*** rbrady has joined #tripleo | 12:30 | |
*** jerrygb has quit IRC | 12:30 | |
bandini | EmilienM: the fixed one will be called mariadb-10.1.18-2.el7 (the broken one is mariadb-10.1.18-1.el7) | 12:30 |
EmilienM | weshay: afik it doesn't use galera, so it's normal | 12:30 |
bandini | not sure where we are with the build | 12:30 |
openstackgerrit | Tomas Sedovic proposed openstack/tripleo-heat-templates: Add an optional extra node admin ssh key parameter https://review.openstack.org/390854 | 12:31 |
*** rlandy has joined #tripleo | 12:31 | |
d0ugal | chem: sure, I was just getting food too, so ready when you are | 12:34 |
openstackgerrit | Ana Krivokapic proposed openstack/tripleo-ui: Refactor *DriverFields components https://review.openstack.org/393289 | 12:34 |
EmilienM | beagles: thx a lot for taking care of them | 12:34 |
*** lucasagomes is now known as lucas-hungry | 12:35 | |
EmilienM | bandini: ok so number80 is doing the build for cbs, once it's done, we have to wait for a sync (less than one hour usually) and see it in http://buildlogs.centos.org/centos/7/cloud/x86_64/openstack-ocata/common/ | 12:35 |
beagles | EmilienM: no prob | 12:35 |
EmilienM | bandini: when we see the new package in http://buildlogs.centos.org/centos/7/cloud/x86_64/openstack-ocata/common/?C=M;O=D - problem solved | 12:35 |
*** jeckersb is now known as jeckersb_gone | 12:36 | |
*** fultonj has joined #tripleo | 12:37 | |
bandini | EmilienM: I see, so nothing else needed on our part, the push of the package in the ocata/newton repos is magic done by the RDO overlords, correct? | 12:37 |
EmilienM | bandini: yes | 12:38 |
bandini | EmilienM: ack, thanks! | 12:39 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Correct opencontrail hiera interpolation key https://review.openstack.org/393292 | 12:39 |
*** dtantsur is now known as dtantsur|brb | 12:41 | |
*** pradk has joined #tripleo | 12:43 | |
openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Pass clients to get the get_password function https://review.openstack.org/393192 | 12:43 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: gnocchi statsd should be able to send data to port 8125 https://review.openstack.org/393296 | 12:47 |
jaosorior | pradk: you preferably need a filed bug in order to do backports | 12:48 |
pradk | sure will do now | 12:48 |
*** ccamacho is now known as ccamacho|lunch | 12:49 | |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: gnocchi statsd should be able to send data to port 8125 https://review.openstack.org/393296 | 12:50 |
sshnaidm | weshay, I see there is big request for tempest statistics.. | 12:52 |
*** mburned_out is now known as mburned | 12:53 | |
*** rbrady has quit IRC | 12:54 | |
*** david-lyle has quit IRC | 12:55 | |
*** tzumainn has joined #tripleo | 12:57 | |
*** jpena|lunch is now known as jpena | 12:59 | |
*** zoli|lunch is now known as zoli|wfh | 13:01 | |
weshay | sshnaidm, heh | 13:02 |
*** jcoufal has joined #tripleo | 13:04 | |
*** kjw3 has joined #tripleo | 13:05 | |
*** shardy is now known as shardy_lunch | 13:05 | |
*** maeca1 has joined #tripleo | 13:06 | |
chem | matbu: so just after undercloud upgrade, before ceilometer migration I still get a non None stack variable | 13:06 |
*** rbrady has joined #tripleo | 13:08 | |
*** artom has joined #tripleo | 13:09 | |
*** paramite has quit IRC | 13:09 | |
*** ooolpbot has joined #tripleo | 13:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638864 | 13:10 |
*** ooolpbot has quit IRC | 13:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 13:10 |
openstack | Launchpad bug 1638864 in tripleo "mariadb-10.1.18 breaks the resource agent" [Critical,New] - Assigned to Michele Baldessari (michele) | 13:10 |
jrist | d0ugal, rbrady - are you guys aware of some of the mistral needs in https://etherpad.openstack.org/p/gui-ocata ? | 13:10 |
jrist | d0ugal, rbrady - specifically line 75 | 13:10 |
d0ugal | jrist: sort-of. | 13:10 |
*** jerrygb has joined #tripleo | 13:10 | |
jrist | d0ugal: is that formal enough to have you run with it? :) | 13:11 |
d0ugal | jrist: A number of them will have impacts, some are not particularly clear. | 13:11 |
d0ugal | jrist: I guess we need to go through them and ask questions where we need further details. | 13:11 |
d0ugal | jrist: but I'm focused on newton bug fixing ATM | 13:12 |
tzumainn | d0ugal, hi! just wanted to let you know your in-progress documentation helped me a ton | 13:12 |
jrist | d0ugal: line 105 | 13:12 |
d0ugal | tzumainn: Great :) | 13:12 |
jrist | d0ugal: ok thanks | 13:12 |
tzumainn | I've run successful tests calling the mistral actions and workflows from ruby, and things look good! | 13:12 |
d0ugal | jrist: 105 can be deleted AFAIK | 13:12 |
jrist | d0ugal: !!! | 13:13 |
d0ugal | tzumainn: Neat. I'd be interested in seeing that code at some point | 13:13 |
tzumainn | d0ugal, sure, any time! | 13:13 |
d0ugal | jrist: post config is deprecated, it is only used for upgrades from mitaka to newton at this point I think | 13:13 |
d0ugal | jrist: and I don't think the UI does upgrades, yet? | 13:14 |
*** pradk has quit IRC | 13:14 | |
jrist | it's going to have to .............................. | 13:14 |
d0ugal | jrist: when? | 13:15 |
jrist | next version! | 13:15 |
rbrady | jrist: I think it's important we get more detail. In the case of line 75, it would be good to know what message you're looking for | 13:15 |
jpich | d0ugal: Yeah your docs have helped me too, for parameters etc :-) Thank you! | 13:15 |
d0ugal | jpich: yw | 13:15 |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci: Reducing a few minutes from the job timeout to save the logs https://review.openstack.org/393309 | 13:15 |
jrist | rbrady: sure | 13:15 |
jrist | rbrady: so that's a no? :) | 13:15 |
rbrady | jrist: yeah, that's a no. | 13:16 |
jrist | damnit rbrady | 13:16 |
jrist | :) | 13:16 |
rbrady | jrist: I'll need it specific and measurable enough that we don't have to change it completely once it's landed | 13:17 |
rbrady | jrist: ) | 13:17 |
jrist | LOL | 13:17 |
owalsh | EmilienM: hi, I'd like to get this bp approved before the ocata-1 deadline https://blueprints.launchpad.net/tripleo/+spec/tripleo-realtime | 13:18 |
*** abregman is now known as abregman|afk | 13:18 | |
EmilienM | owalsh: you need to bring some love to https://review.openstack.org/#/c/388162/ - rebase/address reviews) | 13:18 |
openstackgerrit | John Fulton proposed openstack/tripleo-specs: Integrate TripleO with Tendrl for External Storage Deployment/Management https://review.openstack.org/387631 | 13:19 |
*** pradk has joined #tripleo | 13:20 | |
tzumainn | d0ugal, one question - is there no longer a 'get' for a plan, just list/various kinds of updates/delete? | 13:21 |
*** jerrygb_ has joined #tripleo | 13:21 | |
owalsh | EmilienM: yes, still working out the details to address reviews | 13:22 |
*** jerrygb has quit IRC | 13:22 | |
*** paramite has joined #tripleo | 13:22 | |
*** milan has joined #tripleo | 13:22 | |
owalsh | EmilienM: anything else required? (I see you are about to go on PTO) | 13:22 |
d0ugal | tzumainn: you can list the plans, I don't think there is anything to get a full plan in one go yet | 13:23 |
fultonj | owalsh: I see it has a merge conflict, so you'll need to rebase it, basically you'd get rid on index.rst and just commit the tripleo-realtime.rst | 13:23 |
d0ugal | tzumainn: if you add a comment to the review I'll add how to get a plan in the next update | 13:23 |
owalsh | fultonj: yes, I expected a conflict, will rebase it now | 13:23 |
fultonj | owalsh: then asnwer Pradeep's questions | 13:23 |
tzumainn | d0ugal, I don't personally need that functionality, was just curious! | 13:24 |
d0ugal | tzumainn: okay :) | 13:24 |
fultonj | owalsh: and see if your answers are sufficient for him to not -1 it anymore. others may then comment once it's past jenkins -1 from the merge conflict | 13:24 |
d0ugal | tzumainn: I think there is a plan (maybe even a bug somehwere) to add a plan export function. I guess that is what you want? | 13:25 |
d0ugal | or, what you are pondering. | 13:25 |
tzumainn | d0ugal, 'pondering', yes, a weighty matter to be considered indeed | 13:25 |
tzumainn | d0ugal, lol, but I was mostly just curious! | 13:25 |
owalsh | fultonj: ok, still working out the details. Was blocked by lack of hardware until now | 13:25 |
*** amoralej is now known as amoralej|lunch | 13:25 | |
fultonj | not sure if others will review it in -1 from jenkins, at least that's what happens with code. | 13:25 |
fultonj | AFAICT | 13:25 |
owalsh | fultonj: ok, thanks | 13:28 |
*** sudipto_ has joined #tripleo | 13:28 | |
*** sudipto has joined #tripleo | 13:28 | |
*** Goneri has joined #tripleo | 13:29 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci: Reducing a few minutes from the job timeout to save the logs https://review.openstack.org/393309 | 13:29 |
*** dtantsur|brb is now known as dtantsur | 13:30 | |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-specs: Real-time compute nodes https://review.openstack.org/388162 | 13:33 |
*** lucas-hungry is now known as lucasagomes | 13:35 | |
*** jeckersb_gone is now known as jeckersb | 13:35 | |
jaosorior | EmilienM: could you check this backport? https://review.openstack.org/#/c/393130/ | 13:36 |
EmilienM | jaosorior: sure but until CI is green again, I don't want us to merge anything except if it's fixing one of our problems | 13:37 |
jaosorior | ok | 13:37 |
EmilienM | jaosorior: it should be back stable once we have mariadb new rpm in a few minutes | 13:37 |
jaosorior | EmilienM: thought that had happened already, my bad | 13:37 |
EmilienM | no pb | 13:37 |
EmilienM | jaosorior: once we have new rpm in http://buildlogs.centos.org/centos/7/cloud/x86_64/openstack-ocata/common/?C=M;O=D | 13:37 |
EmilienM | we can recheck | 13:37 |
EmilienM | jaosorior: I +2 your patch, once it pass CI you can approve it | 13:38 |
jaosorior | alright | 13:38 |
openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo: pacemaker/mysql: wait step 2 to remove default accounts https://review.openstack.org/393317 | 13:39 |
*** paramite has quit IRC | 13:39 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Include redis/mongo hiera when using pacemaker https://review.openstack.org/393318 | 13:41 |
fultonj | owalsh: i add a few comments to https://review.openstack.org/#/c/388162 | 13:46 |
owalsh | fultonj: tnx | 13:46 |
*** rodrigods has quit IRC | 13:46 | |
*** rodrigods has joined #tripleo | 13:46 | |
*** akshai_ has quit IRC | 13:46 | |
*** lblanchard has joined #tripleo | 13:47 | |
*** saneax is now known as saneax-_-|AFK | 13:49 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Remove duplicate metadata keys from nova-api.yaml https://review.openstack.org/393327 | 13:49 |
d0ugal | thrash: Do you know how to debug rpm builds done via tripleo.sh? | 13:51 |
*** ealcaniz__ has quit IRC | 13:51 | |
*** jprovazn has quit IRC | 13:51 | |
thrash | d0ugal: how do you mean? | 13:51 |
d0ugal | thrash: asking you because of the last line here: http://paste.openstack.org/show/587769/ | 13:51 |
thrash | d0ugal: i think that's based on the original maintainer of the rpm spec | 13:52 |
*** links has quit IRC | 13:52 | |
thrash | d0ugal: that would change depending on the package. | 13:52 |
d0ugal | thrash: aha | 13:52 |
thrash | d0ugal: although I do know a bit about rpm packaging. :) | 13:53 |
d0ugal | thrash: oh, I think I know what is up anyway | 13:53 |
thrash | d0ugal: ok. let me know | 13:53 |
d0ugal | thrash: I forgot that it ran the tests | 13:53 |
thrash | ahh | 13:53 |
*** pcaruana has joined #tripleo | 13:53 | |
*** paramite has joined #tripleo | 13:53 | |
*** bkopilov has joined #tripleo | 13:55 | |
*** jerrygb has joined #tripleo | 13:57 | |
chem | matbu: so did you have time to recheck the empty stack variable strangeness ? | 13:58 |
*** ebalduf has joined #tripleo | 13:58 | |
matbu | chem: yep, but looks like mistral is broken or in a weird state | 13:58 |
matbu | chem: idk why exactly | 13:59 |
bkreitch | hi, is there a way to make "openstack overcloud image build" to install rdo-release.rpm during image creation? export RDO_RELEASE=mitaka doesn't seem to help.. | 13:59 |
matbu | chem: did you restore your env ? | 13:59 |
rook-out | Hey all : when i see " Warning: Scope(Class[Nova]): Could not look up qualified variable '::nova::scheduler::filter::ram_allocation_ratio'; class ::nova::scheduler::filter has not been evaluated\ " | 13:59 |
chem | matbu: yep, I the stack wasn't empty just after the undercloud upgrade, during ceilometer migration | 13:59 |
rook-out | is that a puppet issue? | 13:59 |
*** jerrygb_ has quit IRC | 14:00 | |
matbu | chem: k, when you run the ceilometer ? | 14:02 |
chem | matbu: nope It's frozen in pdb :) | 14:02 |
*** amoralej|lunch is now known as amoralej | 14:03 | |
matbu | k, i'm restoring my env, maybe it was due to mistral, idk | 14:03 |
matbu | chem: but i'm fine w/ the #11 | 14:03 |
*** numans has quit IRC | 14:03 | |
matbu | lets see if i can reproduce | 14:03 |
chem | matbu: hum "w/" mean without or with ? | 14:04 |
dtrainor | I get so far in this deployment, and then hit "ERROR: Authentication failed: Authentication required". I'm not sure what's causing it. I'll re-deploy with --debug -vvvv for more info but in the mean time I wanted to see if anyone has experienced this one | 14:05 |
matbu | chem: with | 14:05 |
chem | matbu: well it kinda make sense to only trigger it if it's an upgrade/update and if the file exist, but all in all this should be true in both cases, just loosing some more cycles :) | 14:08 |
chem | matbu: both cases being with the upgrade check or without as the presence of the file should match this conditional. | 14:09 |
openstackgerrit | Joe Talerico proposed openstack/tripleo-heat-templates: ram_allocation_ratio was not being set to 1.0 https://review.openstack.org/393339 | 14:09 |
*** ooolpbot has joined #tripleo | 14:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638864 | 14:10 |
*** ooolpbot has quit IRC | 14:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 14:10 |
openstack | Launchpad bug 1638864 in tripleo "mariadb-10.1.18 breaks the resource agent" [Critical,New] - Assigned to Michele Baldessari (michele) | 14:10 |
chem | matbu: the other thing with keeping as it is, is that the tests need to be adjusted | 14:12 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Correct opencontrail hiera interpolation key https://review.openstack.org/393340 | 14:13 |
*** shardy_lunch is now known as shardy | 14:13 | |
*** hjensas has quit IRC | 14:14 | |
*** jprovazn has joined #tripleo | 14:14 | |
*** hjensas has joined #tripleo | 14:14 | |
matbu | chem: you mean UT ? | 14:15 |
chem | matbu: for unit testing I guess, then yes | 14:15 |
matbu | chem: k | 14:15 |
openstackgerrit | Luca Lorenzetto proposed openstack/diskimage-builder: Avoid disabling rhel-7-server-rh-common-rpms https://review.openstack.org/384533 | 14:16 |
*** akshai has joined #tripleo | 14:17 | |
*** jaosorior has quit IRC | 14:17 | |
jrist | rbrady: so do you have any ideas on the central logging? | 14:17 |
jrist | we've got it centralized now in the UI but we need to work on the stuff from UI -> zaqar? mistral? | 14:18 |
jrist | honza: ^ ? | 14:18 |
jtomasek | rbrady: btw. I'll send the Deployment Configuration improvements spec and we can discuss blueprints based on that | 14:19 |
honza | jrist: rbrady: i had a look at it but didn't really get too far; zaqar uses mongodb for "persistence" so i was exploring the idea of querying the db to get the logs out and present it in the GUI | 14:19 |
EmilienM | ayoung: are you working on enabling fernets in tripleo? | 14:20 |
ayoung | EmilienM, its going to be in the upcoming sprint, starting next week. Is it a firedrill yet? | 14:21 |
jrist | LOL ayoung I like that last sentence | 14:21 |
jrist | that belongs in the topic | 14:21 |
EmilienM | maybe we could start by doing like we did with credentials (without rotation) and iterate later | 14:21 |
EmilienM | ayoung: I just saw steve's email about it | 14:21 |
*** akshai has quit IRC | 14:22 | |
ayoung | EmilienM, yes, that is the plan. Let me look for the email | 14:22 |
*** yolanda has quit IRC | 14:22 | |
shardy | presumably we can override the default for a while if we're not ready for the switch of default tho | 14:22 |
EmilienM | shardy: right | 14:23 |
ayoung | shardy, yes, UUID is still supported | 14:23 |
ayoung | PKI is dead | 14:23 |
EmilienM | oh cool | 14:23 |
shardy | ayoung: ack, thanks for clarifying | 14:23 |
EmilienM | ok so no hurry | 14:23 |
shardy | phew, not a firedrill ;) | 14:23 |
*** yolanda has joined #tripleo | 14:23 | |
EmilienM | ayoung: before doing the THT patch, we need to do the tripleoclient like I did for credentials | 14:23 |
ayoung | shardy, it will be part of Ocata, and we should be able to make it default before too long | 14:23 |
ayoung | EmilienM, will do | 14:23 |
shardy | ++ sounds good | 14:24 |
EmilienM | thanks! | 14:24 |
*** dmacpher has quit IRC | 14:24 | |
*** oshvartz has quit IRC | 14:25 | |
*** dmacpher has joined #tripleo | 14:25 | |
openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: Set redis file descriptor limit when run via pacemaker https://review.openstack.org/393343 | 14:25 |
bkreitch | shardy: hi, I see that rdo-release was removed in this patch - https://review.openstack.org/gitweb?p=openstack/python-tripleoclient.git;a=commitdiff;h=a8290209c2174a58f6a923b184078923e1eedb98, but if I do want to install rdo-release? there is /usr/share/tripleo-image-elements/rdo-release/pre-install.d/10-rdo-release-repo, but I'm not sure how to get it executed.. | 14:28 |
*** bkopilov has quit IRC | 14:28 | |
*** absubram has joined #tripleo | 14:28 | |
rbrady | jrist: I do. I was thinking of a custom storage backend, but I was also assuming the desired result was a log file in /var/log | 14:30 |
jrist | I was thinking it might be good to do both? | 14:31 |
*** abregman|afk is now known as abregman | 14:31 | |
jrist | like a configuration | 14:31 |
jrist | but /var/log would be ideal | 14:31 |
shardy | bkreitch: http://docs.openstack.org/developer/tripleo-docs/post_deployment/build_single_image.html#building-a-single-image | 14:31 |
shardy | you can add it back with --builder-extra-args I believe | 14:31 |
jrist | rbrady, honza - something that could be 'splunked' or syslog or the like | 14:32 |
*** HoloIRCUser2 has joined #tripleo | 14:33 | |
*** yolanda has quit IRC | 14:33 | |
*** HoloIRCUser2 has quit IRC | 14:34 | |
*** pkovar has quit IRC | 14:35 | |
bkreitch | shardy: yep, thanks | 14:36 |
*** giulivo has joined #tripleo | 14:36 | |
*** yolanda has joined #tripleo | 14:38 | |
*** athomas has quit IRC | 14:39 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: [WIP] config for containerized-compute https://review.openstack.org/393348 | 14:42 |
*** ccamacho|lunch is now known as ccamacho | 14:42 | |
*** abregman has quit IRC | 14:44 | |
remix_tj | bandini: just seen your backport. Was just asking if i could do this or if i had to wait for someone to do it :-) thanks | 14:44 |
bandini | remix_tj: thanks for the report ;) it was good meeting you in person! | 14:45 |
remix_tj | bandini: for me too :-) | 14:45 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Fix password handling for users upgrading from Mitaka https://review.openstack.org/392593 | 14:46 |
*** yamahata has joined #tripleo | 14:46 | |
*** athomas has joined #tripleo | 14:46 | |
*** giulivo has quit IRC | 14:47 | |
openstackgerrit | Merged openstack/tripleo-quickstart: Fix tempest runner in devmode https://review.openstack.org/391312 | 14:47 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Fix password handling for users upgrading from Mitaka https://review.openstack.org/392593 | 14:50 |
openstackgerrit | Katerina Pilatova proposed openstack/tripleo-validations: undercloud-disk-space.yaml: improved output https://review.openstack.org/393354 | 14:54 |
*** cylopez has quit IRC | 14:55 | |
*** katkapilatova has joined #tripleo | 14:57 | |
*** d0ugal has quit IRC | 14:57 | |
openstackgerrit | Alejandro Andreu proposed openstack/tripleo-heat-templates: (Mitaka only) MidoNet 5.x can now be deployed The puppet module openstack/puppet-midonet suffered a major rewrite hence it was necesssary to rewrite the manifests at tripleo-heat-templates. Everything is MidoNet specific (only applied when the Neutron plu https://review.openstack.org/393357 | 14:57 |
b00tcat | oops, missed a newline (fixing it right now) ^ ^ ^ | 14:57 |
openstackgerrit | Alejandro Andreu proposed openstack/tripleo-heat-templates: (Mitaka only) MidoNet 5.x can now be deployed https://review.openstack.org/393357 | 14:58 |
b00tcat | now | 14:58 |
b00tcat | this is a biggie | 14:58 |
b00tcat | can someone review it? | 14:58 |
b00tcat | I will adapt it to Newton when we officially support it | 14:59 |
b00tcat | but for now this exclusively Mitaka | 14:59 |
*** pkovar has joined #tripleo | 15:00 | |
*** pblaho has quit IRC | 15:08 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-tripleo: Make sure keepalived is restarted before haproxy. https://review.openstack.org/393361 | 15:09 |
*** katkapilatova has left #tripleo | 15:09 | |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 15:10 |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638864 | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
openstack | Launchpad bug 1638864 in tripleo "mariadb-10.1.18 breaks the resource agent" [Critical,New] - Assigned to Michele Baldessari (michele) | 15:10 |
shardy | b00tcat: question - how can we support multiple midonet branches in tripleo when there's only one branch in puppet-midonet? | 15:11 |
*** jerrygb_ has joined #tripleo | 15:12 | |
*** jkilpatr_ has joined #tripleo | 15:12 | |
shardy | seems suboptimal that we've got to essentially rewrite the mitaka integration, it's a real shame the puppet module doesn't have stable branches like all other opentstack/puppet-* ones | 15:12 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-specs: GUI Deployment Configuration improvements https://review.openstack.org/393365 | 15:13 |
*** jkilpatr_ has quit IRC | 15:13 | |
*** d0ugal has joined #tripleo | 15:13 | |
*** jerrygb has quit IRC | 15:13 | |
b00tcat | shardy: we're about to branch it - but anyhow the branch will come from tripleo-puppet-elements which in its different branches will point to different commits of the openstack/puppet-midonet module | 15:14 |
b00tcat | does this make sense? | 15:14 |
jtomasek | rbrady: ^^^ | 15:14 |
*** jkilpatr has quit IRC | 15:14 | |
*** chandankumar has quit IRC | 15:15 | |
b00tcat | shardy: if you want bother me directly | 15:16 |
*** jkilpatr has joined #tripleo | 15:16 | |
*** jaosorior has joined #tripleo | 15:17 | |
rbrady | jtomasek: reading | 15:18 |
*** ealcaniz__ has joined #tripleo | 15:18 | |
shardy | b00tcat: we're installing modules from packages now, so I'm not sure the tripleo-puppet-elements hashes matter anymore, at least for recent branches? | 15:18 |
shardy | b00tcat: so I'd expect us to consume the head of each stable branch provided via puppet-midonet | 15:19 |
shardy | that's the way it works for all the other modules AFAIK | 15:19 |
shardy | or at least all those under the openstack namespace | 15:19 |
b00tcat | we're branching it today yes | 15:20 |
b00tcat | does this still apply for the mitaka release though? | 15:20 |
shardy | b00tcat: the problem with your mitaka patch is it clearly breaks the OpenStack stable branch policy, because it's backwards incompatible (it removes a bunch of parameters) | 15:20 |
b00tcat | (fetch modules from pkgs I mean) | 15:20 |
shardy | b00tcat: AFAIK we're testing packaged modules for all branches now ref https://github.com/openstack-infra/tripleo-ci/commit/242cfb9d97e762e81b1c25e93bb2db8b99a4f157 | 15:25 |
shardy | b00tcat: obviously we've not got coverage of puppet-midonet in CI, but if possible it'd be good to discuss how we get consumption of that aligned with the rest of the puppet stuff | 15:26 |
jaosorior | We don't have a release of mariadb yet, right? :O | 15:27 |
b00tcat | ok good, I'm having a lookt at that and re. the CI I'll send an email to the ML or bother someone here at #tripleo | 15:27 |
b00tcat | thanks shardy | 15:27 |
shardy | b00tcat: ack, thanks - I'm sure we can reach a compromise, particularly given this is all disabled by default | 15:28 |
shardy | b00tcat: but we have to be careful because our stable-follows-policy tag was denied previously because we backported some stuff that didn't follow the OpenStack wide policy during liberty | 15:28 |
b00tcat | what do you mean by this stable-follows-policy tag? | 15:31 |
b00tcat | I'm also reading through http://docs.openstack.org/developer/puppet-openstack-guide/ to make sure everythig is fine | 15:31 |
shardy | https://github.com/openstack/governance/blob/master/reference/tags/stable_follows-policy.rst | 15:32 |
shardy | http://docs.openstack.org/project-team-guide/stable-branches.html#appropriate-fixes | 15:32 |
b00tcat | awesome! | 15:35 |
b00tcat | thanks again | 15:35 |
*** ealcaniz__ has quit IRC | 15:37 | |
*** sudipto_ has quit IRC | 15:37 | |
*** sudipto has quit IRC | 15:37 | |
*** d0ugal has quit IRC | 15:39 | |
*** jtomasek has quit IRC | 15:44 | |
openstackgerrit | Flavio Percoco proposed openstack/tripleo-specs: Containerize TripleO blueprint https://review.openstack.org/223182 | 15:45 |
*** jkilpatr has quit IRC | 15:47 | |
*** ealcaniz has joined #tripleo | 15:51 | |
*** jaosorior has quit IRC | 15:54 | |
*** bogdando has joined #tripleo | 15:55 | |
bogdando | hi folks. Does https://github.com/openstack/tripleo-quickstart/ cover the "quickstart.sh localhost" case, when the localhost is a VM instance, say GCE one? | 15:57 |
*** bana_k has joined #tripleo | 15:58 | |
hewbrocca | trown: ^^^ | 16:00 |
mwhahaha | bogdando: there are some issues with localhost so it may not work | 16:00 |
*** jkilpatr has joined #tripleo | 16:00 | |
*** maeca1 has quit IRC | 16:01 | |
mwhahaha | trown was the one who told me that locahost may not work :D it's cause ansible does stuff when it gets 'localhost'. he recommended doing something like 127.0.0.2 instead but i never got that working | 16:02 |
panda | bogdando: I don't think it was tested that much in that case. It may need nested KVM, and at least 20G of RAM, also pointing at localhost still needs some tweaking. | 16:02 |
*** rcernin has quit IRC | 16:02 | |
*** dtrainor has quit IRC | 16:04 | |
*** dtrainor has joined #tripleo | 16:04 | |
bogdando | mwhahaha, panda I see. I could run quickstart.sh with the virthost pointing to that GCE instance as well then perhaps, with the same result | 16:05 |
bogdando | I hoped it may work self-hosted as well | 16:05 |
*** aufi has quit IRC | 16:09 | |
*** ooolpbot has joined #tripleo | 16:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 16:10 |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638864 | 16:10 |
*** ooolpbot has quit IRC | 16:10 | |
openstack | Launchpad bug 1638864 in tripleo "mariadb-10.1.18 breaks the resource agent" [Critical,New] - Assigned to Michele Baldessari (michele) | 16:10 |
*** rajinir has joined #tripleo | 16:12 | |
*** tremble has quit IRC | 16:15 | |
*** lmiccini has quit IRC | 16:16 | |
*** pkovar has quit IRC | 16:18 | |
openstackgerrit | Dan Trainor proposed openstack/puppet-tripleo: Enable communication between UI and the Undercloud by making HAProxy proxy for the UI https://review.openstack.org/393390 | 16:18 |
*** pcaruana has quit IRC | 16:20 | |
rbrady | thrash: if you have any time today, I could use a review on adding retry defaults to swift client. It's a super small change and follows convention used for ironic client https://review.openstack.org/#/c/389124/ | 16:21 |
*** flepied has quit IRC | 16:21 | |
*** rcernin has joined #tripleo | 16:25 | |
*** bana_k has quit IRC | 16:26 | |
*** myoung is now known as myoung|food | 16:33 | |
*** chandankumar has joined #tripleo | 16:34 | |
*** jlinkes has quit IRC | 16:36 | |
*** ebarrera has quit IRC | 16:37 | |
bogdando | panda, mwhahaha oh, my plan to run quickstart from a centos7 container will not work cuz I can't do that for the GCE instance "you must be able to ssh to the virthost machine as root without a password from the machine running ansible". | 16:40 |
*** artom has quit IRC | 16:40 | |
*** artom has joined #tripleo | 16:40 | |
bogdando | so how could I simply install it quick on a GCE instance? | 16:40 |
bogdando | if I could customize ssh opts and ssh user for ansible, this could work perhaps | 16:41 |
mwhahaha | honestly i just wrote my own ansible playbook to setup the pieces for me | 16:42 |
bogdando | ;) | 16:42 |
mwhahaha | i got tired of fighting quickstart, which works great if you have a specific configuration | 16:43 |
mwhahaha | but if you vary outside of that a bit, it got painful quick | 16:43 |
mwhahaha | that being said, you should be able to configure the ssh user and opts via ansible.cfg | 16:44 |
bogdando | good idea | 16:45 |
bnemec | bogdando: I histhly recommend not trying to run tripleo in a nested virt environment. The docs explicitly say that is not supported. | 16:45 |
bnemec | histhly? | 16:45 |
bnemec | *highly | 16:45 |
* bnemec blames cold medication | 16:45 | |
bnemec | I've had and heard of nothing but trouble trying to use nested virt for this stuff. | 16:45 |
bogdando | bnemec, well, I have a free GCE trial and a strong desire to try tripleo :) | 16:45 |
bogdando | no more options for me! | 16:45 |
bogdando | I've read this story http://osdir.com/ml/openstack-dev/2016-09/msg01452.html and stopped on the quickstart tool | 16:46 |
bogdando | this should be easy thing really, just adjust ansible.cfg, thanks mwhahaha | 16:47 |
*** Slower_ is now known as Slower | 16:49 | |
*** dmacpher is now known as dmacpher-afk | 16:51 | |
*** dmacpher-afk has quit IRC | 16:51 | |
thrash | rbrady: ack | 16:52 |
*** jtomasek has joined #tripleo | 16:52 | |
*** pkovar has joined #tripleo | 16:53 | |
*** florianf has quit IRC | 16:53 | |
*** maeca1 has joined #tripleo | 16:54 | |
*** ealcaniz has quit IRC | 16:56 | |
*** zoli|wfh is now known as zoli|gone | 16:56 | |
*** ohamada has quit IRC | 16:57 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: Test https://review.openstack.org/393415 | 17:03 |
*** rcernin has quit IRC | 17:03 | |
*** rcernin has joined #tripleo | 17:03 | |
*** rcernin has quit IRC | 17:08 | |
*** ebarrera has joined #tripleo | 17:08 | |
openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud: Make inspection also respect whether iPXE is enabled https://review.openstack.org/393418 | 17:09 |
*** hewbrocca is now known as hewbrocca_afk | 17:09 | |
*** ooolpbot has joined #tripleo | 17:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638864 | 17:10 |
*** ooolpbot has quit IRC | 17:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 17:10 |
openstack | Launchpad bug 1638864 in tripleo "mariadb-10.1.18 breaks the resource agent" [Critical,New] - Assigned to Michele Baldessari (michele) | 17:10 |
jidar | damn, fresh install and still getting this checkmodule issue | 17:10 |
*** myoung|food is now known as myoung | 17:11 | |
*** bana_k has joined #tripleo | 17:12 | |
jidar | https://gist.github.com/63ea957b1495905f0dacff88ebfa3acf if anybody wants to take a look | 17:12 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: Containerized Services for Composable Roles https://review.openstack.org/330659 | 17:15 |
*** milan has quit IRC | 17:18 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: Test https://review.openstack.org/393415 | 17:20 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Rework gnocchi-upgrade to run in a separate upgrade step https://review.openstack.org/388649 | 17:28 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Rework gnocchi-upgrade to run in a separate upgrade step https://review.openstack.org/393424 | 17:29 |
*** mgould is now known as mgould|afk | 17:31 | |
*** dtantsur is now known as dtantsur|afk | 17:32 | |
*** ebalduf has quit IRC | 17:33 | |
*** fragatina has quit IRC | 17:39 | |
*** mcornea has quit IRC | 17:43 | |
*** abregman has joined #tripleo | 17:56 | |
*** derekh has quit IRC | 17:56 | |
*** Guest25209 has quit IRC | 17:57 | |
*** lucasagomes is now known as lucas-afk | 17:59 | |
*** dsneddon has quit IRC | 18:00 | |
*** dsneddon has joined #tripleo | 18:00 | |
dprince | slagle: hey, can you remind me what controls the list of elements we install on the multi-node jobs? | 18:00 |
dprince | slagle: I need to add the new hiera agent element there I think | 18:01 |
slagle | dprince: it's the bootstrap-overcloud-full script, which pulls the list of elements from the yaml files from tripleo-common | 18:02 |
slagle | is the new agent element in the yaml files? | 18:02 |
*** jpena is now known as jpena|off | 18:03 | |
dprince | slagle: yeah, should be here http://git.openstack.org/cgit/openstack/tripleo-common/tree/image-yaml/overcloud-images.yaml#n20 | 18:04 |
dprince | slagle: in this case it is a package | 18:04 |
slagle | it should also install that list of packages | 18:04 |
*** rcernin has joined #tripleo | 18:05 | |
*** athomas has quit IRC | 18:05 | |
dprince | slagle: okay, I see it. I must be hitting a different issue... | 18:06 |
slagle | unless there is a bug in my jq | 18:07 |
slagle | which is certainly possible | 18:07 |
EmilienM | CI update: mariadb has been (manually) promoted in RDO and is in wait to be synced in buildlogs. I'll let you know when we can recheck | 18:08 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart: Add roles-gate playbook run to OVB ci-script https://review.openstack.org/392873 | 18:09 |
*** abregman has quit IRC | 18:09 | |
*** ooolpbot has joined #tripleo | 18:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 18:10 |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638864 | 18:10 |
*** ooolpbot has quit IRC | 18:10 | |
openstack | Launchpad bug 1638864 in tripleo "mariadb-10.1.18 breaks the resource agent" [Critical,New] - Assigned to Michele Baldessari (michele) | 18:10 |
jidar | beagles: is there any solution to the "custom selinux policy compilation may fail" I'm trying to deploy right now and ipxe fails | 18:10 |
jidar | the only thing I can figure is to tie the kernel off at 7.2 and do another install | 18:12 |
jidar | (which will take me hours across this horrible vpn) | 18:12 |
openstackgerrit | David Moreau Simard proposed openstack/tripleo-quickstart: Properly reload kvm module when trying to set up nested virtualization https://review.openstack.org/386012 | 18:13 |
beagles | jidar... trying to remember what I did to get past that point | 18:13 |
beagles | jidar: fwiw.. it's totally doable :) 1s | 18:14 |
*** dprince has quit IRC | 18:15 | |
beagles | jidar: so this is when installing the undercloud? | 18:15 |
jidar | yea | 18:15 |
jidar | see gist above if you want to look at the exact messages | 18:15 |
EmilienM | ok mariadb is updated | 18:21 |
EmilienM | let's do recheck | 18:21 |
EmilienM | mwhahaha: can I abandon https://review.openstack.org/#/c/392994/ ? | 18:21 |
*** cdearborn has joined #tripleo | 18:22 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: nova/libvirt: add missing ports for live-migration https://review.openstack.org/391876 | 18:22 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: nova: add missing vnc console port in firewall https://review.openstack.org/392898 | 18:22 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: swift/proxy: remove swift::proxy::ceilometer::rabbit_host https://review.openstack.org/391864 | 18:22 |
mwhahaha | EmilienM: yes | 18:22 |
EmilienM | mwhahaha: ack | 18:22 |
beagles | jidar: you basically need to find the ipxe.te file in your file system and edit it | 18:22 |
*** [1]cdearborn has quit IRC | 18:23 | |
beagles | jidar: what version of tripleo are you working with? | 18:23 |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Run cinder over eventlet again https://review.openstack.org/392647 | 18:23 |
beagles | jidar: mitaka, right? | 18:23 |
jidar | heh, osp7 | 18:23 |
jidar | :( | 18:24 |
beagles | jidar: fwiw this merged https://review.openstack.org/#/c/388889/ | 18:24 |
beagles | jidar: recently.. it'd be the same problem basically | 18:24 |
jidar | gotcha, found this ipxe file I assume I just need to rename the module name to ipxe ? | 18:24 |
slagle | EmilienM: what's the new mariadb package? | 18:25 |
beagles | jidar: yup | 18:25 |
slagle | EmilienM: i'm wondering, b/c i dont see anythign new here: http://buildlogs.centos.org/centos/7/cloud/x86_64/openstack-ocata/ | 18:25 |
slagle | could be i'm looking in the wrong place | 18:26 |
beagles | jidar: I think the other modules only cause pain if you are building overcloud images so if you aren't doing that you might not have to worry about the rest | 18:26 |
jidar | yea, I just grabbed overcloud from the site like usual | 18:26 |
jidar | beagles: you're a lifesaver (assuming this works!) | 18:26 |
slagle | EmilienM: actually, i see some new mariadb packages under common, so i guess they're there | 18:26 |
beagles | jidar: :) fingers are crossed | 18:26 |
jidar | I'll also add notes to that bug report for people who run into this | 18:26 |
beagles | jidar: cool | 18:26 |
EmilienM | damn, Juan left by leaving WIP on https://review.openstack.org/#/c/392647/ | 18:27 |
EmilienM | oh rebasing removed the WIP :) | 18:27 |
beagles | side-effects ftw! | 18:28 |
*** cjllewellyn has joined #tripleo | 18:29 | |
*** cjllewellyn has left #tripleo | 18:29 | |
openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient: Pass clients to get the get_password function https://review.openstack.org/393192 | 18:30 |
EmilienM | slagle: http://buildlogs.centos.org/centos/7/cloud/x86_64/openstack-ocata/common/?C=M;O=D | 18:30 |
EmilienM | mariadb-server-10.1.18-2.el7.x86_64.rpm | 18:30 |
EmilienM | weird it's duplicated | 18:30 |
EmilienM | i'm asking on #rdo | 18:30 |
jidar | poop, now os-net-config is expecting to find eth1 in /sys/class/net/eth1/address | 18:34 |
dsneddon | jidar, Is there some reason why os-net-config wouldn't be able to find eth1 MAC at that location? | 18:35 |
jidar | it doesn't exist | 18:36 |
*** pkovar has quit IRC | 18:36 | |
jidar | it's not biosdevname, it's enp6s0 | 18:36 |
*** jpich has quit IRC | 18:37 | |
jidar | as was told in the underclud install conf file, eg: local_interface = enp6s0 | 18:37 |
jidar | not sure if its supposed to create an alias, but the config.json looks like the following: | 18:38 |
jidar | {"network_config": [{"ovs_extra": ["br-set-external-id br-ctlplane bridge-id br-ctlplane"], "type": "ovs_bridge", "addresses": [{"ip_netmask": "192.0.2.1/24"}], "members": [{"type": "interface", "primary": "true", "name": "eth1"}], "name": "br-ctlplane"}]} | 18:38 |
dsneddon | jidar, Ah, I see. Not sure of the context, but you can pass "nic2" to os-net-config and it should resolve to the second NIC. | 18:38 |
jidar | yea, had some issues with that a while back where some of my hosts would re-order nics and had to edit the overcloud image to set biosdevname=1 | 18:39 |
jidar | different nics in different hosts responded differently | 18:39 |
dsneddon | jidar, That looks like the non-network-isolation configuration. You can set "NeutronPublicInterface" to "nic2" or "enp6s0" and it should be passed to config.json | 18:40 |
*** dprince has joined #tripleo | 18:41 | |
dsneddon | jidar, Just set "NeutronPublicInterface: nic2" or "NeutronPublicInterface: enp6s0" in the paramter_defaults section of an environment file, then include that environment file when you deploy (-e /path/to/environment.yaml) | 18:41 |
jidar | this is the undercloud | 18:41 |
jidar | looks like 7.3 going GA boned me | 18:42 |
dsneddon | jidar, The defaults are set up for virt testing... | 18:42 |
*** ebarrera has quit IRC | 18:44 | |
jidar | the latest os-net-config issues after fixing the selinux stuff https://gist.github.com/7234b95815bdcd066c2aeb8c072bc3ce | 18:47 |
jidar | if anybody wants to take a look | 18:48 |
slagle | jidar: if this is for undercloud install, it's a matter of putting the correct interface name into undercloud.conf | 18:48 |
jidar | slagle: it's currently got enp6s0 listed there, but the /etc/os-net-config/config.json that gets generated replaces it with eth1 | 18:49 |
jidar | otherwise I'd totally agree, it would seem like I fat fingered something | 18:50 |
jidar | https://gist.github.com/bd5ce160fed1eda547f5c5cfa2638a72 see here slagle | 18:52 |
slagle | yea, that looks right | 18:53 |
slagle | that's in the current directory you're running the install command from? | 18:53 |
jidar | it is | 18:54 |
jidar | I've only done this about a thousand times | 18:54 |
jidar | I was literally in the middle of building this when the repos started offering 7.3 | 18:55 |
jidar | so I rebuilt the server last night thinking it might help, but it has nothign to do with any cruft that might have built up | 18:55 |
jidar | support opened a bugzilla on it: https://bugzilla.redhat.com/show_bug.cgi?id=1391678 | 18:56 |
openstack | bugzilla.redhat.com bug 1391678 in openstack-tripleo "OSP undercloud installation broken due to upgarde to RHEL 7.3" [High,New] - Assigned to jslagle | 18:56 |
rook-out | beagles: can ooo deploy lbaas? | 19:00 |
beagles | rook-out: why would you want to do that? | 19:00 |
beagles | ;) | 19:00 |
rook-out | lol i dont | 19:00 |
beagles | rook-out: not to my knowledge | 19:01 |
slagle | jidar: did you get past the selinux issue? | 19:02 |
EmilienM | rook-out: no, we don't have the composable service, but it would be something easy to add | 19:03 |
rook-out | beagles EmilienM thx | 19:03 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: WIP prototyping composable upgrades with Heat+Ansible https://review.openstack.org/393448 | 19:04 |
beagles | rook-out: was just looking for a patch I saw on this recently | 19:04 |
beagles | or not recently | 19:04 |
*** ccamacho has quit IRC | 19:05 | |
slagle | jidar: can you also check the interface name in /var/lib/heat-cfntools/cfn-init-data? | 19:05 |
shardy | EmilienM: Hey I'm stopping for today, but I pushed ^^ WIP for comments | 19:05 |
shardy | EmilienM, marios jistr ^^ | 19:05 |
shardy | It doesn't work yet, but I think it shows how it could be wired together | 19:05 |
shardy | very similar to the composable services deployment steps with puppet | 19:06 |
EmilienM | shardy: woot! I'll look shortly | 19:06 |
*** chandankumar has quit IRC | 19:06 | |
EmilienM | shardy: looks nice | 19:06 |
shardy | EmilienM: thanks, I'll continue tomorrow and try to get it functional | 19:06 |
*** akshai has joined #tripleo | 19:06 | |
shardy | Note we'll still end up with a single playbook per role, so we still could move to something driving ansible not in localhost mode at some future time | 19:07 |
shardy | e.g via mistral or whatever | 19:07 |
shardy | but this seemed like a simpler first step | 19:07 |
EmilienM | shardy: right | 19:07 |
*** hewbrocca_afk is now known as hewbrocca | 19:07 | |
*** mburned is now known as mburned_out | 19:08 | |
*** mburned_out is now known as mburned | 19:08 | |
*** liverpooler has quit IRC | 19:09 | |
*** mburned is now known as mburned_out | 19:09 | |
*** ooolpbot has joined #tripleo | 19:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 19:10 |
*** ooolpbot has quit IRC | 19:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 19:10 |
*** tosky has quit IRC | 19:11 | |
*** shardy has quit IRC | 19:11 | |
dsneddon | EmilienM, For implementing this spec, I would like to use a composable service for the Undercloud if possible. Do we have documentation about how that will work yet? | 19:15 |
dsneddon | https://review.openstack.org/350729 | 19:15 |
EmilienM | slagle: I don't think we'll release a new newton before ocata-1, our CI downtimes slowed us down to merge critical bugfixes in master and backport them. is it ok? | 19:16 |
EmilienM | dsneddon: http://tripleo.org/developer/tht_walkthrough/tht_walkthrough.html#composable-services-tutorial is a good start | 19:16 |
EmilienM | big kudos to Carlos for this excellent document | 19:16 |
dsneddon | EmilienM, Thanks | 19:17 |
slagle | EmilienM: not really | 19:17 |
slagle | why can't we release? | 19:17 |
EmilienM | slagle: we could but CI was really bad this week, I would check if it's stable again now and maybe release tomorrow | 19:18 |
EmilienM | I'm preparing the patch now | 19:19 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Use correct password for keystone bootstrap https://review.openstack.org/393455 | 19:21 |
*** ccamacho has joined #tripleo | 19:22 | |
openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci: [WIP] add more debug to the logs if overcloud deploy fails https://review.openstack.org/393459 | 19:25 |
*** akshai_ has joined #tripleo | 19:27 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Rework gnocchi-upgrade to run in a separate upgrade step https://review.openstack.org/393424 | 19:29 |
*** akshai has quit IRC | 19:30 | |
pradk | is anyone seeing an issue with redis starting correctly? | 19:31 |
pradk | in my latest deploy redis fails to start, seems due to https://review.openstack.org/#/c/389583/ but not sure yet | 19:32 |
bnemec | pradk: Yes, it's broken. The workaround is to set your images to permissive: https://review.openstack.org/#/c/392703/ | 19:33 |
*** yamahata has quit IRC | 19:34 | |
pradk | well i am in permissive | 19:34 |
beagles | man ... we should be keeping a list of "this breaks that" somewhere :) | 19:35 |
*** amoralej is now known as amoralej|off | 19:35 | |
beagles | pradk: what kind of startup errors? | 19:36 |
pradk | just says entered a failed state | 19:40 |
pradk | redis_demote_0 says not running in pcs | 19:40 |
*** cwolferh has quit IRC | 19:41 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-common: Configure run-validation to use the custom output https://review.openstack.org/393467 | 19:50 |
*** jerrygb has joined #tripleo | 19:51 | |
*** mhenkel has quit IRC | 19:52 | |
bandini | beagles: networking question. who is in charge to create those 169.254.* routes on undercloud and overcloud to have os-collect-config talk to the nova metadata service? | 19:53 |
openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci: [WIP] add more debug to the logs if overcloud deploy fails https://review.openstack.org/393459 | 19:53 |
bandini | beagles: hrybacki and I are looking at an env where deployment fails and we saw that os-collect-config can't talk to the undercloud because those routes are missing | 19:53 |
*** jerrygb_ has quit IRC | 19:54 | |
*** mhenkel has joined #tripleo | 19:54 | |
* hrybacki listens in | 19:55 | |
*** bank_ has joined #tripleo | 19:56 | |
beagles | bandini: hrybacki: normally I would say neutron ... but ... 1s | 19:56 |
beagles | bandini: hrybacki: yeah.. that's what I though. If I understand your question correctly, os_net_config handles does some magic here | 19:58 |
*** bana_k has quit IRC | 19:58 | |
beagles | bandini: hrybacki: take a look at t-h-t/net-config-static.yaml for example | 19:58 |
* bandini looks | 19:59 | |
beagles | setting routes and configuring interfaces are two of the tricks os-net-config knows about | 19:59 |
bandini | beagles: thanks that should get me started a bit | 20:01 |
*** nyechiel has quit IRC | 20:01 | |
*** fragatina has joined #tripleo | 20:01 | |
beagles | just wondering what circumstances would cause problems there | 20:01 |
weshay | tripleo doesn't have a server w/ ipv6 so we can console into zuul jobs that have an ipv6 addr do we? | 20:02 |
*** cylopez has joined #tripleo | 20:07 | |
jidar | slagle: re: selinux, yes. looking into /var/lib/heat/cfntools now | 20:08 |
*** jkilpatr has quit IRC | 20:09 | |
jidar | slagle: https://gist.github.com/f33b0a52996c9e069dd32700346fc6af | 20:09 |
*** percevalbot has quit IRC | 20:09 | |
*** ooolpbot has joined #tripleo | 20:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1637961 | 20:10 |
openstack | Launchpad bug 1637961 in tripleo "periodic HA master job pingtest times out" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 20:10 |
*** ooolpbot has quit IRC | 20:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 20:10 |
*** pblaho has joined #tripleo | 20:13 | |
EmilienM | damn, I still see mariadb problem in stable/newton | 20:16 |
EmilienM | with new package | 20:16 |
EmilienM | bandini: you still around? | 20:17 |
dciabrin | EmilienM, have some logs to look at? | 20:17 |
EmilienM | mariadb-common-10.1.18-2.el7.x86_64 should be good right? | 20:17 |
EmilienM | dciabrin: hey you | 20:17 |
EmilienM | http://logs.openstack.org/00/393000/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/4ed9cb8/logs/postci.txt.gz#_2016-11-03_20_05_53_000 | 20:17 |
*** abregman has joined #tripleo | 20:17 | |
EmilienM | even in master | 20:18 |
EmilienM | the package looks like not working | 20:19 |
dciabrin | EmilienM, sigh... same error "Nov 3 19:32:33 localhost galera(galera)[30078]: ERROR: Unable to detect last known write sequence number" | 20:19 |
EmilienM | damn | 20:19 |
dciabrin | EmilienM, do you have the location in cbs i could download this and test locally? | 20:19 |
bandini | EmilienM: am here | 20:21 |
openstackgerrit | Brent Eagles proposed openstack/python-tripleoclient: Do not use selinux-permissive for the CentOS image https://review.openstack.org/393472 | 20:22 |
bandini | mmh | 20:23 |
openstackgerrit | Brent Eagles proposed openstack/python-tripleoclient: Clear the old environment in rc file https://review.openstack.org/393477 | 20:24 |
*** mhenkel has quit IRC | 20:24 | |
*** cylopez has quit IRC | 20:26 | |
*** dprince has quit IRC | 20:26 | |
*** Goneri has quit IRC | 20:27 | |
EmilienM | dciabrin: yeah | 20:27 |
EmilienM | dciabrin: buildlogs.centos.org/centos/7/cloud/x86_64/openstack-ocata/common/ | 20:27 |
EmilienM | ok it seems like the new package was not enough | 20:27 |
EmilienM | 2016-11-03 20:10:28.000 | mError: /Stage[main]/Tripleo::Profile::Pacemaker::Database::Mysql/Exec[galera-ready]/returns: change from notrun to 0 failed: /usr/bin/clustercheck >/dev/null returned 1 instead of one of [0]m | 20:27 |
EmilienM | is it the same trace as before? | 20:27 |
EmilienM | beagles: do we really need https://review.openstack.org/#/c/393477/ backported? | 20:27 |
EmilienM | I don't see a launchpad bug | 20:27 |
beagles | there were a few in tripleoclient that weren't linked to bugs... | 20:28 |
beagles | so "Hail Mary"'d it .. is ayoung around? | 20:29 |
beagles | yo ayoung: was going through recent unbackported patches - is this something that should be backported - i.e fixes an actual issue or is it a cleanup? https://review.openstack.org/#/c/393477/ | 20:30 |
beagles | EmilienM: I was ignoring patches that didn't have bz's then noticed a bunch that were getting backported without bzs | 20:30 |
EmilienM | beagles: ok | 20:30 |
beagles | (only for tripleoclient anyways) | 20:30 |
*** akrivoka has quit IRC | 20:30 | |
*** cwolferh has joined #tripleo | 20:30 | |
ayoung | My Irish Catholic grandfather hjad an interesting ending to "Hail Mary, full of grace...." | 20:31 |
beagles | oh oh :) | 20:31 |
beagles | EmilienM: I'll ping gfidente on the selinux one... | 20:32 |
ayoung | beagles, that one was just a "good idea" | 20:32 |
EmilienM | ok so we don't backport ^ | 20:32 |
ayoung | Not sure if I would recommend backporting it at this time | 20:32 |
beagles | k | 20:32 |
EmilienM | if there is no bug, we don't want to backport it | 20:32 |
ayoung | R | 20:32 |
*** jkilpatr has joined #tripleo | 20:33 | |
beagles | EmilienM: yeah.. I know that's the rule.. maybe some of these were backported because of the *when* the branch was created | 20:35 |
beagles | without bz's that is | 20:35 |
beagles | I was a little interested in the phenomena myself :) | 20:36 |
*** pradk has quit IRC | 20:36 | |
*** pradk has joined #tripleo | 20:36 | |
*** jayg is now known as jayg|g0n3 | 20:38 | |
*** percevalbot has joined #tripleo | 20:45 | |
*** fragatina has quit IRC | 20:49 | |
*** paramite has quit IRC | 20:56 | |
*** rcernin has quit IRC | 20:57 | |
jidar | can somebody explain to me how os-net-config (on an undercloud) is pulling this information out? Like it's supposed to use undercloud.conf and update I assume the following two files, ['/etc/os-net-config/config.json', '/var/lib/heat-cfntools/cfn-init-data'] but both of those files do not have what's in the undercloud.conf (eth1 vs enp6s0) | 20:58 |
slagle | jidar: the cfn-init-data should be created when install.d/02-undercloud-stack-heat-metadata is run during the undercloud install | 21:00 |
jidar | to the debugging! | 21:00 |
slagle | jidar: if you post your whole undercloud install log somewhere, i'll have a look | 21:01 |
jidar | sure thing | 21:01 |
dsneddon | jidar, You did specify local_interface=enp6s0 in undercloud.conf prior to running undercloud install, right? | 21:03 |
jidar | I did! | 21:04 |
jidar | I even followed the cleanup procedures listed here: https://access.redhat.com/solutions/2210421 | 21:04 |
jidar | as a just-in-case | 21:04 |
slagle | neat, i didnt even know we had one of those | 21:04 |
slagle | "neat" in a that looks tricky sort of way | 21:05 |
jidar | https://gist.github.com/155e57f62ec62afc06305762b098a181 | 21:05 |
jidar | slagle: ^ full log | 21:05 |
*** ayoung has quit IRC | 21:06 | |
slagle | looking | 21:07 |
*** ooolpbot has joined #tripleo | 21:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1637961 | 21:10 |
openstack | Launchpad bug 1637961 in tripleo "periodic HA master job pingtest times out" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638864 | 21:10 |
*** ooolpbot has quit IRC | 21:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 21:10 |
openstack | Launchpad bug 1638864 in tripleo "mariadb-10.1.18 breaks the resource agent" [Critical,In progress] - Assigned to Michele Baldessari (michele) | 21:10 |
jidar | so install.d/02--undercloud-stack-heat-metadata has the wrong info in it, it's got eth1 | 21:10 |
jidar | (inside /tmp) | 21:10 |
openstackgerrit | John Eckersberg proposed openstack/tripleo-puppet-elements: Add puppet-qdr module https://review.openstack.org/373488 | 21:11 |
openstackgerrit | John Eckersberg proposed openstack/tripleo-puppet-elements: Add qpid-dispatch-router to overcloud-controller element https://review.openstack.org/373489 | 21:11 |
slagle | jidar: that is a script, the values you see there are default values. so i'd expect to see eth1 there | 21:11 |
slagle | jidar: the issue is why is it taking the default value and not the value you specified in undercloud.conf | 21:12 |
jidar | agreed | 21:12 |
*** lblanchard has quit IRC | 21:15 | |
slagle | unfortunately this log is not all that helpful either | 21:15 |
jidar | heh, I tried to edit /usr/share/instack-undercloud/undercloud-stack-config/install.d/02-undercloud-stack-heat-metadata and replace the eth1 there with enp6s0 and it didn't fix it | 21:16 |
slagle | so the cfn-init-data still had the eth1 in it even in that case? | 21:16 |
jidar | yep, and config.json too | 21:17 |
slagle | you dont happen to have a $LOCAL_INTERFACE env var set by any other means do you? | 21:17 |
jidar | highly doubt it.. checking | 21:18 |
jidar | nope | 21:18 |
*** percevalbot has quit IRC | 21:18 | |
*** thrash is now known as thrash|g0ne | 21:18 | |
jidar | I'm starting to think I need to rollback (sadly by re-installing) and lock the kernel to something that'll keep it at 7.2 | 21:18 |
slagle | LOCAL_INTERFACE should be added to os.env in _generate_environment in undercloud.py | 21:21 |
slagle | os.environ rather | 21:21 |
slagle | maybe you could add a print of os.environ.items() at the end of that function just before it returns? | 21:22 |
slagle | or actually i guess it'd be instack_env.items() | 21:22 |
jidar | sure thing | 21:22 |
*** jcoufal has quit IRC | 21:23 | |
jidar | welp, that's a shame. | 21:25 |
jidar | Correct me if I'm wrong here, but does it matter that it's PWD or ~/ | 21:25 |
jidar | for undercloud.conf | 21:25 |
slagle | it needs to be current directory | 21:25 |
jidar | not this time | 21:25 |
jidar | cp ~/templates/undercloud.conf ~/; fixed it | 21:25 |
jidar | while runnign the install from ~/templates | 21:26 |
slagle | oh right, it assumes ~/undercloud.conf | 21:26 |
jidar | :( | 21:26 |
*** percevalbot has joined #tripleo | 21:27 | |
jidar | sorry to bother you guys on this. I'd swear to all that is holy $PWD was where it looked | 21:27 |
EmilienM | slagle: re: https://review.openstack.org/#/c/393482/ - how would you name it? I'm very bad at names | 21:27 |
slagle | EmilienM: i dunno... | 21:27 |
slagle | EmilienM: that's why i didnt submit it yet :) | 21:27 |
slagle | EmilienM: we could call it something generic for now | 21:27 |
slagle | jidar: np, it's not the most straightforward interface | 21:28 |
EmilienM | slagle: 3nodes | 21:28 |
slagle | EmilienM: sure | 21:28 |
EmilienM | k | 21:28 |
slagle | in french? | 21:28 |
slagle | what is that french character in nodes? is that unicode? i can't even type that | 21:29 |
EmilienM | slagle: nœud | 21:30 |
EmilienM | but you can "noeud" | 21:30 |
bnemec | nod3 | 21:34 |
bnemec | obv :-P | 21:34 |
* bnemec is 1337 | 21:34 | |
mwhahaha | n0d3. n0+ 1337 enuf | 21:35 |
*** percevalbot has quit IRC | 21:36 | |
*** jeckersb is now known as jeckersb_gone | 21:37 | |
*** akshai_ has quit IRC | 21:42 | |
*** percevalbot has joined #tripleo | 21:43 | |
*** akshai has joined #tripleo | 21:48 | |
*** maeca1 has quit IRC | 21:51 | |
*** akshai has quit IRC | 21:52 | |
*** akshai has joined #tripleo | 21:53 | |
*** rasca has quit IRC | 22:00 | |
*** david-lyle has joined #tripleo | 22:03 | |
*** jprovazn has quit IRC | 22:08 | |
*** ooolpbot has joined #tripleo | 22:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1637961 | 22:10 |
openstack | Launchpad bug 1637961 in tripleo "periodic HA master job pingtest times out" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638864 | 22:10 |
*** ooolpbot has quit IRC | 22:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 22:10 |
openstack | Launchpad bug 1638864 in tripleo "mariadb-10.1.18 breaks the resource agent" [Critical,In progress] - Assigned to Michele Baldessari (michele) | 22:10 |
jidar | anybody seen this? | 22:13 |
jidar | [stack@director-osp7 ~]$ sudo systemctl enable openstack-ironic-discoverd-dnsmasq | 22:13 |
jidar | Failed to execute operation: Too many levels of symbolic links | 22:13 |
*** akshai has quit IRC | 22:14 | |
*** flepied has joined #tripleo | 22:17 | |
*** kjw3 has quit IRC | 22:17 | |
*** maeca1 has joined #tripleo | 22:18 | |
*** absubram has quit IRC | 22:19 | |
*** ayoung has joined #tripleo | 22:26 | |
*** pblaho has quit IRC | 22:29 | |
*** jerrygb_ has joined #tripleo | 22:29 | |
*** NP__ has joined #tripleo | 22:30 | |
*** jerrygb has quit IRC | 22:32 | |
*** NP__ has quit IRC | 22:40 | |
*** akshai has joined #tripleo | 22:41 | |
*** ayoung has quit IRC | 22:43 | |
*** akshai_ has joined #tripleo | 22:44 | |
*** ayoung has joined #tripleo | 22:44 | |
*** akshai has quit IRC | 22:48 | |
*** flepied has left #tripleo | 22:49 | |
*** dougbtv has quit IRC | 22:49 | |
*** maeca1 has quit IRC | 22:55 | |
*** ebalduf has joined #tripleo | 22:58 | |
*** akshai_ has quit IRC | 23:01 | |
*** bfournie1 has left #tripleo | 23:02 | |
*** ayoung has quit IRC | 23:03 | |
*** ooolpbot has joined #tripleo | 23:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1637961 | 23:10 |
openstack | Launchpad bug 1637961 in tripleo "periodic HA master job pingtest times out" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638350 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1638864 | 23:10 |
*** ooolpbot has quit IRC | 23:10 | |
openstack | Launchpad bug 1638350 in tripleo "pingtest failing on OVB jobs to create Cinder volume and Nova server" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 23:10 |
openstack | Launchpad bug 1638864 in tripleo "mariadb-10.1.18 breaks the resource agent" [Critical,In progress] - Assigned to Michele Baldessari (michele) | 23:10 |
*** hewbrocca is now known as hewbrocca_afk | 23:12 | |
*** saneax-_-|AFK is now known as saneax | 23:19 | |
*** yamahata has joined #tripleo | 23:22 | |
*** cwolferh has quit IRC | 23:23 | |
*** bfournie has joined #tripleo | 23:32 | |
*** lblanchard has joined #tripleo | 23:33 | |
*** yamahata has quit IRC | 23:33 | |
*** yamahata has joined #tripleo | 23:35 | |
*** cwolferh has joined #tripleo | 23:42 | |
*** jeckersb_gone is now known as jeckersb | 23:42 | |
*** ayoung has joined #tripleo | 23:48 | |
jidar | yay, more problems! | 23:51 |
jidar | >ERROR: openstack ERROR: Parameter 'KeyName' is invalid: Error validating value u'default': The Key (default) could not be found. | 23:52 |
jidar | I get that on an overcloud deploy | 23:52 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!