*** yamahata has joined #tripleo | 00:00 | |
*** ramishra has joined #tripleo | 00:01 | |
*** ramishra has quit IRC | 00:16 | |
*** ramishra has joined #tripleo | 00:18 | |
*** limao has joined #tripleo | 00:19 | |
*** limao has quit IRC | 00:20 | |
*** limao has joined #tripleo | 00:20 | |
openstackgerrit | Merged openstack/puppet-tripleo: Fix broken rabbitmqctl commands when using ipv6 https://review.openstack.org/386921 | 00:21 |
---|---|---|
*** cdearborn has joined #tripleo | 00:26 | |
*** ctayal has quit IRC | 00:30 | |
*** ramishra has quit IRC | 00:30 | |
*** ramishra has joined #tripleo | 00:32 | |
*** x220_ has joined #tripleo | 00:35 | |
*** newmember has quit IRC | 00:39 | |
*** akuznetsov has joined #tripleo | 00:39 | |
*** akuznetsov has quit IRC | 00:44 | |
*** ctayal has joined #tripleo | 00:54 | |
*** ramishra has quit IRC | 00:59 | |
*** ramishra has joined #tripleo | 01:00 | |
*** xuao has joined #tripleo | 01:01 | |
*** ctayal has quit IRC | 01:06 | |
*** xuao has quit IRC | 01:11 | |
openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: Fixed NoneType issue when monitoring-environment.yaml https://review.openstack.org/388272 | 01:11 |
*** bana_k has quit IRC | 01:13 | |
*** xuao has joined #tripleo | 01:14 | |
*** ramishra has quit IRC | 01:28 | |
*** ramishra has joined #tripleo | 01:28 | |
*** fzdarsky_ has joined #tripleo | 01:30 | |
*** fzdarsky|afk has quit IRC | 01:33 | |
*** cdearborn has quit IRC | 01:34 | |
*** dmacpher has joined #tripleo | 01:36 | |
*** sudipto_ has joined #tripleo | 01:38 | |
*** sudipto has joined #tripleo | 01:38 | |
*** skramaja has joined #tripleo | 01:39 | |
*** akuznetsov has joined #tripleo | 01:40 | |
*** akuznetsov has quit IRC | 01:44 | |
*** sudipto_ has quit IRC | 01:59 | |
*** sudipto has quit IRC | 01:59 | |
*** padkrish has joined #tripleo | 02:00 | |
*** padkrish has quit IRC | 02:06 | |
*** sudipto_ has joined #tripleo | 02:12 | |
*** sudipto has joined #tripleo | 02:12 | |
*** chlong has joined #tripleo | 02:16 | |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: [WIP]Adds retry to plan workflows https://review.openstack.org/388285 | 02:19 |
*** yamahata has quit IRC | 02:20 | |
*** ibravo has joined #tripleo | 02:20 | |
*** ibravo has left #tripleo | 02:21 | |
*** sudipto_ has quit IRC | 02:21 | |
*** sudipto has quit IRC | 02:21 | |
*** ramishra has quit IRC | 02:21 | |
*** rbrady is now known as rbrady-afk | 02:21 | |
*** ramishra has joined #tripleo | 02:23 | |
*** bana_k has joined #tripleo | 02:26 | |
*** bana_k has quit IRC | 02:38 | |
*** akuznetsov has joined #tripleo | 02:41 | |
*** limao has quit IRC | 02:44 | |
*** limao has joined #tripleo | 02:45 | |
*** akuznetsov has quit IRC | 02:45 | |
*** ibravo has joined #tripleo | 02:56 | |
*** x220_ has quit IRC | 03:03 | |
*** limao has quit IRC | 03:23 | |
*** limao has joined #tripleo | 03:25 | |
openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates: GATE TEST, please ignore https://review.openstack.org/365449 | 03:30 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/385754 | 03:33 |
*** akuznetsov has joined #tripleo | 03:41 | |
*** links has joined #tripleo | 03:46 | |
*** akuznetsov has quit IRC | 03:46 | |
*** bana_k has joined #tripleo | 03:51 | |
*** yamahata has joined #tripleo | 03:51 | |
*** akuznetsov has joined #tripleo | 03:55 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/os-cloud-config: Updated from global requirements https://review.openstack.org/350676 | 03:57 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/os-collect-config: Updated from global requirements https://review.openstack.org/350905 | 03:57 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-validations: Updated from global requirements https://review.openstack.org/388336 | 04:00 |
*** akuznetsov has quit IRC | 04:00 | |
*** akuznetsov has joined #tripleo | 04:02 | |
*** ibravo has quit IRC | 04:02 | |
*** ibravo has joined #tripleo | 04:03 | |
*** padkrish has joined #tripleo | 04:05 | |
*** akuznetsov has quit IRC | 04:06 | |
*** padkrish_ has joined #tripleo | 04:10 | |
*** padkrish has quit IRC | 04:10 | |
*** limao has quit IRC | 04:12 | |
*** numans has joined #tripleo | 04:15 | |
*** padkrish_ has quit IRC | 04:21 | |
*** padkrish has joined #tripleo | 04:21 | |
*** ctayal has joined #tripleo | 04:23 | |
*** ctayal has quit IRC | 04:23 | |
*** ctayal has joined #tripleo | 04:23 | |
*** bana_k has quit IRC | 04:25 | |
*** ibravo has quit IRC | 04:26 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/385754 | 04:30 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements https://review.openstack.org/381148 | 04:41 |
*** padkrish has quit IRC | 04:46 | |
*** coolsvap has joined #tripleo | 04:47 | |
*** dsariel has joined #tripleo | 04:48 | |
*** skramaja has quit IRC | 04:49 | |
*** skramaja has joined #tripleo | 04:54 | |
*** akuznetsov has joined #tripleo | 04:56 | |
*** nyechiel has joined #tripleo | 04:58 | |
*** dsneddon_ has joined #tripleo | 04:58 | |
*** akuznetsov has quit IRC | 05:00 | |
*** anbu_ has joined #tripleo | 05:04 | |
*** anbu has quit IRC | 05:05 | |
*** ekoorjr has quit IRC | 05:05 | |
*** itlinux has quit IRC | 05:09 | |
*** ctayal has quit IRC | 05:21 | |
*** jaosorior has joined #tripleo | 05:21 | |
*** ctayal has joined #tripleo | 05:22 | |
*** tzumainn has quit IRC | 05:25 | |
jaosorior | dtrainor: are you still around? | 05:27 |
dtrainor | sure am | 05:30 |
*** akuznetsov has joined #tripleo | 05:30 | |
jaosorior | dtrainor: so, I tested your patch. I was a bit confused initially since all I saw was a blank page | 05:32 |
jaosorior | but then realized that the UI relies very heavily on javascript | 05:32 |
dtrainor | yep sure does | 05:32 |
jaosorior | and I was using lynx (which doesn't have support for it) | 05:33 |
dtrainor | oh haha | 05:33 |
jaosorior | but the haproxy configuration looked just fine | 05:33 |
dtrainor | don't scare me liek that! | 05:33 |
dtrainor | excellent | 05:33 |
jaosorior | hahaha, so yeah, +2ed your patch | 05:34 |
jaosorior | now, I think the SSL by default, while it's something I would really like, I suggest you bring it up in the summit | 05:35 |
jaosorior | to see what people think | 05:35 |
dtrainor | ah you think so? i won't be at summit unfortunately. | 05:36 |
jaosorior | damn | 05:36 |
jaosorior | I can bring it up | 05:36 |
jaosorior | dtrainor: if you won't be there, maybe it would be good to ping more people about it. At least to get their attention for reviews | 05:36 |
dtrainor | fair enough. openstack-dev mailing list? | 05:37 |
jaosorior | dtrainor: good idea! | 05:38 |
dtrainor | cool, just making sure | 05:38 |
dtrainor | i brought it up during the TripleO Team Meeting this morning and it went over well | 05:39 |
*** limao has joined #tripleo | 05:39 | |
jaosorior | dtrainor: ah, you brought it up already? | 05:39 |
jaosorior | Then that's great! | 05:39 |
dtrainor | yep sure did. trivial concerns that warped in to a discussion about something else but it went over well, that's when i decided to do the work | 05:39 |
jaosorior | dtrainor: I didn't know. Anyway, if that's the case. It's a matter of fixing the issues in the unit tests and you got a +2 from my side. | 05:41 |
dtrainor | excellent, i'll start on that in the A.M. | 05:42 |
*** nyechiel has quit IRC | 05:42 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Add barbican profile rspec testing https://review.openstack.org/388099 | 05:46 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Add barbican profile https://review.openstack.org/352447 | 05:46 |
*** nyechiel has joined #tripleo | 05:52 | |
*** apetrich has quit IRC | 05:54 | |
*** saneax-_-|AFK is now known as saneax | 05:55 | |
dtrainor | hmm, running in to a failed deployment from the controller, I see: galera(galera)[89879]: INFO: Waiting on node <overcloud-controller-0.internalapi.localdomain> to report database status before Master instances can start. | 05:56 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for gnocchi https://review.openstack.org/377645 | 05:56 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for ceilometer https://review.openstack.org/377644 | 05:56 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for aodh https://review.openstack.org/365457 | 05:56 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for keystone https://review.openstack.org/327029 | 05:56 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable internal TLS for MySQL https://review.openstack.org/378471 | 05:56 |
*** pkovar has joined #tripleo | 05:56 | |
dtrainor | in ControllerDeployment_Step2 | 05:56 |
jaosorior | dtrainor: that's the galera nodes taking time to report to pacemaker | 05:56 |
jaosorior | dtrainor: is the deployment taking unusually long? | 05:57 |
dtrainor | it is, it feels like a timeout | 05:57 |
*** nyechiel has quit IRC | 05:57 | |
*** apetrich has joined #tripleo | 05:58 | |
jaosorior | dtrainor: do you have this commit in your overcloud nodes? https://github.com/openstack/puppet-tripleo/commit/39d88a49bf83a7a3437edc82f42986596356d331 | 05:59 |
jaosorior | dtrainor: you can check if the code is there in /etc/puppet/modules/tripleo/ | 05:59 |
dciabrin | dtrainor: that's because of the value passed to gcomm://, it should read overcloud-controller-0. You probably miss a recent puppet-tripleo | 06:00 |
dtrainor | jaosorior, sure do. | 06:01 |
jaosorior | dtrainor: so you have that in the puppet manifest? | 06:01 |
dtrainor | i do, jaosorior | 06:01 |
jaosorior | ok | 06:02 |
jaosorior | so, what about t-h-t | 06:02 |
jaosorior | let me fetch the commit for you | 06:02 |
dtrainor | dciabrin, i see waht you mean: | 06:02 |
*** aufi has joined #tripleo | 06:02 | |
dtrainor | (well, if my paste buffer was working....?!?!?!) | 06:02 |
dciabrin | :) | 06:03 |
jaosorior | dtrainor: do you have this one https://github.com/openstack/tripleo-heat-templates/commit/6a408ff27e6fd6bff0a822f225c77a76690f805a ? | 06:03 |
jaosorior | in t-h-t | 06:03 |
dtrainor | Failed to open channel 'galera_cluster' at 'gcomm://overcloud-controller-0.internalapi.localdomain': -110 (Connection timed out) | 06:03 |
dciabrin | https://www.redhat.com/archives/rdo-list/2016-October/msg00080.html <- someone on RDO had the same issue a few weeks ago | 06:03 |
dtrainor | i saw that | 06:03 |
jaosorior | dtrainor: yep, that means that you're missing one of those two. | 06:03 |
dtrainor | got it. thank you | 06:03 |
jaosorior | dciabrin: will you get some time to do the RA fix so we can stop using those short-names? | 06:04 |
dtrainor | (RA?) | 06:05 |
dciabrin | jaosorior, it's the 3rd thing on my todo-list, for real :) | 06:05 |
jaosorior | dtrainor: Resource Agent? I think... dciabrin knows more specifics about this one. He's the Galera expert :D | 06:06 |
dciabrin | dtrainor, resource agent | 06:06 |
jaosorior | dciabrin: duuude nice :D | 06:06 |
dtrainor | ah ha. | 06:06 |
*** dsneddon_ has quit IRC | 06:08 | |
*** rcernin has joined #tripleo | 06:11 | |
*** akuznetsov has quit IRC | 06:17 | |
*** lmiccini has joined #tripleo | 06:18 | |
*** lmiccini has quit IRC | 06:18 | |
*** akuznetsov has joined #tripleo | 06:19 | |
openstackgerrit | yolanda.robla proposed openstack/tripleo-quickstart: Create directories with root https://review.openstack.org/384892 | 06:21 |
*** rasca has joined #tripleo | 06:21 | |
*** chandankumar has joined #tripleo | 06:23 | |
*** tobias_fiberdata has joined #tripleo | 06:24 | |
*** jprovazn has joined #tripleo | 06:26 | |
*** ealcaniz has joined #tripleo | 06:27 | |
*** newmember has joined #tripleo | 06:28 | |
*** apetrich has quit IRC | 06:29 | |
bandini | morning * | 06:29 |
*** ealcaniz__ has joined #tripleo | 06:31 | |
*** dsariel has quit IRC | 06:31 | |
*** ealcaniz has quit IRC | 06:32 | |
*** apetrich has joined #tripleo | 06:32 | |
*** xuao has quit IRC | 06:33 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for gnocchi https://review.openstack.org/377645 | 06:33 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for ceilometer https://review.openstack.org/377644 | 06:33 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for aodh https://review.openstack.org/365457 | 06:33 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for keystone https://review.openstack.org/327029 | 06:33 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable internal TLS for MySQL https://review.openstack.org/378471 | 06:33 |
*** cylopez has joined #tripleo | 06:35 | |
*** tremble has joined #tripleo | 06:37 | |
*** lmiccini has joined #tripleo | 06:37 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add Barbican to the overcloud https://review.openstack.org/352458 | 06:40 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: DO NOT MERGE testing barbican https://review.openstack.org/385737 | 06:40 |
*** akuznetsov has quit IRC | 06:41 | |
*** nyechiel has joined #tripleo | 06:41 | |
*** jaosorior has quit IRC | 06:47 | |
*** hjensas has joined #tripleo | 06:48 | |
*** hjensas has joined #tripleo | 06:48 | |
*** lazy_prince has quit IRC | 06:51 | |
*** lazy_prince has joined #tripleo | 06:51 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Revert "Fix grub installation for RHEL" https://review.openstack.org/388468 | 06:52 |
*** hjensas has quit IRC | 06:54 | |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Use Password Generation provided by the Mistral workflows https://review.openstack.org/375544 | 06:55 |
*** flepied1 has quit IRC | 06:56 | |
*** nyechiel has quit IRC | 06:59 | |
*** jaosorior has joined #tripleo | 07:00 | |
*** mgrohar has joined #tripleo | 07:03 | |
jaosorior | Hey guys, could anybody check these two commits out https://review.openstack.org/#/c/387202/ https://review.openstack.org/#/c/387203/ ?? | 07:03 |
*** bana_k has joined #tripleo | 07:06 | |
*** tesseract has joined #tripleo | 07:08 | |
*** mcornea has joined #tripleo | 07:09 | |
*** tesseract is now known as Guest90211 | 07:09 | |
*** mgrohar has quit IRC | 07:09 | |
*** jlinkes has joined #tripleo | 07:10 | |
*** tosky has joined #tripleo | 07:10 | |
d0ugal | What is the etiquette when backporting two changes to Newton? The first one has an issue that the second resolved. Should they be squashed? | 07:11 |
*** akuznetsov has joined #tripleo | 07:11 | |
*** snecklifter has joined #tripleo | 07:12 | |
*** akuznetsov has quit IRC | 07:13 | |
*** akuznetsov has joined #tripleo | 07:14 | |
*** jlinkes has quit IRC | 07:15 | |
*** zoli_gone-proxy is now known as zoliXXL | 07:18 | |
*** zoliXXL is now known as zoli|wfh | 07:19 | |
*** b00tcat has joined #tripleo | 07:20 | |
*** jlinkes has joined #tripleo | 07:23 | |
b00tcat | hi, can someone give me +workflow on these patches? https://review.openstack.org/#/c/383057/ https://review.openstack.org/#/c/383056/ | 07:25 |
d0ugal | jtomasek: FWIW, this has landed in the CLI now - https://review.openstack.org/#/c/382277/ | 07:27 |
d0ugal | jtomasek: so should be safe | 07:27 |
jtomasek | d0ugal: cool, I'll test the GUI patch on new setup I am going to do today | 07:28 |
d0ugal | jtomasek: cool, obviously still not urgent but thought I'd let you know | 07:28 |
jtomasek | d0ugal: yep, thanks | 07:29 |
*** ctayal has quit IRC | 07:29 | |
snecklifter | Any reason why diskimage-builder removes the repo files at the end of it's build? | 07:29 |
*** zoli|wfh is now known as zoli_gone-proxy | 07:29 | |
*** bana_k has quit IRC | 07:29 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for Nova API https://review.openstack.org/388495 | 07:31 |
*** skramaja_ has joined #tripleo | 07:32 | |
*** skramaja has quit IRC | 07:32 | |
b00tcat | snecklifter: where? | 07:33 |
snecklifter | b00tcat: on the built overcloud image | 07:33 |
snecklifter | this is only when I follow the mitaka stable instructions and just use the two export lines | 07:34 |
snecklifter | it basically calls 99-remove-yum-repo-conf but I'm not sure the logic behind this | 07:35 |
snecklifter | as you cannot update packages on the overcloud when this happens | 07:35 |
b00tcat | ah right, afaik you install the packages at image creation time for security/time optimization | 07:35 |
b00tcat | for instance I have puppet code that recreates them afterwards | 07:36 |
b00tcat | at provisioning time | 07:36 |
snecklifter | hmmm, weird | 07:36 |
*** zoli_gone-proxy is now known as zoliXXL | 07:36 | |
snecklifter | b00tcat: but when using trunk instructions the repo files remain in the finished image | 07:37 |
*** fzdarsky_ is now known as fzdarsky | 07:37 | |
b00tcat | hm, I use Mitaka for the time being too | 07:38 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Generate internal TLS hieradata for apache services https://review.openstack.org/366075 | 07:39 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Enable TLS in the internal networkf or Mysql https://review.openstack.org/378537 | 07:39 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Enable internal TLS for ceilometer https://review.openstack.org/377648 | 07:39 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Enable internal TLS for aodh https://review.openstack.org/377649 | 07:39 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Enable internal TLS for gnocchi https://review.openstack.org/377650 | 07:39 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Enable internal TLS for Nova API https://review.openstack.org/388503 | 07:39 |
snecklifter | b00tcat: ok, so you just pull down the repo files in firstboot.yaml? | 07:40 |
*** ebarrera has joined #tripleo | 07:40 | |
b00tcat | snecklifter: in theory all repo files that you have defined in $DIB_ variables should be removed https://github.com/openstack/diskimage-builder/blob/master/elements/yum/cleanup.d/99-remove-yum-repo-conf#L16 | 07:41 |
b00tcat | snecklifter: I do it in the .pp files actually that are ran when spawning the overcloud | 07:41 |
*** masco has joined #tripleo | 07:42 | |
snecklifter | b00tcat: ok, its another thing to do but I suppose there must be some logic to it, would just like to understand why they are removed | 07:43 |
*** akuznetsov has quit IRC | 07:45 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud: Always deploy HAProxy https://review.openstack.org/360368 | 07:48 |
*** jpich has joined #tripleo | 07:50 | |
*** akuznetsov has joined #tripleo | 07:51 | |
*** amoralej|off is now known as amoralej | 07:52 | |
*** abregman|afk is now known as abregman | 07:59 | |
d0ugal | TRIPLEO_ROOT is used in tripleo.sh here: https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L98-L100 but it isn't set until... ttps://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L154 | 08:01 |
d0ugal | My bash is terrible, but isn't that a problem? | 08:01 |
d0ugal | should we move L154 up, or the other block down? | 08:01 |
*** jpena|off is now known as jpena | 08:02 | |
d0ugal | This just happened recently. https://github.com/openstack-infra/tripleo-ci/commit/67deb95ed15870113ebb856629cbb0a1bd4eee55 | 08:02 |
*** ccamacho|out is now known as ccamacho | 08:04 | |
*** nyechiel has joined #tripleo | 08:05 | |
EmilienM | morning | 08:07 |
jaosorior | EmilienM: wow, you're early | 08:07 |
jaosorior | EmilienM: morning dude, what's up? | 08:08 |
EmilienM | jaosorior: i'm arrived in Spain | 08:08 |
jaosorior | EmilienM: nice! how's things over there? Are you in BCN already? | 08:08 |
EmilienM | yes but moving out of the city for PTOs | 08:08 |
EmilienM | I just came here and say hi | 08:09 |
EmilienM | jaosorior: I need to know which puppet modules did you backport the proxy/tls stuff | 08:10 |
jaosorior | EmilienM: have fun dude! | 08:10 |
EmilienM | aodh, ceilo, gnocchi and more? | 08:10 |
jaosorior | aodh, ceilo and gnocchi, that's all. Neutron hasn't approved my backport so I can't backport to puppet-neutron yet. | 08:10 |
EmilienM | ok. I'll release them today | 08:11 |
EmilienM | please let me know if you backport more. I need to know | 08:11 |
jaosorior | EmilienM: you can't +A this one yet https://review.openstack.org/#/c/388099/ since it depends on this https://review.openstack.org/#/c/352447/ | 08:11 |
jaosorior | EmilienM: well, you can, but it won't merge it. | 08:11 |
b00tcat | EmilienM: if you like beer, there's the clone of oktoberfest in BCN at the moment | 08:11 |
EmilienM | jaosorior: right, it won't merge. I dropped +A | 08:11 |
*** flepied has joined #tripleo | 08:12 | |
EmilienM | b00tcat: thanks, but not staying in town this week. I'm with family until Sunday, out of town | 08:12 |
jaosorior | oktoberfest clone? Damn! should have travelled earlier :( | 08:12 |
EmilienM | and nothing can clone real oktoberfest :P | 08:12 |
EmilienM | I did it one time, it's not clonable ! | 08:12 |
b00tcat | lol | 08:12 |
EmilienM | I actually don't remember everything | 08:13 |
jaosorior | beer is good anyway, doesn't have to be the same | 08:13 |
EmilienM | well, that's another story | 08:13 |
jaosorior | lol | 08:13 |
d0ugal | EmilienM: hi! | 08:13 |
EmilienM | d0ugal: hey oh | 08:13 |
jaosorior | EmilienM: anyway, enjoy your PTO dude! | 08:13 |
EmilienM | thanks | 08:13 |
jaosorior | EmilienM: is there any patches you need me to take over? | 08:13 |
d0ugal | Yeah, well deserved PTO :) | 08:13 |
* d0ugal was just saying hi back | 08:13 | |
EmilienM | please watch d0ugal so he doesn't break CI | 08:13 |
d0ugal | lol | 08:13 |
EmilienM | /joke | 08:13 |
d0ugal | I'm gonna stop fixing things now :P | 08:14 |
*** ohamada has joined #tripleo | 08:14 | |
EmilienM | d0ugal: no please :P | 08:14 |
EmilienM | can you guys approve this backport ? https://review.openstack.org/#/c/388272/ | 08:15 |
*** ohamada has quit IRC | 08:15 | |
openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: Fix broken rabbitmqctl commands when using ipv6 https://review.openstack.org/388529 | 08:15 |
*** rcernin has quit IRC | 08:16 | |
jaosorior | EmilienM: done | 08:16 |
*** rcernin has joined #tripleo | 08:16 | |
*** ohamada has joined #tripleo | 08:17 | |
EmilienM | jaosorior: thx | 08:17 |
d0ugal | EmilienM: What is the etiquette when backporting two changes to Newton? The first one has an issue that the second resolved. Should they be squashed? | 08:17 |
*** rcernin has quit IRC | 08:18 | |
EmilienM | d0ugal: good idea | 08:18 |
EmilienM | d0ugal: I'm ok with squashing, as long as it's cleanly done | 08:18 |
d0ugal | EmilienM: okay, I'll include both commit messages and add a note to say why. thanks | 08:18 |
*** rcernin has joined #tripleo | 08:19 | |
EmilienM | d0ugal: excellent | 08:19 |
*** rcernin has quit IRC | 08:19 | |
d0ugal | Looks like I have finally got this to go green - https://review.openstack.org/#/c/375544/ | 08:19 |
*** rcernin has joined #tripleo | 08:19 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 08:19 |
d0ugal | It has only taken me about two weeks of trying different approaches and breaking and fixing things :P | 08:20 |
EmilienM | d0ugal: I saw, but it depends on some patches that fail. I guess you want them squashed? | 08:20 |
* jaosorior off for food | 08:20 | |
*** jaosorior is now known as jaosorior_lunch | 08:20 | |
d0ugal | EmilienM: I need to go through them and figure out the best approach. | 08:21 |
d0ugal | EmilienM: all the depends-on have merged in master, but not Newton | 08:21 |
d0ugal | EmilienM: so yeah, I think I might need to squash for newton, I'll figure it out now. | 08:21 |
*** milan has joined #tripleo | 08:22 | |
EmilienM | d0ugal: ack | 08:22 |
d0ugal | EmilienM: How is your bash? Shouldn't this be after line 154? https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L98 | 08:24 |
d0ugal | (or 154 should be before that) | 08:24 |
*** akuznetsov has quit IRC | 08:24 | |
openstackgerrit | Dougal Matthews proposed openstack-infra/tripleo-ci: Set TRIPLEO_ROOT before it is first used https://review.openstack.org/388542 | 08:25 |
d0ugal | i.e. ^ | 08:25 |
EmilienM | d0ugal: mhh good question, let me look | 08:25 |
EmilienM | d0ugal: have you seen problems in CI? | 08:25 |
d0ugal | EmilienM: I got an error on my local scripts | 08:26 |
EmilienM | d0ugal: but your patch makes sense | 08:26 |
d0ugal | EmilienM: I think I might have a stricter bash flag that doesn't allow unbound variables? | 08:26 |
EmilienM | maybe? it could have been exported in another script also | 08:27 |
EmilienM | I'm +2ing your patch as it makes sense to set it before using it | 08:27 |
d0ugal | EmilienM: Thanks | 08:27 |
openstackgerrit | Dougal Matthews proposed openstack-infra/tripleo-ci: Set TRIPLEO_ROOT before it is first used https://review.openstack.org/388542 | 08:34 |
d0ugal | EmilienM: ^ add some more info to the commit message. | 08:34 |
EmilienM | ok | 08:35 |
*** nyechiel has quit IRC | 08:35 | |
*** florianf has joined #tripleo | 08:36 | |
*** derekh has joined #tripleo | 08:39 | |
*** anbu has joined #tripleo | 08:42 | |
*** anbu_ has quit IRC | 08:43 | |
*** anbu_ has joined #tripleo | 08:45 | |
*** dtantsur|afk is now known as dtantsur|sick | 08:46 | |
*** anbu has quit IRC | 08:46 | |
*** anbu__ has joined #tripleo | 08:47 | |
*** egafford has joined #tripleo | 08:49 | |
*** anbu_ has quit IRC | 08:50 | |
*** anbu_ has joined #tripleo | 08:52 | |
*** anbu__ has quit IRC | 08:54 | |
*** anbu has joined #tripleo | 08:55 | |
*** anbu_ has quit IRC | 08:57 | |
openstackgerrit | Merged openstack/tripleo-common: Updated from global requirements https://review.openstack.org/381148 | 08:57 |
*** social has joined #tripleo | 09:00 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Fixed NoneType issue when monitoring-environment.yaml https://review.openstack.org/388272 | 09:02 |
*** abregman is now known as abregman|afk | 09:05 | |
* EmilienM off for pto | 09:05 | |
*** jaosorior_lunch is now known as jaosorior | 09:05 | |
jaosorior | hey guys, I would REALLY appreciate reviews for these commits https://review.openstack.org/#/q/topic:bp/tls-via-certmonger+status:open they've been there for a while and they're stacking up | 09:07 |
*** chandankumar has quit IRC | 09:08 | |
*** tobias_fiberdata has quit IRC | 09:08 | |
*** chandankumar has joined #tripleo | 09:08 | |
jaosorior | ccamacho: hey dude, how's it going? | 09:08 |
jaosorior | ccamacho: feeling better from the flu? | 09:09 |
*** links has quit IRC | 09:09 | |
*** chandankumar has quit IRC | 09:09 | |
d0ugal | jaosorior: wow, that is quite a few reviews :) | 09:09 |
*** chandankumar has joined #tripleo | 09:09 | |
openstackgerrit | Jiri Stransky proposed openstack/diskimage-builder: RH grub: don't fail if grub is already installed https://review.openstack.org/388567 | 09:09 |
jaosorior | d0ugal: yeah dude, I REALLY need reviews, people don't like reviewing TLS stuff so it seems :( | 09:10 |
ccamacho | jaosorior, hey man! well... not really, now Im getting keystone issues as the apache is not working, the thing is that im like a potato in front of the laptop (cant focus because the flu).. | 09:11 |
shadower | jaosorior: I'll have some time in a bit. Will have a look | 09:11 |
ccamacho | between the headache the fever and the nose leaking.. got me covered.. | 09:11 |
*** anbu_ has joined #tripleo | 09:11 | |
jaosorior | ccamacho: apache is not working? did you enable Gnocchi? | 09:12 |
ccamacho | people dont like to review the TLS patches :P BTW the issues im getting are not related with the submissions | 09:12 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: Fix broken rabbitmqctl commands when using ipv6 https://review.openstack.org/388568 | 09:12 |
ccamacho | Its just I dont know what im doing wrong.. | 09:12 |
ccamacho | have you recently tried to deploy locally master? | 09:13 |
jaosorior | ccamacho: if you enable Gnocchi, it might break, because we need some selinux rules update that already merged in RHEL | 09:13 |
*** anbu has quit IRC | 09:13 | |
panda | CI is a colander .. I cork a failure, another shows up immediately after :( | 09:13 |
jaosorior | ccamacho: alright, is that issue in the overcloud or undercloud? | 09:13 |
jaosorior | panda: what happened now? :O | 09:14 |
jaosorior | ccamacho: if it's undercloud, that issue should be fixed with a recent commit. It was an issue with ceilometer. | 09:15 |
jaosorior | ccamacho: if it's overcloud, it might be a selinux issue, and you might need to disable it for now. We need an update in CentOS | 09:15 |
ccamacho | jaosorior, I though t that dude, so I said f#*k it.. and re-installed everything.. now the endpoints are just not starting (httpd in the OC controller) | 09:15 |
jaosorior | if it's none of the above, I am yet to see it | 09:15 |
ccamacho | so now im reading logs in the controller and I need to records some screencasts for the summit... | 09:16 |
ccamacho | so.. | 09:16 |
panda | jaosorior: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-newton/250707b/logs/postci.txt.gz#_2016-10-19_08_15_38_000 | 09:16 |
jaosorior | ccamacho: can I get access to the node? I could check it out | 09:16 |
panda | jaosorior: I think ceilometer patch caused some other issues | 09:16 |
jaosorior | panda: the ceilometer patch was for the undercloud, not the overcloud | 09:17 |
panda | also, I have liberty and tempest timing out, so no logs | 09:17 |
ccamacho | sure, just give me some mins (call with my manager) | 09:17 |
ccamacho | jaosorior ^ | 09:17 |
jaosorior | ccamacho: sure | 09:17 |
panda | jaosorior: ah, yay! a new whole problem then | 09:17 |
*** zoliXXL is now known as zoli|wfh | 09:17 | |
jaosorior | panda: that might be the same issue ccamacho is seeing. issues with httpd | 09:17 |
ccamacho | jaosorior panda, yeahp same error | 09:19 |
jaosorior | ccamacho: so you're seeing an upstream issue. | 09:19 |
jaosorior | crap | 09:20 |
jaosorior | ok, lets see what's up | 09:20 |
d0ugal | Silly question: If I build and install a package locally, how do I have yum install the latest version from delorean or whever is setup? | 09:20 |
ccamacho | jaosorior yeah because I said, let me re-install all from scratch and then buuum... facepalm... another (new) issue... | 09:21 |
openstackgerrit | afazekas proposed openstack/python-tripleoclient: Disable encrypted volume in the tempest-deployer-input.conf https://review.openstack.org/384868 | 09:22 |
*** stendulker has joined #tripleo | 09:22 | |
panda | d0ugal: priority ? | 09:22 |
d0ugal | panda: ? | 09:22 |
jaosorior | any idea what this means? | 09:22 |
jaosorior | Oct 19 11:04:50 overcloud-controller-1 systemd[1]: httpd.service start-pre operation timed out. Terminating. | 09:22 |
*** anbu_ has quit IRC | 09:25 | |
d0ugal | panda: Yeah, I am hitting something with priorities that I don't understand :) | 09:25 |
*** anbu_ has joined #tripleo | 09:25 | |
jaosorior | panda: I can see that at some point the httpd services go up and haproxy marks them as such. But at some point httpd is killed or something, still not sure what happened there. | 09:25 |
*** anbu__ has joined #tripleo | 09:29 | |
jaosorior | panda: only log I see from httpd is that there is a SIGWINCH that shut down apache at some point... nothing else looks suspicious that I could find :/ | 09:31 |
*** anbu_ has quit IRC | 09:32 | |
panda | SIGWINCH ? ... signal on window size change ? not the first time I see it, and it makes it even more weird | 09:32 |
*** anbu__ has quit IRC | 09:34 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: [WIP] remove rh grub workaround stuff https://review.openstack.org/388580 | 09:34 |
*** anbu has joined #tripleo | 09:34 | |
jaosorior | panda: the only suspicious thing is that I found these ones: Oct 19 10:43:19 overcloud-controller-1 python[15373]: ERROR:scss.ast:Function not found: twbs-font-path:1 | 09:35 |
jaosorior | which I think come from horizon | 09:35 |
jaosorior | could it be that the horizon vhost is having issues and thus preventing the other vhosts to start? | 09:35 |
panda | I think I've seen scss.ast errors other times, an they were not fatal | 09:36 |
jaosorior | panda: ok... will look at the audit log, maybe there's something there | 09:38 |
*** akrivoka has joined #tripleo | 09:40 | |
jaosorior | panda: interesting: type=SERVICE_START msg=audit(1476864299.785:1925): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=httpd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=failed' | 09:40 |
bandini | go 24 | 09:40 |
bandini | ops | 09:40 |
jaosorior | ah | 09:40 |
jaosorior | nevermind | 09:40 |
jaosorior | bandini: O_O | 09:41 |
bandini | :) | 09:41 |
*** ohamada has quit IRC | 09:42 | |
*** ohamada has joined #tripleo | 09:42 | |
*** yamahata has quit IRC | 09:42 | |
*** jaosorior has quit IRC | 09:43 | |
*** jaosorior has joined #tripleo | 09:43 | |
*** anbu has quit IRC | 09:44 | |
*** anbu has joined #tripleo | 09:44 | |
*** tobias_fiberdata has joined #tripleo | 09:46 | |
*** hjensas has joined #tripleo | 09:46 | |
*** hjensas has joined #tripleo | 09:46 | |
akrivoka | jtomasek: so your deployment worked without post config? | 09:47 |
*** anbu has quit IRC | 09:47 | |
jaosorior | panda: I'm really suspicious of horizon though | 09:49 |
jaosorior | panda: in system.journal I see a LOT of Oct 19 11:03:35 overcloud-controller-1 python[31338]: ERROR:scss.ast:Function not found: function-exists:1 | 09:49 |
jtomasek | akrivoka: not entirely, I am trying to debug it but I am getting http 504 error both when trying to access horizon and when running any openstack cli command | 09:49 |
jaosorior | like | 09:49 |
jaosorior | a disturbing lot | 09:50 |
jtomasek | akrivoka: but I think the endpoints are setup | 09:50 |
jtomasek | akrivoka: at least openstack stack show has that info | 09:50 |
*** limao has quit IRC | 09:50 | |
jtomasek | akrivoka: I am trying to run another deployment | 09:50 |
akrivoka | jtomasek: and is it a newton installation? or latest? | 09:51 |
panda | jaosorior: I'm prettty sure those errors can be ignored | 09:51 |
jtomasek | akrivoka: latest | 09:51 |
akrivoka | jtomasek: another question, were you using DIB_INSTALLTYPE_puppet_modules=source when installing undercloud? | 09:52 |
jtomasek | akrivoka: yes | 09:52 |
akrivoka | jtomasek: oh and how did you work around the syntax errors from yesterday? | 09:53 |
jtomasek | akrivoka: that setup where I managed to deploy is from Friday last week | 09:53 |
jtomasek | akrivoka: the other one I was still hitting the syntax error. I am doing another install today to see if it still occurs | 09:53 |
akrivoka | ah, I see | 09:54 |
flepied | hi derekh, do you know who has worked on building packages on the fly for tripleo CI jobs? | 09:54 |
jaosorior | panda: alright. | 09:55 |
jaosorior | ccamacho: let me know if I can poke on your deployment, if you have reproduced the issue would be good to take a look there. | 09:55 |
derekh | flepied: it was me who originally wrote it but that was will over a year ago, you should find a few people in here familiar with it, shardy sshnaidm|away panda slagle bnemec would all be familiar with it | 09:58 |
*** andrey-mp has joined #tripleo | 09:58 | |
andrey-mp | Hi! Does this bug https://bugzilla.redhat.com/show_bug.cgi?id=1221776 have related bug in launchpad? is it fixed somewhere? | 09:59 |
openstack | bugzilla.redhat.com bug 1221776 in rhel-osp-director "nova migrate fails with ssh command failure" [High,Assigned] - Assigned to emacchi | 09:59 |
panda | flepied: what do you mean with "on the fly" ? | 09:59 |
panda | ccamacho: you crated a bug somewhere for the errors on httpd ? | 10:00 |
ccamacho | hey panda, not yet, hitting another issue with tripleo.sh | 10:00 |
openstackgerrit | Julie Pichon proposed openstack/puppet-tripleo: Persist the UI config file https://review.openstack.org/388592 | 10:03 |
flepied | panda: building packages from reviews | 10:04 |
*** hewbrocca-afk is now known as hewbrocca | 10:05 | |
*** mgould|afk is now known as mgould | 10:08 | |
panda | flepied: we are calling delorean to create packages on the fly in tripleO CI, setting up a local repo, and giving it an high priority | 10:09 |
flepied | panda: yes i'm looking for this code | 10:13 |
panda | flepied: https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L347 | 10:14 |
openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Unbound variable when executing tripleo.sh https://review.openstack.org/388594 | 10:14 |
jaosorior | derekh: can you check this out? ^^ | 10:19 |
ccamacho | jaosorior, panda. trying to reproduce the httpd error ill let you know asap.. /me hoping not to hit more things :P | 10:20 |
*** pblaho has joined #tripleo | 10:20 | |
jaosorior | ccamacho: good luck | 10:20 |
ccamacho | jaja | 10:20 |
jaosorior | ccamacho: I'm re-deploying everything from scratch, see if I can reproduce it | 10:22 |
ccamacho | jaosorior, let the force be with you | 10:23 |
jaosorior | ccamacho: seems d0ugal had proposed a commit for the unbound variable https://review.openstack.org/#/c/388542/2 | 10:23 |
d0ugal | :) | 10:23 |
ccamacho | d0ugal jaosorior, ACK :) | 10:24 |
jtomasek | akrivoka: I am still getting the same error http://paste.openstack.org/show/586346/ | 10:26 |
jtomasek | akrivoka, jaosorior^ you've discussed this yesterday, what was the patch which was supposed to fix it? | 10:27 |
jaosorior | jtomasek: we are pinning puppetlabs-ntp IIRC. Since they no longer support puppet 3 | 10:27 |
jaosorior | jtomasek: that was another bug :D | 10:27 |
jtomasek | jaosorior: ok, how do I fix that? | 10:27 |
jaosorior | jtomasek: good question. I don't know. | 10:27 |
*** cdearborn has joined #tripleo | 10:28 | |
jtomasek | jaosorior: I am going to file a bug for it, ok? | 10:28 |
jaosorior | jtomasek: sure | 10:28 |
derekh | jaosorior: looking | 10:29 |
*** tobias-fiberdata has joined #tripleo | 10:31 | |
*** tobias_fiberdata has quit IRC | 10:35 | |
jaosorior | marios: hey dude, could you check this out https://review.openstack.org/#/c/327029/ ? | 10:39 |
*** fzdarsky is now known as fzdarsky|lunch | 10:40 | |
marios | jaosorior: k | 10:42 |
*** phpcodemonkey has joined #tripleo | 10:44 | |
*** zoli|wfh is now known as zoli|lunch | 10:46 | |
*** abregman|afk is now known as abregman | 10:48 | |
bandini | meh launchpad timing out here | 10:50 |
openstackgerrit | Dougal Matthews proposed openstack/instack-undercloud: Only create the Mistral config env if it doesn't exist https://review.openstack.org/387832 | 10:50 |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fetch the snmpd_readonly_user_password from the Mistral environment https://review.openstack.org/385323 | 10:52 |
*** phpcodemonkey has quit IRC | 10:52 | |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fetch the snmpd_readonly_user_password from the Mistral environment https://review.openstack.org/385323 | 10:53 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Use Password Generation provided by the Mistral workflows https://review.openstack.org/375544 | 10:54 |
openstackgerrit | Ryan Brady proposed openstack/tripleo-common: [WIP]Adds retry to plan workflows https://review.openstack.org/388285 | 10:56 |
jtomasek | akrivoka, jaosorior: it should have been fixed: https://review.openstack.org/#/c/387098/ https://review.rdoproject.org/r/gitweb?p=rdoinfo.git;a=commitdiff;h=ecf4cecc0087b1595243af19d049783005f033ba | 10:59 |
jtomasek | akrivoka, jaosorior: the pupetlabs-ntp package version I have on my undercloud is 4.2.0-0.20161017093645.93da3bd.el7.centos | 11:00 |
jtomasek | akrivoka, jaosorior: I don't understand why I get the error | 11:00 |
*** tobias_fiberdata has joined #tripleo | 11:01 | |
openstackgerrit | Merged openstack/puppet-tripleo: Include ::swift::config in Swift API and Storage roles https://review.openstack.org/383721 | 11:02 |
*** tobias-fiberdata has quit IRC | 11:04 | |
akrivoka | jtomasek: I have puppet-ntp-4.2.0-0.20161017093645.93da3bd.el7.centos.noarch on a fresh install | 11:04 |
akrivoka | still haven't tried a deploy tho | 11:04 |
jtomasek | jaosorior, akrivoka: the code in /usr/share/openstack-puppet/modules/ntp/manifests/init.pp is correct, the error is in overcloud controller | 11:04 |
jtomasek | akrivoka, jaosorior: so I assume it is a same problem but in overcloud image? | 11:05 |
*** limao has joined #tripleo | 11:06 | |
*** limao_ has joined #tripleo | 11:08 | |
*** thrash|g0ne is now known as thrash | 11:10 | |
*** pkovar has quit IRC | 11:10 | |
*** tobias-fiberdata has joined #tripleo | 11:10 | |
*** limao has quit IRC | 11:11 | |
*** stendulker has quit IRC | 11:14 | |
*** tobias_fiberdata has quit IRC | 11:14 | |
*** jcoufal has joined #tripleo | 11:26 | |
*** snecklifter has quit IRC | 11:30 | |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates: Fix api_extensions_path in neutron-opencontrail environment https://review.openstack.org/388629 | 11:32 |
panda | jaosorior: apparently apache2 officially uses SIGWINCH as graceful stop, because all the other signals are taken. For for esample you're running in foreground, and you resize the terminal, apache shuts down. | 11:32 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates: Fix api_extensions_path in neutron-opencontrail environment https://review.openstack.org/388631 | 11:33 |
jaosorior | panda: lol, wtf | 11:33 |
jaosorior | marios: here's the t-h-t change https://review.openstack.org/#/c/366075/ | 11:34 |
jistr | jaosorior: thanks for the backport review, can you please look at the newton and liberty ones too https://review.openstack.org/388047 https://review.openstack.org/388631 | 11:35 |
jistr | the newton one is ready to land | 11:35 |
marios | jaosorior: thanks added for tomorrow | 11:35 |
jaosorior | marios: thanks dude, appreciate it | 11:36 |
*** zoli|lunch is now known as zoli_gone-proxy | 11:36 | |
jaosorior | marios: if you have extra time, this is where the tls-via-certmonger stuff is being tracked https://review.openstack.org/#/q/status:open+branch:master+topic:bp/tls-via-certmonger | 11:37 |
jaosorior | marios: but those two are the most crucial commits. The rest is a bit reppetitive stuff for enabling specific services. | 11:37 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart: Stop using deprecated network range https://review.openstack.org/343443 | 11:38 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements https://review.openstack.org/388635 | 11:38 |
openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart: make upgrade use the extras dependencies https://review.openstack.org/385503 | 11:43 |
openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient: TEST - DO NOT MERGE https://review.openstack.org/387405 | 11:43 |
marios | jaosorior: noted | 11:43 |
*** snecklifter has joined #tripleo | 11:44 | |
jistr | thanks jaosorior | 11:45 |
jaosorior | jistr: no biggie | 11:46 |
*** lucas-afk is now known as lucas-sick | 11:47 | |
*** zoli_gone-proxy is now known as zoliXXL | 11:47 | |
*** zoliXXL is now known as zoli|lunch | 11:47 | |
*** saneax is now known as saneax-_-|AFK | 11:48 | |
openstackgerrit | Sven Anderson proposed openstack/puppet-tripleo: Implement Nova ec2api profile https://review.openstack.org/336562 | 11:48 |
*** rbrady-afk is now known as rbrady | 11:49 | |
akrivoka | jtomasek: yeah I'm hitting the same issue again | 11:49 |
*** pkovar has joined #tripleo | 11:49 | |
*** [1]cdearborn has joined #tripleo | 11:50 | |
openstackgerrit | sebastien aime proposed openstack/tripleo-image-elements: fixed an error in os-collect-config if /{a,b} files exist https://review.openstack.org/388644 | 11:51 |
*** bfournie has quit IRC | 11:51 | |
*** athomas has quit IRC | 11:51 | |
*** abregman is now known as abregman|afk | 11:52 | |
afazekas | looking for reviewers for this backport: https://review.openstack.org/#/c/387299/ | 11:53 |
panda | wat ? Oct 19 08:04:56 localhost python: ERROR:scss.compiler:Maximum number of supported selectors in Internet Explorer (4095) exceeded! | 11:56 |
openstackgerrit | Merged openstack/tripleo-quickstart: make upgrade use the extras dependencies https://review.openstack.org/385503 | 11:57 |
*** fzdarsky|lunch is now known as fzdarsky | 11:57 | |
*** limao_ has quit IRC | 11:58 | |
openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart: Upgrade job dont need the overcloud workers settings https://review.openstack.org/388211 | 11:58 |
*** athomas has joined #tripleo | 12:00 | |
*** noslzzp has quit IRC | 12:02 | |
*** noslzzp has joined #tripleo | 12:03 | |
*** abehl has joined #tripleo | 12:03 | |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Dont run gnocchi upgrade before converge https://review.openstack.org/388649 | 12:05 |
*** cdearborn has quit IRC | 12:05 | |
*** dprince has joined #tripleo | 12:06 | |
*** gfidente has joined #tripleo | 12:06 | |
openstackgerrit | Merged openstack/tripleo-quickstart: Upgrade job dont need the overcloud workers settings https://review.openstack.org/388211 | 12:08 |
*** sudipto has joined #tripleo | 12:11 | |
*** sudipto_ has joined #tripleo | 12:11 | |
*** maticue has joined #tripleo | 12:11 | |
*** skramaja_ is now known as skramaja | 12:12 | |
*** abehl has quit IRC | 12:16 | |
*** morazi has joined #tripleo | 12:16 | |
*** zoli|lunch is now known as zoli|wfh | 12:16 | |
*** rhallisey has joined #tripleo | 12:19 | |
*** links has joined #tripleo | 12:20 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Fix api_extensions_path in neutron-opencontrail environment https://review.openstack.org/388047 | 12:21 |
*** jayg|g0n3 is now known as jayg | 12:24 | |
*** morazi has quit IRC | 12:24 | |
*** [1]cdearborn has quit IRC | 12:26 | |
*** trown|outtypewww is now known as trown | 12:26 | |
bandini | panda: I have seen that one too | 12:26 |
*** hewbrocca is now known as hewbrocca-afk | 12:29 | |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: [WIP] Testing adding metadata to roles https://review.openstack.org/386472 | 12:32 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: Have docker start script honor configuration https://review.openstack.org/366138 | 12:32 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: WIP: Containerized Services for Composable Roles https://review.openstack.org/330659 | 12:32 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates: Bind mount files to run DiD in latest atomic host https://review.openstack.org/347218 | 12:32 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Set TRIPLEO_ROOT before it is first used https://review.openstack.org/388542 | 12:33 |
*** abregman|afk is now known as abregman | 12:33 | |
*** bfournie has joined #tripleo | 12:36 | |
*** morazi has joined #tripleo | 12:37 | |
*** rlandy has joined #tripleo | 12:38 | |
panda | bandini: which one ? | 12:39 |
akrivoka | jtomasek: jaosorior: here's the bug for the puppet syntax error issue https://bugs.launchpad.net/tripleo/+bug/1633713 | 12:40 |
openstack | Launchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,Fix released] | 12:40 |
*** afazekas has quit IRC | 12:41 | |
akrivoka | jtomasek: jaosorior the fix is merged but the problem still remains, I guess I should reopen the bug | 12:41 |
*** afazekas has joined #tripleo | 12:42 | |
shadower | d0ugal: any idea how to move this forward? https://review.openstack.org/#/c/379348/ | 12:42 |
bandini | panda: Maximum number of supported selectors in Internet Explorer ... | 12:43 |
shadower | d0ugal: it got +A before its dependency merged but that has happened now and this one is still waiting | 12:43 |
*** myoung|alt is now known as myoung | 12:43 | |
d0ugal | shadower: Yeah, I think that was the problem. Removing the +A and re-adding usually solves it. | 12:44 |
*** jaosorior has quit IRC | 12:44 | |
shadower | d0ugal: ah, thanks! | 12:44 |
d0ugal | shadower: I think "reverify" might also do the trick if that doesn't | 12:44 |
*** jaosorior has joined #tripleo | 12:44 | |
d0ugal | shadower: but it seems jenkins is already on it | 12:44 |
shadower | yeah | 12:44 |
*** dciabrin has quit IRC | 12:44 | |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: Remove the replace controller docs https://review.openstack.org/381469 | 12:46 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: Fix the rabbitmq/redis pacemaker resource timeouts on updates https://review.openstack.org/388676 | 12:46 |
honza | when using the cli to deploy, it's complaining about a missing tripleo.undercloud-config --- is that new? am i missing some config? | 12:47 |
d0ugal | honza: What version are you running? | 12:47 |
honza | d0ugal: latest master | 12:47 |
d0ugal | honza: This is a new thing, it had a slightly rough landing | 12:47 |
honza | d0ugal: of tripleo-common --- is that what you mean? | 12:47 |
jpich | honza: Of aaall the things :-) | 12:47 |
d0ugal | honza: Yeah, but also instack-undercloud is impacted | 12:48 |
honza | d0ugal: jpich: YISS I'm not crazy | 12:48 |
honza | d0ugal: so it's been resolved, and i just need all the new things? | 12:48 |
*** jpena is now known as jpena|lunch | 12:48 | |
d0ugal | honza: Yeah, only just solved, so it might depend on package promotion? | 12:49 |
d0ugal | honza: https://review.openstack.org/#/q/I94428d1deb000c65a1c0266d01f660b76d4a3ee5,n,z | 12:49 |
d0ugal | honza: That resolves it, it isn't resolved in Newton yet | 12:49 |
honza | d0ugal: thanks | 12:49 |
d0ugal | honza: instack-undercloud is a depends-on which is why that is also impacted, and then you need to run the undercloud install again if you are going to update | 12:50 |
honza | d0ugal: hm, that commit is in my tree | 12:50 |
d0ugal | honza: Can you show me `mistral environment-list`? | 12:51 |
*** amoralej is now known as amoralej|lunch | 12:52 | |
d0ugal | honza: it might be that deleting the default plan and re-creating it works. | 12:52 |
d0ugal | honza: it depends how far you got really... | 12:52 |
*** Goneri has joined #tripleo | 12:53 | |
honza | d0ugal: http://paste.openstack.org/show/586372/ | 12:53 |
d0ugal | honza: lol @ ohhai | 12:54 |
honza | :D | 12:54 |
d0ugal | honza: Okay, so, do you have this commit? https://review.openstack.org/#/q/I186217fd0e1125519149763e610d3efdff583388,n,z | 12:54 |
honza | makes it easy to grep for :) | 12:54 |
*** egafford has quit IRC | 12:55 | |
d0ugal | honza: I use "overcast" which is just confusing because at a glance it looks like the default | 12:55 |
*** tzumainn has joined #tripleo | 12:56 | |
d0ugal | honza: it seems like your tripleo-common is newer than your instack-undercloud | 12:56 |
d0ugal | and that would cause an issue | 12:56 |
honza | d0ugal: not sure where to look for the instack repo | 12:56 |
honza | d0ugal: sweet, thanks --- upgrading now | 12:56 |
d0ugal | honza: >>> import instack_undercloud | 12:57 |
d0ugal | >>> instack_undercloud.__file__ | 12:57 |
d0ugal | '/usr/lib/python2.7/site-packages/instack_undercloud/__init__.pyc' | 12:57 |
d0ugal | You could just look at the files in there I guess | 12:57 |
d0ugal | honza: after you update instack-undercloud, (yum would probably do it?) you will need to run `openstack undercloud install` again. | 12:58 |
d0ugal | honza: or, if you want a hacky workaround I can show you how to do that too :) | 12:58 |
*** egafford has joined #tripleo | 12:58 | |
honza | d0ugal: yep | 12:58 |
jpich | You might need to update your delorean repo to point to the latest | 12:58 |
honza | yes, using the upstream docs | 12:59 |
*** links has quit IRC | 12:59 | |
*** sudipto_ has quit IRC | 13:01 | |
*** sudipto has quit IRC | 13:01 | |
*** remix_tj has quit IRC | 13:01 | |
*** remix_tj has joined #tripleo | 13:01 | |
d0ugal | honza: the hacky fix: http://paste.openstack.org/show/586375/ | 13:02 |
d0ugal | honza: you need to change the password to whatever you get from: sudo hiera snmpd_readonly_user_password | 13:02 |
d0ugal | honza: that is all the instack-undercloud code does. | 13:03 |
*** snecklifter has quit IRC | 13:05 | |
*** jprovazn has quit IRC | 13:06 | |
openstackgerrit | Merged openstack/tripleo-quickstart: Remove images/publish role https://review.openstack.org/388189 | 13:06 |
*** dciabrin has joined #tripleo | 13:06 | |
*** cylopez has quit IRC | 13:08 | |
*** jcoufal_ has joined #tripleo | 13:09 | |
*** StevenK has quit IRC | 13:09 | |
rbrady | jtomasek: ping | 13:09 |
*** florianf has quit IRC | 13:10 | |
rbrady | jtomasek: just stepped through a deployment with a debugger and confirmed the _deploy_postconfig method didn't call _keystone_init at all | 13:10 |
*** fultonj has joined #tripleo | 13:11 | |
*** cylopez has joined #tripleo | 13:11 | |
jtomasek | rbrady: nice | 13:11 |
openstackgerrit | Merged openstack/tripleo-quickstart: Generalize check for release name for OVB stack clean up https://review.openstack.org/386624 | 13:11 |
*** jcoufal has quit IRC | 13:12 | |
*** lblanchard has joined #tripleo | 13:12 | |
jtomasek | akrivoka: the bug occurs in overcloud controller, so I wonder that maybe we just need latest images. I am not sure how recent images are used when following upstream docs | 13:14 |
akrivoka | jtomasek: I built images following the docs | 13:15 |
*** StevenK has joined #tripleo | 13:15 | |
rbrady | jtomasek: is there something similar to the overcloudrc file the UI needs? | 13:16 |
jtomasek | akrivoka: hm, me too, I assume that repo used is the latest we can get http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master-tripleo/ | 13:16 |
*** jaosorior is now known as jaosorior_brb | 13:17 | |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: Remove double tcp_listen_options entries for rabbit https://review.openstack.org/388695 | 13:18 |
jtomasek | rbrady: we're providing similar information via GUI, but I think it would be good to make sure overcloudrc is created regardless of what is used to deploy, so if user swiches to CLI he has it available | 13:18 |
jtomasek | rbrady, d0ugal: what is this? https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_deploy.py#L1232 | 13:19 |
d0ugal | jtomasek: a comment? :) it seems to just be the logic which controls if the postconfig code is ran | 13:20 |
jaosorior_brb | If someone has time, could you check out these two commits https://review.openstack.org/#/c/366075/ https://review.openstack.org/#/c/327029/ ?? | 13:20 |
*** social has quit IRC | 13:20 | |
jtomasek | d0ugal: oops, this one https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_deploy.py#L1230 | 13:21 |
*** dsariel has joined #tripleo | 13:21 | |
d0ugal | jtomasek: oh, I think you can skip that. | 13:21 |
jtomasek | rbrady, d0ugal: that is another thing we need to create post-deployment imo | 13:21 |
jtomasek | d0ugal: ok:) | 13:21 |
*** snecklifter has joined #tripleo | 13:21 | |
d0ugal | jtomasek: I mean, it might be nice to do later, but isn't required AFAIK | 13:21 |
d0ugal | jtomasek: it is only useful if you are going to start triggering tempest | 13:22 |
jtomasek | d0ugal: it is some config file for tempest overcloud testing, tight? | 13:22 |
jtomasek | *right | 13:22 |
d0ugal | jtomasek: Yeah, exactly | 13:22 |
d0ugal | jtomasek: and I'd guess that is out of scope for the GUI at the moment | 13:22 |
*** florianf has joined #tripleo | 13:23 | |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: move gnocchi upgrade to controller upgrade step 3 https://review.openstack.org/388649 | 13:23 |
jtomasek | d0ugal: well, since we have some post-deployment validations, I could see tempest being one of them probably. But it is deffinitely not anything we'd need in newton | 13:23 |
d0ugal | jtomasek: yeah, that's what I was thinking. | 13:23 |
jtomasek | rbrady: same as overcloudrc | 13:23 |
jtomasek | I'll note it to summit session etherpad | 13:24 |
openstackgerrit | Merged openstack/puppet-tripleo: Fix broken rabbitmqctl commands when using ipv6 https://review.openstack.org/388529 | 13:25 |
*** rlandy has quit IRC | 13:27 | |
*** rlandy has joined #tripleo | 13:28 | |
*** rlandy has quit IRC | 13:29 | |
*** rlandy has joined #tripleo | 13:29 | |
*** cylopez has quit IRC | 13:30 | |
*** jeckersb_gone is now known as jeckersb | 13:31 | |
*** cylopez has joined #tripleo | 13:33 | |
*** nyechiel has joined #tripleo | 13:34 | |
*** ohamada_ has joined #tripleo | 13:35 | |
*** ohamada has quit IRC | 13:35 | |
*** cylopez has quit IRC | 13:36 | |
openstackgerrit | yolanda.robla proposed openstack/tripleo-quickstart: Create directories with root https://review.openstack.org/384892 | 13:37 |
*** ohamada__ has joined #tripleo | 13:39 | |
*** ohamada_ has quit IRC | 13:39 | |
*** snecklifter has quit IRC | 13:42 | |
*** zoli|wfh is now known as zoli|brb | 13:43 | |
*** abregman is now known as abregman|afk | 13:44 | |
*** akuznetsov has joined #tripleo | 13:46 | |
*** shardy has quit IRC | 13:48 | |
trozet | shardy: hi | 13:48 |
trozet | EmilienM: do you mind setting workflow on https://review.openstack.org/#/c/386737/ ? | 13:49 |
panda | trozet: IIUC they're both on PTO | 13:51 |
trozet | panda: ah, how about you dsneddon ? :) | 13:52 |
* panda sighs | 13:53 | |
*** limao has joined #tripleo | 13:53 | |
panda | I'm unable to reproduce failure in periodic newton | 13:53 |
trozet | panda: why the sigh? | 13:53 |
panda | deploy works locally | 13:53 |
trozet | panda: what is the failure? | 13:54 |
d0ugal | Looking for reviews here if anyone has time: https://review.openstack.org/#/c/375544/ | 13:55 |
d0ugal | Finally kills the password generation in tripleoclient! ^^ | 13:55 |
d0ugal | All green and all the depends-on have merged in master. | 13:55 |
openstackgerrit | Merged openstack/puppet-tripleo: Add port to rabbitmq node ip list https://review.openstack.org/386761 | 13:55 |
openstackgerrit | Merged openstack/tripleo-heat-templates: glance_multiple_locations when NovaEnableRbdBackend=true https://review.openstack.org/387299 | 13:55 |
openstackgerrit | Merged openstack/tripleo-common: Configure run-validation to use the custom output https://review.openstack.org/379348 | 13:55 |
panda | trozet: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-newton/250707b/logs/postci.txt.gz#_2016-10-19_08_15_38_000 | 13:55 |
panda | trozet: but apparently is transient | 13:56 |
d0ugal | thrash, EmilienM: can you re-review https://review.openstack.org/#/c/375544/ ? | 13:56 |
*** amoralej|lunch is now known as amoralej | 13:57 | |
trozet | panda: I haven't seen this particular error before. But if it is reproducible I'm sure we will hit it in OPNFV fairly soon. Will ping you if I see it | 13:58 |
*** flepied has quit IRC | 14:00 | |
*** flepied has joined #tripleo | 14:01 | |
thrash | d0ugal: ack | 14:02 |
thrash | d0ugal: EmilienM is on PTO. Not sure if he's actually here. | 14:02 |
*** jpena|lunch is now known as jpena | 14:02 | |
trozet | d0ugal: in your patch tripleoclient still configuring keystone? | 14:03 |
*** [1]cdearborn has joined #tripleo | 14:03 | |
d0ugal | thrash: he was earlier, but I guess he has left now. | 14:03 |
d0ugal | trozet: the password removal? I think the keystone configuration is deprecated, but the code is still there. | 14:04 |
*** limao has quit IRC | 14:04 | |
*** limao has joined #tripleo | 14:05 | |
trozet | d0ugal: ya. The configuration of keystone endpoints was done post heat stack deployment by tripleoclient over public VIP, i was just wondering if that has been moved into the heat side yet | 14:05 |
d0ugal | trozet: I thought it was done in puppet, but I am not sure. I think rbrady and akrivoka were looking into this today tho' | 14:06 |
panda | trozet: mh, things are actually worse on local build ... heat says deployment complete, but cluster failed on a redis problem. So now I have two problems to solve instead of one. yay! | 14:07 |
rbrady | trozet: the code is still in tripleoclient but deprecated and skipped. message printed says it happens in puppet, but I didn't go looking in puppet for where it happens | 14:08 |
trozet | panda: we went through a month of fixing transient errors in stable/mitaka to get HA deployments to pass 100% of the time - i feel your pain | 14:08 |
trozet | panda: one thing we found is bringing up all the DBs in the same step caused tons of cpu resource contention | 14:09 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements https://review.openstack.org/388635 | 14:09 |
trozet | panda: so we moved mongo, and sql around in different steps | 14:09 |
panda | I think I found a source of problems, again gnocchi is eating all the CPU and causing various timeout issues | 14:09 |
trozet | could be the same thing with redis | 14:09 |
*** ramishra has quit IRC | 14:10 | |
panda | 2016-10-19 13:41:03.766 10873 ERROR cotyledon ToozConnectionError: Error while reading from socket: ('Connection closed by server.',) | 14:10 |
panda | this is gnocchi metricd log | 14:10 |
trozet | panda: yeah that is usually the problem very high cpu contention, we used to see mysql client failures in puppet cause sql coudlnt respond | 14:10 |
trozet | rbrady: thanks | 14:11 |
panda | trozet: mh, this is actually an effect not the cause, tooz is trying to access redis that is down. | 14:11 |
panda | trozet: anything you remember I could look at for the problem you mentioned ? | 14:11 |
panda | i see this in 22475:M 19 Oct 13:04:56.776 # Opening Unix socket: bind: Permission denied | 14:13 |
panda | redis.log .. | 14:13 |
trozet | panda: https://bugs.launchpad.net/tripleo/+bug/1585275 | 14:14 |
openstack | Launchpad bug 1585275 in tripleo "SQL errors on undercloud/overcloud cause HA deployments to fail" [High,Triaged] | 14:14 |
*** nyechiel has quit IRC | 14:14 | |
trozet | panda: im pretty sure we will see the same failures in newton, but we haven't gotten the chance to test it yet | 14:14 |
trozet | panda: but ive already seen failures in tripleoci logs pointing to what looks like the same cause | 14:15 |
*** akuznetsov has quit IRC | 14:15 | |
*** ayoung has quit IRC | 14:15 | |
*** limao_ has joined #tripleo | 14:16 | |
*** ramishra has joined #tripleo | 14:17 | |
*** oshvartz has joined #tripleo | 14:19 | |
*** andrey-mp has left #tripleo | 14:20 | |
*** limao has quit IRC | 14:20 | |
*** hjensas has quit IRC | 14:23 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for gnocchi https://review.openstack.org/377645 | 14:24 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for ceilometer https://review.openstack.org/377644 | 14:24 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for aodh https://review.openstack.org/365457 | 14:24 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for keystone https://review.openstack.org/327029 | 14:24 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable internal TLS for MySQL https://review.openstack.org/378471 | 14:24 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for Nova API https://review.openstack.org/388495 | 14:24 |
jaosorior_brb | hey guys, if someone has time to review that ^^ I would really appreciate it. It's getting pretty hard to maintain all those patches and the keystone one is already in patchset 54 | 14:25 |
*** jaosorior_brb is now known as jaosorior | 14:25 | |
*** zoli|brb is now known as zoli|wfh | 14:25 | |
*** limao_ has quit IRC | 14:27 | |
*** limao has joined #tripleo | 14:27 | |
*** jtomasek_ has joined #tripleo | 14:28 | |
*** jistr is now known as jistr|call | 14:28 | |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: move gnocchi upgrade to controller upgrade step 3 https://review.openstack.org/388649 | 14:29 |
*** hjensas has joined #tripleo | 14:29 | |
*** hjensas has joined #tripleo | 14:29 | |
* mwhahaha waves to trozet | 14:31 | |
trozet | ah! | 14:31 |
*** saneax-_-|AFK is now known as saneax | 14:36 | |
*** jprovazn has joined #tripleo | 14:38 | |
*** limao has quit IRC | 14:38 | |
*** limao has joined #tripleo | 14:39 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for gnocchi https://review.openstack.org/377645 | 14:43 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for ceilometer https://review.openstack.org/377644 | 14:43 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for aodh https://review.openstack.org/365457 | 14:43 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for keystone https://review.openstack.org/327029 | 14:43 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable internal TLS for MySQL https://review.openstack.org/378471 | 14:43 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for Nova API https://review.openstack.org/388495 | 14:43 |
jaosorior | mwhahaha: thanks for the feedback dude! | 14:44 |
mwhahaha | np | 14:45 |
*** hjensas has quit IRC | 14:45 | |
openstackgerrit | Ryan Brady proposed openstack/python-tripleoclient: Use workflow for overcloud node delete https://review.openstack.org/383731 | 14:47 |
mwhahaha | jaosorior: you missed one :o | 14:47 |
*** yamahata has joined #tripleo | 14:49 | |
tdasilva | trown: hello, ran into a different problem with running quickstart to install with master image: http://paste.fedoraproject.org/455702/14768885/ | 14:50 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable internal TLS for MySQL https://review.openstack.org/378471 | 14:50 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for Nova API https://review.openstack.org/388495 | 14:50 |
jaosorior | mwhahaha: done ^^ | 14:50 |
*** limao has quit IRC | 14:50 | |
*** jaosorior has quit IRC | 14:50 | |
*** jtomasek_ has quit IRC | 14:50 | |
*** limao has joined #tripleo | 14:51 | |
trown | tdasilva: so second attempt worked? (second deploy in that paste) | 14:51 |
tdasilva | trown: no, it just stops there | 14:51 |
trown | tdasilva: I wonder if we are seeing odd behavior because of previous runs on the same virthost... there is a "--teardown all" option for quickstart that will destroy everything before starting to build it up that may be helpful | 14:53 |
*** skramaja has quit IRC | 14:53 | |
tdasilva | trown: i always run with '--teardown all' :/ | 14:53 |
*** yamahata has quit IRC | 14:54 | |
tdasilva | trown: my last run was: ./quickstart.sh --no-clone --release master --teardown all $VIRTHOST | 14:54 |
*** yamahata has joined #tripleo | 14:54 | |
trown | tdasilva: what kind of hardware are you working with for the virthost? | 14:54 |
tdasilva | trown: it's a pretty beefy hardware with intel xeon and 32G ram | 14:56 |
tdasilva | trown: is it possible that 32G is not enough? i'm only deploying two overcloud nodes (1 controller, 1 compute) | 14:57 |
trown | hmm, that is pretty much what I run on | 14:57 |
tdasilva | trown: so what I thought was strange this time around was that message about the overcloud container in swift? | 14:58 |
*** dsariel has quit IRC | 14:58 | |
tdasilva | trown: basically i followed the steps here: http://tripleo.org/basic_deployment/basic_deployment_cli.html | 14:59 |
trown | tdasilva: ya, that is what made me ask about hardware... there is an open bug about that, but I think it only reproduced under load | 14:59 |
tdasilva | and when I got to overcloud deploy, it stopped with that error, but that was a first time i saw that | 14:59 |
tdasilva | oh, ok | 14:59 |
trown | tdasilva: oh... we need to document the low-memory env heat environment | 14:59 |
trown | tdasilva: I bet that is your problem | 15:00 |
*** ealcaniz__ has quit IRC | 15:01 | |
tdasilva | trown: this is currently on the VIRTHOST: http://paste.fedoraproject.org/455710/68892801/ | 15:01 |
trown | in CI, we use this https://github.com/redhat-openstack/ansible-role-tripleo-overcloud/blob/fdaeeedb1cc54122eed5fe3adc82d86ab911f0dc/tasks/pre-deploy.yml#L22-L26 | 15:01 |
*** limao has quit IRC | 15:02 | |
trown | tdasilva: ya, passing in that heat environment to the overcloud deploy will lower the number of service workers | 15:02 |
*** limao has joined #tripleo | 15:02 | |
trown | -e /usr/share/openstack-tripleo-heat-templates/environments/low-memory-usage.yaml | 15:03 |
tdasilva | trying now | 15:03 |
trown | https://github.com/openstack/tripleo-heat-templates/blob/master/environments/low-memory-usage.yaml | 15:04 |
*** hjensas has joined #tripleo | 15:05 | |
*** hjensas has joined #tripleo | 15:05 | |
d0ugal | gfidente: Hey, you around? | 15:05 |
d0ugal | gfidente: actually, nevermind - I'll catch you about it tomorrow probably. I needed to do a recheck. | 15:06 |
tdasilva | trown: no luck, same issue: http://paste.fedoraproject.org/455712/76889615/ | 15:07 |
trown | tdasilva: does `openstack stack list` show an overcloud stack? | 15:08 |
* trown thinks we may have cruft we need to clean up first | 15:08 | |
tdasilva | nothing | 15:08 |
*** b00tcat has quit IRC | 15:11 | |
*** pradk has quit IRC | 15:12 | |
*** jistr|call is now known as jistr | 15:12 | |
*** tremble has quit IRC | 15:13 | |
*** limao has quit IRC | 15:13 | |
*** Guest90211 has quit IRC | 15:13 | |
*** limao has joined #tripleo | 15:13 | |
*** pcaruana has quit IRC | 15:14 | |
*** ayoung has joined #tripleo | 15:15 | |
*** rcernin has quit IRC | 15:16 | |
*** pradk has joined #tripleo | 15:17 | |
*** limao has quit IRC | 15:19 | |
*** hjensas has quit IRC | 15:20 | |
*** bana_k has joined #tripleo | 15:24 | |
mandre | EmilienM: I'm actually surprised to see the experimental CI job for containers was green in https://review.openstack.org/#/c/288915/59, was it really tested? | 15:25 |
*** ebarrera has quit IRC | 15:25 | |
openstackgerrit | Deepak proposed openstack/python-tripleoclient: Fix the author and author-email in setup.cfg file https://review.openstack.org/388763 | 15:26 |
jrist | anyone else good with puppet? | 15:34 |
*** hjensas has joined #tripleo | 15:35 | |
*** hjensas has joined #tripleo | 15:35 | |
mwhahaha | jrist: i have been known to write puppet, what's up? | 15:37 |
jrist | akrivoka: ^ | 15:37 |
akrivoka | mwhahaha: hi, wondering if you might have a clue about https://bugs.launchpad.net/tripleo/+bug/1633713 | 15:38 |
openstack | Launchpad bug 1633713 in tripleo "puppet-ntp is breaking ci" [Critical,Triaged] | 15:38 |
mwhahaha | akrivoka: yea the ntp module updated to puppet4 only | 15:38 |
akrivoka | mwhahaha: I'm still hitting that bug even though I have the correct version of the ntp package | 15:38 |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Add bindep support https://review.openstack.org/349114 | 15:38 |
mwhahaha | so you need an older version of ntp | 15:38 |
akrivoka | on my undercloud | 15:38 |
mwhahaha | i just hit it as well so i'm looking at it | 15:39 |
mwhahaha | my undercloud was fine but my overcloud had the newer package | 15:39 |
mwhahaha | what version do you have? | 15:39 |
akrivoka | mwhahaha: I have 4.2.0, is that not the correct one? | 15:39 |
akrivoka | mwhahaha: that's on the undercloud | 15:39 |
*** jistr is now known as jistr|biab | 15:39 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Fix api_extensions_path in neutron-opencontrail environment https://review.openstack.org/388629 | 15:39 |
akrivoka | mwhahaha: yes, the overcloud seems to be the problem, but I don't know how to debug that | 15:39 |
*** bana_k has quit IRC | 15:40 | |
mwhahaha | akrivoka: i'm looking into it now, not exactly sure either | 15:41 |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Don't hide output from get-node.sh https://review.openstack.org/350229 | 15:44 |
*** rbrady is now known as rbrady-run | 15:45 | |
*** links has joined #tripleo | 15:46 | |
trown | akrivoka: mwhahaha is overcloud using puppet from source instead of packages? | 15:46 |
mwhahaha | that's a possibility | 15:47 |
mwhahaha | which if that's the case we'd need to pin to the 4.2.x branch | 15:47 |
trown | I know we have done that before, but looking for where | 15:47 |
akrivoka | trown: I think so, I did export DIB_INSTALLTYPE_puppet_modules=source before building overcloud images | 15:48 |
trown | akrivoka: ah ya that would do it | 15:48 |
trown | there is another DIB var that can be used to pin | 15:48 |
trown | CI is using packages I guess then? | 15:49 |
mwhahaha | yea i think it is | 15:49 |
mwhahaha | which is why the rdo pin solved ci | 15:49 |
*** hjensas has quit IRC | 15:50 | |
trown | akrivoka: any reason to use puppet modules from source? packages are pretty much equivalent these days since they are built by DLRN | 15:50 |
akrivoka | trown: I did that because the undercloud installation was failing for me with packages | 15:51 |
akrivoka | I guess I could try rebuilding images with packages instead of source and retrying the deploy that way | 15:51 |
mwhahaha | you could try export DIB_REPOREF_puppetlabs_ntp=4.2.x | 15:52 |
*** panda is now known as panda|bbl | 15:52 | |
mwhahaha | at least that appears to be the syntax, https://review.openstack.org/#/c/184844/3/elements/stable-puppet-dependencies/environment.d/01-puppet-stable-deps.sh | 15:52 |
trown | akrivoka: ya, or if you dont need anything custom on the images you could get the tripleo-ci produced ones http://66.187.229.139/builds/current-tripleo/ | 15:52 |
trown | thats the var I was thinking of | 15:53 |
mwhahaha | though we probably should do that until we switch to puppet4 | 15:53 |
mwhahaha | i'll test it out and submit a patch if it works :D | 15:53 |
trown | yep, given that is broken otherwise | 15:53 |
akrivoka | trown: ok, let me try with the ci images first | 15:53 |
*** rwsu has quit IRC | 15:56 | |
*** kjw3 has joined #tripleo | 15:56 | |
*** hjensas has joined #tripleo | 15:56 | |
*** hjensas has joined #tripleo | 15:56 | |
openstackgerrit | Markos Chandras proposed openstack/diskimage-builder: elements: growroot: Add SUSE package mappings https://review.openstack.org/388780 | 15:57 |
*** ccamacho is now known as ccamacho|afk | 15:57 | |
*** penick has joined #tripleo | 16:00 | |
*** hjensas has quit IRC | 16:03 | |
*** hjensas has joined #tripleo | 16:04 | |
*** hjensas has quit IRC | 16:04 | |
*** hjensas has joined #tripleo | 16:04 | |
*** jistr|biab is now known as jistr | 16:05 | |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs: Spec: tripleo-routed-networks-deployment - Routed Spine and Leaf https://review.openstack.org/377088 | 16:06 |
*** ayoung has quit IRC | 16:06 | |
*** ebarrera has joined #tripleo | 16:10 | |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs: Spec: tripleo-routed-networks-deployment - Routed Spine and Leaf https://review.openstack.org/377088 | 16:16 |
*** jlinkes has quit IRC | 16:17 | |
*** hjensas has quit IRC | 16:19 | |
openstackgerrit | Frederic Lepied proposed openstack-infra/tripleo-ci: Allow to use an RDO review to fix a packaging issue https://review.openstack.org/388791 | 16:20 |
*** rasca has quit IRC | 16:20 | |
*** mcornea has quit IRC | 16:23 | |
*** links has quit IRC | 16:31 | |
dtrainor | dciabrin, re: galera chat last night, thanks for the background info in https://bugzilla.redhat.com/show_bug.cgi?id=1381836 | 16:32 |
openstack | bugzilla.redhat.com bug 1381836 in resource-agents "galera resource agent cannot bootstrap cluster when galera and pacemaker nodes' name differ" [Medium,New] - Assigned to dciabrin | 16:32 |
*** jpich has quit IRC | 16:34 | |
dciabrin | dtrainor, hey glad you found the bz, forgot to tell you about that | 16:35 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Fix api_extensions_path in neutron-opencontrail environment https://review.openstack.org/388631 | 16:35 |
dtrainor | no worries! | 16:35 |
*** dmacpher is now known as dmacpher-afk | 16:37 | |
*** fzdarsky is now known as fzdarsky|afk | 16:38 | |
*** numans has quit IRC | 16:40 | |
*** jdob has joined #tripleo | 16:41 | |
*** jdob has left #tripleo | 16:41 | |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart: Remove publish from build-images playbook https://review.openstack.org/388804 | 16:43 |
*** ohamada__ has quit IRC | 16:43 | |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart: Remove publish from build-images playbook https://review.openstack.org/388804 | 16:44 |
*** saneax is now known as saneax-_-|AFK | 16:44 | |
*** masco has quit IRC | 16:47 | |
*** pcaruana has joined #tripleo | 16:51 | |
*** flepied has quit IRC | 16:53 | |
*** lmiccini has quit IRC | 16:54 | |
*** derekh has quit IRC | 16:54 | |
*** ebarrera has quit IRC | 16:56 | |
openstackgerrit | Dan Trainor proposed openstack/tripleo-ui: Make sample file use %(tenant_id)s macro https://review.openstack.org/388101 | 16:57 |
*** yamahata has quit IRC | 16:59 | |
*** hjensas has joined #tripleo | 17:00 | |
*** hjensas has joined #tripleo | 17:00 | |
*** zoli|wfh is now known as zoli|gone | 17:01 | |
*** [1]cdearborn is now known as cdearborn | 17:01 | |
*** zoli|gone is now known as zoli_gone-proxy | 17:02 | |
*** amoralej is now known as amoralej|off | 17:04 | |
*** owalsh has quit IRC | 17:09 | |
akrivoka | many thanks mwhahaha and trown - using the pre built images did the trick | 17:10 |
*** athomas has quit IRC | 17:10 | |
trown | nice! | 17:10 |
jtomasek | akrivoka: I am at 99%:) | 17:10 |
akrivoka | jtomasek: yeah kinda takes forever but it gets there eventually :) | 17:10 |
jtomasek | akrivoka: I rebuilt images with export DIB_INSTALLTYPE_puppet_modules=package | 17:11 |
*** owalsh has joined #tripleo | 17:11 | |
akrivoka | I'll put the workaround in the bug | 17:11 |
jtomasek | akrivoka: can you login to controller and run keystone endpoint list? | 17:11 |
jtomasek | akrivoka: err ssh into controller... | 17:12 |
akrivoka | sure, just a sec | 17:12 |
*** michapma_alt has quit IRC | 17:13 | |
*** bana_k has joined #tripleo | 17:13 | |
akrivoka | jtomasek: Missing value auth-url required for auth plugin password | 17:13 |
akrivoka | jtomasek: how do I auth against overcloud? | 17:15 |
*** owalsh_ has joined #tripleo | 17:15 | |
jtomasek | akrivoka: I did openstack --os-username admin --os-password <the password you see at deployment success screen> --os-auth-url http://<ip from success screen>:5000/v2.0 | 17:16 |
*** pkovar has quit IRC | 17:18 | |
*** owalsh has quit IRC | 17:18 | |
*** jcoufal_ is now known as jcoufal | 17:18 | |
akrivoka | jtomasek: https://paste.fedoraproject.org/455783/76897552/ | 17:19 |
jtomasek | akrivoka: beautiful! can you try to curl horizon? http://192.0.2.13:80/dashboard | 17:20 |
*** owalsh_ is now known as owalsh | 17:20 | |
*** yamahata has joined #tripleo | 17:20 | |
jtomasek | akrivoka: argh, I am still at 99% hah | 17:20 |
trozet | dsneddon, dprince: do you mind setting workflow +1 on https://review.openstack.org/#/c/386737/ please | 17:21 |
akrivoka | jtomasek: curl http://192.0.2.13:80/dashboard is not responding | 17:22 |
*** trown is now known as trown|lunch | 17:22 | |
dsneddon | trozet, Done | 17:22 |
jtomasek | akrivoka: ok, 'openstack stack show overcloud' will give you a bunch of outputs, you can find horizon url there. But I am not sure what is the state of Horizon in overcloud tbh | 17:23 |
akrivoka | jtomasek: actually it's there :) (it was just redirect to login page) | 17:26 |
trozet | dsneddon: thanks | 17:26 |
jtomasek | akrivoka: nice | 17:26 |
jtomasek | akrivoka: btw. how did the post-deployment validations end up? | 17:26 |
jtomasek | akrivoka: succeeded? | 17:26 |
akrivoka | jtomasek: most failed | 17:27 |
akrivoka | jtomasek: ansible returned "Failed to connect to the host via ssh." | 17:27 |
jtomasek | probably valuable info for shadower ^ | 17:28 |
shadower | oooh | 17:29 |
shadower | sadface | 17:29 |
* jtomasek senses something wrong with ssh keys workflow | 17:29 | |
shadower | akrivoka: can you try to SSH to one of the overcloud nodes directly? | 17:30 |
akrivoka | shadower: yeah, I can do that | 17:30 |
shadower | akrivoka: also, can you try some of the undercloud validations? E.g. undercloud-ram? That should not rely on SSH keys | 17:31 |
shadower | and would help us determine whether it's really an SSH issue or something with ansible/mistral | 17:32 |
jtomasek | shadower: only post-deployment ones are failing with that error | 17:33 |
jtomasek | shadower: e.g. Check the number of OpenStack processes on undercloud succeeds | 17:33 |
akrivoka | shadower: The RAM on the undercloud node is 16048 MB, the minimal recommended value is 16384 MB | 17:33 |
akrivoka | :) | 17:34 |
shadower | oh, right, because the other ones were run earlier | 17:34 |
jtomasek | shadower: we can re-run | 17:34 |
shadower | akrivoka: lol, I'm really sorry | 17:34 |
akrivoka | boohoo | 17:34 |
*** tiswanso has joined #tripleo | 17:34 | |
jtomasek | akrivoka, shadower: haha problem is that even though you set the variable to 16384, the node ends up with less:) | 17:35 |
akrivoka | that is... not very useful. | 17:36 |
shadower | jtomasek: really? That's a little strange | 17:36 |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs: Spec: tripleo-routed-networks-deployment - Routed Spine and Leaf https://review.openstack.org/377088 | 17:36 |
jtomasek | it is | 17:36 |
shadower | jtomasek: btw do you see the same problem in your deployment? | 17:37 |
jtomasek | shadower: yes | 17:37 |
shadower | k | 17:37 |
*** mgould is now known as mgould|afk | 17:37 | |
openstackgerrit | Ben Nemec proposed openstack/python-tripleoclient: Remove osc boilerplate from the readme https://review.openstack.org/388822 | 17:38 |
jtomasek | shadower: I re-run the pre-deployment one which succeeded previously and it still spins so I expect that it will end up with the same error | 17:38 |
*** pblaho has quit IRC | 17:38 | |
jtomasek | shadower: no, it succeeded again | 17:38 |
jtomasek | shadower: just my 6gb controller is maxed out and totally slow:D | 17:39 |
shadower | right | 17:39 |
akrivoka | I have no flavors or images on overcloud | 17:39 |
akrivoka | is that normal? | 17:39 |
akrivoka | how can I launch an instance? | 17:39 |
*** rbrady-run is now known as rbrady | 17:40 | |
jtomasek | that is normal imo | 17:40 |
shadower | jtomasek, akrivoka: just on a hunch: can you run this on the undercloud? mistral execution-create tripleo.validations.v1.copy_ssh_key | 17:40 |
shadower | with source stackrc obviously | 17:40 |
openstackgerrit | Ben Nemec proposed openstack/instack-undercloud: Remove instack-create-overcloudrc https://review.openstack.org/388823 | 17:40 |
shadower | that's what should set up the SSH keys | 17:40 |
jtomasek | shadower: I'll try in a moment | 17:41 |
shadower | cheers | 17:41 |
shadower | in the meantime, I'll try to run the validations via mistral on my deployment (haven't tried that yet on this new one) | 17:41 |
*** jpena is now known as jpena|off | 17:42 | |
shadower | jtomasek, akrivoka: okay I've got the same issue in my deployment | 17:44 |
shadower | which is good -- will be easier to debug | 17:44 |
jtomasek | akrivoka: my service catalog is empty, noooo :D | 17:44 |
*** ebarrera has joined #tripleo | 17:45 | |
akrivoka | jtomasek: did you include --tenant-name=admin in your command | 17:45 |
*** owalsh has quit IRC | 17:45 | |
akrivoka | jtomasek: it was empty for me when I missed that part | 17:45 |
jtomasek | akrivoka: that must be it | 17:45 |
*** paramite has quit IRC | 17:45 | |
jtomasek | akrivoka: bingo, thanks | 17:46 |
*** newmember has quit IRC | 17:47 | |
akrivoka | jtomasek: what would be the thing we need to check to verify that all the post-deployment config is in place? | 17:47 |
akrivoka | jtomasek: apart from keystone endpoint being there | 17:48 |
jtomasek | akrivoka: endpoint list :) | 17:48 |
akrivoka | jtomasek: that's it? | 17:48 |
jtomasek | akrivoka: that should be all, yeah | 17:48 |
akrivoka | \o/ | 17:48 |
* akrivoka dropmic | 17:48 | |
jtomasek | akrivoka: in addition, CLI creates overcloudrc and prepares tempest config, but those are bonus things IMHO. If we want to get those done too we'll need to add additional post-deployment workflow. I've added it to summit session etherpad | 17:49 |
*** chandankumar has quit IRC | 17:50 | |
*** yamahata has quit IRC | 17:50 | |
shadower | jtomasek, akrivoka: okay I have a local repro. Are you fine if I have a look at it tomorrow? I'm pretty braindead at this point | 17:51 |
shadower | I expect you two must be too | 17:51 |
*** ebarrera has quit IRC | 17:51 | |
shadower | (for the vorecloud validations) | 17:51 |
akrivoka | shadower: fine with me, of course | 17:51 |
shadower | okay cool, see ya tomorrow | 17:51 |
jtomasek | shadower: yeah, sure... I tried to run that workflow and it seems to run for 5 minutes already | 17:51 |
shadower | jtomasek: yep, same here. I'll investigate in the morning | 17:51 |
jtomasek | shadower: great, thanks all | 17:52 |
trozet | dsneddon: how about this one https://review.openstack.org/#/c/386820/ | 17:54 |
shadower | jtomasek: hm, the copy_ssh_keys workflow fails. Which would certainly produce this behaviour | 17:55 |
bnemec | OMG, I just googled vore. | 17:55 |
bnemec | Don't do that. | 17:55 |
dsneddon | trozet, I'll give it a review, but even if I +2 it we'll need some more cores to review and give at least one more +2. | 17:55 |
bnemec | (I was looking for https://en.wikipedia.org/wiki/Vore_Buffalo_Jump ) | 17:55 |
*** owalsh has joined #tripleo | 17:56 | |
dsneddon | trozet, Gave it my +2, but I do want someone else to sanity check | 17:56 |
*** ebarrera has joined #tripleo | 18:01 | |
*** flepied has joined #tripleo | 18:01 | |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs: Spec: tripleo-routed-networks-deployment - Routed Spine and Leaf https://review.openstack.org/377088 | 18:03 |
*** florianf has quit IRC | 18:08 | |
openstackgerrit | Markos Chandras proposed openstack/diskimage-builder: elements: source-repositories: Add git package mapping for SUSE https://review.openstack.org/388840 | 18:14 |
gfidente | bnemec you sound hungry | 18:16 |
*** rhallisey has quit IRC | 18:16 | |
*** rhallisey has joined #tripleo | 18:17 | |
bnemec | gfidente: I was confused how you knew I was eating lunch, then remembered my last IRC messages. ;-) | 18:17 |
*** dsariel has joined #tripleo | 18:20 | |
*** yamahata has joined #tripleo | 18:20 | |
*** ebarrera has quit IRC | 18:20 | |
openstackgerrit | Markos Chandras proposed openstack/diskimage-builder: elements: zypper: Drop not pull recommended packages https://review.openstack.org/388847 | 18:20 |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs: Spec: tripleo-routed-networks-deployment - Routed Spine and Leaf https://review.openstack.org/377088 | 18:20 |
*** cwolferh has quit IRC | 18:21 | |
openstackgerrit | Markos Chandras proposed openstack/diskimage-builder: elements: zypper: Do not pull recommended packages https://review.openstack.org/388847 | 18:21 |
*** pradk has quit IRC | 18:21 | |
*** pradk has joined #tripleo | 18:23 | |
*** rajinir has joined #tripleo | 18:24 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: Fixes missing provider mappings for OpenDaylight https://review.openstack.org/386737 | 18:26 |
*** cwolferh has joined #tripleo | 18:30 | |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs: Spec: tripleo-routed-networks-deployment - Routed Spine and Leaf https://review.openstack.org/377088 | 18:33 |
*** trown|lunch is now known as trown | 18:38 | |
*** abregman|afk has quit IRC | 18:39 | |
*** rbowen has quit IRC | 18:39 | |
*** abregman|afk has joined #tripleo | 18:39 | |
*** abregman|afk has quit IRC | 18:39 | |
*** rbowen has joined #tripleo | 18:43 | |
*** aufi has quit IRC | 18:45 | |
*** jtomasek_ has joined #tripleo | 18:51 | |
*** fzdarsky|afk is now known as fzdarsky | 18:59 | |
*** abregman has joined #tripleo | 19:09 | |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs: Spec: tripleo-routed-networks-deployment - Routed Spine and Leaf https://review.openstack.org/377088 | 19:09 |
openstackgerrit | Merged openstack/tripleo-quickstart: Remove publish from build-images playbook https://review.openstack.org/388804 | 19:12 |
*** panda|bbl is now known as panda | 19:20 | |
*** jtomasek_ has quit IRC | 19:22 | |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Hiera optimization: use a new hiera hook https://review.openstack.org/384757 | 19:23 |
trown | EmilienM: do you know if we are allowed to propose different hash in https://review.openstack.org/388799 or it has to be RC3 hash? | 19:31 |
trown | looked and instack-undercloud has 2 commits on newton since hash in that review... didnt check other projects yet | 19:32 |
trown | tripleo-heat-templates has quite a few | 19:33 |
trown | 10ish | 19:34 |
*** gfidente has quit IRC | 19:35 | |
openstackgerrit | yolanda.robla proposed openstack/tripleo-quickstart: Create directories with root https://review.openstack.org/384892 | 19:39 |
EmilienM | trown: I'm not sure | 19:42 |
EmilienM | trown: I think rc3 will be our GA and we'll propose a new tag right after summit | 19:42 |
EmilienM | that contains our ongoing work (and things recently merged) | 19:42 |
EmilienM | trown: wdyt? | 19:42 |
trown | EmilienM: fine by me... | 19:42 |
trown | EmilienM: though if we are allowed to pick a different hash then RC3 for GA, it is probably worth getting these other fixes in | 19:43 |
EmilienM | trown: I'm not sure about that, I would ask Doug | 19:44 |
trown | EmilienM: k, I will just ask on the review ;) | 19:44 |
EmilienM | trown: ok, let me know | 19:46 |
*** ayoung has joined #tripleo | 19:47 | |
dhill_ | EmilienM, https://bugs.launchpad.net/tripleo/+bug/1634202 | 19:48 |
openstack | Launchpad bug 1634202 in tripleo "Failure to import new nodes using RDO Newton on RHEL" [Medium,New] - Assigned to wes hayutin (weshayutin) | 19:48 |
*** pcaruana has quit IRC | 19:50 | |
stevebaker | morning | 19:50 |
*** tzumainn has quit IRC | 19:52 | |
*** tzumainn has joined #tripleo | 19:53 | |
*** tiswanso has quit IRC | 19:53 | |
*** dbecker has quit IRC | 19:54 | |
*** dprince has quit IRC | 19:55 | |
*** abregman has quit IRC | 19:57 | |
stevebaker | EmilienM: hey, are you aware of any plans to make undercloud endpoints https by default? | 20:08 |
EmilienM | stevebaker: dtrainor has a task to make https default | 20:08 |
EmilienM | and a patch too iirc | 20:08 |
stevebaker | ok, cool | 20:09 |
stevebaker | I was wondering how the cert would be propagated to the overcloud | 20:09 |
*** akrivoka has quit IRC | 20:12 | |
*** saneax-_-|AFK is now known as saneax | 20:12 | |
trown | hmm so heat could call back? | 20:15 |
openstackgerrit | James Slagle proposed openstack/instack-undercloud: Make module name and file name equivalent https://review.openstack.org/388889 | 20:16 |
*** coolsvap has quit IRC | 20:16 | |
ayoung | Short of rerunning openstack undercloud deploy again, is there something I can do that will effectively be puppet apply but use all the hiera data to update an undercloud? | 20:21 |
ayoung | stevebaker, cert should not need to be propagated if it uses the same CA.... | 20:22 |
ayoung | I know Iknow...we are going to do self signed by default because we hate real security and want to hasten the downfall of western civilization.... | 20:23 |
stevebaker | ayoung: heh, indeed | 20:25 |
openstackgerrit | Ben Nemec proposed openstack/tripleo-specs: Area Experts Policy https://review.openstack.org/388891 | 20:25 |
ayoung | stevebaker, out of curiousity, why that particular concern? | 20:26 |
trown | ayoung: I have never done it mind you, but I don't see what would be wrong with `puppet apply --detailed-exitcodes /etc/puppet/manifests/puppet-stack-config.pp` | 20:26 |
stevebaker | ayoung: https on the undercloud? | 20:27 |
trown | ayoung: that is what is being done in the element: https://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/os-refresh-config/configure.d/50-puppet-stack-config#L19 | 20:27 |
EmilienM | bnemec: nice proposal | 20:27 |
EmilienM | bnemec: just saw your comment on my specs | 20:28 |
bnemec | EmilienM: I've been meaning to write that up for a while, but summit was finally the deadline that forced me to sit down and actually do it. :-) | 20:28 |
*** jprovazn has quit IRC | 20:28 | |
bnemec | I don't have any idea how receptive people will be, but it should make for some interesting conversation. | 20:29 |
EmilienM | bnemec: I hope you'll be around during the "Grow the team" session that trown is leading | 20:30 |
EmilienM | your and my specs are going to be discussed there I think | 20:31 |
bnemec | EmilienM: Yeah, I'll make sure to be there. | 20:31 |
EmilienM | excellent | 20:31 |
trown | I am thinking of attending that one | 20:31 |
bnemec | I would hope so...<EmilienM> bnemec: I hope you'll be around during the "Grow the team" session that ***trown is leading*** | 20:32 |
bnemec | ;-) | 20:32 |
EmilienM | trown: LOL | 20:32 |
EmilienM | trown: did I tell you that you don't have the choice? | 20:32 |
*** milan has quit IRC | 20:33 | |
* bnemec will be on the beach growing his tan | 20:33 | |
*** milan has joined #tripleo | 20:33 | |
stevebaker | ayoung: is letsencrypt in the default trusted CAs? | 20:35 |
ayoung | stevebaker, Um...let's find out. I know it works for my blog.... | 20:35 |
trown | all of rdoproject https is letsencrypt... so probably | 20:36 |
ayoung | stevebaker, curl https://adam.younglogic.com/ seems to work | 20:36 |
ayoung | on a brand new Quickstart installed undercloud too | 20:36 |
stevebaker | oh yeah, thats encouraging | 20:37 |
stevebaker | ayoung: anyway, I was looking at docker tooling like docker-registry, and its strong preference for properly encrypted endpoints, which yak-shaved into undercloud endpoints in general | 20:38 |
EmilienM | bnemec: I'm on pto all the week but i'll try to get a first read and review asap | 20:40 |
trown | ayoung: btw just tried `sudo puppet apply --detailed-exitcodes /etc/puppet/manifests/puppet-stack-config.pp` on a fresh undercloud... seems to work | 20:42 |
ayoung | trown, thanks. key piece of knowledge there | 20:43 |
*** saneax is now known as saneax-_-|AFK | 20:43 | |
*** jcoufal has quit IRC | 20:48 | |
*** egafford has quit IRC | 20:48 | |
*** rbrady is now known as rbrady-afk | 20:49 | |
*** saneax-_-|AFK is now known as saneax | 20:50 | |
EmilienM | ayoung: FYI, rdo reported https://bugs.launchpad.net/tripleo/+bug/1634828 and mwhahaha commented | 20:53 |
openstack | Launchpad bug 1634828 in tripleo "Specified fernet token keys are not utilised" [Low,Incomplete] | 20:53 |
mwhahaha | ayoung: EmilienM: I was unable to repro the bug cause it worked correctly for me | 20:53 |
EmilienM | ayoung: where are we with the feature in tripleo? | 20:53 |
*** lblanchard has quit IRC | 20:53 | |
mwhahaha | so it might have been an outdated setup or something cause i thought we fixed it recently | 20:53 |
EmilienM | mwhahaha: right, we fixed it in Newton iirc | 20:54 |
EmilienM | or at least start actually testing it in Newton | 20:54 |
ayoung | EmilienM, its on hold until after the summit | 20:55 |
EmilienM | ayoung: ok, cool | 20:55 |
ayoung | EmilienM, the approach we are doing in Newton is based on | 20:56 |
ayoung | http://adam.younglogic.com/2016/09/fernet-overcloud/ | 20:56 |
EmilienM | ayoung: I think it's a first good iteration and we are open to change it in the future with something more dynamic | 20:56 |
ayoung | and that uses the keys from the tarball | 20:56 |
*** noslzzp has quit IRC | 20:56 | |
stevebaker | ayoung: certmonger doesn't support ACME yet, thats a shame https://fedorahosted.org/certmonger/ticket/37 | 20:57 |
ayoung | ah well | 20:58 |
stevebaker | certbot is in epel though | 20:58 |
openstackgerrit | Lokesh Jain proposed openstack/tripleo-heat-templates: Updates for configuring Nuage in Mitaka release https://review.openstack.org/372749 | 20:59 |
*** noslzzp has joined #tripleo | 21:00 | |
*** maticue has quit IRC | 21:01 | |
*** Goneri has quit IRC | 21:03 | |
*** jayg is now known as jayg|g0n3 | 21:14 | |
openstackgerrit | Frederic Lepied proposed openstack-infra/tripleo-ci: Allow to use an RDO review to fix a packaging issue https://review.openstack.org/388791 | 21:18 |
*** r-mibu has quit IRC | 21:19 | |
*** r-mibu has joined #tripleo | 21:19 | |
*** rhallisey has quit IRC | 21:19 | |
*** cdearborn has quit IRC | 21:32 | |
*** jeckersb is now known as jeckersb_gone | 21:33 | |
*** bfournie has quit IRC | 21:33 | |
*** noslzzp has quit IRC | 21:34 | |
*** kjw3 has quit IRC | 21:40 | |
*** Goneri has joined #tripleo | 22:01 | |
dtrainor | hi EmilienM, stevebaker | 22:05 |
dtrainor | give me a sec to get caught up | 22:05 |
stevebaker | dtrainor: hey | 22:05 |
dtrainor | alrighty. are we all good? | 22:06 |
stevebaker | dtrainor: just that I'm interested in undercloud https by default, because then docker-registry can use the same cert | 22:07 |
dtrainor | oh i see | 22:09 |
stevebaker | dtrainor: and if we persist with self-signed by default then we need to figure out how to propagate the CA to the overclouds, or we need to come up with a real CA default like letsencrypt | 22:09 |
*** morazi has quit IRC | 22:10 | |
dtrainor | hmmmmmm | 22:15 |
*** jeckersb_gone is now known as jeckersb | 22:20 | |
dtrainor | pardon my ignorance for a minute... why does docker-registry need to use that cert? | 22:21 |
dtrainor | aren't undercloud and overcloud ssl different animals at that point? | 22:22 |
*** Goneri has quit IRC | 22:22 | |
stevebaker | dtrainor: sorry, I'm talking about the docker-registry that is currently running on the undercloud - at some point in the future overcloud nodes may pull images from that registry | 22:23 |
stevebaker | dtrainor: on a containerised overcloud | 22:23 |
dtrainor | oh i see. i wasn't familiar with that effort, good point. | 22:24 |
dtrainor | where would the ca cert live? as a swift object? | 22:24 |
stevebaker | dtrainor: I think firstboot config would be the best way to get it to the overcloud - leaving aside upgrade issues for now | 22:25 |
openstackgerrit | Matthew Flusche proposed openstack/os-net-config: Add route_options parameter https://review.openstack.org/388916 | 22:26 |
*** bfournie has joined #tripleo | 22:30 | |
*** dciabrin has quit IRC | 22:33 | |
*** trown is now known as trown|outtypewww | 22:38 | |
*** panda is now known as panda|Zz | 22:39 | |
*** dciabrin has joined #tripleo | 22:40 | |
openstackgerrit | David Hill proposed openstack/tripleo-common: Adding retry in set_node_state in baremetal.yaml https://review.openstack.org/388920 | 22:50 |
*** dciabrin has quit IRC | 22:53 | |
openstackgerrit | Steve Baker proposed openstack/instack-undercloud: Bind docker-registry to controller_host https://review.openstack.org/388923 | 23:02 |
*** yamahata has quit IRC | 23:07 | |
dtrainor | anyone use any early indicators that a deployment is going to fail? | 23:07 |
dtrainor | something simple even, like not being able to ssh heat-admin@ or something | 23:07 |
openstackgerrit | David Hill proposed openstack/tripleo-common: Adding retry in set_node_state in baremetal.yaml https://review.openstack.org/388920 | 23:07 |
dtrainor | deployments take a long time.... i want to know when to just call it and start over | 23:17 |
stevebaker | dtrainor: that depends entirely on where it stalls | 23:18 |
dtrainor | yep | 23:19 |
dtrainor | any indicator, really. especially since I'm using fake_pxe, I think that hides a lot of information | 23:19 |
*** rlandy has quit IRC | 23:19 | |
dtrainor | the heat logs look pretty busy. other than that, i just see a lot of progress states in the heat resource list | 23:20 |
*** yamahata has joined #tripleo | 23:20 | |
dtrainor | (i think i messed it up by rebooting the overcloud nodes at the wrong time / in the wrong order) | 23:21 |
*** fragatina has joined #tripleo | 23:24 | |
stevebaker | dtrainor: if the nova servers don't boot, bail. If they do but the network config resources don't go to complete, you could try ssh heat_admin then bail. From then on its software configuration | 23:26 |
dtrainor | yea, i think i exploded the deployment by rebooting at the wrong time | 23:29 |
dtrainor | i should manually power cycle overcloud nodes when the ironic state changes to 'wait call-back', right? | 23:30 |
*** dciabrin has joined #tripleo | 23:32 | |
dtrainor | does it matter when I run 'openstack baremetal configure boot' ? before/after i assign nodes? | 23:39 |
*** thrash is now known as thrash|g0ne | 23:41 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!