Thursday, 2018-11-08

johnsomI was just going to recommend increasing amp_active_retries. Maybe your nova is super slow for some reason.  Basically that timeout is the time it takes nova to start the qemu process.00:00
johnsomIn a later release we have increased the default from 10 to 30.00:00
Swamijohnsom: Ok, will try it out with the recommended setting or even higher just to make sure if successfully get there.00:01
Swamis/if/it00:01
openstackgerritMichael Johnson proposed openstack/octavia master: Fix VIP plug failure if netns directory exists  https://review.openstack.org/61638200:33
rm_workI recommend having a spares pool...00:38
rm_workjohnsom: oy, what? lol00:38
rm_workis that for bionic? or like... wat?00:38
rm_workwhat causes that00:38
johnsomYeah, I haven't run it to ground completely. I saw it here: http://logs.openstack.org/87/616287/1/check/octavia-v2-dsvm-scenario-ubuntu-bionic/7990a28/controller/logs/screen-o-cw.txt.gz?#_Nov_07_21_01_06_41580800:40
johnsomI figure there is no harm in making that idempotent00:40
*** salmankhan has quit IRC00:48
openstackgerritMichael Johnson proposed openstack/octavia master: Log the compute ID when nova fails  https://review.openstack.org/61638600:50
johnsomThis seems to be the nova failure flavor of the week: WARNING nova.compute.manager [None req-f97856e5-d8f7-4359-8753-2d9cffbd5b59 None None] While synchronizing instance power states, found 2 instances in the database and 0 instances on the hypervisor.00:54
*** emcco__ has quit IRC01:14
*** Swami has quit IRC01:24
*** yamamoto has joined #openstack-lbaas01:45
*** hongbin has joined #openstack-lbaas02:13
rm_work<_<02:23
*** abaindur has quit IRC02:33
*** yamamoto has quit IRC02:49
*** sapd1 has quit IRC03:58
*** sapd1 has joined #openstack-lbaas03:58
*** yamamoto has joined #openstack-lbaas05:45
*** hongbin has quit IRC06:02
*** yboaron has joined #openstack-lbaas06:17
openstackgerritOpenStack Proposal Bot proposed openstack/octavia-dashboard master: Imported Translations from Zanata  https://review.openstack.org/61642806:34
*** ccamposr has joined #openstack-lbaas06:53
*** ccamposr__ has joined #openstack-lbaas06:55
*** ccamposr has quit IRC06:59
openstackgerritZhaoBo proposed openstack/octavia master: Add client_ca_tls_container_ref to Octavia v2 listener API  https://review.openstack.org/61226707:10
*** pcaruana has joined #openstack-lbaas07:34
*** yamamoto has quit IRC07:46
*** yamamoto has joined #openstack-lbaas07:46
*** yamamoto has quit IRC07:47
*** sapd1 has quit IRC08:20
*** sapd1 has joined #openstack-lbaas08:20
*** yamamoto has joined #openstack-lbaas08:34
*** yamamoto has quit IRC08:40
*** yamamoto has joined #openstack-lbaas08:46
*** yamamoto has quit IRC08:47
*** sapd1_ has joined #openstack-lbaas08:47
*** yamamoto has joined #openstack-lbaas08:49
*** sapd1 has quit IRC08:49
*** abaindur has joined #openstack-lbaas08:50
*** abaindur has quit IRC08:51
*** abaindur has joined #openstack-lbaas08:52
*** velizarx has joined #openstack-lbaas09:08
*** yamamoto has quit IRC09:13
*** Horrorcat has joined #openstack-lbaas09:37
Horrorcatgood $timeofday. is the documentation about certificate rollover in https://docs.openstack.org/octavia/latest/admin/guides/operator-maintenance.html#rotating-cryptographic-certificates still up-to-date?09:41
Horrorcatwe’re in the process of preparing octavia deployment and figuring out how our process for CA rollover should look like. From what I gather there, a Amphora CA rollover would require to (a) either manually intervene and change the amphora cert or (b) use the failover technique described for changing the Client CA.09:42
Horrorcatare we missing something or is that correct?09:42
*** velizarx has quit IRC09:46
*** yamamoto has joined #openstack-lbaas09:54
*** sapd1_ has quit IRC09:55
*** yamamoto has quit IRC10:00
*** yamamoto has joined #openstack-lbaas10:04
*** sapd1_ has joined #openstack-lbaas10:05
*** abaindur has quit IRC10:25
*** abaindur has joined #openstack-lbaas10:26
*** salmankhan has joined #openstack-lbaas10:26
*** abaindur has quit IRC10:29
*** Emine has joined #openstack-lbaas10:32
*** velizarx has joined #openstack-lbaas10:42
openstackgerritMerged openstack/octavia master: Log the compute ID when nova fails  https://review.openstack.org/61638610:47
openstackgerritCarlos Goncalves proposed openstack/octavia stable/rocky: Log the compute ID when nova fails  https://review.openstack.org/61650610:51
openstackgerritCarlos Goncalves proposed openstack/octavia stable/queens: Log the compute ID when nova fails  https://review.openstack.org/61650710:51
*** velizarx has quit IRC10:52
*** yamamoto has quit IRC11:10
*** yamamoto has joined #openstack-lbaas11:14
*** emine__ has joined #openstack-lbaas12:08
*** Emine has quit IRC12:11
openstackgerrit98k proposed openstack/neutron-lbaas master: Update min tox version to 2.0  https://review.openstack.org/61495412:18
*** velizarx has joined #openstack-lbaas12:52
*** emine__ has quit IRC13:00
*** emine__ has joined #openstack-lbaas13:00
*** velizarx has quit IRC13:04
*** yamamoto has quit IRC13:07
*** yamamoto has joined #openstack-lbaas13:09
*** yamamoto has quit IRC13:14
*** yboaron has quit IRC13:28
*** velizarx has joined #openstack-lbaas13:38
*** aojea_ has joined #openstack-lbaas13:48
*** velizarx has quit IRC13:58
*** yamamoto has joined #openstack-lbaas13:58
*** velizarx has joined #openstack-lbaas14:00
*** aojea_ has quit IRC14:02
*** salmankhan has quit IRC14:02
*** dmellado has quit IRC14:02
*** eandersson has quit IRC14:02
*** yamamoto has quit IRC14:03
*** dmellado has joined #openstack-lbaas14:04
*** aojea_ has joined #openstack-lbaas14:04
*** numans has joined #openstack-lbaas14:04
*** salmankhan has joined #openstack-lbaas14:06
johnsomHorrorcat: the amp certs get rotated by the housekeeping process.  It is the CA certs that don’t.14:41
*** emine__ has quit IRC14:53
*** Emine has joined #openstack-lbaas15:02
*** velizarx has quit IRC15:06
*** emccormick has joined #openstack-lbaas15:21
Horrorcatjohnsom, thanks for confirming that the houskeeping does indeed take care of rotating the amphora certs. I am more concerned about how to rotate the CA certificates without pain though.15:21
johnsomHorrorcat Yep. Right now the best answer is to make them long life. We plan to put an "update amphora" method in place (it was blocked by a bug in werkzeug), but no one has done that work yet.15:24
Horrorcatjohnsom, okay, thanks. making them long-lived is a workable solution for now.15:25
johnsomHorrorcat This document might be helpful for you as well: https://review.openstack.org/61345415:25
Horrorcatdual CA looks like what we’re looking for, in fact.15:27
johnsomI just wrote that up as a few folks were having trouble setting up the CAs by hand. I have tested it, but it is still open for reviews.15:28
cgoncalveshttps://review.openstack.org/#/c/613454/15:29
cgoncalvesFYI, http://logs.openstack.org/periodic/git.openstack.org/openstack/neutron-lbaas/master/neutron-lbaas-to-octavia-migration/ed77f12/job-output.txt.gz#_2018-11-08_07_00_42_17643615:31
cgoncalvesstable/rocky is okay15:31
johnsomHmmm15:37
*** aojea_ has quit IRC15:56
*** aojea_ has joined #openstack-lbaas15:56
*** aojea_ has quit IRC15:58
*** aojea_ has joined #openstack-lbaas15:58
*** aojea_ has quit IRC16:03
*** ccamposr__ has quit IRC16:08
*** aojea_ has joined #openstack-lbaas16:09
*** pcaruana has quit IRC16:14
*** yboaron has joined #openstack-lbaas16:29
*** yamamoto has joined #openstack-lbaas16:40
*** yamamoto has quit IRC16:44
*** ivve has joined #openstack-lbaas17:02
*** nicolasbock has joined #openstack-lbaas17:03
openstackgerritMichael Johnson proposed openstack/octavia master: Fix VIP plug failure if netns directory exists  https://review.openstack.org/61638217:18
*** irclogbot_1 has quit IRC17:31
*** aojea_ has quit IRC17:35
johnsomCores, can you please review the following LBaaS neutron-lib related patches? https://review.openstack.org/#/c/605466 https://review.openstack.org/#/c/605470 and https://review.openstack.org/#/c/60518317:38
johnsomThanks!17:38
johnsomShould be quick. Just need to keep things up to date with the neutron->neutron-lib work17:39
openstackgerritNguyen Hai Truong proposed openstack/neutron-lbaas master: Add python 3.6 unit test job  https://review.openstack.org/61664117:41
*** velizarx has joined #openstack-lbaas17:51
*** irclogbot_1 has joined #openstack-lbaas18:01
*** irclogbot_1 has quit IRC18:05
*** velizarx has quit IRC18:06
*** pcaruana has joined #openstack-lbaas18:10
*** salmankhan has quit IRC18:11
*** velizarx has joined #openstack-lbaas18:13
*** aojea_ has joined #openstack-lbaas18:15
*** irclogbot_1 has joined #openstack-lbaas18:26
*** irclogbot_1 has quit IRC18:32
*** irclogbot_1 has joined #openstack-lbaas18:35
*** Emine has quit IRC18:40
*** aojea_ has quit IRC18:44
*** Emine has joined #openstack-lbaas19:04
rm_workjohnsom: hey so if a member fails to provision, it gets provisioning_status=ERROR but it doesn't mark anything else as an error, so people can keep doing updates -- which means they can add another member, and the update can *work*, and then both members are provisioned (proved by both going to ONLINE status via the HMs) -- but then the original member is still in provisioning_status=ERROR19:05
rm_workbecause we didn't update *it*, it was just sent as a side-effect19:05
johnsomYeah, I can see that. Though an update would set it back active right?19:06
johnsomActually, they can't update it. ERROR is an immutable state. They should only be able to delete it19:08
*** aojea_ has joined #openstack-lbaas19:17
*** Emine has quit IRC19:18
*** salmankhan has joined #openstack-lbaas19:46
openstackgerritMerged openstack/neutron-lbaas master: opt in for neutron-lib consumption patches  https://review.openstack.org/60518319:48
openstackgerritMerged openstack/neutron-lbaas master: add local tox targets for pep8 and py3  https://review.openstack.org/60546619:48
openstackgerritMerged openstack/neutron-lbaas master: use common rpc and exceptions from neutron-lib  https://review.openstack.org/60547019:48
*** aojea_ has quit IRC19:49
*** salmankhan has quit IRC19:51
*** velizarx has quit IRC19:56
*** aojea has joined #openstack-lbaas20:41
*** aojea has quit IRC21:14
*** yboaron has quit IRC21:15
rm_workjohnsom: so yeah, umm... i feel like when a successful update is made, ALL objects should be updated to ACTIVE?21:24
rm_workbecause... they now are21:24
rm_workxgerman_: is the berlin summit only tues-thurs?21:26
rm_workis there not more stuff going on?21:26
johnsomrm_work Well, those objects under that listener. Other listeners may still be borked21:27
rm_worktrue21:28
rm_workbut yeah21:28
rm_workhmmmmmmmmm actually i could maybe still make it to the summit if i land monday night -- i just thought i'd be missing a day21:35
rm_worktempting21:35
*** Emine has joined #openstack-lbaas21:36
*** ivve has quit IRC21:38
*** fnaval has joined #openstack-lbaas21:40
xgerman_rm_work: yes21:41
xgerman_I get there Monday and leave Friday…21:42
xgerman_also since some reviewers are on a roll - my periodic reminder: https://review.openstack.org/#/c/613685/21:44
xgerman_https://review.openstack.org/#/c/585864/21:44
*** aojea has joined #openstack-lbaas21:47
*** aojea has quit IRC21:58
*** aojea has joined #openstack-lbaas21:59
*** abaindur has joined #openstack-lbaas22:01
*** abaindur has quit IRC22:01
*** abaindur has joined #openstack-lbaas22:02
xgerman_johnsom: what’s this CADF22:09
xgerman_?22:09
johnsomxgerman_ https://www.dmtf.org/standards/cadf22:10
xgerman_yeah, but what & why?22:10
johnsomhttps://review.openstack.org/60985422:10
xgerman_just a badge or deeper meaning?22:10
xgerman_ah, that thing22:10
xgerman_I recall///22:10
johnsomIt's API usage auditing. The work was spawned by an internal discussion22:11
xgerman_yeah, didn’t know it had an offcial name22:11
*** Emine has quit IRC22:14
*** emccormick has quit IRC22:19
rm_workneat22:34
rm_worki think22:34
*** Emine has joined #openstack-lbaas22:41
*** Emine has quit IRC23:06
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add traffic tests using an IPv6 VIP  https://review.openstack.org/61198023:19
*** fnaval has quit IRC23:35
*** aojea has quit IRC23:50
*** hyang has joined #openstack-lbaas23:50
johnsomAnyone else have some comments on this: https://storyboard.openstack.org/#!/story/200425523:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!