Monday, 2015-07-27

« Sunday, 2015-07-26 Index Tuesday, 2015-07-28 »
*** chlong has joined #openstack-lbaas00:00
*** Tiancheng has joined #openstack-lbaas01:04
openstackgerritHenry Gessau proposed openstack/neutron-lbaas: Register alembic_migrations at install time  https://review.openstack.org/19852201:12
*** jhova has quit IRC01:33
openstackgerritmin wang proposed openstack/octavia: health manager service  https://review.openstack.org/16006101:33
*** bana_k has joined #openstack-lbaas03:10
*** ajmiller has quit IRC03:59
*** amotoki has joined #openstack-lbaas04:43
*** ganeshna has joined #openstack-lbaas04:56
*** ganeshna has quit IRC05:01
*** Tiancheng has quit IRC05:05
*** Tiancheng has joined #openstack-lbaas05:05
*** ganeshna has joined #openstack-lbaas06:03
*** mestery has quit IRC06:31
*** bana_k has quit IRC06:36
*** numan has joined #openstack-lbaas06:41
*** ganeshna has quit IRC06:58
*** jschwarz_ has joined #openstack-lbaas07:22
*** chlong has quit IRC07:28
*** ganeshna has joined #openstack-lbaas07:29
*** ganeshna has quit IRC07:34
*** jschwarz_ is now known as jschwarz07:48
*** enikanorov_ has quit IRC07:59
*** ganeshna has joined #openstack-lbaas08:02
*** ganeshna has quit IRC08:32
*** ganeshna has joined #openstack-lbaas08:36
*** bradjones has joined #openstack-lbaas09:42
*** bradjones has quit IRC09:42
*** bradjones has joined #openstack-lbaas09:42
*** albertom has quit IRC10:21
*** albertom has joined #openstack-lbaas10:22
openstackgerritElena Ezhova proposed openstack/neutron-lbaas: Use "session_persistence" in data models for uniformity with API attribute  https://review.openstack.org/20562610:37
*** amotoki has quit IRC10:48
*** kiran-r has joined #openstack-lbaas10:53
*** ganeshna has quit IRC11:12
*** kiran-r has quit IRC11:38
*** Tiancheng has quit IRC11:40
*** apuimedo has joined #openstack-lbaas12:18
*** chlong has joined #openstack-lbaas12:30
*** woodster_ has joined #openstack-lbaas12:45
*** Tiancheng has joined #openstack-lbaas13:00
*** jhova has joined #openstack-lbaas13:01
*** Tiancheng has quit IRC13:03
*** kiran-r has joined #openstack-lbaas13:22
*** _kiran_ has joined #openstack-lbaas13:27
*** kiran-r has quit IRC13:30
*** _kiran_ has quit IRC13:39
*** chlong has quit IRC13:42
*** jhova has quit IRC14:03
*** ajmiller has joined #openstack-lbaas14:17
*** ganeshna has joined #openstack-lbaas14:45
*** ganeshna has quit IRC14:46
*** ganeshna has joined #openstack-lbaas14:46
*** ganeshna_ has joined #openstack-lbaas14:48
*** ganeshna has quit IRC14:51
*** kbyrne has quit IRC14:56
*** mlavalle has joined #openstack-lbaas14:58
*** mestery has joined #openstack-lbaas15:00
*** ganeshna_ has quit IRC15:10
*** kbyrne has joined #openstack-lbaas15:10
*** ganeshna has joined #openstack-lbaas15:10
*** sbalukoff has quit IRC15:15
*** ganeshna has quit IRC15:21
*** ganeshna has joined #openstack-lbaas15:22
*** kiran-r has joined #openstack-lbaas15:25
*** _kiran_ has joined #openstack-lbaas15:26
*** kiran-r has quit IRC15:30
potholehttps://review.openstack.org/#/c/185540/15:35
*** ganeshna has quit IRC15:35
potholehttps://review.openstack.org/#/c/188703/15:35
*** numan has quit IRC15:39
*** _kiran_ has quit IRC15:52
*** mgarza_ has joined #openstack-lbaas16:00
*** fnaval has joined #openstack-lbaas16:08
*** vivek-ebay has joined #openstack-lbaas16:24
*** jschwarz has quit IRC16:24
*** ajmiller has quit IRC16:26
*** ajmiller has joined #openstack-lbaas16:26
*** kiran-r has joined #openstack-lbaas16:34
*** _kiran_ has joined #openstack-lbaas16:35
*** kiran-r has quit IRC16:39
*** TrevorV has joined #openstack-lbaas16:43
*** madhu_ak has joined #openstack-lbaas16:43
*** rm_work is now known as rm_work|away16:51
*** _kiran_ has quit IRC16:55
*** minwang2 has joined #openstack-lbaas17:13
*** bana_k has joined #openstack-lbaas17:15
bana_kcurl -v -k --cert /etc/octavia/certs/client.pem https://192.168.0.9:8443/0.5/info is throwing me an unknown ssl error17:19
bana_kany idea?17:19
bana_ksomeone was suggesting to downgrade the curl17:19
*** TrevorV has quit IRC17:23
*** TrevorV has joined #openstack-lbaas17:25
*** vivek-ebay has quit IRC17:27
*** mgarza_ has quit IRC17:44
rm_youbana_k: i was having similar issues in my testing too, but had to give up on that because of other fires :(17:46
bana_koh, ok17:46
rm_youthere might be something wrong with the cert generation code -- i wrote it originally, and I am not a certificate expert <_<17:47
*** vivek-ebay has joined #openstack-lbaas17:48
bana_kok :).17:48
xgermancan you post the error?17:49
xgermancert generation was working a while back...17:50
*** Sherif has joined #openstack-lbaas17:50
*** apuimedo has quit IRC17:50
bana_k* Hostname was NOT found in DNS cache17:51
bana_k*   Trying 192.168.0.9...17:51
bana_k* Connected to 192.168.0.9 (192.168.0.9) port 8443 (#0)17:51
bana_k* successfully set certificate verify locations:17:51
bana_k*   CAfile: none17:51
bana_k  CApath: /etc/ssl/certs17:51
bana_k* SSLv3, TLS handshake, Client hello (1):17:51
bana_k* Unknown SSL protocol error in connection to 192.168.0.9:844317:51
rm_youxgerman: i mean, it GENERATES, but i can never get it to actually validate17:52
bana_k* Closing connection 017:52
bana_kcurl: (35) Unknown SSL protocol error in connection to 192.168.0.9:844317:52
bana_kxgerman Yes I saw that thing working in your demo video17:52
*** harlowja has joined #openstack-lbaas17:52
xgermanI might be able to do some tests later today.. will keep you posted17:53
bana_kthanks17:54
*** vivek-ebay has quit IRC18:07
*** apuimedo has joined #openstack-lbaas18:08
*** TrevorV2 has joined #openstack-lbaas18:11
*** sbalukoff has joined #openstack-lbaas18:11
*** TrevorV has quit IRC18:12
*** crc32 has joined #openstack-lbaas18:13
*** TrevorV2 is now known as TrevorV18:13
openstackgerritStephen Balukoff proposed openstack/neutron-lbaas: L7 capability extension implementation for lbaas v2  https://review.openstack.org/14823218:20
sbalukoffThis is a reversion to Evgeny's patch ^^18:20
crc32xgerman minwang2 are you still going to pursue MySQL as the "message bus" between the UDP listener and whqat ever mechanism needs to start the fail over of a dead Amphora.18:23
*** numan has joined #openstack-lbaas18:24
potholemysql just sounds bad for this, I havnt really done testing and have been in my own world. but just doesnt sound like a solid path forward considering lots of issues weve ran into with mysql before18:24
potholeatleast not for this type of storage18:25
minwang2what idea do you guys suggest18:26
*** apuimedo has quit IRC18:26
crc32redis18:27
crc32and since they are heartbeats no storage is really needed.18:27
*** gus_spbr has joined #openstack-lbaas18:27
gus_spbrHi all18:28
TrevorVminwang2, We've been a proponent for redis since the beginning of the heartbeat conversation.18:28
TrevorVMore or less18:28
minwang2hmm, xgerman is organzing the meeting, he might join soon, i will talk to him as well18:28
gus_spbrIs there a good soul the could help me find a good reference on how to setup neutron-lbaas (Kilo) on CentOS7?18:29
potholeIve not run this on centos, not sure we have any guides for it either18:29
TrevorVgus_spbr, that's a fantastic question.  I'm not entirely sure if any of us have done anything on centOS.18:29
TrevorVDo you have devstack running on it currently?18:29
johnsomHi18:30
johnsomcrc32 I did testing with mysql and found no issues just running stock18:31
johnsomI commented on the review that the issue is the listener implementation18:31
crc32johnsom How may heartbeats survived into MySQL.18:31
crc32in terms of ratio18:31
gus_spbrTrevorV  Currently my setup is no a devstack, instead I followed this doc here (I'm using one different host for each node: compute, network and controller): http://docs.openstack.org/kilo/install-guide/install/yum/openstack-install-guide-yum-kilo.pdf18:31
johnsomIt is just a while loop with udp receive in it, so all of the other clients are going to error18:31
johnsomI went up to 5000 and stopped, again with stock octavia.18:32
gus_spbrpothole: 15:29:47  TrevorV | gus_spbr, that's a fantastic question.  I'm not entirely sure if any of us have done anything on centOS.                                                     │ gus_spbr18:32
johnsomProbably could go higher, just wondered what the difference was between my code and yours, so looked closer at the review18:32
johnsomNot a single error18:33
gus_spbrI'm  using CentOS7 as the host OS an getting this error:18:33
crc32johnsom: ok so you have a while loop on a listener and each UDP is updating the amphora table?18:33
johnsomThat is also on spinning rust, not ssd18:33
crc32And whats going into error?18:33
*** SumitNaiksatam has joined #openstack-lbaas18:33
johnsomNo, I was using the repository module to do inserts and updates like the mixin did.18:34
gus_spbr[root@neutron01 neutron]# neutron-db-manage --service lbaas current18:34
gus_spbrTraceback (most recent call last):18:34
johnsomYou have a while loop in your code18:34
gus_spbr  File "/usr/bin/neutron-db-manage", line 10, in <module>18:34
gus_spbr    sys.exit(main())18:34
gus_spbr  File "/usr/lib/python2.7/site-packages/neutron/db/migration/cli.py", line 238, in main18:34
gus_spbr    CONF.command.func(config, CONF.command.name)18:34
gus_spbr  File "/usr/lib/python2.7/site-packages/neutron/db/migration/cli.py", line 72, in do_alembic_command18:34
gus_spbr    getattr(alembic_command, cmd)(config, *args, **kwargs)18:34
gus_spbr  File "/usr/lib/python2.7/site-packages/alembic/command.py", line 319, in current18:34
gus_spbr    script.run_env()18:34
gus_spbr  File "/usr/lib/python2.7/site-packages/alembic/script.py", line 382, in run_env18:34
gus_spbr    util.load_python_file(self.dir, 'env.py')18:34
gus_spbr  File "/usr/lib/python2.7/site-packages/alembic/util.py", line 242, in load_python_file18:34
gus_spbr    module = load_module_py(module_id, path)18:34
gus_spbr  File "/usr/lib/python2.7/site-packages/alembic/compat.py", line 79, in load_module_py18:34
gus_spbr    mod = imp.load_source(module_id, path, fp)18:34
gus_spbr  File "/usr/lib/python2.7/site-packages/neutron_lbaas/db/migration/alembic_migrations/env.py", line 85, in <module>18:34
gus_spbr    run_migrations_online()18:34
gus_spbr  File "/usr/lib/python2.7/site-packages/neutron_lbaas/db/migration/alembic_migrations/env.py", line 65, in run_migrations_online18:34
gus_spbr    engine = session.create_engine(neutron_config.database.connection)18:34
gus_spbr  File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/session.py", line 376, in create_engine18:34
gus_spbr    url = sqlalchemy.engine.url.make_url(sql_connection)18:34
gus_spbr  File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/url.py", line 164, in make_url18:34
gus_spbr    return _parse_rfc1738_args(name_or_url)18:34
gus_spbr  File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/url.py", line 213, in _parse_rfc1738_args18:34
gus_spbr    "Could not parse rfc1738 URL from string '%s'" % name)18:35
gus_spbrsqlalchemy.exc.ArgumentError: Could not parse rfc1738 URL from string ''18:35
crc32corect I have a while loop in the code. Which then saves to a table. IE if all the packets survived to the table then no amphora should be marked as down.18:35
johnsomTrevorV we are also proponents of Redis, but we don't think we need it at this point, that mysql should be good enough.18:36
crc32trying to figure out what "All other clients are going to error".18:36
TrevorVgus_spbr, Do you know how to make or use gists?18:36
johnsomcrc32 correct, but this is not server code the way it is written.  It will fail/reject other connections while it is servicing one18:36
gus_spbr15:36:40  TrevorV | gus_spbr, Do you know how to make or use gists?                                                                                                              │ sballe18:36
gus_spbrsorry18:36
*** rm_work|away is now known as rm_work18:37
gus_spbrTrevorV: No. But I can learn :) What do you suggest?18:37
crc32johnsom: Your loosing me johnsom. What is going to error? All the amphoras?18:37
TrevorVgus_spbr, first a couple questions.18:38
TrevorVgus_spbr, you have a github account?18:38
johnsomWhile your loop is servicing one connection, other connections from amphora will fail18:38
gus_spbrTrevorV: Yep.18:39
TrevorVAlright, then this is even easier.18:39
crc32Your talking MySQL connections then. UDP packets are not connected.18:39
johnsomNo, I am not talking mysql18:39
gus_spbrok18:40
TrevorVBasically, gus_spbr, when you need to show people stack traces, or copy config files and show someone them, etc etc, you can go to https://gist.github.com/ and just put it all there18:40
crc32ok so your saying you've already hit the point where you need multiple UDP listeners to get this to work?18:40
TrevorVThen you can copy the link to that "gist" and paste it in chat here.18:40
johnsomcrc32 while your loop is doing session.merge it is not doing dorecv18:40
TrevorVThat way we don't get a million lines of output in the channel.  :)18:40
gus_spbrTrevorV: OK. Got it. :)18:41
TrevorVYessir.18:41
johnsomThe code needs to be able to handle more than one incoming UDP flow at a time18:41
openstackgerritmin wang proposed openstack/octavia: health manager service  https://review.openstack.org/16006118:41
TrevorVgus_spbr, now to troubleshooting the stack trace.  I'm not entirely sure about that one.  My first guess would be incorrect version of sqlalchemy, either too early or too late a release.  If that's not the problem, its possible you need a different mysql endpoint in the config.18:42
crc32Johnsom you mean more then one UDP packet? There is no UDP flow.18:42
crc32Johnsom can we talk on the phone this IRC round trip is confusing me.18:43
crc32I want to make sure we are talking about the same thing.18:43
johnsomI was trying to use a word that wouldn't catch you up.  Yes, UDP does not have sessions18:43
johnsomLet me find and example to send18:44
crc32whats your number johnsom. Can you PM it to me.18:44
gus_spbrTrevorV: OK. I'll check theses two possibilities.18:45
gus_spbr*these18:45
TrevorVGood luck gus_spbr, sorry I can't help with something super specific right away!18:46
gus_spbrTrevorV: Your help very welwelcome. :) Thanks.18:47
TrevorVNot a problem.18:47
crc32johnsom well I guess your about to go to lunch so can we talk afterwords?18:47
gus_spbrTrevorV: How could I check the mysql endpoint (which config you mean) and what version of sqlalchemy shoudl I check against? Any idea?18:48
johnsomcrc32 yes.  Let me find some example code on the interwebs.  So far all I have come up with is dead links18:49
TrevorVgus_spbr, the config options will be in /etc/neutron/neutron.conf  I believe.18:50
crc32You already have an example. If the bottle neck is the session.merge then we can fix that.18:50
crc32I'd like to have a discussion on the phone as well.18:50
gus_spbrTrevorV: ok18:50
TrevorVThen the version of sql alchemy will be in a file called "requirements.txt" in the installation directory, I believe... I've really only done this through devstack, so someone in here correct me if I'm wrong.18:51
bana_kxgerman, rm_you I could not find any  certificates on the amphorae at /etc/octavia/certs/18:52
*** apuimedo has joined #openstack-lbaas18:53
xgermanthat would be the reason — they get installed as part of devstack18:56
gus_spbrthanks, TrevorV These are good guidelines :)18:57
TrevorVNot a problem my man18:57
bana_kso we should push the server.pem on amphorae ?18:58
xgermanthat should come in through he config drive18:59
bana_kok.18:59
xgermanthere is specific certificate code which will generate the server.em and out it through the config drive extension not he amphora18:59
*** vivek-ebay has joined #openstack-lbaas19:02
bana_kI didnt get it :)19:02
xgermanhttps://github.com/openstack/octavia/blob/master/octavia/controller/worker/tasks/cert_task.py to generate19:05
xgermanhttps://github.com/openstack/octavia/blob/master/octavia/controller/worker/tasks/compute_tasks.py19:05
xgermanto move via config drive19:05
bana_kthanks!19:05
xgermanCertComputeCreate is the task19:05
gus_spbrTrevorV: https://gist.github.com/gusbromero/c200bf04618962571bdd Getting this error when I try start neutron-server. However, I was working before I've tried to install neutron-lbaas. But not sure if this issues are related.19:06
xgermannow it will only make certs if the REST driver is enabled19:06
xgerman(see https://github.com/openstack/octavia/blob/master/octavia/controller/worker/flows/amphora_flows.py)19:06
*** apuimedo has quit IRC19:06
xgermanhttps://www.irccloud.com/pastebin/3spnyGSi/19:07
*** vivek-ebay has quit IRC19:08
gus_spbrTrevorV: It's missing a table, but I don't know how to create/populate it properly...19:08
bana_kI think thats what is the prob! mine was ssh enabled !19:10
bana_kxgerman thank you19:11
TrevorVhonestly gus_spbr I'd probably remove the DB and then remove "neutron-lbaas" and then reinstall.19:21
TrevorVMake it all happen fresh.19:21
rm_work^^ nuke the VM from orbit19:22
rm_workit's the only way to be sure :P19:22
potholeBut if hes installing things by hand doesnt he need to run the migrations for neutron-lbaas? That sounds like the steps hes missing19:26
*** crc32 has quit IRC19:27
potholemaybe i overlooked some of the conversation.19:27
TrevorVno no that's probably right pothole, I forgot about that19:29
TrevorVSee, so used to devstack...19:29
*** SumitNaiksatam has quit IRC19:35
*** blogan_ has joined #openstack-lbaas19:36
*** blogan_ has left #openstack-lbaas19:43
*** madhu_ak_ has joined #openstack-lbaas19:45
*** harlowja has quit IRC19:45
*** madhu_ak has quit IRC19:48
*** nmagnezi has joined #openstack-lbaas19:49
gus_spbrTrevorV: pothole:  It turns out that the db configuration was missing on neutron.conf! Ouch! I think these erros are so cryptic... So, so far I can see "Loadbalancer agent " on dashboard, in System Information", but still unable to add it to an existing subnet.19:53
gus_spbrVerifying it.19:53
*** Sherif has quit IRC19:54
*** mestery has quit IRC19:54
*** vivek-ebay has joined #openstack-lbaas20:00
*** harlowja has joined #openstack-lbaas20:01
TrevorVgus_spbr, I hate to admit it, but you're probably going farther than I can help.  Maybe pothole can keep up.20:01
*** mlavalle has quit IRC20:03
potholeAgreed, a lot of the errors are misleading. TBH, i've been using devstack primarily and am sure well run into these errors soon also. Not sure Ill be of much help at the moment, but maybe if i understood your current issue more ill be of more help.20:05
potholeYou are trying to add what to an existing subnet?20:05
*** nmagnezi has quit IRC20:12
*** crc32 has joined #openstack-lbaas20:20
gus_spbrpothole: the same way I add and DHCP agent to an existing subnet, I'm trying to add a lbaas to an existing subnet, but the agent is not listed.20:23
gus_spbr*add a DHCP20:23
potholeCan you gist your config, its possible you are not starting the lbaasv2 agent?20:24
crc32johnsom: Can we have a conversation on the phone so we can get on the same page.20:24
*** Sherif has joined #openstack-lbaas20:26
*** apuimedo has joined #openstack-lbaas20:37
*** numan has quit IRC20:40
*** harlowja_ has joined #openstack-lbaas20:47
*** mlavalle has joined #openstack-lbaas20:47
openstackgerritStephen Balukoff proposed openstack/neutron-lbaas: Adding L7 functionality to reference driver  https://review.openstack.org/20495720:49
openstackgerritStephen Balukoff proposed openstack/neutron-lbaas: L7 capability extension implementation for lbaas v2  https://review.openstack.org/14823220:49
*** harlowja has quit IRC20:51
openstackgerritArmando Migliaccio proposed openstack/neutron-lbaas: Remove fall-back logic to service provider registration  https://review.openstack.org/20622121:03
openstackgerritStephen Balukoff proposed openstack/neutron-lbaas: Adding L7 functionality to reference driver  https://review.openstack.org/20495721:11
*** vivek-ebay has quit IRC21:17
crc32johnsom you around?\21:28
johnsomcrc32 Yes.21:29
openstackgerritMadhusudhan Kandadai proposed openstack/neutron-lbaas: DO NOT MERGE -- testing new experimental job  https://review.openstack.org/20571321:32
*** jorgem has joined #openstack-lbaas21:33
*** TrevorV has quit IRC21:33
openstackgerritMerged openstack/neutron-lbaas: Updated from global requirements  https://review.openstack.org/20439921:34
*** jorgem has quit IRC21:34
*** jorgem has joined #openstack-lbaas21:40
*** vivek-ebay has joined #openstack-lbaas21:58
*** madhu_ak_ is now known as madhu_ak22:02
openstackgerritMerged openstack/neutron-lbaas: Stop use of oslo_utils.timeutils.strtime()  https://review.openstack.org/20579322:06
*** chlong has joined #openstack-lbaas22:09
*** harlowja_ has quit IRC22:21
*** harlowja has joined #openstack-lbaas22:21
openstackgerritSherif Abdelwahab proposed openstack/octavia: Amphora Creation Flows and Tasks for Active Standby  https://review.openstack.org/20625222:52
*** Sherif has quit IRC22:57
*** Sherif has joined #openstack-lbaas23:07
*** mlavalle has quit IRC23:09
*** minwang2 has quit IRC23:09
*** Sherif has quit IRC23:09
*** minwang2 has joined #openstack-lbaas23:17
bana_krm_you : Tested the rest api with the certs and it seems to work fine. you have done a fine job :)23:30
bana_kjust throws couple of warning regarding subjectAltName being not present23:32
bana_kand InsecurePlatformWarning23:32
xgermanyep, that’s my experience as well23:33
bana_k:)23:34
xgermanwe are now trying to replace thhe local cert generator with Anchor https://wiki.openstack.org/wiki/Security/Projects/Anchor - a CA which is part of openstack23:34
rm_workyeah should just be a case of adding AnchorCertGenerator as an Implementation of CertGenerator :)23:37
rm_workand then switching to using that23:37
xgermanyep, sballe is on that23:37
bana_koh cool !23:37
*** jorgem has quit IRC23:43
« Sunday, 2015-07-26 Index Tuesday, 2015-07-28 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!