Monday, 2016-04-25

*** minwang2 has quit IRC00:13
*** alhu has joined #openstack-lbaas00:16
*** minwang2 has joined #openstack-lbaas00:28
*** harlowja has joined #openstack-lbaas00:50
*** minwang2 has quit IRC00:56
*** minwang2 has joined #openstack-lbaas01:03
*** yamamot__ has joined #openstack-lbaas01:07
*** yamamot__ has quit IRC01:11
*** yamamot__ has joined #openstack-lbaas01:22
*** minwang2 has quit IRC01:22
*** yamamot__ has quit IRC01:27
*** kfox1111 has quit IRC01:31
*** kfox1111 has joined #openstack-lbaas01:48
*** yamamot__ has joined #openstack-lbaas01:52
*** barra204 has quit IRC01:53
*** shakamunyi has quit IRC01:53
*** kfox1111 has quit IRC02:48
*** harlowja has quit IRC02:51
*** kfox1111 has joined #openstack-lbaas02:55
*** bana_k has joined #openstack-lbaas02:56
*** yamamot__ has quit IRC02:56
*** alhu has quit IRC03:04
*** alhu has joined #openstack-lbaas03:05
*** ktrmzn has joined #openstack-lbaas03:06
*** bana_k has quit IRC03:09
*** ChrisBenson has quit IRC03:24
*** ChrisBenson has joined #openstack-lbaas03:24
*** prabampm has joined #openstack-lbaas03:30
*** ChrisBenson has quit IRC03:33
*** ChrisBenson has joined #openstack-lbaas03:35
*** bana_k has joined #openstack-lbaas03:39
*** alhu has quit IRC03:43
*** yamamot__ has joined #openstack-lbaas03:56
*** yamamot__ has quit IRC04:03
openstackgerritDoug Wiegley proposed openstack/neutron-lbaas: Switch to using hacking checks from neutron-lib  https://review.openstack.org/30985504:25
*** prabampm has quit IRC04:35
*** prabampm has joined #openstack-lbaas04:37
*** links has joined #openstack-lbaas04:43
*** armax has joined #openstack-lbaas04:46
*** yamamot__ has joined #openstack-lbaas04:59
*** armax has quit IRC04:59
*** yamamot__ has quit IRC05:04
*** yamamot__ has joined #openstack-lbaas06:01
*** yamamot__ has quit IRC06:06
*** rcernin has joined #openstack-lbaas06:19
*** numans has joined #openstack-lbaas06:22
*** yamamot__ has joined #openstack-lbaas07:02
*** sbalukoff has quit IRC07:05
*** sbalukoff has joined #openstack-lbaas07:06
*** reedip__ has joined #openstack-lbaas07:07
*** yamamot__ has quit IRC07:08
*** numans has quit IRC07:10
*** numans has joined #openstack-lbaas07:12
*** kevo has quit IRC07:14
openstackgerritYang Yu proposed openstack/neutron-lbaas: Fix no such option defined for service_auth  https://review.openstack.org/29335207:26
*** banszmar has quit IRC07:40
*** reedip__ has quit IRC07:43
*** eezhova has quit IRC07:56
*** eezhova has joined #openstack-lbaas07:57
*** banszmar has joined #openstack-lbaas07:58
*** yamamot__ has joined #openstack-lbaas08:04
*** yamamot__ has quit IRC08:10
*** bana_k has quit IRC08:34
*** yamamot__ has joined #openstack-lbaas09:06
*** yamamot__ has quit IRC09:11
*** prabampm has quit IRC09:20
*** bogdan has joined #openstack-lbaas09:47
bogdanERROR oslo_messaging.rpc.dispatcher IOError: [Errno 2] No such file or directory: '/etc/octavia/certs/ca_01.pem'09:47
bogdanwhat is this file? I cannot find any explanation over the internet09:47
bogdananyone?09:54
bogdananyone with a reference for octavia.config? there are so many unclear options?10:07
*** yamamot__ has joined #openstack-lbaas10:08
*** yamamot__ has quit IRC10:13
*** jsheeren has joined #openstack-lbaas10:30
*** yamamoto has joined #openstack-lbaas11:09
*** permalac has joined #openstack-lbaas11:10
*** yamamoto has quit IRC11:15
*** bana_k has joined #openstack-lbaas11:21
*** yamamoto_ has joined #openstack-lbaas12:11
*** yamamoto_ has quit IRC12:16
*** yamamoto_ has joined #openstack-lbaas12:17
jsheerenhi quick question about lbaasv2; is the UI for lbaasv2 available in mitaka?12:23
bogdanjsheeren yes, I have installed Mitaka Horizon and I have the Load Balancer for lbaasv2 in there12:28
jsheerenin the local_settings, is it the same enable_lb: true?12:28
jsheerenunder the OPENSTACK_NEUTRON_NETWORK section?12:28
bogdanjsheeren AFAIK the enable_lb has to be true but UI will appear only after you configure your Neutron to run with lbaasv2 enabled12:29
jsheerenbogdan, thanks!  the lbaasv2 agent is running fine .. hmme; i'll double check everything then12:30
*** banszmar has quit IRC12:30
*** diogogmt has quit IRC12:36
*** diogogmt has joined #openstack-lbaas12:41
bogdanany experts on Octavia?12:46
jsheerenbogdan, can i bother you for a sec more?12:46
bogdanyes12:46
jsheereni'm seeing this in the log when i create a loadbalancer: AttributeError: 'HaproxyNSDriver' object has no attribute12:46
jsheeren 'loadbalancer'12:46
jsheerenfollowed this: http://docs.openstack.org/mitaka/networking-guide/adv-config-lbaas.html12:46
jsheerenlbaasv2 with an agent12:47
bogdanunfortunately I cant help with that one, I have never tried out with the agent12:48
*** banszmar has joined #openstack-lbaas12:48
jsheerenoh ok12:48
jsheerenbogdan, thanks anyway12:48
bogdanI started right away with the Octavia12:48
*** permalac_ has joined #openstack-lbaas12:56
*** permalac has quit IRC12:59
*** amit213 has quit IRC13:00
*** yamamoto_ has quit IRC13:24
bogdanany octavia experts?13:38
*** alhu has joined #openstack-lbaas13:39
*** ducttape_ has joined #openstack-lbaas13:40
*** alhu1 has joined #openstack-lbaas13:42
*** alhu has quit IRC13:43
*** ducttape_ has quit IRC13:45
*** alhu1 has quit IRC13:47
*** woodster_ has joined #openstack-lbaas13:49
*** diogogmt has quit IRC14:07
Fritobogdan: I think they may all be involved in the openstack summit this week14:16
Fritohttps://www.openstack.org/summit/austin-2016/14:17
*** links has quit IRC14:18
*** harlowja has joined #openstack-lbaas14:19
*** ajmiller has joined #openstack-lbaas14:28
*** bana_k has quit IRC14:30
*** harlowja has quit IRC14:31
bogdanFrito, thanks, I didn't realize it is this week, will come back in a week if I am not done setting up the Octavia, I am slowly progressing ,... slowly, but progressing :)14:36
Fritohaha, no worries. I feel the same way. I haven't gotten a successful end-to-end local test in devstack yet either.14:37
bogdanwhere are you stuck?14:40
*** banszmar has quit IRC14:40
bogdanI am now at the amphora image creation step :)14:40
FritoThat's an excellent question...  I /think/ I'm stuck at getting members added to the pool successfully. Or at least that's where I was last week. This week it seems my machine is taking forever to spin up an amphorae14:42
FritoBasically I'm trying to run "neutron lbaas-loadbalancer-create --name lb1 private-subnet" right now and get an instance.14:43
FritoI got a gist from ptoohill over the weekend but it's not cooperating with me so I'm in that trial / error mode14:44
bogdanI am right now at exactly the same point :) neutron creating balancer and I get my amphora vm created but I have not used an amphora image yet (just using the cirros one) and as expected the worker log is full of " Could not connect to instance. Retrying."14:51
bogdanso, now I have to create a proper image with haproxy on it etc.14:51
bogdanwhat are you using for amphora image?14:52
FritoI think you can remote into the amphorae if you're using devstack14:52
Fritoif you do "nova list" can you see the amphorae?14:52
*** bana_k has joined #openstack-lbaas14:52
bogdanideally yes, I should be able to remote to it but for whatever reason I am not able to access it, no ping nor ssh14:53
*** harlowja has joined #openstack-lbaas14:53
bogdanyes nova list --all-rpojects shows the amphora-* instance14:53
Fritocool. so you do have an IP there?14:53
Frito10. I think14:53
bogdanyes I have an IP14:53
bogdanin the internal network I configured amphora to run14:54
FritoTry...14:54
Fritossh -i /etc/octavia/.ssh/octavia_ssh_key ubuntu@{your_ip} ??14:54
*** bana_k has quit IRC14:54
bogdanaaah, this is something I forgot - to use the key, but I started with ping and it is not pinging while all my other cirros instances are pinging14:55
bogdaneven in the same network14:55
FritoI'm not sure on the ping. I don't have one up right now to verify if they respond or not.14:55
bogdanbut even without a key it should at least say I am not authorized or something14:56
FritoOr prompt for a password :-/14:57
bogdanssh: connect to host 192.168.1.141 port 22: No route to host14:57
*** banszmar has joined #openstack-lbaas14:57
bogdanin horizon I see the log of the instance and I see it has booted and got an IP, etc.14:58
Fritowhen you created the load balancer what command did you use?14:58
bogdanneutron lbaas-loadbalancer-create --name demo-lb demo-subnet14:58
Fritoyea, that's odd (no route to host).14:59
FritoHonestly, it sounds like you've tried most of the things I would have tried up to this point.15:00
Fritoand the create command looks fine to me too for what it's worth :->15:00
Frito:-/*15:00
Fritoonce my ./stack finishes running I'll stand up an amphorae and see if I can ping it.15:01
*** numans has quit IRC15:01
Fritoyea, when I "neutron lbaas-loadbalancer-list" I get my amphorae but with "PENDING_CREATE"15:05
Fritoand it never updates15:05
Fritowhich is what I'm trying to figure out15:05
bogdani found an issue - the subnet-id of the lb for whatever reason is assigned to my external subnet ...not the internal subnet... will dig deeper now :)15:08
FritoHa, nice. Progress at least!15:09
bogdanin the neutron lb create command and in the octavia.conf I am using the internal subnet name, but I am still getting the external subnet assigned ...wil have to debug the python code I guess... I hate when I end up debugging the code...15:12
*** diogogmt has joined #openstack-lbaas15:15
Frito:-/15:16
FritoYea. I hear ya. Being frank, I've never had this much trouble getting started on a project before...15:16
*** harlowja has quit IRC15:25
bogdanme too15:30
*** links has joined #openstack-lbaas15:43
*** neelashah has joined #openstack-lbaas15:45
*** neelashah has quit IRC16:00
*** fnaval has joined #openstack-lbaas16:18
*** sbalukoff has quit IRC16:29
*** jsheeren has quit IRC16:30
*** rcernin has quit IRC16:30
bogdanFrito, I found the problem on not accessing the instance - the default security group was missing the ICMP... I thought I have enabled it but it seems it was for another default group :)16:31
*** amotoki has joined #openstack-lbaas16:31
Fritoahh, good catch :-)16:31
bogdanalso the ssh with key succeeded :) now my next step is to obtain an amphora image, do you know if ready images exist or should I build one with the script?16:33
bogdanwhat is your progress? where are you stuck at?16:34
*** yamamoto has joined #openstack-lbaas16:35
FritoI'm still trying to make headway. As far as I've gotten is that there is a bug in the nova driver. Getting an error message about the network ID being in the wrong format or something.16:35
FritoTrying to step through that stuff now16:35
bogdanat which step do you get the network ID being in the wrong format?16:37
bogdanI've seen this error when omitted the last symbol from the network ID16:38
bogdanI guess you double checked you ID16:38
FritoIt's on the lb create16:38
bogdanis this the ID that you pass in octavia.conf?16:38
FritoFun part is I'm not really providing an idea16:38
Fritoid*16:38
Fritoneutron lbaas-loadbalancer-create --name lb1 private-subne16:39
FritoJust the name :-/16:39
bogdanhave you setup amp_network = in octavia.conf?16:39
bogdanit should point to the ID of the network where your amphora will live16:40
bogdankeep in mind - the ID of the network and not subnet - at least this is what worked for me16:41
*** links has quit IRC16:41
bogdanI think I was getting the error when trying to use name instead of ID for that parameter16:42
FritoHrm. The only item I have for amp_network is commented out16:43
ptoohillamp_network is deprecated, amp_boot_network list is the new option, but the devstack plugin should have set that16:44
ptoohillamp_network will still work btw, its just not set by 'default' in the devstack plugin anymore16:45
bogdanwas it documented that it is deprecated?16:48
FritoYea, I do have the amp_boot_network_list item16:48
Fritow/ an id16:48
Fritowell a array of a single id16:48
bogdanhow about amp_secgroup_list = default ends up with security group of lb-3b42e800-2e3e-4699....16:49
bogdanptoohill should this be an ID list or namelist?16:50
*** yamamoto_ has joined #openstack-lbaas16:51
FritoALso, should the id in amp_boot_network_list be listed in "neutron subnet-list" ??16:51
ptoohillid list, theres example in the config16:51
ptoohillthis is only on latest master, it just recently merged of course16:51
Fritonevermind. It's in "neutron net-list"16:51
ptoohillnetwork id list, yes16:52
*** amotoki has quit IRC16:53
*** fnaval_ has joined #openstack-lbaas16:54
bogdanok, let me check it out :) I am working with a couple days old file :)16:54
*** yamamoto has quit IRC16:54
ptoohillyou can still set amp_network and comment out the other one if you like, but if youre deploying with devstack that should have been set. If not then i have a bug that i failed to see16:55
*** amotoki has joined #openstack-lbaas16:55
FritoAnyone have tips on being able to debug o-cw in pyCharm? I went to the screen and ctrl+c'ed the process then copied the script and --config-file args into a configuration in pycharm. I can get a breakpoint to actually hit and halt execution but the "variables" section never populates and if I hit "step over" or "step into" nothing happens. It's almost as if the process has just hung.16:55
*** fnaval has quit IRC16:55
*** amotoki has quit IRC16:55
*** amotoki_ has joined #openstack-lbaas16:55
ptoohillFrito: I would suggest pdb for a majority of this. pycharm can be super helpful and awesome, but it can also have a ton of issues16:56
*** amotoki_ has quit IRC16:56
ptoohillFrito: youre doing this in devstack yea?16:56
*** amotoki_ has joined #openstack-lbaas16:57
ptoohillYou need to ensure your debug env/python is the same that devstack is using, this can be a pain because venvs16:57
FritoYes sir. Devstack only. TrevorV helped my configure it.16:57
FritoYea, I"m not using any venvs16:57
ptoohilldevstack does venv16:57
FritoAhh. I wasn't aware of tat.16:58
Fritothat*16:58
ptoohilli would say save yourself pain of trying to figure out through pycharm, use pdb16:58
ptoohillimport pdb; pdb.set_trace() *need to have pdb installed on system16:58
FritoOkaie-dokie.16:58
FritoGot ya. So make that edit in the file I'm trying to debug?16:58
*** amotoki_ has quit IRC16:58
ptoohillput that line anywhere and itll stop, then you have a couple commands to view the stack etc i.e 'l' or 'n'16:58
ptoohillyes16:59
* Frito is somewhat a python newb so these types of tips / tricks I'm still unfamiliar with.16:59
ptoohillput that import pdb line above where you want to start16:59
FritoRight on. Thx16:59
ptoohillFrito: This is a decent walkthrough of pdb17:00
ptoohillhttps://pythonconquerstheuniverse.wordpress.com/2009/09/10/debugging-in-python/17:00
ptoohillAlso, theres things like ipdb and a few others i think that gives more abilities that makes it easier, but pdb will get the info you want17:00
ptoohilli used to heavily rely on pycharm, now i just auto go-to pdb17:01
ptoohillonly time i care to use pycharm debugger now is when im writting tests17:01
ptoohillone gotcha is you have to go clean up your debug points, but thats about it :)17:02
FritoI only have one right now so all good :-D17:02
ptoohill:P17:02
*** yamamoto_ has quit IRC17:08
*** amotoki has joined #openstack-lbaas17:08
*** madhu_ak_ has joined #openstack-lbaas17:15
Fritostupid question: How do I exit pdb after I'm past the point I want to debug?17:18
*** kevo has joined #openstack-lbaas17:18
bogdanI am using winpdb at win side and rpdb2 at python/linux side17:19
bogdanI guess you could run the graphical frontend on linux too17:19
ptoohillFrito: 'q' to quit, 'c' to continue to next break point or the rest of the program17:20
FritoRight on. I think I missed that when I skimed through it the first time. I skimmed b/c I have someone standing over my shoulder.17:21
bogdanAfter some thousands of load balancer creations I ended up with Nova not being able to serve instances due to the DiskFilter ...though I deleted all amphora instances... have you seen such an issue or shall I ask this in the nova channel?17:21
openstackgerritKobi Samoray proposed openstack/octavia: Implement custom header support for Octavia  https://review.openstack.org/25790117:21
FritoSo I think I found the error17:23
FritoIn /octavia/compute/drivers/nova_driver.py... Line 11817:24
Fritonetwork_ids = [{'[id-here]'}]17:24
*** amotoki has quit IRC17:24
FritoI think the [ ] inside the string is what's causing the immediate issue.17:24
ptoohill            nics = [] is my line 11817:27
Fritohrm17:28
Fritomine is17:28
Fritonetwork_ids = network_ids or []17:28
Fritoso probably 2 lines up from where you are :-)17:28
Fritobut yea, that line gets pushed into nics.extend(...) under the if network_ids17:29
Fritoin the debugger I just updated that variable manually and it got past the exception I was getting17:30
ptoohillwhats the exception youre seeing17:30
openstackgerritKobi Samoray proposed openstack/octavia: Implement custom header support for Octavia  https://review.openstack.org/25790117:30
FritoI don't have it handy at the moment but it was something to the tune of "Instance build failed. Network id not in the correct format"17:31
ptoohilli see, hmm you sure youre on latest?17:31
FritoYep.17:31
*** amotoki has joined #openstack-lbaas17:31
Fritolatest devstack and latest octavia17:31
ptoohilli was looking in github on master, your lines are different somehow then17:32
Fritoweird17:32
Fritolet me to a git tree and grab you the hash I'm on17:32
Frito81fc37c17:32
ptoohillyou should see my commit as the latest it looks like17:32
Fritofrom 4 days ago17:32
ptoohill4230e0017:32
ptoohilloh, then hrmm17:32
madhu_ak_@Frito could you message what error you seeing at o-cw logs?17:33
Fritomadhu_ak_: one sec, let me pull my debug stuff out17:33
ptoohilllatest commit i see if from 11 days ago on master in github, hrmmmm17:33
madhu_ak_sure17:33
ptoohillwell for that file of course, but yea, ok i see the one you pasted, hrmmm17:34
ptoohillthats still my commit, just the gerrit commit hash i guess17:34
ptoohillcan you show me what your amp_boot_net_list option contains17:35
ptoohillwondering if thats getting generated bad17:35
Fritomadhu_ak_: 2016-04-25 12:34:53.881 10786 ERROR octavia.compute.drivers.nova_driver BadRequest: Bad networks format: network uuid is not in proper format ([30b3da1c-b456-4c16-90ec-a572789f64f9]) (HTTP 400) (Request-ID: req-bb4ffa15-f010-46fe-b55d-19ed81e785d8)17:35
Fritoptoohill: That's what I was wondering as well.17:36
ptoohill*disclaimer, this worked with a basic build via devstack, i didnt do any crazy testing on it, so i probably misssed something :(17:36
madhu_ak_correct. Is the eror is same as this one: http://logs.openstack.org/53/306053/3/experimental/gate-tempest-dsvm-octavia/9162107/logs/screen-o-cw.txt.gz?17:36
ptoohillyay bugs!17:36
madhu_ak_yesterday I was tryign to run our octavia scenario tests in our gate :) I found this early morning :)17:36
openstackgerritMerged openstack/neutron-lbaas: Port more unit tests to Python 3  https://review.openstack.org/30820417:36
Fritomadhu_ak_: Yep, That looks suspiciously similar to me :-D17:37
madhu_ak_currently I am stacking up devstack and will run octavia cenario tests. Lets see whether I can repoduce locally17:37
ptoohillyea, looks like the config isnt being generated correctly, i wonder if they chaged the osol req for list, the docs showed to submit with [] but... its not looking like it likes that. This worked at one point prior to merge, nothing was failing then17:37
ptoohillfun stuff17:37
ptoohillim sure its easily reproduceable17:38
ptoohillcan you gist your config Frito17:38
ptoohillhopefully this is just a devstack plugin fix17:38
FritoUm. Sure? What config?17:39
ptoohilloctavia17:39
Frito/etc/octavia/octavia.conf ?17:39
ptoohillfor single it might need a ',' or something at the end, this might be funkiness with the option itself and how i did it in the plugin :(17:39
ptoohillyea17:39
FritoYea, one sec17:40
ptoohillim looking at mine, im pretty sure its the same17:40
FritoProbably. I haven't changed anything in that config that I recall17:40
ptoohillblah, going to read through those docs again real quick and do some testing. This is my issue, i just love how it works prior to merge, during merge and then breaks a week later17:40
ptoohillyea, amp_boot_network_list = [04163e33-b44f-423d-8d2b-5010791a2590] it should look like that for you too17:41
ptoohillit probably needs a ',' or something17:41
ptoohill:/17:41
ptoohillcould try that real quick if you wanted :P17:41
ptoohillamp_boot_network_list = [04163e33-b44f-423d-8d2b-5010791a2590,]17:41
ptoohillheh17:41
FritoYea, same thing17:41
ptoohillk, then im not sure why this decided to start failing... lmao..17:42
ptoohillwhy :(17:42
Fritowithout the , and a different GUID but *shrugs* the same for all purposes17:42
ptoohillk, then im not sure whats wrong with it at this point, im stacking17:42
Fritoamp_boot_network_list = [30b3da1c-b456-4c16-90ec-a572789f64f9]17:42
FritoDoes the comma fix it?17:42
ptoohilloh, not sure17:42
ptoohillim not stacked yet17:43
Fritorgr. Are you not at summit?17:43
ptoohillthis worked before and during merge, either something changed, or magic happened during the review process17:43
ptoohillnot yet17:43
*** amotoki has quit IRC17:44
ptoohillIf you wanted to play with that format in config to see if you get something to pick up there for the time being that'd be awesome17:44
ptoohillim going to read a bit while this is stacking17:44
FritoI tried putting a comma at the end of that [id,] and building another loadbalancer but it didn't work17:48
madhu_ak_ptoohill, config is at: http://logs.openstack.org/53/306053/3/experimental/gate-tempest-dsvm-octavia/9162107/logs/etc/octavia/octavia.conf.txt.gz17:48
*** madhu_ak_ is now known as madhu_ak17:49
ptoohillk, based off docs that should have worked, so then it has to be the code itself. maybe the append, do you have amp_network populated still?17:50
ptoohillchecking your config madhu_ak17:50
FritoI only restarted o-cw. Is there anything else I should of restarted?17:51
FritoIs anything cached?17:51
ptoohillthats it17:51
ptoohillshouldnt be17:51
ptoohilli had to have screwed something up, im just not sure why this didnt pop up before :/17:51
ptoohillmaybe it needs something like17:51
ptoohillamp_boot_net_list = [17:51
ptoohillid...17:52
ptoohill]17:52
ptoohillkinda like a multiopt, but..............17:52
ptoohillHRMM17:52
ptoohillstill stacking, ill play with it in a bit sorry about this guys, really not sure why this didnt fail before and during merge when all these same tests were run ><17:52
FritoAll good. I'm just glad its happening on someone elses environment other than mando and myself.17:53
ptoohill:P17:53
FritoEvery time we hit an issue it's just been an assumption that its something isolated to the way we set things up17:53
ptoohillyea, thanks for chiming in madhu_ak, wasnt aware this was failing elsewhere17:53
ptoohillTheres always something to deal with with devstack/openstack in general17:54
ptoohillsometimes its your fault, most of the time its because things are constantly moving. That's why a bunch of folks run in offline and only update every once in a while17:54
FritoThat just seems to be a recipe for issues like this but worse17:57
Fritolol17:57
madhu_akno problem ptoohill17:57
ptoohilli agree, but yea :/17:57
ptoohillcontrol test show same results, awesome, this was not the case before, i love things like this17:59
ptoohilldebugging now17:59
Frito"I love things like this" makes me sense a healthy degree of sarcasm ;-)17:59
ptoohill:)18:00
ptoohillits exciting, i enjoy figuring out what i screwed up, best thing in the world!18:00
ptoohillhhmm18:04
ptoohillits like its reading it in as a string opt, wth18:06
ptoohillits defined as listopt, full on debug mode engage18:07
ptoohillor, it just doesnt need those brackets anymore, and validates what blogan said.. but.... wth why now why didnt it fail before AHH18:10
ptoohillso, to get by for now, remove the brackets :/18:11
ptoohillwell, hold on18:11
ptoohillook, yea, now its complaining about image, so yea, remove brackets that should get you past this issue18:11
ptoohillill submit a patch here shortly, not sure why/how this got past everything o.O18:11
ptoohillFrito: ^18:12
ptoohillone more thing to verify/test then ill fix this18:12
FritoOkie dokie18:13
*** diogogmt_ has joined #openstack-lbaas18:14
*** armax has joined #openstack-lbaas18:14
Fritothat patch is something that has to go through review and get merged and all that?18:14
ptoohillyes, so the tests that madhu_ak shown should have failed, all of those tests would have failed18:14
ptoohilli dont get it :/18:14
ptoohilland docs showed the way i was doing it was right, but blogan brought up this point but was unsure.. so yea..18:14
ptoohillFUN STUFF18:15
ptoohillor you mean my new patch?18:15
ptoohillif so, yes, but you can cherry pick it so you dont have to manually do that18:15
ptoohill*manually update code each time18:16
ptoohilluntil then18:16
*** diogogmt has quit IRC18:16
*** diogogmt_ is now known as diogogmt18:16
ptoohillnot great, but itll work, again sorry, not sure how the heck this happened18:16
FritoNo worreis. Like I said. I'm just glad it wasn't something that was localized to our envionments.18:16
ptoohill:)18:17
ptoohillalrighty, let's see if this fixes it :)18:18
ptoohillstack time18:18
Fritohehe18:19
*** amotoki has joined #openstack-lbaas18:23
*** amotoki has quit IRC18:25
*** woodster_ has quit IRC18:28
ptoohillmadhu_ak: Frito Either one of you want to submit a bug for it? Ill do one shortly if not18:37
ptoohillmaking bug now18:38
madhu_akhttps://bugs.launchpad.net/octavia/+bug/157478418:39
openstackLaunchpad bug 1574784 in octavia "BadRequest: Bad networks format: network uuid is not in proper format when running octavia basic loadbalancer test" [Undecided,New]18:39
madhu_akptoohill, ^^18:39
Fritosry,d idn't see.18:39
ptoohillah, k, thank you18:41
*** harlowja has joined #openstack-lbaas18:44
*** amotoki has joined #openstack-lbaas18:46
bogdanptoohill, I have amp_secgroup_list = 0ec65b33-f491-4631-bdd2-87d841d213a0 but my amphora still gets a new one generated lb-3582eb9... am I missing something?18:47
bogdanthe ID above is the default security group in the service project18:47
bogdani noticed that the lb-... generated ones are in service project too18:47
ptoohillhrmm18:47
bogdanwhich line should I debug to check what happens?18:48
ptoohillnot quite sure18:48
ptoohillthe compute_tasks is where those types of things get sent in to the amphora create18:49
ptoohillstarting line 48 bogdan, you can see if the config value is what you expect. How are you deploying?18:49
openstackgerritPhillip Toohill proposed openstack/octavia: Amphora fails to build  https://review.openstack.org/31004018:50
bogdani am deploying on a standard openstack by cloning octavia and setting up18:50
ptoohillFrito: You can cherry pick that and restack assuming you dont have relone=True in localrc and it gets overwritten18:50
bogdanline 48 in which file? :)18:50
bogdanI guess I should debug         if sec_grps and sec_grps.get('security_groups'):             return sec_grps.get('security_groups')[0]18:52
ptoohillcompute_tasks18:52
bogdanin allowed_address_pairs.py18:52
bogdanok will come back once i debug it18:52
Fritoptoohill: Sure. I would say it would be in a couple but my machine is ssssssllllllllllloooooooooooooooowwwwwwwwwwwwwwwwwwwwwwwwwwwwwww18:52
ptoohill:)18:53
FritoThat's just "git review -d 310040" right?18:53
ptoohilli always fully qualify with cherry-pick line, but that should work for you18:55
FritoYea, I have no changes :-D18:55
*** ducttape_ has joined #openstack-lbaas18:56
Frito/and/ I'm not sure how to cherry pick you w/o having you set up as a remote18:56
ptoohillits in gerrit18:56
*** bana_k has joined #openstack-lbaas18:56
ptoohillhttps://review.openstack.org/#/c/310040/18:57
Fritoright18:57
*** woodster_ has joined #openstack-lbaas18:57
Fritodo I do that from devstack or from /opt/stack/octavia?18:57
ptoohillGo there, then on left hand click the 'download' dropdown and grab the cherrypick link18:57
Fritodevstack right?18:57
ptoohilloctavia18:57
Fritoah, k, got ya18:57
ptoohillright hand side >< **18:57
FritoRight18:59
FritoGOt it now18:59
FritoI had to git clean / git reset HEAD --hard18:59
Fritocleaning / restacking now19:00
*** amotoki has quit IRC19:01
ptoohillplease feel free to submit a review once you test it out, +/-1 Frito. Have you done any reviews yet?19:01
FritoNot yet19:02
Frito:-) Will figure it out though19:02
ptoohill:)19:03
bharathmbogdan: lb-* secgroup is created by octavia for the VIP..19:04
bharathmNova amphora instance contains two security groups.. One is for management port (as defined in amp_secgroup_list in conf) and the other is for tenant port (VIP) that gets dynamically created during lb create19:06
*** amotoki has joined #openstack-lbaas19:06
bogdanok, got it19:11
*** sbalukoff has joined #openstack-lbaas19:13
*** armax has quit IRC19:15
bogdannow when creating amphora a I get  OverQuotaClient: Quota exceeded for resources: ['security_group']19:20
bogdanhow can I tell which quota exactly it is all about?19:21
ptoohillneutron quota-list bogdan, you should be able to increase that in the config or clean up any leftovers you dont need19:22
bogdanthanks ptoohill, it was the security groups per tenant 10 :)19:25
Fritoptoohill: Looks like that worked for me. Thanks. Trying to figure out how to add the +1 to the change19:29
FritoAccording to the Developers Guide there should be a "review" button on the UI or am I reading this wrong?19:30
Fritohttp://docs.openstack.org/infra/manual/developers.html#code-review19:31
ptoohillYes, you should see a review button, are you logged in Frito ?19:32
FritoYep @ logged in19:32
ptoohilloh, its 'reply'19:32
ptoohillat the top left-center-ish19:32
FritoAhh, okay. Makes sense why I didn't see it then. I was looking for "Review"19:32
FritoDone19:33
*** harlowja has quit IRC19:33
ptoohillgood deal :)19:33
*** amotoki has quit IRC19:39
*** ducttape_ has quit IRC19:39
bogdanit seems that both ports created for the amphora are getting assigned to the lb-* security group19:45
bogdanwhy is it not picking my amp_secgroup_list= setting?19:45
*** ducttape_ has joined #openstack-lbaas19:45
*** harlowja has joined #openstack-lbaas19:46
*** yamamoto has joined #openstack-lbaas19:47
*** amotoki has joined #openstack-lbaas19:50
*** yamamoto has quit IRC20:07
*** yamamoto has joined #openstack-lbaas20:09
*** ggolin has quit IRC20:10
*** yamamoto has quit IRC20:12
ptoohillsbalukoff: xgerman: johnsom: blogan: rm_work: https://review.openstack.org/#/c/310040/ somehow that decided to break, please take a peek when you can. See you guys in the morning :)20:12
*** yamamoto has joined #openstack-lbaas20:14
*** yamamoto has quit IRC20:16
*** crc32 has joined #openstack-lbaas20:16
*** bana_k has quit IRC20:24
bogdanany idea why both ports of an amphora get the lb-* security group and ignoring amp_secgroup_list setting?20:25
*** yamamoto has joined #openstack-lbaas20:27
*** yamamoto has quit IRC20:28
*** ducttape_ has quit IRC20:29
*** amotoki has quit IRC20:31
*** harlowja has quit IRC20:31
*** sbalukoff has quit IRC20:33
*** yamamoto has joined #openstack-lbaas20:33
*** yamamoto has quit IRC20:34
*** amotoki has joined #openstack-lbaas20:38
*** ducttape_ has joined #openstack-lbaas20:40
bharathmbogdan: I believe you are referring to both tenant ports (VIP & VRRP ports) of the amphora but not the management port? The "amp_secgroup_list" is the security group assigned for the managemnt port..20:51
bharathmYou can look up the management port as "neutron port-list | grep {mgmt ip address from nova list output}"20:52
*** ducttape_ has quit IRC21:02
bogdanbharathm, here is what I observe: right after lb creation if I look at sec group of the amphora nova instance I see the security group that I assigned via amp_secgroup_list, but after 1-2 seconds the instance gets its security group switched to the lb-*... sec group...21:08
bogdanwhy is that happening?21:09
bharathmHas the LB become ACTIVE? If not because of some error, the revert process would have cleaned that up21:11
bharathmbogdon:21:12
bogdanno, the LB stays Offline because it is in " Could not connect to instance. Retrying" due to the fact that I am not providing a valid amphora image (no haproxy , etc)21:15
bogdanbut the question is why the security group of the amphora nova instance is getting changed right after instance creation21:15
bogdanwill it get reverted back to amp_secgroup_list after the amphora is all up?21:16
bogdanI mean there is not reverting happening yet21:16
bogdanat least I do not see it in the logs21:17
bharathmbogdan: If the revert hasn't initiated yet, then something's wrong with the subnet you passed to lb create.. (I am guessing here).. Because once I accidentally did "neutron lbaas-loadbalaner-crete --name lb1 external-subnet" instead of using private-subnet that resulted in more or less the same outcome as you see21:21
bogdanI am using private subnet : neutron lbaas-loadbalancer-create --name lb26 sub21:24
bogdanbharathm, what lines to debug to check when the security group of the nova instance gets changed?21:24
bharathmHmm.. can you try an image built for octavia (with haproxy etc packages)21:25
bogdanwhere can I get one from?21:25
bharathmbogdan: you can build one with the command in https://github.com/openstack/octavia/tree/master/diskimage-create21:26
bharathmOr if you have a running devstack with octavia, you can copy the already built image21:26
bogdanI might try but I am not sure if I will get it soon because I am on SLES, not Ubuntu21:26
bogdanI am not on devstack21:26
bharathmOh.. Well for testing purposes you can try an ubuntu amphora image :-)21:28
bogdanbtw, my octavia.conf has lb_network_name = sub21:28
bharathmthat diskimage-create.sh will download and build the image from ubuntu mirror..21:28
bogdanwould it be a problem if I use the same subnet both for lb_network_name = and for lb create command?21:28
bogdanok, but how can I build ubuntu image on SLES?21:29
bogdanah, ok, will try it later but from my understanding the process of waiting ..WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying. is still on21:29
bogdanso, why would my security group get changed21:30
bogdanwould it be a problem that I use the same subnet for amphora communication and for lb creation, could this be the cause?21:31
bogdanok now some minutes later I got the REVERTED state and what happened is that the amphora instance got its IP Address and Security Group completely removed21:35
bharathmbogdan: I would say most likely using the same subnet is the cause.. As I mentioned before, I tried using the same network for create and management and I noticed the similar outcome wrt sec groups..21:36
bharathmIdeally the management network and LB network should be different... Former is control plane and the later is for data.. I never extensively tried both on the same network but I am sure it would cause issues21:37
*** yamamoto has joined #openstack-lbaas21:38
bogdanok, let me try with different networks21:41
*** yamamoto has quit IRC21:46
openstackgerritmin wang proposed openstack/octavia: Add failover scenario test for octavia  https://review.openstack.org/30962521:47
bogdanbig thanks bharathm!!! using different networks for mgmt and for lb did work as expected - the instance got the amp_secgroup_list and in addition it got the lb-* group21:50
*** cgross has quit IRC22:02
bharathmthats great bogdan .. glad things worked out22:02
*** cgross has joined #openstack-lbaas22:05
*** harlowja has joined #openstack-lbaas22:21
openstackgerritFranklin Naval proposed openstack/neutron-lbaas: WIP: Neutron-LBaaS: Member Scenario Test  https://review.openstack.org/31006922:21
*** armax has joined #openstack-lbaas22:25
*** minwang2 has joined #openstack-lbaas22:31
*** yamamoto_ has joined #openstack-lbaas22:52
*** crc32 has quit IRC22:53
*** yamamoto_ has quit IRC22:54
*** harlowja has quit IRC23:08
*** amotoki has quit IRC23:12
*** minwang2 has quit IRC23:15
*** bogdan has quit IRC23:17
openstackgerritFranklin Naval proposed openstack/neutron-lbaas: Neutron-LBaaS: Member Scenario Test  https://review.openstack.org/31006923:21
*** diogogmt has quit IRC23:21
*** fnaval_ has quit IRC23:21
*** neelashah has joined #openstack-lbaas23:23
*** neelashah has quit IRC23:30
*** fnaval has joined #openstack-lbaas23:31
openstackgerritMerged openstack/neutron-lbaas: Port more service unit tests to Python 3  https://review.openstack.org/30822123:39
*** chlong has joined #openstack-lbaas23:40
openstackgerritMerged openstack/neutron-lbaas: Port even more service tests to Python 3  https://review.openstack.org/30823423:43
openstackgerritMerged openstack/neutron-lbaas: Port test_db_loadbalancer to Python 3  https://review.openstack.org/30823923:43
openstackgerritLingxian Kong proposed openstack/octavia: Add timestamp to octavia resources  https://review.openstack.org/30925323:47
*** woodster_ has quit IRC23:48
*** ajmiller has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!