Tuesday, 2018-10-23

*** rcernin has joined #openstack-lbaas00:11
*** rcernin_ has quit IRC00:12
*** rcernin has quit IRC00:13
*** rcernin has joined #openstack-lbaas00:14
*** aojea has joined #openstack-lbaas00:39
openstackgerritGerman Eichberger proposed openstack/octavia master: Refactor the pluggin of the VIP  https://review.openstack.org/60447900:39
*** aojea has quit IRC00:44
*** dmellado has joined #openstack-lbaas00:51
*** hongbin has joined #openstack-lbaas01:27
*** celebdor has quit IRC01:32
*** hongbin has quit IRC01:36
*** hongbin has joined #openstack-lbaas01:37
*** hongbin_ has joined #openstack-lbaas01:41
*** hongbin has quit IRC01:43
*** hongbin has joined #openstack-lbaas02:05
*** hongbin_ has quit IRC02:07
*** ramishra has joined #openstack-lbaas03:12
*** lxkong has quit IRC03:15
*** lxkong has joined #openstack-lbaas03:15
*** hongbin has quit IRC03:52
*** aojea has joined #openstack-lbaas04:16
*** yamamoto has quit IRC04:17
*** yamamoto has joined #openstack-lbaas04:17
*** aojea has quit IRC04:20
abaindurWhat does it mean when i keep seeing errors like:05:00
abaindurLoad Balancer def80fd6-67e9-4827-822f-a63981a286f4 is immutable and cannot be updated.05:00
abaindurwhen trying to delete a loadbalancer, a listener, pool, or member?05:00
abaindurthe loadbalancer is in ERROR state05:01
*** yboaron_ has joined #openstack-lbaas05:21
abaindurI foud some old bugs from 2016, which indicate this issue was fixed. we are on queens05:27
*** ccamposr has joined #openstack-lbaas05:35
abainduralso... is there an API to find the active amphora in active/standby topology?06:03
abainduri'm currently using the DB query from operator maintenace guide: "mysql octavia -e 'select id, compute_id, lb_network_ip, role from amphora where status="ALLOCATED" or status="READY";'"06:04
openstackgerritmashuting proposed openstack/neutron-lbaas-dashboard master: Modify the way controls certificates show or hide  https://review.openstack.org/60990206:27
openstackgerritmashuting proposed openstack/neutron-lbaas-dashboard master: Modify the way controls certificates show or hide  https://review.openstack.org/60990206:37
openstackgerritmashuting proposed openstack/neutron-lbaas-dashboard master: Modify the way controls certificates show or hide  https://review.openstack.org/60990206:39
*** ramishra_ has joined #openstack-lbaas06:40
openstackgerritmashuting proposed openstack/neutron-lbaas-dashboard master: Modify the way controls certificates show or hide  https://review.openstack.org/60990206:40
*** ramishra has quit IRC06:43
*** pcaruana has joined #openstack-lbaas06:56
*** yboaron_ has quit IRC07:04
*** rcernin has quit IRC07:06
*** rpittau has quit IRC07:07
*** rpittau has joined #openstack-lbaas07:07
*** abaindur has quit IRC07:23
*** ramishra_ is now known as ramishra07:33
openstackgerritIan Wienand proposed openstack/octavia master: [wip] Redirect disk-image-builder logs, make verbose  https://review.openstack.org/61262207:51
*** velizarx has quit IRC08:02
*** velizarx has joined #openstack-lbaas08:07
*** yboaron_ has joined #openstack-lbaas08:15
openstackgerritLuis Tomas Bolivar proposed openstack/octavia master: Enabling SG customization on loadbalancer listerners  https://review.openstack.org/60256408:31
openstackgerritLuis Tomas Bolivar proposed openstack/octavia master: Deprecating option to create LBaaS security group on users' project  https://review.openstack.org/61263108:31
*** celebdor has joined #openstack-lbaas08:33
*** dmellado has quit IRC08:34
openstackgerritLuis Tomas Bolivar proposed openstack/octavia master: Enabling SG customization on loadbalancer listerners  https://review.openstack.org/60256408:37
openstackgerritLuis Tomas Bolivar proposed openstack/octavia master: Deprecating option to create LBaaS security group on users' project  https://review.openstack.org/61263108:37
*** dmellado has joined #openstack-lbaas09:18
*** bzhao__ has quit IRC09:20
*** salmankhan has joined #openstack-lbaas09:38
*** ianychoi has quit IRC10:22
*** ianychoi has joined #openstack-lbaas10:25
*** yamamoto has quit IRC11:03
*** yamamoto has joined #openstack-lbaas11:04
*** yamamoto has quit IRC11:08
*** yamamoto has joined #openstack-lbaas11:21
*** pck has joined #openstack-lbaas11:28
*** aojea_ has joined #openstack-lbaas12:42
*** aojea_ has quit IRC12:55
*** aojea_ has joined #openstack-lbaas12:56
*** yamamoto has quit IRC13:02
*** emccormick has joined #openstack-lbaas13:05
*** aojea_ has quit IRC13:17
*** aojea_ has joined #openstack-lbaas13:18
*** aojea_ has quit IRC13:22
openstackgerritVadim Ponomarev proposed openstack/octavia master: Add a soft check for the allowed_address_pairs extension.  https://review.openstack.org/56854613:32
*** yamamoto has joined #openstack-lbaas13:35
*** emccormick has quit IRC13:40
*** aojea_ has joined #openstack-lbaas13:45
*** aojea_ has quit IRC13:48
tobias-urdinjohnsom: https://storyboard.openstack.org/#!/story/200415613:49
*** aojea_ has joined #openstack-lbaas13:52
*** aojea_ has quit IRC13:55
*** aojea_ has joined #openstack-lbaas13:56
*** aojea_ has quit IRC14:00
*** ramishra has quit IRC14:06
*** kobis1 has joined #openstack-lbaas14:17
*** kobis1 has quit IRC14:17
ltomasboping johnsom: if you have time, please take a look at https://review.openstack.org/#/c/60256414:50
openstackgerritVadim Ponomarev proposed openstack/octavia master: Support create amphora instance from volume based.  https://review.openstack.org/57050514:53
*** yboaron_ has quit IRC15:25
*** emccormick has joined #openstack-lbaas15:35
*** celebdor has quit IRC15:35
*** ianychoi_ has joined #openstack-lbaas15:36
*** ianychoi has quit IRC15:40
*** ivve has joined #openstack-lbaas15:42
*** ccamposr has quit IRC15:44
*** phuoc has joined #openstack-lbaas16:38
emccormickBoy oh boy. You wanna get people actively deploying / breaking your project, deprecate the alternative :D17:00
emccormickSome of y'all should subscribe to the operators list until the merger happens. Octavia is getting lots of traffic there lately.17:02
johnsomI am on the operator mailing list, and replying to any questions that come up.17:02
johnsomIn fact I'm replying to one right now.17:02
johnsomSomething about an HMAC issue17:03
emccormickoh super :). Thanks. I just spewed a whole bunch of stuff out there on the management network question17:03
emccormickmaybe the beginnings of a noob guide, at least for kolla people17:04
*** phuoc has quit IRC17:05
*** tomtom001 has joined #openstack-lbaas17:08
johnsomCool, yeah, over the weekend I had a huge backlog of stuff to look at, e-mail is one17:10
tomtom001Hello, just got Octavia installed and working on Queens... One issue is that the health monitor shows online yet the Operating Status is always offline, I'm creating the LB's through horizon, is this any kind of known issue?  Is the health monitor ping'ing from the octavia container or the LB instance itself?17:10
tomtom001Any help is much appreciated thank you.17:10
emccormicktomtom01 Are you deploying with Kolla by any chance?17:11
johnsomtomtom001 This likely means your lb-mgmt-net is not working correctly and the health heartbeats are not making it back to your controllers17:11
tomtom001No, using Openstack-ansible; ok so the octavia-health-manager on the controllers need to be able to talk to the "web instances" inside the LB?17:12
tomtom001or are you saying that the LB instance needs to send heartbeats back to the controllers?17:13
emccormicktomtom01 instances talk to the manager17:13
tomtom001ok LB instances talk back to the health-manager.17:13
emccormicktomtom01 well both really. Config happens with controllers talking to the instances, but heartbeats are sent from amphora to health manager17:14
emccormickso you need to be able to go both ways17:14
tomtom001right, ok, I will verify that17:14
johnsomtomtom001 Yes, the "amphora" instance send heartbeats back to the controllers that includes the health and statistics information.17:14
emccormickalso make sure your dashboard is using the Octavia dashboard and not the old LBaaS one. I've found the old one will happily create broken load balancers and never touch octavia17:15
emccormickverify they exist where they should with the cli17:15
emccormickand that the amphorae are getting created17:16
*** phuoc has joined #openstack-lbaas17:18
*** salmankhan has quit IRC17:20
tomtom001Yep thanks johnsom, emccormick, found a config issue.17:22
*** phuoc has quit IRC17:27
*** phuoc has joined #openstack-lbaas17:43
*** aojea has joined #openstack-lbaas17:46
*** abaindur has joined #openstack-lbaas18:04
*** abaindur has quit IRC18:05
*** abaindur has joined #openstack-lbaas18:05
*** irclogbot_3 has joined #openstack-lbaas18:35
*** nicolasbock has joined #openstack-lbaas18:35
nicolasbockHi. I am trying to get Octacia to work in an all-in-one OpenStack Ansible. Unfortunately the amphora image seems to struggle to stay alive and dies with a kernel backtrace.18:37
nicolasbockIf it helps, I can paste a screenshot of at least the last part of that backtrace.18:38
*** phuoc has quit IRC18:56
openstackgerritGerman Eichberger proposed openstack/octavia master: Refactor the pluggin of the VIP  https://review.openstack.org/60447919:08
*** salmankhan has joined #openstack-lbaas19:09
johnsomnicolasbock Yeah, I can take a look. I wonder if it is the KVM bug.19:12
nicolasbockI can launch a cirros though19:12
nicolasbockBut that's presumably a little bit lighter weight though ;)19:12
johnsomOk, so it's not the KVM bug. It kills everything19:12
nicolasbockAh ok19:13
nicolasbockIs there a good place where I can paste the screenshot?19:13
nicolasbock(if that helps)19:13
johnsomI have not had an amphora with a kernel panic before.19:13
*** salmankhan has quit IRC19:13
johnsomHmm, not sure on that.19:14
nicolasbockok19:14
nicolasbockI'll try to create a server directly with the image19:14
nicolasbockAlthough I can't quite imagine that this would make a difference19:15
johnsomMaybe here: https://imgur.com/upload19:15
nicolasbockhttps://imgur.com/XtqMBhb19:15
johnsomHmmm, not much to go off of there.  Can you look at the qemu log for the instance? Is there any thing interesting in there?19:17
johnsomWhere did you get the image? Did you build it or download it from somewhere?19:18
nicolasbockI ran the all-in-one OpenStack Ansible on master19:19
nicolasbockIt downloads the amphora during setup19:19
johnsomOk, so it grabbed a nightly build image.19:19
nicolasbockI can dig through the code to find out where exactly19:19
johnsomI know where ansible is getting that.19:19
nicolasbockThe qemu log looks clean19:20
johnsomI can't pull down that test image to see if last nights image build somehow went bad. My VMs are in use at the moment.19:22
johnsomI can show you how to build a fresh image if you would like, it's pretty straight forward.19:22
*** pcaruana has quit IRC19:23
johnsomI'm not sure if there is an ansible playbook to build a new image.  xgerman_?19:23
emccormicknicolasbock can you copy the entire bootlog to a pastebin somewhere?19:36
emccormickgo to the instance in horizon, select the log tab, click the full log button, copy and paste.19:37
nicolasbockemccormick (IRC): Can I do that on the CLI too?19:37
nicolasbockI don't have horizon installed19:37
emccormickyou can use http://paste.openstack.org/19:37
emccormickopenstack console log show <instance name>19:39
nicolasbockAwesome, didn't know that :)19:40
emccormickyou can > somefile.txt and then upload that to the paste thing I think19:41
nicolasbockhttp://paste.openstack.org/show/732852/19:42
xgerman_johnsom: let me check19:50
*** openstackgerrit has quit IRC20:06
xgerman_I removed that: https://github.com/openstack/openstack-ansible-os_octavia/commit/95eee6bc11e97105cb0356d7475bee699d404bda20:22
xgerman_so we could resurrect that20:23
emccormicknicolasbock I'm not 100% sure, but I think this is a problem with supported CPU features vs. the Kernel that image is using20:23
johnsomAh, ok, bummer20:23
xgerman_well, slowed down the build and we had the script anyway20:24
emccormicknicolasbock If you have the ability to set the CPU in nova.conf, try using this:20:24
emccormickcpu_mode=custom20:24
emccormickcpu_model=kvm6420:24
emccormickand see if it doesn't boot20:24
johnsomYeah. I think a nice to have might be a var that builds or downloads.20:24
emccormickI've run into this with various Ubuntu builds in the past20:24
xgerman_https://github.com/rcbops/rpc-octavia/blob/master/gating/scripts/rpc-build-image.yml20:25
xgerman_is a playbook we use internally20:25
*** ivve has quit IRC20:42
*** salmankhan has joined #openstack-lbaas21:03
abaindurjohnsom: if we delete an amphora VM directly, will it not spin up a new amphora?21:10
johnsomYes it will21:11
johnsomThe health manager will detect it and start a failover flow that replaces the failed amphora21:11
*** rtjure has quit IRC21:39
*** openstackgerrit has joined #openstack-lbaas21:47
openstackgerritMichael Johnson proposed openstack/octavia-lib master: Initial provider driver library checkin  https://review.openstack.org/61281521:47
*** aojea has quit IRC22:02
openstackgerritMichael Johnson proposed openstack/octavia-lib master: Initial provider driver library checkin  https://review.openstack.org/61281522:03
nicolasbockI updated `nova.conf` emccormick (IRC) but in the domain I get `cpu mode='host-model' check='partial'` and `<model fallback='allow'/>`22:23
openstackgerritMichael Johnson proposed openstack/octavia-lib master: Initial provider driver library checkin  https://review.openstack.org/61281522:23
nicolasbockMy `nova.conf` updates don't seem to have worked.22:24
*** rcernin has joined #openstack-lbaas22:24
nicolasbockI'll spend some more time with it22:24
nicolasbockThanks for the suggestion!22:24
openstackgerritMichael Johnson proposed openstack/octavia-lib master: Initial provider driver library checkin  https://review.openstack.org/61281522:34
openstackgerritIan Wienand proposed openstack/octavia master: [wip] Redirect disk-image-builder logs, make verbose  https://review.openstack.org/61262222:37
*** threestrands has joined #openstack-lbaas23:02
emccormicknicolasbock hmm yeah it didn't trigger the change clearly. That's the default I think23:15
emccormickhost-model passes through what the physical box has which is what you specifically do *not* want23:15
openstackgerritIan Wienand proposed openstack/octavia master: [wip] Redirect disk-image-builder logs, make verbose  https://review.openstack.org/61262223:20
emccormickkinda looks like either nova-compute didn't get restarted or the options didn't make it there23:21
openstackgerritIan Wienand proposed openstack/octavia-tempest-plugin master: Collect diskimage-builder logs  https://review.openstack.org/61283023:21
emccormickcat your nova-compute.log and grep for those variables (cpu_mode and cpu_model) at around the time you restarted nova-compute23:24
emccormicknote you need to be running with debug = True to confirm23:26

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!