Wednesday, 2019-07-31

*** yamamoto has quit IRC00:04
*** abaindur has quit IRC00:21
*** goldyfruit has joined #openstack-lbaas01:00
*** ricolin has joined #openstack-lbaas01:01
*** happyhemant has quit IRC01:18
*** ricolin has quit IRC01:31
*** spatel has joined #openstack-lbaas01:33
*** spatel has quit IRC01:36
*** yamamoto has joined #openstack-lbaas01:54
*** yamamoto has quit IRC01:59
*** rcernin has quit IRC02:57
*** rcernin has joined #openstack-lbaas03:13
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add an optional tenant flow log offload test  https://review.opendev.org/67372003:25
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add an optional tenant flow log offload test  https://review.opendev.org/67372003:29
*** psachin has joined #openstack-lbaas03:37
openstackgerritMerged openstack/octavia master: Add missing test requirement "fixtures"  https://review.opendev.org/67234904:00
openstackgerritMerged openstack/octavia-lib master: Blacklist sphinx 2.1.0 (autodoc bug)  https://review.opendev.org/67287804:00
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add an optional amphora admin log offloading test  https://review.opendev.org/67372604:33
*** tkajinam has quit IRC05:04
*** tkajinam has joined #openstack-lbaas05:05
*** ramishra has joined #openstack-lbaas05:06
*** vishalmanchanda has joined #openstack-lbaas05:13
*** gcheresh has joined #openstack-lbaas05:14
*** ramishra_ has joined #openstack-lbaas05:32
*** ramishra has quit IRC05:33
*** threestrands has joined #openstack-lbaas05:44
*** ajay33 has joined #openstack-lbaas06:12
*** dayou_ has quit IRC06:20
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add an optional tenant flow log offload test  https://review.opendev.org/67372006:22
*** dayou_ has joined #openstack-lbaas06:24
*** rcernin has quit IRC07:02
*** takamatsu has quit IRC07:17
*** maciejjozefczyk has joined #openstack-lbaas07:19
*** tesseract has joined #openstack-lbaas07:27
*** numans has joined #openstack-lbaas07:28
*** pcaruana has quit IRC07:35
*** happyhemant has joined #openstack-lbaas07:36
*** rpittau|afk is now known as rpittau07:37
*** ramishra_ has quit IRC07:49
*** lemko has joined #openstack-lbaas07:55
*** pcaruana has joined #openstack-lbaas08:13
*** tkajinam has quit IRC08:19
*** takamatsu has joined #openstack-lbaas08:32
*** ricolin has joined #openstack-lbaas08:40
*** takamatsu_ has joined #openstack-lbaas08:48
*** threestrands has quit IRC08:48
*** takamatsu has quit IRC08:49
cgoncalvesgthiemonge, johnsom, rm_work: https://review.opendev.org/#/c/673764/08:57
gthiemongecgoncalves: thanks!08:59
rm_work+1'd09:17
*** ivve has joined #openstack-lbaas09:28
*** takamatsu_ has quit IRC09:30
*** takamatsu has joined #openstack-lbaas09:37
openstackgerritCarlos Goncalves proposed openstack/octavia stable/stein: Fix multi-listener load balancers  https://review.opendev.org/67351809:44
*** mkuf has quit IRC09:45
*** ramishra has joined #openstack-lbaas09:52
*** takamatsu has quit IRC10:08
*** numans has quit IRC10:09
*** sapd1_x has joined #openstack-lbaas10:22
*** takamatsu has joined #openstack-lbaas10:24
*** pcaruana has quit IRC10:45
openstackgerritCarlos Goncalves proposed openstack/octavia stable/rocky: Add octavia-v2-dsvm jobs to the gate queue  https://review.opendev.org/67378310:55
*** ricolin_ has joined #openstack-lbaas11:01
*** ricolin has quit IRC11:03
*** mkuf has joined #openstack-lbaas11:34
*** ivve has quit IRC11:40
*** boden has joined #openstack-lbaas11:46
*** takamatsu has quit IRC12:10
*** pcaruana has joined #openstack-lbaas12:10
*** mkuf has quit IRC12:15
*** takamatsu has joined #openstack-lbaas12:31
*** ivve has joined #openstack-lbaas12:35
openstackgerritAnn Taraday proposed openstack/octavia master: Transition amphora flows to dicts  https://review.opendev.org/66889812:36
*** psachin has quit IRC12:41
openstackgerritGregory Thiemonge proposed openstack/octavia master: Force DIB Python version for py2 in diskimage-create  https://review.opendev.org/67380512:41
openstackgerritAnn Taraday proposed openstack/octavia master: Transition amphora flows to dicts  https://review.opendev.org/66889812:43
openstackgerritAnn Taraday proposed openstack/octavia master: [WIP] Lb flows to dicts  https://review.opendev.org/67172512:47
*** ricolin_ is now known as ricolin12:50
openstackgerritAnn Taraday proposed openstack/octavia master: [WIP] Jobboard based controller  https://review.opendev.org/64740612:53
*** straldi has joined #openstack-lbaas12:58
*** ivve has quit IRC13:06
*** tesseract has quit IRC13:20
*** tesseract has joined #openstack-lbaas13:24
*** ajay33 has quit IRC13:34
*** ivve has joined #openstack-lbaas13:37
*** spatel has joined #openstack-lbaas13:40
*** spatel has quit IRC13:45
*** spatel has joined #openstack-lbaas13:59
*** spatel has quit IRC14:03
*** numans has joined #openstack-lbaas14:24
*** takamatsu has quit IRC14:28
*** sapd1_x has quit IRC14:30
*** trident has quit IRC14:32
*** trident has joined #openstack-lbaas14:36
straldiHi all, in my octavia conf file I had set amp_image_tag = amphora variable in controller_worker section. When I try to create a loadbalancer from command line for example:14:47
straldi openstack loadbalancer create --name lbdemo --vip-subnet-id 3eabbb63-4627-4377-abaf-0e35efe953c1 this after 1 minute fail. In the worker logs I'm seeing: 2019-07-31 15:05:18.163 22031 ERROR octavia.compute.drivers.nova_driver [-] Nova failed to build the instance due to: Invalid input for field/attribute flavorRef. Value: . u'' is too short (HTTP 400) (Request-ID: req-6ff65183-4e2e-4df6-ba60-b70c7218b67e): BadRequest: Invalid input for field14:47
straldiSo I try to put also amp_image_id withe the id of amphora-x64-haproxy image created with diskimage-builder for octavia14:47
straldiThe worker try to use the image but can not schedule the instance and the error is:14:47
straldi2019-07-31 15:19:26.459 26266 WARNING octavia.compute.drivers.nova_driver [-] Both amp_image_id and amp_image_tag options defined. Using the amp_image_id.14:47
straldi2019-07-31 15:21:32.055 26266 WARNING octavia.controller.worker.controller_worker [-] Task 'STANDALONE-octavia-create-amp-for-lb-subflow-octavia-compute-wait' (408d1311-d0f4-4838-bf6c-89e71ed5cd3f) transitioned into state 'FAILURE' from state 'RUNNING'14:47
straldi11 predecessors (most recent first):14:47
straldi  Atom 'STANDALONE-octavia-create-amp-for-lb-subflow-octavia-mark-amphora-booting-indb' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'amphora_id': u'1c6d9de5-8b07-4c25-8c5f-48433beaac7f', 'compute_id': u'aff8e315-8dd5-4e87-9261-da1c2b641cfa'}, 'provides': None}14:47
straldi  |__Atom 'STANDALONE-octavia-crea14:47
*** trident has quit IRC14:47
straldi....                           |__Flow 'octavia-create-loadbalancer-flow': ComputeWaitTimeoutException: Waiting for compute id aff8e315-8dd5-4e87-9261-da1c2b641cfa to go active timeout.14:47
straldi2019-07-31 15:21:32.055 26266 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last):14:47
straldi2019-07-31 15:21:32.055 26266 ERROR octavia.controller.worker.controller_worker   File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task14:47
straldi2019-07-31 15:21:32.055 26266 ERROR octavia.controller.worker.controller_worker     result = task.execute(**arguments)14:47
straldi2019-07-31 15:21:32.055 26266 ERROR octavia.controller.worker.controller_worker   File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/compute_tasks.py", line 199, in execute14:47
straldi2019-07-31 15:21:32.055 26266 ERROR octavia.controller.worker.controller_worker     raise exceptions.ComputeWaitTimeoutException(id=compute_id)14:47
straldi2019-07-31 15:21:32.055 26266 ERROR octavia.controller.worker.controller_worker ComputeWaitTimeoutException: Waiting for compute id aff8e315-8dd5-4e87-9261-da1c2b641cfa to go active timeout.14:47
straldiI try to scedule a VM using amphora-x64-haproxy and flavor m1.amphora and The VM has been created and it is up and running14:49
*** trident has joined #openstack-lbaas14:50
straldiin controller_worker section I have also:14:51
straldiamphora_driver = amphora_haproxy_rest_driver14:51
straldicompute_driver = compute_nova_driver14:51
straldinetwork_driver = allowed_address_pairs_driver14:51
straldiall loadbalancere I try to create with different user (demo, admin octavia) go in error state like:14:53
straldi| 12d1a76c-d765-40aa-8d44-f0e00ce1162c | lbdemo   | 15ed6becaa4842219cbc6ce0a2ce3a32 | 10.0.0.6    | ERROR               | amphora14:53
*** AustinR has joined #openstack-lbaas15:00
*** trident has quit IRC15:00
*** trident has joined #openstack-lbaas15:03
johnsomstraldi The nova flavor setting is different than the image tag/ID setting. The image tag or ID is for glance, the nova flavor (the first error) is a setting we send to Nova.  On second, I will find a link to the missing setting.15:03
*** ataraday_ has joined #openstack-lbaas15:03
johnsomhttps://docs.openstack.org/octavia/latest/configuration/configref.html#controller_worker.amp_flavor_id15:04
johnsomThat is the nova flavor setting it was erroring about. Nova flavor defines how many CPUS and how much memory is allocated to an amphora15:04
straldithe istructions I used when I installed and configured octavia were:15:06
straldiopenstack image create amphora-x64-haproxy --public --container-format bare --disk-format qcow2 --file amphora-x64-haproxy.qcow215:06
straldiopenstack image set amphora-x64-haproxy --tag amphora15:06
straldiopenstack flavor create --id 200 --vcpus 2 --ram 1024 --disk 10 "m1.amphora" --public15:06
johnsomYeah, that last like "openstack flavor" would have created an ID that gets configured in https://docs.openstack.org/octavia/latest/configuration/configref.html#controller_worker.amp_flavor_id15:08
ataraday_hello, I will miss today's meeting, not feeling well... I posted some comments on https://review.opendev.org/#/c/662791/ - there is an issue with rerty mechanism usage, I will continue refator basing on zookeper and may be figure out something later...15:08
johnsomataraday_ Thank you15:08
*** trident has quit IRC15:08
straldiSo in my definition the tag is amphora and the flavor is m1.amphora15:09
straldiand yes I have in octavia.conf15:09
straldithis line15:09
straldi# Nova parameters to use when booting amphora15:09
straldiamp_flavor_id = 20015:09
straldiin section controller_worker15:10
straldithe id is the one I created in installation and configuration phase15:10
johnsomThis: " Invalid input for field/attribute flavorRef. Value: . u'' is too short (HTTP 400) " is an error coming from the nova service. I guess it will only take a uuid?15:10
straldiSo I have to put the user id?15:11
johnsomHmm, no, it looks like flavors are normally short.15:11
straldim1.amphora is not so long and the id is 200 not a long string15:12
johnsomstralfi Try quoting the value, like "200"15:13
straldiok I'm tryng15:13
johnsomI wonder if something in nova isn't treating it like an integer instead of a string.15:13
straldiNo the error is the same. I will go in your direction I will create a new flavor and I try to put the log id15:16
*** trident has joined #openstack-lbaas15:16
johnsomOk, hmm, I haven't seen that before. Let us know how it goes.15:16
*** gcheresh has quit IRC15:17
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add a flavor to the load balancer CRUD scenarios  https://review.opendev.org/63135315:19
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add amphora update service client and API test  https://review.opendev.org/63329515:20
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add amphora failover API test  https://review.opendev.org/63361415:20
straldithe strange thing is that if I use the image and the flavor I created the instance, and the instance go in running state without problem. Now I'm restarting all services.15:21
*** trident has quit IRC15:24
straldiNo also with new flavor go in error and the main error I found:15:25
straldi2019-07-31 17:23:55.719 17629 ERROR octavia.controller.worker.controller_worker ComputeBuildException: Failed to build compute instance due to: None15:25
straldi2019-07-31 17:24:01.091 17629 ERROR oslo_messaging.rpc.server ComputeBuildException: Failed to build compute instance due to: None15:25
*** trident has joined #openstack-lbaas15:27
straldiseems the engine or worker can not launch instances. The compute node is 1 and I can create VMs with that flavor I can create about 4 instances15:27
straldiTomorrow I will try different configurations and I let you know15:28
straldimay be some problem with availability zone (no I have only nova) and I tried also to put in octavia.conf  availability_zone = nova in nova section but without luck15:30
*** AustinR has quit IRC15:33
*** AustinR has joined #openstack-lbaas15:34
*** trident has quit IRC15:35
*** trident has joined #openstack-lbaas15:38
*** ramishra has quit IRC15:47
*** Vorrtex has joined #openstack-lbaas15:58
*** ajay33 has joined #openstack-lbaas15:59
cgoncalves#startmeeting Octavia16:00
openstackMeeting started Wed Jul 31 16:00:05 2019 UTC and is due to finish in 60 minutes.  The chair is cgoncalves. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: Octavia)"16:00
openstackThe meeting name has been set to 'octavia'16:00
johnsomo/16:00
cgoncalveshi16:00
ajay33hi16:00
colin-o/16:00
cgoncalvesour PTL is unavailable today, so he asked me to run the meeting16:01
cgoncalvesthe agenda is https://wiki.openstack.org/wiki/Octavia/Weekly_Meeting_Agenda#Meeting_2019-07-3116:01
cgoncalvesas a reminder, feel empowered to add items to the agenda at any time!16:01
cgoncalves#topic Announcements16:01
*** openstack changes topic to "Announcements (Meeting topic: Octavia)"16:01
johnsomTC election is coming up16:02
cgoncalvesthe User Committee sent out an email to the -discuss list reminding folks that the OpenStack User Survey is still open. it will close on August 2216:02
johnsom#link http://lists.openstack.org/pipermail/openstack-discuss/2019-July/008098.html16:02
cgoncalves#link http://lists.openstack.org/pipermail/openstack-discuss/2019-July/007898.html16:02
johnsomYes, please fill out the user survey, it helps some of us justify their jobs, etc.16:03
cgoncalveshands up for johnsom as new TC member :)16:03
cgoncalveso/16:03
johnsomlol16:04
johnsomCareful what you wish for....16:04
cgoncalvesI'm sure you'd excel at it! :)16:04
cgoncalvesany other announcements or comments on these two announcements?16:05
cgoncalvesok, moving on16:05
cgoncalves#topic Gerrit ACLs for Backport-Candidate16:06
*** openstack changes topic to "Gerrit ACLs for Backport-Candidate (Meeting topic: Octavia)"16:06
johnsomSo far I kind of like having the the backport flag16:06
cgoncalvesso, gthiemonge brought to the core team attention that non-core reviewers cannot vote -1/0/+1 on backport candidate label16:07
johnsomHmm, this is a total oversight on my part if anyone can't vote +-1 for backports.16:07
cgoncalvesI think there's good value in having non-cores also contributing with their vote16:07
cgoncalveswould anyone disagree?16:07
johnsomOpps, that was not the intent. Everyone should be able to vote on that16:07
cgoncalvesI submitted a patch to allow "Registered Users" to vote on backports16:08
cgoncalves#link https://review.opendev.org/#/c/673764/16:08
cgoncalvesplease have a look and vote16:08
cgoncalvesgthiemonge, thank you for bringing this to the core team attention!16:09
cgoncalveslooking forward to seeing everyone voting on backports, as well as doing the actual backport work :)16:09
johnsomYes, thanks for letting us know!16:10
cgoncalves#topic Brief progress reports / bugs needing review16:10
*** openstack changes topic to "Brief progress reports / bugs needing review (Meeting topic: Octavia)"16:10
cgoncalves1, 2, 3. go!16:10
johnsomI have been busy finishing the octavia-lib get patches. We now have a fancy functional test that actually spins up the driver agent and uses the octavia-lib to get information.16:11
johnsomI also setup scenario tests for the log offloading to check that off my list.16:11
colin-refreshed a woefully outdated amp build job with the latest in stable/stein and have a control plane upgraded in-place in lab successfully to stein. testing it in preparation for upgrading across all envs16:12
cgoncalvesnice!16:12
johnsomI plan to start on the long-lived-provider-processes RFE and then move to focus on fixing the failover flows to be better.16:12
johnsomPlus I have been doing reviews and trying to stay on top of the priority patch list.16:13
cgoncalvesyeah, +30 patches were merged since last meeting.16:14
johnsomYeah, we are making super progress on getting reviews done, but there is still more work to do!16:15
cgoncalvesI think one import milestone was the merge of the multi-listener LBs16:15
cgoncalves#link https://review.opendev.org/#/q/Idaccbcfa0126f1e26fbb3ad770c65c9266cfad5b16:15
cgoncalvesthanks to Michael and Adam for awesome work there16:15
johnsomYes, that has been needed for some time.  Thanks to Adam for helping me with that effort.16:16
colin-yeah really stoked about that one!16:16
*** trident has quit IRC16:16
cgoncalvesI submitted small patches for different fronts: increase timeouts for the centos job, add missing lib dependencies to requirements.txt, switch fedora amp image to minimal + upgrade to fedora 29 (latest available in DIB), and other small fixes here and there16:18
*** rpittau is now known as rpittau|afk16:18
cgoncalvesanyone else would like to share progress and/or raise patches needing review?16:19
cgoncalvesI mean, there are plenty of patches needing review :) I mean patches needing higher priority over others ;)16:20
cgoncalvesplease also feel empowered to help maintaining the priority review list16:21
cgoncalves#link https://etherpad.openstack.org/p/octavia-priority-reviews16:21
*** trident has joined #openstack-lbaas16:21
johnsomPlease add anything missing to the list or the "awaiting prioritization" section.16:22
cgoncalvesok, should we move on to open discussion?16:23
cgoncalves#topic Open discussion16:24
*** openstack changes topic to "Open discussion (Meeting topic: Octavia)"16:24
cgoncalveswould anyone like to see something discussing while we're all here? we have still 35 minutes left :)16:25
colin-any official word on any vendors contributing provider drivers to the project? seems like it's been a while since someone asked16:26
johnsomIt would be super cool if we could merge this:16:26
johnsom#link https://review.opendev.org/67368116:26
johnsomSo we can cut an octavia-lib release.16:26
cgoncalvescolin-, OVN and VMware have been working actively on their provider drivers16:28
cgoncalvesjohnsom worked on the getters in octavia-lib. it was something needed by VMware and was discussed here on the channel16:29
johnsomYes. I think there is one other vendor that has a working driver in their lab.16:30
*** Vorrtex has quit IRC16:30
colin-good to hear :) just clicked on the vendors section of the octavia piece of the user survey so it was top of mind16:33
cgoncalvesthe providers framework is relatively new. even though it's been around since Rocky, Stein further consolidated that framework with the driver agent and now in Train with additional features in that area16:34
cgoncalvesyeah, the user survey may help vendors accelerate their provider drivers16:35
cgoncalvesthe project has been very open to hear from vendors on their requirements, and working nicely with the two providers before mentioned (again, kudos to Michael)16:36
cgoncalvesoki doki. if there's nothing else to discuss today, we can close the meeting16:38
johnsomo/ Thanks for running the meeting.16:39
cgoncalvesthank you, everyone! we meet again next week. the channel is open 24//7!16:39
cgoncalves#endmeetnig16:39
colin-ttyl16:39
cgoncalves#endmeeting16:39
*** openstack changes topic to "Discussions for OpenStack Octavia | Priority bug review list: https://etherpad.openstack.org/p/octavia-priority-reviews"16:39
openstackMeeting ended Wed Jul 31 16:39:36 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:39
openstackMinutes:        http://eavesdrop.openstack.org/meetings/octavia/2019/octavia.2019-07-31-16.00.html16:39
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/octavia/2019/octavia.2019-07-31-16.00.txt16:39
openstackLog:            http://eavesdrop.openstack.org/meetings/octavia/2019/octavia.2019-07-31-16.00.log.html16:39
*** takamatsu has joined #openstack-lbaas16:47
*** trident has quit IRC16:48
*** ricolin has quit IRC16:50
*** trident has joined #openstack-lbaas16:51
*** takamatsu has quit IRC16:59
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add an optional tenant flow log offload test  https://review.opendev.org/67372017:05
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add an optional amphora admin log offloading test  https://review.opendev.org/67372617:08
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add listener scalability scenario test  https://review.opendev.org/66954117:15
*** lemko has quit IRC17:40
*** maciejjozefczyk has quit IRC17:48
*** tesseract has quit IRC18:05
*** goldyfruit has quit IRC18:11
*** altlogbot_1 has quit IRC18:19
*** altlogbot_1 has joined #openstack-lbaas18:20
*** takamatsu has joined #openstack-lbaas18:43
*** lemko has joined #openstack-lbaas19:02
*** goldyfruit has joined #openstack-lbaas19:34
*** takamatsu has quit IRC19:47
*** ajay33 has quit IRC19:56
*** boden has quit IRC20:25
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: DNM: Testing the tempest jobs  https://review.opendev.org/67390920:36
*** trident has quit IRC20:44
*** trident has joined #openstack-lbaas20:46
*** goldyfruit has quit IRC20:50
*** goldyfruit has joined #openstack-lbaas20:51
colin-for the multi-listener LBs change, what's the best way to track its progress into stable/stein? is that a separate change?20:56
johnsomcolin- https://review.opendev.org/67351820:57
colin-just what i was looking for, thx20:58
*** goldyfruit has quit IRC21:40
*** takamatsu has joined #openstack-lbaas21:40
*** rcernin has joined #openstack-lbaas22:05
*** goldyfruit has joined #openstack-lbaas22:31
*** goldyfruit has quit IRC22:35
*** tkajinam has joined #openstack-lbaas22:57
*** lemko has quit IRC23:10
openstackgerritMerged openstack/octavia-lib master: Add constants to octavia-lib  https://review.opendev.org/67368123:52
openstackgerritAdam Harwell proposed openstack/python-octaviaclient master: Add l7policy and l7rule to octavia quota  https://review.opendev.org/59156823:54
johnsomFYI: I have proposed an octavia-lib release: https://review.opendev.org/67392823:58
*** takamatsu has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!