Tuesday, 2018-07-24

openstackgerritMichael Johnson proposed openstack/octavia master: Add amphora statistics to the admin API  https://review.openstack.org/58503100:11
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Adds get_amphora_stats to the service client  https://review.openstack.org/58506000:31
*** threestrands has quit IRC00:38
*** hongbin has joined #openstack-lbaas00:39
*** longkb has joined #openstack-lbaas00:40
korean101hmmmm00:44
korean101johnsom: HI00:44
korean101johnsom: I have a question00:44
johnsomkorean101 Hi, I might have an answer00:45
korean101johnsom: :)00:45
korean101johnsom: lb-mgmt-network is a virtual network right?00:45
johnsomyes, a neutron network00:46
korean101johnsom: how can octavia-worker connect to lb-mgmt-net (9443 port)?00:46
korean101johnsom: Failed to establish a new connection: [Errno 113] No route to host00:46
korean101johnsom: i have a some ERRORs00:47
korean101johnsom: octavia-worker have a real network00:47
korean101johnsom: real network <--> neutron network00:47
johnsomThere are many ways to do it. Some people use provider networks, some add the instances to the vxlan, some add a port directly to OVS or the linux bridge locally (this is how devstack does it)00:47
*** JudeC has quit IRC00:48
korean101johnsom: yes. i know devstack's way00:48
johnsomkorean101 https://github.com/openstack/octavia/blob/master/devstack/plugin.sh#L34100:48
johnsomOh, ha, well, there is another link00:48
korean101johnsom: but I use kolla-ansible00:49
johnsomOpenStack Ansible uses a provider VLAN00:49
korean101johnsom: my octavia daemons in controller nodes00:49
korean101johnsom: provider vlan?00:49
korean101johnsom: can i get some links?00:49
korean101johnsom: any documents?00:49
johnsomhttps://github.com/openstack/openstack-ansible-os_octavia/blob/master/tasks/octavia_mgmt_network.yml00:50
johnsomhttps://docs.openstack.org/neutron/pike/admin/intro-os-networking.html#provider-networks00:51
johnsomhttps://docs.openstack.org/openstack-ansible-os_octavia/latest/configure-octavia.html#setup-a-neutron-network-for-use-by-octavia00:52
korean101johnsom: additional bridge needed?00:53
johnsomIt totally depends on your environment and how you want to do your networking.00:54
johnsomSadly, I cannot spend a lot of time tonight helping, I have some pressing work to finish.00:54
korean101johnsom: ok00:54
korean101johnsom: this links helps to me00:55
korean101johnsom: really thanks!!!00:55
korean101johnsom: always00:55
johnsomOh good.00:55
*** rcernin_ has joined #openstack-lbaas00:56
*** rcernin has quit IRC00:58
*** links has joined #openstack-lbaas01:17
*** yamamoto has joined #openstack-lbaas01:20
*** yamamoto has quit IRC01:24
openstackgerritMichael Johnson proposed openstack/octavia master: Add amphora statistics to the admin API  https://review.openstack.org/58503101:39
*** fnaval has joined #openstack-lbaas01:40
*** fnaval has quit IRC01:45
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Adds get_amphora_stats to the service client  https://review.openstack.org/58506001:46
*** ramishra has joined #openstack-lbaas03:01
*** JudeC has joined #openstack-lbaas04:15
*** hongbin has quit IRC04:16
*** phuoc_ has joined #openstack-lbaas04:45
*** phuoc has quit IRC04:48
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add an active/standby scenario test  https://review.openstack.org/58468105:03
*** JudeC has quit IRC05:09
rm_workcgoncalves: in that repo the latest version of git is git-2.18.0-1.WANdisco.402.x86_64.rpm from 03-Jul-201805:17
rm_workit isn't sorted by date :P05:17
rm_workbut yeah i didn't even realize that they HAD a cent7 repo, but i think the version is essentially the same05:17
rm_workyeah05:18
rm_workit is05:18
rm_workbut prolly i should anyway, maybe compiled against different libs05:18
* rm_work shrugs05:18
johnsomYou don't have to etch your patch on a stone tablet to do a "git commit" anymore?05:18
rm_worknot with this fancy new git tech from the turn of the century! :P05:19
*** yboaron has joined #openstack-lbaas05:19
johnsomI have a working VRRP scenario gate...05:19
johnsomAt least it works local...05:19
rm_workooo05:20
rm_workyeah i have one working internally05:20
rm_workerr, i did, but i might need to rebase it a ton05:20
johnsomHA, and forgot to run pep on it... sigh05:20
rm_workbut mine tracks the master, not sure how yours works05:20
rm_work(my system updates master/standby in the amp table)05:21
johnsomI added amphora stats API so I can see which one handled the traffic05:21
rm_workahhh nice05:21
rm_workso that's how you do it05:21
rm_workclever05:21
johnsomYeah, I am on a bit of a timeline, so...  Shortest path from A->B05:22
johnsomWhich happened to be extend the API05:22
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add an active/standby scenario test  https://review.openstack.org/58468105:22
*** kobis has joined #openstack-lbaas05:25
*** kobis has quit IRC05:26
rm_worklol05:26
rm_workk05:26
*** kobis has joined #openstack-lbaas05:26
*** kobis has quit IRC05:33
johnsomCalling it a night, catch you all tomorrow.05:45
*** yamamoto has joined #openstack-lbaas05:46
*** yamamoto has quit IRC05:48
*** nmanos has joined #openstack-lbaas05:52
*** yamamoto has joined #openstack-lbaas05:56
korean101johnsom: see you~05:59
*** yamamoto has quit IRC06:00
*** kobis has joined #openstack-lbaas06:06
*** kobis has quit IRC06:06
*** kobis has joined #openstack-lbaas06:10
*** nmanos has quit IRC06:17
*** nmanos has joined #openstack-lbaas06:17
korean101hmmmmm06:19
korean101octavia can't use DVR?06:19
*** AlexStaf has joined #openstack-lbaas06:25
*** nmanos has quit IRC06:30
*** nmanos has joined #openstack-lbaas06:31
*** pcaruana has joined #openstack-lbaas06:34
*** ispp has joined #openstack-lbaas07:05
*** JudeC has joined #openstack-lbaas07:12
*** tesseract has joined #openstack-lbaas07:18
*** AlexeyAbashkin has joined #openstack-lbaas07:50
*** velizarx has joined #openstack-lbaas07:54
*** yboaron has quit IRC07:55
*** rcernin_ has quit IRC07:56
*** ftersin has quit IRC08:00
*** yamamoto has joined #openstack-lbaas08:09
*** rcernin_ has joined #openstack-lbaas08:09
*** JudeC has quit IRC08:19
*** kobis has quit IRC08:20
*** yamamoto has quit IRC08:26
*** phuoc_ has quit IRC08:27
*** kobis has joined #openstack-lbaas08:27
*** phuoc_ has joined #openstack-lbaas08:27
*** velizarx has quit IRC08:29
*** ispp has quit IRC08:30
*** velizarx has joined #openstack-lbaas08:31
*** ispp has joined #openstack-lbaas08:38
*** yboaron has joined #openstack-lbaas08:48
*** phuoc_ has quit IRC08:58
*** phuoc_ has joined #openstack-lbaas08:58
*** dmellado has quit IRC09:03
*** phuoc_ has quit IRC09:04
*** phuoc has joined #openstack-lbaas09:05
*** kiennt26 has joined #openstack-lbaas09:06
*** apuimedo has joined #openstack-lbaas09:11
openstackgerritCarlos Goncalves proposed openstack/octavia master: DNM: Gate test with publish-openstack-docs-pti  https://review.openstack.org/58518509:25
openstackgerritCarlos Goncalves proposed openstack/octavia master: DNM: Gate test with publish-openstack-docs-pti  https://review.openstack.org/58518509:38
openstackgerritAdit Sarfaty proposed openstack/octavia master: Init provider drivers at app setup  https://review.openstack.org/58519309:39
*** oanson has quit IRC09:45
*** oanson has joined #openstack-lbaas09:45
*** kiennt26 has quit IRC10:17
*** yboaron_ has joined #openstack-lbaas10:23
*** dmellado has joined #openstack-lbaas10:24
*** yboaron has quit IRC10:26
*** velizarx has quit IRC10:51
*** rcernin_ has quit IRC10:52
*** velizarx has joined #openstack-lbaas10:56
*** phuoc has quit IRC10:59
*** phuoc has joined #openstack-lbaas11:00
*** yamamoto_ has joined #openstack-lbaas11:14
*** yboaron_ has quit IRC11:17
*** yamamoto has joined #openstack-lbaas11:25
*** yamamoto_ has quit IRC11:27
*** atoth has joined #openstack-lbaas11:29
*** yamamoto has quit IRC11:29
*** yamamoto has joined #openstack-lbaas11:31
*** yamamoto has quit IRC11:32
*** yamamoto has joined #openstack-lbaas11:32
*** longkb has quit IRC11:39
*** kobis has quit IRC11:43
*** yamamoto has quit IRC11:47
*** phuoc has quit IRC11:51
*** phuoc has joined #openstack-lbaas11:52
*** yamamoto has joined #openstack-lbaas11:57
*** amuller has joined #openstack-lbaas11:58
*** yamamoto has quit IRC11:59
*** yamamoto has joined #openstack-lbaas12:01
*** strigazi has quit IRC12:13
*** strigazi has joined #openstack-lbaas12:14
*** yboaron has joined #openstack-lbaas12:26
*** yamamoto has quit IRC12:27
*** yamamoto has joined #openstack-lbaas12:30
crazikgoh.12:32
crazikWhat can be a reason for not using spare amphoras when new LB is being created?12:32
crazikeach LB create request starts with amphora create, althought there already are spares...12:34
*** ispp has quit IRC12:39
*** velizarx has quit IRC12:53
*** velizarx has joined #openstack-lbaas12:58
*** ispp has joined #openstack-lbaas12:59
cgoncalvescrazik, spare amps are used when a failover occurs13:04
johnsomkorean101: we do work on networks using DVR however DVR has had a lot of bugs that have caused some things to not work.  For example floating IPs were broken with DVR until Pike13:06
openstackgerritCarlos Goncalves proposed openstack/octavia master: Fixing Octavia generating json named file containing yaml  https://review.openstack.org/58502413:06
*** ianychoi has quit IRC13:08
johnsomcrazik: If you have anti-affinity enabled it will not use the spares pool as nova cannot guarantee the spare will meet the anti-affinity rules13:08
*** phuoc has quit IRC13:08
*** ianychoi has joined #openstack-lbaas13:08
*** phuoc has joined #openstack-lbaas13:08
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add an active/standby scenario test  https://review.openstack.org/58468113:26
johnsomHa, I guess it helps if I tell the gate jobs to run the new tests and not the old ones......13:26
*** apuimedo is now known as apuimedo|afk13:52
*** fnaval has joined #openstack-lbaas13:55
*** KeithMnemonic has joined #openstack-lbaas14:24
*** yamamoto has quit IRC14:25
*** yamamoto has joined #openstack-lbaas14:27
*** yamamoto has quit IRC14:27
*** yamamoto has joined #openstack-lbaas14:27
*** links has quit IRC14:31
*** yamamoto has quit IRC14:43
*** yamamoto has joined #openstack-lbaas14:54
*** yboaron_ has joined #openstack-lbaas14:57
*** yboaron has quit IRC15:00
*** rcernin_ has joined #openstack-lbaas15:04
*** ispp has quit IRC15:26
*** rcernin_ has quit IRC15:30
*** pcaruana has quit IRC15:32
*** ispp has joined #openstack-lbaas15:41
*** hongbin has joined #openstack-lbaas15:42
hongbinfolks, if you find your gate break due to the recent landed validation logic in neutron, you might consider merging this fix: https://review.openstack.org/#/c/584000/15:43
*** velizarx has quit IRC15:53
*** ispp has quit IRC16:04
*** Krast has joined #openstack-lbaas16:18
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add an active/standby scenario test  https://review.openstack.org/58468116:25
johnsomOye, and remember to add the depends-on16:26
johnsomhongbin Thanks!16:28
*** yamamoto has quit IRC16:33
eanderssonWhat is the heartbeat_key ?16:39
eanderssonOr rather... setting it to insecure seems like a bad idea right?16:40
eanderssone.g. https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/octavia/templates/octavia.conf.j2#L5616:40
johnsomYes, that is just a "default" password worded to be a red-flag for folks.16:41
johnsomThe heartbeat message that comes from the amps is HMAC encoded (also has a nonce code of the amp ID) with this key.16:41
johnsomSo, summary, change it at deploy time.  Changing it with running amps can lead to failovers16:42
*** sanfern has joined #openstack-lbaas16:43
eanderssonI figured as much, but we tend to use kolla-ansible as a template, so wanted to double check :p16:45
eanderssonThanks johnsom16:45
johnsomNP16:45
*** JudeC has joined #openstack-lbaas16:51
*** AlexeyAbashkin has quit IRC17:11
rm_worknice, we're also using kolla-ansible for deployments soon ;)17:16
*** ramishra has quit IRC17:17
*** tesseract has quit IRC17:17
openstackgerritCarlos Goncalves proposed openstack/octavia master: Fix DIB_REPOREF_amphora_agent not set on Git !=1.8.5  https://review.openstack.org/58485617:26
rm_workcgoncalves: why is it "!=1.8.5"?17:34
rm_workwas there literally a specific feature ONLY on 1.8.5?17:34
rm_workor should it just be >=1.8.5?17:34
*** sanfern has quit IRC17:35
*** abaindur has joined #openstack-lbaas17:59
*** amuller has quit IRC18:41
crazikcgoncalves: I was quite sure it uses spare amphoras not only for failover.. need to test on dev env again :/18:55
crazikjohnsom: hm, it's not the issue in this case18:55
cgoncalvesrm_work, git -C only works >=1.8.518:56
crazikjohnsom: I have anti-affinity enabled18:56
rm_workright, ok18:56
rm_workyou have "!=" tho18:56
rm_workso was really confused what was specific about that one version :P18:56
rm_workprobably you mean "Fix DIB_REPOREF_amphora_agent not set on Git <1.8.5"18:57
*** yamamoto has joined #openstack-lbaas19:14
*** yamamoto has quit IRC19:19
johnsomcrazik: yes, so with anti-affinity enabled, spares pool is disabled for allocation.19:41
*** yboaron_ has quit IRC19:47
cgoncalvesrm_work, nop. with the code as-is, on >1.8.5 the command would be 'git -c' (lowercase c) which doesn't work19:47
cgoncalvesrm_work, 'git -C' (uppercase c) is only used when ==1.8.519:48
cgoncalvesrm_work, check the 'Fedora 28' part on https://storyboard.openstack.org/#!/story/200306719:49
*** rtjure has quit IRC19:57
colby_Hey All. Im setting up octavia using a ml2 gre network. I created the ports in neutron and create the bridge port on the node with the following command on our network nodes:20:16
colby_ovs-vsctl -- --may-exist add-port br-int o-lbmgmt0 -- set Interface o-lbmgmt0 type=internal -- set Interface o-lbmgmt0 external-ids:iface-status=active -- set Interface o-lbmgmt0 external-ids:attached-mac=fa:16:3e:f4:c9:97 -- set Interface o-lbmgmt0 external-ids:iface-id=db98bbe6-ae9c-4cb1-ab2e-72c0e3cde841 -- set Interface o-lbmgmt0 external-ids:skip_cleanup=true20:16
colby_how do I make that persistent on boot on Centos?20:16
cgoncalvescolby_, create /etc/sysconfig/network-scripts/ifcfg-o-lbmgmt020:18
*** rcernin_ has joined #openstack-lbaas20:18
cgoncalvesa template: https://github.com/openstack/tripleo-common/blob/master/playbooks/roles/octavia-controller-config/templates/ifcfg.j220:18
johnsomWow, learn something new. I thought you had to shove it in ifup-local.  Cool!20:19
colby_Great! Thats exactly what I needed. Im not familiar with ovs network scripts. So was not sure on proper syntax20:19
crazikjohnsom: hm, can I change this behavior? I thought spare pool is for faster LB deployment. In this case it would be only used for failover when compute node fails...20:30
johnsomcrazik Spares pool is used for both new LBs and failover. however, if you enable anti-affinity we cannot pull an instance from the spares pool as nova can't guarantee the instances from the spares pool will meet the anti-affinity rules.  This is probably an area we could enhance to work around the nova limitations20:32
crazikjohnsom: but if I have 3 AZ, and 3 spares in pool..20:33
crazikthen spares could use anti-affinity and be ready for a new LB20:33
*** nmanos has quit IRC20:35
crazikin fact, 2 spares in pool should be enough for active/standby layout20:35
*** crazik has quit IRC20:45
*** rtjure has joined #openstack-lbaas20:58
*** rcernin_ has quit IRC21:30
*** JudeC_ has joined #openstack-lbaas21:44
*** JudeC has quit IRC21:44
johnsomcrazik It is enough, but we can't add them to an anti-affinity server  group in nova. It doesn't live migrate if the server being added doesn't meet the anti-affinity rules.  We don't know "where" the spares compute instances are in the cloud as anti-affinity can mean different things in different clouds.  By default it is just two different compute hosts, but it could be AZs, etc.21:44
openstackgerritMichael Johnson proposed openstack/octavia-tempest-plugin master: Add an active/standby scenario test  https://review.openstack.org/58468121:48
*** yamamoto has joined #openstack-lbaas21:59
*** yamamoto has quit IRC22:04
*** yamamoto has joined #openstack-lbaas22:06
*** fnaval has quit IRC22:21
*** rcernin has joined #openstack-lbaas22:30
*** hongbin has quit IRC22:30
*** fnaval has joined #openstack-lbaas23:00

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!