Monday, 2018-12-17

« Sunday, 2018-12-16 Index Tuesday, 2018-12-18 »
*** abaindur has joined #openstack-lbaas00:09
*** ivve has quit IRC00:23
*** ivve has joined #openstack-lbaas00:35
*** abaindur has quit IRC01:12
*** yangjianfeng has joined #openstack-lbaas01:13
*** yangjianfeng has quit IRC01:14
*** oanson has quit IRC01:59
*** abaindur has joined #openstack-lbaas02:03
*** hongbin has joined #openstack-lbaas02:11
*** abaindur has quit IRC02:14
*** hongbin has quit IRC02:28
*** PagliaccisCloud has quit IRC03:37
*** ramishra has joined #openstack-lbaas03:42
*** PagliaccisCloud has joined #openstack-lbaas04:48
*** rcernin has joined #openstack-lbaas05:46
*** rcernin has quit IRC05:47
*** rcernin has joined #openstack-lbaas06:09
*** rcernin has quit IRC06:09
*** rcernin has joined #openstack-lbaas06:09
*** rcernin has quit IRC06:09
*** gcheresh_ has joined #openstack-lbaas06:35
*** gcheresh has joined #openstack-lbaas06:39
*** gcheresh_ has quit IRC06:39
openstackgerritMarek Lyčka proposed openstack/octavia-dashboard master: Implements a filtered select  https://review.openstack.org/61817306:48
*** ccamposr has joined #openstack-lbaas07:07
*** yboaron_ has quit IRC07:28
*** Emine has joined #openstack-lbaas07:33
*** oanson has joined #openstack-lbaas07:34
*** abaindur has joined #openstack-lbaas07:40
openstackgerritNir Magnezi proposed openstack/octavia master: Tags support for lb resources  https://review.openstack.org/60600607:58
*** rpittau has joined #openstack-lbaas07:58
*** velizarx has joined #openstack-lbaas08:17
*** pcaruana has joined #openstack-lbaas08:18
*** yboaron_ has joined #openstack-lbaas08:29
*** velizarx has quit IRC08:29
*** yamamoto has quit IRC08:30
*** yamamoto has joined #openstack-lbaas08:32
*** yboaron_ has quit IRC08:33
*** yboaron_ has joined #openstack-lbaas08:34
*** yamamoto has quit IRC08:46
*** velizarx has joined #openstack-lbaas08:53
*** abaindur has quit IRC08:56
*** abaindur has joined #openstack-lbaas08:58
*** abaindur has quit IRC09:02
*** yamamoto has joined #openstack-lbaas09:26
*** yamamoto has quit IRC09:45
*** yamamoto has joined #openstack-lbaas09:45
*** rtjure has quit IRC09:52
*** PagliaccisCloud has quit IRC10:02
*** yamamoto has quit IRC10:06
*** PagliaccisCloud has joined #openstack-lbaas10:10
*** yamamoto has joined #openstack-lbaas10:18
*** jarodwl has quit IRC10:20
*** psachin has joined #openstack-lbaas10:20
*** pbandark has joined #openstack-lbaas10:21
*** PagliaccisCloud has quit IRC10:21
*** yboaron_ has quit IRC10:21
*** yboaron_ has joined #openstack-lbaas10:22
*** yamamoto has quit IRC10:23
*** salmankhan has joined #openstack-lbaas10:25
pbandarkhi.. i am unable to create octavia LB. from  amphora instance console logs, i can see:  https://pastebin.com/uPm57w4Y . i am unable to understand the cause from the call trace. can anyone help me to understand the cause?10:25
nmagnezipbandark, is this in devstack? In any case I think you should try (as admin) to boot a nova instance using the same glance image and same nova flavor so you'll see if that even works10:28
pbandarknmagnezi, its tripleo setup. when i tried to boot instance with amphora/centos7/6 image i get same trace. but, i can boot instance with rhel7/cirros.. its very strange :-(10:29
nmagnezipbandark, for some reason your instance gets a kernel, I can't tell why but it does not look directly related to Octavia10:31
nmagnezipbandark, did you try to look at either Nova or Libvirt logs?10:31
pbandarkyeah.. it seems generic to nova/libvirt10:32
nmagnezipbandark, maybe try to download a fresh image and upload to glance, maybe something got corrupted with the image?10:32
pbandarkyup. i tried enabling libvirt/nova debug. but, no pointers10:32
zigoWhat should I put in Neutron's service_plugins= directive? If I set 'neutron_lbaas.services.loadbalancer.plugin.LoadBalancerPluginv2' then it fails, with neutron complaining neutron_lbaas can't be found.10:33
pbandarki confirmed the checksum. but, let me give a try10:34
zigoDo I still need then python3-neutron-lbaas package?10:34
openstackgerritMarek Lyčka proposed openstack/octavia-dashboard master: Implements a filtered select  https://review.openstack.org/61817310:41
openstackgerritLuis Tomas Bolivar proposed openstack/octavia master: Enabling SG customization on loadbalancer listerners  https://review.openstack.org/60256410:45
*** salmankhan1 has joined #openstack-lbaas10:52
cgoncalveszigo, are you deploying Octavia or neutron-lbaas? if Octavia, you don't need to add anything special10:53
zigocgoncalves: Octavia.10:53
zigoOk.10:53
*** salmankhan has quit IRC10:54
*** salmankhan1 is now known as salmankhan10:54
zigoSo, no service_plugins at all for Octavia, thanks.10:54
cgoncalvespbandark, did you build your own amphora image? what do you mean by "amphora/centos7/6"? centos 7.6-based amphora? centos7 and centos6?10:54
cgoncalveszigo, right10:54
cgoncalvespbandark, ok, from kernel trace I see you have centos 7.6-based amphora image10:55
pbandarkcgoncalves, i havent build the image. i tried booting the new instance with amphora image(default), centos7, centos610:56
pbandarkwhich failed with exact call trace10:56
pbandarkbut, i am able to boot instance with rhel7/cirros images10:56
cgoncalvespbandark, from where did you get the amphora image? tripleo doesn't build one for you10:56
cgoncalvescentos6 is not supported10:57
pbandarki am using red hat bit which uploads amphora image to overcloud during the deployment10:57
cgoncalvesi.e. never tested upstream (nor downstream to red hat at least)10:57
cgoncalvesok, so OSP environment10:57
cgoncalvespbandark, have you changed any other default setting?10:59
cgoncalvesOSP 13 (queens), correct?10:59
pbandarki havent made any change. yup its queens10:59
*** yamamoto has joined #openstack-lbaas11:00
cgoncalvesFYI downstream does not support non-official amphora images, which seems to be what you are doing11:01
cgoncalvesso you are, in fact, customizing your environment11:01
cgoncalvesoops, I read your message again and you said you were using default amphora image so the official one11:03
pbandarkif it would have failed for all instances/images then i could have thought of the compute node might be culprit. but for me i can boot rhel7/cirros instances. the issue is only with cenos7/7and amphora images :-|11:04
pbandarkcentos7/6*11:04
cgoncalvespbandark, from where are you getting the centos7 amphora image?11:05
pbandarkcentos7 i am downloading from internet. and amphora is uploaded during the deployment process11:05
cgoncalvesfrom where in the internet...?11:06
cgoncalvesthe internet is a bit big :)11:06
pbandarkhttps://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.qcow211:06
cgoncalvesthat is a generic centos image. it is NOT an amphora-ready image11:06
cgoncalvesyou could try from https://images.rdoproject.org/octavia/queens/11:07
cgoncalvescentos7-based amphora images for Queens11:07
pbandarkok11:07
openstackgerritLuis Tomas Bolivar proposed openstack/octavia stable/rocky: Enabling SG customization on loadbalancer listerners  https://review.openstack.org/62504411:09
openstackgerritLuis Tomas Bolivar proposed openstack/octavia stable/queens: Enabling SG customization on loadbalancer listerners  https://review.openstack.org/62506511:15
*** yboaron_ has quit IRC11:23
openstackgerritSven Wegener proposed openstack/octavia master: db: patch alembic migrations for postgresql  https://review.openstack.org/62555711:25
openstackgerritSven Wegener proposed openstack/octavia master: db: fix length of fields  https://review.openstack.org/62556011:31
openstackgerritDebo Zhang proposed openstack/octavia master: Fix typo  https://review.openstack.org/62556311:32
*** PagliaccisCloud has joined #openstack-lbaas11:33
*** yboaron_ has joined #openstack-lbaas11:33
*** celebdor has joined #openstack-lbaas11:36
*** yamamoto has quit IRC11:38
*** yamamoto has joined #openstack-lbaas11:38
*** AlexStaf has joined #openstack-lbaas11:43
*** rtjure has joined #openstack-lbaas11:53
*** rpittau is now known as rpittau|lunch12:09
*** PagliaccisCloud has quit IRC12:23
*** serhatd has joined #openstack-lbaas12:40
pbandarkcgoncalves, it seems i am hitting https://bugs.launchpad.net/ubuntu/+source/linux/+bug/178395212:42
openstackLaunchpad bug 1783952 in linux (Ubuntu) "Xubuntu 16.04 L0 hypervisor kernel panics L1 CentOS 7.5.1804 guest" [High,Confirmed]12:42
pbandarkmy setup is also running on ubuntu hypervisor with nested virt12:43
pbandarkseems the issue is fixed in latest ubuntu release. wll try upgrading the hypervisor OS12:43
pbandarkthanks a lot for help cgoncalves12:43
pbandarknmagnezi thanks12:43
cgoncalvespbandark, glad you found the root cause :)12:44
cgoncalvesand good that we switched our centos job to also run centos on the controller :)12:44
*** rpittau|lunch is now known as rpittau13:11
*** sapd1__ has joined #openstack-lbaas13:18
serhatdHello everyone13:25
serhatdI have installed octavia with self signed ssl certificates. Although certificate config seems correct in octavia.conf, octavia worker can not connect to amphora. I see following error in octavia-worker log file:13:25
serhatd2018-12-17 16:15:04.218 19 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: SSLError: HTTPSConnectionPool(host='192.168.101.53', port=9443): Max retries exceeded with url: /0.5/info (Caused by SSLError(SSLError("bad handshake: Error([('SSL routines', 'ssl3_read_bytes', 'tlsv1 alert unknown ca')],)",),))13:25
serhatdDo you have any idea about reason of this error?13:25
*** gcheresh has quit IRC13:26
*** yamamoto has quit IRC13:27
*** gcheresh has joined #openstack-lbaas13:30
*** yamamoto has joined #openstack-lbaas13:32
openstackgerritMerged openstack/octavia-dashboard master: Implements a filtered select  https://review.openstack.org/61817313:36
*** pcaruana has quit IRC13:50
openstackgerritSven Wegener proposed openstack/octavia master: db: patch alembic migrations for postgresql  https://review.openstack.org/62555713:52
*** gcheresh_ has joined #openstack-lbaas13:55
*** gcheresh has quit IRC13:55
*** pcaruana has joined #openstack-lbaas14:05
*** reedipb has joined #openstack-lbaas14:06
*** aojea_ has joined #openstack-lbaas14:16
*** psachin has quit IRC14:17
*** AlexStaf has quit IRC14:19
*** velizarx has quit IRC14:24
*** gcheresh has joined #openstack-lbaas14:27
*** yboaron has joined #openstack-lbaas14:27
*** gcheresh_ has quit IRC14:27
*** yboaron_ has quit IRC14:27
openstackgerritNir Magnezi proposed openstack/octavia master: [WIP] Fix v1 scenario tests gates  https://review.openstack.org/62560814:29
*** Krast has joined #openstack-lbaas14:29
*** velizarx has joined #openstack-lbaas14:35
*** yboaron_ has joined #openstack-lbaas14:36
*** yamamoto has quit IRC14:38
*** yboaron has quit IRC14:39
*** gcheresh has quit IRC14:39
*** gcheresh_ has joined #openstack-lbaas14:39
*** yamamoto has joined #openstack-lbaas14:39
*** yamamoto has quit IRC14:45
*** yamamoto has joined #openstack-lbaas14:47
*** yamamoto has quit IRC14:53
*** velizarx has quit IRC15:09
*** yboaron_ has quit IRC15:10
*** yamamoto has joined #openstack-lbaas15:27
*** pcaruana has quit IRC15:29
openstackgerritSven Wegener proposed openstack/octavia master: db: fix length of fields  https://review.openstack.org/62556015:40
*** pcaruana has joined #openstack-lbaas15:51
*** velizarx has joined #openstack-lbaas16:10
*** gcheresh_ has quit IRC16:16
*** amuller has joined #openstack-lbaas16:23
*** Emine has quit IRC16:24
*** fnaval has joined #openstack-lbaas16:25
*** pcaruana has quit IRC16:28
openstackgerritMichael Johnson proposed openstack/octavia master: Fix v1 scenario tests gates  https://review.openstack.org/62560816:42
openstackgerritMichael Johnson proposed openstack/neutron-lbaas master: Fix the scenario test gates  https://review.openstack.org/62565816:43
*** ccamposr has quit IRC16:44
johnsomserrhatd Your controller cannot validate the certificate being presented from the amphora. This is likely because the controller has the wrong CA certificate configured. Please see this guide for the steps to set it up correctly: https://review.openstack.org/#/c/613454/16:46
*** Emine has joined #openstack-lbaas16:48
*** badloop has quit IRC17:11
*** ramishra has quit IRC17:12
*** badloop has joined #openstack-lbaas17:14
*** serhatd has quit IRC17:17
*** pbandark has quit IRC17:17
*** badloop has quit IRC17:18
openstackgerritCarlos Goncalves proposed openstack/octavia master: Install HAProxy 1.8 from Software Collections  https://review.openstack.org/62567217:22
cgoncalvesrm_work, ^, in case you still care about centos-based amps :)17:23
*** sapd1__ has quit IRC17:29
*** badloop has joined #openstack-lbaas17:40
*** badloop has quit IRC17:47
*** PagliaccisCloud has joined #openstack-lbaas17:50
*** Emine has quit IRC17:54
*** Emine has joined #openstack-lbaas17:54
*** PagliaccisCloud has quit IRC17:55
*** Emine has quit IRC17:58
*** PagliaccisCloud has joined #openstack-lbaas18:03
*** velizarx has quit IRC18:04
*** salmankhan has quit IRC18:09
*** phuoc_ has quit IRC18:15
*** rpittau has quit IRC18:16
xgermanlol - "rh-haproxy18"18:19
openstackgerritSven Wegener proposed openstack/octavia master: db: fix length of fields  https://review.openstack.org/62556018:20
*** gcheresh_ has joined #openstack-lbaas18:58
openstackgerritGerman Eichberger proposed openstack/octavia master: Amphora logging  https://review.openstack.org/62483519:06
amullerxgerman: packaging is a wonderful and mythical realm...19:06
*** Emine has joined #openstack-lbaas19:10
*** gcheresh_ has quit IRC19:10
rm_workwoo19:24
*** PagliaccisCloud has quit IRC19:44
*** aojea has joined #openstack-lbaas20:05
*** aojea_ has quit IRC20:06
rm_workcgoncalves: finally more official :P20:13
rm_worknice20:13
*** aojea has quit IRC20:42
*** celebdor has quit IRC20:43
*** celebdor has joined #openstack-lbaas20:45
*** yboaron has joined #openstack-lbaas20:49
*** celebdor has quit IRC20:51
*** dmellado has quit IRC21:05
openstackgerritMerged openstack/octavia master: Fix v1 scenario tests gates  https://review.openstack.org/62560821:08
openstackgerritCarlos Goncalves proposed openstack/octavia master: Install HAProxy 1.8 from Software Collections  https://review.openstack.org/62567221:11
*** Emine has quit IRC21:23
*** amuller has quit IRC21:24
xgermanuh, oh: http://logs.openstack.org/35/624835/6/check/octavia-v1-dsvm-scenario/001cdbe/job-output.txt.gz#_2018-12-17_20_24_33_93281221:24
johnsomxgerman that is actually the cirros image issue Nir and I posted patches for this morning.21:26
johnsomLooks like octavia merged, but lbass is still open.21:26
xgermancool. Figured it wasn’t me ;-)21:26
openstackgerritGerman Eichberger proposed openstack/octavia master: Amphora logging  https://review.openstack.org/62483521:26
cgoncalvesfeed me, hooman!21:26
*** rcernin has joined #openstack-lbaas21:28
*** celebdor has joined #openstack-lbaas21:45
*** ccamposr has joined #openstack-lbaas21:51
*** yboaron has quit IRC21:52
rm_workxgerman: so is that logging patch actually the thing that we were talking about for allowing configurable export of haproxy logs for the users, or is it just for getting admin logs?22:15
xgermanjust for getting admin logs right now… follow on pathces will support configurng haproxy log format22:16
xgermanbut operator still wouldl need to set up appropriate logging infrastructure to hsow by project-if22:16
xgermanthere is another proposal to ship haproxy logs to a log server the user sets up (e.g. in his tenant network) but that’s not part of that series22:17
rm_workhmm k22:17
rm_workuser haproxy logging came up internally22:17
rm_workalso, the thing we were talking about where we'd expose more of the reason for errors on the objects22:18
xgermanhaving the amp logs somewhere central alreday helped me on devstack (saved me logging into the amp to see some errors)22:19
xgermanso babysteps but not turn key (like in nova with nova console-log)22:19
*** yamamoto has quit IRC22:40
*** yamamoto has joined #openstack-lbaas22:41
*** ccamposr has quit IRC22:41
johnsomHmm, we have less than ~23 lines of buffer for our 90% coverage threshold.  I guess we need to really be paying attention to the coverage of each patch.22:54
rm_worki mean.... that's where we should be22:57
johnsomYeah, I just had hoped we were closer to 91% than 90%22:58
rm_workif there's a bunch of extra, it'll encourage some people to be lazy until it ends up at almost exact anyway22:58
rm_workreally it should be existing vs patched coverage22:58
johnsomYeah. I'm trying really hard for 100% on my changes22:58
rm_worki've been refusing to merge anything that doesn't include a new or updated test23:04
*** Emine has joined #openstack-lbaas23:04
rm_workor at least, that's been my intention23:04
rm_worki may have failed at being very strict about it <_<23:04
*** Emine has quit IRC23:08
*** abaindur has joined #openstack-lbaas23:26
*** celebdor has quit IRC23:26
*** fnaval has quit IRC23:26
*** abaindur has quit IRC23:28
*** abaindur has joined #openstack-lbaas23:29
rm_workjohnsom: anything from the priority review list stick out to you? I'm in "focus on some patches and drive them through" mode today23:32
rm_worki guess updating the list might be good23:32
johnsomhttps://review.openstack.org/62565823:33
rm_workcgoncalves: i wish the centos gates would actually pass so i could know if the centos changes are ok without building and testing myself <_<23:34
johnsomThis one is pretty straight forward: https://review.openstack.org/61345423:34
rm_workhmmm the l7 gate still fails on that23:34
rm_workdid we break something else?23:34
johnsomI have no idea what the status of the l7 gate is....23:35
rm_workit *should pass* unless something changed that affects backwards compatibility23:35
rm_workunfortunately what it's really testing is octavia stuff, but it runs in the neutron gate <_<23:35
rm_workso i'm worried we might have broken something23:36
rm_workok well, if it fixes the rest of the gates, then fine23:37
rm_workbut i guess i'll have to look at that in a bit23:37
*** celebdor has joined #openstack-lbaas23:41
rm_workjohnsom: i'm gonna see if i can walk through this guide in my devstack <_<23:42
johnsomYep, good plan. That is what I did as well23:42
rm_workshould we make this be the default devstack config as well?23:46
johnsomMaybe23:46
*** celebdor has quit IRC23:55
*** PagliaccisCloud has joined #openstack-lbaas23:57
*** Emine has joined #openstack-lbaas23:59
« Sunday, 2018-12-16 Index Tuesday, 2018-12-18 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!