Friday, 2017-10-13

rm_workxgerman_: you SHOULD probably review https://review.openstack.org/#/c/504175/ though00:00
rm_workthat's going to change how we use TLS Certs00:01
johnsomYeah, that is on my review short list too00:01
rm_workmy guess is, there will be some -1s the first round ;P00:03
rm_workbrb00:04
xgerman_Ok. Will look at it when kids are in bed ;-)00:07
*** sanfern has quit IRC00:31
rm_worklolk00:33
*** sanfern has joined #openstack-lbaas00:34
*** cody-somerville has joined #openstack-lbaas00:36
*** AlexeyAbashkin has joined #openstack-lbaas00:42
*** AlexeyAbashkin has quit IRC00:47
*** cody-somerville has quit IRC00:51
*** cody-somerville has joined #openstack-lbaas01:02
*** cody-somerville has quit IRC01:02
*** cody-somerville has joined #openstack-lbaas01:02
*** cody-somerville has quit IRC01:07
*** cody-somerville has joined #openstack-lbaas01:11
*** tongl has joined #openstack-lbaas01:17
*** cody-somerville has quit IRC01:39
*** AlexeyAbashkin has joined #openstack-lbaas01:45
*** AlexeyAbashkin has quit IRC01:49
*** sanfern has quit IRC01:57
*** sanfern has joined #openstack-lbaas01:58
*** sanfern has joined #openstack-lbaas01:59
*** sanfern has quit IRC01:59
*** AlexeyAbashkin has joined #openstack-lbaas02:43
*** AlexeyAbashkin has quit IRC02:48
*** links has joined #openstack-lbaas02:51
openstackgerritAdam Harwell proposed openstack/octavia master: WIP: Floating IP Network Driver (spans L3s)  https://review.openstack.org/43561203:03
rm_workjohnsom: we still having issues with certain hosts spawning instances with kvm?03:08
rm_workhttp://logs.openstack.org/45/511045/4/check/gate-octavia-v1-dsvm-scenario-ubuntu-xenial/3e67c3f/03:08
johnsomrm_work yep, ovh still has kvm problems03:10
rm_work:/03:10
rm_workit's been like, a year03:10
rm_workthough i guess the danger is that if we complain too much they might just *disable it* instead of fixing it, lol03:11
johnsomIt was fixed for a while but started again03:11
rm_workbleh03:11
johnsomIt could be the infra image too, not sure03:12
johnsomBut I only see it fail on the ovh hosts03:14
openstackgerritChenghui Yu proposed openstack/neutron-lbaas master: Fix usage of method ensure_dir  https://review.openstack.org/50293203:54
openstackgerritChenghui Yu proposed openstack/neutron-lbaas master: Update link in the README when using devstack to install neutron-lbaas  https://review.openstack.org/49520204:01
*** pcaruana has joined #openstack-lbaas04:27
*** aojea has joined #openstack-lbaas04:33
*** aojea has quit IRC04:37
*** armax has quit IRC04:50
*** armax has joined #openstack-lbaas04:51
*** armax has quit IRC04:51
*** armax has joined #openstack-lbaas04:51
*** armax has quit IRC04:52
*** armax has joined #openstack-lbaas04:52
*** armax has quit IRC04:53
*** pcaruana has quit IRC04:56
*** cody-somerville has joined #openstack-lbaas05:00
*** cody-somerville has quit IRC05:00
*** cody-somerville has joined #openstack-lbaas05:00
*** cody-somerville has quit IRC05:04
*** avtar_ has joined #openstack-lbaas05:05
*** cristicalin has joined #openstack-lbaas05:10
*** chlong has joined #openstack-lbaas05:20
*** cristicalin has quit IRC05:23
*** pcaruana has joined #openstack-lbaas05:30
*** slaweq_ has joined #openstack-lbaas05:32
*** slaweq_ has quit IRC05:33
*** pcaruana has quit IRC05:39
*** rcernin has joined #openstack-lbaas05:41
*** cristicalin has joined #openstack-lbaas05:43
*** gcheresh_ has joined #openstack-lbaas05:53
*** spectr has quit IRC05:58
*** spectr has joined #openstack-lbaas05:58
*** slaweq_ has joined #openstack-lbaas06:09
*** cristicalin has quit IRC06:17
*** gcheresh_ has quit IRC06:23
*** gcheresh_ has joined #openstack-lbaas06:37
*** slaweq_ has quit IRC06:40
*** slaweq_ has joined #openstack-lbaas06:44
*** gcheresh_ has quit IRC06:47
*** Alex_Staf_ has joined #openstack-lbaas06:54
*** pcaruana has joined #openstack-lbaas07:07
*** slaweq_ has quit IRC07:17
*** slaweq_ has joined #openstack-lbaas07:20
*** gcheresh_ has joined #openstack-lbaas07:22
*** tesseract has joined #openstack-lbaas07:22
*** AlexeyAbashkin has joined #openstack-lbaas07:24
*** spectr has quit IRC07:26
*** tesseract has quit IRC07:26
*** rcernin has quit IRC07:26
*** pcaruana has quit IRC07:26
*** spectr has joined #openstack-lbaas07:39
*** pcaruana has joined #openstack-lbaas07:40
*** rcernin has joined #openstack-lbaas07:40
*** gcheresh_ has quit IRC07:42
*** spectr has quit IRC07:43
*** pcaruana has quit IRC07:44
*** spectr has joined #openstack-lbaas07:44
*** pcaruana has joined #openstack-lbaas07:44
*** slaweq_ has quit IRC07:53
*** tongl has quit IRC07:58
*** slaweq_ has joined #openstack-lbaas08:02
*** AlexeyAbashkin has quit IRC08:10
*** AlexeyAbashkin has joined #openstack-lbaas08:11
*** gcheresh_ has joined #openstack-lbaas08:11
*** Alex_Staf_ has quit IRC08:21
*** slaweq_ has quit IRC08:35
*** slaweq_ has joined #openstack-lbaas08:44
*** aojea has joined #openstack-lbaas08:47
*** salmankhan has joined #openstack-lbaas08:53
*** Alex_Staf_ has joined #openstack-lbaas08:54
*** salmankhan1 has joined #openstack-lbaas08:57
*** salmankhan has quit IRC08:57
*** salmankhan1 is now known as salmankhan08:57
*** rcernin has quit IRC08:59
*** spectr has quit IRC08:59
*** pcaruana has quit IRC08:59
*** AlexeyAbashkin has quit IRC09:03
*** AlexeyAbashkin has joined #openstack-lbaas09:03
*** rcernin has joined #openstack-lbaas09:12
*** spectr has joined #openstack-lbaas09:12
*** pcaruana has joined #openstack-lbaas09:13
*** AlexeyAbashkin has quit IRC09:15
*** AlexeyAbashkin has joined #openstack-lbaas09:15
*** slaweq_ has quit IRC09:17
*** slaweq_ has joined #openstack-lbaas09:21
*** salmankhan has quit IRC09:26
*** salmankhan has joined #openstack-lbaas09:31
*** chlong has quit IRC09:40
*** slaweq_ has quit IRC09:55
*** slaweq_ has joined #openstack-lbaas10:00
*** aojea has quit IRC10:22
*** aojea has joined #openstack-lbaas10:23
*** aojea has quit IRC10:27
*** salmankhan has quit IRC10:45
*** aojea has joined #openstack-lbaas10:46
*** aojea has quit IRC10:47
*** pcaruana has quit IRC10:48
*** yamamoto has quit IRC10:48
*** salmankhan has joined #openstack-lbaas11:02
*** slaweq_ has quit IRC11:03
*** slaweq_ has joined #openstack-lbaas11:10
*** aojea has joined #openstack-lbaas11:18
*** aojea has quit IRC11:23
*** salmankhan has quit IRC11:38
*** salmankhan has joined #openstack-lbaas11:39
*** yamamoto has joined #openstack-lbaas11:40
*** gcheresh_ has quit IRC11:41
*** slaweq_ has quit IRC11:43
*** yamamoto has quit IRC11:45
*** yamamoto has joined #openstack-lbaas11:48
*** yamamoto has quit IRC11:54
*** isantosp has quit IRC12:15
*** isantosp has joined #openstack-lbaas12:18
*** aojea has joined #openstack-lbaas12:19
*** slaweq_ has joined #openstack-lbaas12:23
*** aojea has quit IRC12:23
isantospIs it possible in Pike release or future plans to create a loadBalancer without VIP? I think u had a work around but some inconsistencies of this, is that right?12:23
*** yamamoto has joined #openstack-lbaas12:28
*** yamamoto has quit IRC12:29
*** links has quit IRC12:45
*** pcaruana has joined #openstack-lbaas12:48
*** slaweq_ has quit IRC12:56
*** spectr has quit IRC12:57
*** slaweq_ has joined #openstack-lbaas13:01
*** spectr has joined #openstack-lbaas13:01
*** aojea has joined #openstack-lbaas13:20
*** aojea has quit IRC13:24
*** yamamoto has joined #openstack-lbaas13:30
*** sanfern has joined #openstack-lbaas13:32
*** chlong has joined #openstack-lbaas13:33
*** slaweq has quit IRC13:33
*** slaweq_ has quit IRC13:34
openstackgerritDong Jun proposed openstack/octavia master: import _ from octavia.i18n  https://review.openstack.org/51184613:36
openstackgerritDong Jun proposed openstack/octavia master: Valuable change reported by pylint  https://review.openstack.org/51184713:36
openstackgerritDong Jun proposed openstack/octavia master: Trivial change to adapt pylint rules  https://review.openstack.org/51184813:36
openstackgerritDong Jun proposed openstack/octavia master: Support pylint  https://review.openstack.org/51184913:36
*** yamamoto has quit IRC13:40
*** slaweq has joined #openstack-lbaas13:41
*** rcernin has quit IRC13:44
*** yamamoto has joined #openstack-lbaas13:50
*** reedip has quit IRC13:50
*** reedip has joined #openstack-lbaas14:02
*** armax has joined #openstack-lbaas14:11
*** slaweq has quit IRC14:13
*** leitan has joined #openstack-lbaas14:18
*** aojea has joined #openstack-lbaas14:20
*** yamamoto has quit IRC14:21
*** slaweq has joined #openstack-lbaas14:23
*** catintheroof has joined #openstack-lbaas14:23
*** aojea has quit IRC14:25
*** sanfern has quit IRC14:25
*** sanfern has joined #openstack-lbaas14:26
*** yamamoto has joined #openstack-lbaas14:41
*** KeithMnemonic1 has joined #openstack-lbaas14:43
*** rcernin has joined #openstack-lbaas14:45
*** spectr has quit IRC14:46
*** KeithMnemonic has quit IRC14:47
*** reedip has quit IRC14:53
*** slaweq has quit IRC14:56
*** rcernin has quit IRC15:03
*** slaweq has joined #openstack-lbaas15:03
*** reedip has joined #openstack-lbaas15:05
*** tongl has joined #openstack-lbaas15:07
*** fnaval has joined #openstack-lbaas15:19
*** fnaval_ has joined #openstack-lbaas15:20
*** aojea has joined #openstack-lbaas15:21
*** fnaval has quit IRC15:23
*** aojea has quit IRC15:25
*** krypto has joined #openstack-lbaas15:35
*** slaweq has quit IRC15:36
*** slaweq has joined #openstack-lbaas15:41
*** chlong has quit IRC15:53
*** AlexeyAbashkin has quit IRC15:55
*** fnaval_ has quit IRC16:02
*** slaweq has quit IRC16:14
*** slaweq has joined #openstack-lbaas16:16
*** slaweq has quit IRC16:18
*** slaweq has joined #openstack-lbaas16:18
*** aojea has joined #openstack-lbaas16:22
*** krypto has quit IRC16:23
*** pcaruana has quit IRC16:23
*** aojea has quit IRC16:27
*** krypto has joined #openstack-lbaas16:28
*** yamamoto has quit IRC16:29
*** krypto has quit IRC16:39
*** salmankhan has quit IRC16:42
*** slaweq has quit IRC17:06
*** yamamoto has joined #openstack-lbaas17:09
*** yamamoto has quit IRC17:09
*** aojea has joined #openstack-lbaas17:23
*** catintheroof has quit IRC17:25
*** catintheroof has joined #openstack-lbaas17:25
*** AlexeyAbashkin has joined #openstack-lbaas17:27
*** aojea has quit IRC17:27
*** AlexeyAbashkin has quit IRC17:28
*** catintheroof has quit IRC17:29
*** sshank has joined #openstack-lbaas17:33
*** slaweq has joined #openstack-lbaas17:37
*** armax has quit IRC17:42
*** dosaboy has quit IRC17:49
*** fnaval has joined #openstack-lbaas17:50
*** armax has joined #openstack-lbaas17:52
*** salmankhan has joined #openstack-lbaas18:04
*** salmankhan has quit IRC18:08
*** yamamoto has joined #openstack-lbaas18:10
*** sanfern has quit IRC18:10
*** yamamoto has quit IRC18:19
*** aojea has joined #openstack-lbaas18:23
*** aojea has quit IRC18:28
*** catintheroof has joined #openstack-lbaas18:33
openstackgerritAdam Harwell proposed openstack/octavia master: WIP: Floating IP Network Driver (spans L3s)  https://review.openstack.org/43561218:35
*** armax_ has joined #openstack-lbaas18:40
rm_workjohnsom: are L7Rules put together with AND?18:42
*** armax has quit IRC18:42
*** armax_ is now known as armax18:42
*** slaweq has quit IRC18:43
rm_workok yeah, docs say yes18:43
*** slaweq has joined #openstack-lbaas18:48
*** dosaboy has joined #openstack-lbaas18:48
*** dosaboy has quit IRC18:48
rm_workjohnsom: comment on ERD18:49
*** dosaboy has joined #openstack-lbaas18:50
johnsomI was just going to paste a link to the L7 doc18:55
johnsomhttps://docs.openstack.org/octavia/latest/user/guides/l7.html18:55
johnsomThanks, will take a look after lunch18:55
*** fnaval has quit IRC19:02
rm_workxgerman_: https://review.openstack.org/#/c/511848/1/octavia/controller/worker/tasks/network_tasks.py19:03
rm_workjohnsom: so I feel like ... did we support pylint before, and remove it?19:03
rm_workbecause I SWEAR we did19:03
*** gcheresh_ has joined #openstack-lbaas19:07
*** gcheresh_ has quit IRC19:14
*** slaweq has quit IRC19:21
*** slaweq has joined #openstack-lbaas19:21
*** aojea has joined #openstack-lbaas19:24
*** sshank has quit IRC19:26
*** aojea has quit IRC19:29
*** leitan has quit IRC19:34
*** sshank has joined #openstack-lbaas19:35
*** leitan has joined #openstack-lbaas19:35
*** sshank has quit IRC19:39
*** leitan has quit IRC19:40
*** AlexeyAbashkin has joined #openstack-lbaas19:40
*** fnaval has joined #openstack-lbaas19:40
*** Swami has joined #openstack-lbaas19:41
johnsomrm_work: you are correct19:41
rm_workwell, whatever, pylint++19:42
johnsomI thought all of OpenStack pulled it due to stability issues19:42
rm_workmaybe it's fixed ;P19:42
rm_worki don't know how it could be *unstable*19:42
*** fnaval has quit IRC19:42
rm_workit's a freaking linter19:42
johnsomI mean, I like it in principle, but yeah, we pulled it in the past19:42
rm_workdid it seriously crash a lot? T_T19:42
rm_workwell, i'm +2 on most of that chain19:42
*** fnaval has joined #openstack-lbaas19:43
johnsomI don’t remember what the issue was19:43
johnsomOk, I will review and +w when I get back from lunch19:44
*** AlexeyAbashkin has quit IRC19:44
rm_workthere's one fix i want on the third one, i think19:45
rm_workoh, just wanted xgerman_ to look19:45
xgerman_yo19:46
*** blallau has joined #openstack-lbaas19:49
*** blallau has quit IRC19:49
rm_workxgerman_: do you know what this was about: https://review.openstack.org/#/c/511848/1/octavia/controller/worker/tasks/network_tasks.py19:53
*** Swami has quit IRC19:53
xgerman_ok, we ignore the error and I am worried that’s not right since we will still be connected to that network —-19:54
xgerman_chewing up ports, etc. — but haven’t come up with what else to do (e.g. a retry)19:55
xgerman_and us dropping the ball will make it necessary for people to go to greater lengths during clean up19:58
xgerman_or you just run neutron purge19:58
rm_workso, should we preserve the comment?19:58
*** Swami has joined #openstack-lbaas19:58
xgerman_yes19:58
rm_workk19:58
xgerman_I will file an issue so we have some more visibility19:58
*** sshank has joined #openstack-lbaas20:16
*** KeithMnemonic1 has quit IRC20:19
*** aojea has joined #openstack-lbaas20:25
rm_workjohnsom: ugh, my change is not having a good time20:28
rm_workhttps://review.openstack.org/#/c/511045/20:28
rm_workalternating gates are failing20:28
rm_workwe may be at or near critical mass again for hosts that fail * number of gates20:29
*** aojea has quit IRC20:30
*** fnaval has quit IRC20:34
*** fnaval has joined #openstack-lbaas20:34
johnsomrm_work It's probably related to the gates issue this week and zuulv3.  The current pool of working gate hosts may have a higher number of OVH hosts...20:37
johnsomBTW, there was one voting gate that failed on that patch...20:37
johnsomrm_work On the ERD thing, is it a good enough start or do you really want me fiddling with graphviz settings for the rest of the day instead of reviews, etc.?20:39
johnsomPersonally I hope there is someone with better graphviz fu that will come along and feel pity on use.20:39
johnsomus20:39
rm_workk its fine20:42
rm_worki think i did +1 not -1 so20:42
rm_worki was checking in case it was easy20:42
johnsomI personally hate graphviz, but having always update diagrams out weighs my distaste20:43
*** sshank has quit IRC20:53
*** sshank has joined #openstack-lbaas20:56
*** slaweq has quit IRC21:04
*** catintheroof has quit IRC21:10
*** armax has quit IRC21:25
*** aojea has joined #openstack-lbaas21:26
*** aojea has quit IRC21:30
*** armax has joined #openstack-lbaas21:36
*** slaweq has joined #openstack-lbaas21:37
*** AlexeyAbashkin has joined #openstack-lbaas21:39
*** AlexeyAbashkin has quit IRC21:44
*** slaweq has quit IRC22:10
*** colby_ has joined #openstack-lbaas22:13
colby_johsom: Thanks for letting me know about this channel. So Im looking at the octavia docs. It says the controll services need to be able to reach the lb network (which is a network in openstack). Our current openstack setup is 2 controller nodes, 2 network nodes (l3 ha agents), and the compute nodes. Since it sounds like the octavia controller processes need access to the lb network would I need to run those on the network nodes?22:15
colby_Our controllers dont have access to the tenant networks22:16
colby_johnsom: oops mispelled22:17
johnsomThere is not requirement that they be on the network nodes.  The LB mgmt network is just a private network used to control the "amphora" and collect health and statistics.  It can be a provider network or any other neutron visible network22:17
colby_So this would be seperate form the management, and tenant networks?22:18
johnsomWe tell nova to attach it when the service VM boots, so it needs to be connected into neutron on the service VM side.  Some deployers just make the controllers have access to a VLAN provider network22:18
johnsomThe lb mgmt net is only between the controllers and the service VMs.  It is isolated from the tenant networks with a network namespace in the service VMs22:18
*** slaweq has joined #openstack-lbaas22:19
colby_would the compute nodes need to have this network plumbed in (on the physical side) or is that all managed by openstack accross the tenant network?22:20
johnsomIt can be a routed path too.22:20
johnsomneutron on the compute nodes needs to be able to plug this network into the service VM instances when nova boots them.  It doesn't have to be physical though.  We just create a neutron network for it in the Octavia service account, then either connect the controllers into that or bridge/route it to a provider network the controllers have access to.22:22
*** cody-somerville has joined #openstack-lbaas22:24
colby_ok so our setup. We have a 10.2.x.x vlan setup for management, a 10.3.x.x vlan setup for ceph, and a 10.4.x.x network setup as the tenant network. Neutron uses GRE tunnels between the hypervisors, and the network nodes over the 10.4.x.x network.22:25
johnsomI guess I should say, could. Basically there is IP connectivity from the controller process to the amphora and from the amphora back to the health manager processes22:25
*** aojea has joined #openstack-lbaas22:26
johnsomNo other traffic crosses that network.22:27
colby_I can create another vlan to link the hypervisors, network nodes, and controllers if necessary. then just set that up as a providor network in openstack?22:27
johnsomSure, that would work22:27
colby_Is there a way to do it without having to create new vlan in our switches and plumming that into the trunk?22:28
johnsomThe part you need to figure out is how to connect your controllers.22:28
johnsomFor the service VMs (amphora) you can just use a neutron network like you do for any other VM or tenant network.  It's just owned by the octavia service account instead of a tenant.22:29
johnsomThen from that neutron network, you need to figure out how you want to plumb it to he controller processes.  You could create a provider network for the controllers, then add a router between that provider network and the lb-mgmt-net, or you could bridge it, etc.22:30
*** aojea has quit IRC22:30
johnsomIf you run the octavia controller processes on your network node, you can just locally bridge it like we do in devstack.22:31
colby_ok that may be easier then22:31
johnsomhttps://github.com/openstack/octavia/blob/master/devstack/plugin.sh#L31522:32
johnsomThere is a lot of flexibility in how you deploy it.22:32
johnsomIf you use openstack ansible it sets this network up for you22:33
colby_we use puppet22:33
johnsomThere is a puppet module for octavia (probably the old neutron-lbaas way though)22:34
johnsomI'm just not sure how they set that up.22:34
johnsomhttps://github.com/openstack/puppet-octavia22:34
colby_ok Ill dig more on this and let you know if I have any more questions.22:34
colby_thanks!22:35
johnsomSince you are starting a fresh install, you probably want to use the native Octavia v2 API and not use neutron-lbaas22:35
johnsomYou can run Octavia Pike release even if the rest of your cloud is older.22:35
colby_ok cool. Ill take a look at that.22:36
johnsomcolby_ Sure, NP.  Folks are usually here in the channel, so don't be shy22:36
colby_So is that code you linked creating the connection to lb network. So if we ran the controllers on the network nodes, it could just use openvswitch to create the bridge to the network?22:39
johnsomCorrect22:39
*** AlexeyAbashkin has joined #openstack-lbaas22:39
johnsomThat is exactly what we are doing there22:39
colby_So it would do that automatically then?22:39
colby_If so then that is much simpler and will make sure its always setup correctl22:40
johnsomNo, that is our devstack plugin script.  It's a developer deployment script22:40
colby_oh I see. Ok we I can just run the openvswitch command I see there22:40
johnsomYeah, you could basically copy what it is doing into your puppet that deploys the octavia controller processes.22:41
*** AlexeyAbashkin has quit IRC22:43
*** Swami has quit IRC22:45
*** slaweq has quit IRC22:52
rm_workcolby_: for the record, we use one public network for both the VIP (we require users provide a specific network for the VIP...) and for management22:54
rm_workit works fine22:54
rm_workhonestly the management traffic is secure enough that it's not a huge issue to run it over a public network -- just recommended to avoid it if possible (for us it would be extremely difficult)22:54
colby_Everything in our setup is on private network except our api load balancers, and network nodes have external net22:55
openstackgerritAdam Harwell proposed openstack/octavia master: Trivial change to adapt pylint rules  https://review.openstack.org/51184822:56
rm_workcolby_: ok, so just saying you can share any other network too, if you have some private provider network as well22:57
rm_workreally it doesn't matter22:57
colby_rm_work: great thanks!22:57
rm_workit just needs *a network* that can be plugged into every service VM22:57
rm_workjohnsom: did you weigh in on https://review.openstack.org/#/c/494407/22:57
rm_workresurrected, trivial change22:57
rm_workthese gate failures T_T22:58
johnsomOn the fence on that one.  I get Nir's perspective.  I'm also half tempted to just point the governance stance on this22:58
rm_workwhat is the governance stance?22:58
johnsomAnd drop the 16.x all together22:58
rm_worklol22:58
rm_workit's just a freaking "recommended install guide"22:59
rm_workwe can't be opinionated?22:59
johnsomhttps://governance.openstack.org/tc/reference/project-testing-interface.html22:59
johnsomI guess, really, my stance is it shouldn't be there unless there are gates....23:00
*** slaweq has joined #openstack-lbaas23:00
johnsomSo, 16.04 is fine.  If we want to add others, there should be gates23:00
rm_workit's for telling people how to contribute23:00
rm_worki'll wait and try to convince Nir23:00
rm_worknot like it's a rush :P23:00
johnsomI commented23:01
johnsomBut will wait for Nir as he -123:01
rm_workyep23:01
johnsomrm_work the OVH thing... I don't have a good path forward on that. I mean I don't want to put in code that checks if it's OVH and drops qemu to TCG....23:03
johnsomI did open a but upstream with KVM, but they wanted lower level details than I have, so it's just sitting open23:04
johnsomPart of it is probably that they are running artful qemu on a xenial host...23:06
johnsomii  qemu-system-x86                    1:2.10+dfsg-0ubuntu1~cloud0           amd64        QEMU full system emulation binaries (x86)23:07
johnsomhttps://packages.ubuntu.com/search?keywords=qemu-system-x86&searchon=names&suite=all&section=all23:07
*** m-greene has quit IRC23:09
rm_workbleh23:10
johnsomYeah, that is most likely the issue.  Similar to the problem I have with devstack pulling in the ocata apt repo and a newer qemu.23:10
rm_workyeah i don't suppose we can ... downgrade23:10
rm_workas part of our gate23:10
rm_worklol23:10
johnsomHmmm,23:10
*** m-greene_ has quit IRC23:10
johnsomWe *might* be able to trick nova into running the right code....23:10
johnsomLike I do23:10
rm_workyeah23:10
rm_worki mean23:10
rm_workthe same thing i put in my devstack config23:10
johnsomRight.23:11
johnsomProblem is we need to wait for zuul v3.  They won't merge a project-config change now.23:11
rm_workhttps://github.com/rm-you/devstack_deploy/blob/master/local.conf#L29-L3723:11
rm_workeugh23:11
johnsomYep, that23:11
rm_workwhy does it only break SOME of the time tho23:12
rm_workit's ... weird23:12
johnsomIt's pretty much always on the OVH hosts23:12
johnsomI don't know what the combination is, but it's those hosts23:12
rm_workaugh cause ... we're failing over half the time23:13
rm_worki mean, at least one voting check it23:13
rm_work*is23:13
johnsomNot quite that much23:13
rm_work... look at the gates23:13
rm_worki had to recheck my change 4 times23:13
rm_workand of the changes we just +Ad23:13
rm_workalready 3 of them failed23:13
johnsomIt all depends on the percentage of OVH hosts in the pool23:13
rm_workyeah and i'm saying that statistically it ends up being over 50%23:14
rm_workthat at least one of our tests will get on a host that fails23:14
johnsomMaybe today, but not overall23:14
rm_workT_T23:14
johnsomHmm, we actually might be able to do this in a gate hook.....23:15
rm_workyeah, i was wondering23:15
rm_workas long as we have something that runs early enough on the host23:15
rm_workbefore devstack (which is where those hooks run, IIRC)23:15
johnsomYeah, let me cook something up23:16
rm_workk23:16
*** sshank has quit IRC23:22
openstackgerritMichael Johnson proposed openstack/octavia master: Fix mis-matched qemu and nova hw_machine_type  https://review.openstack.org/51198023:26
johnsomrm_work Let's watch that ^^^^23:26
*** aojea has joined #openstack-lbaas23:27
*** aojea has quit IRC23:31
*** slaweq has quit IRC23:33
rm_workkk23:34
johnsomHmm, new google searches indicate it could be an issue with AMD hosts.23:34
*** AlexeyAbashkin has joined #openstack-lbaas23:39
rm_work:323:42
*** slaweq has joined #openstack-lbaas23:43
*** AlexeyAbashkin has quit IRC23:43
openstackgerritMerged openstack/octavia master: Adds automatic ERD generation for the Octavia DB  https://review.openstack.org/50931923:48
openstackgerritMerged openstack/octavia master: Add dependent packages to config reference  https://review.openstack.org/50987923:49
johnsomSee, important things are merging....  Grin23:49
rm_workT_T23:50
rm_work2 of 523:50
rm_workerr, 2 of 623:50
johnsomDocs jobs23:50
rm_worklots of rechecks running23:50
*** tongl has quit IRC23:51
rm_workjohnsom: the issue i'm stuck on for tempest, is that for some reason the ssh client doesn't return after running the nc webserver23:56
rm_worklinux_client.exec_command('sudo %s 80 &' % script)23:56
rm_worknever returns23:56
rm_workbecause it gets stuck in a loop waiting for some polling thing23:56
rm_workprobably because it's running a command that doesn't exit?23:56
johnsomTry what I do:23:57
johnsom"screen -d -m sh webserver.sh"23:57
rm_workno screen on cirros23:57
johnsomYes23:57
johnsomThat is how I run my cirros23:57
rm_work?23:57
rm_workerr23:57
rm_worki swear i just checked this23:57
rm_workor i would have done that already23:57
johnsomssh -o UserKnownHostsFile=/dev/null -i /etc/octavia/.ssh/octavia_ssh_key -o StrictHostKeyChecking=no -q cirros@${IP1} "screen -d -m sh webserver.sh"23:57
rm_workwut. k23:57
johnsomcirros-0.3.4-x86_64-disk.img23:58
johnsomis what I pull down, but newer should work23:58
rm_workhmmm23:58
rm_workwell, ok then23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!