Tuesday, 2019-01-08

openstackgerritMatt McEuen proposed openstack/airship-divingbell master: Make README.rst  https://review.openstack.org/62907400:10
*** georgk has quit IRC00:26
*** aaronsheffield has quit IRC00:51
openstackgerritKaspars Skels proposed openstack/airship-treasuremap master: Revert "Make keystone default host to be consistent with port"  https://review.openstack.org/62907500:51
*** roman_g has quit IRC01:18
*** shoaibwr has quit IRC02:49
*** shoaibwr has joined #airshipit02:49
*** portdirect has joined #airshipit03:57
openstackgerritKaspars Skels proposed openstack/airship-treasuremap master: Revert "Make keystone default host to be consistent with port"  https://review.openstack.org/62907504:26
*** dims has quit IRC04:47
*** evrardjp_ has joined #airshipit08:48
*** evrardjp__ has joined #airshipit08:49
*** evrardjp has quit IRC08:51
*** evrardjp_ has quit IRC08:52
*** evrardjp__ has quit IRC08:53
*** evrardjp has joined #airshipit09:03
*** roman_g has joined #airshipit11:17
openstackgerritPradeep Kumar proposed openstack/airship-promenade master: This commit is to create logging section in promenade.conf and overriding log_level value in it using values.yaml.  https://review.openstack.org/62915411:36
*** dims has joined #airshipit13:23
*** jhesketh has quit IRC13:45
*** jhesketh has joined #airshipit13:47
*** aaronsheffield has joined #airshipit13:58
evrardjpo/13:58
mattmceuenHey jayahn, that's awesome!  We'll definitely help get you up and running with deckhand :)13:59
mattmceueno evrardjp13:59
mattmceueno/ rather13:59
mattmceuen#startmeeting airship14:00
openstackMeeting started Tue Jan  8 14:00:39 2019 UTC and is due to finish in 60 minutes.  The chair is mattmceuen. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
*** openstack changes topic to " (Meeting topic: airship)"14:00
openstackThe meeting name has been set to 'airship'14:00
mattmceuen#topic rollcall14:00
*** openstack changes topic to "rollcall (Meeting topic: airship)"14:00
mattmceuengood morning / evening / middle of night everyone!14:00
evgenylo/14:01
hogepodgeHi!14:01
mark-burnetto/14:01
b-stro/14:01
aaronsheffieldo/14:01
mattmceuenAgenda for today: https://etherpad.openstack.org/p/airship-meeting-2019-01-0814:01
*** nishant_ has joined #airshipit14:01
dwalto/14:01
mattmceuenPlease add in anything additional you'd like to discuss today14:01
*** sgrasley has joined #airshipit14:02
*** sthussey has joined #airshipit14:02
mattmceuenAlrighty14:03
mattmceuen#topic Accessing tiller from behind a proxy14:04
*** openstack changes topic to "Accessing tiller from behind a proxy (Meeting topic: airship)"14:04
*** georgk has joined #airshipit14:04
mattmceuenThere was a discussion on the ML around accessing tiller from behind the proxy14:04
evgenylYes, there is a problem with configuring Armada behind the proxy, no_proxy in grpc (tiller client) does not support cidr for no_proxy, as a result it cannot connect to Tiller.14:04
mattmceuenIt led to some good thoughts around how to streamline armada-tiller-shipyard communication in general14:04
mattmceuenbut first I was hoping evgenyl could walk through his use case to ground us14:05
evgenylScott suggested to configure "proxy" parameter for every repo, I'm wondering if it can be done globally.14:05
evgenylIf we configure tiller with DNS name and use it instead of IP, this should help with no_proxy.14:06
mattmceuenis the proxy issue you're getting happening when you pull images from the repo, or after you pull images and armada is trying to talk to tiller?14:06
sthusseytiller does have a dns name14:06
mattmceuentrying to understand how the repo part fits into this14:06
sthusseythere is a tiller service that gets a in-cluster DNS entry14:07
sthusseyIgnore me14:07
mattmceuenlol14:07
sthusseyThat was the previous tiller chart in OSH14:07
mattmceuenahh14:08
evgenylmattmceuen: it happens when Armada starts to pull git repos.14:08
mattmceuenI see - that's before armada is actually talking to tiller14:08
sthusseyThis is why we define proxies per repo14:08
sthusseyBecause it gives the granularity needed14:08
mattmceuenevgenyl can you give sthussey's idea a try and let us know if it helps, and/or follow on issues?14:09
sthusseyI think the issue Evgeny was having isn't functional, it is UX14:09
evgenylYes.14:10
evgenylI was wondering if it can be redefined globally.14:10
sthusseyBecause in the case of AIAB behind the proxy, he needed to update the proxy for every chart in versions.yaml14:10
evgenylDoes anybody know why DNS was removed from OSH chart?14:10
sthusseyWe had two charts14:10
sthusseyWe stopped using OSH14:10
sthusseyAnd use the chart in the Armada repo14:11
mattmceuen#topic Streamlining tiller lookup logic14:11
*** openstack changes topic to "Streamlining tiller lookup logic (Meeting topic: airship)"14:11
mattmceuenSegueway :)14:11
sthusseyWe can certainly add a service to the chart14:11
sthusseyWhich will yield a DNS entry that could be used14:11
portdirectwould just be a revert of: https://github.com/openstack/airship-armada/commit/eb7c112d2ee8e95ab5a4eda0076c69fdd3aeaf6614:12
evgenylYes. There also an idea to move logic of tiller discovery from shipyard into Armada.14:12
sthusseyThat likely will happen.14:12
mattmceuen++14:13
sthusseyTiller will be running as a sidecar to the armada API in the near future14:13
sthusseySo resolving what address to access tiller at will need to be in Armada, so might as well make that location logic good for the CLI as well14:13
roman_go/14:13
mattmceueno/ roman_g14:14
evgenylsthussey: will it have a separate DNS name when running as a sidecar?14:14
evgenylOt will it be possible to configure?14:14
sthusseyWhen running as a sidecar it will be inaccessible to anything but the Armada API it runs with14:14
sthusseySo there will need to be a few deployment patterns to support use cases of the Armada CLI14:15
evgenylI'm trying to understand if this DNS change will make sense if Tiller lands as a sidecar.14:15
portdirectpresumably then you'd just have it listen on localhost? so the service would not be exposed at all?14:16
evgenylOh, in this case PodIP discovery won't be needed.14:16
sthusseyThat is in the API case14:16
sthusseyDoes work for the CLI case14:16
mattmceuensthussey, are you saying that we'd run tiller-in-armada-pod for an armada API based deployment, but to support the CLI we'd also support standalone tiller pods w/ Service (DNS) ?14:16
sthusseyDoesn't *14:16
sthusseyRight, would need to support multiple patterns14:17
mattmceuengotcha14:17
mattmceuenso to say differently, you'd choose your adventure, one of:14:18
mattmceuen1. Deploy the Armada chart14:18
mattmceuen2. Deploy the Tiller chart (which will include a Service / DNS) and use the Armada client14:18
mattmceuendepending on the operator use case14:18
mattmceuenSo in that case14:19
evgenylSo you can use Armada client without having Armada API service?14:19
sthusseyyes14:19
evgenylOh, ok, this is clear now.14:19
dwaltThe CLI looks for the tiller client with labels14:19
dwalttiller pod*14:20
mattmceuenThe normal way to use the Armada client is  ArmadaClient->Tiller directly14:20
mattmceuenAlthough it can be configured to be ArmadaClient->ArmadaAPI->Tiller as well14:21
evgenylSo to summarize it would like: ArmadaClient-> (DNS) Tiller, ArmadaClient->ArmadaAPI->(localhost)Tiller14:22
mattmceuenWould you be running the armada client from inside the cluster or outside the cluster? Just making sure14:22
mark-burnettAFAIK, nobody is using the configuration of Client -> API -> Tiller14:22
mattmceuenI ask because, if inside the cluster, then the Service will be enough to provide DNS-based routability to tiller14:23
evgenylmattmceuen: I'm interested in a "standard" Shypard -> ArmadaAPI -> Tiller use case14:24
mattmceuenbut if you're trying to get to it from outside the cluster, you'd additionally need an ingress for the service into the cluster, along with *publicly* accessible DNS14:24
mattmceuenok14:24
portdirector just expose a port, and use the ip14:24
mattmceuenyeah14:24
portdirectthe reason we added the service in osh, was much less about dns, but about having a stable vip to hit tiller with14:25
evgenylThe problem with IP gets back to the initial issue with grpc not supporting cidr in no_proxy, isn't it?14:26
sthusseyWhich isn't standard14:26
sthusseySo not surprising14:26
evgenylYes.14:26
portdirectyeah - it does not solve that issue, just providing ontext for where it came from14:26
portdirect*context14:26
sthusseySo there are two issues in parallel - 1) address resolution and 2) routing14:27
sthusseyAddress resolution can use DNS, explicit address or label selection. Only DNS would solve the routing issue14:27
sthusseyIf we add a `proxy` setting at the armada/Manifest/v1 level that will apply to all charts, it solves #2 and makes #1 moot14:28
evgenylSo are there any objections regarding to this? If not I can start looking into that in my spare time.14:30
mattmceuenevgenyl can you try setting the proxy for each chart like sthusey had suggested earlier for now, and we can look to add a manifest-wide proxy setting in the future?14:30
mattmceuenthat would be awesome evgenyl :)14:30
evgenylSure, let me update AIAB doc with this info as a quick fix.14:31
mattmceuenthanks man14:31
mattmceuento wrap up the "tiller lookup" topic:14:31
*** dimitris_ has joined #airshipit14:32
*** ab2434_ has joined #airshipit14:32
mattmceuenwhen we move tiller in-pod with armada, and armada changes to look tiller up via localhost, seems like a natural point to go ahead and take the lookup functionality out of shipyard, any objections?14:32
mattmceuenany other loose ends?14:32
mattmceuenalright - moving on:14:33
mattmceuen#topic Read the Docs jobs not updating documentation14:33
*** openstack changes topic to "Read the Docs jobs not updating documentation (Meeting topic: airship)"14:33
mattmceuenThis one's yours dwalt14:33
dwaltThis is still an issue AFAIK14:33
dwaltFor example, https://review.openstack.org/#/c/628420/1 doesn't appear to have triggered an update14:33
dwaltHas anyone heard anymore official information (outside of  http://lists.openstack.org/pipermail/openstack-infra/2018-December/006247.html) from OpenStack regarding this?14:34
sthussey@roman_g14:34
evgenylMy understanding is infra is waiting for this to be merged14:34
evgenyl#link https://github.com/rtfd/readthedocs.org/issues/498614:34
portdirecthttps://github.com/rtfd/readthedocs.org/pull/500914:35
portdirectthough no indication of the timeline before this is closed out14:36
mattmceuenit seems pretty active14:36
evgenylYes, it is broken for several months already.14:36
mattmceuenI'm leaning toward doing manual rtd updates and give this a chance to get fixed14:36
mattmceuenyes but promising that there's discussion 5 days ago too:)14:36
evgenylSorry, not several months, for almost a month :)14:36
mattmceueni.e. hopefully the end is in sight... we can revert to a token-based push if it does stretch out a long time, but better not to spend the cycles on it if the issue gets resolved soon is what I'm thinking.14:37
mattmceuenagree/disagree?14:37
dwaltAgreed.14:37
evgenyl++14:37
mattmceuenawesome14:38
mattmceuennext topic:14:38
mattmceuen#topic Adding Airship in the CNCF Landscape14:38
*** openstack changes topic to "Adding Airship in the CNCF Landscape (Meeting topic: airship)"14:38
sthusseyWho is doing this manual updates?14:38
sthusseythese*14:38
mattmceuenKaspars is what I hear, sthussey14:38
dwaltI am not sure if that's for all repos or just treasuremap14:38
dwaltIt has to be manually triggered via RTD from what I understand14:39
dwaltSo whoever has access to the account14:39
mattmceuenlet's bring it up in this chat when we need doc updates, kaspars or anyone with rtd access to our account can do it14:39
mattmceuen(I think I might have access, it's been a while :) )14:39
mattmceuenhogepodge for CNCF landscape, this one's yours!  Please educate us on what this thing is14:40
mattmceuenhttps://landscape.cncf.io/grouping=no&license=open-source14:40
mattmceuenI see Zuul in there14:40
hogepodgeSo the CNCF landscape is an interactive document that tries to captures integrations between CNCF projects an other open source projects14:40
hogepodgeSo, Zuul is there because it runs CI jobs for K8s on OpenStack, for example14:41
hogepodgeOr Kata because it can be a container runtime for Docker and Kubernetes.14:41
hogepodgeSince Airship is essentially deployment and hosting tooling, it makes sense to list it in the landscape14:41
portdirectodd that it shows the market cap of the backing company for single vendor projects14:42
mattmceuenSounds reasonable to me14:42
hogepodgeIf there are parts of Airship that can stand alone (like Armada say), there's also a possibility of listing those.14:42
portdirectbut that sounds great14:42
hogepodgeportdirect: it has some... limitations14:42
mattmceuenis it as simple as filling out some request form hogepodge?  Or is there  beurocracy :)14:42
hogepodgeLike they want to pull all data from github, which is fine with mirrors, but for projects run in Gerrit it loses a bunch of data about issues, code reviews, and so on14:43
hogepodgeI've never actually added anything myself, I think it's a pull request14:43
hogepodge#link https://github.com/cncf/landscapeapp14:43
hogepodge#link https://github.com/cncf/landscape14:44
hogepodge"If you think your company or project should be included, please open a pull request to add it to landscape.yml. For the logo, you can either upload an SVG to the hosted_logos directory or put a URL as the value, and it will be fetched."14:44
mattmceuenSounds reasonable to me -- I think perhaps a single PR with two entries, Airship (as a whole) and Armada, using the same Airship logo would be great14:45
mattmceuenAny volunteers for putting in this PR with CNCF?14:45
portdirecti could if you want?14:45
hogepodgeI was about to offer, but portdirect got there first ;-)14:46
mattmceuenlol14:46
mattmceuenhe did have a question mark14:46
mattmceuenportdirect if you have bandwidth that would be awesome, ty14:46
portdirectnp14:46
evrardjpvoluntold14:46
mattmceuenthanks for the  find hogepodge, free publicity!14:47
portdirectevrardjp: quite the opposite ;)14:47
hogepodgeI've been working with Dan on some of the openstack stuff, so it's been on my mind14:47
mattmceuenvolunplease14:47
mattmceuenanything else on this topic?14:48
mattmceuen#topic proposed topic: design overview of ovs-dpdk integration14:48
*** openstack changes topic to "proposed topic: design overview of ovs-dpdk integration (Meeting topic: airship)"14:48
mattmceuengeorgek - this one's yours!  What do you have in mind?14:48
georgkok, thanks14:48
georgkso, as you know there is a need and some discussions around ovs dpdk intergration in Airship14:49
georgkI wanted to bring the topic here to have a sanity check of work items that have been indentified14:49
georgkand to figure out who is wokring on this14:49
georgk#link https://wiki.akraino.org/display/AK/Support+of+OVS-DPDK+in+Airship14:49
georgkthis wiki pages lists a couple of high-level work items that I have identified which need to be done in order to get the integration done14:50
mattmceuengeorgek are there user stories in storyboard for this you could point me toward?  I'm catching up on this topic14:50
portdirect^^14:51
georgkright, that would be a good next step. no, I am not aware of those14:51
georgkbut I am not a huge fan of searching in storyboard (might just be me)14:52
georgkif this list is reasonable, I happy transfer it to storyboard14:52
portdirectit would provide more visibility for sure14:52
sthusseythat wiki seems to be a bit misinformed14:53
mattmceuenportdirect, can we carry the OSH-related bits of this to the OSH meeting coming up next in openstack-meeting-5?14:53
hogepodgegeorgk: aside, if you can file an issue about searching in storyboard in the storyboard storyboard we might have some resources coming online to take a look at it14:53
sthusseySince OSH isn't part of Airship14:53
portdirecti was side-stepping that for the moment sthussey14:53
mattmceuenyeah, let's focus on the Airship-specific bits in the few mins left we have (I need to steal one min at the end for another topic)14:54
mattmceuen"deploy neutron openvswitch agentensure chart of openvswitch agent is deployed"14:54
portdirectbut i think in general, if you want to get traction in airship then storyboard will be the forum to do that in14:54
portdirect(the same applies for osh, but i digress)14:54
portdirectas not many of us are chacking akrano wiki often, and it doesnt allow us to tie the work in with patchsets14:55
georgkok, I agree that it should be in storyboard, I wanted to get a sanity check if the items first14:55
mattmceuenfor deployment of the OVS agent - from an AIrship perspective, I think that item above is just a matter of supplying the right configuration to the helm chart via deployment manifests14:55
sthusseyMost of the Airship items on that list work today14:56
portdirect`DPDK host config: mount hugepages` this is the area i expect you'll find most sticky14:56
georgksthussey: even better14:56
mattmceuenYeah, they're mostly "configs" which are operator-specific14:56
mattmceuenso georgek they may take the form of "as an operator, how do I ..." which we can def help answer14:56
georgkI generally consider most things to be configuration issue, but I´d like to avoid missing major gaps in Airship that need to be addressed14:57
mattmceuenfor sure14:57
mattmceuenand I haven't looked deep in the list, there may be enhancements to airship needed14:57
portdirecti dont really see any tbh14:57
mattmceueneven better :)14:57
mattmceuensorry to rush along, but one timely topic needed14:58
mattmceuen#topic pre-pre-PTG planning14:58
*** openstack changes topic to "pre-pre-PTG planning (Meeting topic: airship)"14:58
mattmceuenWe need to reserve a room for Airship at the PTG in Denver14:58
georgkok, so, we continue on the openstack-helm call, I suppose14:58
mattmceuenseems like we were just in the PTG in Denver14:58
mattmceuenthat's what I'm mthinking too georgek14:58
mattmceuenNeed to have a ROUGH headcount.  Note I don't know how many folks my company will be able to send even, but broadly, who here suspects their company will be sending folks to the PTG?14:59
hogepodgeNote PTG is same week as Open Infra Summit, so you can combine both events (or pick just one)14:59
mattmceuentwo for one, how can I say no15:00
portdirect:)15:00
mattmceuenwell give it some thought guys, I'll try to ballpark a number and get it back to the OSF today15:00
mattmceuenwe're out of time!  Thanks everyone for the discussion!15:00
mattmceuen#endtopic15:00
mattmceuen#endmeeting15:00
*** openstack changes topic to "airshipit.org || General Review Dashboard: https://review.openstack.org/#/q/project:%255Eopenstack/airship.*+status:open,n,z"15:01
openstackMeeting ended Tue Jan  8 15:00:59 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:01
openstackMinutes:        http://eavesdrop.openstack.org/meetings/airship/2019/airship.2019-01-08-14.00.html15:01
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/airship/2019/airship.2019-01-08-14.00.txt15:01
openstackLog:            http://eavesdrop.openstack.org/meetings/airship/2019/airship.2019-01-08-14.00.log.html15:01
mattmceuenand feel free to keep discussing here in the chat room (of course)15:01
roman_gkubectl logs -n ucp maas-ingress-58b687f498-v2lpx -c maas-ingress15:03
roman_gF0108 14:59:41.634737      10 main.go:72] Port 8181 is already in use. Please check the flag --default-server-port15:03
roman_gMy maas-ingress is in CrashLoopBackOff. It's airship-in-a-bottle with all updated latest charts/containers.15:04
roman_gDoes that sound familiar? What should I look for to get it resolved?15:04
roman_gThank you.15:04
mattmceuenroman_g I suspect that's related to https://review.openstack.org/#/c/625338/ ; sthussey would airship-in-a-bottle need an additional manifest tweak for that or some such?15:19
sthusseyPort conflict w/ cluster ingress15:20
sthusseyJust need to add an additional override15:20
*** jezogwza has joined #airshipit15:25
mattmceuengeorgek - you were asking about how to set hugepages15:31
mattmceuenthose settings go in the host profiles for your site, e.g.:  https://github.com/openstack/airship-treasuremap/blob/44dafaa96e6cab5c651fd8fdac9c90fc3f3263a0/site/airship-seaworthy/profiles/host/dp_r720.yaml15:31
mattmceuenspecifically, any kernel parameters would go under the `kernel_params` key15:33
mattmceuenadditional parameters can be set in the hardware profile, see the schema here for reference: https://github.com/openstack/airship-treasuremap/blob/3a1038e122349aa6599691a7e2c6bf167e93d744/global/schemas/drydock/HardwareProfile/v1.yaml15:35
mattmceuenThis would be a good thing to get documented and/or exampled in treasuremap, since it'll be a common thing15:35
mattmceuenin the meantime, please ask any questions you have georgek15:37
*** georgk has quit IRC15:38
roman_gmattmceuen: sthussey thank you15:38
sthusseyhttps://airshipit.readthedocs.io/projects/drydock/en/latest/topology.html#defining-node-configuration15:40
*** hamerins has joined #airshipit16:00
openstackgerritLev Morgan proposed openstack/airship-pegleg master: pki: Port Promenade's PKI catalog into Pegleg  https://review.openstack.org/60613116:35
openstackgerritSamantha Blanco proposed openstack/airship-pegleg master: Add service layer  https://review.openstack.org/60762316:49
openstackgerritLev Morgan proposed openstack/airship-pegleg master: pki: Port Promenade's PKI catalog into Pegleg  https://review.openstack.org/60613117:00
*** nishant_ has quit IRC17:11
openstackgerritAlexander Hughes proposed openstack/airship-pegleg master: Add site master passphrase generation  https://review.openstack.org/62802117:48
openstackgerritAlexander Hughes proposed openstack/airship-pegleg master: Add site master passphrase generation  https://review.openstack.org/62802117:51
*** hamerins has quit IRC18:09
*** hamerins has joined #airshipit18:11
*** zogger__ has joined #airshipit18:11
*** zogger__ has quit IRC18:12
*** ds3330 has joined #airshipit18:13
*** elenalind has joined #airshipit18:19
openstackgerritAnthony Bellino proposed openstack/airship-divingbell master: Add rerun support for perm module  https://review.openstack.org/62904518:27
openstackgerritLev Morgan proposed openstack/airship-pegleg master: pki: Port Promenade's PKI catalog into Pegleg  https://review.openstack.org/60613118:55
*** hamerins has quit IRC19:34
*** hamerins has joined #airshipit19:35
openstackgerritBryan Strassner proposed openstack/airship-in-a-bottle master: Update dns for multinode gates to match endpoints  https://review.openstack.org/62929719:46
*** georgk has joined #airshipit19:50
openstackgerritchinasubbareddy mallavarapu proposed openstack/airship-treasuremap master: Airship-treasuremap: Ceph charts cleanup  https://review.openstack.org/62930219:56
*** jamesgu_ has joined #airshipit20:03
*** elenalind has quit IRC20:27
openstackgerritPRATEEK REDDY DODDA proposed openstack/airship-drydock master: Added line no to drydock message format for troubeshooting  https://review.openstack.org/62636720:41
openstackgerritSamantha Blanco proposed openstack/airship-shipyard master: Adds HTTP Security Headers  https://review.openstack.org/62828620:42
openstackgerritAlexander Hughes proposed openstack/airship-pegleg master: Add site master passphrase generation  https://review.openstack.org/62802120:53
openstackgerritSean Eagan proposed openstack/airship-armada master: Automate deletion of test pods  https://review.openstack.org/62931321:09
*** hamerins has quit IRC21:14
*** hamerins has joined #airshipit21:15
openstackgerritMerged openstack/airship-drydock master: Added line no to drydock message format for troubeshooting  https://review.openstack.org/62636721:35
*** JosW has joined #airshipit21:58
*** JosW has quit IRC22:10
openstackgerritBryan Strassner proposed openstack/airship-shipyard master: [WIP] Move airflow scheduler to worker statefulset  https://review.openstack.org/62904222:14
*** georgk has quit IRC22:18
*** hamerins has quit IRC23:13
*** ab2434_ has quit IRC23:38

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!