Tuesday, 2019-07-02

openstackgerritMerged airship/pegleg master: Uplift deckhand dependency  https://review.opendev.org/66855100:06
openstackgerritKaspars Skels proposed airship/treasuremap master: Update docker to 18.06.3  https://review.opendev.org/66821700:06
openstackgerritAlexander Hughes proposed airship/pegleg master: Uplift Pegleg's Airship Dependencies  https://review.opendev.org/66855200:10
*** DougSchv has joined #airshipit00:20
*** nishantkr has quit IRC00:33
*** DougSchv has quit IRC01:06
*** redrobot has quit IRC01:17
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] YAPF formatting  https://review.opendev.org/66412501:35
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] YAPF formatting  https://review.opendev.org/66412502:05
*** AlexNoskov has quit IRC02:10
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] YAPF formatting  https://review.opendev.org/66412502:25
*** kskels has quit IRC02:28
*** DougSchv has joined #airshipit02:33
*** DougSchv has quit IRC02:34
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] YAPF formatting  https://review.opendev.org/66412502:50
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Re-add OpenSUSE gates as voting  https://review.opendev.org/66857603:01
openstackgerritAlexander Noskov proposed airship/treasuremap master: Uplift Horizon and fix Keystone password for Horizon chart.  https://review.opendev.org/66801604:43
openstackgerritAlexander Noskov proposed airship/treasuremap master: Uplift all components  https://review.opendev.org/66446904:46
*** kskels has joined #airshipit04:48
openstackgerritAlexander Noskov proposed airship/treasuremap master: Uplift all components  https://review.opendev.org/66446904:50
openstackgerritAlexander Noskov proposed airship/treasuremap master: Uplift all components  https://review.opendev.org/66446904:51
openstackgerritAlexander Noskov proposed airship/promenade master: WIP  https://review.opendev.org/65267804:54
openstackgerritKaspars Skels proposed airship/treasuremap master: [CEPH] uplift charts and enable helm tests  https://review.opendev.org/66521905:11
*** lemko has joined #airshipit06:28
*** pgaxatte has joined #airshipit06:31
*** jsuchome has joined #airshipit06:49
*** dpawlik has joined #airshipit06:49
*** pgaxatte has quit IRC06:53
*** pgaxatte has joined #airshipit06:54
*** pgaxatte has quit IRC06:54
*** nmimi has joined #airshipit06:56
*** kskels has quit IRC06:57
*** pgaxatte has joined #airshipit07:02
*** pgaxatte has quit IRC07:03
*** pgaxatte has joined #airshipit07:04
*** pgaxatte has quit IRC07:04
*** pgaxatte has joined #airshipit07:15
*** evrardjp is now known as evrardjp_on_holi07:40
*** evrardjp_on_holi is now known as evrardjp_away07:40
*** amalrajgenocidex has joined #airshipit08:54
amalrajgenocidexHi08:54
amalrajgenocidexIs there any way to use real URL's in airsloop for horizon?08:54
amalrajgenocidexCurrently the url's are like horizon.openstack.svc.cluster.local  ?08:55
*** weystrom has joined #airshipit09:17
openstackgerritJiri Suchomel proposed airship/airship-in-a-bottle master: Replace repository links so they point directly to opendev.org  https://review.opendev.org/66810709:27
*** roman_g has quit IRC10:02
*** roman_g has joined #airshipit10:03
roman_gevgenyl: it hasn't been triggeren on this PS: https://review.opendev.org/#/c/668107/10:03
roman_gamalrajgenocidex: kubectl get svc --all-namespaces, and check published services there.10:03
roman_gamalrajgenocidex: then you'd probably want to set DNS or hosts file record to point to correct IP10:03
*** roman_g_ has joined #airshipit10:05
*** roman_g has quit IRC10:08
*** roman_g_ is now known as roman_g10:10
amalrajgenocidexevgenyl They are all private IP's right. I'm able to access the horizon by setting host entry like 'horizon.openstack.svc.cluster.local' . I was looking at a way to do it by real DNS10:11
roman_gyou'd probably want to set DNS or hosts file record to point to correct IP10:13
openstackgerritRoman Gorshunov proposed airship/docs master: Add basic gate and docs  https://review.opendev.org/66802010:34
amalrajgenocidexroman_g  The IP's shown in 'kubectl get svc --all-namespaces' are all private. So it's not possible to setup dns for public access11:01
roman_gamalrajgenocidex: those which are NodePort should be public11:01
openstackgerritRoman Gorshunov proposed airship/election master: Add basic gate for docs build  https://review.opendev.org/66865011:03
openstackgerritRoman Gorshunov proposed airship/docs master: Add basic gate and docs  https://review.opendev.org/66802011:11
*** amalrajgenocidex has quit IRC11:11
*** amalrajgenocidex has joined #airshipit11:15
amalrajgenocidexThanks roman_g . Thank you. Let me take a llok11:15
roman_gamalrajgenocidex: that .svc.cluster.local is default internal dns suffix of CoreDNS, which is installed with Kubernetes11:16
openstackgerritRoman Gorshunov proposed airship/election master: Add gate for docs build  https://review.opendev.org/66865011:16
openstackgerritRoman Gorshunov proposed airship/election master: Add gate for docs build  https://review.opendev.org/66865012:03
*** pgaxatte has quit IRC12:04
*** alexanderhughes has joined #airshipit12:05
openstackgerritAlexander Hughes proposed airship/pegleg master: Add support for globally encrypted secrets  https://review.opendev.org/66851712:06
*** pgaxatte has joined #airshipit12:06
openstackgerritAlexander Hughes proposed airship/pegleg master: Re-add OpenSUSE gates as voting  https://review.opendev.org/66857612:07
openstackgerritAlexander Hughes proposed airship/pegleg master: Standardize Pegleg code with YAPF  https://review.opendev.org/66412512:12
openstackgerritRoman Gorshunov proposed airship/docs master: Import docuemtation from airsip-in-a-bottle  https://review.opendev.org/66866412:16
*** alexanderhughes has quit IRC12:23
*** alexanderhughes has joined #airshipit12:24
openstackgerritRoman Gorshunov proposed airship/airship-in-a-bottle master: Export all documents to Airship Docs project  https://review.opendev.org/66866512:28
openstackgerritAlexander Hughes proposed airship/pegleg master: Add support for globally encrypted secrets  https://review.opendev.org/66851712:29
*** alexanderhughes1 has joined #airshipit12:31
*** alexanderhughes has quit IRC12:35
openstackgerritRodolfo Pacheco proposed airship/specs master: [WIP] Add AirshipCTL Spec  https://review.opendev.org/65980812:36
openstackgerritRoman Gorshunov proposed airship/airship-in-a-bottle master: Export all documents to Airship Docs project  https://review.opendev.org/66866512:42
*** bh526r has joined #airshipit12:50
openstackgerritMerged airship/airship-in-a-bottle master: Fix link to the repository  https://review.opendev.org/66780512:50
openstackgerritRoman Gorshunov proposed airship/docs master: Import documentation from airsip-in-a-bottle  https://review.opendev.org/66866412:52
*** sthussey has joined #airshipit12:53
*** aaronsheffield has joined #airshipit12:54
openstackgerritAlexander Hughes proposed airship/spyglass master: Add voting to OpenSuse jobs  https://review.opendev.org/66867012:54
openstackgerritAlexander Hughes proposed airship/pegleg master: Add support for globally encrypted secrets  https://review.opendev.org/66851712:58
dpawlikhi, someone else have problem with airskiff that keystone is dying after a while no metters if it is ucp or openstack namespace?13:00
*** lamt has joined #airshipit13:12
*** mbeierl has joined #airshipit13:18
openstackgerritAlexander Hughes proposed airship/pegleg master: Add support for globally encrypted secrets  https://review.opendev.org/66851713:19
alexanderhughes1roman_g - goal in your git reset patch for pegleg is to make sure every time a call is run we're working with a clean repo yeah?  solution may be to require users to work with files in a temporary location, and via the commands save into the repo path desired13:20
alexanderhughes1IE make a temp file in /home/user/some_file.crt then call the wrap_secrets commands and specify save location into the security repo.  that way we can process repos, and place the finished file where it belongs13:21
*** ab2434_ has joined #airshipit13:39
openstackgerritMerged airship/airship-in-a-bottle master: Improve VM failure data collection  https://review.opendev.org/66821013:39
*** sreejithp has joined #airshipit13:40
openstackgerritIan Pittwood proposed airship/spyglass-plugin-xls master: Combines all exceptions into a single file  https://review.opendev.org/66724314:02
openstackgerritIan Pittwood proposed airship/spyglass master: Combines all exceptions into a single file  https://review.opendev.org/66724014:02
*** amalrajgenocidex has quit IRC14:02
openstackgerritMerged airship/treasuremap master: Uplift and Separate fluentbit and fluentd charts  https://review.opendev.org/66723614:05
*** ab2434_ has quit IRC14:07
*** kskels has joined #airshipit14:26
*** redrobot has joined #airshipit14:33
*** AlexNoskov has joined #airshipit14:38
openstackgerritIan Pittwood proposed airship/spyglass master: Combines all exceptions into a single file  https://review.opendev.org/66724014:38
openstackgerritIan Pittwood proposed airship/spyglass-plugin-xls master: Combines all exceptions into a single file  https://review.opendev.org/66724314:40
openstackgerritAlexander Hughes proposed airship/pegleg master: Add support for globally encrypted secrets  https://review.opendev.org/66851714:42
*** sreejithp has quit IRC14:43
*** obravo has joined #airshipit14:44
*** amalrajgenocidex has joined #airshipit14:51
*** pgaxatte has quit IRC14:57
*** evrardjp_away has quit IRC14:58
*** evrardjp has joined #airshipit14:59
kskelsmattmceuen> Matt McEuen hey kskels:  I see that we configure that fourth "cicd" layer here:  https://opendev.org/airship/treasuremap/src/branch/master/global/layering-policy.yaml#L1115:04
kskels10:32 AM However, I can't find any examples of where it gets used, is that in treasuremap or somewhere else?15:04
kskels10:33 AM for the opensuse airskiff gate, I believe we talked about adding a new `treasuremap/cicd` directory to capture that (and any other long-lived ctthaonfigurations that need to follow that model) -- any concerns with that approach?15:04
kskelsso if we add a folder `cicd` that would pull these files in for each site, right?15:04
kskelsif some overrides are needed only for Suse - I would maybe just add those files in the `suse` type or `suse` related site manifests and simply point out `layer: cicd` in those YAMLs15:05
*** cheng1 has joined #airshipit15:06
kskelsthe cicd layer is used internally - to push over few minor changes needed to make CI/CD work (like overriding passwords for things)15:06
mattmceuenkskels:  definitely don't want to pull things in for every site.  I thought a `cicd` instance would pull from / overide a single site, right?   So `airskiff` would be a site that stands on its own, and `airskiff-suse` would be cicd-level overrides on top of `airskiff`15:07
*** ab2434_ has joined #airshipit15:07
kskelsright - so I think you just need to put all files inside airskiff-suse15:07
kskelsand call our the layer they belong to in those files15:08
kskelsor potentially - pegleg may just ignore `cicd` folder - as I think they are hardcoded in the code15:09
kskelsso I would just add a folder treasuremap/site/airskiff-suse/cicd15:09
mattmceuen`treasuremap/site/airskiff-suse/cicd` -- sorry, I'm lost on that one :)15:10
kskelsmaybe I'm not fully grasping what you are trying to di15:11
kskelsdo*15:11
mattmceuenare you saying that pegleg can use cicd-level overrides, but may expect them to live under the `site` folder?15:11
kskelspegleg really just throws all files in a huge file15:12
kskelsso as long as the file has layer set correctly - it can be pretty much in any folder15:12
alexanderhughes1what are we trying to do with Pegleg?15:12
kskelsalthough it may throw a warning that file is not in the right folder15:12
mattmceueno/ alexanderhughes115:12
alexanderhughes1o/15:12
kskelssame - I think we need more use case description :)15:12
mattmceuenso here's what we want to accomplish, by hook or crook:15:13
mattmceuenwe have a site called `airskiff` that we want to keep as-is, with defaults for a lot of things (like operating systems).15:13
amalrajgenocidexhurrah!!! I was able to successfully deploy the Airsloop.. Thank you everyone here for helping me finish it :D  :D  :D15:14
mattmceuenWe want to facilitate overrides on top of `airskiff` for opensuse overrides, mostly base images for things (airship and openstack), but also other overrides15:14
mattmceueno/ amalrajgenocidex that's fantastic!15:14
mattmceuenGood work sticking with it man :)15:14
mattmceuenksels alexanderhughes1:  we want to make sure that all the airskiff peggles are not duplicated in a separate site for opensuse, because then they might drift15:15
mattmceuenthe thought that was proposed a few weeks ago was: we have a little-used layer called `cicd` that could be used to shim in overrides on top of a `site`15:15
mattmceuenSo jamesgu and I are just trying to figure out exactly what that would look like15:16
mattmceueni.e., where do the peggles go (`treasuremap/cicd/airskiff-opensuse`?  `treasuremap/site/airskiff/cicd/opensuse`?  something else?)15:16
kskelsI don't actually think you can do that :(15:17
kskelswhat it really sounds like is - you need `airskiff` type - and then create 2 sites - regular and suse15:17
mattmceuenthen we end up with duplication15:18
kskelswell, if you consolidate most of it in type - it would be OK15:18
* mattmceuen cue mattmceuen's normal service layer tirate15:18
kskelsthough then we would duplicate 'sloop' type15:18
mattmceuenright15:18
mattmceuenbut this cicd layer is already used (by cicd of course) to shim in overrides.  How does it accomplish that, and why wouldn't we be able to do the same with opensuse overrides?15:19
kskelsyeah - cicd layer is really a layer - but not a pegleg concept today15:19
kskelsmeaning - in the site-definition - you only set type: sloop/atlanta, etc15:19
mattmceuenI see15:19
kskelsthe way it works for cicd15:19
alexanderhughes1do you have an example mattmceuen ?  right now we're telling Pegleg things belong to one of three layers: site, type, or global.  we grab those files and make substitutions as needed15:19
kskelsis that extra files reside in another repo - e.g. like global, site repos15:20
openstackgerritMerged airship/treasuremap master: Update docker to 18.06.3  https://review.opendev.org/66821715:20
kskelsso to use cicd layer in the way you like- you would need to create a new repo..15:20
mattmceuenalexanderhughes1:  ignore the name `cicd` for now, we were just trying to leverage some prior art15:20
mattmceuenthe real problem is we need four layers (sometimes)15:20
alexanderhughes1so an "override generics" type layer15:21
kskelsright - or basically multiple layer support in pegleg15:21
mattmceuenI.e. `site` makes a fine thing to deploy as a leaf of that hierarchy, but sometimes you need overrides on top of a site (or something between type and site is really more appropriate)15:21
alexanderhughes1let me scratch my head I have an idea but foot in mouth isn't a good look on me15:22
mattmceuenlol15:22
mattmceuenthat is fair - thanks alexanderhughes1 :D15:22
mattmceuenworst case we will need to refactor airskiff up to a type, or have a duplicate site, or do something horrific with symlinks (please no)15:23
openstackgerritRoman Gorshunov proposed airship/pegleg master: [Test] Pegleg Exceptions docs  https://review.opendev.org/66869515:25
alexanderhughes1mattmceuen is it full documents that need to be overridden - or just specific values in the docs?15:28
mattmceuenalexanderhughes1:  specific values I believe.  Here are the overrides for openstack-helm (which would be a subset of what we'd need):  http://paste.openstack.org/show/753770/15:32
mattmceuen(those were pulled from different override files for different charts, they'll need to be woven into armada-style overrides for airship)15:33
openstackgerritKaspars Skels proposed airship/treasuremap master: [CEPH] uplift charts and enable helm tests  https://review.opendev.org/66521915:34
roman_gkskels: Kaspars, did we disable gfleese AIAB job?15:37
roman_gIt's not being triggerent on patch sets15:37
kskelshttps://jenkins.atlantafoundry.com/job/airship-in-a-bottle/15:37
roman_gGood morning Kaspast and everyone :)15:38
kskelsit looks good15:38
alexanderhughes1good morning roman_g !15:38
kskelsmaybe voting is not setup correctly15:38
kskelsgood morning!15:38
roman_gHmm.15:38
kskelsbut I see patchsets runing - so it looks good from my side15:38
roman_galexanderhughes1: I saw your reply, but need to get deeper to understand what's going on.15:38
roman_gkskels: OK, will reconnect to vpn and 'll recheck.15:39
roman_gthank you15:39
alexanderhughes1so the way Pegleg is working is it's trying to verify we're on the right revision of each repo specified in site-definition.yaml (or in the -e overrides), your patch adds a git reset --hard during that step15:39
alexanderhughes1afterwords it does the command (encrypt, decrypt, whatever).  if we created a file directly in that repo it gets erased before it gets to the encrypt/decrypt/whatever command15:39
alexanderhughes1alternative would be to simply not manually create files in the repos.  have them go somewhere else and leverage pegleg's --save-location or similar flags to place the documents that need to be written into the repo15:40
alexanderhughes1so if I wanted to encrypt a hello world document, I'd create the temporary file in /home/user/ then encrypt --save-location /path/to/security/repo15:41
roman_galexanderhughes1: ahha.. I actually thought that in the place where the code I've changed works, I'm working on a temporary copy of repo, not on the original.15:42
alexanderhughes1mattmceuen looking at our layering definition right now, I'm thinking we'd do a couple things: 1. rename cicd or add a new layer "overrides" "fluffy_unicorn_values" or whatever and 2. add the files that you want to serve as overrides into a specific directory.  under "site" would be most appropriate I believe15:44
alexanderhughes1this may require an extra step of pegleg code to check we're getting the override document in the collect files by site step, still working that out15:45
openstackgerritPRATEEK REDDY DODDA proposed airship/promenade master: Inculde a post-run to the airship-promenade-genesis-gate  https://review.opendev.org/66664515:45
mattmceuenif you put them under `site`, how would we avoid collecting them when we are working with the (non-overridden) site?15:45
mattmceuenI see15:46
mattmceuenCurious, what is behind the preference behind putting them under the site, rather than as separate layer?15:46
alexanderhughes1that's the part I'm trying to work out.  is where it goes to make sure pegleg gets those files only when appropriate15:47
alexanderhughes1do we have an etherpad up yet for today's discussion?  been disconnecting like crazy so I might have missed it earlier15:51
mattmceuensorry, I forgot to share earlier!  https://etherpad.openstack.org/p/airship-meeting-2019-07-0215:51
mattmceuenWas just going to say, do we want to add the "site overrides" dillemma to the agenda?15:51
alexanderhughes1we can talk through it.  I've got mixed feelings - site overrides to me seems kinda silly since that's part of the site configuration.  if we only want to override specific sites with specific overrides that seems to just be site definition15:52
mattmceuenI agree15:52
mattmceuenwhich means airskiff should be a type15:52
mattmceuenbut then, airskiff would ideally continue to have shared overrides with sloop15:53
mattmceuenso you're back to four layers, spun differently15:53
*** nishantkr has joined #airshipit15:53
mattmceuen(or duplication)15:53
*** ian-pittwood has joined #airshipit15:53
openstackgerritKaspars Skels proposed airship/treasuremap master: Fix: git module requires user to exist  https://review.opendev.org/66770715:53
* mattmceuen service layerrrrrrrs15:53
mattmceuenreminder all:  team meeting starts in 5 minutes15:54
roman_gkskels: Kaspars, need mirroring to GitHub be setup for the docs, election, and airshipctl repos, and may be spyglass-plugin-xls15:57
openstackgerritMerged airship/divingbell master: Update documentation based on change to using unprivileged containers  https://review.opendev.org/64751015:58
kskelsroman_g: that should be as simple as following other repo samples -that is adding zuul job with keys15:59
alexanderhughes1so the goal is to minimize code duplication, and give more knobs for site configuration... I wonder if we just add (at a high level) to site-definition.yaml a serviceLayer: <nnnnn> field15:59
alexanderhughes1and add to layering-definition the serviceLayer between site and type15:59
alexanderhughes1or whatever you want to call it16:00
kskelsor maybe just16:00
alexanderhughes1but that seems awful close to just calling it a site specific configuration16:00
kskelshttps://www.irccloud.com/pastebin/rcPDnWyu/16:00
mattmceuenlol time to get started, good ideas if we can bring 'em back out in a few minutes!16:00
kskelslike a list of layers instead of just `layer` that is single16:00
roman_gkskels: np, I can do it, bt is there anything what needs to be done in airshipit org on github?16:00
mattmceuen#startmeeting airship16:00
openstackMeeting started Tue Jul  2 16:00:53 2019 UTC and is due to finish in 60 minutes.  The chair is mattmceuen. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: airship)"16:00
openstackThe meeting name has been set to 'airship'16:00
hogepodgehi16:00
mattmceuen#topic Rollcall16:00
*** openstack changes topic to "Rollcall (Meeting topic: airship)"16:00
roman_go/16:01
alexanderhughes1\o/16:01
mattmceuenHello everyone, here is our agenda du jour:  https://etherpad.openstack.org/p/airship-meeting-2019-07-0216:01
mattmceuenLet's give it a couple mins for folks to join and add things to the agenda16:01
ian-pittwoodo/16:01
mattmceuenalrighty16:03
mattmceuen#topic Announcements16:03
*** openstack changes topic to "Announcements (Meeting topic: airship)"16:03
mattmceuenFirst off -- voting for our TC will commence later today.  Contributors should get a one-time-use email in their inbox later today; please let me know if anyone doesn't get it16:04
mattmceuenvoting will last for one week16:04
mattmceuenThank you in advance to everyone who is running, it's really awesome to see folks from six different companies having nominated, not to mention that all the candidates are fantastic individuals.16:05
mattmceuenNext:16:05
mattmceuenStarting next week:  meeting time is 2pm UTC (2 hours earlier than today)16:05
mattmceuenI think we discussed this last week, so this is just a reminder!16:05
mattmceuenNext:16:05
mattmceuenA project proposal was approved by the OPNFV TSC this morning, to leverage Airship as a reference installer for standard NFV infrastructure16:06
hogepodgemattmceuen: have we updated the meeting time in the opendev calendar?16:06
mattmceuen(the standards focus on telco-grade NFVI and are still being authored)16:06
roman_gmattmceuen: Any links to that?16:06
mattmceuenhodgepodge:  nope, good catch, thank you!  I'll update today16:06
mattmceuenroman_g:  I don't believe so yet, but I will share as soon as I get some16:06
roman_gthanks16:07
mattmceuenI know some folks in our community have been contributing to that already, like kskels16:07
mattmceuenSo more to come, but that's a really exciting way to help make sure Airship remains aligned to some of the more telco-oriented use cases that are developing in the industry!16:07
roman_gyes, IRC meeting time should be updated in several places (wiki, eavesdrop repo, and may be soemwhere else) + e-mail to announcement mailing list16:07
kskelsfyi: good page for opnfv -> https://wiki.opnfv.org/display/PROJ/Project+Proposals+Airship16:08
mattmceuenthx kskels16:08
roman_gkskels: thank you16:08
mattmceuenFor background, here's a link to an article from a while back about the NFVI standards effort itself: https://www.telecomtv.com/content/nfv/csp-led-nfvi-task-force-to-be-hosted-by-gsma-35623/16:09
mattmceuenroman_g:  thanks for that, I'll make sure to check the boxes16:09
mattmceuenA few extra reminders are always a good thing :)16:09
mattmceuenroman_g:  was making sure the meeting time got communicated out fully all you wanted to discuss for this one:     Update meeting time results: https://etherpad.openstack.org/p/airship-meeting-vote-201916:10
mattmceuenOr is there more we should discuss as well?16:10
*** amalrajgenocidex has quit IRC16:11
roman_gТщб ше огые туувы ещ иу гзвфеув цшер куыгдеы16:11
roman_gNo, it just needs to be updated with results16:11
mattmceuenOk awesome - I will do so16:11
mattmceuenAnthing else on these announcements before we move on?16:11
mattmceuen#topic     Follow up on PostgresHA16:12
*** openstack changes topic to "Follow up on PostgresHA (Meeting topic: airship)"16:12
mattmceuenhttps://review.opendev.org/#/c/657667/16:13
mattmceuenThis one's yours roman_g, take it away16:13
roman_gWell, it's yours, Matt. Do we just get it merged as a complete work or is anything else is missing?16:13
mattmceuenReviews on that PS would be appreciated :)16:14
roman_gDo any docs need to be updated on it?16:14
roman_gexcept tools/upgrades/postgresql/README.md16:14
mattmceuenI need to double check  on it in seaworthy16:14
mattmceuenI'm not aware of any other docs that need updating on behalf of HA Postgres, if anyone's aware of any please let me know and I'll be sure to update.16:15
roman_gOK, OK.16:15
mattmceuenI'll make sure whether that PS is good to merge or not in the next couple days, thanks for bringing it up roman_g16:16
mattmceuen#topic Follow up on Code formatting standardization across projects16:16
*** openstack changes topic to "Follow up on Code formatting standardization across projects (Meeting topic: airship)"16:16
mattmceuenGood one to revisit, we'd brought up a few weeks ago that there may be benefit to standardizing across projects a bit16:17
mattmceuen(or a bit more, I should say)16:17
roman_galexanderhughes1 started to do some changes to projects. Just wanted to be sure we have code formatting and style documented.16:17
alexanderhughes1yeah I did things backwards.  I have a proposal out for Pegleg now https://review.opendev.org/#/c/664125/ looking for thoughts on live reformat.  then put those thoughts into documentation for other projects16:18
mattmceuenalexanderhughes1: thanks for getting those changes started.  Is there anything we need to levelset on as a patchset against the documentation as well?16:18
alexanderhughes1like to get people's thoughts on what I have up now so they can see how those knobs in YAPF actually affect the code.  then take those into documentation for the other projects16:18
roman_galexanderhughes1: to here, please: https://airshipit.readthedocs.io/en/latest/code-conventions.html#linting-and-formatting-standards16:19
roman_gadd it there16:19
alexanderhughes1sure.  I'll add thoughts there on what I have going so far, and link back to the patchset in progress16:20
roman_gyour PS for Pegleg looks good, but I'm nowhere expert in formatting :)16:20
mattmceuenthat would be awesome alexanderhughes1.  I think getting the PS against the docs will be a good way to position the pegleg changes as the beginning of cross-project alignment16:21
alexanderhughes1thanks :)  I'll link both ways so people can see the proposal, and how it looks in practice, and add my reasoning for selecting these knobs16:21
mattmceuenexcellent16:21
mattmceuenAnything else on cross-project standards before moving on?16:22
alexanderhughes1not specific to the python projects - but want to keep thinking about airshipctl16:22
roman_gGolang?16:23
alexanderhughes1right now we're talking about gates for gofmt for code submitted which is a good start.  this doesn't impact imports that are separated with a blank line.  should standardize that as we did in python projects https://docs.openstack.org/hacking/latest/user/hacking.html#import-order-template16:23
mattmceuenyeah, would be great to have some conventions off the bat.  I think the only contention we have is "use the go formatter" which already solves a multitude or problems16:23
alexanderhughes1yeah gofmt is huge - but the one thing it's missing is import orders.  if I have a block of 3 then a block of 2, then a block of 4.  each of those blocks separated by a blank line will be sorted alphabetically within their own block16:24
alexanderhughes1but we'll want to address what each block represents, https://docs.openstack.org/hacking/latest/user/hacking.html#import-order-template is a good candidate16:24
mattmceuenWant to propose that as a separate PS against our code style docs alexanderhughes1?  Add a subsection for golang, with our one for-sure bullet and your additional proposal?16:25
alexanderhughes1glad to :)16:25
mattmceuenexcellent16:26
mattmceuenOk - moving on!16:26
mattmceuen#topic     Roman needs help: https://review.opendev.org/#/c/668038/ - tests fail16:26
*** openstack changes topic to "Roman needs help: https://review.opendev.org/#/c/668038/ - tests fail (Meeting topic: airship)"16:26
mattmceuenwant to give us an overview of this one roman_g?16:27
roman_gAlex helped to understand where the problem lies. Now I need to understand how to fix it.16:27
roman_gBasically I broke encryption tests with this PS, and did not understand why is that happening.16:27
roman_gSo.16:28
roman_gLet's move on to other topic. I need to digest what Alex said to be ealier today (in logs above, prior to the meeting).16:28
mattmceuenOk, that sounds good.  Can definitely discuss more in the channel here as well later today16:29
mattmceuenthanks guys16:29
mattmceuenNext up!16:29
mattmceuen#topic Docs project now exists:  next steps16:30
*** openstack changes topic to "Docs project now exists: next steps (Meeting topic: airship)"16:30
mattmceuenwe now have a https://opendev.org/airship/docs project !16:30
mattmceuenWe had discussed this a while back, with the goal of being the home of cross-airship documentation16:30
mattmceuen(project-specific documentation would continue to live in their projects)16:30
mattmceuenWe have a list in an etherpad, but sorry, I don't have it at my fingertips at the moment.   The gist of what we want to move in, however, is:16:31
mattmceuen1: all the documentation from the AIAB project16:31
mattmceuen2: all the non-treasuremap-specific documentation from treasuremap16:31
roman_g1: pending PS reviews.16:32
roman_g2: what is non-treasuremap-specific documentation in treasuremap?16:33
mattmceuenfrom treasuremap, that means the Dev Guide, Troubleshooting Guide, Site Authoring Guide, and Config Update Guide would move I believe -- does that sound right kskels?16:33
roman_gkskels: step in16:33
mattmceuenAnd then Airskiff, Airsloop, Seaworthy docs would continue to live in TM16:33
mattmceuenIt's possible that the SIte Authoring / Config Update guides should continue to live in TM, since they're so TM YAML-oriented16:35
mattmceuenA case could be made either way for those16:35
roman_gKaspars is not here. Let's leave it for now.16:36
mattmceuenAgree, we can circle back later16:36
mattmceuenHowever, we do need gates in `docs`, I don't believe we have any yet16:37
mattmceuenunless you've added any roman_g?16:37
roman_gadded, yes16:37
mattmceuensweet!16:37
roman_gwaiting for review16:37
mattmceuenThank you :)16:37
mattmceuenI am behind in reviews this week, sorry16:37
roman_gwelcome :)16:37
mattmceuenAfter we get the docs migrated from AIAB, I think that `docs` can take over responsibility for pushing rendered docs to readthedocs.io as well16:38
roman_gthis is ready to be reviewed and merged.16:38
roman_gincluding migration of docs from AIAB to docs repo16:39
mattmceuenbeautiful.  Ok, I think we're going in a good direction here and can follow up with kskels for that last detail later16:39
mattmceuenThat's awesome16:39
mattmceuenonce we have the skeleton and seed content in docs, it'll make it easier for others to contribute more.16:39
mattmceuenso, moving on!16:39
mattmceuen#topic Revisit using `cicd layer` for overrides on top of a site definition16:40
*** openstack changes topic to "Revisit using `cicd layer` for overrides on top of a site definition (Meeting topic: airship)"16:40
mattmceuenSo the problem statement is:16:40
mattmceuenWe want to be able to apply overrides against some of the sites we have today16:40
mattmceuenE.g. "airskiff but with opensuse overrides"16:40
mattmceuene.g. "aiab but with tungsten fabric SDN"16:41
mattmceuenA few weeks ago we floated the idea of using a rumored `cicd` layer underneath `site` to accomplish this16:41
mattmceuenhowever, in getting in to the details of that this morning, it's not perfectly straightforward, as pegleg does not support that yet16:42
mattmceuennote:  we're going to support service layer type functionality with Airship 2.016:42
mattmceuen(details are still TBD but it must/will happen)16:42
mattmceuenSo what we need to figure out in the meantime, how can we best support these types of use cases/overrides in the meantime, using the Airship 1.x tools we have?16:43
mattmceuenalexanderhughes1 we had just started talking about, if we were going to add a "legit" fourth layer, where would we insert it16:44
mattmceuenbetween `type` and `site` potentially?16:44
roman_gcould we define a sequence of layers application?16:45
roman_gsequence of overrides16:46
jamesgumattmceuen: not trying to throw another wrench into it. does the gate run against a single version of openstack currently, or multiple versions? I see the overrides for some OSH charts start to have default release specific overrides?16:46
mattmceuenroman_g:  I think that's basically what we have today, but we have a sequence of three -- and that doesn't give us enough "space" to do all the config de-duplication we want anymore16:47
alexanderhughes1well there's a couple things, and we'd want to POC it - but at a high level one possible solution might be adding to layering-definition.yaml "overrides" at bottom of list, on top of the site.  add to that site-definition.yaml an override_type definition, then create override documents that would exist in a /path/to/override/definitions/16:47
mattmceuenjamesgu: we don't do testing of different sets of openstack overrides in treasuremap today, testing different versions of openstack is more osh territory16:48
alexanderhughes1then tell pegleg to collect all the documents for the site (global, type defined by site-def, site name, and overrides defined by site def)16:48
mattmceuenhow much effort do you think that would be from a pegleg perspective, alexanderhughes1?16:49
alexanderhughes1still preliminary thoughts, I can play with it over the weekend and see what struggles I have and discuss next week16:50
mattmceuenDoes that exactly solve the problem, though -- if you configure your site to pull extra overrides declaratively, that is great.  but,16:50
mattmceuenwe have an airskiff site that we don't want to pull in overrides16:50
mattmceuenin the default case, at least16:51
mattmceuenbut then we want to pull in overrides against it in other cases16:51
mattmceuenLet me clarify16:51
mattmceuenwe want to say "deploy airskiff" and "deploy airskiff, but with opensuse"16:51
mattmceuenif airskiff (site) is hardwired to pull overrides, then it would always pull in opensuse16:51
mattmceuenanyway - I think we've explored the solution space a bit16:52
mattmceuenlike you said alexanderhughes1, let's think about this16:52
alexanderhughes1that's the sticking point, if we want to pull in overrides we have to tell Pegleg somehow.  the least amount of duplication off the top of my head is modifying site-def16:52
mattmceuenjamesgu: however, I don't want to hold you up either16:52
mattmceuenA couple options on how we could proceed in the meantime with opensuse airskiff16:53
mattmceuen1. make a copy of airskiff, with the intention of de-duplicating those manifests once we have a path forward ironed out16:53
mattmceuen2. make a "do not merge" patchset against airskiff, applying opensuse overrides, until we have a path forward ironed out16:53
kskelsI think airkiff using sloop can be made fairly lightweight - so duplication would be minimal16:54
kskelsdidn't we have a patchset for that somewhere @drew16:54
mattmceuendwalt: ? ^16:54
dwaltyes! There is a patch; however, it recently entered merge conflict16:55
dwaltI'll send it over16:55
mattmceuenalexanderhughes1:  I like the idea of having separate sites for airskiff and airskiff-opensuse, as long as "most of their manifests" live somewhere outside the site level16:55
mattmceuenawesome ty dwalt16:55
dwalt#link https://review.opendev.org/65688216:55
mattmceuenwell we have enough to stew on, gotta keep moving as the end of the meeting time is nearly upon us16:56
mattmceuenlet's please keep the ball moving before those of us in the US go on holiday!16:56
mattmceuen#topic Review Requests16:56
*** openstack changes topic to "Review Requests (Meeting topic: airship)"16:56
mattmceuen    https://review.opendev.org/#/c/664045/ - Check sync of only active MaaS rack controllers16:56
mattmceuen    https://review.opendev.org/#/c/668020/ - airship/docs docs and gates for docs16:56
mattmceuen    https://review.opendev.org/#/c/668664/ - airship/docs Import documentation from airsip-in-a-bottle16:56
mattmceuen    https://review.opendev.org/668665 - airship/airship-in-a-bottle Export all documents to Airship Docs project16:56
mattmceuen    https://review.opendev.org/#/c/667707/ - airship/treasuremap (calling Pegleg in container under non-root user) Fix: git module requires user to exist16:56
mattmceuen    https://review.opendev.org/#/c/661004/ - airship/treasuremap treasuremap updater script, Add cross-verification of Git commit ID'd and image tags16:56
mattmceuen    https://review.opendev.org/#/c/666606/ - Airship mailing list for CI errors reporting; Cores: add +1's, please16:56
mattmceuen    https://review.opendev.org/#/c/667318/ - airship/election - rts formatting fixes16:56
mattmceuen    https://review.opendev.org/668650 - airship/election Add gate for docs build16:56
mattmceuenLots of requests for reviews this time16:57
mattmceuenLet's clean up some of our open patches, there's a lot going on and it will be good to get merged what is ready!!16:57
mattmceuenAny additional PS team?16:57
alexanderhughes1need to add another -- https://review.opendev.org/#/c/668517/ this patch adds support for Pegleg to use a site encrypted set of global passphrase/salt, and then use those global keys to encrypt/decrypt any global layer documents16:57
*** alexanderhughes1 has quit IRC16:58
*** alexanderhughes has joined #airshipit16:58
alexanderhughescan be expanded to type level if we wanted16:58
mattmceuenthanks alexanderhughes, good add and I'll take a look16:59
alexanderhughesIE if every site needed to be able to use some passphrase, and it was encrypted with a global passphrase Pegleg will be able to decrypt it if you store the global passphrase as an encrypted document along with the other site encrypted documents16:59
mattmceuenthat's a wrap folks -- for those of us in the US have a happy Fourth of July!  For everyone else - well hopefully you have a great Fourth of July too :D17:00
mattmceuen#endmeeting17:00
*** openstack changes topic to "airshipit.org || General Review Dashboard: https://review.opendev.org/#/q/project:%255Eairship.*+status:open,n,z"17:00
openstackMeeting ended Tue Jul  2 17:00:31 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/airship/2019/airship.2019-07-02-16.00.html17:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/airship/2019/airship.2019-07-02-16.00.txt17:00
openstackLog:            http://eavesdrop.openstack.org/meetings/airship/2019/airship.2019-07-02-16.00.log.html17:00
mattmceuenThanks everybody, appreciate your time & discussion!!17:00
roman_gThank you, Matt.17:00
alexanderhughesthanks everyone!  enjoy the weekend :)17:00
mattmceuenI FORGOT17:01
mattmceuenToday is the last day to submit talk submissions for the upcoming Shanghai summit!17:01
roman_gWho goes there?17:02
mattmceuenThat is an excellent question, to which I do not have an answer :)17:02
hogepodgeI just came from KubeCon Shanghai, and I highly recommend attending the Open Infra event this November.17:03
hogepodgeGet those submissions in! :-)17:03
kskelsyes - I'm working on a submission also - but going there then will be a question for later if get selected.17:03
kskelssorry I missed the docs part - I can update later - will send a mail.17:03
*** alexanderhughes2 has joined #airshipit17:06
*** ian-pittwood has left #airshipit17:06
*** alexanderhughes5 has joined #airshipit17:07
alexanderhughes5the disconnects today -.-17:07
*** lemko has quit IRC17:07
*** alexanderhughes8 has joined #airshipit17:10
*** alexanderhughes has quit IRC17:10
mattmceuenI thought we were just cloning alexanderhughes over and over to help develop airship faster!17:10
alexanderhughes8bless my internet today17:10
alexanderhughes82 years with 0 hiccups from ATT's gigabit fiber.  and something happened that affects my whole neighborhood kicking me off vpn every 3-8 minutes for usually only 1-2 seconds at a time17:11
alexanderhughes8but the tech support team has been fantastic so should be resolved in another few days17:11
*** alexanderhughes5 has quit IRC17:12
*** obravo has quit IRC17:17
roman_gTeam, ode reviews, please.17:46
roman_g*code17:46
openstackgerritMerged airship/spyglass master: Add voting to OpenSuse jobs  https://review.opendev.org/66867017:47
openstackgerritRoman Gorshunov proposed airship/divingbell master: [WIP] Test gates  https://review.opendev.org/66873118:28
openstackgerritRoman Gorshunov proposed airship/divingbell master: fix: read the docs project name, hook trigger  https://review.opendev.org/66873818:42
*** rdhar2019 has joined #airshipit18:43
openstackgerritRoman Gorshunov proposed airship/divingbell master: Fix: read the docs project name, webhook trigger  https://review.opendev.org/66873818:43
*** rdhar2019 has quit IRC18:45
*** rdhar2019 has joined #airshipit18:46
*** rdhar2019 is now known as rdharwadkar18:48
*** rdharwadkar has quit IRC18:50
openstackgerritMerged airship/spyglass-plugin-xls master: Use data objects for document generation  https://review.opendev.org/66684918:50
*** rdharwadkar has joined #airshipit18:53
*** rdharwadkar has left #airshipit18:54
openstackgerritAlexander Hughes proposed airship/pegleg master: Add support for globally encrypted secrets  https://review.opendev.org/66851718:54
openstackgerritMerged airship/spyglass-plugin-xls master: Testing for plugin  https://review.opendev.org/66773418:56
openstackgerritAlexander Noskov proposed airship/treasuremap master: Uplift Horizon and fix Keystone password for Horizon chart.  https://review.opendev.org/66801619:03
*** bh526r has quit IRC19:20
*** jsuchome has quit IRC19:22
openstackgerritchinasubbareddy mallavarapu proposed airship/treasuremap master: [CEPH] uplift charts and enable helm tests  https://review.opendev.org/66521919:23
openstackgerritchinasubbareddy mallavarapu proposed airship/treasuremap master: [CEPH] uplift charts and enable helm tests  https://review.opendev.org/66521919:24
openstackgerritIan Pittwood proposed airship/spyglass-plugin-xls master: [WIP] Revise formatting of excel specs  https://review.opendev.org/66874819:39
openstackgerritMerged airship/pegleg master: Re-add OpenSUSE gates as voting  https://review.opendev.org/66857619:41
openstackgerritMerged airship/treasuremap master: Fix: git module requires user to exist  https://review.opendev.org/66770720:01
openstackgerritchinasubbareddy mallavarapu proposed airship/treasuremap master: [CEPH] uplift charts and enable helm tests  https://review.opendev.org/66521920:15
*** ab2434_ has quit IRC20:16
AlexNoskovHi guys. I'm currently trying to deploy Airship with the latest versions of all components. Doing an uplift using updater.py script from treasuremap. It is failing on genesis stage with the following error:20:28
AlexNoskov2019-07-02 19:58:21.933 1044 INFO armada.handlers.tiller [-] [chart=ucp-ceph-osd]: RUNNING: airship-ucp-ceph-osd-test20:28
AlexNoskov2019-07-02 19:58:31.062 1044 INFO armada.handlers.tiller [-] [chart=ucp-ceph-osd]: ERROR: No API token found for service account "airship-ucp-ceph-osd-test", retry after the toke20:28
AlexNoskovn is automatically created and added to the service account20:28
AlexNoskovThis issue appear after the following PS https://review.opendev.org/#/c/628290/. Do not wont to revert it, just want to fix it, probably something missed in chart?20:28
*** jamesgu_ has joined #airshipit20:28
AlexNoskovhttps://www.irccloud.com/pastebin/ZUQRNdea/20:30
*** alexanderhughes8 has quit IRC20:45
*** alexanderhughes has joined #airshipit20:47
*** evrardjp has quit IRC20:51
openstackgerritMerged airship/maas master: (fix) Check sync of only active rack controllers  https://review.opendev.org/66404520:51
openstackgerritMerged airship/maas master: Provide dependency chain on maas-ingress  https://review.opendev.org/65557120:52
*** evrardjp has joined #airshipit20:52
openstackgerritMerged airship/pegleg master: Add support for globally encrypted secrets  https://review.opendev.org/66851721:21
mattmceuenhey guys, srwilkers put in this PS to get prometheus scraping fixed up for airship components: https://review.opendev.org/#/c/668746/1  would be great to get some eyes on that of someone with experience in that area, I didn't even realize it was broken!21:25
srwilkersThanks mattmceuen. This just provides a simple way to check the response code of the health endpoints for the airship services to determine whether they’re reporting as up or not.21:33
openstackgerritIan Pittwood proposed airship/spyglass-plugin-xls master: [WIP] Revise formatting of excel specs  https://review.opendev.org/66874821:41
*** jamesgu_ has quit IRC21:46
*** jamesgu_ has joined #airshipit22:26
*** alexanderhughes has quit IRC23:10
*** aaronsheffield has quit IRC23:13
*** sthussey has quit IRC23:32

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!