Wednesday, 2019-05-29

*** sreejithp_ has quit IRC00:16
*** michael-beaver has quit IRC00:25
*** sreejithp has joined #airshipit01:13
*** happyhemant has quit IRC01:23
*** sreejithp has quit IRC01:39
*** sreejithp has joined #airshipit02:22
*** calw has joined #airshipit02:38
*** Talion has quit IRC02:43
*** sreejithp_ has joined #airshipit02:50
*** sreejithp has quit IRC02:53
*** licanwei has joined #airshipit03:17
*** altlogbot_0 has quit IRC03:44
*** altlogbot_0 has joined #airshipit03:44
*** altlogbot_0 has quit IRC04:38
*** altlogbot_1 has joined #airshipit04:40
*** sreejithp_ has quit IRC04:49
*** anyrude10_ has quit IRC05:55
*** anyrude10_ has joined #airshipit05:56
anyrude10_Hi Team, Can we setup Airship-Seaworthy on our Virtual Environment? If yes, what type of configuration do we need for it?05:56
*** aojea has joined #airshipit06:17
*** jamesgu_ has quit IRC06:29
*** roman_g has joined #airshipit06:49
*** mbeierl has quit IRC08:03
*** nishantkr has quit IRC08:35
anyrude10_<roman_g> I tried using your suggested steps and it passed the previous error, but now giving error in ucp-Rabbitmq.  ERROR armada.handlers.wait [-] [chart=ucp-rabbitmq]: Ti                                         med out waiting for statefulsets (namespace=ucp, labels=(release_group=airship-uc                                         p-rabbitmq)). These statefulsets were not ready=['airship-ucp-rabbitmq-rabbitmq'] 2019-05-29 10:10:22
anyrude10_ERROR armada.handlers.wait [-] [chart=ucp-rabbitmq]: Timed out waiting for statefulsets (namespace=ucp, labels=(release_group=airship-ucp-rabbitmq)). These statefulsets were not ready=['airship-ucp-rabbitmq-rabbitmq'] 2019-05-29 10:20:21.329 1 ERROR armada.handlers.armada [-] Chart deploy [ucp-rabbitmq] failed: armada.exceptions.k8s_exceptions.10:23
*** happyhemant has joined #airshipit10:56
anyrude10_Airship in Bottle, facing the error http://lists.airshipit.org/pipermail/airship-discuss/2018-November/000176.html11:30
*** redrobot has quit IRC11:39
*** howell has joined #airshipit12:31
*** calw has quit IRC12:57
*** mbeierl has joined #airshipit13:06
openstackgerritAlexander Hughes proposed airship/spyglass master: [WIP] Spyglass opensuse support  https://review.opendev.org/65969213:17
*** aaronsheffield has joined #airshipit13:19
*** kranthikirang has joined #airshipit13:20
openstackgerritAlexander Hughes proposed airship/spyglass master: [WIP] Update Spyglass base image to ubuntu xenial  https://review.opendev.org/66198013:22
*** kranthikirang has quit IRC13:27
*** michael-beaver has joined #airshipit13:28
mattmceuenhey anyrude10_:  for using airship-seaworthy in a virtual environment, the answer is "yes, with some amount of customization" :)13:41
mattmceuenThe site manifests are all configuration, so you'd need to combine the right config for running in VMs with whatever you'd like to leverage from airship-seaworthy13:42
*** sreejithp has joined #airshipit13:43
mattmceuenHave you checked out the airship-in-a-bottle multinode setup? https://opendev.org/airship/in-a-bottle/src/branch/master/tools/multi_nodes_gate13:47
mattmceuenIt's scripting + a site definition that the developers often use for standing up a multi-node airship inside of a big VM.13:48
mattmceuenWe're in the process of migrating airship-in-a-bottle (single VM demo and multi-VM setup) into the treasuremap project, so that it will be aligned to the same global manifests that airship-seaworthy uses -- at that point it may be easier to do what you need as well.  evgenyl has a patchset up for this.13:49
mattmceuenIf you can give me any more details of what you're trying to achieve I can try to help!13:50
openstackgerritIan Pittwood proposed airship/spyglass master: Separate plugins from Spyglass  https://review.opendev.org/65355513:53
mattmceuenanyrude10_: for your airship-in-a-bottle issue, are you getting it with the latest version of the https://opendev.org/airship/in-a-bottle project?13:54
openstackgerritIan Pittwood proposed airship/spyglass master: Schema validation  https://review.opendev.org/65917214:01
openstackgerritAnthony Bellino proposed airship/shipyard master: Update Airflow logrotate logic  https://review.opendev.org/65603314:02
*** jamesgu_ has joined #airshipit14:02
openstackgerritAnthony Bellino proposed airship/shipyard master: Add pod affinity to Shipyard and Airflow  https://review.opendev.org/65989314:02
openstackgerritMerged airship/pegleg master: Fix --save-location error in decrypt command  https://review.opendev.org/66182714:12
openstackgerritMerged airship/pegleg master: Fix multiple I/O issues in cert generation  https://review.opendev.org/64367814:12
openstackgerritAlexander Hughes proposed airship/pegleg master: Update Pegleg base image to ubuntu xenial  https://review.opendev.org/66108814:23
openstackgerritIan Pittwood proposed airship/spyglass master: Adds Safety dependency vulnerability checks  https://review.opendev.org/65885414:46
openstackgerritMerged airship/spyglass master: Removes remaining yapf: disable statements  https://review.opendev.org/65814314:53
openstackgerritAlexander Hughes proposed airship/spyglass master: [WIP] Update Spyglass base image to ubuntu xenial  https://review.opendev.org/66198015:08
openstackgerritAlexander Hughes proposed airship/spyglass master: Update Spyglass base image to ubuntu xenial  https://review.opendev.org/66198015:24
openstackgerritIan Pittwood proposed airship/spyglass-plugin-xls master: Updates YAPF settings to match Spyglass  https://review.opendev.org/66202015:29
openstackgerritIan Pittwood proposed airship/spyglass master: Separate plugins from Spyglass  https://review.opendev.org/65355515:30
*** altlogbot_1 has quit IRC15:35
*** altlogbot_1 has joined #airshipit15:35
openstackgerritIan Pittwood proposed airship/spyglass master: Manifest undefined data validation  https://review.opendev.org/65568315:35
*** irclogbot_2 has quit IRC15:35
*** irclogbot_2 has joined #airshipit15:36
openstackgerritMerged airship/spyglass-plugin-xls master: Various fixes for plugin separation  https://review.opendev.org/65911615:45
*** arunkant has joined #airshipit15:45
*** arunkant has quit IRC15:55
*** kskels has joined #airshipit16:02
*** arunkant_ has joined #airshipit16:02
*** arunkant_ has quit IRC16:03
*** arunkant has joined #airshipit16:03
*** arunkant_ has joined #airshipit16:03
*** arunkant_ has quit IRC16:03
arunkantroman_g: Hi, will you be able to review this patch (deckhand opensuse image support) and possibly workflow it https://review.opendev.org/#/c/638301/16:07
openstackgerritIan Pittwood proposed airship/spyglass-plugin-xls master: Updates YAPF settings to match Spyglass  https://review.opendev.org/66202016:14
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Update Pegleg base image to ubuntu xenial  https://review.opendev.org/66108816:17
openstackgerritIan Pittwood proposed airship/spyglass master: Schema validation  https://review.opendev.org/65917216:17
openstackgerritMerged airship/spyglass master: Separate plugins from Spyglass  https://review.opendev.org/65355516:21
openstackgerritAlexander Hughes proposed airship/spyglass master: [WIP] Update Spyglass base image to ubuntu xenial  https://review.opendev.org/66198016:21
*** happyhemant has quit IRC16:24
*** aojea has quit IRC16:35
openstackgerritIan Pittwood proposed airship/spyglass-plugin-xls master: Adds force option to manifest generation  https://review.opendev.org/66203416:38
openstackgerritIan Pittwood proposed airship/spyglass master: Manifest undefined data validation  https://review.opendev.org/65568316:39
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Update Pegleg base image to ubuntu xenial  https://review.opendev.org/66108816:43
openstackgerritIan Pittwood proposed airship/spyglass master: Schema validation  https://review.opendev.org/65917216:44
openstackgerritIan Pittwood proposed airship/spyglass master: Adds Safety dependency vulnerability checks  https://review.opendev.org/65885416:47
openstackgerritIan Pittwood proposed airship/spyglass-plugin-xls master: Adds Safety dependency vulnerability checks  https://review.opendev.org/66203916:52
*** howell has quit IRC17:01
openstackgerritMerged airship/treasuremap master: Add tag filter parameter to the updater tool  https://review.opendev.org/66042917:03
openstackgerritMerged airship/treasuremap master: Fix: tools/airship permissions and directories issues  https://review.opendev.org/66160017:06
evgenylCan somebody help with reviews for MaaS patch https://review.opendev.org/#/c/653551/ ? I have been struggling with this problem during AIAB testing.17:10
arunkantcan anyone help with review for this deckhand patch https://review.opendev.org/#/c/638301/ ? It has been waiting for one more review and workflow for quite sometime.17:15
openstackgerritMerged airship/maas master: Add explicit rackd image sync  https://review.opendev.org/65355117:20
openstackgerritEvgeniy L proposed airship/treasuremap master: Update Jenkinsfile's to use Ubuntu-based images  https://review.opendev.org/66044117:26
kskelsarunkant: I have given +2 to your PS, so given all gates pass - it should merge shortly17:56
openstackgerritMichael Beaver proposed airship/shipyard master: Follow up change for deployment-status ConfigMap  https://review.opendev.org/66185418:12
*** howell has joined #airshipit18:15
openstackgerritKaspars Skels proposed airship/deckhand master: Adding opensuse image build for deckhand  https://review.opendev.org/63830118:16
*** alexanderhughes has joined #airshipit18:16
mattmceuenevgenyl & kskels: I left some feedback for future todos/questions in the treasuremap aiab patchset, but will +2 once it tests ok for me, since they're existing concerns with aiab as-is -- please still take a look at those items and let me know what you think18:24
evgenylmattmceuen: Agree with everything you said! I will refactor this using tools/airship and remove these custom creds/tests and reuse other scripts that we already have in treasuremap. I also agree about hardcoded absolute paths, they should go away. Wanted to do it iteratively with small patch-sets which easy to track and review.18:31
mattmceuenperfect - thanks evgenyl!18:37
alexanderhughesquestion on image scanning - https://quay.io/repository/airshipit/pegleg/manifest/sha256:86d47bf777216eb28c4fc3594e57b0f758fd532b7e88a17ab8e5bd4f42dcd44e?tab=vulnerabilities is the pegleg vulnerability report from quay on the latest master image... it shows more than 600 vulnerabilities, 50 of which are high18:38
alexanderhughesI've got a patch to address much of that, I've got it (locally scanned with clair) down to 135 vulnerabilities, 0 of which are high.  what's the 'acceptable' CVE risk we're willing to take on these projects?  medium?  low?18:39
alexanderhugheswhich brings me to my next point, I'd like to do a POC against pegleg or spyglass to have zuul run clair to let us know if there are any vulnerabilities above that threshold in the image layers18:42
alexanderhughesany thoughts?  if it works it could be useful across all of airship to tighten things up a bit18:43
evgenylWe may want to have all of them to be 0, but practically we should have at least high and medium to be 0. Is there any specific reasons we keep all dependencies pinned with `==`, this makes the maintenance of these packages harder, this is the main reason why other OS packages usually keep their packages unpinned, and use ranges if needed.18:44
evgenyl*other OS projects18:44
alexanderhughesin spyglass ian and I have been discussing the use of 'safety' module to check the python modules for vulnerabilities and alert.  but the vulnerabilities I found in image layers are separate from the python modules18:45
evgenylalexanderhughes: does this mean that `python:3.6` image does not have all these vulnerabilities patched?18:48
alexanderhughescorrect.  when I scanned the pegleg image created with a python:3.6 base image I had 635 vulnerabilities in clair.  when I used the makefile in my patch here https://review.opendev.org/#/c/661088/ and scanned again, the new pegleg image had 13518:49
evgenylalexanderhughes: Oh, this is what this patch is for,  have not seen your comment. Do you still have the report available to check how many of those are Mediums after switching to ubuntu xenial?18:51
alexanderhughesevgenyl: give me a few moments I'll re-generate the report and do a count on medium18:52
alexanderhughesevgenyl: 60 mediums on xenial18:54
openstackgerritMerged airship/treasuremap master: [seaworthy gate] Explicitly configure auth parmaters  https://review.opendev.org/66136318:58
evgenylalexanderhughes: Thank you for the info. I looked at examples of Medium vulns, and it is hard to give a quantitative threshold, the severity depends on our usage of e.g. standard python libraries. I'm wondering if instead of a scanner check we can get a periodic job, that would get the latest ubuntu xenial image with all most recent vulns fixed and push an updated version of the image.19:00
evgenylalexanderhughes: Updating the base image is what we would probably do anyway if we see some new High vuln detected in our image.19:00
alexanderhughesevgenyl: that's one approach, I think the scanning method would give us a better indication of something 'bad' happening.  the vulnerability database is updated daily, and a vulnerability can come from not just the base image but any of the other steps in the dockerfile so it'd be better to scan the final image as a whole in my opinion19:05
alexanderhughesjust playing devil's advocate if I introduced a RUN sudo apt-get install -y some_package=vulnerable_version we'd want to catch that rather than just blame the base image19:10
openstackgerritIan Pittwood proposed airship/pegleg master: Pin dependency versions  https://review.opendev.org/66206919:11
*** weystrom has joined #airshipit19:11
weystromhey guys, i wanted to run small airship deployment to check it out, tried both the bottle and airskif way, both deployments get stuck on postgresql-0 pod which complains either about DB 'postgres' not existing or missing ip in pg_hba.conf. Looks like the pod config is wrong, i'm currently looking through the setup to understand it better, but maybe there's already a solution for this? Thanks.19:13
openstackgerritIan Pittwood proposed airship/spyglass master: [WIP] Data objects for Spyglass  https://review.opendev.org/65891719:16
evgenylalexanderhughes: Agree, the scanning should be done on the entire image. I was thinking about the entire flow, when the issue is reported, who is going to analyze it and how are we going to fix the vulnerabilities? Analyzing the report is not trivial, and would require a core to go through the code and spend quite some time on that, we may not have enough resources on that. Fixing any vulnerability that scanner detects19:16
evgenylrequires to pull new base image or pip dependency, if it's not fixed in upstream, I don't think there is too much we can do. If we have a hard rule to unpin all dependencies and would have a periodic job to rebuild those we should be able to cover most of the problems except when somebody pins the package to a specific version, the latter we can enforce on review stage.19:16
evgenylweystrom: Many people report this problem, and it seems to be related to nfs-provisioner that we use for these demo/testing envs, for production use-cases we have Ceph. There is an ongoing work in OpenStack-Helm which allows to mount host directories directly, we are considering to use this instead of nfs based volumes. Can you provide a bit more details, where do you run Airship in a bottle?19:22
weystromright now i'm trying out airskif and it's way better than the bottle, at least the code looks fresher, i'm running it on a single ubuntu 16.04 baremetal host19:24
weystromi can try replacing nfs with hostpath and see if it spins up i guess19:24
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Update Pegleg base image to ubuntu xenial  https://review.opendev.org/66108819:37
alexanderhughesevgenyl: checked again with a bionic image, down to 65 vulnerabilities, 36 medium, 0 high vs xenial which had 135 vulnerabilities, 60 medium, 0 high19:39
alexanderhugheseither way we go whether we repackage or alert on vulnerability, at some point someone has to go look into it.  no magic cure here I think19:40
openstackgerritMerged airship/treasuremap master: Update Jenkinsfile's to use Ubuntu-based images  https://review.opendev.org/66044119:44
openstackgerritSreejith Punnapuzha proposed airship/in-a-bottle master: make bridge-nf configurations persistent  https://review.opendev.org/66208019:49
*** licanwei has quit IRC19:57
*** howell has quit IRC19:57
openstackgerritSreejith Punnapuzha proposed airship/in-a-bottle master: make bridge-nf configurations persistent  https://review.opendev.org/66208019:58
openstackgerritSreejith Punnapuzha proposed airship/in-a-bottle master: make bridge-nf configurations persistent  https://review.opendev.org/66208020:03
openstackgerritMichael Beaver proposed airship/shipyard master: Add unit tests and fix comments/samples  https://review.opendev.org/66185420:03
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Update Pegleg base image to ubuntu bionic  https://review.opendev.org/66108820:06
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Update Pegleg base image to ubuntu bionic  https://review.opendev.org/66108820:12
openstackgerritEvgeniy L proposed airship/treasuremap master: Uplift all components except Armada  https://review.opendev.org/66208520:15
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Update Pegleg base image to ubuntu bionic  https://review.opendev.org/66108820:16
*** weystrom has quit IRC20:17
openstackgerritSreejith Punnapuzha proposed airship/in-a-bottle master: make bridge-nf configurations persistent  https://review.opendev.org/66208020:35
openstackgerritSreejith Punnapuzha proposed airship/in-a-bottle master: make bridge-nf configurations persistent  https://review.opendev.org/66208020:36
*** weystrom has joined #airshipit20:43
openstackgerritEvgeniy L proposed airship/treasuremap master: Uplift MaaS to fix resource-import hanging  https://review.opendev.org/66209020:50
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Update Pegleg base image to ubuntu bionic  https://review.opendev.org/66108820:56
*** alexanderhughes has quit IRC21:02
openstackgerritIan Pittwood proposed airship/spyglass master: [WIP] Implements data object models  https://review.opendev.org/66209221:04
openstackgerritIan Pittwood proposed airship/spyglass-plugin-xls master: [WIP] Implements data objects in excel extractor  https://review.opendev.org/66209321:05
*** mbeierl has quit IRC21:22
openstackgerritIan Pittwood proposed airship/spyglass master: Data objects for Spyglass  https://review.opendev.org/65891721:25
*** sreejithp has quit IRC21:28
openstackgerritMerged airship/in-a-bottle master: make bridge-nf configurations persistent  https://review.opendev.org/66208021:31
*** mbeierl has joined #airshipit21:34
openstackgerritArijit Bose proposed airship/in-a-bottle master: [site update] update software  https://review.opendev.org/65519721:35
*** mbeierl has quit IRC21:39
*** mbeierl has joined #airshipit21:53
*** mbeierl has quit IRC21:57
openstackgerritAnthony Bellino proposed airship/promenade master: Add pod anti-affinity to apiserver-webhook  https://review.opendev.org/66210122:12
*** mbeierl has joined #airshipit22:13
*** ianychoi has quit IRC22:32
*** ianychoi has joined #airshipit22:33
*** mbeierl has quit IRC22:35
*** aaronsheffield has quit IRC22:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!