*** ispp has joined #openstack-loci | 07:09 | |
*** ispp has quit IRC | 07:21 | |
*** ispp has joined #openstack-loci | 07:47 | |
openstackgerrit | Iago Santos proposed openstack/loci master: Add Octavia stable/queens branch image to Loci https://review.openstack.org/584279 | 08:34 |
---|---|---|
*** pbourke has quit IRC | 08:37 | |
*** pbourke has joined #openstack-loci | 08:39 | |
*** openstackgerrit has quit IRC | 08:48 | |
*** ispp has quit IRC | 09:11 | |
*** ispp has joined #openstack-loci | 09:19 | |
*** e0ne has joined #openstack-loci | 09:48 | |
*** e0ne has quit IRC | 09:57 | |
*** e0ne has joined #openstack-loci | 10:00 | |
*** ispp has quit IRC | 10:01 | |
*** e0ne has quit IRC | 10:17 | |
*** e0ne has joined #openstack-loci | 10:17 | |
*** e0ne has quit IRC | 10:17 | |
*** e0ne has joined #openstack-loci | 10:18 | |
*** e0ne has quit IRC | 10:19 | |
*** e0ne has joined #openstack-loci | 10:25 | |
*** e0ne has quit IRC | 10:29 | |
*** e0ne has joined #openstack-loci | 10:33 | |
*** e0ne has quit IRC | 10:36 | |
*** e0ne has joined #openstack-loci | 10:43 | |
*** e0ne has quit IRC | 10:44 | |
*** ispp has joined #openstack-loci | 10:49 | |
*** e0ne has joined #openstack-loci | 10:49 | |
*** e0ne has quit IRC | 10:50 | |
*** e0ne has joined #openstack-loci | 10:52 | |
*** e0ne has quit IRC | 10:52 | |
*** openstackgerrit has joined #openstack-loci | 10:53 | |
openstackgerrit | Paul Bourke (pbourke) proposed openstack/loci master: Add a profile for kolla keystone https://review.openstack.org/583255 | 10:53 |
openstackgerrit | Paul Bourke (pbourke) proposed openstack/loci master: [WIP] Add a profile for kolla core services https://review.openstack.org/583255 | 10:59 |
hrw | added building of loci to Linaro CI :D | 11:12 |
openstackgerrit | Iago Santos proposed openstack/loci master: Add Octavia stable/queens branch image to Loci https://review.openstack.org/584279 | 11:43 |
openstackgerrit | Iago Santos proposed openstack/loci master: Add Octavia stable/queens branch image to Loci https://review.openstack.org/584279 | 11:46 |
hrw | SamYaple: how often gates rebuild images? and do they rebuild all of them or is requirements one rebuilt less often? | 11:50 |
*** ispp has quit IRC | 11:54 | |
*** ispp has joined #openstack-loci | 11:57 | |
hrw | SamYaple: requirements image collects all wheels and then drops all 'noarch' ones. Then every image fetches those 'noarch' wheels again. | 12:03 |
hrw | SamYaple: will it be faster to fetch all in requirements phase, keep and then build rest of images with requirements image working as a cache? | 12:04 |
hrw | I know that on gates it does not matter much as there is a cache at infra anyway | 12:04 |
*** e0ne has joined #openstack-loci | 12:06 | |
pbourke | hrw: gates build on every review | 12:53 |
hrw | ok | 12:54 |
hrw | numpy/scipy suxx | 12:54 |
hrw | looks like scikit-learn and scipy are not used in cinder glance keystone ironic horizon heat nova neutron octavia images | 13:02 |
hrw | scipy takes 40 minutes on our CI builder | 13:02 |
hrw | and we build it twice | 13:03 |
ispp | Is there any possibility to test CI builder locally instead of push anything and wait for the CI to run? | 13:06 |
pbourke | hrw: all images should use the wheels from requirements but it's been a while since I've looked at the exact way it works | 13:06 |
hrw | Collecting scipy===1.1.0 (from -c /upper-constraints.txt (line 98)) | 13:08 |
hrw | Downloading https://files.pythonhosted.org/packages/2a/f3/de9c1bd16311982711209edaa8c6caa962db30ebb6a8cc6f1dcd2d3ef616/scipy-1.1.0-cp27-cp27mu-manylinux1_x86_64.whl (30.8MB) | 13:08 |
hrw | x86 is spoiled arch | 13:09 |
hrw | similar with numpy | 13:10 |
hrw | that way I see why rebuilding all iamges is cheap ;d | 13:14 |
openstackgerrit | Iago Santos proposed openstack/loci master: Add Octavia stable/queens branch image to Loci https://review.openstack.org/584279 | 13:16 |
hrw | added scipy and scikit-learn to ignore list. will see how it will improve | 13:22 |
hrw | was 104 minutes before | 13:22 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/loci master: Clarify build requirements https://review.openstack.org/585751 | 13:49 |
hrw | 51 minutes if scipy/scikit-learn are dropped | 14:16 |
hrw | https://pastebin.com/a4n5Up81 is whole patch | 14:36 |
hrw | pbourke SamYaple ^^ | 14:36 |
pbourke | hrw: what are these packages needed for I wonder? | 14:37 |
hrw | pbourke: none of loci images | 14:37 |
hrw | pbourke: requirements repo lists all modules used by any project | 14:38 |
hrw | and openstack has many of them... | 14:38 |
pbourke | you could do a blame on requirements maybe and see who added it | 14:38 |
hrw | will do | 14:39 |
pbourke | sounds like a good improvement though :) | 14:39 |
hrw | Add scipy, scientific tools for python. | 14:40 |
hrw | 14:40 | |
hrw | This dependency is required by openstack/monasca_analytics. | 14:40 |
hrw | same for scikit-learn | 14:40 |
hrw | will create nice patch | 14:41 |
SamYaple | hrw: the 'working cache' won't work but maybe not for the reason you think | 14:43 |
hrw | SamYaple: ok | 14:43 |
SamYaple | the pip tool itself has no way to check if it is pulling source or a whl, much less a way to abort if its pulling a 'noarch' whl | 14:43 |
SamYaple | i had a patch previously to prune down to just the compiled whls, but we have since reverted it | 14:44 |
SamYaple | hrw: `--build-arg WHEELS=http://some.site/wheels.tar.gz` works you know | 14:44 |
SamYaple | you don't have to use the requiremetns image, just have all built wheels in that tarball | 14:45 |
hrw | SamYaple: I build base, requirements and then images | 14:45 |
hrw | SamYaple: requirements image is kind of tarball too | 14:45 |
SamYaple | yep, thats the normal pattern. im just saying, the WHEELS part is super flexible for different workflows | 14:45 |
hrw | yep | 14:47 |
hrw | ok. started build without scipy/scikit-learn and without blas/lapack headers. | 14:48 |
hrw | as I do not remember were they needed for numpy or not ;D | 14:48 |
SamYaple | :) | 14:59 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/loci master: requirements: drop package install phase https://review.openstack.org/585408 | 15:24 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/loci master: bindep: install blas and lapack headers to build numpy on aarch64 https://review.openstack.org/583726 | 15:24 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/loci master: requirements.sh: ignore scipy and scikit-learn https://review.openstack.org/583727 | 15:24 |
hrw | 1st one same, 2nd got commit message changed, 3rd rewritten | 15:24 |
*** ispp has quit IRC | 15:53 | |
openstackgerrit | Paul Bourke (pbourke) proposed openstack/loci master: [WIP] Add a profile for kolla core services https://review.openstack.org/583255 | 16:22 |
*** e0ne has quit IRC | 16:41 | |
evrardjp | hrw: I commented on your ignore scipy patch | 16:52 |
evrardjp | could you add a little comment in the code, that would be more than welcomed :) | 16:53 |
evrardjp | hrw: (I meant the 3rd) | 16:53 |
openstackgerrit | Merged openstack/loci master: Clarify build requirements https://review.openstack.org/585751 | 17:18 |
*** e0ne has joined #openstack-loci | 17:57 | |
*** e0ne has quit IRC | 18:20 | |
*** e0ne has joined #openstack-loci | 18:43 | |
*** e0ne has quit IRC | 18:50 | |
*** e0ne has joined #openstack-loci | 19:07 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/loci master: requirements.sh: ignore scipy and scikit-learn https://review.openstack.org/583727 | 19:15 |
hrw | evrardjp: done | 19:15 |
*** e0ne has quit IRC | 20:51 | |
*** e0ne has joined #openstack-loci | 20:53 | |
*** e0ne has quit IRC | 20:58 | |
*** openstackgerrit has quit IRC | 21:04 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!