Wednesday, 2018-07-25

*** ispp has joined #openstack-loci07:09
*** ispp has quit IRC07:21
*** ispp has joined #openstack-loci07:47
openstackgerritIago Santos proposed openstack/loci master: Add Octavia stable/queens branch image to Loci  https://review.openstack.org/58427908:34
*** pbourke has quit IRC08:37
*** pbourke has joined #openstack-loci08:39
*** openstackgerrit has quit IRC08:48
*** ispp has quit IRC09:11
*** ispp has joined #openstack-loci09:19
*** e0ne has joined #openstack-loci09:48
*** e0ne has quit IRC09:57
*** e0ne has joined #openstack-loci10:00
*** ispp has quit IRC10:01
*** e0ne has quit IRC10:17
*** e0ne has joined #openstack-loci10:17
*** e0ne has quit IRC10:17
*** e0ne has joined #openstack-loci10:18
*** e0ne has quit IRC10:19
*** e0ne has joined #openstack-loci10:25
*** e0ne has quit IRC10:29
*** e0ne has joined #openstack-loci10:33
*** e0ne has quit IRC10:36
*** e0ne has joined #openstack-loci10:43
*** e0ne has quit IRC10:44
*** ispp has joined #openstack-loci10:49
*** e0ne has joined #openstack-loci10:49
*** e0ne has quit IRC10:50
*** e0ne has joined #openstack-loci10:52
*** e0ne has quit IRC10:52
*** openstackgerrit has joined #openstack-loci10:53
openstackgerritPaul Bourke (pbourke) proposed openstack/loci master: Add a profile for kolla keystone  https://review.openstack.org/58325510:53
openstackgerritPaul Bourke (pbourke) proposed openstack/loci master: [WIP] Add a profile for kolla core services  https://review.openstack.org/58325510:59
hrwadded building of loci to Linaro CI :D11:12
openstackgerritIago Santos proposed openstack/loci master: Add Octavia stable/queens branch image to Loci  https://review.openstack.org/58427911:43
openstackgerritIago Santos proposed openstack/loci master: Add Octavia stable/queens branch image to Loci  https://review.openstack.org/58427911:46
hrwSamYaple: how often gates rebuild images? and do they rebuild all of them or is requirements one rebuilt less often?11:50
*** ispp has quit IRC11:54
*** ispp has joined #openstack-loci11:57
hrwSamYaple: requirements image collects all wheels and then drops all 'noarch' ones. Then every image fetches those 'noarch' wheels again.12:03
hrwSamYaple: will it be faster to fetch all in requirements phase, keep and then build rest of images with requirements image working as a cache?12:04
hrwI know that on gates it does not matter much as there is a cache at infra anyway12:04
*** e0ne has joined #openstack-loci12:06
pbourkehrw: gates build on every review12:53
hrwok12:54
hrwnumpy/scipy suxx12:54
hrwlooks like scikit-learn and scipy are not used in cinder glance keystone ironic horizon heat nova neutron octavia images13:02
hrwscipy takes 40 minutes on our CI builder13:02
hrwand we build it twice13:03
isppIs there any possibility to test CI builder locally instead of push anything and wait for the CI to run?13:06
pbourkehrw: all images should use the wheels from requirements but it's been a while since I've looked at the exact way it works13:06
hrwCollecting scipy===1.1.0 (from -c /upper-constraints.txt (line 98))13:08
hrw  Downloading https://files.pythonhosted.org/packages/2a/f3/de9c1bd16311982711209edaa8c6caa962db30ebb6a8cc6f1dcd2d3ef616/scipy-1.1.0-cp27-cp27mu-manylinux1_x86_64.whl (30.8MB)13:08
hrwx86 is spoiled arch13:09
hrwsimilar with numpy13:10
hrwthat way I see why rebuilding all iamges is cheap ;d13:14
openstackgerritIago Santos proposed openstack/loci master: Add Octavia stable/queens branch image to Loci  https://review.openstack.org/58427913:16
hrwadded scipy and scikit-learn to ignore list. will see how it will improve13:22
hrwwas 104 minutes before13:22
openstackgerritJean-Philippe Evrard proposed openstack/loci master: Clarify build requirements  https://review.openstack.org/58575113:49
hrw51 minutes if scipy/scikit-learn are dropped14:16
hrwhttps://pastebin.com/a4n5Up81 is whole patch14:36
hrwpbourke SamYaple ^^14:36
pbourkehrw: what are these packages needed for I wonder?14:37
hrwpbourke: none of loci images14:37
hrwpbourke: requirements repo lists all modules used by any project14:38
hrwand openstack has many of them...14:38
pbourkeyou could do a blame on requirements maybe and see who added it14:38
hrwwill do14:39
pbourkesounds like a good improvement though :)14:39
hrw    Add scipy, scientific tools for python.14:40
hrw14:40
hrw    This dependency is required by openstack/monasca_analytics.14:40
hrwsame for scikit-learn14:40
hrwwill create nice patch14:41
SamYaplehrw: the 'working cache' won't work but maybe not for the reason you think14:43
hrwSamYaple: ok14:43
SamYaplethe pip tool itself has no way to check if it is pulling source or a whl, much less a way to abort if its pulling a 'noarch' whl14:43
SamYaplei had a patch previously to prune down to just the compiled whls, but we have since reverted it14:44
SamYaplehrw: `--build-arg WHEELS=http://some.site/wheels.tar.gz` works you know14:44
SamYapleyou don't have to use the requiremetns image, just have all built wheels in that tarball14:45
hrwSamYaple: I build base, requirements and then images14:45
hrwSamYaple: requirements image is kind of tarball too14:45
SamYapleyep, thats the normal pattern. im just saying, the WHEELS part is super flexible for different workflows14:45
hrwyep14:47
hrwok. started build without scipy/scikit-learn and without blas/lapack headers.14:48
hrwas I do not remember were they needed for numpy or not ;D14:48
SamYaple:)14:59
openstackgerritMarcin Juszkiewicz proposed openstack/loci master: requirements: drop package install phase  https://review.openstack.org/58540815:24
openstackgerritMarcin Juszkiewicz proposed openstack/loci master: bindep: install blas and lapack headers to build numpy on aarch64  https://review.openstack.org/58372615:24
openstackgerritMarcin Juszkiewicz proposed openstack/loci master: requirements.sh: ignore scipy and scikit-learn  https://review.openstack.org/58372715:24
hrw1st one same, 2nd got commit message changed, 3rd rewritten15:24
*** ispp has quit IRC15:53
openstackgerritPaul Bourke (pbourke) proposed openstack/loci master: [WIP] Add a profile for kolla core services  https://review.openstack.org/58325516:22
*** e0ne has quit IRC16:41
evrardjphrw: I commented on your ignore scipy patch16:52
evrardjpcould you add a little comment in the code, that would be more than welcomed :)16:53
evrardjphrw: (I meant the 3rd)16:53
openstackgerritMerged openstack/loci master: Clarify build requirements  https://review.openstack.org/58575117:18
*** e0ne has joined #openstack-loci17:57
*** e0ne has quit IRC18:20
*** e0ne has joined #openstack-loci18:43
*** e0ne has quit IRC18:50
*** e0ne has joined #openstack-loci19:07
openstackgerritMarcin Juszkiewicz proposed openstack/loci master: requirements.sh: ignore scipy and scikit-learn  https://review.openstack.org/58372719:15
hrwevrardjp: done19:15
*** e0ne has quit IRC20:51
*** e0ne has joined #openstack-loci20:53
*** e0ne has quit IRC20:58
*** openstackgerrit has quit IRC21:04

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!