Friday, 2018-05-25

*** threestrands has joined #zuul00:05
*** threestrands has quit IRC00:05
*** threestrands has joined #zuul00:05
*** EmilienM is now known as EmilienM_PTO00:18
*** smyers has quit IRC00:49
*** harlowja has quit IRC01:05
*** smyers has joined #zuul01:10
*** swest has quit IRC01:56
*** swest has joined #zuul02:11
*** GonZo2000 has quit IRC02:13
*** rlandy|rvr|bbl is now known as rlandy|rover02:20
*** eikke has joined #zuul02:28
eikkeAre Zuul PyPI releases supposed not to have the static web content contained in the packages?02:28
*** pabelanger has left #zuul02:48
*** myoung is now known as myoung|off02:57
*** threestrands has quit IRC03:10
*** myoung|off is now known as myoung|zzz03:12
*** threestrands has joined #zuul03:13
*** threestrands has quit IRC03:13
*** threestrands has joined #zuul03:14
*** threestrands has quit IRC03:15
*** threestrands has joined #zuul03:15
*** threestrands has quit IRC03:15
*** threestrands has joined #zuul03:15
*** Guest60589 is now known as trishnag03:35
fungieikke: the sdist tarballs on pypi have a web subdir with static files04:05
fungithe wheels likely don't04:05
fungiconfirmed, only in the sdist, not wheel (since wheel files are just the python bits)04:09
*** harlowja has joined #zuul04:47
*** eumel8 has joined #zuul05:11
*** harlowja has quit IRC05:11
*** quiquell|off is now known as quiquell05:37
*** GonZo2000 has joined #zuul05:58
*** hashar has joined #zuul05:58
*** eumel8 has quit IRC06:30
*** GonZo2000 has quit IRC06:35
*** threestrands has quit IRC07:18
*** gtema has joined #zuul07:21
*** rlandy|rover has quit IRC07:22
eikkefungi: I don't see those files in the sdist either?07:23
eikkeShould be in zuul/web/static07:23
eikkethey are in an sdist I create locally, because Yarn is installed. But, when Yarn is not installed, the code happily lets an sdist to be built without those artifacts07:24
*** ssbarnea_ has joined #zuul07:50
*** jpena|off is now known as jpena07:53
ssbarneaam i the only one that got a  "ImportError: No module named pathlib" while trying to install zuul (3.0.3) from pip?08:50
gtemano, I have seen that yesterday trying to update my zuul in the venv. And the reason was that I was using sudo, which namely tried to install it into wrong location08:51
gtemaso source venv && pip install zuul --user solved the issue for me08:52
gtemaok, now when I try it again locally I have it again08:53
ssbarneaadded as https://storyboard.openstack.org/#!/story/200210408:53
*** pcaruana has joined #zuul08:54
gtemaah, found. With https://github.com/openstack-infra/zuul/commit/325829b69c2e63d939e7a87669348066371407db#diff-b4ef698db8ca845e5845c4618278f29a you see that yarl 1.1.1 is used for python<3.5.3. This version seems to have broken requirements (missing pythlib)08:57
*** electrofelix has joined #zuul08:57
gtemaso if you use python 3.6 - no problem, otherwise manually install pathlib08:57
*** pcaruana is now known as pcaruana|call|08:58
odyssey4meShrews ok, so the trouble we got into was that the provider was not at quota, but it could not fulfill the request because doing so would hit quota - but it had already grabbed the request, so that request stayed in that provider's pool... and more and more of them did that. So I had one provider hogging all the requests, but unable to fulfill them until there was quota available again. Meanwhile, I had another provider with08:58
odyssey4me quota available and nodes at a ready state doing nothing.08:58
openstackgerritSorin Sbarnea proposed openstack-infra/zuul master: Add missing pathlib dependency  https://review.openstack.org/57053909:02
*** Rohaan has joined #zuul09:03
openstackgerritSorin Sbarnea proposed openstack-infra/zuul master: Add missing pathlib dependency  https://review.openstack.org/57053909:06
ssbarneaalso related to https://review.openstack.org/570546 (my attempt to use reproduce, did not went very far, two critical bugs before it really started :))09:24
*** toabctl has joined #zuul10:06
ssbarneawhat happened with zuul-cloner? it seems that is no longer installed by pip install zuul.10:07
gtemassbarnea: https://github.com/openstack-infra/zuul/commit/fc120688f85c8a98a8c0322fd5cd1796fb9e491410:09
ssbarneagtema: i found zuul cloner used inside reproduce.sh, which means that the devstack-gate which uses it no longer works.10:10
ssbarneasee https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh10:11
ssbarneathere is code there calling zuul-cloner10:11
gtemait might be, that devstack was not updated, but zuul-cloner is removed from zuul itself10:11
ssbarneagtema: any hints on what it would be way to fix it?10:12
gtemassbarnea: nope, no idea.10:14
gtemaI guess simply remove any reference10:14
gtemamost likely even, since jobs are now themselves responsible for what cloner was doing10:15
gtemaaah, see what you mean10:15
gtema`zuul-cloner -m clonemap.yaml ...`10:16
gtemasince it is more or less just fetch me a repo - simple git clone should be sufficient10:21
gtemathere is anyway direct `git` usage later in the script10:22
*** persia has quit IRC10:32
*** persia has joined #zuul10:33
fungieikke: the sdist i retrieved from pypi and manually untarred contains zuul-3.0.3/web/util.js and so on. are those not the static web files you're looking for?11:21
fungigtema: ssbarnea: zuul v3 can be told to prepare a list of required projects for a job, which basically does the thing zuul-cloner used to do (remember zuul-cloner didn't just clone a got repo, it fetched and checked out specific refs zuul had prepared for testing). if you simply git clone then you'll break all your cross-repo dependencies and dependent pipelines11:23
fungidevstack-gate has been deprecated in favor of the ansible roles which are now included in the devstack repository11:23
fungi(that last point is technically a topic for #openstack-infra)11:34
*** jpena is now known as jpena|lunch11:37
*** D3VIATION has joined #zuul11:56
*** jpena|lunch is now known as jpena12:03
*** rlandy has joined #zuul12:39
*** rlandy is now known as rlandy|rover12:39
*** myoung|zzz is now known as myoung12:42
*** D3VIATION has quit IRC12:42
ssbarneafungi: thanks. a clear deprecation message would have saved me some time. https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/README.rst contains no hints.13:28
*** eumel8 has joined #zuul13:47
*** acozine1 has joined #zuul14:01
*** quiquell is now known as quiquell|off14:14
*** Rohaan has quit IRC14:16
*** electrofelix has quit IRC14:34
*** eumel8 has quit IRC14:55
*** eumel8 has joined #zuul15:00
*** eumel8 has quit IRC15:00
*** bhavik1 has joined #zuul15:13
*** bhavik1 has quit IRC15:18
Shrewscorvus: the static driver has an option called max-parallel-jobs (number of jobs that can run in parallel on a node). That can't possibly work, can it? Doesn't zuul run jobs in the 'work' dir of the ansible user dir? This seems like parallel jobs would conflict with each other15:19
gtemaI was also wondering about that. But isn't bubblewrap for that (naive question)?15:23
tobiashShrews: that depends entirely on how the base job is structured15:23
tobiashyou just need a base job that can handle it15:23
tobiashgtema: bubblewrap is used in the zuul-executor side15:24
Shrewstobiash: that's a pretty big assumption on the part of a driver15:24
Shrewsa driver should not be dependent on a base job, IMO15:25
tobiashShrews: it's the other way round, the base job currently assumes that it's alone on a node15:25
tobiashso I think the base job should be able to handle it15:26
tobiashthe driver doesn't assume anything, it just gives you several slots on a static node15:26
Shrewsbut you cannot use that feature of the driver UNLESS the base job is setup to handle it15:26
Shrewsso it is a feature dependent on the base job15:26
tobiashI think it's a limitation of the base job we should fix15:27
*** pcaruana|call| has quit IRC15:27
gtematobiash: I think even our current base job is not very well able to handle this, isn't it? How would two change on the same repo tested in parallel, if the sources are packed in the ~zuul/src/git15:28
Shrewswe can't fix everyone's base jobs15:29
tobiashShrews: in many cases static nodes are special and often need their own base jobs anyway so we could stick a big fat warning into the docs that state that when using that feature the job needs to be able to handle concurrent runs15:32
gtematobiash: big fat warning is definitely what is required. In case of my zuul installation I didn't need any special base job and assumed it somehow magically work (luckily no conflicts so far)15:34
tobiashgtema: most of the roles used by the base job use the zuul_workspace_dir (or similar) variable15:35
tobiashso it might almost be sufficient to encode the job uuid in there15:36
tobiashso the source is then located in ~zuul/<uuid>/src/git15:36
gtemaok, make sence15:37
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Support databases on other hosts during tests  https://review.openstack.org/56012716:30
*** jpena is now known as jpena|off16:30
*** acozine1 has quit IRC16:44
*** rlandy|rover is now known as rlandy|rover|brb17:02
*** gtema has quit IRC17:23
*** gtema has joined #zuul17:31
*** rlandy|rover|brb is now known as rlandy|rover17:34
*** pcaruana has joined #zuul17:35
*** myoung is now known as myoung||bbl17:45
*** pcaruana has quit IRC18:14
*** acozine1 has joined #zuul18:42
*** D3VIATION has joined #zuul18:57
*** acozine1 has quit IRC19:05
*** myoung||bbl is now known as myoung19:09
eikkefungi: no. Those are the source files for the actual static HTML etc (e.g. tenants.html), which zuul-web expects to be in site-packages/zuul/web/static etc19:28
*** gtema has quit IRC19:45
*** myoung is now known as myoung|bbl19:57
*** harlowja has joined #zuul20:16
*** yolanda has quit IRC20:34
*** GonZo2000 has joined #zuul20:42
*** GonZo2000 has joined #zuul20:42
*** GonZo2000 has quit IRC20:48
*** GonZo2000 has joined #zuul20:53
*** GonZo2000 has quit IRC20:58
*** GonZo2000 has joined #zuul21:10
*** GonZo2000_ has joined #zuul21:25
*** GonZo2000 has quit IRC21:28
*** harlowja has quit IRC22:02
tobiashmordred: I think this is a question for you ^22:04
tobiashshould the wheel contain the built html or is it expected that this runs during pip install?22:05
*** D3VIATION has quit IRC22:08
*** GonZo2000_ has quit IRC22:23
tobiashmordred, corvus: just noticed a test failure because of a connection issue to npmjs.org: http://paste.openstack.org/show/722001/22:33
tobiashdo we need to mirror this?22:33
*** GonZo2000_ has joined #zuul22:44
*** hashar has quit IRC22:45
*** myoung|bbl is now known as myoung22:56
*** eumel8 has joined #zuul23:49
*** rlandy|rover has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!