Friday, 2019-10-18

*** armstrongs has joined #zuul00:55
*** saneax has quit IRC01:00
*** armstrongs has quit IRC01:04
*** igordc has quit IRC01:25
*** rlandy has quit IRC01:29
*** swest has quit IRC02:01
*** jamesmcarthur has quit IRC02:03
*** swest has joined #zuul02:16
*** jamesmcarthur has joined #zuul02:43
*** jamesmcarthur has quit IRC02:51
*** bhavikdbavishi has joined #zuul02:55
*** bhavikdbavishi1 has joined #zuul02:58
*** bhavikdbavishi has quit IRC03:00
*** bhavikdbavishi1 is now known as bhavikdbavishi03:00
*** jamesmcarthur has joined #zuul03:09
*** jangutter has joined #zuul03:22
*** jangutter has quit IRC03:26
*** jamesmcarthur has quit IRC03:28
*** jamesmcarthur has joined #zuul03:29
*** jamesmcarthur has quit IRC03:34
*** jamesmcarthur has joined #zuul03:59
*** jamesmcarthur has quit IRC04:06
*** swest has quit IRC04:20
*** igordc has joined #zuul04:35
*** igordc has quit IRC04:35
*** igordc has joined #zuul04:35
*** jamesmcarthur has joined #zuul05:03
*** igordc has quit IRC05:05
*** jamesmcarthur has quit IRC05:07
*** swest has joined #zuul05:08
*** jamesmcarthur has joined #zuul05:42
*** jamesmcarthur has quit IRC05:47
*** jamesmcarthur has joined #zuul06:43
*** jamesmcarthur has quit IRC06:48
*** jamesmcarthur has joined #zuul07:21
*** hashar has joined #zuul07:24
*** jamesmcarthur has quit IRC07:26
*** pcaruana has joined #zuul07:26
*** tosky has joined #zuul07:33
*** jamesmcarthur has joined #zuul07:37
*** jamesmcarthur has quit IRC07:41
*** jpena|off is now known as jpena07:42
*** saneax has joined #zuul07:47
*** jangutter has joined #zuul07:54
*** jangutter_ has joined #zuul07:54
*** jangutter has quit IRC07:58
*** jamesmcarthur has joined #zuul08:09
*** dmsimard has quit IRC08:14
*** dmsimard1 has joined #zuul08:14
*** jamesmcarthur has quit IRC08:45
*** bhavikdbavishi has quit IRC08:50
*** gtema_ has joined #zuul08:52
*** gtema_ has quit IRC08:58
openstackgerritFabien Boucher proposed zuul/zuul master: Add reference pipelines file for Github driver  https://review.opendev.org/67271209:26
*** jamesmcarthur has joined #zuul09:41
*** jamesmcarthur has quit IRC09:46
openstackgerritFabien Boucher proposed zuul/zuul master: Pagure - Support for branch creation/deletion  https://review.opendev.org/68511609:47
openstackgerritFabien Boucher proposed zuul/zuul master: Pagure - add the enqueue_ref unit test  https://review.opendev.org/68735109:58
openstackgerritFabien Boucher proposed zuul/zuul master: Keep tenant_last_reconfigured float precision (time.sleep removal)  https://review.opendev.org/68939410:03
*** fdegir has quit IRC10:16
*** fdegir has joined #zuul10:17
*** hashar has quit IRC10:22
*** jpena is now known as jpena|lunch11:03
*** jamesmcarthur has joined #zuul11:04
*** themroc has joined #zuul11:21
*** themroc has quit IRC11:22
*** bhavikdbavishi has joined #zuul11:47
openstackgerritFabien Boucher proposed zuul/zuul master: Keep tenant_last_reconfigured float precision (time.sleep removal)  https://review.opendev.org/68939411:53
*** hashar has joined #zuul11:55
*** jpena|lunch is now known as jpena11:58
*** rfolco|ruck has joined #zuul12:04
*** jamesmcarthur has quit IRC12:09
*** rlandy has joined #zuul12:16
*** jamesmcarthur has joined #zuul12:27
*** jamesmcarthur has quit IRC12:40
*** jamesmcarthur has joined #zuul12:45
*** jangutter_ is now known as jangutter13:13
*** jamesmcarthur has quit IRC13:18
openstackgerritMerged zuul/nodepool master: Pull minikube log data  https://review.opendev.org/68877513:30
openstackgerritMerged zuul/nodepool master: Remove unused k8s log config  https://review.opendev.org/68896113:30
openstackgerritDavid Shrewsbury proposed zuul/nodepool master: Remove unused nodepool-functional-py35-src  https://review.opendev.org/68945713:41
*** jamesmcarthur has joined #zuul13:52
*** pcaruana has quit IRC13:53
openstackgerritDavid Shrewsbury proposed zuul/nodepool master: Remove unused functional testing playbooks  https://review.opendev.org/68945713:54
*** jamesmcarthur has quit IRC13:56
*** Goneri has joined #zuul13:57
openstackgerritDavid Shrewsbury proposed zuul/nodepool master: WIP: Take advantage of fetch-output  https://review.opendev.org/68947314:07
openstackgerritMichal Pryc proposed zuul/nodepool master: Implement a Devnest nodepool driver  https://review.opendev.org/68947414:09
openstackgerritMichal Pryc proposed zuul/nodepool master: Implement a Devnest nodepool driver  https://review.opendev.org/68947414:11
*** jangutter has quit IRC14:19
openstackgerritDavid Shrewsbury proposed zuul/nodepool master: Cleanup openshift pre.yaml playbook  https://review.opendev.org/68947914:25
tristanCShrews: this devnest driver is something that can let nodepool steal jenkins node ^14:25
*** bhavikdbavishi has quit IRC14:26
*** sgw has quit IRC14:26
ShrewstristanC: yeah, i was looking at that14:26
Shrewscan it smack jenkins in the face as it does so?   >:)14:26
* fungi pictured the fish-slapping dance from mpfc14:29
Shrewsfungi: that is the proper imagery14:31
fungithe commit message seems to confuse "node" and "executor" terminology14:33
openstackgerritDavid Shrewsbury proposed zuul/nodepool master: Take advantage of fetch-output  https://review.opendev.org/68947314:42
corvustristanC, Shrews: i did a quick initial review14:43
openstackgerritJames E. Blair proposed zuul/zuul-registry master: Disable namespacing  https://review.opendev.org/68921914:46
*** jamesmcarthur has joined #zuul14:53
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Use zuul-registry as buildset registry  https://review.opendev.org/68923814:53
*** jamesmcarthur has quit IRC14:58
ShrewstristanC: fyi, another k8s failure on ovh: https://zuul.opendev.org/t/zuul/build/5142c4927c404151a04d2bd6da36cdd6/log/minikube.txt15:03
Shrewsthat has as much logging from minikube that i know how to extract15:04
* Shrews has to change work venues. biab15:04
*** Goneri has quit IRC15:16
tristanCShrews: is it already using the debug options? There should be more occurence of the nodepool pod id (000001)15:20
ShrewstristanC: that's with https://review.opendev.org/689021 merged15:21
*** mattw4 has joined #zuul15:25
*** bhavikdbavishi has joined #zuul15:26
*** jamesmcarthur has joined #zuul15:27
tristanCShrews: that's odd, kubelet should be much more verbose with --v=715:28
*** mattw4 has quit IRC15:29
*** Goneri has joined #zuul15:31
tristanCShrews: on a local setup, switching services to --v=7 and creating a single pod resulted in 30k log lines, (including all the detail of the pod creation state)15:32
*** mattymo has joined #zuul15:32
*** igordc has joined #zuul15:32
tristanCperhaps the "/tmp/minikube logs" command also needs a special cli argument? I was looking for adding --no-trunc to the docker ps (to get the argv of the services)15:38
mattymoIf I run nodeimage-builder inside a container and want to use DIB_YUM_REPO_CONF, that means my yum conf has to be mounted inside the container, right? It's too bad I can't just list repo URLs to add15:45
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Use zuul-registry as buildset registry  https://review.opendev.org/68923815:47
corvusShrews: should we cut a nodepool release today?15:58
*** panda has quit IRC16:01
Shrewscorvus: i believe so. i've seen no complaints, and nothing of note in the launcher logs16:01
corvusShrews: 3.9.0 ?16:02
Shrewsyes, i think the python-path dependency on zuul warrants at least that16:03
corvusand cec796eaf2419b8741d2ca10720601485a5d5750 ?16:03
tobiashlgtm16:03
Shrewsyep16:03
*** panda has joined #zuul16:03
corvuscool, i'll get that going now16:03
corvusfungi, clarkb: does this just like bad internet luck to you?  https://zuul.opendev.org/t/zuul/build/5b4196ae553a4fd6b8ff009889fc66e3/console16:07
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Use zuul-registry as buildset registry  https://review.opendev.org/68923816:07
*** rlandy is now known as rlandy|brb16:20
corvusthe pypi.org website seems to be picking languages for me at random... today it's french.16:21
mhubienvenue sur PyPI ?16:22
corvusoui, it suggests i should "explorez les projets"16:24
corvusas a self-confessed (near-)monolingual, i think it's totally fair to throw random languages at me, i deserve it :)16:25
corvushow else am i going to learn?16:25
webknjazhttps://github.com/pypa/warehouse/issues/683416:26
corvusi think pypi has my best interests in mind and merely wants to make me a better world citizen.  bravo!16:26
corvuswebknjaz: aha! that explains it.  cookieless is indeed how i'm browsing :)16:28
mhubesides french language support obviously, is there a list of planned future features or roadmap I can quote for the OSS presentation? The one I have from old slides is old16:30
mhufrom https://storyboard.openstack.org/#!/project/679 I get: gitlab driver, hashicorp vault implementation ... anything else worth mentioning?16:31
corvusmhu: the specs here: https://zuul-ci.org/docs/zuul/developer/specs/index.html16:31
mhuthx16:32
corvusShrews, ianw: nodepool release complete16:35
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Make the buildset registry port configurable  https://review.opendev.org/68924016:36
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Test buildset registry with k8s and docker  https://review.opendev.org/68928016:36
*** igordc has quit IRC16:40
*** mattw4 has joined #zuul16:42
*** jpena is now known as jpena|off16:45
*** michael-beaver has joined #zuul16:49
fungicorvus: "gpg: keyserver receive failed: No dirmngr" looks to me like the dirmngr daemon gpg2 relies on failed to get started/forked16:58
corvusoh, hrm... /me googles that16:58
corvusokay that's weird, i have no idea why that would fail16:59
*** hashar has quit IRC17:00
fungimhu: also bitbucket support in zuul and azure support in nodepool seem to be in the works, no idea if those are reflected in specs17:01
ofososHey, I've my jobs failing at "Running Ansible setup...", so very early. What could this be?17:02
corvusofosos: best check the executor logs for that17:02
ofososThe nodes are online, the only thing I see is an ARA error in the executor log17:02
ofososI get "The module failed to execute correctly, you probably need to set the interpreter.\\nSee stdout/stderr for the exact error"17:03
ofosos"packages/ara/plugins/actions/ara_record' has no attribute 'CallbackModule'"17:03
corvusdmsimard1: ^ does that mean anything to you?17:04
ofososAlso: Ansible output: b'/var/lib/zuul/builds/88985276cf264a298f8525b8a762504f/ansible/setup-inventory.yaml did not meet script requirements, check plugin documentation if this is unexpected17:04
ofososAnd: Ansible output: b'/var/lib/zuul/builds/88985276cf264a298f8525b8a762504f/ansible/setup-inventory.yaml did not meet host_list requirements, check plugin documentation if this is unexpected17:04
ofososBut I think these were present before17:05
*** tosky has quit IRC17:08
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Use zuul-registry as buildset registry  https://review.opendev.org/68923817:08
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Make the buildset registry port configurable  https://review.opendev.org/68924017:08
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Test buildset registry with k8s and docker  https://review.opendev.org/68928017:08
corvusofosos: maybe check the ara installation and version?17:11
ofososIs ARA installed by default?17:11
mnaserso in a new private tab, searching for "zuul docs" shows the zuul docs before anything :)17:11
ofososcorvus: We didn't change anything, it started to break friday evening.17:12
ofososSo ARA seems to be 0.16.517:13
mnasermhu: im progressing on top of your patch that you started working on oidc :)17:14
mnaseri am likely going to split it into two, one that just allows auth into the dashboard, then one that adds the admin level features17:14
ofososI also get this as stdout of the first module: Warning: Permanently added the ED25519 host key for IP address \'10.168.208.93\' to the list of known hosts.\\r\\n/bin/sh: 1: auto: not found\\n17:19
mnaserofosos: i bet i know what happened17:21
mnaserdidnt someone recently push a change about changing python version to 'auto' ?17:21
mnaserthere is a playbook somewhere that is taking that value literally17:21
mnaserwhen it tries to detect if python exists or not17:22
ofososSo, how do we fix it? I'd just like to run my build :)17:22
mnaserofosos: have you upgraded nodepool by any chance?17:23
ofososNot at all, we're running  some containers with a multiple months old version of zuul master17:23
mnaserhttps://zuul-ci.org/docs/nodepool/releasenotes.html17:23
mnaser"This release should only be run against Zuul 3.11.1 or greater. Earlier Zuul releases will not convert the new default python-path of auto to /usr/bin/python2 for Ansible <2.8, leading to a configuration error. It may be possible to use earlier Zuul releases if you you are only using Ansible >= 2.8, or explicitly set python-path for every image."17:23
mnasercan you double check your nodepool by any chance?17:24
mnaserwait, that's not even released yet, or is it17:24
mnaseryes thats in nodepool 3.9.017:24
tobiashit is17:24
ofososNodepool version: 3.8.1.dev4917:25
mnaserpretty sure you're probably running that commit then17:25
mnasereither bump up your zuul or bring your nodepool back, but you've definetly been.. continiously delivering nodepool without knowing :)17:26
mnasernodepool 3.8.1.dev40 was the version that made that change based on pbr17:27
mnaserso yep, that's your issue, either bring back nodepool or bump up zuul17:27
*** rlandy|brb is now known as rlandy17:32
*** saneax has quit IRC17:34
*** saneax has joined #zuul17:35
fungizuul 3.11.1 for workgroups ;)17:37
*** jamesmcarthur has quit IRC17:44
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Use zuul-registry as buildset registry  https://review.opendev.org/68923817:52
mnaserthis auth stuff is proving a little more difficult than i thought because we have multiple authenticators17:53
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Make the buildset registry port configurable  https://review.opendev.org/68924017:53
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Test buildset registry with k8s and docker  https://review.opendev.org/68928017:54
*** tosky has joined #zuul18:00
*** noorul has joined #zuul18:00
noorulofosos: hi18:00
noorulofosos: Any update on merging the PR?18:00
openstackgerritMohammed Naser proposed zuul/zuul master: Zuul Web: add /api/user/authorizations endpoint  https://review.opendev.org/64109918:01
openstackgerritMohammed Naser proposed zuul/zuul master: [WIP] admin REST API: zuul-web integration  https://review.opendev.org/64353618:01
openstackgerritMohammed Naser proposed zuul/zuul master: Add API endpoint to get authenticators  https://review.opendev.org/68956018:01
openstackgerritDavid Shrewsbury proposed zuul/nodepool master: Take advantage of fetch-output  https://review.opendev.org/68947318:08
openstackgerritDavid Shrewsbury proposed zuul/nodepool master: Take advantage of fetch-output  https://review.opendev.org/68947318:10
*** hashar has joined #zuul18:11
mnaserhmm, whats the best way to get myself a little zuul to hack against?  it looks like quickstart seems to pull images?18:11
noorulmnaser: From scratch guide18:14
noorulmnaser: Make changes locally and then run pip install -U .18:15
corvusmnaser: generally if i want to hack on zuul, i write unit tests.  in the rare event i need to interact with a remote system (which isn't yet faked in tests), i just run the component in a virtualenv.18:16
corvusmnaser: (but i pretty much only do that to verify behavior that i then put in the unit tests)18:16
mnasercorvus: gotcha, as im trying to play with behaviour interaction of web + dashboard18:16
*** shanemcd has quit IRC18:17
mnaserso needing "newer" api endpoints exposed is a bit of the thing im dealing with18:17
*** igordc has joined #zuul18:17
corvusmnaser: ah, then, yeah, you'll need a mysql db too.  in that case, i might use quick-start to get everything running, update docker to expose the mysql port to the host, then run zuul-web out of a venv.18:17
corvusmnaser: (and of course, running the dashboard out of a checkout has its own instructions i think you're familiar with)18:18
mnaseryeah that's actaully a good idea, because the rest of the components are still ok18:19
mnaserbut docs seem to say that i can fake api responses now instaed of talking to openstack's zuul18:19
*** shanemcd has joined #zuul18:19
mnaserso i might do that18:19
corvussounds promising, but i haven't tried it18:20
mnaserworked perfectly18:27
corvusShrews: some feedback about the new autohold stuff (which is great!): 1) makeing the "--id" argument positional might be more intuitive.  2) would be helpful to record the build which triggered each held nodeset.  3) also -- this is speculation -- based on what it looks like when i hold a single copy of a multinode job, we may need to record that data a little differently (so if you hold 2 counts of a 3 node18:27
corvusjob, you don't just end up with a list of 6 nodes)18:27
*** saneax has quit IRC18:28
Shrewscorvus: agree on all points. i think tristanC had started some of those improvements in https://review.opendev.org/68246618:29
corvusShrews: indeed!18:29
*** noorul has quit IRC18:30
corvusleft a quick comment on that about adding uuid18:31
openstackgerritTristan Cacqueray proposed zuul/zuul master: Store a list of held node per held build in hold request  https://review.opendev.org/68246618:31
openstackgerritDavid Shrewsbury proposed zuul/nodepool master: Take advantage of fetch-output  https://review.opendev.org/68947318:32
corvustristanC, Shrews: also, i find that a lot of our debugging these days is provider related -- maybe we should add that as an autohold selection criterion18:34
openstackgerritTristan Cacqueray proposed zuul/zuul master: Store a list of held node per held build in hold request  https://review.opendev.org/68246618:37
mordredcorvus: ++18:38
Shrewscorvus: got an example of where/how that might be used? if a job is failing because of something on the provider, i don't see the need to specify it18:38
Shrewsunless it's failing across all providers and you want to narrow in on only one of them. but i've never seen a use case for that18:40
fungii agree most of the time the workflow there has been to set the autohold for a known-working change and then recheck it until it hits the problematic provider and fails. but i can see wanting the upper-hand on statistics if you need to broaden the autohold to all changes (so are fighting against some which are simply bad patches) or dealing with an infrequent nondeterminstic failure on one provider which isn't18:42
fungistatistically more likely than general nondeterministic failures for the job in question18:42
corvusShrews: it's probably too narrow of a use-case... i'm juggling about 3 failures right now, and the only ones i want to hold are in one provider (the rest i can diagnose from logs).18:42
corvusas i fix the others, the problem does solve itself :)18:43
Shrewsfungi's broad use and corvus' narrow use are both valid   :)18:45
*** hashar has quit IRC18:46
*** armstrongs has joined #zuul18:47
*** bhavikdbavishi has quit IRC18:51
*** armstrongs has quit IRC18:57
Shrewsmordred: if you're in a reviewing-kinda-mood, both https://review.opendev.org/689457 and https://review.opendev.org/689479 are very easy.19:14
mordredmmm. easy review points19:15
mordredShrews: done!19:15
* Shrews hands mordred his soup19:16
mordredmmm. noodle soup19:16
fungireview points can be exchanged for soup19:16
corvusmmm soup19:29
*** hashar has joined #zuul19:35
ofososmnaser: works +1, pulled from master on friday at 8 p.m. and now it's all good :)19:49
mnaserofosos: cool! enjoy19:49
*** igordc has quit IRC19:54
*** igordc has joined #zuul20:23
*** hashar has quit IRC20:32
*** hashar has joined #zuul20:32
*** hashar has quit IRC21:33
*** rfolco|ruck has quit IRC21:40
*** tosky has quit IRC22:04
*** rlandy has quit IRC22:04
*** sgw has joined #zuul22:08
*** mattw4 has quit IRC22:46
*** michael-beaver has quit IRC23:09
*** saneax has joined #zuul23:27
*** saneax has quit IRC23:45

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!