Monday, 2020-01-27

*** jamesmcarthur has quit IRC00:04
*** sugaar has quit IRC00:10
*** jamesmcarthur has joined #zuul00:30
*** jamesmcarthur has quit IRC00:43
*** rfolco has joined #zuul00:52
*** jamesmcarthur has joined #zuul00:59
*** jamesmcarthur has quit IRC01:05
*** jamesmcarthur has joined #zuul01:05
*** rfolco has quit IRC01:45
*** jamesmcarthur has quit IRC01:47
*** jamesmcarthur has joined #zuul01:49
*** jamesmcarthur has quit IRC01:54
*** openstackgerrit has quit IRC02:04
*** openstackgerrit has joined #zuul02:15
openstackgerritMonty Taylor proposed zuul/zuul-jobs master: Add support for installing python with pyenv  https://review.opendev.org/70426602:15
*** jamesmcarthur has joined #zuul02:18
*** jamesmcarthur has quit IRC02:24
*** jamesmcarthur has joined #zuul02:52
*** jamesmcarthur has quit IRC02:56
*** bhavikdbavishi has joined #zuul03:27
*** jamesmcarthur has joined #zuul03:31
*** jamesmcarthur has quit IRC03:32
*** jamesmcarthur has joined #zuul03:32
*** bhavikdbavishi1 has joined #zuul03:36
*** bhavikdbavishi has quit IRC03:38
*** bhavikdbavishi1 is now known as bhavikdbavishi03:38
*** jhesketh has quit IRC03:56
*** jamesmcarthur has quit IRC04:44
*** raukadah is now known as chkumar|rover04:45
*** zxiiro has joined #zuul05:51
*** AJaeger has quit IRC07:05
*** AJaeger has joined #zuul07:10
*** bhavikdbavishi has quit IRC07:31
*** tosky has joined #zuul07:56
*** bhavikdbavishi has joined #zuul08:08
*** avass has joined #zuul08:24
*** pcaruana has joined #zuul08:25
*** sugaar has joined #zuul08:36
*** jpena|off is now known as jpena08:51
openstackgerritTobias Henkel proposed zuul/zuul master: Optionally support mitogen for job execution  https://review.opendev.org/65702408:55
*** avass has quit IRC09:12
openstackgerritJan Kubovy proposed zuul/zuul master: Enforce sql connections for scheduler and web  https://review.opendev.org/63047209:20
*** fbo is now known as fbo|off09:39
*** bhavikdbavishi has quit IRC09:58
*** saneax has joined #zuul09:59
*** sshnaidm is now known as sshnaidm|afk10:27
*** sanjayu_ has joined #zuul10:32
*** saneax has quit IRC10:34
reiterativeI'm trying to run the latest version of Zuul from master, but when I browse to the web interface I get a 404. I installed via 'sudo python3 -m pip install .' from a clone of the repo, having checked out the 3.15.0 label. When I install the same version from PyPI ( sudo python3 -m pip install zuul), everything works just fine. Is there something different i need to do when installing in this way?10:37
*** adamw has joined #zuul10:40
*** avass has joined #zuul10:48
*** etp has quit IRC10:58
*** etp has joined #zuul11:00
*** saneax has joined #zuul11:06
*** sanjayu_ has quit IRC11:07
*** sshnaidm|afk is now known as sshnaidm11:34
*** zxiiro has quit IRC11:50
*** rfolco has joined #zuul12:00
mordredreiterative: if you're installing from git, you'll need the javascript toolchain installed. the wheels we publish to pypi have the javascript things pre-built12:13
mordredreiterative: https://zuul-ci.org/docs/zuul/reference/developer/javascript.html#yarn-dependency-management has some docs on installing those12:14
mordred(really just the install-js-tools.sh script should get you set up - it's yarn you need - yarn will install the other stuff needed)12:15
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: Add a markdownlint job and role  https://review.opendev.org/60769112:23
reiterativeThanks mordred! I thought I'd installed everything specified in bindep.txt (which includes yarn and nodejs-npm), but bindep fails to mention that those are missing...12:25
mordredreiterative: hrm.12:25
mordredreiterative: what platform are you on? I wonder if we've got a bad tag in our bindep file ...12:26
reiterativeI'm working on Ubuntu 18.0412:26
lennybHi, why openstack-python3-ussuri-jobs-neutron suppose runs openstack-tox-py27 #link https://review.opendev.org/#/c/704269/8?    According to #link https://docs.openstack.org/infra/openstack-zuul-jobs/project-templates.html#project_template-openstack-python3-ussuri-jobs-neutron   it should not to12:26
mordredoh - yeah - so - the issue there ...12:26
mordredreiterative: is that bindep only lists them for alpine because it's the only ones with them built in. for ubuntu and red hat distros you need to add package repos, and we don't have any way to express that in bindep sadly12:27
*** jpena is now known as jpena|lunch12:28
* mordred keeps trying to brainstorm some way to do it that isn't horrific - but hasn't yet been able to12:28
reiterativemordred Understood! This sort of mult-platform dependency problem is a familiar one :-)12:29
mordred:) ... you'd think this would be a solved problem by now ...12:30
AJaegerlennyb: where are your jobs defined?12:36
lennybAJaeger: https://review.opendev.org/#/c/704269/8/.zuul.yaml12:37
AJaegerlennyb: and here as well: https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml#L588612:38
AJaegerSend a change to remove the project stanza from project-config and you'll be fine..12:38
lennybAJaeger: thanks a lot.12:38
lennybAJaeger: Will it be enough to define it in my x/ repo only, or I will need to update https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml#L5886   each time ?12:40
*** bhavikdbavishi has joined #zuul12:42
*** bhavikdbavishi1 has joined #zuul12:45
*** bhavikdbavishi has quit IRC12:47
*** bhavikdbavishi1 is now known as bhavikdbavishi12:47
*** rlandy has joined #zuul12:50
*** Goneri has quit IRC12:53
*** jamesmcarthur has joined #zuul13:06
*** jamesmcarthur has quit IRC13:21
*** bhavikdbavishi has quit IRC13:24
*** jamesmcarthur has joined #zuul13:27
openstackgerritJan Kubovy proposed zuul/zuul master: Enforce sql connections for scheduler and web  https://review.opendev.org/63047213:28
*** jpena|lunch is now known as jpena13:31
*** jamesmcarthur has quit IRC13:37
*** Goneri has joined #zuul13:44
*** jamesmcarthur has joined #zuul13:49
openstackgerritJan Kubovy proposed zuul/zuul master: Enforce sql connections for scheduler and web  https://review.opendev.org/63047213:50
*** smcginnis has quit IRC13:50
*** smcginnis has joined #zuul13:52
*** zxiiro has joined #zuul13:52
*** smcginnis is now known as smcginnis|FOSDEM13:53
*** avass has quit IRC14:04
*** bolg has joined #zuul14:12
bolgcorvus: Updated spec for scale out scheduler (https://review.opendev.org/c/621479) and would like to proceed with required sql connections for scheduler and web (https://review.opendev.org/c/630472) how would be best to proceed?14:15
bolgAre there any points which should be considered in the spec?14:16
openstackgerritTobias Henkel proposed zuul/zuul master: Don't reset file list to None in updateChange  https://review.opendev.org/70432814:20
openstackgerritMerged zuul/nodepool master: kubernetes: add release note about service account token issue  https://review.opendev.org/70386914:27
openstackgerritSimon Westphahl proposed zuul/nodepool master: Annotate logs in launcher  https://review.opendev.org/70355814:29
openstackgerritSimon Westphahl proposed zuul/nodepool master: Annotate logs in node request handler  https://review.opendev.org/70355914:29
openstackgerritSimon Westphahl proposed zuul/nodepool master: Include event id in node request listings  https://review.opendev.org/70356014:29
openstackgerritSimon Westphahl proposed zuul/nodepool master: Annotate logs in zk module  https://review.opendev.org/70356114:29
swestShrews: sorry for the delayed response. eliminated the duplicate data in the log messages ^14:32
*** hashar has joined #zuul14:38
openstackgerritAntoine Musso proposed zuul/zuul master: Enhance some logging messages  https://review.opendev.org/70433114:39
openstackgerritTobias Henkel proposed zuul/zuul master: Evaluate CODEOWNERS settings during canMerge check  https://review.opendev.org/64455714:39
AJaegerlennyb: your proposed change is just fine, let's continue discussing there...14:41
lennybAJaeger: I feel that my answers and your proposals are the same :). looks like I am missing small words, that make all the difference when I read :). Sorry for that14:52
openstackgerritTobias Henkel proposed zuul/zuul master: Handle draft pull requests in canMerge  https://review.opendev.org/70415014:55
openstackgerritTobias Henkel proposed zuul/zuul master: Evaluate CODEOWNERS settings during canMerge check  https://review.opendev.org/64455714:55
*** paladox is now known as paladox|UKInEU14:56
pabelangerzbr: a new role could be added for it, we generate html before uploading to swift.  Look to htmlify-logs role for example14:58
AJaegerlennyb: yeah, all looks fine. What I'm saying is that you need to add to stable/train (and other branches) the python-jobs template.14:58
zbrpabelanger: my impression is that this view is generating at runtime by loading the json file. which means that ansi2html must happen in the browser. not a big deal as there are several libraries able to do that.14:59
pabelangerzbr: ah, the dashboard might be different, was sharing on straight html file that is uploaded into logs folder15:00
zbrmy first worry is the dashboard, as it has two problems: the tail is too short, even on linting errors often you do not see the error, and is messed due to lack of ANSI processing.15:01
zbrboth of them fixable, i would at least double the tail lenght.15:02
fungior add a clickable control to expose another chunk of the log15:03
fungiif it's too short some of the time but not most of the time, that would allow us to keep a shorter and more focused log snippet by default15:04
fungiif it's too short most of the time, then yeah maybe we should change the number of lines we display by default15:04
corvusbolg: i'll review the spec asap15:11
*** jamesmcarthur has quit IRC15:17
*** hashar has quit IRC15:30
*** bhavikdbavishi has joined #zuul15:38
*** bolg has quit IRC16:01
*** saneax has quit IRC16:10
pabelangera heads up, zbr spend some time last week migrating molecule from travis CI to zuul.ansible.com. I'm happy to share this16:32
*** jamesmcarthur has joined #zuul16:51
*** chkumar|rover is now known as raukadah16:54
clarkbhashar tobiash please see comment on https://review.opendev.org/#/c/704331/1 I think it may be too minor to worry about but wasn't super sure17:04
clarkbcorvus: re my comment on https://review.opendev.org/#/c/704222/1 you might have a process for editing those screenshots to highlight fields?17:04
tobiashclarkb: good catch17:08
*** paladox|UKInEU is now known as paladox17:09
openstackgerritClark Boylan proposed zuul/zuul master: Be more specific with remaining time  https://review.opendev.org/70419117:13
*** hashar has joined #zuul17:18
clarkbAJaeger: pabelanger ^ thanks for the catch on that. using the constant as specified should fix it17:22
pabelanger+2 looks better!17:26
pabelangerthanks17:26
clarkbtobiash: before I approve https://review.opendev.org/#/c/703651/15 do you know why True gets string converted the way it does in the test added there (comment has more details)17:44
Shrewsoops, i just +Ad that17:44
clarkbShrews: oh I think its fine17:44
clarkbthe tests pass and it must be owrking :)17:44
clarkbits just not exactly how I would haev expected17:44
clarkbalso I enjoy that the ec2 api uses key: 'foo', value: 'bar' not realizing those are implicit in the datastructure17:45
tobiashclarkb: I think that's magic done by the yaml parser17:46
tobiashclarkb: scratch that, I misunderstood your question17:47
tobiashclarkb: are you sure that this gets deserialized to a bool?17:48
clarkbtobiash: now that you've asked that I'm not compeltely sure it isn't a pyyaml supplied bool type17:48
clarkbpossibly one that stringifies to match the yaml input17:48
clarkbor perhaps zuul does that conversion somewhere internally17:49
clarkber nodepool17:49
tobiashclarkb: hrm, local testing in a python console results in 'True'17:53
*** mattw4 has joined #zuul17:53
fungiclarkb: if python True is being fed to the yaml serializer/dumper then "true" is the default truthy boolean value for pyyaml (yaml as a whole presumably?)17:53
tobiashclarkb: I wonder if that assert is actually executed17:53
clarkbfungi: this is the other direction though17:53
tobiashah ok, that explains it17:53
fungiit interprets "true" in yaml as the True boolean in python17:54
clarkbfungi: ya then nodepool is serializing it back out again to str($yaml_input_true)17:54
clarkbfungi: I would expect that to be 'True' not 'true'17:54
fungiagreed17:55
tobiashclarkb: just verified, safe_dump results in 'true'17:55
fungistr(True) yields "True" in my python3.817:55
tobiashwhich is the yaml preferred standard representation of a bool17:55
fungibut if it's going through the pyyaml dumper then that will generate "true" instead17:55
tobiashyaml prefers true over True (e.g. verified by yamllint) but accepts both17:56
fungiright17:56
tobiashactually yaml accepts a variety of values as bool, but has to decide to one when serializing: https://yaml.org/type/bool.html17:57
fungibut according to clarkb this is generated by str() of the python value we deserialized?17:57
*** jpena is now known as jpena|off17:57
clarkbfungi: ya line 134 https://review.opendev.org/#/c/703651/15/nodepool/driver/aws/config.py17:58
tobiashthere are probably further deserialization/serialization steps in between which are done by boto317:59
fungiso many layers18:00
clarkblike onions and ogres18:00
fungiogrions18:01
openstackgerritMerged zuul/nodepool master: Annotate logs in launcher  https://review.opendev.org/70355818:05
openstackgerritMerged zuul/nodepool master: Annotate logs in node request handler  https://review.opendev.org/70355918:14
openstackgerritDavid Shrewsbury proposed zuul/nodepool master: Remove duplicate log info from OpenStack driver  https://review.opendev.org/70437918:15
Shrewstobiash: swest: you two may be interested in 704379 ^^18:15
Shrewssaw that while looking at test result logs18:15
Shrewsthere was also at least 1 missing self.log() parameter bug18:16
Shrewsline 27918:17
openstackgerritAntoine Musso proposed zuul/zuul master: Add details to waitUntilSettled() debug log  https://review.opendev.org/70438018:17
openstackgerritAntoine Musso proposed zuul/zuul master: tests: throttle after all builds have reported  https://review.opendev.org/70438118:17
*** bhavikdbavishi has quit IRC18:18
openstackgerritMerged zuul/nodepool master: Include event id in node request listings  https://review.opendev.org/70356018:25
openstackgerritJames E. Blair proposed zuul/zuul master: Update screenshot for gerrit profile in quick-start  https://review.opendev.org/70422218:28
corvusclarkb: ^ thx, see comment18:31
corvustflink: ^18:32
openstackgerritJames E. Blair proposed zuul/zuul master: Fix path in quick-start localtest  https://review.opendev.org/70438518:32
*** sshnaidm is now known as sshnaidm|afk18:35
openstackgerritMerged zuul/nodepool master: Annotate logs in zk module  https://review.opendev.org/70356118:37
*** notnone is now known as at_work18:39
openstackgerritJeremy Stanley proposed zuul/zuul master: Flesh out the glossary significantly  https://review.opendev.org/70439118:51
fungistill in progress ^ but the entries i've added so far are fare game for critical feedback18:51
corvusfungi: there's a special ref for terms in the glossary; after bulking it out, you might want to grep through the source and set up those links18:55
corvusfungi: :term:18:56
corvuslike: tutorials/quick-start.rst::term:`check` and :term:`gate`.  In our system, ``check`` will be18:56
fungicorvus: awesome. and yeah, step 1 is to compose the prose and identify gaps18:59
fungithe other step can hopefully be done semi-programmatically?19:00
fungii'll admit i really hadn't even looked closely at that mechanism yet19:00
corvusi'd expect it to be grep + human editing19:04
corvusi don't think we'd want to :term: every occurance -- just the first time it shows up in a section19:04
fungiif it's a bunch, it may be grep/sed -i followed by human cleanup ;)19:04
fungithankfully it's not hard to tell the stream editor to bail after the first edit19:05
*** jamesmcarthur has quit IRC19:05
*** jamesmcarthur has joined #zuul19:28
openstackgerritMerged zuul/zuul master: Update Quick-Start Fedora Package Install Command  https://review.opendev.org/70422119:38
*** mattw4 has quit IRC19:49
*** jamesmcarthur has quit IRC20:03
tobiashShrews: thanks, lgtm20:13
*** jamesmcarthur has joined #zuul20:16
openstackgerritAntoine Musso proposed zuul/zuul-jobs master: Skip test-setup.sh in pep8 jobs  https://review.opendev.org/70441420:17
*** rlandy is now known as rlandy|brb20:19
openstackgerritMerged zuul/nodepool master: add tags support for aws provider  https://review.opendev.org/70365120:21
*** SotK has quit IRC20:25
*** SotK has joined #zuul20:25
tobiashfungi: awesome, one additional important term would be project-pipeline20:28
fungitobiash: please add a review comment, i don't know how a project-pipeline differs from a normal pipeline20:28
*** openstackstatus has joined #zuul20:28
*** ChanServ sets mode: +v openstackstatus20:28
corvus(it's the pipeline part of a project stanza)20:29
*** rlandy|brb is now known as rlandy20:29
fungiahh, got it20:31
fungias opposed to the pipeline definitions in the tenant configuration20:31
openstackgerritAntoine Musso proposed zuul/zuul master: tox: rename pep8 to linters  https://review.opendev.org/70363520:34
openstackgerritAntoine Musso proposed zuul/zuul master: tox: do not install bindep for linters  https://review.opendev.org/70363620:36
fungifor full disclosure, i phoned into the first "meeting" of the cd foundation's interoperability sig last week, and mentioned that before it made the least bit of sense to talk about interoperability between ci/cd software we needed a common language to be able to hold those discussions in, so i'm going to push the folks involved in the sig to try and work out relevant terminology for the tools they represent. in20:36
fungithe same vein, i figured our glossary could use some work so that i have a way to map our terms to their terms20:36
fungiin good news, there are people involved in that sig who are happy users of zuul, so i feel at least somewhat obligated to find out where we fit in there20:37
fungithe interim chair also asked me to deliver a brief (~30-minute) presentation during the 2020-02-20 call on what measures zuul takes in support of "interoperability" (setting aside i suppose the fact that the term hasn't been clearly defined yet)20:43
fungii figure i'll talk about how zuul is designed to support integration between deployments through sharing of job definitions and ansible playbooks, though i'm open to ideas of course20:43
fungiour decision not to nih a dsl is a big part of our stance on some kinds of interoperability20:44
fungias is the fundamental design around distribution and reuse of content in git repositories and connecting a deployment to repositories in multiple systems20:46
fungii still don't really buy into the underlying premise of the sig, but i'm open to seeing where it goes20:47
*** jamesmcarthur has quit IRC20:59
*** mattw4 has joined #zuul21:07
*** mattw4 has quit IRC21:13
*** mattw4 has joined #zuul21:14
corvusfungi: that sounds relevant and correct.  if they feel like "iteroperability" means "exchange standardized messages over a standardized message bus", then zuul's flexible driver system with user-configurable mqtt, etc drivers may be relevant.21:24
fungiooh, yes i should something something mqtt something in there ;)21:25
corvusfungi: also tristanC has an amqp driver ready for review https://review.opendev.org/63745821:26
fungifor reference, it's a continuation of some of the things we talked to fdegir and zxiiro about at the ci/cd opendev event in vancouver a couple years ago21:26
corvus++21:27
fungithese discussions may eventually result in some sort of protocol standards for cross-systems communication, but for now i'm pushing for a commons of terminology and reviewing case studies to understand the problems folks are facing before we assume that's a solution21:29
*** Goneri has quit IRC21:39
*** jamesmcarthur has joined #zuul21:41
*** jamesmcarthur has quit IRC21:45
*** jamesmcarthur has joined #zuul21:48
*** decimuscorvinus has quit IRC22:15
*** jamesmcarthur has quit IRC22:16
*** decimuscorvinus has joined #zuul22:16
*** jamesmcarthur has joined #zuul22:17
*** jamesmcarthur has quit IRC22:18
*** jamesmcarthur has joined #zuul22:25
*** jamesmcarthur has quit IRC22:27
*** jamesmcarthur has joined #zuul22:29
*** jamesmcarthur has quit IRC22:31
*** jamesmcarthur has joined #zuul22:34
*** hashar has quit IRC22:36
*** jamesmcarthur has quit IRC22:38
*** jamesmcarthur has joined #zuul22:38
*** armstrongs has joined #zuul22:46
*** armstrongs has quit IRC22:55
*** jamesmcarthur has quit IRC23:13
*** jamesmcarthur has joined #zuul23:17
*** jamesmcarthur has quit IRC23:21
*** tosky has quit IRC23:45

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!