Tuesday, 2019-07-30

openstackgerritMerged zuul/zuul master: Add log browsing to build page  https://review.opendev.org/67190600:10
*** threestrands has joined #zuul00:10
openstackgerritMerged zuul/zuul master: Move artifacts to their own section  https://review.opendev.org/67237900:21
openstackgerritMerged zuul/zuul master: Remember tab location on build page  https://review.opendev.org/67283600:34
openstackgerritMerged zuul/zuul master: Use base 1 line number anchors in log view  https://review.opendev.org/67283700:54
*** panda has quit IRC01:06
*** panda has joined #zuul01:08
openstackgerritMerged zuul/zuul master: Add severity filtering to logs  https://review.opendev.org/67283901:14
*** igordc has quit IRC01:15
openstackgerritMerged zuul/zuul master: Colorize log severity  https://review.opendev.org/67310301:29
openstackgerritMerged zuul/zuul master: Add raw links to log manifest  https://review.opendev.org/67310401:46
*** saneax has quit IRC01:48
openstackgerritMerged zuul/zuul master: Rename view to logfile  https://review.opendev.org/67310502:03
*** threestrands has quit IRC03:30
*** threestrands has joined #zuul03:30
*** threestrands has quit IRC03:31
*** saneax has joined #zuul03:53
*** jank has joined #zuul04:53
*** jamesmcarthur_ has quit IRC05:28
*** shachar has quit IRC06:05
*** shachar has joined #zuul06:05
openstackgerritTobias Henkel proposed zuul/zuul master: Add support for smart reconfigurations  https://review.opendev.org/65211406:49
openstackgerritTobias Henkel proposed zuul/zuul master: Add --check-config option to zuul scheduler  https://review.opendev.org/54216006:49
*** yoctozepto has quit IRC07:00
*** tosky has joined #zuul07:24
*** jpena|off is now known as jpena07:24
*** themroc has joined #zuul07:26
*** jangutter has joined #zuul07:55
arxcruzhey guys, is that possible to set a host-vars to several jobs as a variable? so i don't need to repeat the host-vars in all the jobs? It can't be by the parent since there are different parents for those jobs07:58
arxcruzsomething like host-vars: my-host-vars where my-host-vars have the dictionary07:59
AJaegerarxcruz: you can add vars to all templates like https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml#L6508:02
AJaegerThat might even apply to jobs in all pipelines, not sure about exact semantics - let's check docs...08:02
AJaegerso, we have https://zuul-ci.org/docs/zuul/user/config.html#attr-project.vars08:03
arxcruzAJaeger, yeah, here's the problem i have, we have some rhel-8 jobs running that require to set ansible_python_interpreter: /usr/bin/python308:03
AJaegerarxcruz: but not project.host-vars, so what you want is not possible today...08:04
arxcruzAJaeger, i was wondering if i could do something like the nodeset08:04
arxcruzthat i have a - nodeset:08:05
arxcruz- name: my-nodeset08:05
arxcruzand all the settings08:05
AJaegerarxcruz: So, the quick ideas don't work - sorry, can't help further right now. Best ask later today. But let me check first what you read ;)08:05
AJaegerarxcruz: looking at the docs, that is not possible. Don't you have a common base job?08:07
AJaegerBut better discuss with rest of team later today, I'm offline again now...08:07
arxcruzAJaeger, yes, i do, but as i said, it's shared by other jobs that run on python208:07
arxcruzAJaeger, sure, thanks08:07
AJaegerah, fun ;)08:08
*** yoctozepto has joined #zuul08:09
openstackgerritMatthieu Huin proposed zuul/zuul master: Zuul CLI: allow access via REST  https://review.opendev.org/63631508:46
*** SotK has quit IRC09:06
*** SotK has joined #zuul09:08
*** AshBullock has joined #zuul09:32
*** hwangbo has quit IRC09:52
*** ianw has quit IRC09:55
*** ianw has joined #zuul09:59
*** AshBullock has quit IRC10:26
*** bhavikdbavishi has joined #zuul10:31
*** bjackman has joined #zuul10:39
openstackgerritSorin Sbarnea proposed zuul/zuul-jobs master: WIP: Allow ensure-tox to upgrade tox version  https://review.opendev.org/67276010:44
*** jank has quit IRC10:48
*** AshBullock has joined #zuul10:57
*** bhavikdbavishi has quit IRC11:01
*** jank has joined #zuul11:04
*** saneax has quit IRC11:30
*** saneax has joined #zuul11:34
*** jpena is now known as jpena|lunch11:35
*** AshBullock has quit IRC11:41
*** jamesmcarthur has joined #zuul11:50
*** jamesmcarthur has quit IRC12:03
*** jpena|lunch is now known as jpena12:42
*** jamesmcarthur has joined #zuul12:44
*** bjackman has quit IRC12:47
*** jamesmcarthur has quit IRC12:51
*** jamesmcarthur has joined #zuul13:01
*** jank has quit IRC13:01
*** jamesmcarthur has quit IRC13:02
*** jank has joined #zuul13:03
*** jamesmcarthur has joined #zuul13:03
fungiarxcruz: if they're all defined in the same file, you could use a yaml anchor and reference it13:38
funginot technically a zuul feature, it's a yaml feature13:39
mordredarxcruz: for instance: https://opendev.org/opendev/system-config/src/branch/master/.zuul.yaml#L54 and then https://opendev.org/opendev/system-config/src/branch/master/.zuul.yaml#L66 and https://opendev.org/opendev/system-config/src/branch/master/.zuul.yaml#L7313:43
arxcruzmordred, fungi is this work also to host-vars right?14:01
arxcruzthanks! that's what i needed :D14:01
fungiyeah, it's just a general yaml feature to deduplicate data structures14:05
fungisince zuul relies on a standard yaml parser, zuul doesn't need to know you're doing that14:05
arxcruzfungi, but it requires to be in the same file correct? or zuul will parse all the files in a big yaml file first ?14:06
*** jeliu_ has joined #zuul14:09
*** wxy-xiyuan has quit IRC14:10
fungihas to be in the same file, yes14:12
fungizuul doesn't concatenate files14:12
*** jeliu_ has quit IRC14:13
*** jeliu_ has joined #zuul14:13
*** jank has quit IRC14:19
*** bjackman has joined #zuul14:22
*** michael-beaver has joined #zuul14:27
*** sanjayu_ has joined #zuul14:41
*** saneax has quit IRC14:41
*** bjackman has quit IRC14:48
*** bhavikdbavishi has joined #zuul14:52
*** jeliu_ has quit IRC14:54
*** bhavikdbavishi has quit IRC14:56
*** jeliu_ has joined #zuul15:00
tobiashcorvus, mordred: is there some important stuff to review atm?15:02
tobiashI was less active here in the last weeks due to operational challenges and vacation but plan to get more active again15:03
corvustobiash: i think mhu's zuul_admin_web series is close to ready, and since it's half-merged already, it would be nice to get the whole thing in for a release15:04
corvusalso we said we'd review Shrews' autohold stuff once that merges15:05
mhucorvus, the GUI part needs a lot of work yet though. I am on it but I am not a react specialist15:05
mhubut if you're fine with just the CLI part at this point in time, then by all means15:06
Shrews\o/15:06
corvusmhu: yeah, the current stuff up for review is the authz configuration, right?  with that in place, someone can at least use the rest api15:06
mhucorvus, yes15:06
tobiashcool, I'll look at it15:06
mhualso, I'll be on vacation in a week, so if I'm not around do not hesitate to take over15:07
corvusall the more reason to get it finished this week :)15:07
tobiashI left a comment on 63631515:12
tobiashcorvus: what do you think?15:13
*** bhavikdbavishi has joined #zuul15:14
SpamapSIs one of the things in the admin interface going to be a "retry" button for buildsets? I have gotten a few requests for that of late, but I don't remember seeing it in the spec.15:19
mhuspamaps, the spec didn't cover the GUI, but if you look at https://review.opendev.org/#/c/643536/15/web/src/pages/Buildsets.jsx I added an "enqueue" button15:20
mhuso yes15:20
corvusor perhaps the web trigger could handle that15:22
SpamapSCool, just wondering.15:23
corvustobiash: replied and +315:27
corvusmhu: you want to rebase the rest of that stack?15:27
mhucorvus, on it15:27
*** chandankumar is now known as raukadah15:29
tobiash:)15:31
openstackgerritMatthieu Huin proposed zuul/zuul master: Add Authorization Rules configuration  https://review.opendev.org/63985515:32
openstackgerritMatthieu Huin proposed zuul/zuul master: Web: plug the authorization engine  https://review.opendev.org/64088415:32
openstackgerritMatthieu Huin proposed zuul/zuul master: Zuul Web: add /api/user/authorizations endpoint  https://review.opendev.org/64109915:32
openstackgerritMatthieu Huin proposed zuul/zuul master: authentication config: add optional token_expiry  https://review.opendev.org/64240815:32
corvusclarkb, mordred, tristanC: i *think* opendev's javascript updated, but when i visit a page like http://zuul.opendev.org/t/zuul/build/0c8293045843425b89c14d1f49af52b0 i don't see the tabs at the top15:38
corvuswhat am i missing?15:38
corvuswe should at least see the "Summary" tab even if there's no "Logs" tab; that makes it feel like it's an old version of the js15:40
corvusbut isn't the artifacts list new?15:40
tobiashcorvus: I saw that some post jobs failed15:41
tobiashcorvus: https://review.opendev.org/67310515:41
corvustobiash: aha, thanks!15:41
corvusi will follow that trail15:41
tobiashI guess opendev-promote-javascript-content is supposed to do that?15:41
corvusyep15:42
corvusindeed, the artifacts change is the last time that succeeded15:43
tobiashwasn't there some deprecation around download artifact by name?15:43
tobiashthat's where it fails: http://logs.openstack.org/05/673105/1/promote/opendev-promote-javascript-content/784f17a/job-output.txt.gz#_2019-07-30_02_04_22_90231115:44
corvusyeah, but it's supposed to be backwards compat for the next 2 weeks15:44
corvusi guess that didn't work15:44
*** hwangbo has joined #zuul15:45
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Fix typo in download-artifact  https://review.opendev.org/67356615:46
corvustobiash: ^15:46
AJaegerah, an extra ")"15:47
corvusonce that's done, i'll retrigger the latest promotes15:47
mordredstupid )'s15:48
openstackgerritMerged zuul/zuul master: Spec: Add a Kubernetes Operator for Zuul  https://review.opendev.org/65918015:50
tobiashI was too slow...15:50
openstackgerritMerged zuul/zuul-jobs master: Update testing section  https://review.opendev.org/67282015:51
openstackgerritSorin Sbarnea proposed zuul/zuul-jobs master: WIP: Allow ensure-tox to upgrade tox version  https://review.opendev.org/67276015:54
corvustobiash: do you have mirrors or proxies (ie, operating system or language packages, etc) in your setup?15:54
tobiashcorvus: both15:55
corvustobiash: then do you want to look over https://review.opendev.org/669948 ?15:55
tobiash(authenticated) Proxies for internet access and mirrors using artifactory15:56
tobiashcorvus: I'll take a look when I'm at home15:56
corvustobiash: thanks15:56
openstackgerritMerged zuul/zuul-jobs master: Fix typo in download-artifact  https://review.opendev.org/67356616:01
corvusre-enqueuing 673105,1 for promote16:04
AJaegercorvus: want to re-enqueue 672820 for promote as well?16:08
AJaegerwe can also wait for next merge for accurate docs...16:08
corvusAJaeger: i still had the command up so it was easy enough to do, thanks :)16:09
corvusthe jobs for 105 ran as expected16:09
*** panda has quit IRC16:09
corvusand afs is updated16:10
corvusso we're just waiting on an opendev ansible/puppet run16:10
*** panda has joined #zuul16:13
openstackgerritMerged zuul/zuul master: Zuul CLI: allow access via REST  https://review.opendev.org/63631516:18
openstackgerritJeff Liu proposed zuul/zuul-jobs master: Add auth config to kubelet user for buildset registries  https://review.opendev.org/67335116:19
AJaegerthanks, corvus16:22
*** evgenyl has quit IRC16:24
*** evgenyl has joined #zuul16:27
*** igordc has joined #zuul16:33
*** evgenyl has quit IRC16:34
*** evgenyl has joined #zuul16:36
*** jpena is now known as jpena|off16:38
*** cixx has quit IRC16:39
*** cixx has joined #zuul16:40
*** sgw has quit IRC16:42
*** themroc has quit IRC16:52
*** bhavikdbavishi has quit IRC16:54
pabelangerGreetings, I think I've asked this before, we have a new requirement for zuul to checkout a project (say https://github.com/ansible-network/sandbox) on disk as src/github.com/ansible_network/sandbox. I know a role has the ability to control the dest name, but I don't believe a project can?  This is all related to the upcoming collections work that ansible is going to be pushing in 2.9 and a hyphen in project16:54
pabelangername is no longer allowed.  I am hoping to avoid renaming a complete org in git to support it16:55
*** bhavikdbavishi has joined #zuul16:56
mordredpabelanger: I  would suggest that you're not the only person who is going to have an issue with a decision to start disallowing hypens16:57
fungisounds like a good reason to convince them to allow hyphens16:57
fungiyeah, that16:57
mordredyeah16:57
*** jeliu_ has quit IRC16:57
mordredotherwise its going to make life VERY hard for people who want to use collections but want to install them via git16:57
*** sshnaidm is now known as sshnaidm|afk16:58
pabelangerfrom what I am being told, it is because python importer breaks (doesn't support it)16:58
pabelangeryes16:58
mordredpabelanger: anyway - I believe you'd want a pre-playbook to do a mv16:58
pabelangervery hard is what I am seeing now, I'm trying to avoid the need to move files around after zuul pushed them16:58
pabelangermordred: yah, I do that today, but don't like it16:59
fungiprobably we need a way for collections to do that remapping. it would be very confusing to need to refer to the on-disk path with something other than its actual repository name. so many places i expect we assume they match16:59
pabelangerI'd also symlink it, but something about testing tool (ansible-test) doesn't like a symlink :(16:59
mordredyup. also - I have roles in repos with -s in them16:59
mordrednot just org names :)17:00
mordredlike - literally all of my role repos17:00
pabelangerthis is also going to be an issue for zuul directly, when it grows the ability to use a collection from executor17:00
pabelangersame17:00
fungican collections "know" a thing by some symbolic name which is not its directory name, maybe?17:00
fungimaybe via some configurable translation table?17:00
*** jamesmcarthur has quit IRC17:00
pabelangermaybe, but so far there is resistance to using "-", even if a technical solution was found17:00
mordredpabelanger: is it possible to do something (slighly absurd) like "mazer install src/github.com/ansible-network/sandbox" and have that install the thing into a location with the transformations needed?17:01
fungii guess good luck getting it adopted if they're basically telling users they're not going to support existing names and everyone has to rename stuff before collections will be generally usable17:01
fungisounds like a cop-out to me17:01
pabelangermordred: maybe, I can test17:02
mordredfungi: yeah - but ... other things need to be installed, so I can accept the difference between "installed artifact" and "checked out source repo"17:02
fungiright, i mean python packages support this concept17:03
mordredyeah17:03
fungithe distname doesn't have to be the file/directory/archive name17:03
fungiyou just have a registry mapping them to one another somewhere, or embed some metadata, or both17:03
fungiit's kinda like saying my new web browser is awesome but it doesn't support domains with hyphens in them so everyone will need to rename their websites17:04
fungi(because the url parsing library i chose gets confused by hyphens, but also because i think hyphens in domain names are ugly and everyone should agree with me)17:05
*** bhavikdbavishi has quit IRC17:07
*** bhavikdbavishi has joined #zuul17:07
*** bhavikdbavishi has quit IRC17:17
*** bhavikdbavishi has joined #zuul17:18
*** jamesmcarthur has joined #zuul17:26
corvusyay! http://zuul.opendev.org/t/zuul/build/2bf9467ddfe74b039a03d81c7d074f01#logs works17:32
clarkbcorvus: the raw links have an extra / in them (it will work as is, but would be a nice cleanup)17:33
corvusclarkb: ya17:33
* clarkb can write that patch if you want17:33
clarkbI'm betting that one is simple enough for me to not get wrong :)17:33
corvusclarkb: all yours :)17:34
corvusi need to afk for a bit anyway17:34
*** bhavikdbavishi1 has joined #zuul17:36
*** bhavikdbavishi has quit IRC17:37
*** bhavikdbavishi1 is now known as bhavikdbavishi17:37
mordredcorvus: that's just so sexy17:39
mordredSpamapS: ^^ I think you're going to like that17:41
*** bhavikdbavishi has quit IRC17:41
pabelangerlooking at http://zuul.opendev.org/t/zuul/build/2bf9467ddfe74b039a03d81c7d074f01#logs in chrome, doesn't show anything execpt summary17:42
pabelangerI do see expections in console17:42
pabelangerhmm, network error17:43
pabelangerso maybe myside17:43
*** tosky has quit IRC17:43
*** bhavikdbavishi has joined #zuul17:43
AJaegercorvus: that is great!17:43
pabelangerhttp://logs.openstack.org/99/641099/33/check/tox-pep8/2bf9467/job-output.json.gz does load directy17:44
pabelangerdirectly*17:44
pabelangerso something in js that is issue?17:44
mordredpabelanger: if you refresh the build link does it work?17:44
mordred(and what sort of network error?)17:45
pabelangerhttp://paste.openstack.org/show/755129/17:45
tristanCcorvus: well done :)17:45
pabelangerthat is what I see17:45
pabelangerctrl-f5 doesn't fix17:45
mordredpabelanger: (the logs tab won't show until the data has been loaded)17:46
pabelangerfirefox works17:46
pabelangersome things related to chrome17:46
mordredhrm. it's like it's applying a CORS rule or something - what version of chrome?17:47
mordredpabelanger: ad blocker17:47
mordredor also https://love2dev.com/blog/what-the-heck-does-neterr_blocked_by_client-mean-and-how-can-you-fix-it/17:47
fungipabelanger: blocked by am extension maybe?17:47
pabelangerGoogle Chrome 74.0.3729.131 (Official Build) (64-bit)17:48
pabelangerfungi: checking17:48
mordredoh - which is also mentioning adblock17:48
pabelangeryah, incognito works17:48
pabelangerso like adblock17:49
Shrewspabelanger: you'll accept our zuul ads and like it!  :)17:49
mordredthe internet seems to think it's related to extension - so maybe the fetch of a thing ending in .gz is bothering it?17:49
pabelangerindeed!17:49
pabelangerprivacy badger was issue17:49
pabelangerrelaxed settings for logs.o.o17:50
mordredah. privacy badger17:50
pabelangerwhich is odd17:50
mordredI wonder if there is any way to detect such a thing and display a warning17:50
pabelangerbecause premerge it worked17:50
pabelangerI suspect because both were on logs.o.o17:50
Shrewshrm, i use pb and don't have any problems17:50
pabelangerweb and logs17:50
mordredpabelanger: pre-merge it was the same site17:50
fungiyeah, it's the cross-site request that does it17:50
mordredboth from logs.o.o17:50
pabelangeryah, that worked fine17:50
mordredcross-site to a .txt.gz potentially17:50
pabelangermaybe17:50
fungipb blocks it for me in ff too, fwiw17:51
Shrewsmordred: possibility of an sdk release soon-ish to help track down the builder volume leak issue?17:51
mordredShrews: https://review.opendev.org/673581 Release 0.32.0 of openstacksdk17:53
mordredShrews:  you mean like that?17:53
Shrewssomething like that, yeah17:53
mordredShrews: sweet17:54
tristanCpabelanger: did it worked before for json.gz request, e.g. on failed build page, there should be a panel with the failed task output17:54
fungii bet if it was linking to logs.opendev.org pb wouldn't care17:55
*** fdegir has quit IRC17:55
fungibut it's a cross-domain request and those seem to raise its ire17:55
*** fdegir has joined #zuul17:56
tristanCfungi: failed build page does a cross-domain request the job-output.json.gz from zuul.o.o to logs.o.o (to display hosts stat and failed task output)17:57
pabelangerhttp://paste.openstack.org/show/755132/17:59
pabelangeris what I seen17:59
pabelangernothing after Summary was rendered17:59
mordredpabelanger: does privacy badger show you anything about why it's blocking that?18:00
fungiyep, and eff privacy badger blocks that request unless i tell it to allow requests to logs.openSTACK.org from zuul.openDEV.org18:00
mordredI'm reading about posting DNT policy files to self-certify that we are not tracking people18:00
openstackgerritClark Boylan proposed zuul/zuul master: Cleanup extra /'s in manifest render view  https://review.opendev.org/67360518:01
mordredfungi: any more specific information about what it doesn't like about it?18:01
pabelangermordred: no, nothing about why, just orange indicator that something was found18:01
fungimordred: good luck with that. pretty sure the folks assessing the dnt policy submissions only get around to verifying them for *very* large/popular sites18:01
fungii looked into it at length18:01
mordredboo18:01
*** jeliu_ has joined #zuul18:02
mordredwell - this is unfortunate, as I imagine this will be an issue for a non-zero number of our users18:02
pabelangerwill also be issue with swift I suspect18:03
clarkbfwiw FF with default do not track stuff enabled and ublock origin and my crazy home firewall did not block it18:03
clarkbpabelanger: with swift we'll drop the .gz suffix and have swift properly serve the content based on headers18:03
tristanCclarkb: same for me18:03
pabelangerclarkb: cool18:03
mordredclarkb: I don't know that we've determined it's the .gz vs. just the cross-domain18:03
clarkbmordred: ah18:03
tristanCclarkb: there needs to be a cors header though18:03
clarkbtristanC: ya that may fix the cross domain problem?18:04
mordredit's _something_ and those are both likely candidates - unfortunately privacy badger isn't telling us what rule is being triggered18:04
mordreda CORS header violation would show differently - and we'd all be seeing it18:05
fungimordred: fwiw, if i allow cookies for logs.openstack.org when viewing zuul.opendev.org pages, that fixes it18:06
fungiis the logs.o.o site requesting/setting a cookie somehow?18:06
tristanCclarkb: this is the header needed from the logserver: https://review.opendev.org/62790318:06
clarkbtristanC: isn't that set then?18:07
clarkbI mean the change is merged18:07
clarkbthat is probably why we aren't seeing cors errors18:07
mordredfungi: hrm. I don't think we're _purposely_ doing cookies on logs.o.o18:07
mordredclarkb: yeah - we'll need to ensure we tell swift to set that header when we start using swift18:08
tristanCclarkb: this would somehow need to be set on the swift host18:08
clarkbtristanC: I think we may be able to set that via the swift api?18:08
clarkbhttps://www.swiftstack.com/blog/2013/04/02/using-cors-with-swift/ ya18:08
clarkb(note we aren't using swift yet)18:08
fungifor comparison, http://zuul.openstack.org/build/46add3e269ae4c33a2adfdc95ace58f9#logs works fine for me and pb doesn't claim to have spotted any requests to trackers (allowed or otherwise)18:09
fungiin that case, the requests are not cross-domain though, they're just to other sites in the same domain18:09
mordredfungi: I don't see any cookies in my browers' interaction with logs.o.o18:10
fungiyeah, nor do i18:10
fungiso the "allow cookies" setting in pb may not be as simple as its name would imply18:10
mordredooh!18:12
mordredhttps://zuul.opendev.org/t/zuul/build/2bf9467ddfe74b039a03d81c7d074f01#logs does not work18:13
mordredbecause of ssl / no-ssl18:13
fungimordred: https://zuul.opendev.org/t/zuul/build/2bf9467ddfe74b039a03d81c7d074f01 doesn't seem to have a logs tab at all18:14
mordredyeah - the logs tab won't load if it can't load the json content that drives it18:15
fungiaha, right18:15
fungiand yeah, doing https://zuul... to http://logs... will be a problem (the browser will generally block that, don't need some extension to get in the way)18:15
clarkbwe can create a vhost for logs.opendev and LE it easy enough18:16
clarkbor just switch to swift18:16
mordredyeah. but then zuul.openstack.org would be an issue - also - can we fetch swift objects over https:18:17
mordred?18:17
mordred(This is a fun rabbithole we've opened here)18:17
clarkbmordred: that will depend on the swift implementation re swift https18:18
mordredclarkb: I guess since the objects are part of the API though that it's highly unlikely any of our public clouds don't have https turned on18:18
clarkbya18:18
mordredwe'll still need to sort out whether the .gz is involved or whether this will be a problem with swift too18:19
clarkbwith swift we'll drop the .gz's18:19
mordredwhat I'm saying is - if the .gz isn't the issue, and the issue is the cross domain ...18:19
mordredthen swift will have the same issue18:19
fungithe easiest demonstration is to compare http://zuul.openstack.org/build/46add3e269ae4c33a2adfdc95ace58f9#logs and http://zuul.opendev.org/t/openstack/build/46add3e269ae4c33a2adfdc95ace58f9#logs18:20
clarkbmordred: ah yup18:20
fungithey are the same build but via different vhosts18:20
fungithe former works fine for me and pb reports no trackers, the latter it thinks the logs site is a tracker and blocks it by default (unless i allow it)18:20
mordred*awesome*18:21
clarkbso could be that while the CORS policy says cross domain is fine18:21
clarkbpb is not allowing it because thatcould be a nefarious third party18:21
fungipb does the same thing when i go to http://graphana.opendev.org/ because it requests files from http://graphite.openstack.org/ (again cross-domain)18:21
corvusi just installed pb and am able to view the job-output.txt of both of those just fine18:21
fungier, http://grafana.opendev.org/ to http://graphite.openstack.org/18:21
fungigah, other way around18:22
mordredfungi: privacy badger source says that if we post https://subdomain.example.com/.well-known/dnt-policy.txt18:23
mordredit won't block the interaction18:23
corvuscan someone help me out with a reproducer?18:23
mordredfungi: it reproduces for fungi - I think he's the reproducer case18:23
mordredfungi: which link doesn't work for you?18:24
mordredalso, fungi, what version of PB do you have installed?18:25
corvusversion 2019.7.1.118:25
corvusis what i just installed18:25
fungicorvus: i'm on firefox 67.0.1 with eff privacy badger 2019.7.1.118:25
corvusi see that pabelanger was looking at job-output.json earlier -- i suspect there's a problem with direct rendering of that, so we may want to be clear about which files we're accessing18:26
corvusi'm looking at job-output.txt, and so far, i have not had any trouble18:26
corvusi'm on ff 68.0.118:27
fungiin general what i see is that if an opendev.org site requests content from an openstack.org site (such as the case with the zuul builds pages) or an openstack.org site requests content from an opendev.org site (such as graphs in grafana) then privacy badger sees the request as going to a tracker18:27
mordredcorvus: I thought the original pabelanger issue was that he got no logs tab at all because he got the blocking18:27
fungiso i generally just slide the control for that "tracker" over to allow and forget about it18:28
mordredcorvus: I concur though - I just installed PB and I am able to load the page fine18:28
corvusmordred: 17:44 < pabelanger> http://logs.openstack.org/99/641099/33/check/tox-pep8/2bf9467/job-output.json.gz does load directy18:28
corvusmordred, fungi: yeah, i don't know how to reproduce fungi's issue18:29
fungimordred: corvus: does the pb icon show a yellow-background number like "1" or a green-background "0" on those pages?18:29
corvusgreen 018:29
fungineat18:29
mordredgreen 0 for me too18:29
mordred13:42:51<pabelanger>looking at http://zuul.opendev.org/t/zuul/build/2bf9467ddfe74b039a03d81c7d074f01#logs in chrome, doesn't show anything execpt summary18:29
mordred(sorry for the bad timestamp)18:29
corvusmordred: right, i'm just saying let's be careful about using job-output.json as a test18:30
mordredtotally18:30
corvusi'm not saying that pabelanger didn't have a problem18:30
fungifor me http://zuul.openstack.org/build/46add3e269ae4c33a2adfdc95ace58f9#logs has a green "0" (no trackers found) but http://zuul.opendev.org/t/openstack/build/46add3e269ae4c33a2adfdc95ace58f9#logs has a yellow "1" (logs.openstack.org)18:30
corvusi'm saying, "hey folks, there may be 2 problems, let's be careful not to accidentally conflate them"18:30
fungipabelanger: do you see the same?18:30
mordredcorvus: incidentally - job-output.json IS giving me a problem - but it's a different issue, so I'll just put a pin in it and we can come back to it18:30
corvusfungi: pb apparently "learns" ?18:30
fungiyeah, i don't know what sort of learning algorithm it uses18:31
mordredhttp://paste.openstack.org/show/755133/ is what I get from http://zuul.opendev.org/t/openstack/build/46add3e269ae4c33a2adfdc95ace58f9/log/job-output.json18:31
mordredcorvus: so maybe the fact that pabelanger and fungi both enabled it means we don't see the issue?18:33
mordredoh - or the opposite - fungi has been using it for a while so it has learned things about his usage18:34
corvusyeah... maybe something about some other site under openstack.org?18:34
fungimordred: ahh, the dnt policy thing is different, okay. maybe that's a lot easier. i was thinking of the https://tosdr.org/ database which is how ddg privacy essentials works out the site's "privacy practices" for part of its "privacy grade"18:34
mordredfungi: can you still see the error?18:34
mordredfungi: if so, I'd like to try putting the well-known file in place and seeing if that clears it up for you18:35
*** jamesmcarthur has quit IRC18:35
fungimordred: that seems to have solved it18:35
mordredI did not put the file in place18:35
fungioh, you're right18:36
fungiit took a moment for the js to get far enough to request the file and then it switched form green 0 to yellow 118:36
fungiso yes, it is reprodicble for me on reload, just takes a moment to show up18:36
pabelangerfungi: yes, that is correct18:37
mordredfungi: ok. I'm going to put the file in place - let's see if it solves it18:37
fungilmk when it's there and i'll do another forced reload18:37
fungiassuming you can confirm it's directly fetchable18:37
fungiyou're installing it on the logs site, right?18:38
mordredhttp://logs.openstack.org/.well-known/dnt-policy.txt is in place18:38
mordredyes18:38
mordredfungi: any luck?18:39
fungii confirmed i was able to load that file, but pb behavior is unchanged18:39
fungiwe can also check the apache access log for any requests for that file18:40
mordredok. so putting that file in place does not help. that's at least good to know18:40
fungiof course, i've requested it once already18:40
corvusmordred: when you're done, let's be sure to remove it so it doesn't confuse the issue18:40
mordredcorvus: agree18:40
mordredfungi: I see three accesses18:40
mordredI loaded it once18:40
mordredyou loaded it once18:40
corvusme18:40
mordredand corvus18:41
mordredso pb did not load it18:41
mordredI will remove it now18:41
mordredgone18:41
mordredcorvus: ok - I can't load job-output.json in my browser in either domain - same error each time18:45
mordredline 29 of errors.js - it seems like error.request is undefined18:45
corvusmordred: yeah, i expect that's a different error18:45
corvusare we switching to that?18:45
corvusi can only handle debugging one thing at a time18:45
mordredcorvus: oh - sorry - yes. I expect that's a different error. and we can keep a pin in it18:46
corvusmind you, i'm not sure what else to do with the PB thing18:47
corvusi've been browsing a bunch of openstack.org domains to try to get PB to "learn" to distrust it, but no joy so far18:47
corvuslooking at the pb config pages, i don't see anything indicating why it may have decided a domain is a tracking domain18:49
corvus(i have accumulated 1073 tracking domains just by browsing openstack.org)18:50
mordredcorvus: same here (out of ideas) and same here (can't see anything)18:50
mordredcorvus: wow18:50
fungiit could also have to do with the identifier-looking hex strings in those requests18:50
fungihard to say18:50
mordredcorvus: go to openstack.org itself?18:50
corvusmordred: openstack.org, ask.openstack.org, wiki.openstack.org18:50
mordredand maybe log in to your foundation account?18:50
corvusoh, i haven't logged in18:50
mordred(trying to think of something that would set a cookie in openstack.org domain)18:51
fungioh, great point18:51
corvusno joy18:52
fungiff says i have an "openstack.org" cookie last used 35 minutes ago18:52
fungiso this might explain 1. why not all of us see this behavior and 2. why allowing cookies for logs.openstack.org gets the content loading for me18:53
mordredyeah - because you had the cookies thing18:53
mordredyeah18:53
mordredlike - why is your ff sending a cookie to logs.o.o one wonders18:53
funginow if only i could figure out how to get it to show me what's in that cookie18:54
clarkbfungi: that should be in the network debug panel of ff18:54
fungialso i think this may explain why pabelanger said switching to an incognito session solved it (you did say that didn't you pabelanger?)18:54
mordredI have a cookie set for logs.o.o18:56
mordredhow do I have one of those?18:56
corvusfungi: do you have ff content blocking enabled?  mine is set to strict18:56
corvusi wonder if that means that pb isn't seeing as much training material18:56
fungicorvus: i do, but it's possible at some point i allowed cookies for openstack.org to get something working there18:57
fungithe cookie in question is for .openstack.org and has a name of __cfduid18:57
fungiset back in may with a one-year expiration18:57
fungiand ff says it is indeed sending that to logs.o.o18:58
clarkbya I think cookies are sent to subdomains and parent domains18:58
mordredfungi: that's a cloudflare cookie19:00
fungiyuck19:00
fungibaleeted19:01
corvusis the current hypothesis: openstack.org set a cloudflare cookie at some point in the past, PB saw that cookie go to logs.o.o and therefore learned that it was a "tracking domain"?19:01
mordredyeah19:01
mordredalso - I thought we looked in to cookies for subdomains and determined they did not get sent to subdomains - when we were looking in to the zuul-preview stuff19:02
clarkbmordred: I think there are settings you set in the cookie for that19:02
mordredyes - this is accurate - I just re-learned that19:03
clarkbso if the cloudflare cookie doesn't do that then you lose19:03
clarkb(we might be able to work with jimmy to fix that)19:03
mordredyeah - and fungi said it was set for .openstack.org19:03
fungior was until i baleeted it19:03
corvusnew browsers ignore the leading dot, so i think that means that cookie should be sent to *.openstack.org and openstack.org19:05
fungito takeaway is for opendev/osf folks to work out the openstack.org cookie. this is not a zuul problem so i think we've discussed it as much as needs be in here19:13
fungican move on to the json file issue i guess19:13
mordredfungi, corvus: maybe we should put in a $something where the logs tab will go after $time or something $somehow - like with a little flag and a popup "don't see logs, you may have an issue with PB or browser blocking, please contact your admin" or something like that? (I don't think we get an actual exception in the javascript we can respond to)19:18
corvusmordred: that's a good question -- are we sure we don't get an error?  (like, axios returns a i couldn't get this file message?)19:19
corvuscause if so, we can probably do a thing where we say "this build has a manifest, but i can't retrieve it, popup an error"19:19
fungithe js debugger shows a "blocked by client" error19:19
fungiso maybe that's doable?19:19
corvusand that error could say "unable to fetch $URL" which might be enough for the user to debug the issue19:19
corvus(that would let them triage "oh hey i think the logserver is down" as well as "hrm, maybe that orange privacy badger thing has something to do with this"19:20
fungicould even say "unable to fetch $URL, check your browser plugins and ad blockers"19:20
fungior... whatever19:20
fungi(though also we're going to be unable to generally support https->http requests so need to remember that needs solving by adding https to more things)19:21
fungi((or switching to things that already https, like swift))19:21
mordredwell - the js debugger shows that in the console - but that doesnt' mean an exception got tossed to the javascript code19:21
mordredfungi: yeah19:21
corvusmordred: but... something should, right?19:22
corvusi mean, somewhere, there's an http request that needs a response19:22
mordredcorvus: yeah. I'd like to know what that response looks like I guess19:22
corvustoo bad fungi removed the cookie19:23
mordredcorvus: maybe we could manaully add logs.openstack.org to the PB list?19:23
corvusmordred: oh maybe19:23
corvusmight could do that by exporting, modifying, importing data19:24
fungii have a feeling i can reacquire said cookie easily19:24
mordredyeah19:24
fungibut not until after the infra meeting19:25
mordredcorvus: I tried the modifying route. it did not work as well as I otherwise might have wanted19:30
corvus:(19:31
*** bhavikdbavishi has quit IRC19:39
fungiso... on another computer i actually have two .openstack.org cookies (the aforementioned __cfduid which is probably from cloudflare and also a __ga which looks to be google analytics)19:59
corvusfungi: is it broke there too?20:01
fungitesting now20:01
fungiyes, privacy badger claims to have detected logs.openstack.org as a tracking site on this computer's firefox as well20:02
fungi(when trying to view the zuul.opendev.org build details)20:03
corvuscool20:03
corvusso i can add some error handling for this, but i think we would have to actually merge and deploy it to test it with PB20:04
corvussince the logs.o.o hosted version of this won't hit the error20:04
corvusoh, i wonder if we could use zuul-preview20:04
corvusyes!20:10
fungiwow, a new use case for it!20:10
corvusfungi: can you visit http://site.1e8199ad98454be297311a2542315ed8.zuul.zuul-preview.opendev.org/build/3c841507c8c345f0a4c83dc8fb8b6d00  and tell me if the problem shows up?20:10
clarkbwow hax20:11
corvusthat's just the most recent build from the old patch series20:11
corvusbut if it works, then it means i can mock up a solution and we can test it pre-merge20:11
fungi"File Not Found"20:11
corvuswhat's the context for that?20:11
fungimaybe i got the url wrong20:11
corvusfwiw, that url works for me, including the log tree and rendering job-output.txt20:12
corvusoh ha20:12
corvusa reload gets 40420:12
corvusso, we might be hitting a zuul-preview bug20:12
corvusoh no i know what it is20:12
corvusi deep linked, but we can't do that with preview sites20:12
corvusfungi: go to http://site.1e8199ad98454be297311a2542315ed8.zuul.zuul-preview.opendev.org/status20:13
corvusgrr20:13
corvusfungi: go to http://site.1e8199ad98454be297311a2542315ed8.zuul.zuul-preview.opendev.org/20:13
corvusfungi: then navigate to a buld using the builds tab20:13
corvusany build should do20:13
corvus(so click "builds" then click the first "success" link on the list)20:13
fungiprivacy badger is currently blocking content from zuul.openstack.org there for me. will set it to allow20:14
fungiallowing cookies for zuul.openstack.org got the initial url working20:14
corvus(that sounds like the same error)20:14
fungii concur20:15
corvuswe have 3 sites involved now, so 2 places where we can hit that error20:15
corvushappily we don't really need to solve this one20:15
fungiand yeah, on a build it is flagging logs.openstack.org as a blocked tracker20:15
corvusfungi: w00t20:16
corvusi will go add some error handling based on just a 404 and we can see if that's the same20:16
jeliu_ansible20:16
jeliu_^sorry accident20:16
fungii will go to the grocery store, but shouldn't be gone long. pabelanger may also be able to test20:17
pabelangersame, GET https://zuul.openstack.org/api/info net::ERR_BLOCKED_BY_CLIENT for url above20:18
corvusother than the config-errors, i can't find a place where we report an error to a user; can anyone think of one?20:21
*** themroc has joined #zuul20:24
corvusfound it20:24
openstackgerritJames E. Blair proposed zuul/zuul master: js: correct action names  https://review.opendev.org/67368020:28
corvusi have learned something about the way our app is structured.  :)20:29
corvusonce the preview build is ready for that, i'll paste in the new url20:29
corvusi'm going to debug the json issue while we wait20:33
*** pabelanger has quit IRC20:37
corvusokay, the json issue is (this may not surprise anyone) that we're given in actual javascript object when we fetch that, rather than a string.20:38
*** mhu has quit IRC20:38
*** sgw has joined #zuul20:39
mordredcorvus: hahahaha20:41
openstackgerritJeff Liu proposed zuul/zuul-operator master: use opendev image building system for zuul-operator test  https://review.opendev.org/67302020:46
openstackgerritJeff Liu proposed zuul/zuul-jobs master: Add auth config to kubelet user for buildset registries  https://review.opendev.org/67335120:48
*** igordc has quit IRC20:50
openstackgerritJames E. Blair proposed zuul/zuul master: js: don't transform json logfiles  https://review.opendev.org/67368820:54
corvusthat should take care of that one20:54
mordred\o/20:55
corvusfungi: can you try http://site.7ee9de4db7ca498ead5c80429d0b6830.zuul.zuul-preview.opendev.org/  ?21:37
*** jeliu_ has quit IRC21:46
fungii am back and can definitely try that21:50
fungimy browser is really, really slow at the moment. please wait :/21:51
fungiokay, so that initial page worked because i was allowing zuul.openstack.org cookies. retrying with them disabled21:52
corvusfungi: i expect you're going to need to allow from zuul.openstack.org21:54
fungiyeah, so with cookies to zuul.openstack.org blocked, http://site.7ee9de4db7ca498ead5c80429d0b6830.zuul.zuul-preview.opendev.org/ just spins forever at "Fetching info..."21:54
fungii'll reallow those and then see about the builds page21:54
corvusi think we're only interested in what happens when you go to the builds page21:54
fungifair21:55
fungire-set it to block cookies for logs.openstack.org now21:56
fungino error message... i just don't get a logs tab when i select a build's detail21:57
corvusfungi: what happens if you enable the network pane?21:58
corvusfungi: oh, also, try going to the developer console and clicking the "XHR" button21:59
corvusmaybe mordred's idea of not receiving an error response is at play, in which case, i'd love some suggestion as to what that actually looks like22:00
*** themroc has quit IRC22:02
*** jamesmcarthur has joined #zuul22:09
fungiwill check22:09
fungiaha, under web developer -> web console22:11
fungiooh, this is fun22:12
fungiCross-Origin Request Blocked: The Same Origin Policy disallows reading the remote resource at http://logs.openstack.org/81/668181/1/gate/build-openstack-releasenotes/f863b3a/zuul-manifest.json. (Reason: CORS request did not succeed).22:12
fungiCross-Origin Request Blocked: The Same Origin Policy disallows reading the remote resource at http://logs.openstack.org/81/668181/1/gate/build-openstack-releasenotes/f863b3a/html/job-output.json. (Reason: CORS request did not succeed).22:12
corvusokay, so it looks like it's the same mech for cors22:14
corvusthat's a less esoteric error, so that may be a thread we can pull on22:14
*** panda has quit IRC22:15
fungiright, that doesn't 100% jive with my experience that pb is blocking cookies for logs.o.o and if i allow cookies for logs.o.o the content loads22:17
*** panda has joined #zuul22:18
corvusfungi: yeah, but i'm thinking that's how pb implements its blocking -- it somehow triggers the same codepath that cors does22:18
fungioh, entirely possible22:19
corvus(maybe behind the scenes if it wants to block something, it updates firefox's cors value for a site)22:19
*** sanjayu_ has quit IRC22:22
*** sanjayu_ has joined #zuul22:23
*** jamesmcarthur has quit IRC22:39
openstackgerritJames E. Blair proposed zuul/zuul master: Attempt to report CORS and related errors  https://review.opendev.org/67370722:47
corvusfungi: ^ that's based on a cors failure i manufactured; once we have that available through the preview site, we should see if that handles the PB case too22:48
openstackgerritClark Boylan proposed zuul/zuul master: Cleanup extra /'s in manifest render view  https://review.opendev.org/67360522:51
*** rfolco|ruck has quit IRC23:02
*** michael-beaver has quit IRC23:15
clarkbcorvus: I'm not sure ^ is working beacuse I get weird urls back out except not weird in the way I expected (missing /s or extra /s) weird beacuse there are extra works in the urls. Maybe that is beacuse of how I am viewing them in js off of the logserver?23:38
clarkbhttp://logs.openstack.org/05/673605/2/check/zuul-build-dashboard/5d07d5f/npm/html/build/bc7c11147a464bd48c06f44677608611#logs has an extra /html/ in the raw url23:39
corvusclarkb: it's because the log_url has an html in it23:42
corvusi think that was overwritten with success_url23:43
clarkboh so not related to my change but likely a bug we need to fix anyway?23:43
corvusyep23:43
corvusi think we need to update zuul to store the original log_url in the database, not what was reported back23:44
corvusalso, i think we're going to need to deprecate success-url and failure-url altogether23:44
clarkbor turn them into something the builds page can link to?23:44
corvusyes -- that part is already there -- many of our jobs now report those as "artifacts"23:45
clarkboh right23:45
corvusnot that one though, so we should update it23:45
corvusand there's still ongoing cleanup for that https://review.opendev.org/673327 and https://review.opendev.org/672382 will make that much better23:46
corvusso anyway, i think we should change the log_url in the mysql reporter now, then over the next 2 weeks we can update the success-url jobs to return artifacts.  then when we make the switch, it should be pretty straightforward to get to preview builds23:49
corvusfungi: can you try http://site.142c8d68a65c4ca48341390fae29998a.zuul.zuul-preview.opendev.org/23:51
*** sanjayu_ has quit IRC23:52

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!