Wednesday, 2023-01-11

opendevreviewMerged openstack/project-config master: openstack-afs.yaml : correct indentation  https://review.opendev.org/c/openstack/project-config/+/86977200:17
*** swalladge is now known as Guest102701:51
opendevreviewMerged openstack/project-config master: Add nb04 config  https://review.opendev.org/c/openstack/project-config/+/86976902:41
*** bhagyashris|brb is now known as bhagyashris06:39
*** bhagyashris is now known as bhagyashris|afk06:39
*** soniya29 is now known as soniya29|lunch08:01
*** jpena|off is now known as jpena08:29
*** soniya29|lunch is now known as soniya2909:18
opendevreviewdaniel.pawlik proposed openstack/ci-log-processing master: Add Opensearch dashboards backup script; add dashboards objects  https://review.opendev.org/c/openstack/ci-log-processing/+/86081109:22
opendevreviewdaniel.pawlik proposed openstack/ci-log-processing master: DNM Add ndjson OpenSearch Dashboards objects  https://review.opendev.org/c/openstack/ci-log-processing/+/86980009:28
opendevreviewdaniel.pawlik proposed openstack/ci-log-processing master: Add Opensearch dashboards backup script; add dashboards objects  https://review.opendev.org/c/openstack/ci-log-processing/+/86081109:39
*** rlandy|out is now known as rlandy11:15
*** bhagyashris|afk is now known as bhagyashris11:32
Tenguhello there! Quick question for you, Infra folks ( fungi, clarkb maybe?): do we have the "ansible-galaxy" command available in the test job for system-config repository? If so, I'd be happy to update https://review.opendev.org/c/opendev/system-config/+/869819 in order to be 100% sure it's working now.12:45
*** soniya29 is now known as soniya29|afk13:04
clarkbTengu: I'm not sure I understand the question. Test jobs regardless of repository are typically expected to manage their dependencies direclt.y If you need a command installed then you need to install it15:50
Tenguclarkb: the question was: is that command already available in the test associated to system-config repository, if not, how shall I add it, and, well, "is it a good idea"?15:51
clarkbTengu: I don't think it is already available. We don't use ansible galaxy anywhere anymore instead we just directly install git repos iirc.15:52
clarkbYou can install it (via pip?) in a test job to test the mirror setup15:52
Tenguclarkb: ok. I'll have a look shortly.15:53
TenguI'd rather double-check the proxy is working ^^'. The "it's work locally" is nice, but... ;)15:54
Tengu'k, found a way that should make things OK - without installing ansible.16:35
*** d34dh0r5| is now known as d34dh0r5316:56
*** d34dh0r53 is now known as d34dh0r5-16:58
*** dmellado_ is now known as dmellado17:03
*** jpena is now known as jpena|off17:21
dansmithfungi: did you ever notice or hear anything about the new line limit restriction for syntax highlighting?19:11
dansmithit's low enough that a large number of nova files (that I've look at thus far) aren't highlighted, which is a real bummer19:12
fungiahh, no, i ended up sidetracked by other fires19:17
fungisorry about that19:17
fungiit might be of general interest to infra-root sysadmins and other folk now that more people are around again19:18
fungiwere you able to narrow down what the limit might be?19:18
clarkbfungi: its like 500 characters or something19:18
clarkbgerrit gives you a popup warning on the files affected and tells you what the limit is19:18
fungiahh, no this is gerrit silently not providing any syntax highlighting, seems like it's when the file is maybe over 2k lines long?19:19
clarkbit isn't silent19:19
fungiwe weren't able to narrow down whether it was for sure the file length, and whether if so whether it's linecount or bytecount19:19
clarkbit give you a popup that says it is doing it19:19
clarkband iirc its by line size. Once it finds a line that is over the threashold it gives up on the entire file19:19
fungiit wasn't giving me a popup, but maybe my browser was blocking/hiding that19:20
clarkbits one of thos elittle yellow alert things19:20
dansmithclarkb: I don't get the popup almost any of the time19:20
dansmithI saw it once yesterday, so I've been looking for it, but it is very much not always showing19:20
clarkbcan someone link me ot an example file so I can look? I noticed this after the upgrade and it definite gave me the little yellow window saying why it wasn't highlighting19:20
dansmithclarkb: and what I'm seeing is the entire file is not highlighted, not per line19:20
clarkbdansmith: correct19:20
fungithere were a few examples in channel last week or so, i'll check scrollback19:21
dansmithso maybe the popup is just for the line thing, but we have <80 lines19:21
clarkbit gives up on the entire file once it hits a line above a certain length aiui19:21
dansmithhttps://review.opendev.org/c/openstack/nova/+/863918/6/nova/tests/unit/compute/test_compute_mgr.py19:21
fungilooks like we talked about it on 2023-01-0319:21
dansmithI meant "<80 char lines almost everywhere"19:21
fungino highlighting on https://review.opendev.org/c/openstack/nova/+/867832/2/nova/compute/manager.py for example19:21
clarkbI wonder if it also applies to file length and doesn't give you the warning for that19:22
clarkbor maybe it gives your user a warning once?19:22
clarkbhttps://review.opendev.org/c/opendev/system-config/+/866781/2/inventory/base/group_vars/all.yaml theres the warning for line length19:22
dansmithnot that I ever saw.. first one since the upgrade Ive seen was yesterday, which was probably line length19:22
dansmithnow that says the whole file won't be highlighted because of the one line19:23
clarkbmy hunch is that they are doing similar on file size but not warning you about it19:23
dansmithbut I'm pretty sure those py files are not triggering that as they should all be short lines19:23
dansmithyeah19:23
fungiwe saw syntax highlighting on a 3k line file but no syntax highlighting on a 7k line file19:23
dansmithyeah19:23
clarkbpolygerrit-ui/app/services/highlight/highlight-service.ts:export const CODE_MAX_LINES = 20 * 1000;19:25
clarkbpolygerrit-ui/app/services/highlight/highlight-service.ts:const CODE_MAX_LENGTH = 25 * CODE_MAX_LINES;19:25
dansmithit definitely stops on files <20KLOC19:26
clarkbyour example is under that limit19:26
clarkbalso the code that checks CODE_MAX_LINES is adjacent to the one that checks max line length and they both fire warnings the same way19:26
fungimaybe pygments or whatever lib provides the highlighting has its own baked-in limit which is coming into play19:27
dansmithwell, it's clearly new, so it'd have to be some new restriction in that lib that came in via the upgrade or something19:27
clarkbits looking at getDiffLength though so it may be related to the larger diff and not the size of one side19:27
dansmithpretty sure it happens on large files with small diffs19:27
dansmithhttps://review.opendev.org/c/openstack/nova/+/863919/6/nova/tests/unit/compute/test_compute_mgr.py19:28
dansmiththat's a few lines of diff, large file, no highlight19:28
clarkbya I suspect the reason we don't get the warning here is we're below those constants. But then something else like the thing actually doing the highlighting is giving up19:29
clarkbif you look in the console log it shows "Diff Syntax Render: 0" Cross checking with the code this seems to be the timing for how long it took to syntax highlight19:33
dansmithdo you see these? Deprecated as of 10.7.0. highlight(lang, code, ...args) has been deprecated.19:33
dansmithand a bunch of font failures19:34
dansmithI don't get the diff syntax render message19:34
dansmithI get the deprecated and font messages even on files that do highlight, so must be unrelated19:35
clarkbI get the font stuff but don't see the highlight deprecation19:35
clarkbin the syntax highlighter worker it checks if it is enabled and if not returns early. So now i'm back to thinking something trips that enabled flag to fale19:35
clarkb*false19:35
dansmithalso something about a deprecated plugin api with opendev-theme19:35
dansmiththese are all my warnings, just FYI: https://pastebin.com/GaFf0fAZ19:36
clarkbthe theme is a known thing. They changed their js framework again so all of our existing stuff has to be updated prior to the 3.7 upgrade19:37
clarkbbut it should be fine in 3.619:37
dansmithokay19:37
clarkbthere is some formula they use to calculate the diff size. I wonder if that could be it (but then it doesn't explain why we don't get the alert for this case)19:48
fungicould it be that the highlighter is taking too long on larger files for some reason, so gerrit's giving up on that and just showing the raw uncolorized version?19:53
clarkbfungi: maybe, though it it self reporting it took 0 time (ms?) to do the syntax rendering which implies to me it isn't even trying19:54
clarkbok heres my hunch its CODE_MAX_LENGTH (not CODE_MAX_LINES) that we are tripping over19:55
clarkbthat allows for so many bytes I think before it short circuits and I'm guessing we're over that19:56
clarkblet me get a code link19:56
clarkbhttps://gerrit.googlesource.com/gerrit/+/refs/tags/v3.6.3/polygerrit-ui/app/services/highlight/highlight-service.ts#133 I'm pretty sure that is causing it19:57
clarkbwhy they don't do the check when they do the other checks and raise the alert I don't know but no alert is raised there19:57
clarkbmanager.py is ~551364 bytes19:58
clarkbwe are allowed 25 * 20 * 1000 = 500000 bytes which we are just over19:59
clarkbI can file a bug for that if we can articulate what the issue(s) is/are. At the very least it seems like they should do these length checks consistently so they all alert consistently to avoid user confusion20:02
dansmithwhy would that not be a configurable limit?20:02
clarkbyou'd have to ask them. But its probably based on some benchmarking of their syntax highlighting tool20:02
dansmithbut it clearly got turned down recently20:03
clarkbor maybe wasn't there before20:03
dansmithand even still, if we all have fast machines with lots of memory, should be our choice20:03
clarkbso maybe "user programmable limits" for syntax highlighting20:03
dansmithyeah20:03
dansmithwhat I meant by my why question is, why wouldn't the bug be "this limit should be configurable"20:04
clarkbit wouldn't surprise me if google has a response time requirement for all google apps and this kept them under it20:04
clarkbconfirmed that a googler made the change. They also annotated the commit as not deserving a release note20:05
dansmithlol20:05
clarkbit says "safe guard for not killing the browser"20:07
clarkbbut unfortinately no additioanl info on how those limits were chosen20:07
clarkbthere is a google bug id though20:07
clarkbso if you worked at google you could probably find out20:08
clarkbI need to figure out lunch, but I can work on a bug after20:08
dansmithwell, unless they made it substantially suckier, they just chose a value low enough to make their target and not actually avoid killing the browser20:08
clarkbI think there are two parts the first is consistently reporting the givng up to avoid confusion and second suggesting it be user configurable20:08
dansmithor, not just20:09
dansmithyeah20:09
dansmiththanks clarkb 20:09
opendevreviewJay Faulkner proposed openstack/project-config master: Noop change to ironic-inspector.config  https://review.opendev.org/c/openstack/project-config/+/86987221:51
clarkbdansmith: fungi https://bugs.chromium.org/p/gerrit/issues/detail?id=1659222:07
dansmithnice, thanks22:08
opendevreviewJay Faulkner proposed openstack/project-config master: Noop change to ironic-inspector.config  https://review.opendev.org/c/openstack/project-config/+/86987222:10
opendevreviewJay Faulkner proposed openstack/project-config master: Remove redundant editHashtag lines  https://review.opendev.org/c/openstack/project-config/+/86987822:35
*** rlandy is now known as rlandy|out22:58
opendevreviewMerged openstack/project-config master: Remove redundant editHashtag lines  https://review.opendev.org/c/openstack/project-config/+/86987822:58
opendevreviewJay Faulkner proposed openstack/project-config master: Correct syntax on toggleWipState  https://review.opendev.org/c/openstack/project-config/+/86988223:12
*** dasm is now known as dasm|off23:20
opendevreviewMerged openstack/project-config master: Correct syntax on toggleWipState  https://review.opendev.org/c/openstack/project-config/+/86988223:50

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!