Monday, 2021-08-09

*** marios is now known as marios|ruck05:32
*** jpena|off is now known as jpena07:35
*** rpittau|afk is now known as rpittau07:52
opendevreviewMatthieu Huin proposed zuul/zuul master: web UI: user login with OpenID Connect  https://review.opendev.org/c/zuul/zuul/+/73408208:49
opendevreviewMatthieu Huin proposed zuul/zuul master: Add authentication-realm attribute to tenants  https://review.opendev.org/c/zuul/zuul/+/73558608:49
opendevreviewMatthieu Huin proposed zuul/zuul master: web UI: allow a privileged user to dequeue a change  https://review.opendev.org/c/zuul/zuul/+/73485008:49
opendevreviewMatthieu Huin proposed zuul/zuul master: web UI: allow a privileged user to re-enqueue a change  https://review.opendev.org/c/zuul/zuul/+/73677208:49
opendevreviewMatthieu Huin proposed zuul/zuul master: Web UI: allow a privileged user to request autohold  https://review.opendev.org/c/zuul/zuul/+/76811508:49
opendevreviewMatthieu Huin proposed zuul/zuul master: Web UI: add Autoholds, Autohold page  https://review.opendev.org/c/zuul/zuul/+/76819908:49
opendevreviewMatthieu Huin proposed zuul/zuul master: REST API, Web UI: add pipelines' manager, triggers data in status  https://review.opendev.org/c/zuul/zuul/+/73696808:49
opendevreviewMatthieu Huin proposed zuul/zuul master: web UI: allow a privileged user to promote a change  https://review.opendev.org/c/zuul/zuul/+/78185809:41
opendevreviewMatthieu Huin proposed zuul/zuul master: Example Docker compose: keycloak integration  https://review.opendev.org/c/zuul/zuul/+/76994309:42
*** jcapitao is now known as jcapitao_lunch10:41
opendevreviewMatthieu Huin proposed zuul/zuul master: Web UI: Add "Create Autohold Request" form, improve API error messages  https://review.opendev.org/c/zuul/zuul/+/80255910:43
opendevreviewMatthieu Huin proposed zuul/zuul master: Example Docker compose: keycloak integration  https://review.opendev.org/c/zuul/zuul/+/76994310:53
*** jpena is now known as jpena|lunch11:39
*** jpena|lunch is now known as jpena12:32
opendevreviewMatthieu Huin proposed zuul/zuul master: web UI: allow a privileged user to re-enqueue a change  https://review.opendev.org/c/zuul/zuul/+/73677214:06
erbarrHi, I'm trying to run a task now which is a "shell" in the job.yaml file but on zuul I'm seeing a "waiting on logger" repeating until a "[Zuul] Log stream did not terminate". I'm also not seeing any Task Summary, Artifacts, Logs, or Console. What am I missing to populate those?15:02
fungierbarr: does the job include the start-zuul-console role? usually you'd add it to the pre-run playbook of your base job so that all jobs inherit that behavior15:03
erbarrahh, okay, let me add that15:04
fungierbarr: here's where we add it to opendev's base job, for example: https://opendev.org/opendev/base-jobs/src/branch/master/playbooks/base/pre.yaml#L2515:05
*** marios|ruck is now known as marios15:06
*** marios is now known as marios|ruck15:08
erbarrthanks!15:09
fungiandrii_ostapenko: see #opendev, clarkb has cleaned those up now. i suspect they may have been the result of reenqueuing earlier items in those pipelines after a recent restart15:22
andrii_ostapenkofungi: cool, thx!15:22
*** jpena is now known as jpena|off15:32
clarkbcorvus: only 2 sos changes this morning and one one of them isn't approved \o/15:40
clarkb*only one isn't approved15:40
corvusyeah, we should make some more :)15:42
corvusclarkb: i see 3 changes15:48
clarkboh ya the zk key management change. I don't know why gerrit shows you emrged things by default which makes the lists long and you miss open hcanges like that15:49
clarkblooks like that change needs to be rebased too15:49
opendevreviewJames E. Blair proposed zuul/zuul master: Stop running mypy in linters  https://review.opendev.org/c/zuul/zuul/+/80360215:49
corvusoh it does, i'll rebase15:50
opendevreviewJames E. Blair proposed zuul/zuul master: Add commands to export/import keys to/from ZK  https://review.opendev.org/c/zuul/zuul/+/80085415:51
*** marios|ruck is now known as marios16:11
*** rpittau is now known as rpittau|afk16:26
*** marios is now known as marios|out16:39
nirmoyI was working on bad get repo where HEAD points to an non-existing master branch. Now we changed HEAD to point to correct branch, we have no master branch for that repo. I understand zuul maintains local cache of git repos, how do I ask zuul to refresh that cache ?16:41
clarkbnirmoy: you should be able to simply delete the repo in the zuul merger and executor dirs /var/lib/zuul/executor-git and /var/lib/zuul/git16:44
clarkbzuul will reclone when it doesn't already have the repo cloned. You may want to pause zuul's processing of jobs to do that safely though16:44
clarkbsafely meaning jobs won't fail due to intermediate states however it seems they are likely to fail anyway?16:45
nirmoyclarkb: Thanks! Yes jobs are failing already 16:46
clarkbnirmoy: another option would be to do srugery in the git repos there and fix the head16:47
clarkbyou might prefer this if the repo is very large and recloning will be a slow process16:47
nirmoyclarkb: ah that is even better, thanks :) 16:49
corvusclarkb and i are tracking down a potential issue first found in #opendev16:51
clarkbcorvus: I see if not self.last_reconfigured: <- in startCleanup16:51
corvusit looks like we may not be running the semaphore cleanup16:51
clarkbI think that may be the issue16:51
corvusyeah... i think maybe the solution is we don't need that anymore, but lemme think about that a minute16:52
clarkbcorvus: we can probably confirm this by doing a thread dump and looking for a thread named 'cleanup start' normally it would go away after scheduling the apsched stuff but I think it may be spinning on that condition16:52
corvusclarkb: agreed16:52
corvusi'll do that16:54
clarkbok16:54
clarkbdon't forget to run it twice to turn off the yappi stuff (otherwise zuul gets slow)16:54
corvusya16:55
corvusyeah, cleanup start is running16:56
corvusi'll work on a patch16:56
clarkbI suspect that condition was there before to ensure we know about all the semaphores so that when we cleanup we aren't cleaning up inappropriately?16:59
corvusclarkb: exactly16:59
opendevreviewJames E. Blair proposed zuul/zuul master: Fix cleanup thread not starting  https://review.opendev.org/c/zuul/zuul/+/80394417:00
corvusclarkb: i think we can repair opendev without a restart by essentially running that ^ from the repl17:01
clarkbcorvus: re the comment in your change I'm not sure that we necesarily want to store that in zk as the state that matters is in the running process: eg does it know about the configs?17:05
clarkbcorvus: maybe instead we want to set scheduler.config_loaded to true in prime()? and check that flag?17:05
clarkbor scheduler.primed = True.17:06
corvusclarkb: sorry i meant my comment to mean the other thing: instead of setting last_reconfigured to time.time() set it to whatever is in zk17:06
corvusany non-null vallue is sufficient17:06
clarkboh I see since the actual last reconfigured time doesn't really matter17:06
clarkbjust that we've read a config and set a flag saying we have done so17:06
corvusyep.  and right now, it's slightly wrong from a human pov, so i'm suggesting when we're able to, we use a more human-meaningful value17:07
clarkbmakes sense17:07
corvusbut really, the main point of that comment was to make sure that people know about the relationship between that and the cleanup thread wait :)17:07
corvusso that no one just removes it without thinking of it17:08
clarkb++17:09
opendevreviewMatthieu Huin proposed zuul/zuul master: web UI: allow a privileged user to dequeue a change  https://review.opendev.org/c/zuul/zuul/+/73485017:13
corvusclarkb: aha, i think i get the issue that's causing the semaphore red herrings17:18
opendevreviewJames E. Blair proposed zuul/zuul master: Suppress spurious semaphore lock error logs  https://review.opendev.org/c/zuul/zuul/+/80394817:24
corvusclarkb: ^17:24
clarkblooking17:24
corvusi think we should restart opendev after those 2 land and consider that a candidate for release17:51
clarkbtobiash[m]: can you review the parent of ^ https://review.opendev.org/c/zuul/zuul/+/803944/ as well if you are stillaround?17:52
clarkbthis fixes a regression created by the most recent sos changes17:52
clarkbcorvus: I'm tryingto catch up on https://review.opendev.org/c/zuul/zuul/+/800854 and wondering if you saw my latest comments on ps317:58
clarkbcorvus: specifically the thing about --force17:59
corvusclarkb: i think i implemented --force17:59
clarkboh I should do a diff then sorry17:59
corvusclarkb: latest ps is only a rebase18:00
corvus3..4 is meaningful diff18:00
clarkbthanks18:00
corvus(4..5 is a rebase with a resolved merge conflict, which is why it's not a trivial rebase and didn't carry over tobiash's vote, but the merge confict was just textual proximity, no actual changes needed; i think we can consider the +2 still applies.)18:01
clarkband there isn't a followon change to do the copy delete things yet? I was looking for that too and not seeing it18:02
corvusclarkb: i'm writing it now :)18:08
clarkbgerrit's diff of ps3..ps4 seems the same as base..ps418:13
clarkbI'll just review ps5 in that case :/18:13
corvusreally?  gertty's diff is way different18:14
clarkbI guess it isn't compeltely the same but for a number of files it seems to be18:14
clarkbthere must be some weird rebase thing it is trying to accomodate there? I don't understand it18:15
clarkboh hrm I think I see why, it is that ps4 is sufficiently different than ps3 that its delta between base and ps3 renders similarly?18:15
corvusclarkb: gerrit's 3..4 diff looks correct to me18:16
clarkbya I think it is correct, it is larger than I anticipated because it differs sufficiently from ps3 that it is similar to delta to base18:16
corvusthat's possible.  the tests and test fixtures are very similar.18:17
corvusalmost everything else changed :)18:17
opendevreviewJames E. Blair proposed zuul/zuul master: Add copy-keys and delete-keys zuul client commands  https://review.opendev.org/c/zuul/zuul/+/80397318:32
corvusclarkb: there ya are18:32
clarkbthanks, sorry got distracted but I'm trying to do those reviews18:33
opendevreviewMatthieu Huin proposed zuul/zuul master: web UI: allow a privileged user to re-enqueue a change  https://review.opendev.org/c/zuul/zuul/+/73677220:02
opendevreviewMatthieu Huin proposed zuul/zuul master: Web UI: allow a privileged user to request autohold  https://review.opendev.org/c/zuul/zuul/+/76811520:02
opendevreviewMatthieu Huin proposed zuul/zuul master: Web UI: add Autoholds, Autohold page  https://review.opendev.org/c/zuul/zuul/+/76819920:02
opendevreviewMatthieu Huin proposed zuul/zuul master: REST API, Web UI: add pipelines' manager, triggers data in status  https://review.opendev.org/c/zuul/zuul/+/73696820:02
opendevreviewMatthieu Huin proposed zuul/zuul master: web UI: allow a privileged user to promote a change  https://review.opendev.org/c/zuul/zuul/+/78185820:02
opendevreviewMatthieu Huin proposed zuul/zuul master: Web UI: Add "Create Autohold Request" form, improve API error messages  https://review.opendev.org/c/zuul/zuul/+/80255920:02
opendevreviewMatthieu Huin proposed zuul/zuul master: Example Docker compose: keycloak integration  https://review.opendev.org/c/zuul/zuul/+/76994320:02
*** dviroel is now known as dviroel|brb20:06
opendevreviewMatthieu Huin proposed zuul/zuul master: web UI: user login with OpenID Connect  https://review.opendev.org/c/zuul/zuul/+/73408220:42
opendevreviewJames E. Blair proposed zuul/zuul master: DNM: Add script to pre-populate private keys  https://review.opendev.org/c/zuul/zuul/+/80399120:43
clarkbcorvus: making sure I'm reading these changes properly. The lastest import/export code dumps everything to a single json file and imports from a single json file?20:44
corvusclarkb: correct20:45
clarkbthanks for confirming20:46
corvusso if you want to do surgery, you need to use a json parser.  but hopefully copy-keys and delete-keys reduces the need for surgery20:46
clarkb++ I did leave a comment about some test asserts that might be worth a followup but +2'd20:47
clarkblooks like the copy and delete stuff failed testing fwiw20:47
*** dviroel|brb is now known as dviroel20:50
corvusprobably some white-box tests that need updating for the refactor20:53
corvusclarkb: re you comment i think we should delete the entire test file because it's covered by testv3.TestProjectKeys.testkey_generation  -- does that work for you?20:56
clarkbcorvus: I'll look shortly, finishing up revie wof copy and delete. I think I found one issue that may be making tests unhappy20:57
clarkbcorvus: ok those comments have been posted21:01
clarkbcorvus: yes I think removing that test in favor of test_key_generation is fine if we don't care about the specific key contents being reliably read back which seems to be the only thing different happening in the to be deleted test?21:06
corvusclarkb: i think other tests verify that the loaded secrets are actually the fixtures  (any test that actually has an encrypted secret)21:09
clarkbah good point21:10
clarkbsince they wouldn't decrypt otherwise21:10
opendevreviewJames E. Blair proposed zuul/zuul master: Add copy-keys and delete-keys zuul client commands  https://review.opendev.org/c/zuul/zuul/+/80397321:10
opendevreviewMatthieu Huin proposed zuul/zuul master: web UI: allow a privileged user to re-enqueue a change  https://review.opendev.org/c/zuul/zuul/+/73677221:19
clarkbcorvus: one additional thought on those backups: do we need to make them 0600? Or are we happy with the fact they are still covered by the encryption key?21:21
corvusclarkb: seems like 0600 would be good 21:26
opendevreviewMerged zuul/zuul master: Fix cleanup thread not starting  https://review.opendev.org/c/zuul/zuul/+/80394421:27
opendevreviewMatthieu Huin proposed zuul/zuul master: Add authentication-realm attribute to tenants  https://review.opendev.org/c/zuul/zuul/+/73558621:29
opendevreviewMatthieu Huin proposed zuul/zuul master: web UI: allow a privileged user to dequeue a change  https://review.opendev.org/c/zuul/zuul/+/73485021:29
opendevreviewMatthieu Huin proposed zuul/zuul master: web UI: allow a privileged user to re-enqueue a change  https://review.opendev.org/c/zuul/zuul/+/73677221:30
opendevreviewMatthieu Huin proposed zuul/zuul master: Web UI: allow a privileged user to request autohold  https://review.opendev.org/c/zuul/zuul/+/76811521:32
opendevreviewMatthieu Huin proposed zuul/zuul master: Web UI: add Autoholds, Autohold page  https://review.opendev.org/c/zuul/zuul/+/76819921:32
opendevreviewMatthieu Huin proposed zuul/zuul master: REST API, Web UI: add pipelines' manager, triggers data in status  https://review.opendev.org/c/zuul/zuul/+/73696821:32
opendevreviewMatthieu Huin proposed zuul/zuul master: web UI: allow a privileged user to promote a change  https://review.opendev.org/c/zuul/zuul/+/78185821:32
opendevreviewMatthieu Huin proposed zuul/zuul master: Web UI: Add "Create Autohold Request" form, improve API error messages  https://review.opendev.org/c/zuul/zuul/+/80255921:32
opendevreviewMatthieu Huin proposed zuul/zuul master: Example Docker compose: keycloak integration  https://review.opendev.org/c/zuul/zuul/+/76994321:32
*** dviroel is now known as dviroel|out21:47
opendevreviewJames E. Blair proposed zuul/zuul master: Fix race in test_lost_merge_requests  https://review.opendev.org/c/zuul/zuul/+/80385022:03
corvusclarkb, tobiash: ^ that hit the test race it was aiming to fix, but i think i was able to find the underlying issue now22:04
opendevreviewJames E. Blair proposed zuul/zuul master: Join the scheduler thread before stopping the zk client  https://review.opendev.org/c/zuul/zuul/+/80385122:04
clarkbcorvus: small thing on that bug fix but I +2'd anyway22:08
opendevreviewJames E. Blair proposed zuul/zuul master: Add commands to export/import keys to/from ZK  https://review.opendev.org/c/zuul/zuul/+/80085422:10
corvusclarkb: ack; i'll fix it22:11
opendevreviewJames E. Blair proposed zuul/zuul master: Fix race in test_lost_merge_requests  https://review.opendev.org/c/zuul/zuul/+/80385022:12
opendevreviewJames E. Blair proposed zuul/zuul master: Join the scheduler thread before stopping the zk client  https://review.opendev.org/c/zuul/zuul/+/80385122:12
opendevreviewJames E. Blair proposed zuul/zuul master: Add copy-keys and delete-keys zuul client commands  https://review.opendev.org/c/zuul/zuul/+/80397322:12
corvusokay, i think that set is stable now :)22:13
pabelanger[m]unrelated to zuul, could someone recommend where best to ask questions for PBR? I am down the rabbit hole of git describe tags and multiple branches, and trying to understand more how it all works22:20
fungipabelanger[m]: officially, #openstack-oslo (that's the team overseeing reviews/approvals for the codebase)22:22
fungipabelanger[m]: unofficially, a lot also gets discussed in #openstack-infra22:22
fungiping me in either channel and i can try to help22:22
fungiit does also have documentation, though it's not as comprehensive as it could be (but really, when is documentation ever as comprehensive as it *could* be?)22:24
fungioh, and you can ask on the openstack-discuss@lists.openstack.org mailing list too if you prefer22:25
pabelanger[m]thanks, I'll post something into infra tomorrow for some help22:34
pabelanger[m]trying to figure out how to handle stable / main properly22:34

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!