| openstackgerrit | Merged opendev/system-config master: Filter docker directories out of cacti https://review.opendev.org/678730 | 00:11 |
|---|---|---|
| *** dpawlik has joined #openstack-infra | 00:11 | |
| *** hwoarang has quit IRC | 00:12 | |
| *** dchen has joined #openstack-infra | 00:13 | |
| *** ijw_ has joined #openstack-infra | 00:13 | |
| *** hwoarang has joined #openstack-infra | 00:14 | |
| ianw | fungi: any idea why snmpd not listening on lists.openstack.org? i restarted it and it is now -> http://paste.openstack.org/show/766137/ | 00:15 |
| *** dpawlik has quit IRC | 00:15 | |
| fungi | um... no clue what would have caused it to stop | 00:16 |
| *** ijw has quit IRC | 00:17 | |
| ianw | exactly same thing on afsdb01 & afsdb02 | 00:18 |
| *** ijw_ has quit IRC | 00:18 | |
| fungi | running but not listening, or not running at all? | 00:20 |
| ianw | running, but not listening | 00:32 |
| fungi | yeah, that seems strange | 00:34 |
| fungi | my guess would be a garden variety bug | 00:35 |
| ianw | alright, well i'll call that spring cleaning on cacti done, i've cleared out a range of old stuff ... there's a few oddities, i think some of the down hosts are falling to the asymmetric ipv6 rax issues, but i'm certainly not going to recreate the hosts | 00:37 |
| fungi | thanks! | 00:39 |
| *** gyee has quit IRC | 00:43 | |
| *** xarses has quit IRC | 00:53 | |
| AJaeger_ | config-core, here's a change to add api-ref jobs for adjutant for review: https://review.opendev.org/#/c/675766/ and infra-root, one Zuul docs update for system-config https://review.opendev.org/#/c/678733/ . Note that this renames pages you might have referenced... Reviews welcome, please | 00:56 |
| adriant | AJaeger_: ty for the Adjutant doc changes :) | 00:56 |
| *** auristor has quit IRC | 00:57 | |
| *** markvoelker has quit IRC | 00:57 | |
| AJaeger_ | adriant: you're welcome! | 00:58 |
| *** auristor has joined #openstack-infra | 00:59 | |
| *** dychen has joined #openstack-infra | 00:59 | |
| adriant | AJaeger_: I need to do a big rewrite of those docs soon, but will be good to get them publishing! Slowly Adjutant is becoming a 'real' project | 00:59 |
| *** larainema has joined #openstack-infra | 01:00 | |
| *** dchen has quit IRC | 01:02 | |
| ianw | clarkb: another one from yesterday -> https://review.opendev.org/#/c/678735/ ... i think the base job logstash fails ungracefully on things like promote jobs, but this would help diagnose it | 01:02 |
| *** bdodd_ has joined #openstack-infra | 01:04 | |
| *** bdodd has quit IRC | 01:05 | |
| *** dingyichen has joined #openstack-infra | 01:07 | |
| *** dychen has quit IRC | 01:10 | |
| *** xenos76 has quit IRC | 01:13 | |
| clarkb | ianw you'll also see it in the executor logs | 01:13 |
| ianw | yeah true | 01:14 |
| ianw | clarkb: http://paste.openstack.org/show/766139/ | 01:16 |
| openstackgerrit | Merged opendev/base-jobs master: log-processor: include full exception traceback https://review.opendev.org/678735 | 01:18 |
| *** jamesmcarthur has joined #openstack-infra | 01:22 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Fedora 30 functional and boot tests https://review.opendev.org/676582 | 01:22 |
| clarkb | ya the traceback will be useful :) | 01:28 |
| *** bhavikdbavishi has joined #openstack-infra | 01:30 | |
| *** markvoelker has joined #openstack-infra | 01:52 | |
| *** bhavikdbavishi has quit IRC | 01:52 | |
| *** jamesmcarthur has quit IRC | 01:54 | |
| openstackgerrit | Merged opendev/system-config master: Docs: Zuul v2 is dead https://review.opendev.org/678733 | 01:55 |
| *** markvoelker has quit IRC | 02:02 | |
| *** markvoelker has joined #openstack-infra | 02:03 | |
| openstackgerrit | Jeff Liu proposed zuul/zuul-operator master: Add PerconaXDB Cluster to Zuul-Operator https://review.opendev.org/677315 | 02:07 |
| *** nicolasbock has quit IRC | 02:09 | |
| *** apetrich has quit IRC | 02:09 | |
| *** eharney has quit IRC | 02:10 | |
| *** spsurya has joined #openstack-infra | 02:11 | |
| *** dpawlik has joined #openstack-infra | 02:11 | |
| *** markvoelker has quit IRC | 02:13 | |
| *** markvoelker has joined #openstack-infra | 02:14 | |
| *** dpawlik has quit IRC | 02:16 | |
| *** markvoelker has quit IRC | 02:24 | |
| *** ricolin has joined #openstack-infra | 02:25 | |
| *** xarses has joined #openstack-infra | 02:46 | |
| *** rh-jelabarre has quit IRC | 02:59 | |
| *** rh-jelabarre has joined #openstack-infra | 03:03 | |
| *** psachin has joined #openstack-infra | 03:10 | |
| *** bhavikdbavishi has joined #openstack-infra | 03:14 | |
| *** rh-jelabarre has quit IRC | 03:15 | |
| *** ramishra has joined #openstack-infra | 03:17 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 03:19 | |
| *** bhavikdbavishi has quit IRC | 03:20 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 03:20 | |
| *** ianychoi has quit IRC | 03:29 | |
| *** ianychoi has joined #openstack-infra | 03:30 | |
| *** rfolco has quit IRC | 03:32 | |
| *** markvoelker has joined #openstack-infra | 04:05 | |
| *** markvoelker has quit IRC | 04:10 | |
| *** dpawlik has joined #openstack-infra | 04:13 | |
| *** dpawlik has quit IRC | 04:17 | |
| *** tkajinam_ has joined #openstack-infra | 04:37 | |
| *** tkajinam has quit IRC | 04:40 | |
| *** darvon has quit IRC | 04:40 | |
| *** dave-mccowan has quit IRC | 04:40 | |
| *** darvon has joined #openstack-infra | 04:41 | |
| *** raukadah is now known as chkumar|rover | 04:47 | |
| *** rkukura has quit IRC | 04:47 | |
| AJaeger_ | adriant: understood - now you can start at a good base | 04:52 |
| openstackgerrit | Andreas Jaeger proposed opendev/system-config master: Zuul docs: Remove obsolete note https://review.opendev.org/678985 | 04:52 |
| AJaeger_ | ianw: here's the followup you pointed out ^ | 04:53 |
| AJaeger_ | config-core, here's a change to add api-ref jobs for adjutant for review, please: https://review.opendev.org/#/c/675766/ | 04:54 |
| *** soniya29 has joined #openstack-infra | 04:55 | |
| *** odicha has joined #openstack-infra | 05:08 | |
| openstackgerrit | Merged openstack/project-config master: Identify Cinder as the Block Storage Service https://review.opendev.org/678931 | 05:11 |
| *** udesale has joined #openstack-infra | 05:14 | |
| *** markvoelker has joined #openstack-infra | 05:20 | |
| *** markvoelker has quit IRC | 05:25 | |
| *** jhesketh has quit IRC | 05:34 | |
| *** udesale has quit IRC | 05:38 | |
| ianw | AJaeger_: that post upload error has me stumped | 05:41 |
| AJaeger_ | which post upload error? | 05:42 |
| AJaeger_ | the logstash thing? | 05:42 |
| *** jhesketh has joined #openstack-infra | 05:42 | |
| ianw | yeah, the error is -> http://paste.openstack.org/show/766143/ | 05:44 |
| AJaeger_ | yeah, saw it one time as well ;( | 05:44 |
| AJaeger_ | did you follow a new promote after the traceback merged` | 05:45 |
| AJaeger_ | ah, that is with it | 05:45 |
| *** udesale has joined #openstack-infra | 05:45 | |
| *** udesale has quit IRC | 05:45 | |
| *** udesale has joined #openstack-infra | 05:45 | |
| ianw | host_vars comes from "hostvars" here -> https://opendev.org/opendev/base-jobs/src/branch/master/roles/submit-logstash-jobs/tasks/main.yaml#L7 | 05:46 |
| ianw | how it could not be set ... i dunno | 05:47 |
| AJaeger_ | strange ;( | 05:48 |
| AJaeger_ | sorry, need to leave now and can't help today | 05:49 |
| ianw | that's ok :) | 05:49 |
| *** ramishra has quit IRC | 05:49 | |
| *** ramishra has joined #openstack-infra | 05:53 | |
| *** rkukura has joined #openstack-infra | 05:56 | |
| openstackgerrit | Merged opendev/system-config master: Zuul docs: Remove obsolete note https://review.opendev.org/678985 | 05:58 |
| *** lpetrut has joined #openstack-infra | 06:00 | |
| *** dpawlik has joined #openstack-infra | 06:14 | |
| openstackgerrit | Merged zuul/zuul master: web: test trailing slash are removed from renderTree https://review.opendev.org/676824 | 06:14 |
| openstackgerrit | Benedikt Löffler proposed zuul/zuul master: Report retried builds via sql reporter. https://review.opendev.org/633501 | 06:18 |
| *** udesale has quit IRC | 06:26 | |
| *** jtomasek has joined #openstack-infra | 06:26 | |
| *** udesale has joined #openstack-infra | 06:27 | |
| *** slaweq has joined #openstack-infra | 06:27 | |
| *** udesale has quit IRC | 06:31 | |
| *** slaweq has quit IRC | 06:32 | |
| openstackgerrit | Dmitry Ukov proposed openstack/project-config master: New project request: airship/images https://review.opendev.org/677944 | 06:34 |
| *** ginopc has joined #openstack-infra | 06:44 | |
| *** slaweq has joined #openstack-infra | 06:48 | |
| *** trident has quit IRC | 07:08 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul master: Add linter rule disallowing use of var https://review.opendev.org/673841 | 07:08 |
| *** rcernin has quit IRC | 07:12 | |
| *** trident has joined #openstack-infra | 07:17 | |
| *** xek has joined #openstack-infra | 07:17 | |
| *** pkopec has joined #openstack-infra | 07:38 | |
| *** jpena|off is now known as jpena | 07:40 | |
| *** tosky has joined #openstack-infra | 07:40 | |
| onovy | clarkb: hi, https://review.opendev.org/#/c/678385/ depends-on review is merged now, can you +A this one pls? thanks | 07:49 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: Zuul Web: add /api/user/authorizations endpoint https://review.opendev.org/641099 | 07:56 |
| *** tkajinam_ has quit IRC | 08:02 | |
| *** ccamacho has joined #openstack-infra | 08:04 | |
| *** lucasagomes has joined #openstack-infra | 08:04 | |
| *** apetrich has joined #openstack-infra | 08:11 | |
| *** dingyichen has quit IRC | 08:21 | |
| *** pkopec has quit IRC | 08:23 | |
| *** pkopec has joined #openstack-infra | 08:24 | |
| *** ralonsoh has joined #openstack-infra | 08:24 | |
| *** jaosorior has quit IRC | 08:28 | |
| *** jaosorior has joined #openstack-infra | 08:29 | |
| *** yolanda__ is now known as yolanda | 08:30 | |
| *** derekh has joined #openstack-infra | 08:43 | |
| *** jaosorior has quit IRC | 08:46 | |
| *** xenos76 has joined #openstack-infra | 09:02 | |
| *** xenos76 has quit IRC | 09:07 | |
| *** xenos76 has joined #openstack-infra | 09:09 | |
| *** mtreinish has quit IRC | 09:13 | |
| *** mtreinish has joined #openstack-infra | 09:15 | |
| *** jaosorior has joined #openstack-infra | 09:31 | |
| *** rcosnita has joined #openstack-infra | 09:44 | |
| openstackgerrit | Dmitry Ukov proposed openstack/project-config master: New project request: airship/images https://review.opendev.org/677944 | 09:51 |
| *** sshnaidm|afk is now known as sshnaidm | 10:02 | |
| *** ricolin has quit IRC | 10:25 | |
| zbr | out-of-sync github mirrors is an accident or by design? i wasted some time trying to figure-out what was happening just to find that I had the github as origin. | 10:44 |
| zbr | neverming | 10:45 |
| *** nicolasbock has joined #openstack-infra | 11:08 | |
| *** tesseract has joined #openstack-infra | 11:12 | |
| *** dtantsur|afk is now known as dtantsur | 11:26 | |
| mordred | zbr: don't know if you saw via email notifications - but I got .gitreview files added to the gerrit source tree | 11:28 |
| zbr | mordred: long backlog of emails, trying to catch-up now.... | 11:29 |
| *** Lucas_Gray has joined #openstack-infra | 11:33 | |
| *** jpena is now known as jpena|lunch | 11:35 | |
| *** xenos76 has quit IRC | 11:39 | |
| mordred | yah. I know the feeling | 11:40 |
| *** markvoelker has joined #openstack-infra | 11:43 | |
| *** rlandy has joined #openstack-infra | 11:52 | |
| *** rlandy is now known as rlandy|ruck | 11:53 | |
| *** jaosorior has quit IRC | 11:58 | |
| *** rh-jelabarre has joined #openstack-infra | 12:01 | |
| *** dpawlik has quit IRC | 12:02 | |
| *** jaosorior has joined #openstack-infra | 12:11 | |
| *** rfolco has joined #openstack-infra | 12:15 | |
| *** rlandy|ruck is now known as rlandy|ruck|mtg | 12:19 | |
| openstackgerrit | Merged zuul/zuul master: Check refs and revs for repo needing updates https://review.opendev.org/678895 | 12:21 |
| *** jamesmcarthur has joined #openstack-infra | 12:22 | |
| *** jamesmcarthur has quit IRC | 12:29 | |
| *** dpawlik has joined #openstack-infra | 12:30 | |
| *** larainema has quit IRC | 12:30 | |
| *** jpena|lunch is now known as jpena | 12:32 | |
| openstackgerrit | Merged zuul/zuul master: Add linter rule disallowing use of var https://review.opendev.org/673841 | 12:35 |
| *** sthussey has joined #openstack-infra | 12:47 | |
| *** jamesmcarthur has joined #openstack-infra | 12:48 | |
| EmilienM | fungi: good morning! We will have (at least) one candidate for TripleO PTL, but this person is on PTO and contacted me in private to send the patch on behalf | 12:50 |
| *** ricolin has joined #openstack-infra | 12:50 | |
| *** soniya29 has quit IRC | 12:50 | |
| EmilienM | fungi: if I send the patch and this person manages to +1 from the phone/gerrit, would it be ok? | 12:50 |
| *** xenos76 has joined #openstack-infra | 13:05 | |
| *** mriedem has joined #openstack-infra | 13:09 | |
| *** dave-mccowan has joined #openstack-infra | 13:10 | |
| openstackgerrit | James E. Blair proposed ttygroup/gertty master: Fix a py3 error with exception formatting https://review.opendev.org/679050 | 13:10 |
| openstackgerrit | James E. Blair proposed ttygroup/gertty master: Add support for hashtags https://review.opendev.org/679051 | 13:10 |
| openstackgerrit | James E. Blair proposed ttygroup/gertty master: Use account_id to identify the user's own account https://review.opendev.org/679052 | 13:10 |
| corvus | fungi: if you have a minute to back up your gertty db, install that patch series, and run it (there are 2 schema migrations) to help double check it, i'd appreciate it | 13:11 |
| corvus | that at least gets it working with some of the google weirdness and adds one of the 3.0 features (obviously we won't be able to use hashtags on openstack's gerrit yet, but the ui element will be visible) | 13:12 |
| *** roman_g has quit IRC | 13:16 | |
| *** jcoufal has joined #openstack-infra | 13:17 | |
| openstackgerrit | James E. Blair proposed ttygroup/gertty master: Update googlesource example https://review.opendev.org/679055 | 13:18 |
| *** aaronsheffield has joined #openstack-infra | 13:21 | |
| *** nhicher has joined #openstack-infra | 13:21 | |
| mordred | corvus: if you get a sec, https://review.opendev.org/#/c/673141 and https://review.opendev.org/#/c/678412 and https://review.opendev.org/#/c/678411 | 13:21 |
| *** tosky has quit IRC | 13:30 | |
| *** tosky has joined #openstack-infra | 13:30 | |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: WIP: Add autohold delete/info commands to web API https://review.opendev.org/679057 | 13:32 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: WIP: Add autohold delete/info commands to web API https://review.opendev.org/679057 | 13:39 |
| Shrews | hrm, seems I'm adding the first DELETE verb usage. Is True the correct thing to return via cherrypy if that succeeds? | 13:41 |
| *** Goneri has joined #openstack-infra | 13:42 | |
| Shrews | oops, wrong chan | 13:43 |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: zuul: add openstack/magnum to opendev https://review.opendev.org/678840 | 13:46 |
| *** odicha has quit IRC | 13:50 | |
| *** eharney has joined #openstack-infra | 13:50 | |
| fungi | EmilienM: you can upload the nomination, just please note the circumstances in the commit message so the officials don't get confused! ;) | 13:52 |
| EmilienM | fungi: I will, thanks | 13:53 |
| fungi | the current state of the tooling no longer relies on any git metadata in the nomination itself, in part for this exact reason | 13:53 |
| fungi | corvus: thanks! giving it a try now | 13:53 |
| openstackgerrit | Merged openstack/project-config master: Retire swauth - remove project https://review.opendev.org/678385 | 13:54 |
| *** priteau has joined #openstack-infra | 13:54 | |
| *** bhavikdbavishi has quit IRC | 13:59 | |
| lpetrut | Hi, I noticed that compute-hyperv patches no longer update launchpad issues automatically anymore. Is there some project definition that I could check? | 14:00 |
| *** eharney has quit IRC | 14:00 | |
| fungi | corvus: okay, running with ? reporting "Gertty version: 1.6.1.dev8" | 14:00 |
| fungi | and indeed, i see an empty "Hashtags" line in the summary area | 14:01 |
| fungi | i'll let you know if i run into any inexplicable errors | 14:02 |
| fungi | lpetrut: "no longer" could be misleading. there are a variety of reasons it might be unable to leave particular sorts of comments on bugs, depending primarily on whether or not it needs to update the assignee. do you have an example where it did not work as expected? i can walk through the various requirements to make sure they're all met | 14:04 |
| fungi | (in which case we're left with "there was an lp api error/timeout" as the most likely remaining reason) | 14:04 |
| lpetrut | fungi: here's an example: https://bugs.launchpad.net/compute-hyperv/+bug/1841068 | 14:05 |
| openstack | Launchpad bug 1841068 in compute-hyperv "Allocations leaked during migration rollback" [Undecided,New] - Assigned to Lucian Petrut (petrutlucian94) | 14:05 |
| lpetrut | fungi: I saw that it happened for all my recent patches and I thought it's worth checking. thanks for helping me on this! | 14:05 |
| openstackgerrit | Merged openstack/project-config master: zuul: add openstack/magnum to opendev https://review.opendev.org/678840 | 14:05 |
| fungi | the Closes-Bug header on the corresponding change looks correctly-formed | 14:06 |
| fungi | the gerrit/projects.yaml entry for openstack/compute-hyperv doesn't indicate it should use a different tracker, nor a different lp project name/group | 14:07 |
| fungi | the Closes-Bug header was included in the commit message of the first patchset, not a subsequent patch | 14:08 |
| AJaeger_ | config-core, here's a change to add api-ref jobs for adjutant for review, please: https://review.opendev.org/#/c/675766/ | 14:11 |
| fungi | lpetrut: found it! the Bug-Supervisor group in lp for the project doesn't contain the "OpenStack Infra (hudson-openstack)" user and the comment event for that bug would have included a user assignment which only a bug supervisor can perform. add that account to https://launchpad.net/~compute-hyperv-bugs/+members and it should work in the future | 14:11 |
| lpetrut | fungi: that's great, thanks a lot! giving it a try | 14:14 |
| openstackgerrit | Merged opendev/system-config master: Update bazel flags to be more inline with upstream https://review.opendev.org/678411 | 14:14 |
| fungi | lpetrut: you would have probably seen it work in the past on other bugs where the assignee had already been set by someone before a patch was pushed, or for events which usually don't involve (re)assignment like when a change merges or when a related change is declared | 14:16 |
| fungi | but if the script thinks the bug needs to be (re)assigned and then lacks the permission to do so, it also fails to comment on that bug at all because the script short-circuits after the api error | 14:17 |
| lpetrut | makes sense now | 14:17 |
| *** sshnaidm has quit IRC | 14:17 | |
| *** sshnaidm has joined #openstack-infra | 14:19 | |
| *** openstackgerrit has quit IRC | 14:22 | |
| mnaser | neat, the opendev project addition merged, i'll wait a bit and report if its all good | 14:26 |
| *** markvoelker has quit IRC | 14:26 | |
| *** jamesmcarthur has quit IRC | 14:29 | |
| *** jamesmcarthur has joined #openstack-infra | 14:29 | |
| *** eharney has joined #openstack-infra | 14:29 | |
| *** jeliu_ has joined #openstack-infra | 14:29 | |
| *** markvoelker has joined #openstack-infra | 14:29 | |
| *** dpawlik has quit IRC | 14:29 | |
| *** amotoki_ has quit IRC | 14:34 | |
| *** tosky_ has joined #openstack-infra | 14:34 | |
| *** tosky has quit IRC | 14:34 | |
| *** tosky_ is now known as tosky | 14:35 | |
| *** amotoki has joined #openstack-infra | 14:35 | |
| *** markvoelker has quit IRC | 14:37 | |
| *** markvoelker has joined #openstack-infra | 14:38 | |
| *** openstackgerrit has joined #openstack-infra | 14:42 | |
| openstackgerrit | Merged opendev/system-config master: Remove the extra bazel options https://review.opendev.org/678412 | 14:42 |
| *** jamesmcarthur has quit IRC | 14:42 | |
| *** rcosnita has quit IRC | 14:46 | |
| *** rcosnita_ has joined #openstack-infra | 14:46 | |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: Switch to fetch-sphinx-tarball for tox-docs https://review.opendev.org/676430 | 14:47 |
| *** jamesmcarthur has joined #openstack-infra | 14:49 | |
| *** Lucas_Gray has quit IRC | 14:51 | |
| *** lpetrut has quit IRC | 14:52 | |
| *** igordc has joined #openstack-infra | 14:57 | |
| *** pkopec has quit IRC | 14:58 | |
| *** pkopec has joined #openstack-infra | 15:00 | |
| *** jamesmcarthur has quit IRC | 15:02 | |
| *** dpawlik has joined #openstack-infra | 15:02 | |
| *** xenos76 has quit IRC | 15:03 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: Add phoronix-test-suite job https://review.opendev.org/679082 | 15:06 |
| *** dpawlik has quit IRC | 15:07 | |
| openstackgerrit | Merged opendev/system-config master: Build gerrit with bazel 0.27.1 instead https://review.opendev.org/673141 | 15:10 |
| *** jamesmcarthur has joined #openstack-infra | 15:13 | |
| *** lpetrut has joined #openstack-infra | 15:15 | |
| *** xenos76 has joined #openstack-infra | 15:17 | |
| clarkb | yoctozepto: sshnaidm have you noticed any recent ipv4 failures in limestone? | 15:18 |
| *** jamesmcarthur has quit IRC | 15:18 | |
| clarkb | want to make sure the change to kernel settings on centos7 has fixed that for your jobs | 15:18 |
| *** markvoelker has quit IRC | 15:18 | |
| *** donnyd has quit IRC | 15:19 | |
| *** donnyd has joined #openstack-infra | 15:20 | |
| *** donnyd has quit IRC | 15:20 | |
| *** markvoelker has joined #openstack-infra | 15:21 | |
| *** donnyd has joined #openstack-infra | 15:21 | |
| yoctozepto | clarkb: no, it got better in that regard, all failures irrelevant to that | 15:22 |
| yoctozepto | that is for kolla | 15:22 |
| clarkb | thanks | 15:22 |
| clarkb | corvus: off the top of your head: any reason to not restart all of the zuul executors today? | 15:23 |
| clarkb | maybe if I rotate restarts of the executors to pick up the merger fix the impact will be low | 15:23 |
| *** gyee has joined #openstack-infra | 15:26 | |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: WIP: Add autohold delete/info commands to web API https://review.opendev.org/679057 | 15:31 |
| *** chkumar|rover is now known as raukadah | 15:31 | |
| *** stewie925 has joined #openstack-infra | 15:33 | |
| *** dpawlik has joined #openstack-infra | 15:34 | |
| sshnaidm | clarkb, didn't see it recently, looks ok | 15:39 |
| *** dpawlik has quit IRC | 15:39 | |
| *** niceplace_ has joined #openstack-infra | 15:39 | |
| *** rlandy|ruck|mtg is now known as rlandy | 15:43 | |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: WIP: Add autohold delete/info commands to web API https://review.opendev.org/679057 | 15:44 |
| *** rlandy is now known as rlandy|brb | 15:46 | |
| *** panda is now known as panda|rover | 15:47 | |
| *** sshnaidm is now known as sshnaidm|afk | 15:49 | |
| *** bdodd has joined #openstack-infra | 15:53 | |
| *** bdodd_ has quit IRC | 15:54 | |
| *** rcosnita_ has quit IRC | 15:59 | |
| *** lucasagomes has quit IRC | 16:00 | |
| *** whoami-rajat has joined #openstack-infra | 16:01 | |
| *** roman_g has joined #openstack-infra | 16:02 | |
| openstackgerrit | Bruno Cornec proposed openstack/project-config master: Manages build reqs in python-redfish project https://review.opendev.org/678968 | 16:03 |
| mordred | clarkb, fungi: https://gerrit-review.googlesource.com/c/gerrit/+/234730 | 16:03 |
| mordred | that's the patch for updating lucene index config | 16:03 |
| *** ricolin has quit IRC | 16:04 | |
| mordred | trevor has another patch that splits a single large project into smaller chunks for reindexing so that it can go in parallel | 16:04 |
| mordred | but that's not posed yet | 16:04 |
| mordred | posted | 16:04 |
| clarkb | oh wow lucene is overriding the smarts gerrit thought it already had? | 16:04 |
| *** ricolin has joined #openstack-infra | 16:04 | |
| *** jpena is now known as jpena|off | 16:05 | |
| roman_g | Hello team. We typically release code (obviously) in Git repo, and publish containers (on quay.io). OpenStack-Infra doesn't host containers so far. But is it possible to host released binaries? Would be golang binaries in our (Airship) case. | 16:05 |
| mordred | clarkb: yeah - it's a fun patch isn't it? I especially love lucene throttling disk throughput when it thinks you have spinning rust even when you don't | 16:05 |
| AJaeger_ | config-core, here's a change to add api-ref jobs for adjutant for review, please: https://review.opendev.org/#/c/675766/ | 16:05 |
| mordred | roman_g: we're good with publishing containers - although you'd be our first quay.io publisher, so we might want to work with you a little to make sure we had the mechanics sorted out | 16:06 |
| mordred | (supporting quay.io well is on the todo list - just haven't gotten to it yet) | 16:06 |
| clarkb | mordred: I think roman_g means we don't run a public registry to push into ourselves which is correct. However we infra push our own images up to docker hub and it works fine so far | 16:06 |
| clarkb | (so I don't see much reason to host a public registry ourselves yet) | 16:07 |
| mordred | yeah | 16:07 |
| clarkb | as for hosting binaries you can setup a publishing directory on tarballs.opendev.org https://tarballs.opendev.org/zuul/zuul/ is zuul's dir there | 16:07 |
| *** rlandy|brb is now known as rlandy | 16:07 | |
| mordred | clarkb: I agree - just mostly saying we have been pushing to docker hub just fine so should be able to publish to quay.io too | 16:07 |
| clarkb | mordred: ya | 16:07 |
| *** tesseract has quit IRC | 16:08 | |
| roman_g | mordred: we already do publish onto quay.io (many thanks and long live CoreOS/Quay/Red Hat/IBM folks who donate and support it) | 16:08 |
| mordred | awesome | 16:08 |
| clarkb | roman_g: any idea how large these binaries are? for python artifacts what we've done in the past is the publish the most recent artifact for every branch and then also for each tagged release | 16:08 |
| clarkb | but python artifacts tend to be quite small so storage space hasn't been much of a concern | 16:09 |
| roman_g | clarkb: no idea so far. shouldn't be fat. | 16:09 |
| roman_g | clarkb: thanks! Didn't know about tarballs site, will check it out. | 16:10 |
| clarkb | roman_g: note tarballs.opendev.org is fairly empty (just zuul using it now). tarballs.openstack.org is what we've done historically and has a lot more data to poke at | 16:10 |
| clarkb | we'd set up airship on tarballs.opendev.org though | 16:11 |
| *** bobh has joined #openstack-infra | 16:11 | |
| fungi | and i think the current plan is to fold tarballs.openstack.org into tarballs.opendev.org and then set up relevant directory redirects | 16:11 |
| roman_g | not super nice hostname part of fqdn, but that's still fine :) | 16:11 |
| roman_g | I'll fwd suggestion to out team and we would probably agree on publishing there | 16:12 |
| clarkb | roman_g: what do you have against tarballs? | 16:12 |
| *** ricolin has quit IRC | 16:12 | |
| fungi | i guess because not everything published there is a tarball | 16:12 |
| clarkb | meh | 16:12 |
| roman_g | I mean not all binaries are tarballs. executable binaries are certainly not tarballs :) | 16:12 |
| clarkb | thats the sort of thing we could bikeshed over all day and really makes no difference beceause people are going to copy and paste urls anyway | 16:13 |
| roman_g | also totally true. | 16:14 |
| roman_g | I'll name it OpenStack Tarballs service | 16:14 |
| fungi | i'm open to discussing changing the hostname, and i agree that deciding on a new name for it would be far more work than the actual implementation, but yes i think we have bigger fish to fry | 16:14 |
| roman_g | will try to search a sample job in zuul's repos which publishes onto it | 16:15 |
| roman_g | it is a plain file store or object store? | 16:15 |
| *** bobh has quit IRC | 16:15 | |
| fungi | it's all in afs with an apache server in front of it | 16:15 |
| clarkb | roman_g: it is an AFS filesystem | 16:15 |
| *** efried is now known as efried_rollin | 16:16 | |
| *** bobh has joined #openstack-infra | 16:16 | |
| fungi | so you can also get to it via /afs/openstack.org/project/opendev.org/tarballs/ if you have an afs client installed | 16:16 |
| openstackgerrit | Bruno Cornec proposed openstack/project-config master: Manages build reqs in python-redfish project https://review.opendev.org/678968 | 16:16 |
| fungi | (changing the node name to something other than openstack.org is likely quite hard so we haven't even considered it for now) | 16:17 |
| roman_g | clarkb: fungi first time I see AFS being used. So it's a distributed file store without data replication, right? | 16:20 |
| * roman_g opens google | 16:20 | |
| *** bobh has quit IRC | 16:20 | |
| clarkb | distributed file store with data replication | 16:22 |
| clarkb | we run ours with a replica | 16:22 |
| clarkb | though that is per volume so we could change it on subtrees, but our typical setup is each volume has a RO replica | 16:23 |
| fungi | yes, we've been relying on afs for years. it's a global network filesystem particularly popular with universities and research institutions, and has close ties to kerberos | 16:24 |
| fungi | the fact that it uses a global namespace (similar to dns) is one of the aspects that makes it significantly different from typical distributed network filesystems | 16:25 |
| fungi | one of the reasons we like it is that it supports ~atomic global publication from read-write to read-only replicas | 16:26 |
| roman_g | nice | 16:26 |
| roman_g | http://dl.central.org/dl/cellservdb/CellServDB - list of some server | 16:26 |
| roman_g | s | 16:26 |
| clarkb | infra-root I'm going to restart logstash workers to pick up the earlier minor fix for content encoding default value | 16:27 |
| mordred | what do we have to do to get our cell listed in there? | 16:27 |
| fungi | roman_g: we have some notes on our use of it at https://docs.openstack.org/infra/system-config/afs.html | 16:27 |
| mordred | (also - we should really make an opendev cell in all of our copious spare time) | 16:27 |
| clarkb | then I'm going to work on restarting zuul executors to pick up the fix for zuul running tests against the wrong commit | 16:27 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: Add phoronix-test-suite job https://review.opendev.org/679082 | 16:27 |
| mordred | clarkb: ++ | 16:27 |
| mordred | clarkb: we should also already be running with the json appending patch right? | 16:27 |
| clarkb | mordred: I don't know that that merged? | 16:28 |
| * clarkb looks | 16:29 | |
| clarkb | mordred: it merged yesterday so we aren't running that yet | 16:29 |
| clarkb | will be after the restart | 16:29 |
| clarkb | I'm going to do rolling restarts of the zuul executors I think | 16:29 |
| clarkb | to minimize disruption to running jobs | 16:29 |
| clarkb | and we can sanity check some of these changes before fully rolling them out | 16:30 |
| mordred | clarkb: cool. that'll be a good restart then | 16:31 |
| *** ginopc has quit IRC | 16:34 | |
| clarkb | restarting ze01 now | 16:35 |
| clarkb | zuul==3.10.2.dev47 # git sha 50a0f73 is what will be running there | 16:35 |
| roman_g | mordred: http://grand.central.org/csdb.html - basically, to be listed there we need to send an e-mail to the robot | 16:36 |
| clarkb | alright ze01 is running newer code | 16:41 |
| clarkb | mordred: ^ what is the best way to double check the resulting json? just see if zuul dashboard can render the console tab after job completes on ze01? | 16:41 |
| mordred | clarkb: yeah. | 16:41 |
| mordred | clarkb: when we get the error about not being able to pull a container image because of checksum mismatch - do we need to clear something manually? or just try again? | 16:42 |
| clarkb | oh wait I lied its not running the new code. I failed to check properly if it had stopped running so the new start didn't actualyl start | 16:43 |
| mordred | like https://zuul.opendev.org/t/openstack/build/a54544dcc35c4b97b7156caf22acd56c | 16:43 |
| clarkb | mordred: I think you have to delete the bad image from the intermediate registry | 16:43 |
| mordred | awesome | 16:44 |
| clarkb | now it is restarted | 16:45 |
| *** jeliu_ has quit IRC | 16:45 | |
| *** mriedem is now known as mriedem_away | 16:49 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Increase timeout for promote-openstack-manuals https://review.opendev.org/679100 | 16:53 |
| clarkb | mordred: https://zuul.opendev.org/t/openstack/build/9e10f1b455264de294fa70d2dee92907/console I believe that ran on ze01 | 16:57 |
| clarkb | and started after the restart | 16:57 |
| clarkb | console seems to render fine | 16:57 |
| *** derekh has quit IRC | 16:57 | |
| clarkb | and I see we still properly skip local repo updates so I donlt think my change regressed that | 16:58 |
| clarkb | infra-root ^ given that I'll proceed with restarting more executors | 16:58 |
| mordred | clarkb: yah - and if you look at the json you can see that the indentation is a little off with the outer [] - which is expected with the new code | 17:00 |
| *** jamesmcarthur has joined #openstack-infra | 17:00 | |
| mordred | clarkb: https://zuul.opendev.org/t/openstack/build/9e10f1b455264de294fa70d2dee92907/log/job-output.json#1-2 | 17:00 |
| mordred | clarkb: ++ looks great | 17:01 |
| fungi | corvus: here's an interesting rendering problem i've spotted in gertty, though no idea if it's new: http://paste.openstack.org/show/766642/ | 17:03 |
| fungi | in this case i've voted on 678703 so when i pull up the project list it's hidden initially. what you can't see there is that it's also the parent of 678705 | 17:04 |
| clarkb | mordred: cool I'm going to do ze02 now then | 17:04 |
| clarkb | thanks for double checking | 17:04 |
| fungi | corvus: i think when it's hiding 678703 it loses the threading of 678705, so even after i hit the l key it doesn't stitch it in and still shows it as not having any parent in the thread | 17:05 |
| fungi | fairly minor, but as i say i don't recall whether this is a regression or just something i hadn't spotted before | 17:05 |
| fungi | (or something i have spotted before and then forgotten) | 17:06 |
| *** jeliu_ has joined #openstack-infra | 17:06 | |
| *** dtantsur is now known as dtantsur|afk | 17:08 | |
| *** ijw has joined #openstack-infra | 17:14 | |
| *** ijw has quit IRC | 17:16 | |
| *** ijw has joined #openstack-infra | 17:16 | |
| *** ijw has quit IRC | 17:17 | |
| *** ijw has joined #openstack-infra | 17:18 | |
| clarkb | ze02 seems happy. I'm going to start rolling through the others quickly once I find some breakfast | 17:22 |
| *** panda|rover is now known as panda|rover|off | 17:23 | |
| *** dpawlik has joined #openstack-infra | 17:35 | |
| *** dpawlik has quit IRC | 17:40 | |
| *** eharney_ has joined #openstack-infra | 17:43 | |
| *** eharney has quit IRC | 17:44 | |
| *** roman_g has quit IRC | 17:45 | |
| *** tosky_ has joined #openstack-infra | 17:45 | |
| *** tosky has quit IRC | 17:45 | |
| *** tosky_ is now known as tosky | 17:45 | |
| *** eharney_ is now known as eharney | 17:46 | |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Add autohold-info CLI command https://review.opendev.org/662487 | 18:00 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Record held node IDs with autohold request https://review.opendev.org/662498 | 18:00 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Auto-delete expired autohold requests https://review.opendev.org/663762 | 18:00 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Mark nodes as USED when deleting autohold https://review.opendev.org/664060 | 18:00 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: WIP: Add autohold delete/info commands to web API https://review.opendev.org/679057 | 18:00 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Add autohold delete/info commands to web API https://review.opendev.org/679057 | 18:08 |
| *** priteau has quit IRC | 18:12 | |
| *** ociuhandu has joined #openstack-infra | 18:12 | |
| *** ramishra has quit IRC | 18:12 | |
| *** psachin has quit IRC | 18:13 | |
| *** mriedem_away is now known as mriedem | 18:21 | |
| *** michael-beaver has joined #openstack-infra | 18:23 | |
| *** igordc has quit IRC | 18:23 | |
| AJaeger_ | config-core, a couple of easy reviews, please: https://review.opendev.org/679100 https://review.opendev.org/675766 https://review.opendev.org/678968 | 18:29 |
| *** prometheanfire has quit IRC | 18:32 | |
| *** prometheanfire has joined #openstack-infra | 18:32 | |
| mtreinish | is there a reason openstack-discuss doesn't set a Reply-to header like openstack-dev used to? | 18:37 |
| clarkb | mtreinish: we are passing things through with minimal modification so that signed emails still verify properly | 18:38 |
| mtreinish | I sign all my ML email and never used to have a problem with that | 18:39 |
| clarkb | mtreinish: sorry not gpg signed but dmarc/dkim | 18:40 |
| mtreinish | ah, ok | 18:40 |
| *** jamesmcarthur has quit IRC | 18:43 | |
| AJaeger_ | thanks, clarkb for reviewing these three! | 18:44 |
| clarkb | AJaeger_: no problem | 18:45 |
| clarkb | mtreinish: ya the difference is with the dmarc/dkim signatures they sign headers in addition to content | 18:45 |
| clarkb | and iirc reply-to is one of the commonly hashed headers | 18:45 |
| clarkb | (it is specified in dns what gets verified iirc) | 18:46 |
| clarkb | rfolco: I see in your email that you removed fedora testing? does that mean we can remove fedora 28 images now? | 18:46 |
| *** dciabrin has quit IRC | 18:47 | |
| rfolco | clarkb, yes no value in f28 jobs anymore, we completed removal of all upstream jobs now. | 18:48 |
| mtreinish | clarkb: yeah I was just reading the dkim faq (https://dmarc.org/wiki/FAQ ) about the reply-to headers for mailing lists | 18:48 |
| mtreinish | I was just caught by surprise because I just realized my muscle memory for replying to ML posts was sending replies to both the original author and the ML | 18:49 |
| openstackgerrit | Merged openstack/project-config master: Increase timeout for promote-openstack-manuals https://review.opendev.org/679100 | 18:50 |
| clarkb | rfolco: I think this https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/deprecated-jobs.yaml#L102-L125 will need to be removed before we can safely remove the nodepool definitions for fedora028 | 18:50 |
| clarkb | rfolco: do you know if that is used at all? if not we can just remove the definitions and the job won't be able to run but I believe it can remain defined | 18:51 |
| fungi | mtreinish: for mutt i simply use shift-L (default keybinding for reply-to-list) which figures it out from the rfc 2919 headers | 18:52 |
| AJaeger_ | clarkb: there's still in openstack-zuul-jobs the job kata-runsh-fedora-28, see https://opendev.org/openstack/openstack-zuul-jobs/src/branch/master/zuul.d/jobs.yaml#L1414 | 18:52 |
| mtreinish | ah cool, I was just pulling up the man page to see if there was an option for that | 18:52 |
| AJaeger_ | and x/packstack has it: https://opendev.org/x/packstack/src/branch/master/.zuul.yaml#L57 | 18:52 |
| openstackgerrit | Merged openstack/project-config master: Add api-ref jobs for adjutant https://review.opendev.org/675766 | 18:53 |
| rfolco | clarkb, these jobs in deprecated-jobs.yaml do not run anywhere. if they need to be removed to get rid of the f28 nodepool image, then I can take care of it. Otherwise (with the nodeset: fedora it will complain I guess? | 18:53 |
| AJaeger_ | clarkb: and nodepool: https://opendev.org/zuul/nodepool/src/branch/master/.zuul.yaml#L123 | 18:53 |
| clarkb | AJaeger_: we can remove the kata stuff in ozj since they have their own tenant now | 18:53 |
| mtreinish | (I'll remap it so I don't have to adjust my muscle memory) | 18:53 |
| clarkb | rfolco: I think it will only complain if you try to run the job so as long as you say it doesn't run anywhere we are good :) | 18:53 |
| clarkb | AJaeger_: we should remove the kata job and then have packstack and nodepool update, then we can delete that imgae \o/ | 18:54 |
| clarkb | I can push changes for that as soon as executors are done restarting. On the last one now | 18:54 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Remove kata jobs https://review.opendev.org/679114 | 18:55 |
| clarkb | looks like tobiko and devstack do it too? | 18:55 |
| AJaeger_ | clarkb: like this ^ ? | 18:55 |
| AJaeger_ | clarkb: sorry, did not see that you wanted to do it ... | 18:55 |
| clarkb | AJaeger_: yup like that and I'm happy if someone else does it too :) +2 | 18:56 |
| rfolco | clarkb, cool, ping me if any required actions on my side for removing f28. | 18:56 |
| *** tosky has quit IRC | 18:56 | |
| openstackgerrit | Merged openstack/project-config master: Manages build reqs in python-redfish project https://review.opendev.org/678968 | 18:57 |
| clarkb | #status log Restarted ze01-ze12 on zuul==3.10.2.dev47 # git sha 50a0f73 this fixes a bug in Zuul not testing the correct commit in some cases and may improve memory consumption of jobs due to changes in how json documents are manipulated. | 18:58 |
| openstackstatus | clarkb: finished logging | 18:58 |
| openstackgerrit | Clark Boylan proposed zuul/nodepool master: Use fedora-29 instead of fedora-28 https://review.opendev.org/679116 | 19:01 |
| clarkb | AJaeger_: Shrews ^ fyi | 19:01 |
| *** lpetrut has quit IRC | 19:02 | |
| AJaeger_ | clarkb: want to use fedora-latest instead? | 19:04 |
| clarkb | hrm maybe? | 19:04 |
| clarkb | remote: https://review.opendev.org/679117 | 19:04 |
| AJaeger_ | clarkb: https://review.opendev.org/679115 is my packstack change | 19:04 |
| clarkb | oh you beat me to it :) | 19:04 |
| clarkb | sorry wasn't sure if you were doing it I'll get out of the way now :) | 19:04 |
| clarkb | and ya I think fedora-latest is what we want | 19:04 |
| AJaeger_ | clarkb: I'm done ;) | 19:04 |
| AJaeger_ | I think that's all... | 19:04 |
| clarkb | AJaeger_: did you get tobiko and devstack? | 19:05 |
| AJaeger_ | clarkb: no, I didn't - please do | 19:05 |
| AJaeger_ | hope there are no branches so that backports are needed | 19:06 |
| openstackgerrit | Clark Boylan proposed zuul/nodepool master: Use fedora-29 instead of fedora-28 https://review.opendev.org/679116 | 19:06 |
| clarkb | updated nodepool to use -latest | 19:06 |
| AJaeger_ | fungi, want to review the kata job removal, please? https://review.opendev.org/679114 | 19:08 |
| clarkb | tobiko: remote: https://review.opendev.org/679118 Use fedora-29 instead of fedora-28 | 19:08 |
| AJaeger_ | rfolco, are you removing the tripeo fedora28 job? | 19:10 |
| clarkb | Devstack remote: https://review.opendev.org/679121 Use fedora-29 instead of 28 | 19:10 |
| rfolco | AJaeger_, I can propose if needed. If not running anywhere, zuul won't complain if still have any nodeset defined right? | 19:11 |
| clarkb | I think the label is only verified when it makes node requests which requires the job to be executed | 19:11 |
| rfolco | AJaeger_, Let me nuke it real quick | 19:11 |
| clarkb | it should be fine to leave alone if not running it (though I'm not sure what the value is in that case) | 19:11 |
| AJaeger_ | thanks, rfolco | 19:11 |
| *** ociuhandu has quit IRC | 19:14 | |
| openstackgerrit | Clark Boylan proposed zuul/nodepool master: Use fedora-29 instead of fedora-28 https://review.opendev.org/679116 | 19:15 |
| clarkb | AJaeger_: ^ fyi it has to be -29 in the label context as we don't have a fedora-latest label | 19:15 |
| AJaeger_ | ah | 19:16 |
| clarkb | we do haev a fedora-latest nodeset that can be used instead if you don't need anything special | 19:16 |
| AJaeger_ | clarkb: indeed, you're right | 19:16 |
| Shrews | clarkb: nodepool change lgtm, but probably want to run it by tristanC too | 19:16 |
| fungi | increases chances that something will break spontaneously related to the fedora version, but reduces the constant nodeset change | 19:16 |
| AJaeger_ | clarkb: rfolco's change is https://review.opendev.org/#/c/679125/1 | 19:18 |
| openstackgerrit | Ronelle Landy proposed zuul/zuul-jobs master: Only use RHEL8 deps repo on Red Hat systems newer than 7 https://review.opendev.org/679126 | 19:19 |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Remove kata jobs https://review.opendev.org/679114 | 19:20 |
| AJaeger_ | clarkb: want to abandon this kata change now ? https://review.opendev.org/#/c/583296/ | 19:20 |
| clarkb | AJaeger_: done | 19:21 |
| *** efried_rollin is now known as efried | 19:22 | |
| AJaeger_ | config-core, here're four more open reviews: https://review.opendev.org/677738 https://review.opendev.org/678868 https://review.opendev.org/674334 https://review.opendev.org/#/c/677027/ | 19:25 |
| * AJaeger_ signs off for the day and wishes everybody a great remaining day | 19:26 | |
| clarkb | AJaeger_: enjoy | 19:26 |
| clarkb | I'll try to get to those reivews after lunch | 19:26 |
| *** nicolasbock has quit IRC | 19:34 | |
| *** nicolasbock has joined #openstack-infra | 19:36 | |
| *** eharney has quit IRC | 19:36 | |
| *** dpawlik has joined #openstack-infra | 19:36 | |
| fungi | gonna go get a late lunch since there is no storyboard meeting, but will be back soonish | 19:37 |
| *** dpawlik has quit IRC | 19:41 | |
| *** ralonsoh has quit IRC | 19:42 | |
| mnaser | infra-root: is it ok if i clear out the buckets that were used for logging? our rebalances are really struggling with the large # of objects | 19:45 |
| clarkb | we'll lose those logs, but that is probably ok. We are already on a 4 week retention iirc so not uncommon to lose logs | 19:46 |
| mnaser | ok, and i posted an issue with swift logs in #zuul, i can bring it up to ml too | 19:47 |
| *** jcoufal_ has joined #openstack-infra | 19:57 | |
| *** jcoufal has quit IRC | 19:59 | |
| *** gyee has quit IRC | 20:05 | |
| *** dciabrin has joined #openstack-infra | 20:06 | |
| *** slaweq has quit IRC | 20:09 | |
| *** mloza has joined #openstack-infra | 20:09 | |
| *** mloza has left #openstack-infra | 20:09 | |
| openstackgerrit | Clark Boylan proposed zuul/zuul-jobs master: WIP: Add day of month to periodic logs for swift sharding https://review.opendev.org/679135 | 20:16 |
| *** pkopec has quit IRC | 20:17 | |
| *** calebb has joined #openstack-infra | 20:18 | |
| openstackgerrit | Clark Boylan proposed zuul/zuul-jobs master: WIP: Add current date seconds to periodic logs for swift sharding https://review.opendev.org/679135 | 20:18 |
| *** pkopec has joined #openstack-infra | 20:20 | |
| *** gyee has joined #openstack-infra | 20:23 | |
| fungi | mnaser: i have no objection. if folks want refreshed logs they know how to recheck. we can't expect our donors to provide perfect retention | 20:35 |
| fungi | and also thank you for use of your systems! | 20:35 |
| *** xek has quit IRC | 20:39 | |
| clarkb | fungi: https://review.opendev.org/#/c/679135/2 is related #zuul has details if you want to weighin on that | 20:40 |
| *** jcoufal_ has quit IRC | 20:44 | |
| *** jamesmcarthur has joined #openstack-infra | 20:44 | |
| *** jcoufal has joined #openstack-infra | 20:45 | |
| *** jcoufal has quit IRC | 20:50 | |
| *** bdodd has quit IRC | 20:51 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: Add phoronix-test-suite job https://review.opendev.org/679082 | 20:53 |
| *** xenos76 has quit IRC | 20:53 | |
| *** eharney has joined #openstack-infra | 20:55 | |
| *** markvoelker has quit IRC | 20:58 | |
| *** markvoelker has joined #openstack-infra | 20:58 | |
| *** jamesmcarthur has quit IRC | 20:59 | |
| *** markvoelker has quit IRC | 21:10 | |
| *** markvoelker has joined #openstack-infra | 21:10 | |
| *** slaweq has joined #openstack-infra | 21:11 | |
| *** Goneri has quit IRC | 21:15 | |
| *** slaweq has quit IRC | 21:16 | |
| *** pkopec has quit IRC | 21:21 | |
| clarkb | another option (whcih I think I'm now in favor of) is add a new role for creating log urls specifically for object stores | 21:29 |
| clarkb | thenwe can do the uuid[:3] prefix and call it a day | 21:29 |
| * clarkb writes this change | 21:29 | |
| fungi | wfm | 21:29 |
| clarkb | or just a switch on the existing role | 21:29 |
| fungi | if uuid is a string then that works. if it's an int then we probably want something like uuid%4096 | 21:32 |
| ianw | it should be 100% testable in the test roles, right? | 21:35 |
| clarkb | ya thats the other upside to doing it this way we should be able to merge, set flag in test base job and then be good | 21:36 |
| clarkb | fungi: its a string | 21:36 |
| *** dpawlik has joined #openstack-infra | 21:37 | |
| fungi | cool | 21:39 |
| *** markvoelker has quit IRC | 21:39 | |
| openstackgerrit | Clark Boylan proposed zuul/zuul-jobs master: Add option for object store friendly log paths https://review.opendev.org/679145 | 21:40 |
| *** markvoelker has joined #openstack-infra | 21:40 | |
| *** dpawlik has quit IRC | 21:41 | |
| *** markvoelker has quit IRC | 21:45 | |
| *** eharney has quit IRC | 21:50 | |
| *** dayou has quit IRC | 21:51 | |
| *** jeliu_ has quit IRC | 21:52 | |
| *** jbadiapa has quit IRC | 21:52 | |
| *** mriedem has quit IRC | 21:54 | |
| *** eharney has joined #openstack-infra | 21:55 | |
| *** dayou has joined #openstack-infra | 22:05 | |
| *** markvoelker has joined #openstack-infra | 22:05 | |
| openstackgerrit | Merged zuul/nodepool master: Use fedora-29 instead of fedora-28 https://review.opendev.org/679116 | 22:06 |
| *** markvoelker has quit IRC | 22:11 | |
| *** slaweq has joined #openstack-infra | 22:11 | |
| openstackgerrit | Clark Boylan proposed zuul/zuul-jobs master: Add option for object store friendly log paths https://review.opendev.org/679145 | 22:12 |
| *** ccamacho has quit IRC | 22:14 | |
| *** slaweq has quit IRC | 22:17 | |
| clarkb | ianw: did you see that tripleo is apparently done with fedora-28? I've pushed up changes to clean up the remainig use of fedora-28 in nodepool, tobiko, and devstack with ajaeger pushing a change to packstack | 22:31 |
| clarkb | ianw: once those merge I think we can start cleaning up nodepool's configs? | 22:31 |
| *** notmyname has quit IRC | 22:38 | |
| fungi | and then it's just magnum's reliance on f27 to worry about? | 22:38 |
| *** dchen has joined #openstack-infra | 22:38 | |
| clarkb | ya, thankfully we only have to worry about that in our mirrors | 22:39 |
| clarkb | they don't run tests on fedora27 instead they deploy f27 atomic from our mirror onto openstack clouds | 22:39 |
| clarkb | then run k8s in that | 22:39 |
| *** aaronsheffield has quit IRC | 22:40 | |
| fungi | ahh, okay, so not a nodepool/dib/nodeset issue at least | 22:42 |
| clarkb | AJaeger_: your packstack change failed I think because the nodeset node name matters there :/ | 22:43 |
| clarkb | I've pushed a followup ps that only changes the label instead to check that | 22:43 |
| clarkb | fungi: ya | 22:43 |
| clarkb | except that the nodepool test k8s is magnum deployed so uses f27 | 22:43 |
| clarkb | but we haven't done much with that yet and should probably start over | 22:43 |
| openstackgerrit | Bruno Cornec proposed openstack/project-config master: Manages build reqs in alexandria project https://review.opendev.org/679155 | 22:46 |
| *** notmyname has joined #openstack-infra | 22:48 | |
| clarkb | is rax.ord's mirror rnning kafs? | 22:51 |
| *** tkajinam has joined #openstack-infra | 22:51 | |
| clarkb | e-r is complaining about mismatched ubuntu repo file sizes | 22:51 |
| ianw | clarkb: yeah i'm pushing through the f30 changes, we can probably go straight to that | 22:52 |
| ianw | clarkb: no, no kafs in rotation atm | 22:53 |
| clarkb | ianw: I was just bumping them to 29 because its there, but ya can continue to push to 30 from there | 22:53 |
| ianw | though i saw some changes fly past that i think might be related to the fscache issues that was oopsing the machine, need to get back to it | 22:53 |
| clarkb | hrm I wonder why there is a spike on that issue | 22:53 |
| ianw | hrm, issuse upstream? | 22:55 |
| *** dchen has quit IRC | 22:55 | |
| clarkb | ianw: it seems to only affect the one mirror too | 22:58 |
| clarkb | (which was why I immediatley thought of kafs) | 22:58 |
| ianw | yeah, it is a opendev.org (afs 1.8) server thought | 22:59 |
| ianw | nothing particularly in it's logs | 22:59 |
| *** dchen has joined #openstack-infra | 23:02 | |
| *** slaweq has joined #openstack-infra | 23:11 | |
| *** slaweq has quit IRC | 23:15 | |
| *** adriant has quit IRC | 23:17 | |
| *** adriant has joined #openstack-infra | 23:18 | |
| *** adriant3 has joined #openstack-infra | 23:19 | |
| *** stewie925 has quit IRC | 23:20 | |
| *** rcernin has joined #openstack-infra | 23:21 | |
| *** adriant3 has quit IRC | 23:21 | |
| *** adriant4 has joined #openstack-infra | 23:22 | |
| *** adriant has quit IRC | 23:23 | |
| *** adriant49 has joined #openstack-infra | 23:24 | |
| *** adriant49 has quit IRC | 23:24 | |
| *** adriant4 has quit IRC | 23:28 | |
| *** rfolco has quit IRC | 23:29 | |
| *** dpawlik has joined #openstack-infra | 23:38 | |
| *** rh-jelabarre has quit IRC | 23:42 | |
| *** dpawlik has quit IRC | 23:43 | |
| *** rlandy has quit IRC | 23:43 | |
| *** Swami has joined #openstack-infra | 23:44 | |
| *** Swami has quit IRC | 23:45 | |
| *** sthussey has quit IRC | 23:47 | |
| *** adriant has joined #openstack-infra | 23:48 | |
| adriant | AJaeger_: https://review.opendev.org/#/c/679071 should be good to merge now (once zuul passes) | 23:50 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!