| *** tetsuro has joined #openstack-infra | 00:05 | |
| *** tetsuro_ has quit IRC | 00:07 | |
| *** armax has quit IRC | 00:08 | |
| corvus | yay, we have a git.z cert now | 00:11 |
|---|---|---|
| *** armax has joined #openstack-infra | 00:12 | |
| mordred | corvus: \o/ | 00:14 |
| openstackgerrit | James E. Blair proposed opendev/system-config master: Use LE cert for git.zuul-ci.org https://review.opendev.org/701640 | 00:15 |
| corvus | that's probably a tomorrow change :) | 00:15 |
| *** Goneri has quit IRC | 00:15 | |
| fungi | lgtm | 00:16 |
| clarkb | I'm going to try and get the zuul.opendev.org changes up tomorrow | 00:16 |
| clarkb | corvus: mordred related https://review.opendev.org/#/c/701482/ tracks insecure-ci-registry's cert | 00:17 |
| *** mattw4 has quit IRC | 00:20 | |
| *** armax has quit IRC | 00:45 | |
| *** Goneri has joined #openstack-infra | 00:49 | |
| *** Goneri has quit IRC | 00:55 | |
| openstackgerrit | Merged opendev/system-config master: Alphabetize ssldomains file https://review.opendev.org/701481 | 01:01 |
| openstackgerrit | Merged opendev/system-config master: Add insecure-ci-registry to ssldomains https://review.opendev.org/701482 | 01:01 |
| *** portdirect has quit IRC | 01:02 | |
| *** tetsuro has quit IRC | 01:04 | |
| *** tetsuro has joined #openstack-infra | 01:04 | |
| kevinz | fungi hrw: well I cleaned the instance with "deleting" state now after restart nova-compute service. Now you can check again | 01:07 |
| *** tetsuro has quit IRC | 01:08 | |
| fungi | kevinz: thanks, checking now | 01:08 |
| fungi | i'm not seeing new errors, but it also looks like we may have caught up on outstanding arm64 node requests so it's not currently trying to go beyond 5 instances | 01:10 |
| *** slaweq has joined #openstack-infra | 01:11 | |
| *** slaweq has quit IRC | 01:17 | |
| *** tetsuro has joined #openstack-infra | 01:17 | |
| *** eernst has quit IRC | 01:19 | |
| *** tetsuro_ has joined #openstack-infra | 01:22 | |
| *** eernst has joined #openstack-infra | 01:23 | |
| kevinz | well, np | 01:23 |
| *** gyee has quit IRC | 01:23 | |
| clarkb | mordred: thank you for reviews on those changes | 01:23 |
| clarkb | fungi: how close to expiring is the registry cert? | 01:23 |
| kevinz | fungi: I'm working on offering new 40+ nodes for openstack-infra. Will be ready soon | 01:23 |
| *** tetsuro has quit IRC | 01:26 | |
| *** eernst has quit IRC | 01:27 | |
| fungi | clarkb: roughly a month. i pushed up that addition when i got the 30-day notice | 01:31 |
| fungi | so we have plenty of time | 01:31 |
| clarkb | got it. I guess it goes behind zuul.opendev.org :) | 01:31 |
| fungi | kevinz: that's marvellous--thanks! | 01:32 |
| *** rh-jelabarre has quit IRC | 01:34 | |
| *** rh-jelabarre has joined #openstack-infra | 01:36 | |
| *** jangutter has quit IRC | 01:42 | |
| kevinz | fungi: my pleasure | 01:44 |
| *** tetsuro has joined #openstack-infra | 02:00 | |
| *** tetsuro_ has quit IRC | 02:04 | |
| *** tonyb has quit IRC | 02:10 | |
| *** tinwood has quit IRC | 02:10 | |
| *** tinwood has joined #openstack-infra | 02:12 | |
| *** hwoarang has quit IRC | 02:12 | |
| *** hwoarang has joined #openstack-infra | 02:13 | |
| *** goldyfruit has joined #openstack-infra | 02:14 | |
| *** xek_ has joined #openstack-infra | 02:22 | |
| *** xek has quit IRC | 02:23 | |
| *** goldyfruit has quit IRC | 02:41 | |
| *** goldyfruit has joined #openstack-infra | 02:42 | |
| *** paladox is now known as [UK] | 02:59 | |
| *** [UK] is now known as paladox | 03:00 | |
| *** goldyfruit has quit IRC | 03:01 | |
| *** goldyfruit has joined #openstack-infra | 03:01 | |
| *** tetsuro has quit IRC | 03:07 | |
| *** ricolin has quit IRC | 03:07 | |
| *** slaweq has joined #openstack-infra | 03:11 | |
| *** xinranwang has joined #openstack-infra | 03:11 | |
| *** apetrich has quit IRC | 03:13 | |
| *** rlandy|bbl is now known as rlandy | 03:13 | |
| *** rlandy has quit IRC | 03:14 | |
| *** slaweq has quit IRC | 03:16 | |
| *** exsdev has quit IRC | 03:19 | |
| *** exsdev has joined #openstack-infra | 03:24 | |
| *** ricolin has joined #openstack-infra | 03:28 | |
| *** psachin has joined #openstack-infra | 03:42 | |
| *** goldyfruit has quit IRC | 03:46 | |
| *** goldyfruit has joined #openstack-infra | 03:46 | |
| *** exsdev has quit IRC | 03:49 | |
| *** exsdev has joined #openstack-infra | 03:50 | |
| *** ricolin_ has joined #openstack-infra | 03:57 | |
| *** ricolin_ has quit IRC | 03:57 | |
| *** tetsuro has joined #openstack-infra | 03:59 | |
| *** ricolin has quit IRC | 04:02 | |
| *** udesale has joined #openstack-infra | 04:03 | |
| *** ricolin has joined #openstack-infra | 04:03 | |
| *** zxiiro has quit IRC | 04:10 | |
| *** roman_g has quit IRC | 04:24 | |
| *** ykarel|away has joined #openstack-infra | 04:42 | |
| *** slaweq has joined #openstack-infra | 05:11 | |
| *** slaweq has quit IRC | 05:16 | |
| *** ykarel|away is now known as ykarel | 05:25 | |
| *** ociuhandu has joined #openstack-infra | 05:31 | |
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #openstack-infra | 05:34 | |
| *** goldyfruit has quit IRC | 05:34 | |
| *** ociuhandu has quit IRC | 05:35 | |
| *** xinranwang has quit IRC | 05:36 | |
| *** udesale has quit IRC | 05:40 | |
| *** surpatil has joined #openstack-infra | 05:44 | |
| *** exsdev has quit IRC | 06:03 | |
| *** exsdev has joined #openstack-infra | 06:04 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml https://review.opendev.org/701666 | 06:08 |
| *** exsdev has quit IRC | 06:08 | |
| *** exsdev has joined #openstack-infra | 06:09 | |
| *** jaicaa has quit IRC | 06:24 | |
| *** lmiccini has joined #openstack-infra | 06:24 | |
| *** jaicaa has joined #openstack-infra | 06:25 | |
| *** rcernin has quit IRC | 06:32 | |
| *** surpatil has quit IRC | 06:34 | |
| *** surpatil has joined #openstack-infra | 06:35 | |
| *** hwoarang has quit IRC | 07:06 | |
| *** hwoarang has joined #openstack-infra | 07:06 | |
| *** dpawlik has joined #openstack-infra | 07:07 | |
| *** udesale has joined #openstack-infra | 07:12 | |
| openstackgerrit | Merged openstack/project-config master: Revert "Linaro London: use new bigger flavour" https://review.opendev.org/701626 | 07:16 |
| openstackgerrit | Merged openstack/project-config master: Normalize projects.yaml https://review.opendev.org/701666 | 07:16 |
| *** pgaxatte has joined #openstack-infra | 07:42 | |
| *** slaweq has joined #openstack-infra | 07:52 | |
| *** sshnaidm|afk is now known as sshnaidm | 07:53 | |
| *** jpena|off is now known as jpena | 07:56 | |
| *** pcaruana has joined #openstack-infra | 08:02 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/project-config master: New repo: "ideas" https://review.opendev.org/701530 | 08:04 |
| *** dchen has quit IRC | 08:05 | |
| *** rpittau|afk is now known as rpittau | 08:06 | |
| *** ykarel is now known as ykarel|lunch | 08:06 | |
| *** roman_g has joined #openstack-infra | 08:11 | |
| *** tkajinam has quit IRC | 08:18 | |
| *** pkopec has joined #openstack-infra | 08:22 | |
| *** tosky has joined #openstack-infra | 08:25 | |
| *** slaweq_ has joined #openstack-infra | 08:29 | |
| *** tesseract has joined #openstack-infra | 08:30 | |
| *** slaweq has quit IRC | 08:31 | |
| *** udesale has quit IRC | 08:32 | |
| *** trident has quit IRC | 08:37 | |
| *** trident has joined #openstack-infra | 08:39 | |
| *** tetsuro has quit IRC | 08:43 | |
| *** iurygregory has joined #openstack-infra | 08:45 | |
| openstackgerrit | Daniel Bengtsson proposed openstack/reviewstats master: Stop configuring install_command in tox. https://review.opendev.org/694506 | 08:59 |
| openstackgerrit | Daniel Bengtsson proposed openstack/reviewstats master: Stop configuring install_command in tox. https://review.opendev.org/694506 | 09:00 |
| *** ralonsoh has joined #openstack-infra | 09:03 | |
| *** ykarel|lunch is now known as ykarel | 09:06 | |
| *** udesale has joined #openstack-infra | 09:11 | |
| *** kjackal has joined #openstack-infra | 09:11 | |
| *** apetrich has joined #openstack-infra | 09:12 | |
| *** jtomasek has joined #openstack-infra | 09:13 | |
| *** ociuhandu has joined #openstack-infra | 09:15 | |
| *** ociuhandu has quit IRC | 09:19 | |
| *** lucasagomes has joined #openstack-infra | 09:19 | |
| hrw | fungi, kevinz: thanks for sorting out stuff | 09:23 |
| *** aedc has joined #openstack-infra | 09:26 | |
| *** electrofelix has joined #openstack-infra | 09:36 | |
| *** slaweq_ has quit IRC | 09:38 | |
| *** ociuhandu has joined #openstack-infra | 09:44 | |
| *** ociuhandu has quit IRC | 09:45 | |
| *** tetsuro has joined #openstack-infra | 09:45 | |
| *** ociuhandu has joined #openstack-infra | 09:48 | |
| *** slaweq_ has joined #openstack-infra | 09:50 | |
| *** ociuhandu has quit IRC | 09:53 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: Authorization rules: support YAML nested dictionaries https://review.opendev.org/684790 | 09:58 |
| *** tetsuro has quit IRC | 10:05 | |
| *** ociuhandu has joined #openstack-infra | 10:14 | |
| *** ociuhandu has quit IRC | 10:15 | |
| *** ociuhandu has joined #openstack-infra | 10:16 | |
| *** ociuhandu has quit IRC | 10:21 | |
| *** ociuhandu has joined #openstack-infra | 10:22 | |
| *** ociuhandu has quit IRC | 10:27 | |
| hrw | hm. UCA/ussuri got synced to openstack mirror. but arm64 part still did not ;( can someone take a look? | 10:39 |
| *** ociuhandu has joined #openstack-infra | 10:47 | |
| *** xek__ has joined #openstack-infra | 10:51 | |
| *** ociuhandu has quit IRC | 10:52 | |
| *** xek_ has quit IRC | 10:54 | |
| *** dtantsur|afk is now known as dtantsur | 10:55 | |
| *** ociuhandu has joined #openstack-infra | 10:55 | |
| *** gfidente|afk is now known as gfidente | 10:58 | |
| *** ociuhandu has quit IRC | 10:58 | |
| *** ociuhandu has joined #openstack-infra | 10:59 | |
| *** tetsuro has joined #openstack-infra | 11:07 | |
| *** aedc_ has joined #openstack-infra | 11:07 | |
| *** aedc has quit IRC | 11:10 | |
| *** ociuhandu has quit IRC | 11:12 | |
| *** udesale has quit IRC | 11:12 | |
| *** ykarel is now known as ykarel|afk | 11:16 | |
| *** rpittau is now known as rpittau|bbl | 11:18 | |
| *** lbragstad has quit IRC | 11:20 | |
| *** lbragstad has joined #openstack-infra | 11:23 | |
| *** ykarel has joined #openstack-infra | 11:28 | |
| *** Lucas_Gray has joined #openstack-infra | 11:30 | |
| *** ociuhandu has joined #openstack-infra | 11:48 | |
| *** ociuhandu has quit IRC | 11:52 | |
| *** jpena is now known as jpena|lunch | 11:58 | |
| *** ociuhandu has joined #openstack-infra | 11:58 | |
| *** ociuhandu has quit IRC | 12:00 | |
| *** ociuhandu has joined #openstack-infra | 12:02 | |
| *** pkopec has quit IRC | 12:06 | |
| *** pkopec_ has joined #openstack-infra | 12:06 | |
| *** ociuhandu has quit IRC | 12:07 | |
| *** ykarel is now known as ykarel|afk | 12:10 | |
| openstackgerrit | Paul Albertella proposed zuul/zuul master: Fix Gerrit config issue in tutorial demo https://review.opendev.org/701562 | 12:13 |
| *** tetsuro has quit IRC | 12:15 | |
| *** ykarel|afk has quit IRC | 12:26 | |
| *** dosaboy has quit IRC | 12:44 | |
| *** dosaboy has joined #openstack-infra | 12:45 | |
| *** Lucas_Gray has quit IRC | 12:51 | |
| *** rfolco has joined #openstack-infra | 12:54 | |
| *** ykarel|afk has joined #openstack-infra | 12:57 | |
| *** Lucas_Gray has joined #openstack-infra | 12:59 | |
| *** zbr|rover has quit IRC | 13:00 | |
| *** jpena|lunch is now known as jpena | 13:11 | |
| *** gibi has joined #openstack-infra | 13:13 | |
| gibi | hi! it seems that the testr_results.html.gz in this CI run is gzipped twice: https://zuul.opendev.org/t/openstack/build/b46813b6585640068bab92ad93b0475b/logs | 13:14 |
| *** surpatil has quit IRC | 13:20 | |
| *** dpawlik has quit IRC | 13:21 | |
| smcginnis | gibi: See http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011875.html | 13:24 |
| *** dpawlik has joined #openstack-infra | 13:25 | |
| *** rpittau|bbl is now known as rpittau | 13:25 | |
| *** ykarel|afk is now known as ykarel | 13:25 | |
| *** rh-jelabarre has quit IRC | 13:27 | |
| openstackgerrit | Merged openstack/devstack-gate master: Re-enable the n-cauth required service for stable/queens|pike|ocata https://review.opendev.org/701404 | 13:27 |
| gibi | smcginnis: thanks for the link1 | 13:28 |
| *** ociuhandu has joined #openstack-infra | 13:32 | |
| *** ociuhandu has quit IRC | 13:37 | |
| *** ykarel is now known as ykarel|afk | 13:46 | |
| *** ociuhandu has joined #openstack-infra | 13:48 | |
| *** Goneri has joined #openstack-infra | 13:50 | |
| *** ociuhandu has quit IRC | 13:54 | |
| *** ociuhandu has joined #openstack-infra | 13:55 | |
| AJaeger | config-core, please review https://review.opendev.org/700913 (ACL cleanup) and https://review.opendev.org/701596 (grafana update) and https://review.opendev.org/701584 (one liner gerritbot update) | 13:57 |
| *** zul has joined #openstack-infra | 14:01 | |
| *** ociuhandu has quit IRC | 14:03 | |
| *** ociuhandu has joined #openstack-infra | 14:04 | |
| *** eharney has joined #openstack-infra | 14:04 | |
| *** michael-beaver has joined #openstack-infra | 14:07 | |
| *** rlandy has joined #openstack-infra | 14:11 | |
| *** ociuhandu has quit IRC | 14:13 | |
| *** zbr has joined #openstack-infra | 14:16 | |
| *** zxiiro has joined #openstack-infra | 14:17 | |
| *** zbr is now known as zbr|rover | 14:18 | |
| *** slaweq_ is now known as slaweq | 14:26 | |
| *** Lucas_Gray has quit IRC | 14:29 | |
| *** portdirect has joined #openstack-infra | 14:31 | |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: WIP: Documentation reorg https://review.opendev.org/701608 | 14:40 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: WIP: Documentation reorg https://review.opendev.org/701608 | 14:43 |
| hrw | is www.stackalytics.com run by infra or is it external thing? SSL cert expired yesterday | 14:44 |
| AJaeger | hrw: run by mirantis, so completely external | 14:44 |
| hrw | AJaeger: thanks | 14:45 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: WIP: Documentation reorg https://review.opendev.org/701608 | 14:45 |
| *** pcaruana has quit IRC | 14:47 | |
| *** psachin has quit IRC | 14:48 | |
| *** rh-jelabarre has joined #openstack-infra | 14:49 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add --check-config option to zuul scheduler https://review.opendev.org/542160 | 14:49 |
| fungi | hrw: i'm fiddling with the uca mirror now to see if i can figure out what the problem is | 14:50 |
| hrw | fungi: thanks | 14:50 |
| fungi | hrw: okay, i think i've solved it | 14:50 |
| hrw | yay you! | 14:51 |
| fungi | it needed the flood command run for arm64 even though we added it at the same time as amd64 (and this time it didn't include an error in the log letting us know either) | 14:51 |
| openstackgerrit | Mohammed Naser proposed zuul/zuul-helm master: Add Zuul charts https://review.opendev.org/700460 | 14:54 |
| fungi | per the reprepro manpage section on its flood subcommand... "There are mostly two use cases for this command: If you added any new architecture to an distribution and want to copy all architecture all packages to it. Or if you included some architecture all packages only to some architectures using -A to avoid breaking the other architectures for which the binary packages were still missing and now | 14:54 |
| fungi | want to copy it to those architectures were they are unlikely to break something (because a newbinary is already available)." | 14:54 |
| fungi | i don't think we did either of those things, so i wonder why it was populating a zero-byte packages file until i ran it | 14:54 |
| fungi | maybe whatever was actually needed this time also happens as a side-effect of the flood subcommand | 14:55 |
| hrw | no idea. I gave up on mirroring distros long time ago. | 14:56 |
| fungi | we wouldn't either if we didn't get significantly higher throughput and reliability for ci jobs by doing so | 14:59 |
| hrw | I know | 15:00 |
| hrw | but with amount of jobs done on CI not mirroring would be huge waste of time and bandwidth | 15:00 |
| hrw | btdt | 15:00 |
| *** pcaruana has joined #openstack-infra | 15:02 | |
| *** udesale has joined #openstack-infra | 15:04 | |
| *** ociuhandu has joined #openstack-infra | 15:07 | |
| *** Lucas_Gray has joined #openstack-infra | 15:11 | |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Documentation reorg https://review.opendev.org/701608 | 15:12 |
| *** kjackal has quit IRC | 15:12 | |
| *** kjackal has joined #openstack-infra | 15:13 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: WIP: Add spec for scale out scheduler https://review.opendev.org/621479 | 15:14 |
| *** ociuhandu has quit IRC | 15:19 | |
| *** ociuhandu has joined #openstack-infra | 15:20 | |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Documentation reorg https://review.opendev.org/701608 | 15:22 |
| *** ociuhandu has quit IRC | 15:24 | |
| *** ociuhandu has joined #openstack-infra | 15:24 | |
| *** dave-mccowan has quit IRC | 15:25 | |
| *** ociuhandu has quit IRC | 15:28 | |
| *** udesale has quit IRC | 15:33 | |
| openstackgerrit | Mohammed Naser proposed zuul/zuul-helm master: Add Zuul charts https://review.opendev.org/700460 | 15:36 |
| *** pgaxatte has quit IRC | 15:37 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: WIP: Add spec for scale out scheduler https://review.opendev.org/621479 | 15:39 |
| openstackgerrit | Albin Vass proposed zuul/zuul master: Force fetch when updating merger repositories https://review.opendev.org/701753 | 15:41 |
| *** pkopec_ has quit IRC | 15:50 | |
| *** pkopec has joined #openstack-infra | 15:51 | |
| mordred | fungi, corvus: could I nudge you to review https://review.opendev.org/#/c/692003 ? | 15:56 |
| fungi | but of course | 15:56 |
| mordred | clarkb, corvus: could I nudge you to review https://review.opendev.org/#/c/691800/ ? | 15:56 |
| fungi | out of curiosity, what is launchpadlib still being used for there? | 15:57 |
| fungi | do we have automation which authenticates via openid? | 15:58 |
| corvus | bug closing | 15:58 |
| *** armax has joined #openstack-infra | 15:59 | |
| mordred | yah - in the gerrit hook scripts | 16:00 |
| fungi | ohhh, right | 16:00 |
| fungi | to authenticate to lp services | 16:00 |
| corvus | reminder, airship ci call is now | 16:01 |
| fungi | for some reason i was thinking in terms of lp auth for gerrit's webui | 16:01 |
| *** roman_g has quit IRC | 16:01 | |
| fungi | i'm going to listen in on the airship call, but juggling multiple meetings | 16:02 |
| *** gyee has joined #openstack-infra | 16:03 | |
| *** jpena is now known as jpena|off | 16:06 | |
| *** surpatil has joined #openstack-infra | 16:09 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add --check-config option to zuul scheduler https://review.opendev.org/542160 | 16:11 |
| *** bdodd has joined #openstack-infra | 16:12 | |
| beagles | mordred: I'm trying to sort a tricky CI issue where a file that is being installed seems to disappearing. After hacking away with print statements, I think our best option is to try ssh'ing into the node after the deployment fails. Is this possible? | 16:13 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add --validate-tenants option to zuul scheduler https://review.opendev.org/542160 | 16:14 |
| mordred | beagles: yeah - although I'm juggling a couple of meetings right now. an infra-root can set a hold for you and then put an ssh key on there | 16:16 |
| fungi | beagles: yes, we can set a hold for a specific combination of project/job/changeid | 16:16 |
| fungi | and then when that fails, the node won't be deleted | 16:16 |
| fungi | and as mordred says, one of us can add an ssh key for you | 16:16 |
| fungi | once that job ends | 16:17 |
| *** slaweq has quit IRC | 16:17 | |
| beagles | mordred, fungi, cool I'll reach out when I'm ready to re-run the job | 16:18 |
| fungi | sounds good | 16:20 |
| openstackgerrit | James E. Blair proposed zuul/zuul-helm master: Test helm charts against k8s https://review.opendev.org/701764 | 16:22 |
| *** lmiccini has quit IRC | 16:25 | |
| *** ociuhandu has joined #openstack-infra | 16:28 | |
| *** Lucas_Gray has quit IRC | 16:30 | |
| *** slaweq has joined #openstack-infra | 16:34 | |
| *** Lucas_Gray has joined #openstack-infra | 16:37 | |
| *** ociuhandu has quit IRC | 16:38 | |
| *** slaweq has quit IRC | 16:40 | |
| *** roman_g has joined #openstack-infra | 16:43 | |
| *** Lucas_Gray has quit IRC | 16:43 | |
| *** Lucas_Gray has joined #openstack-infra | 16:44 | |
| *** Lucas_Gray has quit IRC | 16:46 | |
| *** iurygregory has quit IRC | 16:46 | |
| *** sshnaidm is now known as sshnaidm|bbl | 16:48 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Add cri-o support to use-buildset registry https://review.opendev.org/701237 | 16:49 |
| openstackgerrit | James E. Blair proposed zuul/zuul-helm master: Test helm charts against k8s https://review.opendev.org/701764 | 16:55 |
| *** lucasagomes has quit IRC | 16:57 | |
| *** mattw4 has joined #openstack-infra | 17:00 | |
| openstackgerrit | Albin Vass proposed zuul/zuul master: Force fetch when updating merger repositories https://review.opendev.org/701753 | 17:01 |
| *** tesseract has quit IRC | 17:01 | |
| *** dtantsur is now known as dtantsur|afk | 17:03 | |
| *** ricolin has quit IRC | 17:03 | |
| *** tosky has quit IRC | 17:05 | |
| *** ociuhandu has joined #openstack-infra | 17:06 | |
| *** tosky has joined #openstack-infra | 17:06 | |
| *** stevebaker has quit IRC | 17:06 | |
| clarkb | roman_g: https://etherpad.openstack.org/p/Wqxwce1UDq | 17:06 |
| *** stevebaker has joined #openstack-infra | 17:07 | |
| roman_g | clarkb: ty | 17:07 |
| clarkb | heh I broke the numbering some how. Sorry | 17:08 |
| *** Lucas_Gray has joined #openstack-infra | 17:10 | |
| roman_g | clarkb: rewrite your name with your color, please | 17:12 |
| roman_g | clarkb: or mark it somehow | 17:12 |
| clarkb | roman_g: done | 17:14 |
| clarkb | roman_g: see my note on item 4 (just wanted to clarify that bit) | 17:14 |
| *** ociuhandu has quit IRC | 17:16 | |
| roman_g | clarkb: item 4: this testing on a huge VM is a third party gate for the Airship 1.x at the moment. It's not implemented for the Airship 2.x we are working on now. | 17:17 |
| clarkb | roman_g: oh I see | 17:17 |
| openstackgerrit | Merged zuul/zuul master: Only report to changes in gerrit https://review.opendev.org/696459 | 17:18 |
| openstackgerrit | James E. Blair proposed zuul/zuul-helm master: Test helm charts against k8s https://review.opendev.org/701764 | 17:29 |
| *** jpena|off is now known as jpena | 17:31 | |
| *** ykarel|afk is now known as ykarel|away | 17:31 | |
| *** evrardjp has quit IRC | 17:33 | |
| *** evrardjp has joined #openstack-infra | 17:34 | |
| *** sshnaidm|bbl is now known as sshnaidm | 17:38 | |
| clarkb | roman_g: I added links to the multi-node-* roles that we use to set up l2 networking | 17:38 |
| clarkb | at the bottom of the etherpad | 17:38 |
| *** ykarel|away has quit IRC | 17:40 | |
| *** rpittau is now known as rpittau|afk | 17:44 | |
| *** eharney has quit IRC | 17:44 | |
| roman_g | clarkb: I see. Thank you! | 17:44 |
| AJaeger | config-core, please review https://review.opendev.org/700913 (ACL cleanup) and https://review.opendev.org/701596 (grafana ocatavia update) and https://review.opendev.org/701584 (one liner gerritbot update) | 17:57 |
| fungi | infra-root: rackspace notified us of a host outage impacting zm05, looks like the zuul-merger service didn't start, and there's nothing in its logs to indicate it tried and died, though there's no stale pidfile i can find | 18:00 |
| fungi | systemctl status reports Active: active (exited) since Thu 2020-01-09 03:03:49 UTC; 14h ago | 18:01 |
| fungi | i'm going to try telling systemctl to stop and start it again | 18:01 |
| fungi | zuul 14690 1.8 3.3 620612 67796 ? Sl 18:02 0:00 /usr/bin/python3 /usr/local/bin/zuul-merger | 18:02 |
| fungi | 2020-01-09 18:02:34,600 DEBUG zuul.Merger: Configured logging: 3.14.1.dev16 | 18:03 |
| fungi | that seems to have done the trick | 18:03 |
| clarkb | roman_g: did you want to compile what we've got into an email we can send? | 18:04 |
| fungi | 2020-01-09 18:06:58,498 DEBUG zuul.MergeServer: Got refstate job: 904b1ace4ac4490d97841f6163fb1d61 | 18:07 |
| *** ociuhandu has joined #openstack-infra | 18:07 | |
| fungi | looks like it's taking orders again, so i'll close out the provider trouble ticket | 18:07 |
| roman_g | clarkb: no, I wast wanted to have confirmation from Chris that they are OK to use those bare-metals in standard shared OpenStack Foundation nodepool, before we shoot an e-mail to the mailing list | 18:07 |
| roman_g | *wast -> just | 18:07 |
| clarkb | roman_g: gotcha | 18:07 |
| clarkb | I'll wait to hear back from you on that then | 18:08 |
| roman_g | clarkb: deal. I will talk to him | 18:08 |
| * fungi notes that it's the opendev nodepool, not really the osf nodepool | 18:08 | |
| roman_g | fungi: pardon, I'm a bit lost on what has moved to OpenDev already and what has not yet moved | 18:09 |
| fungi | well, the openstack infrastructure nodepool also wasn't really the osf nodepool | 18:09 |
| fungi | it's always been a community collaboration, it's not overseen by the foundation | 18:10 |
| roman_g | aah, gotcha | 18:10 |
| roman_g | also I often find myself mixing OpenDev with OpenInfra | 18:10 |
| fungi | the foundation promotes/recommends it, but they don't run it (at least not directly, though a couple of is who participate are employed by the osf, most are not) | 18:10 |
| fungi | s/of is/of us/ | 18:11 |
| fungi | the idea is that it's a collaboration run by the people/projects who use it | 18:12 |
| openstackgerrit | James E. Blair proposed zuul/zuul-helm master: Change builder container name https://review.opendev.org/701793 | 18:13 |
| *** gfidente is now known as gfidente|afk | 18:14 | |
| *** ociuhandu has quit IRC | 18:15 | |
| fungi | #status log manually restarted zuul-merger service on zm05 at 18:02z because it did not start automatically following a host outage earlier at 02:10-03:15z | 18:15 |
| openstackstatus | fungi: finished logging | 18:15 |
| *** ociuhandu has joined #openstack-infra | 18:16 | |
| *** pkopec has quit IRC | 18:17 | |
| openstackgerrit | Merged opendev/system-config master: Use LE cert for git.zuul-ci.org https://review.opendev.org/701640 | 18:19 |
| openstackgerrit | Merged zuul/zuul master: Force fetch when updating merger repositories https://review.opendev.org/701753 | 18:20 |
| *** ociuhandu has quit IRC | 18:21 | |
| *** ociuhandu has joined #openstack-infra | 18:23 | |
| *** JayF has joined #openstack-infra | 18:24 | |
| *** Lucas_Gray has quit IRC | 18:25 | |
| *** ociuhandu has quit IRC | 18:27 | |
| *** jpena is now known as jpena|off | 18:29 | |
| *** electrofelix has quit IRC | 18:31 | |
| *** surpatil has quit IRC | 18:32 | |
| *** surpatil has joined #openstack-infra | 18:33 | |
| yoctozepto | clarkb, AJaeger, mordred: if you wanted to discuss next steps on js-openstack-lib, I'm waiting here :-) | 18:40 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Documentation reorg https://review.opendev.org/701608 | 18:44 |
| AJaeger | yoctozepto: if mordred will adopt is in SDK as SDK PTL, then it's two things: A change for governance repo to transfer the repo, and updating the ACL to give a new core team. clarkb would need to Ack this. You don't need me for that - I'll just abandon my changes if this happens. ;) So, please talk with mordred and clarkb. | 18:48 |
| *** tosky has quit IRC | 18:48 | |
| yoctozepto | AJaeger: ack, thanks | 18:49 |
| * yoctozepto writes a note to not bother AJaeger further :-) | 18:49 | |
| fungi | also it's in the opendev namespace, right? if so, we'll need to schedule a rename change/maintenance for its move to the openstack namespace at some point | 18:49 |
| AJaeger | yoctozepto: I'm happy to hand out pointer and delegate ;) | 18:50 |
| yoctozepto | fungi: it's openstack | 18:50 |
| fungi | though that's not time-sensitive | 18:50 |
| AJaeger | fungi: openstack, so no worries | 18:50 |
| yoctozepto | AJaeger: :-) | 18:50 |
| fungi | ahh, since it's already in the openstack namespace, then yes, much easier ;) | 18:50 |
| AJaeger | indeed | 18:51 |
| AJaeger | yoctozepto: besides governance change, a change for project-config/gerritbot/ will be needed so that you don't spam us here ;) | 18:51 |
| yoctozepto | AJaeger: ack ;-) | 18:53 |
| yoctozepto | AJaeger: actually I think I will be bothering you still as I will want to drop those legacy jobs and move Zuul config to project's repo | 18:56 |
| yoctozepto | ;-) | 18:56 |
| * yoctozepto not so easy to get rid of, huh | 18:56 | |
| fungi | moving those jobs into the repo sound like a great idea | 18:57 |
| fungi | as does making them use zuul v3 native functionality rather than relying on legacy variables/playbooks | 18:58 |
| yoctozepto | fungi: for the moment we can drop legacy completely as they need rewrite in many aspects and just block progress | 18:58 |
| yoctozepto | new ones will go zuulv3 for sure | 18:59 |
| yoctozepto | using the roles recommended by AJaeger and clarkb | 18:59 |
| fungi | yeah, sounds like most/all of what's needed already exists, just needs to be put to use there | 18:59 |
| yoctozepto | fungi: since you are around, could you elaborate on dsvm? | 19:00 |
| yoctozepto | I believe this is devstack in action stuff | 19:00 |
| fungi | it's an ancient abbreviation we used for "devstack virtual machine" jobs, which ran on devstack-specific nodes whose images were custom-tailored for devstack | 19:01 |
| *** eharney has joined #openstack-infra | 19:01 | |
| yoctozepto | the language of ancients is fascinating indeed | 19:01 |
| fungi | those were our "thin" job nodes, and then we had "thick" job nodes with tons of dependencies for things like unit tests preinstalled | 19:01 |
| yoctozepto | thanks | 19:01 |
| yoctozepto | oh gosh | 19:02 |
| *** kjackal has quit IRC | 19:02 | |
| fungi | we eventually underwent a massive reorganization to collapse nodes onto a single image per platform and got rid of the thick/thin split, but the old dsvm abbreviation hung around in job names long after they no longer ran on special nodes | 19:03 |
| yoctozepto | fungi: I see, that makes sens | 19:03 |
| yoctozepto | sense* | 19:03 |
| fungi | at one point though, we had a zuul scheduling function which caused jobs with "dsvm" in their names to run on that specific node type | 19:04 |
| fungi | which is why you find it all over in the names of old jobs | 19:04 |
| yoctozepto | I see | 19:04 |
| *** ab-a has joined #openstack-infra | 19:12 | |
| *** zul has quit IRC | 19:20 | |
| openstackgerrit | Clark Boylan proposed opendev/zone-opendev.org master: Add LE delegation for zuul.opendev.org https://review.opendev.org/701819 | 19:30 |
| *** pcaruana has quit IRC | 19:35 | |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Provision LE cert for zuul.opendev.org https://review.opendev.org/701820 | 19:37 |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Use zuul.opendev.org LE cert https://review.opendev.org/701821 | 19:40 |
| clarkb | infra-root ^ I think we can start working through that stack now | 19:40 |
| *** ociuhandu has joined #openstack-infra | 19:42 | |
| *** kjackal has joined #openstack-infra | 19:42 | |
| *** ralonsoh has quit IRC | 19:44 | |
| *** ociuhandu has quit IRC | 19:47 | |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Move chart-testing to a role and disable version check https://review.opendev.org/701822 | 19:48 |
| openstackgerrit | James E. Blair proposed zuul/zuul-helm master: Change builder container name https://review.opendev.org/701793 | 19:48 |
| openstackgerrit | Merged openstack/project-config master: gerritbot: notify in #heat for stable branches https://review.opendev.org/701584 | 19:57 |
| openstackgerrit | Merged openstack/project-config master: Add periodic panel to Octavia dashboard https://review.opendev.org/701596 | 19:57 |
| *** openstackgerrit has quit IRC | 19:59 | |
| *** slaweq has joined #openstack-infra | 20:08 | |
| *** Lucas_Gray has joined #openstack-infra | 20:21 | |
| *** dpawlik has quit IRC | 20:35 | |
| *** openstackgerrit has joined #openstack-infra | 20:46 | |
| openstackgerrit | Jeremy Stanley proposed opendev/zone-opendev.org master: Reorganize zonefile https://review.opendev.org/701833 | 20:46 |
| fungi | clarkb: ^ is that more along the lines of what you were thinking? | 20:47 |
| clarkb | ya grouping by name rather than record type | 20:48 |
| hrw | fungi: sorry to bother, but how it goes with reprepro mirroring uca/ussuri/arm64? http://files.openstack.org/mirror/ubuntu-cloud-archive/pool/main/p/python-ethtool/ has amd64 only | 20:48 |
| fungi | hrw: oh, i haven't done anything since hours ago when i said i thought i had fixed it | 20:49 |
| hrw | fungi: no problem. I decided that my ubuntu-bionic-aarch64 job may wait until we get more nodes. still probably better to resolve issue while you remember what it logged | 20:50 |
| fungi | yeah, i see http://ubuntu-cloud.archive.canonical.com/ubuntu/pool/main/p/python-ethtool/ shows arm64 versions of those packages | 20:52 |
| fungi | so not sure why reprepro chose not to grab them | 20:53 |
| fungi | i wonder if this is the same situation we had when we added buster to the debian config and then it repeatedly failed to grab bew packages for the updates repo | 20:53 |
| fungi | i ended up blowing away reprepro's database for that mirror and letting it reindex everything | 20:54 |
| fungi | hopefully uca is small enough doing that wouldn't take long | 20:54 |
| hrw | fungi: thanks | 20:54 |
| *** Lucas_Gray has quit IRC | 20:57 | |
| *** Lucas_Gray has joined #openstack-infra | 21:02 | |
| fungi | infra-root: i have a root screen session on mirror-update.openstack.org with one window holding the /var/run/reprepro/ubuntu-cloud-archive.lock flock and have moved /afs/.openstack.org/mirror/ubuntu-cloud-archive/db into ~/tmp/ | 21:02 |
| fungi | i'm about to manually rerun the cronjob to refresh uca packages, which should hopefully not need to redownload any existing packages, just reindex everything and fetch missing one | 21:03 |
| fungi | s | 21:03 |
| fungi | it's underway now | 21:03 |
| *** eharney has quit IRC | 21:05 | |
| *** Lucas_Gray has quit IRC | 21:10 | |
| *** Lucas_Gray has joined #openstack-infra | 21:11 | |
| *** kjackal has quit IRC | 21:13 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Add basic Helm jobs https://review.opendev.org/700222 | 21:19 |
| *** surpatil has quit IRC | 21:21 | |
| *** michael-beaver has quit IRC | 21:27 | |
| *** jtomasek has quit IRC | 21:32 | |
| *** rh-jelabarre has quit IRC | 21:33 | |
| openstackgerrit | Jeremy Stanley proposed opendev/system-config master: Add arm64 to reprepro updates file for UCA https://review.opendev.org/701843 | 21:35 |
| fungi | hrw: found it ^ | 21:35 |
| fungi | i've manually applied that and have reprepro running with it in place, seems to be pulling in arm64 packages now | 21:36 |
| fungi | that's probably been the issue all along | 21:36 |
| fungi | i know it's late where you are, but i'll still let you know once it's done in case you happen to be awake | 21:37 |
| *** Goneri has quit IRC | 21:41 | |
| openstackgerrit | Jeremy Stanley proposed opendev/zone-opendev.org master: Reorganize zonefile https://review.opendev.org/701833 | 21:48 |
| *** xek__ has quit IRC | 21:55 | |
| mordred | fungi: that'll definitely do it | 22:14 |
| fungi | hrw: completed at 2020-01-09T22:13:27 | 22:18 |
| fungi | hopefully it's working for you next opportunity you have to test | 22:19 |
| *** slaweq has quit IRC | 22:19 | |
| fungi | http://files.openstack.org/mirror/ubuntu-cloud-archive/pool/main/p/python-ethtool/ is showing arm64 debs now as well | 22:20 |
| fungi | infra-root: i've released the flock for uca mirror updates now | 22:21 |
| openstackgerrit | Merged zuul/zuul-helm master: Added nodepool to charts https://review.opendev.org/700462 | 22:26 |
| openstackgerrit | Merged zuul/zuul-jobs master: Move chart-testing to a role and disable version check https://review.opendev.org/701822 | 22:31 |
| openstackgerrit | Merged opendev/system-config master: Clean up review comments https://review.opendev.org/692003 | 22:42 |
| *** bdodd has quit IRC | 22:50 | |
| openstackgerrit | Mohammed Naser proposed zuul/zuul-helm master: Test helm charts against k8s https://review.opendev.org/701764 | 22:51 |
| *** rcernin has joined #openstack-infra | 22:57 | |
| clarkb | infra-root anyone else able to review https://review.opendev.org/#/c/701819/1 and https://review.opendev.org/#/c/701820/ to hopefully get zuul.opendev.org's cert LE'd? | 22:58 |
| clarkb | fungi: re ^ and zuul.openstack.org that cert actually expires in 2021. I'm hoping we'll be able to simply stop using the .openstack.org names by midyear 2021 but we'll have to see how we do | 22:59 |
| fungi | oh, indeed, i missed that we got such a long one for it | 23:00 |
| clarkb | fungi: when I did the last round of renewals I went with 2 year to give us breathing room and time to focus on switchign to LE | 23:00 |
| clarkb | with the hope that many/most/all names might be canonically opendev.org'd and we can sort of let .openstack.org names die on the vine | 23:00 |
| clarkb | however at the time we also didn't realize we could delegate to acme.opendev.org from openstack.org | 23:01 |
| fungi | anyway, it was really just an open question, didn't stop me from tossing in a +2 | 23:01 |
| corvus | clarkb: +2s and 1 +3 on the first dns change | 23:01 |
| corvus | i'll let you +w the rest | 23:01 |
| clarkb | corvus: thank you | 23:01 |
| *** tkajinam has joined #openstack-infra | 23:05 | |
| *** hrw has quit IRC | 23:06 | |
| openstackgerrit | Merged opendev/system-config master: Plumb through secure.config contents https://review.opendev.org/691800 | 23:07 |
| openstackgerrit | Merged opendev/zone-opendev.org master: Add LE delegation for zuul.opendev.org https://review.opendev.org/701819 | 23:07 |
| openstackgerrit | Mohammed Naser proposed zuul/zuul-helm master: Test helm charts against k8s https://review.opendev.org/701764 | 23:18 |
| *** slaweq has joined #openstack-infra | 23:20 | |
| *** slaweq has quit IRC | 23:25 | |
| openstackgerrit | Mohammed Naser proposed zuul/zuul-helm master: Test helm charts against k8s https://review.opendev.org/701764 | 23:31 |
| openstackgerrit | Merged opendev/system-config master: Add arm64 to reprepro updates file for UCA https://review.opendev.org/701843 | 23:39 |
| *** aedc_ has quit IRC | 23:42 | |
| openstackgerrit | Mohammed Naser proposed zuul/zuul-helm master: Test helm charts against k8s https://review.opendev.org/701764 | 23:43 |
| *** goldyfruit has joined #openstack-infra | 23:43 | |
| openstackgerrit | James E. Blair proposed zuul/zuul-helm master: Add empty clouds value https://review.opendev.org/701865 | 23:47 |
| *** stevebaker has quit IRC | 23:48 | |
| openstackgerrit | Merged opendev/system-config master: Provision LE cert for zuul.opendev.org https://review.opendev.org/701820 | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!