| *** rascasoft has quit IRC | 00:00 | |
| clarkb | the ubuntu-ports mirror should be our first mirror to update | 00:02 |
|---|---|---|
| clarkb | watching it now | 00:02 |
| clarkb | Released volume mirror.deb-hammer successfully | 00:06 |
| clarkb | still waiting for ubuntu-ports, it had actual content so seems like a good one to check on | 00:06 |
| clarkb | ianw: for graphite.o.o cleanup can we remove graphite.openstack.org from the emergency.yaml file? | 00:11 |
| clarkb | Released volume mirror.ubuntu-ports successfully | 00:12 |
| clarkb | http://mirror.dfw.rax.openstack.org/ubuntu-ports/timestamp.txt | 00:12 |
| clarkb | with that I think I am calling ti a day | 00:13 |
| clarkb | thanks for all the help with that today everyone | 00:13 |
| ianw | clarkb: yep, i can remove the host now. i'll put on my todo list | 00:15 |
| *** gyee has quit IRC | 00:16 | |
| *** rlandy has quit IRC | 00:20 | |
| *** sthussey has quit IRC | 00:21 | |
| *** gfidente|afk has quit IRC | 00:22 | |
| *** dave-mccowan has joined #openstack-infra | 00:54 | |
| *** agopi has quit IRC | 01:04 | |
| openstackgerrit | Merged openstack-infra/system-config master: Just use openstack.org domain for wiki hosts https://review.openstack.org/642267 | 01:10 |
| openstackgerrit | Merged openstack-infra/system-config master: Add wiki-dev02 to Ansible inventory https://review.openstack.org/642268 | 01:10 |
| openstackgerrit | Merged openstack-infra/system-config master: Add meetbot to openstack-fenix channel https://review.openstack.org/642340 | 01:10 |
| *** whoami-rajat has joined #openstack-infra | 01:12 | |
| openstackgerrit | Merged openstack-infra/zuul master: Remove default user for fingergw https://review.openstack.org/635632 | 01:16 |
| openstackgerrit | Merged openstack-infra/zuul master: Remove default zookeeper hosts https://review.openstack.org/635633 | 01:16 |
| *** wolverineav has quit IRC | 01:18 | |
| *** wolverineav has joined #openstack-infra | 01:18 | |
| *** ricolin has joined #openstack-infra | 01:22 | |
| *** wolverineav has quit IRC | 01:23 | |
| *** wolverineav has joined #openstack-infra | 01:33 | |
| *** wolverineav has quit IRC | 01:33 | |
| *** rascasoft has joined #openstack-infra | 01:36 | |
| *** rascasoft has quit IRC | 01:44 | |
| *** hongbin has joined #openstack-infra | 01:53 | |
| *** armax has quit IRC | 02:12 | |
| *** armax has joined #openstack-infra | 02:19 | |
| *** openstackstatus has quit IRC | 02:22 | |
| *** openstack has joined #openstack-infra | 02:23 | |
| *** ChanServ sets mode: +o openstack | 02:23 | |
| *** wolverineav has joined #openstack-infra | 02:59 | |
| *** rascasoft has joined #openstack-infra | 03:00 | |
| *** agopi has joined #openstack-infra | 03:06 | |
| *** rascasoft has quit IRC | 03:10 | |
| *** apetrich has quit IRC | 03:16 | |
| *** yamamoto has joined #openstack-infra | 03:30 | |
| *** hongbin has quit IRC | 03:33 | |
| *** ykarel|away has joined #openstack-infra | 03:39 | |
| *** ykarel|away is now known as ykarel | 03:39 | |
| *** dave-mccowan has quit IRC | 03:40 | |
| *** udesale has joined #openstack-infra | 03:49 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul master: Add API endpoint to get frozen jobs https://review.openstack.org/607077 | 03:50 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul master: Get executor job params https://review.openstack.org/607078 | 03:50 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul master: Separate out executor server from runner https://review.openstack.org/607079 | 03:50 |
| *** rh-jelabarre has quit IRC | 03:51 | |
| *** lathiat has quit IRC | 04:01 | |
| *** lathiat has joined #openstack-infra | 04:02 | |
| *** ramishra has joined #openstack-infra | 04:02 | |
| *** mordred has quit IRC | 04:14 | |
| *** Shrews has quit IRC | 04:14 | |
| openstackgerrit | Riju Khatri proposed openstack-infra/storyboard-webclient master: Enhance adding tags on story details page https://review.openstack.org/642643 | 04:19 |
| *** mordred has joined #openstack-infra | 04:21 | |
| *** Shrews has joined #openstack-infra | 04:21 | |
| *** yamamoto has quit IRC | 04:22 | |
| *** yamamoto has joined #openstack-infra | 04:22 | |
| *** jmorgan1 has quit IRC | 04:31 | |
| *** jmorgan1 has joined #openstack-infra | 04:32 | |
| *** diablo_rojo has quit IRC | 04:32 | |
| *** mordred has quit IRC | 04:37 | |
| *** Shrews has quit IRC | 04:37 | |
| *** janki has joined #openstack-infra | 04:38 | |
| *** rascasoft has joined #openstack-infra | 04:41 | |
| *** Shrews has joined #openstack-infra | 04:44 | |
| *** udesale has quit IRC | 04:45 | |
| *** mordred has joined #openstack-infra | 04:45 | |
| *** udesale has joined #openstack-infra | 04:46 | |
| *** rascasoft has quit IRC | 04:49 | |
| kota_ | hello, can i ask how to configure zuul jobs in .zuul.xml in the project repository? | 04:55 |
| kota_ | I found sub feature branch of our Swift project is missing some gate job but I cannot find the reason yet. | 04:56 |
| kota_ | the missing gate job is `swift-dsvm-xxxx` that is configured as cross-project job (e.g. it includes `required-projects` setting), https://github.com/openstack/swift/blob/master/.zuul.yaml#L147 | 04:59 |
| *** wolverineav has quit IRC | 05:00 | |
| *** wolverineav has joined #openstack-infra | 05:01 | |
| *** markvoelker has joined #openstack-infra | 05:06 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul master: Add API endpoint to get frozen jobs https://review.openstack.org/607077 | 05:07 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul master: Add API endpoint to get frozen jobs https://review.openstack.org/607077 | 05:11 |
| *** armax has quit IRC | 05:11 | |
| *** wolverineav has quit IRC | 05:17 | |
| *** wolverineav has joined #openstack-infra | 05:18 | |
| *** wolverineav has quit IRC | 05:22 | |
| *** wolverineav has joined #openstack-infra | 05:25 | |
| *** larainema has joined #openstack-infra | 05:26 | |
| *** wolverineav has quit IRC | 05:30 | |
| *** jmorgan1 has quit IRC | 05:31 | |
| *** jmorgan1 has joined #openstack-infra | 05:31 | |
| *** wolverineav has joined #openstack-infra | 05:32 | |
| *** wolverineav has quit IRC | 05:40 | |
| *** ykarel is now known as ykarel|afk | 05:40 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul master: Get executor job params https://review.openstack.org/607078 | 05:55 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul master: Separate out executor server from runner https://review.openstack.org/607079 | 05:55 |
| *** jtomasek has joined #openstack-infra | 05:58 | |
| *** rf0lc0 has joined #openstack-infra | 06:00 | |
| *** slaweq_ has joined #openstack-infra | 06:01 | |
| *** ykarel|afk is now known as ykarel | 06:01 | |
| *** tristanC has quit IRC | 06:02 | |
| *** lastmikoi has quit IRC | 06:03 | |
| *** wolverineav has joined #openstack-infra | 06:04 | |
| *** tristanC2 has joined #openstack-infra | 06:04 | |
| *** wolverineav has quit IRC | 06:04 | |
| *** snierodz_ has joined #openstack-infra | 06:04 | |
| *** jbadiapa has quit IRC | 06:05 | |
| *** slaweq has quit IRC | 06:07 | |
| *** rfolco|ruck|off has quit IRC | 06:07 | |
| *** mgoddard has quit IRC | 06:07 | |
| *** snierodz has quit IRC | 06:07 | |
| *** pabelanger has quit IRC | 06:07 | |
| *** gary_perkins has quit IRC | 06:08 | |
| *** lastmikoi has joined #openstack-infra | 06:09 | |
| *** andreaf has quit IRC | 06:09 | |
| *** flaper87 has quit IRC | 06:10 | |
| *** gary_perkins has joined #openstack-infra | 06:10 | |
| *** mgoddard has joined #openstack-infra | 06:10 | |
| *** panda|rover|off has quit IRC | 06:10 | |
| *** andreaf has joined #openstack-infra | 06:12 | |
| *** panda has joined #openstack-infra | 06:12 | |
| *** flaper87 has joined #openstack-infra | 06:13 | |
| *** wolverineav has joined #openstack-infra | 06:14 | |
| *** e0ne has joined #openstack-infra | 06:18 | |
| *** rascasoft has joined #openstack-infra | 06:19 | |
| *** masayukig[m] has joined #openstack-infra | 06:20 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [dmn] stashing some scripts to make git:// -> https:// changes https://review.openstack.org/642314 | 06:22 |
| *** wolverineav has quit IRC | 06:32 | |
| *** rascasoft has quit IRC | 06:32 | |
| *** masayukig[m] is now known as masayukig[m]1 | 06:35 | |
| *** masayukig[m]1 is now known as masayukig[m]2 | 06:35 | |
| ianw | #status log graphite-old.openstack.org server, volumes & dns records removed (replaced by graphite.opendev.org) | 07:06 |
| openstackstatus | ianw: finished logging | 07:06 |
| AJaeger | kota_: is the swift-dsvm-xxx job defined in the branch itself? You need to define jobs for each branch separately | 07:09 |
| *** apetrich has joined #openstack-infra | 07:13 | |
| kota_ | AJaeger: in .zuul.yaml, is it? yes, you can find the job definition at https://github.com/openstack/swift/blob/feature/losf/.zuul.yaml#L147 then, it is set in the check list, https://github.com/openstack/swift/blob/feature/losf/.zuul.yaml#L352 | 07:21 |
| *** rascasoft has joined #openstack-infra | 07:23 | |
| *** pgaxatte has joined #openstack-infra | 07:25 | |
| *** dpawlik has joined #openstack-infra | 07:30 | |
| AJaeger | kota_: you can add "debug: true" to the check queue to see after the run in the CI output why it could not find it. Might be that it does not find devstack-minimal. you might need to ask during US time the rest of the time - I'll be offline for a bit now... | 07:35 |
| kota_ | AJaeger: ok. thanks. | 07:36 |
| * kota_ is thinking devstack-minimal is in devstack then, it will be pulled by required-project | 07:36 | |
| AJaeger | kota_: but devstack has branches - and there'S no "features/losf" branch. | 07:38 |
| *** pcaruana has joined #openstack-infra | 07:39 | |
| kota_ | oic | 07:39 |
| *** owalsh has quit IRC | 07:39 | |
| kota_ | so perhaps, we need to set master branch explicitly? | 07:40 |
| kota_ | for required-projects | 07:40 |
| AJaeger | kota_: https://zuul-ci.org/docs/zuul/user/config.html#attr-pragma.implied-branches | 07:40 |
| kota_ | let me check the docs.. | 07:42 |
| AJaeger | kota_: so, enable debug - and read the docs. corvus can help with details during US time... | 07:42 |
| AJaeger | bbl | 07:43 |
| *** pcaruana has quit IRC | 07:43 | |
| *** pcaruana has joined #openstack-infra | 07:43 | |
| kota_ | alright, thx | 07:43 |
| *** AJaeger has quit IRC | 07:46 | |
| *** ykarel is now known as ykarel|lunch | 07:52 | |
| *** kopecmartin|off is now known as kopecmartin | 07:53 | |
| *** jbadiapa has joined #openstack-infra | 07:54 | |
| *** wolverineav has joined #openstack-infra | 07:55 | |
| *** wolverineav has quit IRC | 07:59 | |
| *** rpittau|afk is now known as rpittau | 07:59 | |
| *** ginopc has joined #openstack-infra | 08:03 | |
| *** kjackal has joined #openstack-infra | 08:06 | |
| *** tkajinam has quit IRC | 08:07 | |
| *** threestrands_ has quit IRC | 08:11 | |
| openstackgerrit | Ankita Bansal proposed openstack-infra/storyboard-webclient master: allow subscriptions to projects when items in project groups list are expanded https://review.openstack.org/642371 | 08:16 |
| *** e0ne has quit IRC | 08:17 | |
| *** ykarel|lunch is now known as ykarel | 08:20 | |
| *** ccamacho has joined #openstack-infra | 08:21 | |
| *** e0ne has joined #openstack-infra | 08:23 | |
| *** xek has joined #openstack-infra | 08:34 | |
| *** iurygregory has joined #openstack-infra | 08:35 | |
| *** e0ne has quit IRC | 08:39 | |
| openstackgerrit | Ankita Bansal proposed openstack-infra/storyboard-webclient master: Pagination error in active/merged/invalid stories in projects resolved. https://review.openstack.org/642224 | 08:43 |
| *** jpena|off is now known as jpena | 08:44 | |
| openstackgerrit | Ankita Bansal proposed openstack-infra/storyboard-webclient master: Pagination error in active/merged/invalid stories in projects resolved. https://review.openstack.org/642224 | 08:44 |
| kota_ | AJaeger: thanks, it looks like finally I got the dsvm jobs in the feature/losf branch. My way is setting override-checkout for master branch. I'm not sure the implied-branch matcher works similar with my usage. | 08:44 |
| *** dtantsur|afk is now known as dtantsur | 08:52 | |
| *** adriancz has joined #openstack-infra | 08:54 | |
| *** AJaeger has joined #openstack-infra | 09:00 | |
| *** jpich has joined #openstack-infra | 09:01 | |
| *** priteau has joined #openstack-infra | 09:02 | |
| *** hwoarang has quit IRC | 09:04 | |
| *** roman_g has joined #openstack-infra | 09:04 | |
| *** hwoarang has joined #openstack-infra | 09:05 | |
| *** iurygregory has quit IRC | 09:06 | |
| *** nickv1985 has joined #openstack-infra | 09:11 | |
| *** hwoarang has quit IRC | 09:13 | |
| openstackgerrit | Ankita Bansal proposed openstack-infra/storyboard-webclient master: Displayed tags should link to search view for the tag https://review.openstack.org/642262 | 09:14 |
| *** hwoarang has joined #openstack-infra | 09:15 | |
| *** lucasagomes has joined #openstack-infra | 09:16 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: prevent exception if a parent job doesn't exists https://review.openstack.org/642702 | 09:22 |
| zbr | ianw: clarkb fungi corvus : re bindep, please cast a proposal/vote on https://ask.openstack.org/en/question/120501/what-atom-should-bindep-expose-about-official-distro-python-version/?answer=120502#post-id-120502 -- naming convention strikes again :D | 09:27 |
| *** iurygregory has joined #openstack-infra | 09:31 | |
| *** rf0lc0 is now known as rfolco|ruck | 09:34 | |
| *** derekh has joined #openstack-infra | 09:34 | |
| *** tosky has joined #openstack-infra | 09:44 | |
| *** gfidente has joined #openstack-infra | 09:45 | |
| *** helenafm has joined #openstack-infra | 09:58 | |
| openstackgerrit | Merged openstack-infra/zuul master: web: switch jobs list to a tree view https://review.openstack.org/633437 | 10:03 |
| openstackgerrit | Merged openstack-infra/zuul master: web: add jobs list filter https://review.openstack.org/633652 | 10:06 |
| *** gbutnaru has joined #openstack-infra | 10:12 | |
| *** owalsh has joined #openstack-infra | 10:14 | |
| openstackgerrit | Merged openstack-infra/zuul master: web: add flatten checkbox https://review.openstack.org/642047 | 10:15 |
| *** e0ne has joined #openstack-infra | 10:16 | |
| *** panda is now known as panda|rover | 10:22 | |
| *** iurygregory has quit IRC | 10:29 | |
| *** iurygregory has joined #openstack-infra | 10:29 | |
| openstackgerrit | Merged openstack-infra/zuul-sphinx master: Add type to role variables https://review.openstack.org/641168 | 10:32 |
| *** lpetrut has joined #openstack-infra | 10:33 | |
| *** ykarel is now known as ykarel|lunch | 10:40 | |
| *** luizbag has joined #openstack-infra | 10:44 | |
| *** electrofelix has joined #openstack-infra | 10:49 | |
| *** ykarel|lunch is now known as ykarel | 11:07 | |
| *** chkumar|pto is now known as chandankumar | 11:11 | |
| *** ricolin_ has joined #openstack-infra | 11:20 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Allow marking stories as security-related https://review.openstack.org/642071 | 11:21 |
| *** dave-mccowan has joined #openstack-infra | 11:23 | |
| *** ricolin has quit IRC | 11:23 | |
| *** chandankumar is now known as chkumar246 | 11:35 | |
| jrosser | what does this mean? openstack-ansible-functional-ubuntu-bionic finger://ze02.openstack.org/4691d70e7c424ffb886b97c8758717c7 : RETRY_LIMIT in 14m 46s | 11:36 |
| jrosser | i have a few patches doing that consistently | 11:36 |
| *** ricolin__ has joined #openstack-infra | 11:49 | |
| *** owalsh has quit IRC | 11:50 | |
| *** ricolin_ has quit IRC | 11:51 | |
| *** owalsh has joined #openstack-infra | 11:52 | |
| *** rh-jelabarre has joined #openstack-infra | 11:53 | |
| *** jpena is now known as jpena|lunch | 11:56 | |
| *** owalsh has quit IRC | 11:56 | |
| *** owalsh has joined #openstack-infra | 11:57 | |
| *** ricolin__ has quit IRC | 11:58 | |
| *** rlandy has joined #openstack-infra | 12:01 | |
| *** iurygregory has quit IRC | 12:03 | |
| *** iurygregory has joined #openstack-infra | 12:03 | |
| *** owalsh has quit IRC | 12:06 | |
| *** owalsh has joined #openstack-infra | 12:07 | |
| *** trown|outtypewww is now known as trown | 12:10 | |
| *** jpich has quit IRC | 12:14 | |
| *** cmoura has joined #openstack-infra | 12:15 | |
| *** jpich has joined #openstack-infra | 12:15 | |
| *** markvoelker has quit IRC | 12:18 | |
| *** owalsh has quit IRC | 12:18 | |
| *** owalsh has joined #openstack-infra | 12:21 | |
| *** panda|rover is now known as panda|rover|lunc | 12:21 | |
| frickler | jrosser: it usually means that the job failed in the pre or post phase, even after zuul retried. may be an issue with your job or with our setup, which patches are affected? | 12:23 |
| jrosser | frickler: froma quick look https://review.openstack.org/#/c/636776/ https://review.openstack.org/#/c/639550/ https://review.openstack.org/#/c/639544/ | 12:33 |
| jrosser | although those patches are all generated from the bot, those errors appear to be in specific repos, like here https://review.openstack.org/#/q/project:openstack/openstack-ansible-os_octavia | 12:35 |
| *** e0ne has quit IRC | 12:36 | |
| *** kgiusti has joined #openstack-infra | 12:38 | |
| openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config master: Move wsme jobs in-tree https://review.openstack.org/642737 | 12:38 |
| *** iurygregory has quit IRC | 12:39 | |
| *** iurygregory has joined #openstack-infra | 12:40 | |
| *** jaosorior has quit IRC | 12:43 | |
| *** yamamoto has quit IRC | 12:47 | |
| dabukalam | Schedule for OpenInfra Days UK is live! https://openinfradays.co.uk/ | 12:48 |
| *** yamamoto has joined #openstack-infra | 12:48 | |
| *** udesale has quit IRC | 12:50 | |
| *** udesale has joined #openstack-infra | 12:51 | |
| *** mriedem has joined #openstack-infra | 12:53 | |
| *** yamamoto has quit IRC | 12:53 | |
| frickler | jrosser: yes, seems to be an error in the log collection stage, but I've no idea how to best debug that, given that things seem to work just fine for other repos | 12:56 |
| *** janki has quit IRC | 12:59 | |
| *** janki has joined #openstack-infra | 12:59 | |
| *** jpena|lunch is now known as jpena | 13:00 | |
| *** owalsh has quit IRC | 13:01 | |
| *** owalsh has joined #openstack-infra | 13:02 | |
| mordred | infra-root: I've got an appointment this morning - so out the next couple of hours | 13:02 |
| fungi | thanks for the heads up. i'm still trying to catch up on scrollback/e-mail and election officiating backlog | 13:03 |
| *** FlorianFa has quit IRC | 13:03 | |
| fungi | before i enter my meeting tunnel | 13:03 |
| *** pabelanger has joined #openstack-infra | 13:04 | |
| *** slaweq_ is now known as slaweq | 13:08 | |
| *** ricolin has joined #openstack-infra | 13:08 | |
| *** owalsh has quit IRC | 13:10 | |
| *** yamamoto has joined #openstack-infra | 13:12 | |
| *** panda|rover|lunc is now known as panda|rover | 13:12 | |
| *** gfidente has quit IRC | 13:13 | |
| *** jaosorior has joined #openstack-infra | 13:15 | |
| *** owalsh has joined #openstack-infra | 13:15 | |
| *** owalsh has quit IRC | 13:19 | |
| *** owalsh has joined #openstack-infra | 13:20 | |
| AJaeger | frickler, jrosser, often you can recheck and follow the job while it runs and get the log file - and then see the error - use zuul.openstack.org for that. | 13:20 |
| *** dave-mccowan has quit IRC | 13:22 | |
| *** hrubi has quit IRC | 13:23 | |
| *** sthussey has joined #openstack-infra | 13:23 | |
| jrosser | AJaeger: frickler http://paste.openstack.org/show/747609/ | 13:24 |
| *** iurygregory has quit IRC | 13:24 | |
| *** irclogbot_1 has quit IRC | 13:26 | |
| *** hrubi has joined #openstack-infra | 13:28 | |
| *** e0ne has joined #openstack-infra | 13:28 | |
| fungi | jrosser: is there a chance something about the change being tested alters networking for the system on which it's tested? | 13:28 |
| *** irclogbot_1 has joined #openstack-infra | 13:28 | |
| jrosser | oh yes quite - the ansible task prior to it doing that is "Enable and start systemd-networkd" :( | 13:28 |
| fungi | you said it was hitting a few of your changes though | 13:29 |
| fungi | are those changes related in that regard? | 13:29 |
| frickler | jrosser: fungi: the "TASK [systemd_networkd : Enable and start systemd-networkd]" just before looks very suspicious to me | 13:29 |
| jrosser | yes, we have a common tests repo that gets pulled into a lot of things | 13:29 |
| *** jamesmcarthur has joined #openstack-infra | 13:29 | |
| jrosser | and that is responsible for configuring the required bridges and so forth on the host | 13:30 |
| fungi | jrosser: yeah, best guess based on the initial symptoms is that the last thing it logged there before that is causing the zuul executor to lose network connectivity to the test node | 13:30 |
| jrosser | right ok - thats totally enough to start digging into why - thanks for the pointers | 13:31 |
| *** dave-mccowan has joined #openstack-infra | 13:34 | |
| fungi | jrosser: the basic architecture is that zuul jobs are driven from persistent "executor" servers which execute ansible tasks over ssh connections to the job node(s) | 13:35 |
| fungi | so if something disrupts the ability to ssh to the job node over its globally routable ip addresses, that prevents the job from continuing | 13:36 |
| EmilienM | hello infra, have you already noticed some 401 errors while using HTTP GET on containers ? | 13:44 |
| EmilienM | e.g. urllib3.connectionpool [ ] http://mirror.bhs1.ovh.openstack.org:8081 "GET /registry-1.docker/v2/tripleomaster/centos-binary-nova-libvirt/blobs/sha256:299c9c8e48d91e5b3ce1ade9d3dcf3f88cd1a21679ca94778d588c2d364960c4 HTTP/1.1" 401 183 | 13:44 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Allow marking stories as security-related https://review.openstack.org/642071 | 13:46 |
| *** jamesmcarthur has quit IRC | 13:48 | |
| *** jamesmcarthur has joined #openstack-infra | 13:48 | |
| *** owalsh has quit IRC | 13:50 | |
| *** lennyb has quit IRC | 13:51 | |
| openstackgerrit | Ankita Bansal proposed openstack-infra/storyboard-webclient master: Login redirect replaces page history https://review.openstack.org/642755 | 13:52 |
| *** jbadiapa has quit IRC | 13:55 | |
| *** owalsh has joined #openstack-infra | 13:56 | |
| *** openstack has joined #openstack-infra | 15:38 | |
| *** ChanServ sets mode: +o openstack | 15:38 | |
| fungi | meetbot seems to be back now | 15:38 |
| *** openstackstatus has joined #openstack-infra | 15:38 | |
| *** ChanServ sets mode: +v openstackstatus | 15:38 | |
| fungi | and yeah, sorry for the delays digging into that, i was in back-to-back conference calls | 15:39 |
| clarkb | infra-root I replaced the ThisCell symlink on afs01.dfw with a regular file to make puppet happy | 15:41 |
| clarkb | also matches the other two afs file servers now | 15:41 |
| *** jbadiapa has quit IRC | 15:41 | |
| *** e0ne has quit IRC | 15:45 | |
| *** jchhatbar has quit IRC | 15:47 | |
| *** dulek has joined #openstack-infra | 15:51 | |
| clarkb | infra-root can I get some quick reviews on topic:more-forgiving-deps helps to reduce the noise we get from puppet4 as we make that transition (it likes to warn that the versions aren't matched as specified in the deps list) | 15:51 |
| clarkb | fungi: anything I can help with on your host upgrades? | 15:55 |
| *** kjackal has quit IRC | 15:55 | |
| *** anteaya has joined #openstack-infra | 15:56 | |
| *** e0ne has joined #openstack-infra | 15:58 | |
| openstackgerrit | Emilien Macchi proposed opendev/base-jobs master: Adding NODEPOOL_DOCKER_REGISTRY_V2_PROXY https://review.openstack.org/642803 | 15:59 |
| EmilienM | clarkb, mordred, weshay, panda|rover ^ first step - then I'll use the var in tripleo-ci, should be easy. | 15:59 |
| fungi | clarkb: nah, i just need to check the state of wiki-dev02 before i move the cname and delete the old server | 16:00 |
| *** guimaluf has joined #openstack-infra | 16:00 | |
| openstackgerrit | Emilien Macchi proposed opendev/base-jobs master: Adding NODEPOOL_DOCKER_REGISTRY_V2_PROXY https://review.openstack.org/642803 | 16:00 |
| openstackgerrit | Emilien Macchi proposed opendev/base-jobs master: Adding NODEPOOL_DOCKER_REGISTRY_V2_PROXY https://review.openstack.org/642803 | 16:01 |
| panda|rover | EmilienM: ack | 16:02 |
| *** diablo_rojo has joined #openstack-infra | 16:04 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/openstack-zuul-jobs master: Adding NODEPOOL_DOCKER_REGISTRY_V2_PROXY https://review.openstack.org/642805 | 16:07 |
| EmilienM | panda|rover, weshay, mordred: https://review.openstack.org/#/q/topic:docker/v2+(status:open+OR+status:merged) | 16:11 |
| *** eernst has joined #openstack-infra | 16:13 | |
| clarkb | EmilienM: I think we do not need https://review.openstack.org/#/c/642805/ because we should use the role from base-jobs (you can confirm by checking ARA on your jobs to see where the role is sourced from) | 16:14 |
| pabelanger | Hmm, when we moved mirror-info into opendev, we moved it from untrusted to trusted context. So, we won't be able to test that util it is landed | 16:15 |
| clarkb | EmilienM: and comment on https://review.openstack.org/#/c/642803/3 | 16:15 |
| pabelanger | do we know why we moved it into trusted? | 16:16 |
| clarkb | pabelanger: because we used it in our base jobs but not all tenants will use ozj | 16:17 |
| openstackgerrit | Emilien Macchi proposed opendev/base-jobs master: Adding NODEPOOL_DOCKER_REGISTRY_V2_PROXY https://review.openstack.org/642803 | 16:17 |
| clarkb | pabelanger: so if we want to set up mirrors they need to be set up in the base jobs repo | 16:17 |
| pabelanger | clarkb: right, but didn't we say we wanted opendev-zuul-jobs? for untrusted things. | 16:18 |
| clarkb | pabelanger: yes, as a future step | 16:18 |
| EmilienM | clarkb: thx for the review | 16:18 |
| clarkb | pabelanger: there are two orthogonal things going on there. One is refactoring base to be more testable and one is having generic base jobs | 16:18 |
| openstackgerrit | Merged openstack-infra/puppet-drupal master: Be more forgiving about module dep versions https://review.openstack.org/641727 | 16:18 |
| openstackgerrit | Merged openstack-infra/puppet-openstackid master: Be more forgiving in module deps list https://review.openstack.org/641726 | 16:18 |
| openstackgerrit | Merged openstack-infra/puppet-askbot master: Be more forgiving in module deps list https://review.openstack.org/641725 | 16:18 |
| *** weshay is now known as Dwight | 16:18 | |
| clarkb | pabelanger: we've done the generic base jobs aspect, and now we can refactor them to be more testable if we want | 16:18 |
| *** Dwight is now known as DwightH | 16:18 | |
| pabelanger | ack | 16:19 |
| *** DwightH is now known as weshay | 16:19 | |
| pabelanger | in that case, we likely want to create test-mirror-info and properly test ^ in base-test first, then promote up | 16:19 |
| pabelanger | so we don't break jobs | 16:19 |
| clarkb | pabelanger: I'm not too worried about this particular change. It follows a pattern and no one is usign that variable yet | 16:22 |
| clarkb | if the variable value breaks things we'll know when tripleo tries to use it and we can update | 16:22 |
| *** agopi has joined #openstack-infra | 16:22 | |
| fungi | #status log restarted meetbot and statusbot at ~1540z, switching them from card.freenode.net to niven.freenode.net as the former was taken out of rotation | 16:26 |
| openstackstatus | fungi: finished logging | 16:26 |
| *** gyee has joined #openstack-infra | 16:27 | |
| *** ccamacho has quit IRC | 16:29 | |
| openstackgerrit | Riju Khatri proposed openstack-infra/storyboard-webclient master: Make task ordering in Story view selectable https://review.openstack.org/641930 | 16:29 |
| *** pgaxatte has quit IRC | 16:36 | |
| *** davecore has joined #openstack-infra | 16:37 | |
| *** udesale has quit IRC | 16:37 | |
| *** bringha has joined #openstack-infra | 16:39 | |
| clarkb | https://etherpad.openstack.org/p/afs-dbserver-trusty-to-xenial I've started to outline what an afs db server upgrade might look lioke | 16:41 |
| clarkb | there are questions in there about the validity of some of the steps that corvus and/or mordred may know | 16:41 |
| *** hwoarang has quit IRC | 16:41 | |
| *** hwoarang has joined #openstack-infra | 16:43 | |
| clarkb | The big question is if openafs 1.6.7 and 1.6.15 are compatible enough to run mixed versions on the db servers while we upgrade them one after the other to avoid downtime | 16:43 |
| clarkb | Reading docs I've also learned of the update server which will apparently sync openafs binaries between systems. I have no idea how safe that is if the kernel module gets out of sync though | 16:44 |
| *** ricolin has joined #openstack-infra | 16:44 | |
| corvus | clarkb: i mostly think of the update server as being helpful for systems that existed before package management and orchestration were invented. | 16:45 |
| clarkb | gotcha | 16:45 |
| corvus | clarkb: the process looks reasonable. i have no idea about version (in)comptability. | 16:45 |
| *** wolverineav has joined #openstack-infra | 16:45 | |
| *** wolverineav has quit IRC | 16:45 | |
| *** wolverineav has joined #openstack-infra | 16:45 | |
| clarkb | I just found a mailing list thread that says ti was safe to mix 1.4 versions | 16:46 |
| *** ricolin_ has joined #openstack-infra | 16:46 | |
| clarkb | my guess here is that mixing 1.4 and 1.6 would not be safe but that mixing 1.6 is | 16:46 |
| clarkb | but I'll continue to try to find hard evidence of that | 16:46 |
| clarkb | when they say mixed versions are not supported I think they mean 1.4 vs 1.6 not 1.6.x vs 1.6.y | 16:47 |
| *** wolverineav has quit IRC | 16:47 | |
| corvus | that sounds likely | 16:48 |
| *** wolverineav has joined #openstack-infra | 16:48 | |
| tobiash | clarkb, ianw: I observed weird diskimage-builder behavior: http://paste.openstack.org/show/747629/ | 16:48 |
| *** ricolin has quit IRC | 16:49 | |
| clarkb | tobiash: my guess is the unmount fails beacuse it never mounted it due to the size error at the beginning of your paste | 16:49 |
| tobiash | I added a validation script in finalise.d or pre-finalise.d that should fail and it seems to correctly abort the image build but disk-image-create doesn't exit with a failure | 16:49 |
| clarkb | oh is it returning 0? | 16:50 |
| tobiash | yes | 16:50 |
| clarkb | tobiash: probably a bug in the exception handling | 16:50 |
| tobiash | k, so no known issue? | 16:50 |
| tobiash | then I'll dig deeper tomorrow | 16:50 |
| clarkb | not that I am aware of | 16:50 |
| tobiash | we had several issues now with images that got too large for the flavors so I wanted to add a safety guard that nodepool is not able to build images bigger than size x | 16:51 |
| clarkb | tobiash: looks like there is no exception handling and we are relying on an uncaught exception to return non zero | 16:54 |
| clarkb | not immediately clear to me why it wouldn't do that given the code there | 16:54 |
| *** e0ne has quit IRC | 16:55 | |
| *** helenafm has quit IRC | 16:56 | |
| *** bringha has quit IRC | 16:58 | |
| *** bringha has joined #openstack-infra | 16:58 | |
| clarkb | tobiash: http://paste.openstack.org/show/747630/ is how it is supposed to work I think | 16:59 |
| *** rpittau is now known as rpittau|afk | 16:59 | |
| tobiash | clarkb: thanks, will look into that deeper tomorrow | 17:00 |
| *** kjackal has joined #openstack-infra | 17:03 | |
| *** kopecmartin is now known as kopecmartin|off | 17:05 | |
| *** armax has quit IRC | 17:08 | |
| *** priteau has quit IRC | 17:08 | |
| *** bringha has quit IRC | 17:08 | |
| *** kjackal has quit IRC | 17:10 | |
| *** eernst has quit IRC | 17:13 | |
| corvus | #status log changed intermediate registry password in bridge hostvars | 17:13 |
| openstackstatus | corvus: finished logging | 17:13 |
| corvus | once that propagates, i'll probably need to restart the registry container to pick up the change | 17:13 |
| *** trown is now known as trown|lunch | 17:20 | |
| clarkb | infra-root I've read the release notes for openafs 1.6.7 through to 1.6.15 and not seen anything that would indicate a backward incompatibiltiy | 17:24 |
| clarkb | most of the changes are bug fixes and improvements and platform support updates (for newer linux kernels) | 17:24 |
| fungi | sounds safe enough in that case | 17:24 |
| *** panda|rover is now known as panda|rover|off | 17:24 | |
| clarkb | there was an issue with 1.6.13 that they fixed in 1.6.14 that caused compat issues with the backup system and since we are going to 1.6.15 we should be fine | 17:25 |
| *** jpich has quit IRC | 17:26 | |
| *** gfidente is now known as gfidente|afk | 17:31 | |
| *** ricolin_ has quit IRC | 17:32 | |
| *** eernst has joined #openstack-infra | 17:32 | |
| * clarkb has been prepping for the infra meeting and realized that there is an extra hour to do so now :) | 17:35 | |
| fungi | or you got out of bed an hour earlier than you needed to | 17:35 |
| openstackgerrit | Riju Khatri proposed openstack-infra/storyboard-webclient master: Make task ordering in Story view selectable https://review.openstack.org/641930 | 17:35 |
| fungi | i'm getting weary of loaning the government an hour every spring, even if they have fairly consistently repaid said loan in autumn | 17:36 |
| clarkb | Apparently the entire west coast now has bills/measures in progress to switch to DST permanently | 17:36 |
| clarkb | and supposedly this poses a problem because you can't DST permenently without congress acting? | 17:37 |
| clarkb | maybe we'll all change timezones | 17:37 |
| *** dtantsur is now known as dtantsur|afk | 17:39 | |
| *** mattw4 has joined #openstack-infra | 17:41 | |
| openstackgerrit | Brian Haley proposed openstack-infra/project-config master: Add graph for number of periodic neutron jobs run https://review.openstack.org/642836 | 17:42 |
| fungi | clarkb: yeah, this is what i don't get. the usg already allows any state to decide to stop observing dst. the argments i've seen against just switching to year-round standard time is parents concerned kids will have to walk to school in the dark. so, um, the usg also lets states decide what time schools should start, right? | 17:46 |
| fungi | nor do businesses need congressional action to decide what hours they're going to open/close | 17:47 |
| fungi | makes me wonder if it's because the people promoting it are less interested in the actual change and more in the visibility of having to get the federal government involved | 17:48 |
| anteaya | seems like you've thought about this a bit | 17:49 |
| corvus | fungi: the problem is cultural. we'd have to get dolly parton to re-record some songs and then remove all the previous versions of those songs from circulation. | 17:51 |
| anteaya | I'm still a big fan of the sun being at zeinth at noon | 17:51 |
| anteaya | Islands in the Stream? | 17:51 |
| fungi | corvus: ouch, yeah that's an excellent point | 17:52 |
| clarkb | fungi also later school starts result in better learning according to $study | 17:52 |
| mordred | clarkb: we don't like making decisions based on actual studies | 17:53 |
| mordred | clarkb: if we did, the IT managers in the US would stop trying to get their employees to work 80 hours of week "for greater productivity" | 17:54 |
| fungi | i know my state has specifically passed laws saying you can't pass laws based on scientific evidence | 17:54 |
| fungi | because unscientifically they've proven that science is bad for politics | 17:54 |
| *** armax has joined #openstack-infra | 17:55 | |
| * davidlenwell smashes his palm into his face | 17:55 | |
| *** derekh has quit IRC | 17:55 | |
| fungi | davidlenwell: just imagine, if you lived where i do you' | 17:56 |
| fungi | d have to type like that all day | 17:56 |
| davidlenwell | we have plenty of flat earthers and ultra spiritual types that ignore science here.. | 17:56 |
| corvus | i did have to spend a split second disambiguating whether davidlenwell ran a body part or a tree into his face | 17:57 |
| corvus | both were funny | 17:57 |
| davidlenwell | we do have ample palm trees | 17:57 |
| davidlenwell | and yes.. the urge to hit my self in the face with a a30 foot tree is there when I read things like what fungi typed | 17:58 |
| fungi | we get crazy stuff like https://www.theguardian.com/us-news/2018/sep/12/north-carolina-didnt-like-science-on-sea-levels-so-passed-a-law-against-it | 17:58 |
| *** jbadiapa has joined #openstack-infra | 17:58 | |
| davidlenwell | humans .... uhg | 17:59 |
| davidlenwell | hoomans | 17:59 |
| fungi | okay, so one of my dnm base-test exercising changes to nova is demonstrating an unanticipated problem. the master branch run of the py35 job seems to have selected ubuntu-bionic (which doesn't have python3.5) | 17:59 |
| corvus | fungi: can you point me at some urls? | 18:00 |
| fungi | oh! it's nova-tox-functional-py35 which i think they define somewhere i didn't catch | 18:01 |
| fungi | https://review.openstack.org/642580 | 18:01 |
| *** e0ne has joined #openstack-infra | 18:02 | |
| tosky | did anyone already report that refstack.openstack.org is down? Or is it a known fact? (maybe wanted?) | 18:02 |
| fungi | http://zuul.opendev.org/t/openstack/job/nova-tox-functional-py35 indicates it's nova which is setting tox_envlist to functional-py35 so i guess it needs patching there | 18:03 |
| *** ginopc has quit IRC | 18:04 | |
| fungi | i'll send an update to the ml encouraging teams to prepare for setting nodeset:ubuntu-xenial on some jobs like these in their repos before we switch the default node tomorrow | 18:05 |
| corvus | fungi: sounds good -- should that be parented on openstack-tox-py35 instead? | 18:06 |
| clarkb | tosky: news to me | 18:06 |
| fungi | corvus: they set a different tox_envlist than openstack-tox-py35 uses, i think? | 18:06 |
| *** e0ne has quit IRC | 18:06 | |
| clarkb | it appears the server is completely down. Possibly due to the dfw host migrations | 18:06 |
| clarkb | I'll look for a ticket | 18:06 |
| fungi | corvus: would that still work? | 18:07 |
| corvus | fungi: yes, it would still override what's set there | 18:07 |
| tosky | clarkb: thanks! | 18:07 |
| fungi | corvus: awesome, i'll give that a try since it should be self-testing anyway | 18:07 |
| tosky | someone else mentioned it one or two days ago on #refstack, then I forgot to check, then I noticed the refstack jobs failing | 18:07 |
| corvus | it would pick up the ?!driverfixes/ branch matcher (??!?). and irrelevant-files is now overridden as well, so that shouldn't be a problem. | 18:07 |
| corvus | fungi: ^ | 18:07 |
| corvus | fungi: but from what i can see, it would be an improvement (it would automatically get the bindep profile and nodeset | 18:08 |
| corvus | fungi: short version, i think as long as the ?!driverfixes branch matcher is okay, that's the way to go. | 18:09 |
| fungi | yeah, it should be fine there | 18:09 |
| *** shardy has quit IRC | 18:09 | |
| corvus | fungi: also, i wonder if the irrelevant files can be coalesced... | 18:10 |
| corvus | that's the only thing causing that to be its own job | 18:10 |
| corvus | but the lists are *really* close | 18:10 |
| *** sshnaidm is now known as sshnaidm|afk | 18:11 | |
| corvus | if they could, then they could just use openstack-tox-functional-py35 | 18:12 |
| clarkb | I don't see a ticket for refstack. I'll check its console then like reboot it | 18:13 |
| *** trown|lunch is now known as trown | 18:13 | |
| *** bringha has joined #openstack-infra | 18:13 | |
| clarkb | rax web ui says that we shutoff the refstack server | 18:14 |
| clarkb | infra-root anyone know if shutting off the refstack server is/was intentional? | 18:14 |
| fungi | i'm not aware of anyone shutting it off | 18:15 |
| corvus | clarkb: i know of nothing. status log does not either. | 18:15 |
| fungi | nothing in the status log | 18:15 |
| clarkb | ok I'm going to reboot it then | 18:16 |
| openstackgerrit | James E. Blair proposed openstack-infra/openstack-zuul-jobs master: Use YAML anchors to avoid repeating irrelevant-files https://review.openstack.org/642845 | 18:17 |
| *** e0ne has joined #openstack-infra | 18:18 | |
| corvus | oops i got that backwards :) | 18:18 |
| clarkb | tosky: should be back now | 18:18 |
| clarkb | #status log Rebooted refstack.openstack.org via openstack api as it was in a shutdown state | 18:18 |
| openstackstatus | clarkb: finished logging | 18:18 |
| openstackgerrit | James E. Blair proposed openstack-infra/openstack-zuul-jobs master: Use YAML anchors to avoid repeating irrelevant-files https://review.openstack.org/642845 | 18:18 |
| tosky | clarkb: thank you | 18:18 |
| EmilienM | pabelanger: hey :-) do you expect me to do something for https://review.openstack.org/#/c/642803/ ? | 18:18 |
| *** electrofelix has quit IRC | 18:19 | |
| *** bringha has quit IRC | 18:20 | |
| *** jamesmcarthur has quit IRC | 18:20 | |
| *** jamesmcarthur has joined #openstack-infra | 18:21 | |
| *** e0ne_ has joined #openstack-infra | 18:21 | |
| *** e0ne has quit IRC | 18:22 | |
| *** hwoarang has quit IRC | 18:26 | |
| *** gmann is now known as gmann_afk | 18:26 | |
| *** hwoarang has joined #openstack-infra | 18:27 | |
| *** jamesmcarthur has quit IRC | 18:27 | |
| *** electrofelix has joined #openstack-infra | 18:32 | |
| *** jamesmcarthur has joined #openstack-infra | 18:33 | |
| *** pcaruana has quit IRC | 18:39 | |
| *** e0ne_ has quit IRC | 18:41 | |
| *** jpena is now known as jpena|off | 18:44 | |
| *** jamesmcarthur has quit IRC | 18:51 | |
| clarkb | Infra team meeting starts in just under 10 minutes. See you in #openstack-meeting for that | 18:51 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Forward artifacts to child jobs within buildset https://review.openstack.org/642857 | 18:52 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Forward artifacts to child jobs within buildset https://review.openstack.org/642857 | 18:54 |
| pabelanger | EmilienM: I wanted to leave comments because last time we merged something into base jobs is was called out why we didn't properly test it. I don't want to block, henace no -1. But something we should be carefuly of, since these repo is not self testing | 18:54 |
| EmilienM | pabelanger: ok gotcha | 18:54 |
| clarkb | pabelanger: the difference here imo is we aren't changing any ansible. Instead we modifying a script written to disk using the same method as the code around it | 18:55 |
| clarkb | if we were changing how that file was written I would agree we should use base-test | 18:56 |
| pabelanger | clarkb: okay, I don't have ability to monitor myself now, just wanted to comment on it | 18:56 |
| *** jamesmcarthur has joined #openstack-infra | 19:03 | |
| *** hrubi has quit IRC | 19:07 | |
| ianw | tobiash: hrm, this is now the second time in about a week it's been annoying that exception doesn't show the stdout of the failed process. i'll look into that. running with "-x" does | 19:07 |
| tobiash | ianw: thanks, I'll re-run it with -x | 19:08 |
| *** wolverineav has quit IRC | 19:09 | |
| ianw | in the past "-x" put out way too much stuff; hundreds of lines of useless bash loops. but we've been pretty good with xtrace on/off flags around that stuff lately, so it's usually ok just to run with it on always | 19:11 |
| *** yamamoto has quit IRC | 19:13 | |
| openstackgerrit | Riju Khatri proposed openstack-infra/storyboard-webclient master: Show tags for all stories in a project group https://review.openstack.org/642867 | 19:22 |
| tobiash | ianw: this is a run with -x: http://paste.openstack.org/show/747645/ So it correctly notices that 01-validate-image-size failed with exit code 1. Then it does some cleanup, and that cleanup fails but somehow dib doesn't return an overall failure | 19:22 |
| *** wolverineav has joined #openstack-infra | 19:29 | |
| *** betherly has joined #openstack-infra | 19:32 | |
| *** wolverineav has quit IRC | 19:34 | |
| *** larainema has quit IRC | 19:36 | |
| *** betherly has quit IRC | 19:37 | |
| ianw | "target is busy." ... hrm we've seen that before when daemons are unintentionally started in the chroot | 19:38 |
| ianw | oh wait, hang on, the issue is the exit code, right | 19:38 |
| clarkb | mordred: out of curiousity do you have the most recent fix for default branch setting? I'm curious to know what it was | 19:42 |
| mordred | clarkb: it was "create empty repo first" | 19:43 |
| mordred | clarkb: I can dig up the change if you want | 19:43 |
| clarkb | oh right the autoinit flag | 19:43 |
| clarkb | I remember it now | 19:43 |
| mordred | https://review.openstack.org/#/c/641851/ was the followup (we needed to tell it to use the default readme as well) | 19:44 |
| mordred | https://review.openstack.org/#/c/641108/ made auto_init happen | 19:44 |
| openstackgerrit | Merged opendev/base-jobs master: Adding NODEPOOL_DOCKER_REGISTRY_V2_PROXY https://review.openstack.org/642803 | 19:46 |
| *** hwoarang has quit IRC | 19:48 | |
| *** yamamoto has joined #openstack-infra | 19:49 | |
| *** hwoarang has joined #openstack-infra | 19:49 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Make ansible version configurable https://review.openstack.org/637422 | 19:50 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Install ansible during executor startup if needed https://review.openstack.org/640644 | 19:50 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Run tox remote concurrent https://review.openstack.org/640654 | 19:50 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Support ansible 2.6 https://review.openstack.org/631931 | 19:50 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Support ansible 2.7 https://review.openstack.org/631932 | 19:50 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Switch default ansible version to 2.7 https://review.openstack.org/637424 | 19:50 |
| *** yamamoto has quit IRC | 19:54 | |
| *** wolverineav has joined #openstack-infra | 20:02 | |
| *** electrofelix has quit IRC | 20:05 | |
| *** wolverineav has quit IRC | 20:06 | |
| *** wolverineav has joined #openstack-infra | 20:06 | |
| *** gfidente|afk has quit IRC | 20:09 | |
| *** electrofelix has joined #openstack-infra | 20:11 | |
| *** jamesmcarthur has quit IRC | 20:14 | |
| *** jamesmcarthur has joined #openstack-infra | 20:15 | |
| *** electrofelix has quit IRC | 20:15 | |
| ianw | tobiash: out of interest, what's the problem with the image size? | 20:16 |
| tobiash | they got bigger than the flavors we used which lead to node failures | 20:16 |
| tobiash | I want to prevent that by failing image builds in nodepool that get too large | 20:16 |
| frickler | infra-root: zuul01 is sending 3 mails per hours from kinda broken cronjobs, if someone has some spare time to look into that | 20:17 |
| frickler | also zp01.opendev.org still bounces once per day with missing A record | 20:18 |
| frickler | and with that I'm off for today | 20:18 |
| corvus | zp01 is my fault, i'll fix it | 20:18 |
| *** jamesmcarthur has quit IRC | 20:19 | |
| *** e0ne has joined #openstack-infra | 20:20 | |
| corvus | dmsimard: the zuul01 errors seem to be related to the status backup stuff, if you have a chance to look at it | 20:20 |
| ianw | tobiash: oh, cool, that makes sense. i thought it might be hitting some limit in dib. i'll look at why this exit isn't being picked up | 20:21 |
| openstackgerrit | Brian Haley proposed openstack-infra/project-config master: Update the network-ovn failure rate dashboard https://review.openstack.org/642879 | 20:21 |
| tobiash | ianw: thanks :) | 20:21 |
| *** dave-mccowan has quit IRC | 20:24 | |
| dmsimard | corvus: missing context -- what errors ? I guess by backup you mean the status.json backups ? | 20:25 |
| dmsimard | oh, I hadn't read back far enough | 20:25 |
| corvus | dmsimard: 4 lines up from my message and yep :) | 20:27 |
| dmsimard | corvus: curl on https://zuul.openstack.org/api/status works but not on https://zuul.opendev.org/api/status -- complains that javascript is required. Should we be hitting another URL ? | 20:29 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Manage ansible installations within zuul https://review.openstack.org/631930 | 20:30 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Validate ansible installations on startup https://review.openstack.org/637418 | 20:30 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Make ansible version configurable https://review.openstack.org/637422 | 20:30 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Install ansible during executor startup if needed https://review.openstack.org/640644 | 20:30 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Run tox remote concurrent https://review.openstack.org/640654 | 20:30 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Support ansible 2.6 https://review.openstack.org/631931 | 20:30 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Support ansible 2.7 https://review.openstack.org/631932 | 20:30 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Switch default ansible version to 2.7 https://review.openstack.org/637424 | 20:30 |
| dmsimard | The other thing that is failing seems to be crons like this one: "curl http://zuul.openstack.org-http/api/status" (notice the -http) | 20:31 |
| dmsimard | I'll try to understand how these came to be | 20:31 |
| clarkb | oh that is probably brokenness in the multi tenant support | 20:32 |
| corvus | well, status is tenant specific | 20:33 |
| clarkb | ya the -http suffix though | 20:33 |
| corvus | so there is no /api/status endpoint on zuul.opendev.org | 20:33 |
| *** kgiusti has left #openstack-infra | 20:33 | |
| corvus | the right endpoint for a multi-tenant status is, eg, https://zuul.opendev.org/api/tenant/kata-containers/status | 20:34 |
| dmsimard | clarkb: the -http bits are likely coming from https://opendev.org/openstack-infra/system-config/src/branch/master/manifests/site.pp#L962-L976 | 20:35 |
| dmsimard | corvus: I suppose the API is able to return a list of tenants ? Could we just iterate through that list instead ? | 20:36 |
| corvus | dmsimard: yes: https://zuul.opendev.org/api/tenants | 20:36 |
| openstackgerrit | James E. Blair proposed opendev/base-jobs master: Update intermediate registry password https://review.openstack.org/642887 | 20:41 |
| corvus | infra-root: ^ could you +3 that? | 20:41 |
| *** agopi has quit IRC | 20:42 | |
| *** luizbag has quit IRC | 20:46 | |
| dmsimard | The code search in gitea is a bit weird | 20:47 |
| *** chkumar246 is now known as chandankumar | 20:47 | |
| corvus | dmsimard: how so? | 20:47 |
| dmsimard | https://opendev.org/openstack-infra/puppet-zuul/search?q=status_backups returns only a single match but there's actually five more according to codesearch: http://codesearch.openstack.org/?q=status_backups&i=nope&files=&repos= | 20:48 |
| corvus | i agree, we should look into that | 20:50 |
| dmsimard | So, anyway, there's two problems. 1) We're creating as many backups crons as there are vhosts (of which there are four, including the -http ones) https://opendev.org/openstack-infra/puppet-zuul/src/branch/master/manifests/web.pp#L153-L155 | 20:50 |
| dmsimard | 2) That tenant iteration thing | 20:51 |
| clarkb | dmsimard: https://opendev.org/openstack-infra/puppet-zuul/src/branch/master/manifests/status_backups.pp#L19 is supposed to prevent us from doing the backups for non tenant specific vhosts | 20:52 |
| clarkb | dmsimard: so that should cut ti down to just two | 20:52 |
| clarkb | the problem is the lack of $ signs I think | 20:53 |
| dmsimard | oh, yeah | 20:53 |
| dmsimard | good catch | 20:53 |
| dmsimard | curious how puppet even let that work at all | 20:53 |
| *** gmann_afk is now known as gmann | 20:54 | |
| clarkb | it might treat it as a literal string? | 20:55 |
| dmsimard | My puppet is a bit.. rusty :D | 20:56 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/puppet-zuul master: Use $tenant_name instead of tenant_name in condition https://review.openstack.org/642891 | 20:56 |
| dmsimard | clarkb: so, right below that line, we are making assumptions on the endpoint of the status url | 20:57 |
| clarkb | dmsimard: ya comes from https://opendev.org/openstack-infra/system-config/src/branch/master/manifests/site.pp#L945-L977 | 20:57 |
| dmsimard | how should we plumb the tenant names in there ? | 20:58 |
| clarkb | dmsimard: vhost_name is the value I think we want to use not name, but we'd have to pass that through | 20:58 |
| clarkb | sorry the data structure is actually https://opendev.org/openstack-infra/system-config/src/branch/master/manifests/site.pp#L979-L996 | 20:59 |
| clarkb | dmsimard: you could add a field to vhost flags called "uri" or something then have that default to the ${name} value but then we override it at my link above | 21:00 |
| *** lseki has joined #openstack-infra | 21:00 | |
| openstackgerrit | Merged opendev/base-jobs master: Update intermediate registry password https://review.openstack.org/642887 | 21:00 |
| dmsimard | clarkb: I don't see a reference to kata in that structure, though | 21:00 |
| clarkb | dmsimard: correct | 21:00 |
| clarkb | dmsimard: because we don't do a whitelabel for kata | 21:01 |
| dmsimard | Do we want to back up their status too ? | 21:01 |
| clarkb | probably | 21:01 |
| clarkb | updating it to do a root level backup might be best | 21:02 |
| clarkb | then the tool can detect if it is looking at a specific tenent or not and backup all tenants if not | 21:02 |
| dmsimard | sure, but then we're not looking at two simple bash one liners anymore :p | 21:03 |
| clarkb | indeed | 21:03 |
| clarkb | starting with a fix for the cronspam is probably fine and simpler | 21:03 |
| *** eharney has quit IRC | 21:03 | |
| dmsimard | This would be fairly easy to do in Ansible (get_url, built-in understanding of json, etc.) but in Puppet this feels tedious :D | 21:03 |
| clarkb | another option is to add a flag to the flags dict that says "back this up" | 21:03 |
| clarkb | well with pupept you'd write otu a python script | 21:04 |
| clarkb | then have the cron trigger that script | 21:04 |
| *** mriedem has quit IRC | 21:05 | |
| fungi | zuul feature idea: option to have something (zuul-web process?) periodically write out a copy of the status.json for each tenant | 21:06 |
| corvus | fungi: well, the long term goal is not to need that by implementing HA schedulers | 21:08 |
| dmsimard | fungi: so what we're sort of already doing ? :p | 21:08 |
| *** mriedem has joined #openstack-infra | 21:08 | |
| fungi | corvus: great point! | 21:10 |
| clarkb | infra-root https://etherpad.openstack.org/p/afs-dbserver-trusty-to-xenial has been updated with the two TODOs filled in | 21:13 |
| clarkb | if that plan looks good I'll likely give it a go tomorrow once fungis xenial job transition stuff is settled | 21:13 |
| dmsimard | There's https://review.openstack.org/#/c/642891/ for cutting on probably more than half of the cronspam -- I don't have a solution I'm happy with for multi tenant backups if we want to keep it in puppet-zuul right now | 21:14 |
| *** xek has quit IRC | 21:16 | |
| clarkb | thinking about how to puppetize this better | 21:17 |
| clarkb | it might be best to directyl invoke the status_backups resource from our site.pp | 21:17 |
| clarkb | let me push that up | 21:17 |
| clarkb | still won't get us kata but fixes the cronspam regression | 21:18 |
| *** wolverineav has quit IRC | 21:20 | |
| *** nickv1985 has quit IRC | 21:20 | |
| *** nickv1985 has joined #openstack-infra | 21:20 | |
| *** betherly has joined #openstack-infra | 21:21 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Manage zuul status backups directly https://review.openstack.org/642894 | 21:21 |
| clarkb | dmsimard: corvus ^ should be the other half | 21:21 |
| corvus | clarkb: can you have 2 of those? | 21:22 |
| clarkb | corvus: you can, it writes to $name_status_$date | 21:23 |
| clarkb | so as long as $name is different it should work. It doesn't support non whitelabeled entries yet | 21:23 |
| clarkb | actually | 21:23 |
| clarkb | I bet we can fix that by using the url path that isn't white labeled then specify a different one per tenant | 21:24 |
| clarkb | would need changes to the cron entries but should be doable | 21:24 |
| *** betherly has quit IRC | 21:26 | |
| *** e0ne has quit IRC | 21:26 | |
| *** wolverineav has joined #openstack-infra | 21:26 | |
| *** agopi has joined #openstack-infra | 21:27 | |
| *** mattw4 has quit IRC | 21:30 | |
| *** mattw4 has joined #openstack-infra | 21:30 | |
| *** wolverineav has quit IRC | 21:31 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-zuul master: Allow optional status_uri to be set for status backups https://review.openstack.org/642896 | 21:35 |
| *** ab-a has quit IRC | 21:37 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Manage zuul status backups directly https://review.openstack.org/642894 | 21:38 |
| clarkb | dmsimard: corvus ^ hows that. I think that is backward compatible and fixes our current issues | 21:38 |
| *** ab-a has joined #openstack-infra | 21:38 | |
| clarkb | we'll need to manually clear out the crons we don't want. I can do that | 21:38 |
| openstackgerrit | Merged openstack-infra/puppet-zuul master: Use $tenant_name instead of tenant_name in condition https://review.openstack.org/642891 | 21:44 |
| *** wolverineav has joined #openstack-infra | 21:45 | |
| *** jamesmcarthur has joined #openstack-infra | 21:50 | |
| *** mattw4 has quit IRC | 21:52 | |
| mordred | infra-root: as an fyi - I've got a doctor's appointment in the morning - so I likely won't be around until 1700UTC | 21:54 |
| *** auristor has quit IRC | 21:56 | |
| fungi | noted, thanks mordred | 21:56 |
| fungi | i likely won't be around until 13:00 utc, but that's just because i like to sleep in | 21:57 |
| fungi | (and expect a late night as we need to fire up ptl polls in a few hours) | 21:57 |
| mordred | fungi: I can't remember the last time there was a contested nova! | 21:59 |
| fungi | it's going to be great, i promise! | 21:59 |
| *** kjackal has joined #openstack-infra | 22:00 | |
| fungi | i mean, i promise to keep the amount of screwing it up i'll do to the minimum possible for me | 22:00 |
| *** rcernin has joined #openstack-infra | 22:01 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Handle launchpad projects in our gitea project creation https://review.openstack.org/642907 | 22:04 |
| clarkb | mordred: corvus ^ I think I've got that right | 22:04 |
| mordred | clarkb: I read now | 22:04 |
| clarkb | there may be some corner cases that aren't handled though like if the project isn't using its own launchpad name? | 22:04 |
| fungi | that can be inferred from the groups list variable in gerrit/projects.yaml | 22:05 |
| fungi | since we already need to know that for jeepyb's lp bug updater hook script | 22:06 |
| mordred | fungi: is it groups[0] that would be the launchpad project? | 22:07 |
| clarkb | mordred: ya I don't think we support multiple groups with launchpad | 22:07 |
| corvus | clarkb, fungi, mordred: assuming several paragraphs surrounding this (including a glossary), does this image help convey the sequencing between the different parts of the buildset registry jobs? | 22:07 |
| clarkb | we don't do groups with storyboard right now either, but that doesn't matter because every project still has a place in storyboard | 22:07 |
| clarkb | let me push a new patchset that checks for groups | 22:07 |
| mordred | clarkb: we do groups in storyboard | 22:07 |
| mordred | clarkb: but yes, also every project has a place in storyboard | 22:08 |
| *** betherly has joined #openstack-infra | 22:08 | |
| clarkb | mordred: we don't use the group on the gitea side I mean | 22:08 |
| clarkb | at least I don't think we do, but we don't need to because every project has a spot anyway | 22:08 |
| mordred | yah - it doesn't matter for gitea | 22:08 |
| fungi | mordred: clarkb: correct on groups[0] for projects with not use-storyboard | 22:08 |
| mordred | corvus: I'm assuming an image link is coming? | 22:09 |
| corvus | clarkb: you may need "project['use-storyboard']" instead of project.use-storyboard | 22:09 |
| mordred | yeah. because of the - | 22:09 |
| corvus | mordred: derp | 22:09 |
| corvus | clarkb, fungi, mordred: image link :) https://screenshots.firefox.com/upI2uB4RZj0Sy5Qx/null | 22:09 |
| clarkb | corvus: mordred I didn't feel like day drinking until you said that. Fixing now | 22:11 |
| mordred | corvus: absent surrounding paragraphs, 'deploy job' seems weird ... I'm not sure why a deployment would be deploying from the buildset registry (but as I write this, I'm betting in this case that's "a job that deploys the image to test it") | 22:12 |
| *** whoami-rajat has quit IRC | 22:12 | |
| corvus | mordred: yeah... would "Deployment test job" be better? | 22:12 |
| mordred | yes | 22:12 |
| *** betherly has quit IRC | 22:12 | |
| mordred | unless the words make it make more sense, since that would get wordy in that box | 22:13 |
| corvus | it fits | 22:13 |
| fungi | corvus: is the intermediate registry the persistent "untrusted registry" server we run? | 22:13 |
| mordred | corvus: also - the time sequencing for pushing the current image into the intermediate registry is unclear - or makes the need for the two registries not make sense - but I think that's likely made better by text | 22:13 |
| fungi | and the buildset registry is the one created in a paused job? | 22:14 |
| corvus | fungi: yep | 22:14 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Handle launchpad projects in our gitea project creation https://review.openstack.org/642907 | 22:14 |
| clarkb | mordred: corvus fungi ^ I think that handles the - thing and the groups thing | 22:14 |
| corvus | mordred: ack.... i may need a second change to show why it's necessary, though it may get long if i do that | 22:15 |
| clarkb | corvus: that picture look good and agree with mordreds clarification comment | 22:16 |
| fungi | corvus: given i feel like i've not been following the docker registry work as closely as i should have, that i can follow the diagram even in the absence of contextual prose suggests to me it's a good depiction | 22:16 |
| mordred | corvus: maybe it's what you have first, and then a follow up for "if things are more complex" ? | 22:16 |
| mordred | or maybe it's just the prose | 22:16 |
| mordred | I think that image is super helpful in general | 22:16 |
| corvus | thanks, that's all helpful feedback -- i at least know what things tripped you all up on seeing it the first time. i'll try to revise. :) | 22:17 |
| mordred | clarkb: jeez yeah. you do feel like day drinking now don't you? | 22:17 |
| corvus | +2 because that couldn't possibly be incorrect | 22:18 |
| mordred | yeah. same | 22:19 |
| mordred | so - how do we want to update things? run the sync playbook once that has landed? | 22:19 |
| fungi | is it still day drinking if i've already had dinner? | 22:19 |
| clarkb | fungi: is the sun up? | 22:19 |
| corvus | mordred: yeah i think so | 22:19 |
| clarkb | actually thats a bad measure because in a few months the sun will be up here at 10pm | 22:19 |
| dmsimard | didn't know seqdiag in sphinx was a thing, I'll have to check it out | 22:19 |
| fungi | mmm, if my blinds are closed, then not as far as i'm concerned | 22:20 |
| clarkb | mordred: ya that was my thought, also a good test of the full background sync playbook | 22:20 |
| mordred | clarkb: yeah. warning - it'll take probably 90 minutes to run I think - so likely run in a screen. and we might uncover more phantom repos in gerrit / projects.yaml | 22:20 |
| mordred | so it could take a day to iterate | 22:21 |
| mordred | but - you know - shrug | 22:21 |
| clarkb | ok so probably don't want to start it now if it causes things to have a sad | 22:21 |
| clarkb | because I need to EOD at a reasonable time | 22:21 |
| mordred | I don't think it should cause anything to sad | 22:22 |
| mordred | but - also fine to kick it off tomorrow - it's not liek there's a rush :) | 22:22 |
| *** jamesmcarthur has quit IRC | 22:22 | |
| *** agopi has quit IRC | 22:23 | |
| *** jamesmcarthur has joined #openstack-infra | 22:23 | |
| clarkb | mordred: fungi while you are around, care to review https://review.openstack.org/#/c/642894/ and its depends on? I can cleanup the crons on the host once those get in | 22:24 |
| mordred | clarkb: lgtm | 22:25 |
| *** jamesmcarthur has quit IRC | 22:25 | |
| *** jamesmcarthur has joined #openstack-infra | 22:25 | |
| *** mattw4 has joined #openstack-infra | 22:26 | |
| fungi | the other one's approved now too | 22:27 |
| clarkb | spring has finally (mostly) arrived so I'm trying to take advantage of the warm weather and sun in the evenings (hence EOD at reasonable time) | 22:27 |
| *** jamesmcarthur has quit IRC | 22:27 | |
| *** auristor has joined #openstack-infra | 22:27 | |
| clarkb | I've learned that 49F is tshirt weather if not windy and the sun is out | 22:27 |
| ianw | it was like 100F here yesterday | 22:28 |
| clarkb | we actually had a relatively warm winter but then the last few weeks (prior to this weekend) were freezing and we've had multiple bouts of snow and freezing rain | 22:29 |
| clarkb | our snowpack went from abyssmal to average so we won't have to ration water this year | 22:30 |
| ianw | largest solar generating day @ 27.80kWh ... for the last 5 days i've been tracking anyway :) | 22:30 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: Allow group read permissions on project keys directory https://review.openstack.org/642913 | 22:30 |
| mordred | ianw: what's the solar array driving that? | 22:34 |
| ianw | mordred: it's a 5kw system, 20 panels, mostly wnw facing | 22:36 |
| mordred | ianw: neat! I'm trying to wrap my head around solar generation capacities in advance of our crazy boat-related plans | 22:38 |
| ianw | mordred: ahh, i imagine then you'd be looking at more keeping deep-cycle batteries topped up? | 22:40 |
| *** jamesmcarthur has joined #openstack-infra | 22:43 | |
| mordred | ianw: at first - although eventually we're looking at solar/wind into batteries to then run electric motors: https://oceanvolt.com/ | 22:43 |
| *** tosky has quit IRC | 22:43 | |
| clarkb | mordred: oh neat I've always wondered why people didn't do that (the generation via prop in water) | 22:43 |
| ianw | haha, so basically a sea tesla | 22:44 |
| mordred | clarkb: it'll apparently eat a knot of speed - and doesn't work great until you're crusing at 6 or 7 knots in teh first place - but yeah - exactly! | 22:44 |
| mordred | ianw: yah. should be a fun experiment! :) | 22:45 |
| clarkb | mordred: re knot of speed: sure, but isn't the whole point to typically not be going anywhere quickly? | 22:45 |
| clarkb | unless you've got to outrun weather I doubt you usually care | 22:45 |
| mordred | yup | 22:45 |
| mordred | the goal is definitely to be able to not care | 22:46 |
| mordred | if you want to get somewhere quickly - cruising catamaran sailboat is NOT the right vehicle | 22:46 |
| clarkb | once upon a time I geeked out on ocean based electrical generation because island my parents live on runs two diesel generators for power. One that doesn't work and the other is shut down constantly for maintenance | 22:46 |
| clarkb | tide based generation is basically a really big version of ^ installed in reef channels | 22:47 |
| clarkb | and wave is really neat, you push a column of air through a cylinder bobbing in the waves to drive a turbine | 22:47 |
| *** ianychoi_ is now known as ianychoi | 22:47 | |
| mordred | oh - yeah - that makes total sense | 22:48 |
| mordred | fwiw - https://www.torqeedo.com are the other main folks doing electric propulsion for boats - their Deep Blue system actually uses the BMW i3 batter packs | 22:50 |
| mordred | https://www.torqeedo.com/us/en-us/products/hybrid-drives | 22:50 |
| *** mriedem has quit IRC | 22:51 | |
| *** tkajinam has joined #openstack-infra | 22:53 | |
| *** jamesmcarthur has quit IRC | 22:55 | |
| fungi | i've been interested in playing with some tidal power generation here at the house, along with a small wind turbine (we certainly have enough of the stuff), though mostly to drive some small hobby projects like a weather station | 22:56 |
| fungi | the real challenge with those is building them to withstand unnatural surges and gusts | 22:56 |
| fungi | which we, unfortunately, also get our fair share of | 22:57 |
| anteaya | a few folks around where I live did wind turbines for a while | 22:58 |
| anteaya | they removed them because power surges took out the entire residence's system | 22:58 |
| fungi | i've found a number of 3d printer patterns for making helical airfoil sections | 22:58 |
| fungi | not interested in connecting them to my house/the grid at least so that's a bit simpler | 22:59 |
| anteaya | good call | 23:00 |
| anteaya | these folks felt that big money solved all problems | 23:00 |
| fungi | since all i have to care about is dc power generation and distribution this way | 23:00 |
| anteaya | there is benefit to experimenting | 23:00 |
| ianw | my energy meter has a flash/W imported LED, so i see in my future a small arduino project to make a battery simulator and see if it makes any sort of financial sense to get something | 23:00 |
| fungi | well-insulated experimenting at any rate ;) | 23:00 |
| anteaya | indeed | 23:01 |
| *** kjackal has quit IRC | 23:01 | |
| mordred | fungi: don't insulate it so much that the output electricity all becomes heat :) | 23:01 |
| anteaya | toasty marshmallows | 23:01 |
| *** rascasoft has quit IRC | 23:05 | |
| *** mattw4 has quit IRC | 23:06 | |
| openstackgerrit | Merged openstack-infra/puppet-zuul master: Allow optional status_uri to be set for status backups https://review.openstack.org/642896 | 23:07 |
| openstackgerrit | Merged openstack-infra/system-config master: Manage zuul status backups directly https://review.openstack.org/642894 | 23:07 |
| *** mattw4 has joined #openstack-infra | 23:10 | |
| clarkb | re ^ I've done the first pass of cleaning up crontab entries | 23:10 |
| *** betherly has joined #openstack-infra | 23:10 | |
| *** betherly has quit IRC | 23:15 | |
| *** slaweq has quit IRC | 23:24 | |
| openstackgerrit | Merged openstack-infra/system-config master: Handle launchpad projects in our gitea project creation https://review.openstack.org/642907 | 23:24 |
| clarkb | ok gonna pop out for a few to prep dinner then back to clean up cron things once puppet runs to show me what should go away | 23:32 |
| *** tristanC2 is now known as tristanC | 23:36 | |
| *** rascasoft has joined #openstack-infra | 23:40 | |
| *** betherly has joined #openstack-infra | 23:42 | |
| *** betherly has quit IRC | 23:46 | |
| *** armax has quit IRC | 23:47 | |
| *** rascasoft has quit IRC | 23:53 | |
| *** jamesmcarthur has joined #openstack-infra | 23:53 | |
| *** yamamoto has joined #openstack-infra | 23:54 | |
| clarkb | zuul crons applied as expected and look correct to me. I've removed the old cron entries which should fix teh cron spam | 23:57 |
| *** lseki has quit IRC | 23:58 | |
| *** Qiming has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!