| *** wolverineav has quit IRC | 00:02 | |
| *** wolverineav has joined #openstack-infra | 00:03 | |
| *** wolverineav has quit IRC | 00:07 | |
| *** Swami has quit IRC | 00:08 | |
| *** gyee has quit IRC | 00:09 | |
| *** ijw has quit IRC | 00:14 | |
| *** wolverineav has joined #openstack-infra | 00:20 | |
| *** tbachman has joined #openstack-infra | 00:25 | |
| *** wolverineav has quit IRC | 00:27 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add graphite01.opendev.org letsencrypt configuration https://review.openstack.org/648288 | 00:33 |
|---|---|---|
| *** wolverineav has joined #openstack-infra | 00:49 | |
| *** wolverineav has quit IRC | 00:53 | |
| openstackgerrit | Manjeet Singh Bhatia proposed openstack-infra/project-config master: Add a new project networking-omnipath https://review.openstack.org/651008 | 00:59 |
| openstackgerrit | Manjeet Singh Bhatia proposed openstack-infra/project-config master: Add a new project networking-omnipath https://review.openstack.org/651008 | 01:00 |
| *** ricolin has joined #openstack-infra | 01:02 | |
| *** igordc has quit IRC | 01:06 | |
| zxiiro-away | Anyone tried using "black" for their code linting? curious about others experiences with it. (ref: https://github.com/ambv/black) | 01:09 |
| *** jamesmcarthur has quit IRC | 01:09 | |
| clarkb | zxiiro-away: I've looked at it and like that it is optomized for avoiding merge conflicts and reducing diff sizes for code review | 01:15 |
| clarkb | zxiiro-away: I think we ahould consider using it insteadof pycodestyle once rhel8 happens and python3.6 is more broadly available | 01:15 |
| zxiiro-away | yeah I'm liking what I've read about it so far. Anything that helps contributors spend less cycles spinning on small trivial issues is useful. | 01:17 |
| lifeless | zxiiro-away: I used it quite successfully internally at VMware | 01:27 |
| lifeless | zxiiro-away: its reasonably, though not completely, stable between versions (as you'd expect :)) | 01:27 |
| ianw | fatal: [adns1.opendev.org]: FAILED! => {"msg": "The task includes an option with an undefined variable. The error was: 'ansible.vars.hostvars.HostVarsVars object' has no attribute 'acme_txt_required' | 01:28 |
| lifeless | clarkb: if you can, you might consider having a robot submitting style fixes rather than folk having to match the style on submission | 01:28 |
| lifeless | clarkb: (e.g. a robot that pushes an update to the changesets if the formatting is wrong) | 01:28 |
| ianw | lifeless: cue complaints about robots getting credit for commits ... :) | 01:29 |
| ianw | "credit" | 01:29 |
| lifeless | ianw: the lava like heat of corporate mad-investment is over, surely we can do good things for contributors now? | 01:30 |
| lifeless | Actually that implies we haven't in the past, which is unfair. | 01:31 |
| lifeless | Say instead, surely we aren't blocked from ... now. | 01:31 |
| clarkb | lifeless: doesnt that undo the benefits for code review? | 01:33 |
| *** hongbin has joined #openstack-infra | 01:33 | |
| clarkb | I guess its tradeoff between churn and format | 01:33 |
| ianw | lifeless: yeah, there's been work to make zuul put output rich gerrit comments that include highlighting of the errors and i think even pep8 was hooked up to it all, but maybe there was some issue and it didn't get activated | 01:33 |
| lifeless | clarkb: I don't think so; there are a couple of places it could be layered in. | 01:33 |
| ianw | we get a ton of "skipping: [gitea07.opendev.org] => (item={'project': 'openstack/radar', 'description': 'dashboard for ci reporting'})" for every run in the ansible logs | 01:35 |
| clarkb | we do have robots pushing changes (amd have for years) the trick here would be doing it early enough in the process that you get the diff benefits in code review | 01:35 |
| clarkb | ianw I think we skip things if they are already there? or is it that specific repo? | 01:36 |
| ianw | clarkb: oh, sorry i mean we have that for *every* repo | 01:36 |
| ianw | i think on every run ... so it's quite verbose | 01:36 |
| clarkb | ya I think that may be expected :/ | 01:36 |
| clarkb | because we check if they need gitea setup and after its done we skip them | 01:36 |
| ianw | yeah and i guess related to corvus wanting to move it out of the base playbook | 01:37 |
| ianw | just makes a big haystack for needles atm | 01:37 |
| ianw | letsencrypt appears to be *not* working ... despite my CI efforts :/ | 01:38 |
| clarkb | ya the pieces to move it out and have zuul drive it should all be there now | 01:38 |
| clarkb | is in my list for tomorrow to get the current test cd job working and from there drive gitea (and maybe dns?) | 01:39 |
| *** nicolasbock has quit IRC | 01:39 | |
| clarkb | lifeless: does it have a operate on a diff mode or on the last git commit? | 01:42 |
| clarkb | hopefully we can avoid unrelated changes when black updates | 01:42 |
| fungi | the main reason we check changes for style rather than correcting style after they merge is not so much to enforce consistency, it's to stop overzealous reviewers arguing over code style on proposed changes | 01:48 |
| *** ricolin_ has joined #openstack-infra | 01:50 | |
| *** ricolin has quit IRC | 01:50 | |
| *** sthussey has quit IRC | 01:51 | |
| ianw | fungi / clarkb: hrm, i'm really struggling to see why it seems the letsencrypt roles aren't matching anything -> http://paste.openstack.org/show/749028/ | 01:52 |
| *** rosmaita has left #openstack-infra | 01:53 | |
| clarkb | ianw there is an ansible command I forget that prints group mbership | 01:55 |
| clarkb | I usually start with that when ansi le isnt runni g where I expect it | 01:56 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Remove linaro-cn1 region https://review.openstack.org/651053 | 01:58 |
| *** apetrich has quit IRC | 01:58 | |
| lifeless | clarkb: not that I'm aware of; you can certainly limit it to the files involved in a changeset, but not to the changed regions of those files. | 02:04 |
| ianw | sigh, playbooks/host_vars/graphite01.opendev.org.yaml is an untracked file ... i've forgotten to commit it | 02:05 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Really add graphite01.opendev.org certificate details https://review.openstack.org/651055 | 02:07 |
| *** lseki has quit IRC | 02:27 | |
| *** roman_g has quit IRC | 02:29 | |
| ianw | clarkb / cmurphy: not sure if you've noticed but all the "TASK [puppet-install : Install puppetlabs repo] ********************************" for puppet4 seems to fail | 02:32 |
| ianw | fatal: [cacti02.openstack.org]: FAILED! => {"changed": false, "msg": "A later version is already installed"} | 02:32 |
| clarkb | ya its because we try to enforce puppet indtall in two ways. I ha e achange up to start simplifyi g that | 02:33 |
| clarkb | ianw https://review.openstack.org/#/c/597325/ | 02:35 |
| clarkb | it wont fix that but it does start removing redundant bits in that role | 02:35 |
| *** hongbin has quit IRC | 02:35 | |
| *** whoami-rajat has joined #openstack-infra | 02:37 | |
| *** diablo_rojo has quit IRC | 02:37 | |
| *** hongbin has joined #openstack-infra | 02:38 | |
| ianw | ok ... will look | 02:38 |
| ianw | mirror01.nrt1.arm64ci.openstack.org has gone r/o with a bunch o kernel errors | 02:38 |
| *** igordc has joined #openstack-infra | 02:40 | |
| *** hongbin has quit IRC | 02:49 | |
| *** hongbin has joined #openstack-infra | 02:51 | |
| *** ykarel|away has joined #openstack-infra | 02:51 | |
| *** bhavikdbavishi has joined #openstack-infra | 02:56 | |
| *** bhavikdbavishi has quit IRC | 03:21 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 03:21 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 03:23 | |
| ianw | clarkb: sigh, ansible is actually right about it's later version | 03:28 |
| ianw | we have ii puppetlabs-release-pc1 1.1.0-4xenial installed | 03:28 |
| ianw | https://apt.puppetlabs.com/puppetlabs-release-pc1-xenial.deb appears to be Version: 1.1.0-2xenial | 03:28 |
| ianw | how has it gone backwards! | 03:28 |
| clarkb | ianw does /opt/puppetlabs exist? | 03:38 |
| clarkb | and if so there should be a bin dir in there with puppet that reporta veraion 4 if you run puppet --version | 03:38 |
| clarkb | pc1 is this weird versioning thing they did I think it roughly maps to 4? | 03:39 |
| clarkb | its a collection of puppet 4 or something like that | 03:39 |
| ianw | clarkb: yeah, i am struggling to see how puppetlabs-release-pc1 version 1.1.0-4xenial is installed. i'm not sure where that .deb comes from ... google has like 4 random weird hits | 03:39 |
| ianw | it's the deb with the puppet repos | 03:40 |
| *** yamamoto has quit IRC | 03:40 | |
| clarkb | is it our install puppet script? | 03:40 |
| clarkb | that us what we are using to upgrade from 3 to 4 | 03:40 |
| ianw | installed at 2019-03-21 16:04:09 configure puppetlabs-release-pc1:all 1.1.0-4xenial <none> | 03:41 |
| openstackgerrit | Merged openstack-infra/system-config master: Don't manage puppet.conf during puppet-install https://review.openstack.org/597325 | 03:44 |
| ianw | logs don't go back that far ... where did this deb come from! | 03:46 |
| clarkb | thats in the range of time I wouldve upgraded puppet | 03:47 |
| clarkb | ianw https://opendev.org/openstack-infra/system-config/src/branch/master/install_puppet.sh#L218 | 03:48 |
| clarkb | I think that is where | 03:48 |
| ianw | clarkb: right ... but https://apt.puppetlabs.com/puppetlabs-release-pc1-xenial.deb is 1.1.0-2xenial ... unless somehow it was -4 when you updated it, and then it's remotely switched back? | 03:49 |
| clarkb | pc1 is puppet 4 but with its own versioning I think | 03:50 |
| clarkb | so its puppet collection 1 (which is puppet 4) version 1.1.0 | 03:51 |
| clarkb | there wasnever really a true puppet v1 so I think that must be it | 03:51 |
| clarkb | it went from 0.something to 2.7 to 3 iirc | 03:51 |
| clarkb | oh I see itsthe suffix | 03:53 |
| clarkb | sorry | 03:53 |
| ianw | clarkb: yeah, i mean AFAICS https://apt.puppetlabs.com/puppetlabs-release-pc1-xenial.deb was installed by probably puppet4 update, but somehow has used a later version than is currently available | 03:54 |
| *** yamamoto has joined #openstack-infra | 03:55 | |
| clarkb | did maybe they removed packages or did a non version increase release? | 03:55 |
| clarkb | http://apt.puppetlabs.com/pool/xenial/PC1/p/puppetlabs-release-pc1/ | 03:56 |
| clarkb | they are both available | 03:57 |
| clarkb | do we pin the version in that ansible role? | 03:57 |
| ianw | clarkb: ahhh!!! ok, so that's in the actual *repo*. ansible is grabbing it from the top-level dir https://apt.puppetlabs.com/ ... it's out of sync | 03:58 |
| *** ramishra has joined #openstack-infra | 03:59 | |
| ianw | arrggghhh, what a mess | 04:00 |
| clarkb | ya we've got code attacking it from two sides :/ | 04:00 |
| ianw | so basically, you install https://apt.puppetlabs.com/puppetlabs-release-pc1-xenial.deb , and then upgrade, and it upgrades puppetlabs-release-pc1-xenial | 04:01 |
| clarkb | unfortunately I didnt realize until after we started upgrading and I didnt want to have to use a different process so instead have tried cleaning up (slowly) | 04:01 |
| ianw | now you can't install https://apt.puppetlabs.com/puppetlabs-release-pc1-xenial.deb again. i think the easiest thing to do here is add a skip in the ansible | 04:01 |
| clarkb | I think that is reasonable | 04:01 |
| clarkb | if puppetlabs list exists then skil | 04:02 |
| *** imacdonn_ has quit IRC | 04:02 | |
| *** imacdonn_ has joined #openstack-infra | 04:03 | |
| *** udesale has joined #openstack-infra | 04:04 | |
| *** hongbin has quit IRC | 04:05 | |
| *** ykarel|away is now known as ykarel | 04:07 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Skip installing puppetlabs repos if they exist https://review.openstack.org/651064 | 04:15 |
| ianw | clarkb: ^ ok, yak shaved :) | 04:15 |
| *** markvoelker has quit IRC | 04:31 | |
| ianw | gary_perkins_: it seems mirror01.nrt1.arm64ci.openstack.org has gone into shutdown, and despite my best efforts to "start" it again (it doesn't return any error) it remains in shutdown | 04:34 |
| ianw | well, to be clear, it was basically dead with the root filesystem r/o and ext4 errors. i rebooted from command line, it didn't come back. i did a hard reboot, which didn't seem to work but it went into shutdown | 04:35 |
| ianw | i would really prefer to not have to rebuild it if at all possible | 04:36 |
| ianw | clarkb: ^ fyi too | 04:36 |
| *** hwoarang_ has quit IRC | 04:37 | |
| *** hwoarang has joined #openstack-infra | 04:42 | |
| *** ykarel has quit IRC | 04:42 | |
| *** dpawlik has joined #openstack-infra | 04:45 | |
| *** wolverineav has joined #openstack-infra | 04:49 | |
| *** dpawlik has quit IRC | 04:50 | |
| *** wolverineav has quit IRC | 04:54 | |
| *** ykarel has joined #openstack-infra | 04:56 | |
| *** igordc has quit IRC | 05:11 | |
| *** gregoryo has joined #openstack-infra | 05:22 | |
| *** e0ne has joined #openstack-infra | 05:25 | |
| *** e0ne has quit IRC | 05:29 | |
| *** quiquell|off is now known as quiquell|rover | 05:43 | |
| *** udesale has quit IRC | 05:52 | |
| *** ykarel is now known as ykarel|afk | 05:58 | |
| *** ricolin_ has quit IRC | 05:58 | |
| *** jbadiapa has joined #openstack-infra | 06:01 | |
| AJaeger | infra-root, https://git.openstack.org/cgit/inaugust/inaugust.com/ is not imported - it's an empty repo | 06:01 |
| *** ykarel|afk has quit IRC | 06:02 | |
| *** kopecmartin|off is now known as kopecmartin | 06:05 | |
| *** ccamacho has joined #openstack-infra | 06:12 | |
| *** ykarel|afk has joined #openstack-infra | 06:13 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Remove graphite.openstack.org https://review.openstack.org/651104 | 06:14 |
| *** kjackal_v2 has quit IRC | 06:21 | |
| *** ricolin has joined #openstack-infra | 06:22 | |
| *** pgaxatte has joined #openstack-infra | 06:22 | |
| *** rkukura has joined #openstack-infra | 06:26 | |
| *** dpawlik has joined #openstack-infra | 06:27 | |
| *** pcaruana has joined #openstack-infra | 06:30 | |
| *** markvoelker has joined #openstack-infra | 06:32 | |
| *** udesale has joined #openstack-infra | 06:33 | |
| *** snapiri has quit IRC | 06:33 | |
| *** ykarel|afk is now known as ykarel | 06:35 | |
| *** quiquell|rover is now known as quique|rover|brb | 06:41 | |
| *** slaweq has joined #openstack-infra | 06:47 | |
| *** ginopc has joined #openstack-infra | 06:56 | |
| *** kjackal has joined #openstack-infra | 06:56 | |
| *** hwoarang has quit IRC | 06:57 | |
| *** hwoarang has joined #openstack-infra | 07:04 | |
| *** gfidente has joined #openstack-infra | 07:05 | |
| *** markvoelker has quit IRC | 07:06 | |
| *** apetrich has joined #openstack-infra | 07:10 | |
| *** gfidente has quit IRC | 07:11 | |
| *** rpittau|afk is now known as rpittau | 07:12 | |
| *** quique|rover|brb is now known as quiquell|rover | 07:13 | |
| *** mnencia_ has joined #openstack-infra | 07:14 | |
| *** mnencia has quit IRC | 07:15 | |
| *** mnencia_ is now known as mnencia | 07:15 | |
| *** SpamapS has quit IRC | 07:15 | |
| *** slaweq has quit IRC | 07:17 | |
| *** SpamapS has joined #openstack-infra | 07:17 | |
| *** slaweq has joined #openstack-infra | 07:17 | |
| *** tosky has joined #openstack-infra | 07:20 | |
| *** sshnaidm|off is now known as sshnaidm|pto | 07:23 | |
| *** ykarel is now known as ykarel|lunch | 07:31 | |
| *** tosky has quit IRC | 07:33 | |
| *** tosky has joined #openstack-infra | 07:33 | |
| ianw | #status log mirror01.nrt1.arm64ci.openstack.org currently offline pending (hopeful) recovery | 07:39 |
| openstackstatus | ianw: finished logging | 07:39 |
| *** roman_g has joined #openstack-infra | 07:39 | |
| *** jpena|off is now known as jpena | 07:47 | |
| frickler | mordred: AJaeger: seems the source repo is messed up http://paste.openstack.org/show/749037/ | 07:49 |
| *** jpich has joined #openstack-infra | 07:52 | |
| *** jonher_ has joined #openstack-infra | 07:57 | |
| *** jonher has quit IRC | 07:58 | |
| *** frickler has quit IRC | 07:58 | |
| *** jonher_ is now known as jonher | 07:58 | |
| *** frickler has joined #openstack-infra | 07:59 | |
| *** dtantsur|afk is now known as dtantsur | 08:00 | |
| *** rcernin has quit IRC | 08:01 | |
| *** ccamacho has quit IRC | 08:01 | |
| *** markvoelker has joined #openstack-infra | 08:03 | |
| *** gfidente has joined #openstack-infra | 08:04 | |
| *** e0ne has joined #openstack-infra | 08:13 | |
| *** priteau has joined #openstack-infra | 08:15 | |
| *** wolverineav has joined #openstack-infra | 08:15 | |
| *** wolverineav has quit IRC | 08:20 | |
| *** kjackal has quit IRC | 08:21 | |
| *** kjackal has joined #openstack-infra | 08:22 | |
| ironfoot | ianw: re. mirror01.nrt1.arm64ci.openstack.org, I can have a quick look in the meantime | 08:24 |
| *** lucasagomes has joined #openstack-infra | 08:27 | |
| ianw | ironfoot: great, thanks | 08:27 |
| *** zbr has quit IRC | 08:28 | |
| *** yamamoto has quit IRC | 08:30 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Skip installing puppetlabs repos if they exist https://review.openstack.org/651064 | 08:31 |
| ianw | frickler: ^ thanks for pointing that out, dropped the puppet5 bit | 08:31 |
| *** yamamoto has joined #openstack-infra | 08:36 | |
| *** markvoelker has quit IRC | 08:36 | |
| *** e0ne has quit IRC | 08:37 | |
| *** derekh has joined #openstack-infra | 08:40 | |
| *** tkajinam has quit IRC | 08:43 | |
| *** kjackal has quit IRC | 08:46 | |
| *** e0ne has joined #openstack-infra | 08:47 | |
| *** ykarel|lunch is now known as ykarel | 08:48 | |
| ironfoot | ianw: space related issues in the controller... -.-' Glance could do with an images cleanup on the zuul project | 08:48 |
| ironfoot | I can do if it's safe to clean them up. I assume these images were uploaded as part of some tests | 08:48 |
| ironfoot | As a side note, we have finished a new cloud deployment, more robust, more redundancy, ceph backed, etc, to avoid these kind of problems in the future | 08:49 |
| *** gregoryo has quit IRC | 08:59 | |
| *** yamamoto has quit IRC | 09:16 | |
| *** kjackal has joined #openstack-infra | 09:16 | |
| *** jaosorior has quit IRC | 09:24 | |
| *** e0ne has quit IRC | 09:25 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 09:28 | |
| *** bhavikdbavishi has quit IRC | 09:29 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 09:29 | |
| *** jaosorior has joined #openstack-infra | 09:31 | |
| *** electrofelix has joined #openstack-infra | 09:41 | |
| *** e0ne has joined #openstack-infra | 09:44 | |
| *** yamamoto has joined #openstack-infra | 09:44 | |
| *** Lucas_Gray has joined #openstack-infra | 09:45 | |
| *** yolanda_ has quit IRC | 09:47 | |
| *** yamamoto has quit IRC | 09:47 | |
| *** Lucas_Gray has quit IRC | 09:53 | |
| *** Lucas_Gray has joined #openstack-infra | 09:54 | |
| *** udesale has quit IRC | 09:57 | |
| *** udesale has joined #openstack-infra | 09:58 | |
| *** psachin has joined #openstack-infra | 09:59 | |
| ianw | ironfoot: ok, cool -- it is possible that nodepool has leaked images -- any of the "-numbers" ones are from nodepool; only the ones listed in http://nl01.openstack.org/dib-image-list should be active | 10:02 |
| *** yamamoto has joined #openstack-infra | 10:02 | |
| ironfoot | ianw: thanks for that list. I'll do the cleanup :) | 10:03 |
| ianw | ironfoot: looking at that list, those ones that are like 24 days old i think shouldn't be there. i'll have to check later ... it might be that the linaro CN1 cloud somehow got things a little messed up with nodepool's tracking -- that has been flakey and eventually the ssl cert expired so we couldn't talk to it any more. we've disabled that cloud now | 10:07 |
| *** yamamoto has quit IRC | 10:08 | |
| AJaeger | frickler: thanks for checking. Hope mordred can fix the inaugust repo... | 10:08 |
| ironfoot | ianw: none of the -numbered images here were in that dib-image-list :/ | 10:09 |
| ironfoot | It might be that this cloud has been faulty for a while | 10:09 |
| *** gary_perkins_ has quit IRC | 10:11 | |
| *** gary_perkins has joined #openstack-infra | 10:11 | |
| ianw | ironfoot: yeah, possibly. i just manually deleted all those really old ones from nodepool. i'll keep an eye as it rebuilds and check on them tomorrow | 10:14 |
| ironfoot | ta | 10:14 |
| ironfoot | I'll continue debuggin what's going on with `mirror01.nrt1.arm64ci.openstack.org`. | 10:15 |
| *** yamamoto has joined #openstack-infra | 10:15 | |
| *** yamamoto has quit IRC | 10:18 | |
| *** yamamoto has joined #openstack-infra | 10:21 | |
| *** yamamoto has quit IRC | 10:21 | |
| *** yamamoto has joined #openstack-infra | 10:22 | |
| *** yamamoto has quit IRC | 10:24 | |
| *** yamamoto has joined #openstack-infra | 10:24 | |
| *** markvoelker has joined #openstack-infra | 10:33 | |
| *** bhavikdbavishi has quit IRC | 10:35 | |
| *** e0ne has quit IRC | 10:37 | |
| *** ykarel is now known as ykarel|afk | 10:41 | |
| *** e0ne has joined #openstack-infra | 10:44 | |
| *** nicolasbock has joined #openstack-infra | 10:46 | |
| *** tbachman has quit IRC | 10:48 | |
| *** owalsh has quit IRC | 10:53 | |
| *** owalsh_ has joined #openstack-infra | 10:53 | |
| *** udesale has quit IRC | 10:56 | |
| *** yamamoto has quit IRC | 11:01 | |
| *** yamamoto has joined #openstack-infra | 11:03 | |
| *** markvoelker has quit IRC | 11:07 | |
| *** yamamoto has quit IRC | 11:07 | |
| *** zbr has joined #openstack-infra | 11:08 | |
| *** yamamoto has joined #openstack-infra | 11:09 | |
| *** yamamoto has quit IRC | 11:09 | |
| *** ykarel|afk is now known as ykarel | 11:12 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] admin REST API: docker-compose PoC, frontend https://review.openstack.org/643536 | 11:12 |
| *** yamamoto has joined #openstack-infra | 11:26 | |
| *** e0ne has quit IRC | 11:30 | |
| *** jpena is now known as jpena|lunch | 11:37 | |
| *** yamamoto has quit IRC | 11:41 | |
| mordred | AJaeger: uhoh - what did I do? | 11:56 |
| mordred | AJaeger: oh - weird. k. I'm on it | 11:58 |
| *** yamamoto has joined #openstack-infra | 11:59 | |
| *** yamamoto has quit IRC | 11:59 | |
| *** tbachman has joined #openstack-infra | 11:59 | |
| *** nicolasbock has quit IRC | 12:02 | |
| *** nicolasbock has joined #openstack-infra | 12:02 | |
| *** quiquell|rover is now known as quique|rover|eat | 12:07 | |
| *** bhavikdbavishi has joined #openstack-infra | 12:09 | |
| *** elod has quit IRC | 12:11 | |
| *** elod has joined #openstack-infra | 12:11 | |
| *** gfidente has quit IRC | 12:13 | |
| *** gfidente has joined #openstack-infra | 12:13 | |
| *** lseki has joined #openstack-infra | 12:14 | |
| *** wolverineav has joined #openstack-infra | 12:16 | |
| *** jamesmcarthur has joined #openstack-infra | 12:17 | |
| mordred | AJaeger: fixed | 12:18 |
| *** wolverineav has quit IRC | 12:20 | |
| *** rosmaita has joined #openstack-infra | 12:21 | |
| openstackgerrit | Merged openstack-infra/project-config master: Adds contributor guide repo to Upstream Institute channel https://review.openstack.org/651007 | 12:26 |
| *** jpena|lunch is now known as jpena | 12:29 | |
| *** rlandy has joined #openstack-infra | 12:32 | |
| *** apetrich has quit IRC | 12:32 | |
| *** rlandy is now known as rlandy|ruck | 12:32 | |
| *** jamesdenton has quit IRC | 12:33 | |
| *** jamesmcarthur has quit IRC | 12:34 | |
| *** apetrich has joined #openstack-infra | 12:39 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/jeepyb master: Correct blueprint topic links for modern Gerrit https://review.openstack.org/630461 | 12:39 |
| *** priteau has quit IRC | 12:42 | |
| *** yamamoto has joined #openstack-infra | 12:43 | |
| *** openstackgerrit has quit IRC | 12:44 | |
| *** quique|rover|eat is now known as quiquell|rover | 12:44 | |
| *** apetrich has quit IRC | 12:45 | |
| *** dtantsur is now known as dtantsur|brb | 12:46 | |
| tdasilva | Hello, I'm looking for some help with a gate job. I have a task in my ansible script to install 'yasm' in Centos7, but it is failing to do so as it can't find the package. In my own testing it should be available in epel | 12:49 |
| tdasilva | Here's the failure: http://logs.openstack.org/75/650975/4/check/liberasurecode-unittests-centos-7/6d9c494/job-output.txt.gz#_2019-04-08_23_31_33_893294 | 12:49 |
| tdasilva | this is my test: http://paste.openstack.org/show/749029/ | 12:49 |
| *** Goneri has joined #openstack-infra | 12:50 | |
| *** jamesmcarthur has joined #openstack-infra | 12:50 | |
| *** kgiusti has joined #openstack-infra | 12:51 | |
| tdasilva | AJaeger, clarkb: wondering if you would have any pointers for above ^^^ | 12:51 |
| *** e0ne has joined #openstack-infra | 12:54 | |
| *** apetrich has joined #openstack-infra | 12:54 | |
| *** openstackgerrit has joined #openstack-infra | 12:55 | |
| openstackgerrit | Merged openstack-infra/jeepyb master: Correct blueprint topic links for modern Gerrit https://review.openstack.org/630461 | 12:55 |
| *** witek has joined #openstack-infra | 12:55 | |
| *** jroll has quit IRC | 12:55 | |
| *** sthussey has joined #openstack-infra | 12:58 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Allow user to set ara_report_executable https://review.openstack.org/648773 | 12:58 |
| *** owalsh_ is now known as owalsh_afk | 12:58 | |
| *** jroll has joined #openstack-infra | 12:59 | |
| mordred | AJaeger, clarkb, fungi: https://review.openstack.org/651229 Add pipeline definitions | 12:59 |
| fungi | tdasilva: i wonder if epel needs to be enabled first on the node? | 13:00 |
| *** eharney has joined #openstack-infra | 13:00 | |
| mordred | fungi: looks like it is | 13:02 |
| fungi | hrm | 13:02 |
| *** ykarel is now known as ykarel|afk | 13:02 | |
| mordred | yeah | 13:02 |
| tdasilva | fungi: we added here: https://review.openstack.org/#/c/650975/4/roles/install_isal/tasks/main.yaml | 13:02 |
| mordred | I don't think we're doing anything to mirror epel right? | 13:02 |
| mordred | (like, we'd have to get pretty crafty for yum install epel-release to wind up installing a yum config file that pointed to our mirrors I think) | 13:03 |
| pabelanger | epel should be installed, just disabled on nodes | 13:03 |
| pabelanger | yum --enablerepo epel should would | 13:03 |
| mordred | yah | 13:03 |
| mordred | ah | 13:03 |
| mordred | so that'll be the thing then | 13:03 |
| fungi | tl;dr: we don't want jobs accidentally installing different packages from epel unless the job author explicitly desires that | 13:04 |
| mordred | yeah | 13:04 |
| pabelanger | +1 | 13:04 |
| mordred | so the yum install epel-release in tdasilva's job is essentially a no-op | 13:04 |
| mordred | and the enablerepo line is needed | 13:04 |
| *** jamesmcarthur has quit IRC | 13:04 | |
| tdasilva | mordred: yeah, i realized that later when looking at the logs. will try to change to enable repo | 13:05 |
| mordred | \o/ | 13:05 |
| pabelanger | yah, epel-release is done via DIB builds, so we can get haveged, then we disable it. Also means we can configure our mirrors too | 13:05 |
| mordred | fungi, pabelanger: I think we have to force-merge the add pipelines to opendev patch, right? since there are no pipelines, it's not possible to land changes in that repo normally, yeah? | 13:05 |
| mordred | pabelanger: ++ | 13:06 |
| fungi | mordred: i concur. that will not run speculatively | 13:06 |
| pabelanger | looking | 13:06 |
| mordred | k. well - I copied those verbatim from the zuul tenant - so they _should_ be good :) | 13:06 |
| fungi | frickler had a suggestion for the commit message on it | 13:06 |
| pabelanger | agree with force merge, we should maybe also add noop job too? otherwise that needs force merge too | 13:07 |
| *** ykarel|afk has quit IRC | 13:09 | |
| *** yamamoto has quit IRC | 13:10 | |
| *** tbachman has quit IRC | 13:10 | |
| mordred | pabelanger: good call - I'll update | 13:10 |
| pabelanger | I've been seening the following crontab emails from openstackid.org for the last few days: | 13:10 |
| pabelanger | mysqldump: Got error: 2005: Unknown MySQL server host 'oodbeba95d95748e4e01a8f825ac9f1a980c.openstack.org' (0) when trying to connect | 13:10 |
| pabelanger | looks like backups aren't working? | 13:10 |
| ironfoot | ianw: mirror01.nrt1.arm64ci.openstack.org instance is running now | 13:10 |
| *** jcoufal has joined #openstack-infra | 13:10 | |
| *** yamamoto has joined #openstack-infra | 13:11 | |
| *** yamamoto has quit IRC | 13:11 | |
| mordred | pabelanger, fungi, frickler: updated with the suggestions | 13:11 |
| mordred | if y'all are ok with that - I'll do the force-merge | 13:12 |
| pabelanger | +2 | 13:13 |
| *** witek has quit IRC | 13:16 | |
| *** tbachman has joined #openstack-infra | 13:16 | |
| frickler | mordred: ack | 13:18 |
| AJaeger | mordred: http://git.openstack.org/cgit/inaugust/inaugust.com/ looks fine now - thanks | 13:19 |
| *** aaronsheffield has joined #openstack-infra | 13:21 | |
| mordred | woot! zuul is running jobs in opendev tenant now | 13:25 |
| *** priteau has joined #openstack-infra | 13:27 | |
| openstackgerrit | Monty Taylor proposed opendev/base-jobs master: Use tox-linters for opendev https://review.openstack.org/651240 | 13:28 |
| *** tbachman has quit IRC | 13:32 | |
| *** ykarel has joined #openstack-infra | 13:32 | |
| *** udesale has joined #openstack-infra | 13:36 | |
| *** tbachman has joined #openstack-infra | 13:38 | |
| *** lpetrut has joined #openstack-infra | 13:42 | |
| *** mriedem has joined #openstack-infra | 13:43 | |
| *** eernst has joined #openstack-infra | 13:44 | |
| pabelanger | mordred: Yay | 13:49 |
| *** yamamoto has joined #openstack-infra | 13:51 | |
| dmsimard | the gerrit replication autoreload patch has 3 +2s -- unless there's any objections I'll +w and keep an eye on it | 13:53 |
| dmsimard | ( https://review.openstack.org/#/c/650051/ ) | 13:53 |
| *** e0ne has quit IRC | 13:53 | |
| *** Lucas_Gray has quit IRC | 13:57 | |
| *** eernst has quit IRC | 13:57 | |
| *** Lucas_Gray has joined #openstack-infra | 14:01 | |
| *** yamamoto has quit IRC | 14:02 | |
| fungi | do we want to wait on merging gerrit config changes until after tomorrow? | 14:03 |
| fungi | just a thought | 14:03 |
| AJaeger | mordred: regarding https://review.openstack.org/#/c/651240/ - openstack-zuul-jobs-linters works, why is the change needed? | 14:03 |
| dmsimard | fungi: I've been trying to move the ara repos for a few weeks now :( | 14:03 |
| fungi | dmsimard: yep, we've also been trying to release openstack stein for a few weeks and promised the openstack release team we'd try to avoid making any disruptive changes | 14:04 |
| *** priteau has quit IRC | 14:04 | |
| dmsimard | fair | 14:04 |
| *** lpetrut has quit IRC | 14:04 | |
| fungi | i don't personally expect that change to be disruptive, but if we're in a bind and need to restart gerrit for some reason and that config change breaks our inability to start it up for a few minutes, that extends the potential disruption | 14:05 |
| fungi | plus, we need a gerrit restart for it to take effect, right? | 14:06 |
| fungi | so there's little point in merging it until we're about to restart gerrit (which we can probably plan to do on thursday or friday if we want) | 14:06 |
| dmsimard | the autoreload addition requires a gerrit restart to be effective, yes -- I didn't plan to restart gerrit but I wanted the change to be in so that if we need to restart gerrit then it's picked up | 14:06 |
| fungi | i would rather plan to just go ahead and restart it once release activity calms down. that way we know whether it's working the way we want prior to opendev migration | 14:07 |
| dmsimard | works for me, apologies for my patience running short :p | 14:07 |
| fungi | and still leaves us some time to fix it up better if it isn't for some reason | 14:08 |
| tdasilva | fungi, mordred, pabelanger: thanks! enabling epel repo fixed our issue with patch 650975 | 14:08 |
| fungi | dmsimard: no worries, i'm eager to see it put to use as well | 14:08 |
| pabelanger | tdasilva: \o/ | 14:09 |
| pabelanger | tdasilva: +1 left comment too | 14:11 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/system-config master: Use /usr/bin/python3 as the interpreter for bridge.o.o https://review.openstack.org/651251 | 14:16 |
| dmsimard | infra-root: ^ not sure if that was a known issue but infra-prod-zuul_reconfigure has been consistently failing: http://zuul.openstack.org/builds?job_name=infra-prod-zuul_reconfigure | 14:17 |
| *** michael-beaver has joined #openstack-infra | 14:17 | |
| pabelanger | dmsimard: https://review.openstack.org/649331 is the fix | 14:19 |
| dmsimard | pabelanger: we have the same fix, I'll abandon mine :) | 14:20 |
| dmsimard | pabelanger: not exactly the same fix, mine provides /usr/bin/python3 instead of just python3 -- does just python3 work ? | 14:20 |
| pabelanger | yup, https://github.com/ansible-network/windmill-config/blob/master/tests/playbooks/bastion.yaml#L10 | 14:21 |
| pabelanger | dmsimard: Oh, also | 14:21 |
| dmsimard | TIL | 14:21 |
| *** michael-beaver has left #openstack-infra | 14:21 | |
| pabelanger | maybe sure you use IP address for bridge.o.o, not DNS. Otherwise zuul_console won't work | 14:21 |
| pabelanger | there is a bug that is only support IPs, not hostnames | 14:21 |
| pabelanger | mordred: ^ | 14:22 |
| pabelanger | http://eavesdrop.openstack.org/irclogs/%23zuul/%23zuul.2019-04-04.log.html#t2019-04-04T20:49:43 | 14:22 |
| *** bobh has joined #openstack-infra | 14:28 | |
| AJaeger | mordred: did you see my comment regarding https://review.openstack.org/#/c/651240/ ? | 14:29 |
| AJaeger | mordred: sorry, thought you spoke in the meantime - misparsed lines above ;( | 14:29 |
| *** dtantsur|brb is now known as dtantsur | 14:30 | |
| *** e0ne has joined #openstack-infra | 14:31 | |
| *** quiquell|rover is now known as quiquell|off | 14:38 | |
| *** owalsh_afk is now known as owalsh | 14:41 | |
| clarkb | dmsimard: pabelanger: ya that was all not working previously due to not allowing root ssh from the executors. So I added the zuulcd user and that finally got in and now we have the next round of things to fix for it | 14:42 |
| clarkb | dmsimard: pabelanger: considering that gitea and the dns servers are 100% ansible driven (no puppet) I think we want to pivot that job to CDing those services | 14:42 |
| *** igordc has joined #openstack-infra | 14:42 | |
| clarkb | that will be the step once we've got the base ssh in and run a thing working | 14:42 |
| clarkb | I've got a meeting in a few minutes but then will be catching up on ianw's puppet yak and can help shepherd the zuulcd stuff along too | 14:45 |
| *** _erlon_ has joined #openstack-infra | 14:46 | |
| *** jamesmcarthur has joined #openstack-infra | 14:47 | |
| *** lpetrut has joined #openstack-infra | 14:48 | |
| *** jistr is now known as jistr|call | 14:51 | |
| *** ijw has joined #openstack-infra | 14:51 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Add rewrites for whitelabeled legacy git sites https://review.openstack.org/651268 | 15:02 |
| *** ijw has quit IRC | 15:05 | |
| *** ijw has joined #openstack-infra | 15:05 | |
| openstackgerrit | Malek Karray proposed openstack-infra/storyboard-webclient master: Allowing the user to choose what Columns are seen https://review.openstack.org/651270 | 15:07 |
| mordred | AJaeger: oh weird ... I was looking at http://zuul.opendev.org/t/opendev/status at the config errors | 15:09 |
| *** ijw has quit IRC | 15:09 | |
| clarkb | mordred: AJaeger are we running jobs for opendev/base-jobs from the openstack tenant? | 15:09 |
| *** ijw has joined #openstack-infra | 15:09 | |
| clarkb | that may explain that behavior? | 15:09 |
| mordred | ah - yes, I think we are | 15:09 |
| mordred | we have - opendev/base-jobs: | 15:10 |
| AJaeger | ah... | 15:10 |
| mordred | shadow: openstack-infra/project-config | 15:10 |
| mordred | in the openstack tenant | 15:10 |
| TheJulia | Out of curiosity, was it intentional to take rocky grenade to always start on Bionic? | 15:10 |
| clarkb | TheJulia: thats a question for the qa team. But I want to say in the past we have chosen the node so that we upgrade starting on the supported distro for the first release | 15:11 |
| fungi | TheJulia: probably not, but it's more a question for #openstack-qa and maybe gmann specifically | 15:11 |
| *** kjackal has quit IRC | 15:12 | |
| *** tbachman has quit IRC | 15:15 | |
| *** tbachman has joined #openstack-infra | 15:22 | |
| *** e0ne has quit IRC | 15:23 | |
| *** e0ne has joined #openstack-infra | 15:27 | |
| openstackgerrit | Tim Burke proposed openstack/os-testr master: Default concurrency to 0 to avoid TypeError in stestr https://review.openstack.org/651275 | 15:28 |
| *** lpetrut has quit IRC | 15:29 | |
| *** iurygregory_ has joined #openstack-infra | 15:32 | |
| *** iurygregory has quit IRC | 15:35 | |
| *** gyee has joined #openstack-infra | 15:35 | |
| *** udesale has quit IRC | 15:37 | |
| *** iurygregory_ is now known as iurygregory | 15:38 | |
| clarkb | mordred: AJaeger I think that means you can add the opendev linter job and then remove the openstack side config? | 15:38 |
| clarkb | and for a short period we may end up running both jobs | 15:38 |
| mordred | clarkb: yeah - although with the shadowing - I'm not 100% I know what the job architecture intent is supposed to be | 15:39 |
| mordred | clarkb: so maybe we update zuul/main.yaml to only pull in jobs from opendev/base-jobs in the opendev tenant for now - I don't want to mess up any in-flight sequencing corvus might have been workign through | 15:40 |
| clarkb | mordred: I think that was mostly bootstrapping. However we may need an opendev/project-config | 15:40 |
| mordred | we have one | 15:40 |
| mordred | just landed pipelines in it this morning | 15:40 |
| clarkb | I think the problem here is that we want base-jobs to be reusable base jobs and so that needs to be constrained to that | 15:40 |
| clarkb | then we can put all of the other stuff in the project-config repo | 15:41 |
| clarkb | ah cool | 15:41 |
| clarkb | in that case I think it was largely just ease of bootstrapping | 15:41 |
| mordred | nod | 15:41 |
| *** tbachman has quit IRC | 15:41 | |
| rosmaita | AJaeger: ianw: gerrit dashboard review at your convenience: https://review.openstack.org/651276 ... thanks! | 15:42 |
| mordred | clarkb: k. well - we have this: https://review.openstack.org/#/c/651240/ | 15:42 |
| mordred | which removes the openstack-specific linter job usage | 15:42 |
| *** jamesmcarthur has quit IRC | 15:42 | |
| mordred | I'll push up a patch to remove opendev/base-jobs from openstack tenant | 15:42 |
| clarkb | mordred: opendev/base-jobs still needs to be in the openstack tenant for the base jobs | 15:43 |
| clarkb | but shouldn't have a project: block | 15:43 |
| clarkb | aiui | 15:43 |
| mordred | clarkb: nod | 15:43 |
| *** tbachman has joined #openstack-infra | 15:44 | |
| *** bobh has quit IRC | 15:44 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Only pull in jobs from opendev/base-jobs to openstack https://review.openstack.org/651280 | 15:45 |
| mordred | clarkb: something like that ^^? | 15:45 |
| clarkb | mordred: ya though the tab will liekly have to be cleaned up because yaml? | 15:46 |
| clarkb | mordred: also that might be scary enough that we merge it after the openstack release? | 15:46 |
| mordred | bah. I put in a tab? sigh | 15:46 |
| mordred | ++ | 15:46 |
| mordred | clarkb: it's totally non-urgent | 15:46 |
| clarkb | but ya I think that is correct | 15:46 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Only pull in jobs from opendev/base-jobs to openstack https://review.openstack.org/651280 | 15:47 |
| clarkb | pabelanger: dmsimard I've approved https://review.openstack.org/#/c/649331/1 | 15:47 |
| clarkb | currently the playbook that runs should just say hello world | 15:48 |
| clarkb | if we get that to work I think we can fix the console streaming and pivot to configuring gitea with that | 15:48 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Remove project config for api-sig repo https://review.openstack.org/651282 | 15:50 |
| *** apetrich has quit IRC | 15:50 | |
| openstackgerrit | Pedro Alvarez Piedehierro proposed openstack/diskimage-builder master: Fix Fedora aarch64 image location https://review.openstack.org/651283 | 15:50 |
| *** ijw has quit IRC | 15:50 | |
| *** ijw has joined #openstack-infra | 15:51 | |
| *** bobh has joined #openstack-infra | 15:57 | |
| *** jistr|call is now known as jistr | 16:00 | |
| *** diablo_rojo has joined #openstack-infra | 16:01 | |
| *** jamesmcarthur has joined #openstack-infra | 16:05 | |
| *** ginopc has quit IRC | 16:08 | |
| *** e0ne has quit IRC | 16:08 | |
| *** Lucas_Gray has quit IRC | 16:08 | |
| *** priteau has joined #openstack-infra | 16:13 | |
| ironfoot | ^ That helps when trying to build an aarch64 Amphora image, although fails because `open-vm-tools` package couldn't be found | 16:14 |
| openstackgerrit | Merged openstack-infra/system-config master: Set ansible_python_interpreter for bridge.o.o https://review.openstack.org/649331 | 16:15 |
| clarkb | ironfoot: is that fedora version dependent? | 16:16 |
| * clarkb looks up some urls | 16:16 | |
| clarkb | 28 and 29 both have it so we should be fine | 16:17 |
| ironfoot | yeah, and I couldn't find it on earlier versions | 16:18 |
| ironfoot | although, are you talking about the aarch64 image or the open-vm-tools package | 16:18 |
| clarkb | aarch64 | 16:18 |
| * ironfoot nods | 16:19 | |
| *** pgaxatte has quit IRC | 16:19 | |
| *** lucasagomes has quit IRC | 16:22 | |
| *** jamesmcarthur has quit IRC | 16:23 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Use /etc/hosts with docker registries to handle ipv6 https://review.openstack.org/650968 | 16:23 |
| *** tjgresha has joined #openstack-infra | 16:26 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul master: Don't cache wheels in dockerfile https://review.openstack.org/651322 | 16:29 |
| mordred | clarkb: on ^^ - the use of --cache-dir is to consume the wheels built in the builder image step | 16:35 |
| clarkb | mordred: ah | 16:35 |
| clarkb | mordred: well we can remove the zuul-executor use of it | 16:35 |
| clarkb | because the zuul image deletes them before zuul-executor can use them | 16:35 |
| clarkb | or we can stop zuul from deleting them and then delete them in every sub iamge? | 16:35 |
| *** mattw4 has joined #openstack-infra | 16:36 | |
| clarkb | mordred: do you have a preference on that? I can update the change so that it is mergeable | 16:36 |
| mordred | clarkb: that wouldn't save much - since they'd be in the zuul layer | 16:36 |
| mordred | clarkb: but - we copy /output from the builder image into the zuul-executor image | 16:36 |
| mordred | so the zuul image deleting them wouldn't impact the use of them in the executor image | 16:36 |
| mordred | this is mostly all just to make sure we don't need -dev packages installed | 16:36 |
| clarkb | mordred: doesn't the copy happen after the delete though? | 16:36 |
| openstackgerrit | Manjeet Singh Bhatia proposed openstack-infra/project-config master: Add a new project networking-omnipath https://review.openstack.org/651008 | 16:37 |
| mordred | the copy is happening --from=builder | 16:37 |
| clarkb | oh I see | 16:37 |
| mordred | it would be so much nicer if one could use volumes in image builds | 16:37 |
| mordred | but apparently that has a high degree of confusing people making them think that the volume content would wind up in the resulting image - thus why it is blocked | 16:38 |
| clarkb | I guess any valid zuul change would build new images | 16:38 |
| mordred | yeah | 16:38 |
| clarkb | so I should go review some zuul/nodepool changes | 16:38 |
| mordred | clarkb: I just +A'd https://review.openstack.org/#/c/650917 - it's just a change to tests, but I think it should still cause new images? | 16:40 |
| clarkb | mordred: I was just looking at that one | 16:40 |
| clarkb | and ya I think we always build new images | 16:40 |
| mordred | cool | 16:40 |
| mordred | probably a good idea to | 16:40 |
| clarkb | ara --help creates a db? | 16:40 |
| clarkb | we may want to make sure that isn't a behavior that could change but otherwise the test should be fine | 16:41 |
| mordred | clarkb: I figure if the behavior changes we just yell at dmsimard | 16:41 |
| clarkb | mordred: http://zuul.openstack.org/stream/555d041f4a8c4e76be08e4f16d907c86?logfile=console.log that should push to the intermediate registry and dockerhub | 16:42 |
| clarkb | I think it will run a buildset registry in that job too and push to it? then zuul-quick-start will pull from it | 16:43 |
| clarkb | so we should exercise this reasonably well | 16:43 |
| mordred | yes, I believe so | 16:43 |
| *** ijw has quit IRC | 16:43 | |
| openstackgerrit | Merged openstack-infra/system-config master: Skip installing puppetlabs repos if they exist https://review.openstack.org/651064 | 16:43 |
| *** jamesmcarthur has joined #openstack-infra | 16:45 | |
| openstackgerrit | Gary Perkins proposed openstack-infra/system-config master: Changed config to add the new ewr1cloud * New cloud 'arm64ci-ewr1' (url: ewr1cloud.arm64ci.cloud) * Keeping the old cloud 'arm64ci' (url: arm64ci.cloud) for now for a bit of overlap. https://review.openstack.org/650021 | 16:47 |
| *** jpena is now known as jpena|away | 16:50 | |
| *** dpawlik has quit IRC | 16:51 | |
| *** jpich has quit IRC | 16:54 | |
| *** electrofelix has quit IRC | 16:58 | |
| *** derekh has quit IRC | 17:00 | |
| *** psachin has quit IRC | 17:00 | |
| *** dtantsur is now known as dtantsur|afk | 17:03 | |
| *** priteau has quit IRC | 17:04 | |
| *** tjgresha has quit IRC | 17:10 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul-jobs master: Revert "Use /etc/hosts with docker registries to handle ipv6" https://review.openstack.org/651332 | 17:10 |
| *** bgmccollum has quit IRC | 17:10 | |
| *** ykarel is now known as ykarel|away | 17:12 | |
| *** bgmccollum has joined #openstack-infra | 17:13 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul-jobs master: Revert "Revert "Use /etc/hosts with docker registries to handle ipv6"" https://review.openstack.org/651334 | 17:13 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/openstackid master: Switch to openstackdocstheme and latest Sphinx https://review.openstack.org/651335 | 17:14 |
| clarkb | fungi: on ^ the openstackdocstheme docs imply you need to set some other conf.py values | 17:15 |
| * clarkb finds recent glean change that did that switch | 17:15 | |
| clarkb | fungi: https://review.openstack.org/#/c/650480/1/doc/source/conf.py | 17:16 |
| *** ykarel|away has quit IRC | 17:17 | |
| AJaeger | clarkb: or docs.openstack.org/openstackdocstheme | 17:17 |
| AJaeger | clarkb, fungi, marcet was too quick and already gave a +2A... Want to WIP? | 17:18 |
| fungi | interesting. it builds and renders for me locally | 17:18 |
| AJaeger | fungi: might not be nice ;) | 17:19 |
| AJaeger | fungi: if it works, you can do a followup as well... | 17:19 |
| *** ramishra has quit IRC | 17:19 | |
| fungi | might as well add it to this change | 17:20 |
| *** gfidente is now known as gfidente|afk | 17:23 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/openstackid master: Switch to openstackdocstheme and latest Sphinx https://review.openstack.org/651335 | 17:23 |
| fungi | AJaeger: clarkb: ^ | 17:23 |
| *** mriedem is now known as mriedem_away | 17:27 | |
| *** ijw has joined #openstack-infra | 17:28 | |
| *** yamamoto has joined #openstack-infra | 17:28 | |
| *** bobh has quit IRC | 17:32 | |
| *** kopecmartin is now known as kopecmartin|off | 17:36 | |
| *** tjgresha has joined #openstack-infra | 17:38 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Some python yaml fixes https://review.openstack.org/651338 | 17:39 |
| AJaeger | fungi, clarkb, our periodic jobs to remove the upstream keyword does not run anymore, could you review this, please? ^ | 17:39 |
| AJaeger | fungi, openstackid change looks fine, thanks | 17:40 |
| AJaeger | regarding the yaml fixes: I used safeloader - or do we need the fullloader? | 17:40 |
| *** gmann is now known as gmann_afk | 17:40 | |
| clarkb | safe should be fine for us | 17:41 |
| *** michael-beaver has joined #openstack-infra | 17:41 | |
| clarkb | we don't serialize python objects other than str, int, bool, list, dict | 17:41 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Fix race with test_provider_removal unit test https://review.openstack.org/651339 | 17:41 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Revert "Use /etc/hosts with docker registries to handle ipv6" https://review.openstack.org/651332 | 17:42 |
| *** jpena|away is now known as jpena | 17:43 | |
| openstackgerrit | Gary Perkins proposed openstack-infra/system-config master: Changed config to add the new ewr1cloud * New cloud 'arm64ci-ewr1' (url: ewr1cloud.arm64ci.cloud) * Keeping the old cloud 'arm64ci' (url: arm64ci.cloud) for now for a bit of overlap. https://review.openstack.org/650021 | 17:44 |
| *** mriedem_away is now known as mriedem | 17:46 | |
| *** wolverineav has joined #openstack-infra | 17:48 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/storyboard-webclient master: Override javascript_content_dir in build job https://review.openstack.org/651341 | 17:52 |
| *** wolverineav has quit IRC | 17:52 | |
| *** cfriesen has joined #openstack-infra | 17:53 | |
| *** wolverineav has joined #openstack-infra | 17:53 | |
| *** jpena is now known as jpena|off | 17:53 | |
| *** tjgresha has quit IRC | 17:53 | |
| cfriesen | is this a race condition? I'm seeing a -1 vote from Zuul, but no explanation of which tests failed. https://review.openstack.org/#/c/650311/ | 17:53 |
| fungi | cfriesen: zuul left a comment on the change which says "This change depends on a change that failed to merge." | 17:54 |
| fungi | likely 650311 was undergoing testing when one of its two dependencies (or one of their dependencies if it has any) received a new patchset | 17:55 |
| cfriesen | weird, I'm not seeing that comment in Chrome or Firefox | 17:55 |
| fungi | click the "toggle ci" button at the bottom to un-hide comments from ci system accounts | 17:55 |
| cfriesen | ah, cool. so just a recheck then? | 17:55 |
| fungi | yeah, as long as that change's dependencies are still viable | 17:56 |
| cfriesen | should be. thanks | 17:56 |
| fungi | cfriesen: the zuul team have been discussnig a possible behavior change to restart testing of changes in such a scenario. the failure message, while technically correct, isn't terribly helpful | 17:57 |
| openstackgerrit | Merged openstack-infra/openstackid master: Switch to openstackdocstheme and latest Sphinx https://review.openstack.org/651335 | 17:58 |
| openstackgerrit | Matt McEuen proposed openstack-infra/project-config master: Add airship-governance project https://review.openstack.org/651342 | 18:01 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Some python yaml fixes https://review.openstack.org/651338 | 18:03 |
| AJaeger | argh, yamllib needs some more changes, first cut - and then fix the next one ^ | 18:03 |
| *** ricolin has quit IRC | 18:04 | |
| fungi | infra-root: if we can get https://review.openstack.org/651268 fast-tracked in the next few minutes, then we'll be able to let our various community representatives know during the meeting that the opendev git redirects for their respective whitelabeled legacy sites are available for testing | 18:06 |
| fungi | it's a very small change to a .htaccess file used only in vhosts which don't have any dns pointed at them, so shouldn't be able to break anything even if it's terribly wrong (but i tested it all manually myself, so it shouldn't be) | 18:07 |
| mordred | fungi: I am supportive of such things | 18:07 |
| fungi | thanks! | 18:08 |
| fungi | i'm glad to have moved on to scripting the in-repository changes | 18:08 |
| mordred | fungi: that sounds like a lot of fun | 18:08 |
| mordred | I'm "looking forward" to reviewing such a thing | 18:08 |
| fungi | but wuold like to have the redirects fully in place to allow for a lot of time for the impacted communities to make sure i didn't miss something | 18:09 |
| fungi | (10 days and countnig!_ | 18:09 |
| * fungi can't type today | 18:09 | |
| clarkb | fungi: what is the | in (cgit/|) | 18:12 |
| fungi | an or condition, so that $1 contains one of "cgit/" or "" | 18:13 |
| clarkb | oh we are redirectly not cgit to cgit too? I guess that is beacuse the opendev redirect requires cgit | 18:13 |
| fungi | though in the latter part of the pattern, i just spotted that i can simplify now that i'm wildcarding some stuff, just a sec | 18:13 |
| clarkb | ok that makes sense to me | 18:13 |
| *** ijw has quit IRC | 18:13 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Add rewrites for whitelabeled legacy git sites https://review.openstack.org/651268 | 18:14 |
| clarkb | hrm but we drop all args when we redirect to opendev.org? | 18:15 |
| fungi | (cgit/|) should match the same things as (cgit/)? except i don't know if the latter will always still populate $1 or could cause $1 to shift to the second match in the pattern | 18:15 |
| clarkb | I think it will cause it to shift so yours is better | 18:16 |
| clarkb | that redirects git.zuul-ci.org/cgit/zuul to git.zuul-ci.org/cgit/openstack-infra/zuul ? | 18:16 |
| *** e0ne has joined #openstack-infra | 18:16 | |
| fungi | but yeah, the ^(cgit/|) is there to help us root the repository name prefixes | 18:16 |
| fungi | so if the url starts cgit/stx- or stx- then insert openstack/ so that it becomes cgit/openstack/stx- or openstack/stx- | 18:17 |
| clarkb | then git.zuul-ci.org/cgit/openstack-infra/zuul goes through the normal redirect rules below and gets setn to opendev.org? | 18:17 |
| fungi | right | 18:17 |
| fungi | this block of rules exists solely to insert namespaces before the repository names so they'll match and be processed the same way as git.openstack.org urls are | 18:18 |
| clarkb | yup got it | 18:18 |
| *** rlandy|ruck is now known as rlandy|ruck|hw | 18:19 | |
| *** jcoufal has quit IRC | 18:19 | |
| *** yamamoto has quit IRC | 18:19 | |
| *** gmann_afk is now known as gmann | 18:21 | |
| *** rpittau is now known as rpittau|afk | 18:21 | |
| *** cfriesen has left #openstack-infra | 18:22 | |
| *** e0ne has quit IRC | 18:23 | |
| *** lpetrut has joined #openstack-infra | 18:25 | |
| clarkb | fungi: I'll bring https://etherpad.openstack.org/p/lists.o.o-upgrade-notice that up in our meeting today but since I think you are likely to end up being the second set of eyeballs on the upgrade want ot look over that now quickly? | 18:27 |
| clarkb | fungi: I'm flexible on time too but I figured 1700UTC gave you/me enough time to snapshot the server in the morning before we begin | 18:28 |
| fungi | please send it as separate copies and don't cross-post that | 18:28 |
| clarkb | k, noted in the To: line | 18:28 |
| fungi | yeah, friday works fine for me | 18:28 |
| fungi | message lgtm too, thanks! | 18:29 |
| *** lpetrut has quit IRC | 18:29 | |
| clarkb | cool if no one objects in the meeting I'll send that out after our meeting | 18:30 |
| fungi | awesome | 18:30 |
| clarkb | getting that done knocks the list down to static, status, ask, refstack, wiki | 18:31 |
| clarkb | if anyone wants to volunteer to pick some of those up hint hint :P | 18:32 |
| fungi | i'm still poking at wiki-dev but need to get around to lookup up what all the new package names are | 18:32 |
| fungi | a quick test suggests the following packages specified in the manifest don't exist on xenial: libogg0, libtheora0, libvorbisenc2, ttf-bengali-fonts, ttf-devanagari-fonts, ttf-gujarati-fonts, ttf-kannada-fonts, ttf-linux-libertine, ttf-malayalam-fonts, ttf-oriya-fonts, ttf-punjabi-fonts, ttf-sil-scheherazade, ttf-tamil-fonts | 18:33 |
| *** e0ne has joined #openstack-infra | 18:33 | |
| fungi | that said, i also don't know how many of them are strictly necessary either | 18:33 |
| clarkb | libtheora0 exists on my xenial | 18:34 |
| fungi | ahh, in that case puppet has failed to install it for some reason | 18:34 |
| clarkb | as does libogg0 | 18:35 |
| fungi | so might be skipping some packages due to other problems | 18:35 |
| clarkb | ya | 18:35 |
| fungi | ahh, nevermind, these are the packages puppet clearly said it was unable to find: apache2-prefork-dev php5-intl php5-memcached libvips37 ttf-sil-yi | 18:36 |
| *** tjgresha has joined #openstack-infra | 18:36 | |
| fungi | a couple are related to the php7.0 transition | 18:37 |
| fungi | and i think apache 2.4 dropped the prefork mpm? | 18:37 |
| *** adriant has quit IRC | 18:38 | |
| fungi | libvips likely has a dummy package which could be used instead of getting specific about the soname | 18:38 |
| fungi | leaving ttf-sil-yi to figure out a replacement for | 18:38 |
| *** betherly has joined #openstack-infra | 18:38 | |
| fungi | there are a ton of fonts-sil-.* packages in xenial | 18:39 |
| fungi | aha, ttf-sil-yi was a transitional dummy package for fonts-sil-nuosusil | 18:40 |
| fungi | which does exist in xenial | 18:40 |
| *** eharney has quit IRC | 18:42 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient master: Override javascript_content_dir in build job https://review.openstack.org/651341 | 18:42 |
| *** betherly has quit IRC | 18:43 | |
| *** wolverineav has quit IRC | 18:46 | |
| *** wolverineav has joined #openstack-infra | 18:47 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-mediawiki master: Replace transitional package names for Xenial https://review.openstack.org/651352 | 18:49 |
| fungi | clarkb: ^ that's hopefully the bulk of th problems to move forward on wiki-dev | 18:49 |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul-jobs master: Only alias registries on build nodes https://review.openstack.org/651353 | 18:51 |
| *** wolverineav has quit IRC | 18:52 | |
| fungi | #status log deleted old trusty-based openstackid-dev.openstack.org and openstackid.org servers now that the xenial-based replacements have been operating successfully in production for a while | 18:52 |
| openstackstatus | fungi: finished logging | 18:52 |
| clarkb | fungi: +2 | 18:52 |
| clarkb | friendly reminder we'll have our infra meeting in about 8 mintes over in #openstack-meeting | 18:52 |
| clarkb | * 8 minutes | 18:52 |
| * fungi consumes 8 mints | 18:53 | |
| *** jamesmcarthur has quit IRC | 18:55 | |
| *** yamamoto has joined #openstack-infra | 18:58 | |
| clarkb | fungi: careful if you s/m/p/ that becomes a long day/night | 18:59 |
| *** betherly has joined #openstack-infra | 18:59 | |
| *** ijw has joined #openstack-infra | 19:02 | |
| fungi | good point | 19:03 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Some python yaml fixes https://review.openstack.org/651338 | 19:04 |
| *** betherly has quit IRC | 19:04 | |
| *** ociuhandu has joined #openstack-infra | 19:05 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Some python yaml fixes https://review.openstack.org/651338 | 19:09 |
| AJaeger | fungi, clarkb, so, this works ^ - but gives some side effects. | 19:09 |
| *** yamamoto has quit IRC | 19:09 | |
| ianw | ironfoot: hrm, i'm not getting a response from mirror01.nrt1.arm64ci.openstack.org now | 19:09 |
| clarkb | AJaeger: side effects like needing to change our yaml files? | 19:09 |
| AJaeger | clarkb: see the two checked in files. gerritbot/channels.yaml is fine, and gerrit/projects gets normalized (I shouldn't have checked it in) in the daily update that I only wanted to fix | 19:10 |
| AJaeger | So, either we take it - or somebody needs to fix tools/projectconfig_yamllib.py to work differently | 19:11 |
| * AJaeger has no ideas and neither time for another fix | 19:11 | |
| *** e0ne has quit IRC | 19:15 | |
| *** tbachman has quit IRC | 19:15 | |
| *** whoami-rajat has quit IRC | 19:17 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add rewrites for whitelabeled legacy git sites https://review.openstack.org/651268 | 19:19 |
| *** betherly has joined #openstack-infra | 19:20 | |
| *** jamesmcarthur has joined #openstack-infra | 19:21 | |
| *** wolverineav has joined #openstack-infra | 19:23 | |
| *** wolverineav has quit IRC | 19:23 | |
| *** wolverineav has joined #openstack-infra | 19:24 | |
| AJaeger | infra-root, any python yaml experts that want to look at 651338 and fix it better, please? | 19:25 |
| * AJaeger needs to leave... | 19:25 | |
| *** betherly has quit IRC | 19:25 | |
| fungi | thanks AJaeger! if i get a moment i'll take a look | 19:27 |
| *** efried is now known as efried_afk | 19:30 | |
| AJaeger | fungi: thanks | 19:32 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove upstream lines from gerrit/projects.yaml https://review.openstack.org/651360 | 19:32 |
| AJaeger | as a band-aid, we can merge ^ | 19:32 |
| *** eharney has joined #openstack-infra | 19:38 | |
| *** betherly has joined #openstack-infra | 19:41 | |
| *** auristor has quit IRC | 19:43 | |
| *** e0ne has joined #openstack-infra | 19:44 | |
| *** betherly has quit IRC | 19:45 | |
| clarkb | I'm going to review ianw's LE fix change then I need to find lunch | 19:59 |
| clarkb | I plan to send my lists upgrade email when I am back from lunch so please give that a look if youcan | 19:59 |
| ianw | clarkb: cool, thanks ... i think we should be ok now. with the puppet fix acme.sh is installed and i'm just double-checking that it's running as part of base ok now | 20:00 |
| anteaya | does slushy equate to flexible? | 20:00 |
| anteaya | is this a thing and I missed the genesis? | 20:00 |
| anteaya | to me slushy just means rubber boots | 20:00 |
| clarkb | ianw: ok I just approved the fix | 20:00 |
| anteaya | and in the spring, maple syrup | 20:00 |
| clarkb | anteaya: "frozen" is a common term for not making changes | 20:00 |
| anteaya | ah, silly me | 20:01 |
| clarkb | we say slushy when we mean be extra careful about the changes you make | 20:01 |
| anteaya | I missed that thanks | 20:01 |
| clarkb | so updating graphite.o.o is ok but gerrit/zuul/nodepool less so | 20:01 |
| fungi | slushy being "not entirely frozen" | 20:01 |
| anteaya | to me frozen means tend to the fire | 20:01 |
| clarkb | since release team relies on gerrit/zuul/nodepool but not directly on graphite | 20:01 |
| *** betherly has joined #openstack-infra | 20:01 | |
| clarkb | ianw: should I unapprove it? | 20:01 |
| anteaya | ah, thanks for the idiot's guide | 20:01 |
| mordred | ianw, clarkb: https://review.openstack.org/#/c/651282/ easy p-c change if you want one | 20:01 |
| clarkb | mordred: done | 20:02 |
| mordred | thanks! | 20:02 |
| mordred | clarkb: (we noticed earlier that it was running python27 jobs - and they're really not needed - so yay tiny amount of less-wasted capacity!) | 20:02 |
| clarkb | ianw: you probably have about half an hour to unapprove/wip that change if it isn't what you wanted so I'll leave it in place | 20:02 |
| ianw | fatal: [mirror01.cn1.linaro.openstack.org]: FAILED! => {"changed": false, "msg": "No package matching 'puppet-agent' is available"} | 20:03 |
| ianw | every time i look at the logs something else :/ | 20:03 |
| clarkb | ianw: it should be puppet4 now and the package is just puppet iirc? | 20:03 |
| clarkb | oh you know what | 20:03 |
| clarkb | we use the puppetlabs repos for that | 20:03 |
| clarkb | and maybe they don't have arm packages | 20:04 |
| clarkb | so we might need to pin nb03 and the arm mirrors to $distropuppet | 20:04 |
| clarkb | mordred: re placement and the docker image jobs don't forget we are half broken with ipv6 right now :) | 20:04 |
| mordred | clarkb: totally. :) | 20:05 |
| mordred | clarkb: I think that was an email teeing up discussion for the ptg | 20:05 |
| clarkb | ok I'm off to find lunch. Back to send lists upgrade email and all the other things | 20:05 |
| ianw | ok: [graphite01.opendev.org] => { | 20:05 |
| ianw | "letsencrypt_certs": "VARIABLE IS NOT DEFINED!" | 20:05 |
| ianw | ... that's good; that change will fix that. i think in a few hours when things go through we might be looking ood | 20:05 |
| *** betherly has quit IRC | 20:06 | |
| * fungi is already looking odd | 20:06 | |
| *** pfallenop has quit IRC | 20:08 | |
| *** kjackal has joined #openstack-infra | 20:10 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove project config for api-sig repo https://review.openstack.org/651282 | 20:12 |
| ironfoot | ianw: I noticed I couldn't ping it or reach some ports. I wonder if the security groups got lost or something. | 20:16 |
| *** jamesmcarthur has quit IRC | 20:17 | |
| *** jamesmcarthur has joined #openstack-infra | 20:18 | |
| *** pfallenop has joined #openstack-infra | 20:20 | |
| *** auristor has joined #openstack-infra | 20:21 | |
| ironfoot | when I recovered it, the floating IP was actually gone. | 20:22 |
| *** betherly has joined #openstack-infra | 20:22 | |
| ianw | ironfoot: oh, if it's ip has changed that would explain a lot :) | 20:23 |
| ianw | hrm, ip address via openstack is same as in dns, so that's not it | 20:23 |
| ironfoot | oh no, the floating IP should be the same. The internal one though, might be, if that affects the service | 20:24 |
| *** Goneri has quit IRC | 20:24 | |
| *** kgiusti has left #openstack-infra | 20:24 | |
| *** auristor has quit IRC | 20:24 | |
| ianw | no, that won't matter, only floating ip | 20:25 |
| ianw | looks active, nothing crazy on console | 20:25 |
| ironfoot | and security groups look permisive enough, right? | 20:25 |
| openstackgerrit | Merged openstack-infra/system-config master: Really add graphite01.opendev.org certificate details https://review.openstack.org/651055 | 20:26 |
| *** betherly has quit IRC | 20:26 | |
| *** rlandy|ruck|hw is now known as rlandy|ruck | 20:27 | |
| *** wolverineav has quit IRC | 20:27 | |
| ianw | ironfoot: yeah, i'm looking at 51053955-7559-467b-a12d-e43e8cdade9a and it all looks right | 20:27 |
| *** pcaruana has quit IRC | 20:31 | |
| *** wolverineav has joined #openstack-infra | 20:32 | |
| *** ijw has quit IRC | 20:33 | |
| *** pcaruana has joined #openstack-infra | 20:33 | |
| *** pcaruana has quit IRC | 20:36 | |
| *** wolverineav has quit IRC | 20:37 | |
| *** pcaruana has joined #openstack-infra | 20:39 | |
| *** jamesmcarthur has quit IRC | 20:44 | |
| *** jamesmcarthur has joined #openstack-infra | 20:45 | |
| *** pcaruana has quit IRC | 20:47 | |
| *** wolverineav has joined #openstack-infra | 20:50 | |
| ironfoot | Tried to reach it from an instance in the same subnet, no luck. | 20:54 |
| *** wolverineav has quit IRC | 20:57 | |
| *** tbachman has joined #openstack-infra | 20:58 | |
| *** wolverineav has joined #openstack-infra | 20:59 | |
| *** wolverineav has quit IRC | 21:00 | |
| *** wolverineav has joined #openstack-infra | 21:00 | |
| *** betherly has joined #openstack-infra | 21:03 | |
| *** betherly has quit IRC | 21:08 | |
| *** SpamapS has quit IRC | 21:10 | |
| *** SpamapS has joined #openstack-infra | 21:11 | |
| *** jamesmcarthur has quit IRC | 21:11 | |
| *** wolverineav has quit IRC | 21:15 | |
| *** wolverineav has joined #openstack-infra | 21:16 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Fixed Member/Speaker Pic URL https://review.openstack.org/651384 | 21:17 |
| *** eharney has quit IRC | 21:19 | |
| clarkb | ianw: ianychoi I just sent an email to you both to kick off the next steps on weblate (I wasn't sure if email or irc is easier for ianychoi so mentioning it here too). Basically I think we should have the i18n team do a sanity check of the tool and if there aren't any major concerns we'll draft up an email together to send to the weblate hosted service and cc jbryce on that | 21:20 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Fixed Member/Speaker Pic URL https://review.openstack.org/651384 | 21:20 |
| *** wolverineav has quit IRC | 21:21 | |
| ianw | clarkb: ++, thanks | 21:21 |
| *** wolverineav has joined #openstack-infra | 21:23 | |
| *** efried_afk is now known as efried | 21:25 | |
| *** igordc has quit IRC | 21:25 | |
| *** Goneri has joined #openstack-infra | 21:27 | |
| *** wolverineav has quit IRC | 21:27 | |
| *** e0ne has quit IRC | 21:28 | |
| *** wolverineav has joined #openstack-infra | 21:28 | |
| *** msmarcal is now known as msmarcal|eod | 21:28 | |
| *** wolverineav has quit IRC | 21:28 | |
| *** wolverin_ has joined #openstack-infra | 21:29 | |
| *** kjackal has quit IRC | 21:30 | |
| *** wolverin_ has quit IRC | 21:31 | |
| *** wolverineav has joined #openstack-infra | 21:33 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: letsencrypt: split staging and self-signed generation https://review.openstack.org/651388 | 21:35 |
| ianw | clarkb: ^ seems obvious now that i should have split them ... hindsight | 21:35 |
| *** wolverineav has quit IRC | 21:38 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Remove zuul_reconfigure CD job https://review.openstack.org/651389 | 21:38 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Pivot to running zuul cd against nameservers https://review.openstack.org/651390 | 21:38 |
| clarkb | infra-root pabelanger and dmsimard in particular. That is sort of what I had in mind for the infra-prod job next step | 21:39 |
| clarkb | ianw: looking | 21:39 |
| openstackgerrit | Merged openstack-infra/storyboard master: Search bars handle queries as if they have a * at the end https://review.openstack.org/644487 | 21:40 |
| clarkb | ianw lgtm | 21:41 |
| openstackgerrit | Pierre Riteau proposed openstack/diskimage-builder master: Increase size of EFI system partition (again) https://review.openstack.org/641702 | 21:41 |
| openstackgerrit | Merged openstack-infra/openstackid master: Fixed Scope Groups Update https://review.openstack.org/649431 | 21:42 |
| *** betherly has joined #openstack-infra | 21:44 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul-jobs master: Only alias registries on build nodes https://review.openstack.org/651393 | 21:45 |
| fungi | ianw: to answer your question on 650021, gary_perkins generously handed initial credentials off to me at ~20:30z | 21:47 |
| *** betherly has quit IRC | 21:49 | |
| ianw | fungi: cool, have they been put in the ... usual locations? | 21:53 |
| clarkb | how to make your browser sad? open the 9k line yaml diff in AJaeger's yaml fixup change | 21:53 |
| mordred | clarkb: yeah. don't do that | 21:54 |
| clarkb | I may have to restart firefix | 21:54 |
| fungi | ianw: nope, i haven't even had a chance to change the passwords yet, which is usually step #1 before recording them for everyone else | 21:54 |
| clarkb | it is really unhappy now | 21:54 |
| ianw | clarkb: it's not as fun these days with ssds, in the old days you knew you were in trouble when you heard things whirring and knew it was swappin time | 21:54 |
| *** gfidente|afk has quit IRC | 21:54 | |
| fungi | sounded like your computer was preparing for launch | 21:55 |
| *** mattw4 has quit IRC | 21:56 | |
| *** mattw4 has joined #openstack-infra | 21:57 | |
| *** wolverineav has joined #openstack-infra | 21:58 | |
| *** ijw has joined #openstack-infra | 22:00 | |
| mordred | the fanless laptop version of that is "why are my legs getting really hot?" | 22:00 |
| *** slaweq has quit IRC | 22:01 | |
| *** jamesmcarthur has joined #openstack-infra | 22:03 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Pivot to running zuul cd against nameservers https://review.openstack.org/651390 | 22:05 |
| *** thomasmckay has joined #openstack-infra | 22:08 | |
| thomasmckay | hello! are there any python client devs/experts that i could email with issue? we're debugging an issue with quay | 22:09 |
| thomasmckay | sorry, keystone python client | 22:10 |
| thomasmckay | i don't know tech details but would like an email intro to anyone that may be able to direct further | 22:10 |
| clarkb | thomasmckay: you'll probably have better luck in the #openstack-keystone channel | 22:10 |
| thomasmckay | thanks! | 22:11 |
| clarkb | though if using openstacksdk library mordred is the person to bug | 22:11 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Pivot to running zuul cd against nameservers https://review.openstack.org/651390 | 22:13 |
| *** slaweq has joined #openstack-infra | 22:14 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Pivot to running zuul cd against nameservers https://review.openstack.org/651390 | 22:16 |
| *** slaweq has quit IRC | 22:18 | |
| clarkb | fungi: other than being awake early do you know of anything that would be helpful pre release? | 22:20 |
| clarkb | fungi: the d-g grenade change has merged | 22:20 |
| *** rcernin has joined #openstack-infra | 22:28 | |
| *** jamesdenton has joined #openstack-infra | 22:32 | |
| rpioso | I submitted a change to stable/stein -- https://review.openstack.org/#/c/645956/ It hasn't merged. I've been asked to submit it to master first, and then backport it to stable/stein. May I change the branch of the original change or must it be abandoned and a new change against master created? | 22:32 |
| clarkb | rpioso: a change is in part uniquely identified by its target branch so you can't change that. What you can do is update your existing change on stein once you have a backport ready | 22:33 |
| rpioso | clarkb: Thank you! | 22:34 |
| *** auristor has joined #openstack-infra | 22:39 | |
| *** jamesmcarthur has quit IRC | 22:42 | |
| fungi | though the stable branch folks generally like for them to have matching change-id footers | 22:44 |
| fungi | so the only way to do that would be to make sure the new change for the master branch uses the same change-id footer in its commit message | 22:44 |
| fungi | clarkb: i'm planning to be at the keyboard by 11:30z to make sure things look normal, big red button gets mashed at 12:00z, if all goes well automation will run to completion by 12:30-13:00z, press release embargo lifts at 15:00z | 22:46 |
| fungi | so i figure if something turns out to be broken and we didn't notice earlier, we'll be aware by ~12:30z which is likely still really early on your end of the rock | 22:47 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Migrated Mail from native to Sendgrid API https://review.openstack.org/651405 | 22:47 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: letsencrypt: split staging and self-signed generation https://review.openstack.org/651388 | 22:47 |
| clarkb | fungi: ya I think 1400UTC is about when I figured I could be at a computer | 22:47 |
| fungi | just in time to look at all the shiny new git tags and release announcements! | 22:48 |
| fungi | i can always try to enlist ianw, frickler, dmsimard, pabelanger or mordred if further troubleshooting assistance is needed that time of day | 22:50 |
| fungi | or Shrews or jhesketh | 22:50 |
| clarkb | heh ok. I have tried to keep my wednesday clear at least | 22:51 |
| fungi | thanks! | 22:51 |
| *** jamesmcarthur has joined #openstack-infra | 22:52 | |
| *** tkajinam has joined #openstack-infra | 22:53 | |
| *** betherly has joined #openstack-infra | 22:57 | |
| *** betherly has quit IRC | 23:02 | |
| clarkb | alright the sun just popped out and my grass is like a foot tall after being mowed a week ago so I think I'm going to try and mow before the next rain storm shows up | 23:02 |
| *** jamesmcarthur has quit IRC | 23:03 | |
| *** jamesmcarthur has joined #openstack-infra | 23:06 | |
| *** rlandy|ruck is now known as rlandy | 23:06 | |
| *** rlandy has quit IRC | 23:09 | |
| *** aaronsheffield has quit IRC | 23:10 | |
| *** jamesmcarthur has quit IRC | 23:14 | |
| *** betherly has joined #openstack-infra | 23:18 | |
| anteaya | mowing grass | 23:19 |
| * anteaya looks at the snow covering everything in her yard | 23:20 | |
| anteaya | I'm a ways away from mowing of the grass | 23:20 |
| fungi | snowmowing | 23:21 |
| *** betherly has quit IRC | 23:22 | |
| *** _erlon_ has quit IRC | 23:25 | |
| *** mattw4 has quit IRC | 23:29 | |
| *** jamesmcarthur has joined #openstack-infra | 23:30 | |
| *** jamesmcarthur has quit IRC | 23:30 | |
| *** wolverineav has quit IRC | 23:31 | |
| *** wolverineav has joined #openstack-infra | 23:33 | |
| *** tosky has quit IRC | 23:36 | |
| mordred | fungi: what are we troubleshooting? | 23:38 |
| *** betherly has joined #openstack-infra | 23:38 | |
| mordred | oh - tomorrow release day | 23:39 |
| *** mattw4 has joined #openstack-infra | 23:39 | |
| mordred | fungi: I have nothing on my calendar tomorrow until 23:00z | 23:40 |
| *** wolverineav has quit IRC | 23:41 | |
| fungi | good deal | 23:43 |
| *** rkukura_ has joined #openstack-infra | 23:43 | |
| *** betherly has quit IRC | 23:44 | |
| *** rkukura has quit IRC | 23:45 | |
| *** rkukura_ is now known as rkukura | 23:45 | |
| *** slaweq has joined #openstack-infra | 23:48 | |
| openstackgerrit | Manjeet Singh Bhatia proposed openstack-infra/project-config master: Add a new project networking-omnipath https://review.openstack.org/651008 | 23:52 |
| *** dklyle has quit IRC | 23:52 | |
| *** slaweq has quit IRC | 23:52 | |
| *** hwoarang has quit IRC | 23:54 | |
| *** hwoarang has joined #openstack-infra | 23:58 | |
| *** betherly has joined #openstack-infra | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!