| corvus | clarkb, mordred, fungi: https://review.openstack.org/640900 is ready for review | 00:00 |
|---|---|---|
| *** tosky has quit IRC | 00:00 | |
| corvus | wait no its not | 00:01 |
| mordred | poo | 00:01 |
| corvus | sorry, it's missing a correction i thought i made earlier :/ | 00:01 |
| *** armax has quit IRC | 00:01 | |
| *** armax has joined #openstack-infra | 00:02 | |
| *** dmellado has quit IRC | 00:03 | |
| *** wolverineav has quit IRC | 00:04 | |
| *** dmellado has joined #openstack-infra | 00:04 | |
| *** hwoarang has quit IRC | 00:05 | |
| *** armax has quit IRC | 00:08 | |
| *** hwoarang has joined #openstack-infra | 00:09 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul-sphinx master: Add type to role variables https://review.openstack.org/641168 | 00:14 |
| *** rkukura has quit IRC | 00:17 | |
| clarkb | systemctl daemon-reload does not remove S90gerrit | 00:21 |
| *** wolverineav has joined #openstack-infra | 00:22 | |
| clarkb | the LSB info in that sysv init script probably does explain the S04gerrit and that would be loaded by systemd's compat layer | 00:24 |
| *** sshnaidm is now known as sshnaidm|afk | 00:28 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] Add unmanaged domains, add acme.opendev.org https://review.openstack.org/641155 | 00:29 |
| *** jesusaur has quit IRC | 00:30 | |
| *** rkukura has joined #openstack-infra | 00:32 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Use a buildset registry in the container jobs https://review.openstack.org/640900 | 00:34 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: DNM: test broken zuul-preview dockerfile https://review.openstack.org/640903 | 00:34 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: DNM: test fixed zuul-preview dockerfile https://review.openstack.org/640905 | 00:34 |
| *** jesusaur has joined #openstack-infra | 00:34 | |
| corvus | mordred, clarkb: even with that, there's still a hole in our testing, in that we don't have a great way of saying that if the gitea deployment job needs the gitea image build job, it should depend on it, otherwise it should not. this only comes about because we build and deploy the gitea image in the system-config repo. we should be good for images that are built outside of system-config. | 00:36 |
| corvus | we may need a new zuul feature to handle that. i'll need to think about it when my mind is more clear | 00:36 |
| ianw | did something change with log copying? in http://logs.openstack.org/55/641155/1/check/system-config-run-dns/6d095d6/ ... everything used to be under "hosts/<hostname>" ... now we have both the hostnames at top level and a hosts/ directory with the ara report etc | 00:37 |
| clarkb | ianw: that may be a side effect of mordred and pabelangers artifact collection changes | 00:37 |
| ianw | hrm, yeah, all the top level dirs have "docker" and "syslog" | 00:38 |
| corvus | yes, i added the stage-output role | 00:38 |
| corvus | which has a difference of opinion with fetch-output on where output should be staged | 00:39 |
| clarkb | infra-root cmurphy based on watching when the S90gerrit file goes away and mapping to syslog it is the package install of puppet that removes S90gerrit | 00:39 |
| corvus | this is something that should be corrected. i haven't had time yet. | 00:39 |
| clarkb | so that mystery at least is mostly solved and we should stop deleting those files when we stop installing puppet more than we need to | 00:39 |
| clarkb | cmurphy: ^ maybe we can improve the install puppet script? | 00:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Test gitea project creation playbook https://review.openstack.org/641158 | 00:42 |
| clarkb | corvus: are the opendev-build-docker-image and friends jobs able to be deleted? | 00:48 |
| *** wolverineav has quit IRC | 00:48 | |
| *** markvoelker has joined #openstack-infra | 00:49 | |
| *** wolverineav has joined #openstack-infra | 00:51 | |
| clarkb | infra-root https://review.openstack.org/#/q/owner:cboylan+topic:puppet-4+status:open is all green with zuul now | 00:52 |
| clarkb | I'm going to call it a day | 00:52 |
| clarkb | cmurphy: ^ tomorrow morning (for me) I'll do my best to generate that module deps list and we can work through it | 00:52 |
| fungi | i will be doing the same once tc office hour is over | 00:52 |
| fungi | thankfully election transition from tc to ptl a few minutes ago had lots of hands on deck | 00:53 |
| clarkb | the vcsrepo should actually clean up a bunch of the deps issues with puppet4 | 00:53 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] Add unmanaged domains, add acme.opendev.org https://review.openstack.org/641155 | 00:55 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: switch jobs list to a tree view https://review.openstack.org/633437 | 00:58 |
| *** mriedem has quit IRC | 01:00 | |
| *** wolverineav has quit IRC | 01:03 | |
| *** sthussey has quit IRC | 01:04 | |
| *** wolverineav has joined #openstack-infra | 01:04 | |
| *** whoami-rajat has joined #openstack-infra | 01:09 | |
| *** wolverineav has quit IRC | 01:09 | |
| *** armax has joined #openstack-infra | 01:13 | |
| *** oanson has quit IRC | 01:13 | |
| corvus | clarkb: the opendev-build-docker-image job is brand new | 01:19 |
| corvus | i don't think we should delete it | 01:19 |
| clarkb | corvus: ok between ps1 and 2 it went from using that job as a pare t to not | 01:20 |
| corvus | clarkb: it's used by zuul-preview | 01:20 |
| clarkb | wasnt sure if that implied the zuul-jobs job was the location we are moving to | 01:20 |
| corvus | clarkb: it's the version of the job that *includes* a buildset registry, whereas the jobs in system-config build on their own and use a buildset registry provided by a separate job (opendev-buildset-registry) | 01:21 |
| *** gyee has quit IRC | 01:21 | |
| *** markvoelker has quit IRC | 01:22 | |
| corvus | i will write this all up once the dust settles :) | 01:22 |
| corvus | lmit 76 | 01:25 |
| corvus | gah | 01:25 |
| *** sdake has quit IRC | 01:29 | |
| *** ricolin has joined #openstack-infra | 01:34 | |
| *** wolverineav has joined #openstack-infra | 01:36 | |
| *** sdake has joined #openstack-infra | 01:46 | |
| openstackgerrit | Merged openstack-infra/system-config master: Use a buildset registry in the container jobs https://review.openstack.org/640900 | 01:53 |
| *** jhesketh has quit IRC | 01:57 | |
| *** jhesketh has joined #openstack-infra | 01:58 | |
| *** wolverineav has quit IRC | 02:00 | |
| *** wolverineav has joined #openstack-infra | 02:00 | |
| *** bhavikdbavishi has joined #openstack-infra | 02:02 | |
| *** sdake has quit IRC | 02:05 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient master: Clear task title field on saving a new task https://review.openstack.org/634557 | 02:14 |
| *** hwoarang has quit IRC | 02:14 | |
| *** hwoarang has joined #openstack-infra | 02:16 | |
| *** markvoelker has joined #openstack-infra | 02:19 | |
| *** wolverineav has quit IRC | 02:22 | |
| *** hongbin has joined #openstack-infra | 02:26 | |
| *** wolverineav has joined #openstack-infra | 02:27 | |
| *** sdake has joined #openstack-infra | 02:30 | |
| *** rkukura has quit IRC | 02:35 | |
| *** bhavikdbavishi has quit IRC | 02:39 | |
| *** wolverineav has quit IRC | 02:40 | |
| *** sdake has quit IRC | 02:42 | |
| *** psachin has joined #openstack-infra | 02:42 | |
| *** markvoelker has quit IRC | 02:52 | |
| *** ykarel has joined #openstack-infra | 02:54 | |
| *** yamamoto has joined #openstack-infra | 03:00 | |
| *** rlandy|bbl is now known as rlandy | 03:06 | |
| *** hwoarang has quit IRC | 03:12 | |
| *** anteaya has quit IRC | 03:15 | |
| *** hwoarang has joined #openstack-infra | 03:16 | |
| *** sdake has joined #openstack-infra | 03:20 | |
| *** sdake has quit IRC | 03:23 | |
| *** sdake_ has joined #openstack-infra | 03:24 | |
| *** bhavikdbavishi has joined #openstack-infra | 03:24 | |
| *** bhavikdbavishi has quit IRC | 03:28 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] Add unmanaged domains, add acme.opendev.org https://review.openstack.org/641155 | 03:29 |
| *** bhavikdbavishi has joined #openstack-infra | 03:42 | |
| *** wolverineav has joined #openstack-infra | 03:43 | |
| *** wolverineav has quit IRC | 03:44 | |
| *** janki has joined #openstack-infra | 03:49 | |
| *** markvoelker has joined #openstack-infra | 03:49 | |
| *** janki has quit IRC | 03:50 | |
| *** janki has joined #openstack-infra | 03:50 | |
| *** roman_g has quit IRC | 03:57 | |
| *** sdake_ has quit IRC | 03:58 | |
| *** wolverineav has joined #openstack-infra | 03:58 | |
| *** hwoarang has quit IRC | 04:12 | |
| *** rlandy has quit IRC | 04:12 | |
| *** gregoryo has joined #openstack-infra | 04:14 | |
| *** ramishra has joined #openstack-infra | 04:14 | |
| *** hwoarang has joined #openstack-infra | 04:18 | |
| *** markvoelker has quit IRC | 04:22 | |
| *** armax has quit IRC | 04:32 | |
| *** sdake has joined #openstack-infra | 04:32 | |
| *** sdake has quit IRC | 04:32 | |
| *** hongbin has quit IRC | 04:42 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] Add unmanaged domains, add acme.opendev.org https://review.openstack.org/641155 | 04:46 |
| openstackgerrit | Doug Wiegley proposed openstack/gertty master: Enable review keys in diffs, and close change on review https://review.openstack.org/641197 | 04:55 |
| *** raukadah is now known as chandankumar | 04:56 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] Add unmanaged domains, add acme.opendev.org https://review.openstack.org/641155 | 05:02 |
| *** dave-mccowan has quit IRC | 05:03 | |
| *** sdake has joined #openstack-infra | 05:04 | |
| *** sdake has quit IRC | 05:04 | |
| *** sdake has joined #openstack-infra | 05:05 | |
| *** sdake has quit IRC | 05:05 | |
| *** ianychoi_ has joined #openstack-infra | 05:24 | |
| *** ianychoi has quit IRC | 05:28 | |
| *** yboaron has joined #openstack-infra | 05:29 | |
| *** sdake has joined #openstack-infra | 05:30 | |
| *** sdake has quit IRC | 05:30 | |
| *** sdake has joined #openstack-infra | 05:37 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] Add unmanaged domains, add acme.opendev.org https://review.openstack.org/641155 | 05:39 |
| *** wolverineav has quit IRC | 05:40 | |
| *** kjackal has joined #openstack-infra | 05:52 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] Add unmanaged domains, add acme.opendev.org https://review.openstack.org/641155 | 06:00 |
| *** udesale has joined #openstack-infra | 06:07 | |
| *** wolverineav has joined #openstack-infra | 06:14 | |
| *** wolverineav has quit IRC | 06:18 | |
| *** wolverineav has joined #openstack-infra | 06:18 | |
| *** rkukura has joined #openstack-infra | 06:21 | |
| *** hwoarang has quit IRC | 06:26 | |
| *** hwoarang has joined #openstack-infra | 06:28 | |
| *** e0ne has joined #openstack-infra | 06:31 | |
| *** wolverineav has quit IRC | 06:32 | |
| *** markvoelker has joined #openstack-infra | 06:49 | |
| *** quiquell|off is now known as quiquell | 06:53 | |
| *** pgaxatte has joined #openstack-infra | 07:21 | |
| *** markvoelker has quit IRC | 07:21 | |
| *** rascasoft has quit IRC | 07:36 | |
| *** rascasoft has joined #openstack-infra | 07:37 | |
| *** ccamacho has joined #openstack-infra | 07:41 | |
| *** e0ne has quit IRC | 07:47 | |
| *** quiquell is now known as quiquell|brb | 07:50 | |
| *** e0ne has joined #openstack-infra | 07:54 | |
| *** gregoryo has quit IRC | 07:57 | |
| *** cmoura has quit IRC | 07:59 | |
| *** cmoura has joined #openstack-infra | 08:00 | |
| *** rpittau|afk is now known as rpittau | 08:02 | |
| *** dtantsur|afk is now known as dtantsur | 08:03 | |
| *** dtantsur is now known as dtantsur|mtg | 08:03 | |
| cmurphy | clarkb: i think we had that warning about missing module deps pre puppet 4, i was never concerned about it since puppet-apply and beaker were always passing | 08:03 |
| *** wolverineav has joined #openstack-infra | 08:03 | |
| *** ginopc has joined #openstack-infra | 08:04 | |
| *** kopecmartin|off is now known as kopecmartin | 08:05 | |
| *** wolverineav has quit IRC | 08:08 | |
| *** tkajinam has quit IRC | 08:09 | |
| *** wolverineav has joined #openstack-infra | 08:10 | |
| *** e0ne has quit IRC | 08:16 | |
| *** wolverineav has quit IRC | 08:17 | |
| *** wolverineav has joined #openstack-infra | 08:18 | |
| *** markvoelker has joined #openstack-infra | 08:19 | |
| *** helenafm has joined #openstack-infra | 08:27 | |
| *** quiquell|brb is now known as quiquell | 08:28 | |
| *** eumel8 has joined #openstack-infra | 08:29 | |
| *** tosky has joined #openstack-infra | 08:29 | |
| *** pcaruana has joined #openstack-infra | 08:29 | |
| *** yboaron_ has joined #openstack-infra | 08:32 | |
| *** yboaron has quit IRC | 08:34 | |
| *** aojea has joined #openstack-infra | 08:49 | |
| *** xek has joined #openstack-infra | 08:49 | |
| *** markvoelker has quit IRC | 08:52 | |
| *** jpena|off is now known as jpena | 08:55 | |
| *** dpawlik has joined #openstack-infra | 08:57 | |
| *** jpich has joined #openstack-infra | 08:58 | |
| *** gfidente has joined #openstack-infra | 09:00 | |
| *** yboaron_ has quit IRC | 09:06 | |
| *** yboaron_ has joined #openstack-infra | 09:07 | |
| *** roman_g has joined #openstack-infra | 09:07 | |
| *** dpawlik has quit IRC | 09:17 | |
| frickler | #status log manually removed /var/log/exim4/paniclog on new g*.opendev.org servers after crosschecking the contents to reduce spam | 09:18 |
| openstackstatus | frickler: finished logging | 09:18 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] Add unmanaged domains, add acme.opendev.org https://review.openstack.org/641155 | 09:18 |
| frickler | infra-root: what is the status of zp01.opendev.org? it's trying to send mails, which bounce due to lacking A record | 09:19 |
| openstackgerrit | Ian Wienand proposed openstack-infra/zone-opendev.org master: Add acme.opendev.org https://review.openstack.org/641154 | 09:19 |
| *** wolverineav has quit IRC | 09:19 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Implement a Runc driver https://review.openstack.org/535556 | 09:22 |
| *** sshnaidm|afk has quit IRC | 09:26 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] Add unmanaged domains, add acme.opendev.org https://review.openstack.org/641155 | 09:36 |
| *** ykarel is now known as ykarel|lunch | 09:36 | |
| *** derekh has joined #openstack-infra | 09:37 | |
| *** aojeagarcia has joined #openstack-infra | 09:42 | |
| *** aojea has quit IRC | 09:46 | |
| *** markvoelker has joined #openstack-infra | 09:49 | |
| *** luizbag has joined #openstack-infra | 10:06 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Change Heat meeting time https://review.openstack.org/641062 | 10:10 |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Update Airship meeting time, change chair https://review.openstack.org/640359 | 10:10 |
| *** markvoelker has quit IRC | 10:22 | |
| *** ykarel|lunch has quit IRC | 10:27 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: master-nameserver: Add unmanaged domains; add acme.opendev.org https://review.openstack.org/641155 | 10:28 |
| *** ykarel|lunch has joined #openstack-infra | 10:28 | |
| *** yamamoto has quit IRC | 10:34 | |
| *** e0ne has joined #openstack-infra | 10:35 | |
| *** ramishra has quit IRC | 10:40 | |
| ianw | fungi / corvus: appreciate reviews on 641154, 641155 and 641168 for the initial letsencrypt work to get acme.opendev.org available | 10:44 |
| *** ykarel|lunch is now known as ykarel | 10:45 | |
| *** electrofelix has joined #openstack-infra | 10:49 | |
| *** wolverineav has joined #openstack-infra | 10:53 | |
| *** sshnaidm|afk has joined #openstack-infra | 10:54 | |
| *** iurygregory is now known as iurygregory|lunc | 10:54 | |
| *** udesale has quit IRC | 10:57 | |
| *** sshnaidm|afk has quit IRC | 10:57 | |
| *** wolverineav has quit IRC | 10:57 | |
| *** xek has quit IRC | 10:58 | |
| *** xek_ has joined #openstack-infra | 10:58 | |
| *** ramishra has joined #openstack-infra | 10:59 | |
| *** FlorianFa has quit IRC | 11:01 | |
| *** FlorianFa has joined #openstack-infra | 11:02 | |
| *** helenafm_ has joined #openstack-infra | 11:04 | |
| *** pcaruana has quit IRC | 11:04 | |
| *** raissa has joined #openstack-infra | 11:05 | |
| *** helenafm has quit IRC | 11:06 | |
| *** panda|ruck|off is now known as panda|ruck|flu | 11:10 | |
| *** yamamoto has joined #openstack-infra | 11:10 | |
| *** bhavikdbavishi has quit IRC | 11:16 | |
| *** yamamoto has quit IRC | 11:18 | |
| *** markvoelker has joined #openstack-infra | 11:19 | |
| *** ianychoi_ is now known as ianychoi | 11:20 | |
| *** ginopc has quit IRC | 11:25 | |
| *** ginopc has joined #openstack-infra | 11:26 | |
| *** yamamoto has joined #openstack-infra | 11:27 | |
| frickler | infra-root: forget to mention in the meeting yesterday: system-config-run-base-ansible-devel is failing with some centos7+sudo/become issue, would be great if someone had time to look into that in more detail http://logs.openstack.org/55/641155/11/check/system-config-run-base-ansible-devel/78f9bb4/job-output.txt.gz#_2019-03-06_10_46_24_126080 | 11:28 |
| *** pcaruana has joined #openstack-infra | 11:32 | |
| *** ldnunes has joined #openstack-infra | 11:36 | |
| *** ginopc has quit IRC | 11:40 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: Proposed spec: tenant-scoped admin web API https://review.openstack.org/562321 | 11:45 |
| *** dave-mccowan has joined #openstack-infra | 11:46 | |
| *** ginopc has joined #openstack-infra | 11:49 | |
| *** markvoelker has quit IRC | 11:52 | |
| *** xek_ has quit IRC | 11:54 | |
| *** sshnaidm|afk has joined #openstack-infra | 12:01 | |
| *** iurygregory|lunc is now known as iurygregory | 12:02 | |
| *** ginux has joined #openstack-infra | 12:03 | |
| *** ginopc has quit IRC | 12:05 | |
| *** ginux is now known as ginopc | 12:05 | |
| *** bhavikdbavishi has joined #openstack-infra | 12:19 | |
| *** jpena is now known as jpena|lunch | 12:31 | |
| *** kgiusti has joined #openstack-infra | 12:35 | |
| *** udesale has joined #openstack-infra | 12:38 | |
| *** kgiusti has quit IRC | 12:38 | |
| *** markvoelker has joined #openstack-infra | 12:49 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Updates for CFP https://review.openstack.org/641347 | 12:57 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Updates for CFP https://review.openstack.org/641347 | 12:59 |
| *** TheJulia_sick is now known as TheJulia | 13:05 | |
| *** pgaxatte has quit IRC | 13:05 | |
| *** pgaxatte has joined #openstack-infra | 13:07 | |
| *** rlandy has joined #openstack-infra | 13:21 | |
| *** markvoelker has quit IRC | 13:22 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Update API code to work with Presentation Moderators collection (+N) https://review.openstack.org/641091 | 13:25 |
| *** sshnaidm|afk is now known as sshnaidm | 13:32 | |
| *** jpena|lunch is now known as jpena | 13:34 | |
| *** mriedem has joined #openstack-infra | 13:34 | |
| *** bhavikdbavishi has quit IRC | 13:36 | |
| *** quiquell is now known as quiquell|lunch | 13:42 | |
| *** gfidente has quit IRC | 13:44 | |
| *** jamesmcarthur has joined #openstack-infra | 13:45 | |
| *** yamamoto has quit IRC | 13:47 | |
| *** yamamoto has joined #openstack-infra | 13:48 | |
| *** pcaruana has quit IRC | 13:51 | |
| *** eharney has joined #openstack-infra | 13:51 | |
| *** sdake has quit IRC | 13:54 | |
| *** quiquell|lunch is now known as quiquell | 13:55 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] web: add tenant and project scoped, JWT-protected actions https://review.openstack.org/576907 | 13:55 |
| openstackgerrit | jacky06 proposed openstack/os-performance-tools master: Update hacking version https://review.openstack.org/641363 | 13:58 |
| *** sdake has joined #openstack-infra | 14:00 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Allow operator to generate auth tokens through the CLI https://review.openstack.org/636197 | 14:01 |
| *** pcaruana has joined #openstack-infra | 14:01 | |
| *** rfolco|pto is now known as rfolco|ruck | 14:02 | |
| *** wolverineav has joined #openstack-infra | 14:08 | |
| *** FlorianFa has quit IRC | 14:09 | |
| *** wolverineav has quit IRC | 14:12 | |
| *** sdake has quit IRC | 14:17 | |
| *** jamesmcarthur has quit IRC | 14:18 | |
| *** markvoelker has joined #openstack-infra | 14:19 | |
| *** rascasoft has quit IRC | 14:20 | |
| openstackgerrit | jacky06 proposed openstack/os-testr master: Update hacking version https://review.openstack.org/641384 | 14:22 |
| *** sdake has joined #openstack-infra | 14:22 | |
| quiquell | Hi all | 14:24 |
| quiquell | Do nested virtualization works at zuul jobs ? | 14:24 |
| *** sdake has quit IRC | 14:24 | |
| *** jcoufal has joined #openstack-infra | 14:27 | |
| mordred | quiquell: not really in the openstack zuul cloud providers - as in, it's not something you can/should count on being available right now. on some of our providers nested virt triggers kernel panics, so we have it configured off | 14:28 |
| mordred | quiquell: there are folks, like mnaser, who are interested in being able to provide working and reliable nested virt | 14:29 |
| mnaser | yes, and it was working, until a few days ago :( | 14:29 |
| mordred | (it works well at vexxhost already - but we need it working more consistently across multiple providers before it's a thing we can enable in teh gate) | 14:29 |
| mordred | oh - yeah - until it stops working :) | 14:30 |
| mnaser | unfortunately i haven't had the most of time to dig into it | 14:30 |
| mnaser | i bet kata hasn't been hit because they don't update their kernels all the time | 14:30 |
| quiquell | so it works when it works :-) | 14:30 |
| quiquell | ok, thanks | 14:30 |
| quiquell | sshnaidm: ^ | 14:30 |
| *** jamesmcarthur has joined #openstack-infra | 14:35 | |
| *** jamesmcarthur has quit IRC | 14:36 | |
| *** jamesmcarthur_ has joined #openstack-infra | 14:36 | |
| quiquell | mordred so vexxhost is consistent with nested ? | 14:37 |
| *** sdake has joined #openstack-infra | 14:39 | |
| *** kgiusti has joined #openstack-infra | 14:39 | |
| mordred | quiquell: well - it was, until a couple of days ago | 14:40 |
| quiquell | ack | 14:41 |
| mordred | quiquell: something broke - we think a kernel update | 14:41 |
| quiquell | sshnaidm: ^ maybe vexxhost has issues too :-/ | 14:41 |
| *** rascasoft has joined #openstack-infra | 14:43 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Allow operator to generate auth tokens through the CLI https://review.openstack.org/636197 | 14:43 |
| *** anteaya has joined #openstack-infra | 14:46 | |
| *** gfidente has joined #openstack-infra | 14:47 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] web: add tenant and project scoped, JWT-protected actions https://review.openstack.org/576907 | 14:47 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Allow operator to generate auth tokens through the CLI https://review.openstack.org/636197 | 14:47 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Zuul CLI: allow access via REST https://review.openstack.org/636315 | 14:49 |
| *** rascasoft has quit IRC | 14:50 | |
| *** rascasoft has joined #openstack-infra | 14:51 | |
| *** markvoelker has quit IRC | 14:52 | |
| *** sdake has quit IRC | 15:00 | |
| *** sthussey has joined #openstack-infra | 15:01 | |
| *** pgaxatte has quit IRC | 15:02 | |
| *** chandankumar is now known as chkumar|pto | 15:03 | |
| *** pgaxatte has joined #openstack-infra | 15:04 | |
| *** sdake has joined #openstack-infra | 15:06 | |
| *** agopi has joined #openstack-infra | 15:14 | |
| *** ekultails has joined #openstack-infra | 15:16 | |
| *** agopi has quit IRC | 15:18 | |
| *** quiquell is now known as quiquell|off | 15:21 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] web: add tenant and project scoped, JWT-protected actions https://review.openstack.org/576907 | 15:26 |
| *** xek_ has joined #openstack-infra | 15:30 | |
| *** xek__ has joined #openstack-infra | 15:32 | |
| *** xek_ has quit IRC | 15:35 | |
| *** udesale has quit IRC | 15:37 | |
| *** Sundar has joined #openstack-infra | 15:38 | |
| Sundar | Hi, I have 2 email addresses registered -- my Intel email and gmail. My submission for PTL candidacy hit an issue because it could not locate the Intel email address, though it is registered and is the preferred email. Please LMK what is needed. | 15:40 |
| Sundar | ^ Logs here: http://logs.openstack.org/07/641407/1/check/openstack-tox-docs/116a531/job-output.txt.gz#_2019-03-06_15_05_02_818405 | 15:40 |
| fungi | Sundar: you have it added to your openstack.org foundation member profile? | 15:41 |
| Sundar | fungi: Yes | 15:41 |
| Sundar | I can see it in Profile, Preferences, etc. | 15:41 |
| Sundar | When i attempted o register it now, it says that is already registered. | 15:41 |
| fungi | Sundar: i think you're talking about gerrit and not your osf membership | 15:42 |
| fungi | Sundar: see https://docs.openstack.org/contributors/common/accounts.html#setup-your-openstack-foundation-account | 15:42 |
| Sundar | Oh wait, openstack.org foundation? Is that a separate step from registering in review.openstack.org? | 15:42 |
| fungi | yes, completely separate | 15:42 |
| fungi | all ptls must be individual members of the openstack foundation in good standing | 15:43 |
| Sundar | fungi: Thanks :) Will follow up. | 15:43 |
| *** lpetrut has joined #openstack-infra | 15:50 | |
| *** markvoelker has joined #openstack-infra | 15:50 | |
| openstackgerrit | Jan Gutter proposed openstack/diskimage-builder master: Clean the BSP partition for the EFI layout https://review.openstack.org/641426 | 15:50 |
| *** dtantsur|mtg is now known as dtantsur|afk | 15:50 | |
| *** pcaruana has quit IRC | 15:53 | |
| clarkb | cmurphy: gotcha, the bit that scared me was puppet saying those modules won't be available. But I'm guessing that is because it thinks the module isn't available at all when it actually is | 15:53 |
| clarkb | in any case cleaning that up would be nice and my changes should put a big dent in that (particularly the vcsrepo stuff) | 15:53 |
| cmurphy | agreed | 15:53 |
| cmurphy | +1'd/+2'd | 15:53 |
| *** janki has quit IRC | 15:55 | |
| clarkb | infra-root can I get reviews on https://review.openstack.org/#/q/owner:cboylan+topic:puppet-4+status:open to help clean up some puppet-4 related things? | 15:55 |
| *** armax has joined #openstack-infra | 15:56 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Allow operator to generate auth tokens through the CLI https://review.openstack.org/636197 | 15:57 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Zuul CLI: allow access via REST https://review.openstack.org/636315 | 15:57 |
| *** raissa has quit IRC | 15:59 | |
| mordred | infra-root: the tc.log issue with mariadb that requires deleting the tc.log on restart sometimes has been fixed in the 10.4 branch of mariadb upstream so should be included in the next docker image | 16:00 |
| *** luizbag has quit IRC | 16:00 | |
| *** luizbag has joined #openstack-infra | 16:01 | |
| clarkb | mordred: cool. Looks like we still need to update the default branches? I'm guessing we need to run the fixup playbook for that/ | 16:01 |
| clarkb | mordred: do we want to test the ansible POST on a single repo to start? | 16:01 |
| *** yboaron_ has quit IRC | 16:04 | |
| Shrews | mordred: neat | 16:06 |
| *** pcaruana has joined #openstack-infra | 16:06 | |
| mordred | clarkb: yes - probably so. I've got a phone call in 25 minutes so I don't want to dive in to working on that just yet - but can work on it once my call is over | 16:06 |
| mordred | althoughj I will not be upset if someone else decides they want to work on it in the meantime | 16:07 |
| clarkb | mordred: I too am in a meeting right now so I'm unlikley to get to it soon | 16:07 |
| *** sdake has quit IRC | 16:09 | |
| *** ricolin has quit IRC | 16:11 | |
| mordred | kk | 16:13 |
| *** sdake has joined #openstack-infra | 16:13 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Add Authorization Rules configuration https://review.openstack.org/639855 | 16:14 |
| *** roman_g has quit IRC | 16:14 | |
| Sundar | fungi: I am an OpenStack Foundation member with my gmail address. If I just add my corporate address to the same profile, is that enough? Or should I separately register the corporate address? | 16:14 |
| *** roman_g has joined #openstack-infra | 16:14 | |
| *** markvoelker has quit IRC | 16:22 | |
| *** ccamacho has quit IRC | 16:27 | |
| fungi | Sundar: whatever address you want to use in connection with your potential leadership role as a ptl can be added to an available field in your foundation member profile | 16:34 |
| fungi | it doesn't have to be the primary address in your foundation member profile, it can be in any of the three available e-mail address fields | 16:35 |
| fungi | but at least one of the addresses in your member profile also needs to be registered on your gerrit contact settings too (that's how we confirm you are a code contributor to the project) | 16:36 |
| fungi | and so the address you use for your ptl platform submission needs to be registered in your gerrit contact settings | 16:36 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Add Authorization Rules configuration https://review.openstack.org/639855 | 16:39 |
| openstackgerrit | Jan Gutter proposed openstack/diskimage-builder master: [DNM] Clean the BSP partition for the EFI layout https://review.openstack.org/641426 | 16:43 |
| *** sdake has quit IRC | 16:48 | |
| *** sdake has joined #openstack-infra | 16:49 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: WIP allow soft job dependencies https://review.openstack.org/641439 | 16:49 |
| Sundar | fungi: Thanks. Just one more question. Foundation web page says there is one more account with same first/last names as me, with email s*************r@gmail.com. But that is not my email, and it could be somebody else's. When I click on 'This is not my account', it says it will delete that -- but somebody else may get affected then. | 16:50 |
| *** pgaxatte has quit IRC | 16:51 | |
| clarkb | Sundar: that is probably something we want to bring up with jamesmcarthur_ | 16:51 |
| clarkb | Sundar: as you say it is entirely possible this isn't an error | 16:51 |
| Sundar | clarkb: Thanks, will do. | 16:52 |
| Sundar | jamesmcarthur_: Please take a look at my query above. | 16:53 |
| jamesmcarthur_ | Sundar: It should just allow you to dismiss the message. You won't be able to delete the other account w/o a login. | 16:53 |
| Sundar | jamesmcarthur_: OK, I'll click on 'This is not my account' and see what happens. | 16:54 |
| *** pcaruana has quit IRC | 16:55 | |
| *** sdake has quit IRC | 16:56 | |
| *** panda|ruck|flu is now known as panda|ruck|off | 16:57 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Test gitea project creation playbook https://review.openstack.org/641158 | 16:57 |
| *** ccamacho has joined #openstack-infra | 17:02 | |
| *** eharney has quit IRC | 17:06 | |
| *** gyee has joined #openstack-infra | 17:06 | |
| *** eharney has joined #openstack-infra | 17:13 | |
| *** ramishra has quit IRC | 17:14 | |
| *** lpetrut has quit IRC | 17:14 | |
| *** ccamacho has quit IRC | 17:15 | |
| *** yamamoto has quit IRC | 17:15 | |
| clarkb | ianw: I think I'll take you up on your offer of afs upgrade help if you want to walk through an upgrade of afs01.ord today via shared screen session? | 17:16 |
| clarkb | hrm one thing I realize is I don't know how do-release-upgrade is going to handle puppet installs. But we should be able to fix that post install since puppet/ansible won't be running anyway | 17:16 |
| *** lpetrut has joined #openstack-infra | 17:17 | |
| clarkb | ianw: if today is bad I can do tomorrow as well | 17:18 |
| *** ccamacho has joined #openstack-infra | 17:19 | |
| *** markvoelker has joined #openstack-infra | 17:19 | |
| *** ykarel is now known as ykarel|away | 17:20 | |
| fungi | does ubuntu provide release notes explaining what do-release-upgrade is going to do aside from an apt full-upgrade command? | 17:21 |
| *** rlandy is now known as rlandy|brb | 17:21 | |
| fungi | i'm too used to performing in-place upgrades with debian, where you just read the release notes and then adjust your sources.list and use the package manager, it doesn't provide any separate tool | 17:22 |
| clarkb | fungi: not that I am aware of | 17:23 |
| fungi | i've gotten the impression in the past that do-release-upgrade is basically just automating any arbitrary manual things which would normally be spelled out in the release notes in debian's terms | 17:24 |
| clarkb | if we want ot be really cautious I can snapshot afs01.ord and do-release-upgrade on the snapshot first | 17:24 |
| clarkb | not sure how I need to disconnect it from the afs cluster for that though | 17:24 |
| clarkb | I'm guessing I'll mostly be fine since all that is managed by the db servers and the new server won't be in the db | 17:24 |
| clarkb | corvus: ^ any concern with booting a snapshot of afs01.ord and causing problems for afs? | 17:28 |
| *** yamamoto has joined #openstack-infra | 17:28 | |
| corvus | clarkb: yes -- i'd have to refresh my memory of how fileservers talk to dbservers. it may well have the requisite credentials already installed. | 17:29 |
| clarkb | corvus: unrelated https://review.openstack.org/#/c/641158/5 may have found an ansible-lint bug? | 17:32 |
| clarkb | (I left details on the cahnge) | 17:32 |
| *** lpetrut has quit IRC | 17:32 | |
| *** kopecmartin is now known as kopecmartin|off | 17:33 | |
| *** yamamoto has quit IRC | 17:34 | |
| *** e0ne has quit IRC | 17:34 | |
| corvus | clarkb: probably if you shut down afs and removed /etc/openafs/server before making the snapshot it'd be ok? | 17:34 |
| *** helenafm_ has quit IRC | 17:34 | |
| clarkb | corvus: ok | 17:34 |
| pabelanger | clarkb: left comment also | 17:35 |
| corvus | clarkb: (but put that directory back before bringing it back online) | 17:35 |
| clarkb | corvus: ya | 17:36 |
| corvus | you know what? i'd really rather not spend my day guessing which of 10 perfectly valid ways of running a command ansible-lint wants me to type. | 17:37 |
| *** jpich has quit IRC | 17:37 | |
| *** rkukura has quit IRC | 17:38 | |
| *** rlandy|brb is now known as rlandy | 17:38 | |
| mordred | clarkb: I'm going to test the branch setting now | 17:39 |
| corvus | clarkb, pabelanger: can the two of you please give me a recommendation on how to proceed? | 17:39 |
| clarkb | mordred: I think corvus is doing it via https://review.openstack.org/#/c/641158/5 and it seems to work there | 17:39 |
| corvus | clarkb: nope | 17:40 |
| corvus | clarkb: that's the baseline -- if that change works, you can reparent mordred's change to mine and it will be tested | 17:40 |
| clarkb | corvus: gotcha | 17:40 |
| clarkb | well corvus' chagne does work other than a sad linter | 17:40 |
| clarkb | corvus: re the linter I don't know what the best course is there. I find myself annoyed by ansible-lint often myself | 17:41 |
| mordred | oh - duh. /me will wait for that change | 17:41 |
| clarkb | corvus: we could no lint the task, disable that rule from being checked, or stop linting entirely? The problem with not linting at all is it does catch real issues it just also catches these non issues with obtuse errors | 17:42 |
| corvus | my next patchset is either going to disable that rule or the linter entirely because ansible-lint has never prevented an error, only annoyed me. so someone who cares about ansible-lint is welcome to propose an alternative. | 17:42 |
| corvus | clarkb: what real issue has ansible-lint caught? | 17:42 |
| clarkb | corvus: yaml format errors iirc | 17:42 |
| clarkb | (there are other ways of catchign those fwiw) | 17:42 |
| corvus | so do you disable this with -x ANSIBLE0304 ? | 17:43 |
| clarkb | corvus: yes that appears to be the case | 17:44 |
| *** wolverineav has joined #openstack-infra | 17:44 | |
| clarkb | I checked that 304 is the environment error number to make sure I am reading that error line properly and it is | 17:44 |
| clarkb | https://docs.ansible.com/ansible-lint/rules/default_rules.html is the table of errors | 17:45 |
| corvus | mordred: no need to wait. please proceed with fixing default branch as quickly as possible. my next task is waiting on that. | 17:45 |
| mordred | corvus: ok! I will proceed | 17:45 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Test gitea project creation playbook https://review.openstack.org/641158 | 17:45 |
| corvus | there's the test disabled. we're up to 9 now. | 17:46 |
| clarkb | https://github.com/ansible/ansible-lint/commit/80ed68746432cf9484a5cb8bb3d912d10aa374b3#diff-2d074af6d234f70358049a66b660c721 they have fixed that bug at least | 17:46 |
| pabelanger | I want to say it might be -x 304, because I have no idea why | 17:46 |
| pabelanger | new rules don't seem to use ANSIBLE prefix | 17:47 |
| corvus | mordred: if https://review.openstack.org/641158 fails again, can you take it over? i only wrote it to test your change anyway. | 17:48 |
| mordred | corvus: yup | 17:48 |
| pabelanger | but ya, ansible-lint has started be become very opinionated in playbook design. I can see us disabling it moving forward | 17:48 |
| *** wolverineav has quit IRC | 17:49 | |
| clarkb | pabelanger: for me the major fail there is lack of info on how to fix the error. That said this appears to have been a bug they fixed of course we can't get to ansible-lint 4.x without a ton of changes anyway so bugfix not super valuable right now | 17:49 |
| pabelanger | clarkb: agree | 17:50 |
| *** jamesmcarthur_ has quit IRC | 17:50 | |
| *** jamesmcarthur has joined #openstack-infra | 17:50 | |
| *** jamesmcarthur has quit IRC | 17:50 | |
| *** jamesmcarthur has joined #openstack-infra | 17:51 | |
| pabelanger | clarkb: the roadmap for ansible-lint is very much tied to galaxy, so if we don't plan on uploading to galaxy (and want a good score), we likely can consider other yaml lint tools | 17:51 |
| *** markvoelker has quit IRC | 17:52 | |
| mordred | clarkb: the 'set default branch' task seems to work as long as there is content in the repo - I did just get a 404 for https://opendev.org/openstack-attic/compute-api - but there is no content in that repo in gitea right now, so it matches | 17:54 |
| *** wolverineav has joined #openstack-infra | 17:54 | |
| mordred | clarkb: I have also seen the task succeed on repos that do exist- although the one I happened to catch as it scrolled by only had a master branch | 17:54 |
| mordred | clarkb: I think that means that the set-default-branch option isn't going to work and we're going to need to do the create-empty-project option | 17:55 |
| clarkb | mordred: ok and in that case pushing an ephemeral master branch should be sufficient to make the default branch master (however we shouldn't do that in the fixup case if the project already has content? so maybe we need a combo of both?) | 17:56 |
| mordred | clarkb: ok - it did fix https://opendev.org/openstack-attic/akanda-appliance-builder | 17:56 |
| mordred | clarkb: yeah - to do the fixup I think the easiest thing to do is actually likely just do a one-off sql query - or else make sure to replicate to compute-api and any other repo that doesn't have content yet | 17:57 |
| *** mattw4 has joined #openstack-infra | 17:57 | |
| corvus | i wonder why it doesn't have content? replication finished yesterday | 17:58 |
| clarkb | and we aren't excluding the attic projects from our replication config | 17:59 |
| corvus | (it really didn't take very long) | 17:59 |
| mordred | http://git.openstack.org/cgit/openstack-attic/compute-api | 17:59 |
| clarkb | they are excluding from replicating to github but not gitea | 17:59 |
| mordred | is empty | 17:59 |
| corvus | that project doesn't exist in gerrit? | 18:00 |
| mordred | actually - openstack-attic isn't even on git.o.o | 18:00 |
| *** ccamacho has quit IRC | 18:00 | |
| mordred | no -there is no compute-api in gerrit | 18:00 |
| corvus | https://review.openstack.org/#/admin/projects/?filter=openstack-attic | 18:00 |
| corvus | but there are other openstack-attic projects there | 18:01 |
| *** wolverineav has quit IRC | 18:01 | |
| corvus | it's "hidden" in gerrit | 18:02 |
| corvus | if you log in as an admin, you'll see it here: https://review.openstack.org/#/admin/projects/openstack-attic/compute-api | 18:02 |
| *** derekh has quit IRC | 18:03 | |
| *** rkukura has joined #openstack-infra | 18:04 | |
| mordred | corvus: hrm. so maybe we should unhide it in gerrit? | 18:04 |
| mordred | corvus: since we don't hide the others | 18:04 |
| corvus | i'm trying to dig into the config history, but that's how i'm leaning | 18:04 |
| clarkb | would certainly reduce confusion | 18:05 |
| *** psachin has quit IRC | 18:05 | |
| fungi | yeah, i bet that was a very early iteration of our project retirement process | 18:05 |
| mordred | if we do that - we should be able to trigger a forced replication to get it populated in gitea | 18:05 |
| fungi | right, you can ask the replication plugin to just replicate a specific repo by name | 18:06 |
| mordred | yeah | 18:06 |
| clarkb | thinking out loud here we never have empty git repos at the end of the day. We either pull in existing content or make a .gitreview commit | 18:06 |
| *** wolverineav has joined #openstack-infra | 18:06 | |
| *** wolverineav has quit IRC | 18:06 | |
| clarkb | but we don't create the project in gerrit until after we create it in gitea | 18:06 |
| *** jtomasek has quit IRC | 18:06 | |
| *** wolverineav has joined #openstack-infra | 18:06 | |
| clarkb | so we may need to create in gitea, create in gerrit, then set default branch? | 18:06 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Validate ansible installations on startup https://review.openstack.org/637418 | 18:07 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Make ansible version configurable https://review.openstack.org/637422 | 18:07 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Install ansible during executor startup if needed https://review.openstack.org/640644 | 18:07 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Support ansible 2.6 https://review.openstack.org/631931 | 18:07 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: WIP: Support ansible 2.7 https://review.openstack.org/631932 | 18:07 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Switch default ansible version to 2.7 https://review.openstack.org/637424 | 18:07 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: DNM: zuul-stream-functional debugging https://review.openstack.org/640648 | 18:07 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: DNM: Test concurrent tox remote https://review.openstack.org/640654 | 18:07 |
| openstackgerrit | Doug Wiegley proposed openstack/gertty master: Enable review keys in diffs, and close change on review https://review.openstack.org/641197 | 18:08 |
| *** yamamoto has joined #openstack-infra | 18:09 | |
| corvus | mordred: i dug up the history. it looks like there were a bunch of changes made by you through the web ui starting around Sat Oct 17 19:31:05 2015 +0000. but there's no additional info. | 18:09 |
| mordred | corvus: yay for me | 18:09 |
| corvus | mordred: so, unless you remember otherwise, we can probably assume it was an accident -- selected the wrong item in the drop down or something | 18:10 |
| mordred | clarkb: oh - I see what you're saying - do the gitea set default branch action after... wait no - that won't work | 18:10 |
| mordred | corvus: yeah. let's assume that | 18:10 |
| mordred | clarkb: creating the project in gerrit does not equal the project getting replicated to gitea | 18:10 |
| clarkb | mordred: it should | 18:11 |
| corvus | mordred: happily, since then, you've created a system that prevents this from happening. we just didn't know we had already demonstrated its necessity. :) | 18:11 |
| mordred | clarkb: so we still might attempt to run the set-default-branch before the project has been replicated | 18:11 |
| clarkb | mordred: however there may be a delay | 18:11 |
| clarkb | ya | 18:11 |
| mordred | clarkb: right. I mean the set-default-branch would need to wait for content to exist | 18:11 |
| *** ginopc has quit IRC | 18:12 | |
| corvus | clarkb, mordred: i switched it to read-only in the web ui | 18:12 |
| corvus | we should probably update projects.yaml, but at least it matches its siblings now | 18:13 |
| mordred | corvus: it's gerrit replication start openstack-attic/compute-api right? | 18:13 |
| corvus | mordred: i think you drop 'gerrit' now | 18:14 |
| mordred | kk | 18:14 |
| clarkb | ya the plugin has its own command namespace iirc | 18:14 |
| * mordred kicks replication for that | 18:14 | |
| *** yamamoto has quit IRC | 18:14 | |
| clarkb | mordred: maybe the thing to do is if project was just created in gitea then push master branch else (if fixup) set branch via settings url | 18:14 |
| mordred | clarkb: yeah | 18:16 |
| mordred | or, rather - have the creation path create empty repo in gitea - but have the fixup playbook do the settings url | 18:16 |
| * mordred is running the fixup playbook now | 18:17 | |
| mordred | based on previous attempts - I expect it to take what - 1.5 hours? | 18:17 |
| *** jpena is now known as jpena|off | 18:19 | |
| mordred | clarkb: let me push up an amended patch | 18:19 |
| *** luizbag_ has joined #openstack-infra | 18:21 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Revert "Revert "Set default branch for repo"" https://review.openstack.org/641108 | 18:22 |
| mordred | clarkb: ^^ that should do the logic I think we're talking about | 18:22 |
| mordred | it's going to create repos with default content in them | 18:22 |
| mordred | but then leave in teh 'set default branch' code - which will normally not do anything on the creation case, but when we run the fixup playbook, it can be useful | 18:23 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Add foreground option https://review.openstack.org/635649 | 18:24 |
| *** luizbag__ has joined #openstack-infra | 18:25 | |
| mordred | corvus: patch failed again - I'm taking it over | 18:25 |
| corvus | mordred: thx | 18:25 |
| clarkb | mordred: assuming auto init results in initing to master branch then ya I think that should do what we want | 18:25 |
| *** luizbag_ has quit IRC | 18:27 | |
| *** luizbag has quit IRC | 18:27 | |
| *** Sundar has quit IRC | 18:31 | |
| *** cmoura has quit IRC | 18:38 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Test gitea project creation playbook https://review.openstack.org/641158 | 18:43 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Revert "Revert "Set default branch for repo"" https://review.openstack.org/641108 | 18:43 |
| *** aojeagarcia has quit IRC | 18:47 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Update API code to work with Presentation Moderators collection (+N) https://review.openstack.org/641091 | 18:49 |
| *** markvoelker has joined #openstack-infra | 18:50 | |
| *** jamesmcarthur has quit IRC | 18:50 | |
| *** jamesmcarthur has joined #openstack-infra | 18:51 | |
| *** jamesmcarthur has quit IRC | 18:55 | |
| mordred | watching the project fixup playbook run is very boring | 18:56 |
| clarkb | mordred: care to review https://review.openstack.org/#/q/owner:cboylan+topic:puppet-4+status:open for a slight improvement in the excitement levels? | 18:57 |
| clarkb | this set of chagnes addresses some stuff I noticed after we upgraded more dev servers to puppet4 | 18:57 |
| *** eumel8 has quit IRC | 18:57 | |
| clarkb | mordred: out of curiousity are there docs for the gitea settings api? | 19:00 |
| clarkb | the swagger api stuff doesn't cover it, does something else? | 19:00 |
| clarkb | Or was this capture what the web browser does with debugging tools and use it? | 19:00 |
| mordred | clarkb: that | 19:06 |
| mordred | clarkb: this is a thing where we likel want to go make some patches to add things to the swagger api | 19:06 |
| *** kaiokmo has quit IRC | 19:07 | |
| mordred | clarkb: if (defined('$::project_config_ref') and $::project_config_ref != undef) { is amaing | 19:08 |
| clarkb | mordred: yes... | 19:09 |
| clarkb | mordred: that might be me being overly cautious but I'm 99% sure you can define a variable with an undef value | 19:09 |
| clarkb | which is different than having an undefined variable | 19:09 |
| clarkb | in any case puppet complains with a warning so may as well clean it up | 19:10 |
| mordred | yeah. still. jeez | 19:10 |
| mordred | clarkb: +2 and/or +A from me on that stack | 19:11 |
| clarkb | thank you | 19:11 |
| *** wolverineav has quit IRC | 19:14 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Fix test race with Watchdog thread still running https://review.openstack.org/641473 | 19:18 |
| *** ykarel_ has joined #openstack-infra | 19:20 | |
| *** ykarel|away has quit IRC | 19:22 | |
| *** markvoelker has quit IRC | 19:22 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Run tox remote concurrent https://review.openstack.org/640654 | 19:22 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: WIP: Support ansible 2.7 https://review.openstack.org/631932 | 19:22 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Switch default ansible version to 2.7 https://review.openstack.org/637424 | 19:22 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: DNM: zuul-stream-functional debugging https://review.openstack.org/640648 | 19:22 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Add puppet-vcsrepo as required project on puppet jobs https://review.openstack.org/641161 | 19:24 |
| *** wolverineav has joined #openstack-infra | 19:25 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Create a repo for zuul-operator https://review.openstack.org/641474 | 19:26 |
| *** rfolco|ruck has quit IRC | 19:26 | |
| mordred | clarkb: if you were thinking to yourself, "I bet the repo fix playbook is almost done" ... you'd be so wrong | 19:26 |
| *** wolverineav has quit IRC | 19:26 | |
| *** gfidente has quit IRC | 19:26 | |
| *** wolverineav has joined #openstack-infra | 19:26 | |
| clarkb | I was actually thinking to myself: "what do I have for lunch" | 19:27 |
| clarkb | because it is snowing outside and I don't feel like going outside to find food | 19:27 |
| *** electrofelix has quit IRC | 19:27 | |
| *** rfolco has joined #openstack-infra | 19:27 | |
| corvus | mmm. bachelor chow! | 19:28 |
| fungi | i ordered a cheeseless thin crust pizza for lunch. they got the cheeseless part right but also made it sauceless, so it's like a dry cracker with loose toppings scattered across the surface | 19:28 |
| mordred | fungi: hahahaha. wow. yeah. that doesnm't sound like food as much as art | 19:28 |
| corvus | fungi: wash it down with some slurm | 19:29 |
| fungi | it's a challenge to consume. slurm would probably help | 19:29 |
| clarkb | also I've just remembered my new desk is supposed to arrive today so depending on timing of that I may tackle afs01.ord tomorrow | 19:29 |
| *** wolverineav has quit IRC | 19:29 | |
| fungi | whimmy wham wham wozzle | 19:29 |
| *** gfidente has joined #openstack-infra | 19:30 | |
| *** wolverineav has joined #openstack-infra | 19:30 | |
| clarkb | fungi: corvus any chance you have a moment to be second review on https://review.openstack.org/#/q/owner:cboylan+topic:puppet-4+status:open | 19:31 |
| fungi | done | 19:33 |
| clarkb | thanks | 19:34 |
| clarkb | I guess I should go find food so I can follow up on them once they've merged | 19:34 |
| openstackgerrit | Merged openstack-infra/puppet-project_config master: Check if project_config_ref is defined before using it https://review.openstack.org/641152 | 19:34 |
| *** wolverineav has quit IRC | 19:35 | |
| *** kaiokmo has joined #openstack-infra | 19:38 | |
| *** wolverineav has joined #openstack-infra | 19:41 | |
| *** xek has joined #openstack-infra | 19:42 | |
| *** xek has quit IRC | 19:44 | |
| *** xek_ has joined #openstack-infra | 19:44 | |
| *** xek__ has quit IRC | 19:45 | |
| *** wolverineav has quit IRC | 19:47 | |
| mordred | SAD TROMBONE | 19:48 |
| mordred | openstack/deb-oslotest | 19:48 |
| mordred | also not a real repo | 19:49 |
| *** flwang has left #openstack-infra | 19:50 | |
| fungi | do we have "data quality" issues with our repos? mildly shocked | 19:50 |
| mordred | fungi, clarkb, corvus: as fun as this is - I'd like to just fix this for this time with a sql query if y'all are ok with that | 19:50 |
| fungi | mordred: pretend for a moment i haven't been paying super-close attention to scrollback... can you elaborate on "this" with different words? | 19:52 |
| mordred | fungi: the repos in the gitea servers have incorrect settings for default_branch | 19:52 |
| fungi | that this, okay | 19:53 |
| mordred | fungi: we have the create playbook fixed so it won't happen moving forward (at least we think so) - and have been running the sync-gitea-repos playbook to fix the existing ones | 19:53 |
| fungi | (i'm keeping a lot of this'es in my head which need fixing) | 19:53 |
| clarkb | mordred: should we query gerrit for all hidden projects and unhide them so that fixup playbook works in the future at least? | 19:53 |
| mordred | clarkb: this one isn't a hidden project - this one is just flat empty | 19:53 |
| mordred | clarkb: I mean - I think continuing to run the fixup playbook until it runs green is a good idea - so that we know we're in good shape | 19:54 |
| clarkb | oh interesting. Thats right yhe deb s tuff defaulted to not master | 19:54 |
| clarkb | mordred: ++ | 19:54 |
| mordred | clarkb: hrm. do we have any repos that legit don't want master as their default branch (of things we still care about?) | 19:55 |
| fungi | well, the deb stuff we imported defaulted to not master on the originals, we "fixed" that (or so we thought) after one or two didn't import correctly | 19:55 |
| fungi | so maybe this was one of those | 19:55 |
| fungi | mordred: we made it a policy that the default branch on all our repos is master, but it wasn't until the deb projects import that we added a ci check to make sure we didn't import more in that state | 19:55 |
| mordred | cool | 19:56 |
| *** wolverineav has joined #openstack-infra | 19:56 | |
| clarkb | ya I think not doing master introduces so many weird corner cases we should continue to avoid it | 19:56 |
| fungi | so if we find some we didn't fix entirely from the beforetime, we're fine to manually fix those up in my opinion | 19:56 |
| *** tosky has quit IRC | 20:00 | |
| *** tosky has joined #openstack-infra | 20:01 | |
| *** auristor has quit IRC | 20:01 | |
| *** luizbag__ has quit IRC | 20:01 | |
| mordred | clarkb, fungi, corvus: ok. all of the giteas should be fixed with default_branch now | 20:01 |
| *** e0ne has joined #openstack-infra | 20:03 | |
| fungi | mordred: if for some reason we need to redo these servers from scratch or add another, they'll get the right default branch on all the repos we sync in from now on right? | 20:03 |
| fungi | (since the playbook is fixed) | 20:03 |
| mordred | fungi: once we land the updated playbook patch | 20:03 |
| mordred | yes | 20:03 |
| fungi | okay, sounds fine to me. thanks! | 20:03 |
| mordred | https://review.openstack.org/#/c/641108/ ftr | 20:04 |
| mordred | corvus: incidentally - your patch is green, and I based my patch on top of it | 20:04 |
| openstackgerrit | Merged openstack-infra/system-config master: Install latest puppet-vcsrepo https://review.openstack.org/641156 | 20:07 |
| openstackgerrit | Merged openstack-infra/system-config master: Bump puppet/staging to 1.0.1 to satisfy mysql module dep https://review.openstack.org/641157 | 20:07 |
| openstackgerrit | Merged openstack-infra/zuul master: Fix test race with Watchdog thread still running https://review.openstack.org/641473 | 20:10 |
| *** yamamoto has joined #openstack-infra | 20:11 | |
| corvus | mordred: thank you! | 20:14 |
| *** cmoura has joined #openstack-infra | 20:14 | |
| corvus | +2s; i'll let clarkb/fungi +3 | 20:15 |
| *** yamamoto has quit IRC | 20:16 | |
| *** auristor has joined #openstack-infra | 20:16 | |
| *** markvoelker has joined #openstack-infra | 20:19 | |
| fungi | one of these days when someone has time, i'm curious to know why we expect status_code: 302 from the gitea api | 20:20 |
| *** wolverineav has quit IRC | 20:21 | |
| *** e0ne has quit IRC | 20:21 | |
| mordred | fungi: well - those calls aren't actually gitea api calls | 20:25 |
| mordred | fungi: those calls are us pretending to be the html of gitea | 20:25 |
| mordred | fungi: in the future, we should add api calls for the places where we're making form submit calls | 20:26 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Allow operator to generate auth tokens through the CLI https://review.openstack.org/636197 | 20:26 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Zuul CLI: allow access via REST https://review.openstack.org/636315 | 20:26 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Add Authorization Rules configuration https://review.openstack.org/639855 | 20:27 |
| fungi | ooh | 20:27 |
| fungi | okay, that makes more sense | 20:27 |
| fungi | so after you perform those actions gitea wants to redirect your "browser" | 20:27 |
| corvus | yeah, generally back to the page you were just on | 20:27 |
| corvus | POST /org/project/settings -> /org/project | 20:28 |
| fungi | fun times | 20:28 |
| clarkb | which is why we need the csrf tokens too? | 20:29 |
| *** jamesmcarthur has joined #openstack-infra | 20:30 | |
| corvus | yep | 20:31 |
| *** betherly has joined #openstack-infra | 20:31 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Web: plug the authorization engine https://review.openstack.org/640884 | 20:32 |
| *** wolverineav has joined #openstack-infra | 20:37 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Web: plug the authorization engine https://review.openstack.org/640884 | 20:37 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Zuul Web: add /api/user/actions endpoint https://review.openstack.org/641099 | 20:38 |
| *** betherly has quit IRC | 20:41 | |
| clarkb | the puppet run just after 2100UTC should apply those puppet things. I'll be watching it to make sure that we get the expected cleanup behavior on those warnings | 20:44 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Log exception on module failure with empty stdout https://review.openstack.org/640650 | 20:45 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Zuul Web: add /api/user/actions endpoint https://review.openstack.org/641099 | 20:46 |
| clarkb | I've approved the test gitea chang which will get the fix for branch setting in the gate too | 20:48 |
| *** eernst has joined #openstack-infra | 20:50 | |
| mordred | clarkb: woot | 20:51 |
| *** betherly has joined #openstack-infra | 20:51 | |
| clarkb | I didn't have to resort to bachelor chow either. Reheated some frozen bolognese I made a couple months ago :) | 20:51 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Log exception on module failure with empty stdout https://review.openstack.org/640650 | 20:52 |
| *** eernst has quit IRC | 20:52 | |
| *** eernst has joined #openstack-infra | 20:52 | |
| *** markvoelker has quit IRC | 20:53 | |
| *** fdegir has quit IRC | 20:53 | |
| fungi | freezers are a marvellous invention | 20:53 |
| corvus | oh i thought he just left it outside | 20:54 |
| *** fdegir has joined #openstack-infra | 20:54 | |
| *** eernst has quit IRC | 20:54 | |
| fungi | i think if you do that, the portland pandas are likely to find it | 20:55 |
| clarkb | thankfully I don't live in the part of the wolrd where you can do that (/me looks at smcginnis ) | 20:55 |
| *** betherly has quit IRC | 20:55 | |
| smcginnis | Walk out freezers can be very handy! | 20:56 |
| fungi | heck, we did that for the winter 2017 holiday season when we had family coming to stay and the fridge/freezer died on us | 20:57 |
| fungi | and because everybody had decided to buy appliances as gifts, everything was backordered and the delivery folks were backlogged too | 20:58 |
| fungi | worst time of year to have appliances die on you | 20:58 |
| clarkb | around here its more fridge temp | 20:58 |
| clarkb | and I don't trust it for anything but beer | 20:58 |
| clarkb | (but we have had a weird end of winter with it being extra cold) | 20:59 |
| fungi | we used the garage for a refrigerator and some coolers on the porch for a freezer | 20:59 |
| fungi | it worked out fine | 20:59 |
| fungi | panda-proof coolers | 20:59 |
| fungi | i just looked up and realized the day is nearly gone and all i've really "gotten done" is to be in a bunch of meetings | 21:00 |
| clarkb | fungi: you've also got the water which I imagine is a pretty constant temp but probably warmer than fridge temp there? | 21:00 |
| fungi | clarkb: it's fridge temp in the winter. sometimes approaching freezer temperature and that gets really funky with the tides lifting and lowering the ice sheet | 21:01 |
| clarkb | michigan had an ice tsunami recently | 21:01 |
| fungi | the ice rime that builds up on the pier pilings and cyprus knees is gnarly | 21:01 |
| fungi | worth noting the water *can* get well below 0c since it's briny | 21:02 |
| *** zbr|ssbarnea has joined #openstack-infra | 21:07 | |
| *** irclogbot_1 has joined #openstack-infra | 21:08 | |
| *** zbr has quit IRC | 21:10 | |
| *** betherly has joined #openstack-infra | 21:11 | |
| *** e0ne has joined #openstack-infra | 21:13 | |
| clarkb | puppet is looking slightly cleaner on review-dev now | 21:15 |
| clarkb | the staging version bump hasn't made it in yet so on the next run we should see it properly clean up | 21:15 |
| *** betherly has quit IRC | 21:15 | |
| *** ldnunes has quit IRC | 21:16 | |
| openstackgerrit | Merged openstack-infra/system-config master: Test gitea project creation playbook https://review.openstack.org/641158 | 21:17 |
| *** whoami-rajat has quit IRC | 21:18 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Manage ansible installations within zuul https://review.openstack.org/631930 | 21:21 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Validate ansible installations on startup https://review.openstack.org/637418 | 21:22 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Make ansible version configurable https://review.openstack.org/637422 | 21:22 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Install ansible during executor startup if needed https://review.openstack.org/640644 | 21:22 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Support ansible 2.6 https://review.openstack.org/631931 | 21:22 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Run tox remote concurrent https://review.openstack.org/640654 | 21:22 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: WIP: Support ansible 2.7 https://review.openstack.org/631932 | 21:22 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Switch default ansible version to 2.7 https://review.openstack.org/637424 | 21:22 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: DNM: zuul-stream-functional debugging https://review.openstack.org/640648 | 21:22 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: Proposed spec: tenant-scoped admin web API https://review.openstack.org/562321 | 21:22 |
| *** jamesmcarthur has quit IRC | 21:24 | |
| clarkb | fungi: puppet4 has caught that the reply_to_email_address in puppet-storyboard is never defined but used in our storyboard conf erb | 21:24 |
| *** jamesmcarthur has joined #openstack-infra | 21:24 | |
| clarkb | fungi: any chance you know what the intent was there? I'm thinking maybe we just remove it from the config if it has been unsed | 21:24 |
| openstackgerrit | George Dimitrov proposed openstack-infra/git-review master: Fix parsing of review over http https://review.openstack.org/641484 | 21:26 |
| *** irclogbot_1 has quit IRC | 21:28 | |
| *** jamesmcarthur has quit IRC | 21:28 | |
| *** eharney has quit IRC | 21:29 | |
| ianw | i wonder what year it will be when i think "wow, it's been a long time since my whole system randomly stopped receiving peripheral input and i had to ssh in and sighup gnome-shell to avoid destroying all my state" | 21:30 |
| *** betherly has joined #openstack-infra | 21:31 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-storyboard master: Remove unused puppi dependency https://review.openstack.org/641485 | 21:32 |
| clarkb | fungi: ^ thats a different fix. Happy to push up the removal of that undefined var as well if you think that is appropriate | 21:33 |
| clarkb | ianw: the year of the linux desk | 21:33 |
| clarkb | er linux desktop | 21:33 |
| *** betherly has quit IRC | 21:35 | |
| clarkb | fungi: SotK looks like SotK added support for that in the template I'm guessing it was just a missed variable in that case? | 21:37 |
| clarkb | I guess I'll define it then | 21:37 |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-storyboard master: Define reply_to_email_address https://review.openstack.org/641486 | 21:39 |
| clarkb | fungi: SotK ^ I think that is the fix | 21:39 |
| openstackgerrit | Merged openstack-infra/system-config master: Revert "Revert "Set default branch for repo"" https://review.openstack.org/641108 | 21:40 |
| fungi | clarkb: i think it was probably related to the fact that we haven't yet implemented the ability to comment on stories via e-mail | 21:44 |
| *** betherly has joined #openstack-infra | 21:46 | |
| clarkb | ianw: did you see my questions about working through afs01.ord soon? also do you think it would be worthwhile to stop afs on it, move the afs config aside, take a snapshot, then test thsi on the snapshot first? | 21:46 |
| clarkb | fungi: my fix for it should support that then | 21:49 |
| clarkb | fungi: I add it as a valid parameter which makes the variable defined | 21:49 |
| fungi | clarkb: i commented in the review, but right now it's resulting in setting the variable to an empty value. wondering if the nil erb is going to turn that undef into will end up as a literal 'nil' string instead? | 21:50 |
| *** markvoelker has joined #openstack-infra | 21:50 | |
| clarkb | fungi: I responded | 21:50 |
| clarkb | fungi: it should remove the section entirely beacuse of the != undef check just above | 21:50 |
| fungi | oh! thanks, i missed the if | 21:51 |
| clarkb | unless the != :undef is not hcecking what we want there | 21:51 |
| clarkb | its possible it would still fall through in that case | 21:51 |
| *** betherly has quit IRC | 21:51 | |
| clarkb | cmurphy: ^ do you have a sec to check that? https://review.openstack.org/#/c/641486/1/templates/storyboard.conf.erb | 21:51 |
| fungi | oh, yeah i thought undef became nil in erb, and i guess we're specifically matching on :undef | 21:52 |
| fungi | but i've never seen that syntax before so maybe it's valid | 21:52 |
| clarkb | fungi: let me update it to be safe | 21:53 |
| clarkb | actually stackoverflow says the check for :undef is correct when doing scope.lookupvar | 21:54 |
| clarkb | $deity forbid we actually make this simple | 21:54 |
| clarkb | I don't understand how it was falling through before | 21:56 |
| ianw | clarkb: sorry, i didn't; i mean it's probably never a *bad* idea to get the snapshot before updating? | 21:57 |
| clarkb | ianw: ya I am leaning towards doing it, I'll get started on stopping afs on the server so that I can make a snapshot | 21:58 |
| clarkb | but first sorting out this puppet mystery | 21:58 |
| *** e0ne has quit IRC | 21:58 | |
| *** jcoufal has quit IRC | 21:59 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-storyboard master: Define reply_to_email_address https://review.openstack.org/641486 | 21:59 |
| clarkb | fungi: ^ we check against nil in other places | 21:59 |
| clarkb | and we shouldn't fall through if that :undef check was working so I suspect that check was not working | 22:00 |
| *** e0ne has joined #openstack-infra | 22:01 | |
| fungi | thanks | 22:01 |
| *** e0ne has quit IRC | 22:01 | |
| clarkb | hrm what happens when you vos release and one of your secondary RO sites is down? | 22:02 |
| clarkb | docs in particular has a secondary site on afs01.ord | 22:02 |
| clarkb | and snapshotting isn't a fast process so chances are I will atke the service down for a bit | 22:03 |
| clarkb | does it just catch up again after the service is running again? | 22:04 |
| *** apetrich has quit IRC | 22:08 | |
| clarkb | vos_release manpage implies it handles it properly but you have to manually rerun vos release to do the catch up | 22:09 |
| clarkb | I think for docs we are likely ok there since we run the cron often | 22:09 |
| clarkb | it should just automatically catch back up again when it can | 22:09 |
| clarkb | infra-root given ^ any objection to me disabling afs01.ord's afs services in order to make a snapshot? | 22:09 |
| corvus | clarkb: sounds good | 22:10 |
| *** apetrich has joined #openstack-infra | 22:11 | |
| fungi | clarkb: sounds like the safer path | 22:11 |
| clarkb | ok I did a bos shutdown, then a service openafs-fileserver stop, then moved /etc/openafs/ to /etc/clarkb.moved.openafs and am running the snapshot now | 22:15 |
| clarkb | when snapshot is done I'll move /etc/openafs back, start openafs-fileserver, and the bos status and make sure its happy again | 22:15 |
| *** betherly has joined #openstack-infra | 22:17 | |
| *** betherly has quit IRC | 22:22 | |
| *** markvoelker has quit IRC | 22:22 | |
| *** pabelanger has quit IRC | 22:32 | |
| *** auristor has quit IRC | 22:32 | |
| *** auristor has joined #openstack-infra | 22:33 | |
| openstackgerrit | Merged openstack-infra/puppet-storyboard master: Remove unused puppi dependency https://review.openstack.org/641485 | 22:35 |
| *** anteaya has quit IRC | 22:37 | |
| clarkb | snapshot has finished and I've moved things back and started openafs-fileserver again. bos status says "currently running normally" | 22:40 |
| clarkb | I'm going to pop out for a few before I boot the snapshot but next step in my plan is to boot the snapshot then run the upgrade on it | 22:40 |
| *** cmoura has quit IRC | 22:45 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Fix duplicate and reversed artifacts https://review.openstack.org/641508 | 22:46 |
| *** rcernin has joined #openstack-infra | 22:52 | |
| *** wolverineav has quit IRC | 22:52 | |
| *** wolverineav has joined #openstack-infra | 22:58 | |
| *** mattw4 has quit IRC | 23:00 | |
| *** mattw4 has joined #openstack-infra | 23:01 | |
| *** tkajinam has joined #openstack-infra | 23:01 | |
| *** dave-mccowan has quit IRC | 23:06 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Test afs nodes on xenial https://review.openstack.org/641512 | 23:08 |
| clarkb | realized I should double check ^ before I get too far down the path of doing upgrades | 23:09 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Allow soft job dependencies https://review.openstack.org/641439 | 23:10 |
| clarkb | test server is booting off of the snapshot now | 23:11 |
| *** wolverineav has quit IRC | 23:13 | |
| *** wolverineav has joined #openstack-infra | 23:17 | |
| *** markvoelker has joined #openstack-infra | 23:19 | |
| *** rlandy is now known as rlandy|bbl | 23:24 | |
| *** kjackal has quit IRC | 23:24 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Fix duplicate and reversed artifacts https://review.openstack.org/641508 | 23:28 |
| *** ekultails has quit IRC | 23:29 | |
| clarkb | ianw dmsimard did we learn anything about booting snapshots? my booted snapshot pings but does not accept ssh connections | 23:30 |
| ianw | clarkb: yes, yes we did | 23:30 |
| fungi | may need to check its console | 23:30 |
| ianw | https://etherpad.openstack.org/p/bridge-snapshot-bringup | 23:31 |
| ianw | what i learnt, at least for bionic, was that what seems to happen is that the initial boot is cloud-init enabled, and nova-agent correctly writes out the config | 23:31 |
| ianw | but then we remove cloud-init, and so subsequent boots will not pick up new networking | 23:31 |
| ianw | i think because rax's nova-agent .service files are all tied into cloud-init dependencies | 23:32 |
| clarkb | hrm this may be a reason to not uninstall cloud-init | 23:32 |
| clarkb | mordred: ^ fyi | 23:32 |
| clarkb | ianw: step 3 requires web ui? | 23:33 |
| mordred | clarkb: I see that as another reason to start using our own base images | 23:33 |
| mordred | clarkb: but yeah | 23:33 |
| clarkb | mordred: well glean doesn't work in that case either | 23:33 |
| ianw | clarkb: afaik, yes, you need the webui to enter the rescue mode. it gives you the root password | 23:33 |
| clarkb | (not on rax) | 23:33 |
| mordred | oh - this is for bringing up snapshot | 23:33 |
| mordred | because of new networking | 23:34 |
| clarkb | mordred: yes | 23:34 |
| mordred | sorry - I fixated on nova-agent first :) | 23:34 |
| *** rascasoft has quit IRC | 23:34 | |
| clarkb | I mean nova-agent/cloud-init are the actors on my snapshot | 23:34 |
| clarkb | but we'd get the same behavior on our own images with glean | 23:34 |
| mordred | yeah- totes | 23:35 |
| mordred | clarkb: glean doesnt' run on subsequent boots because we write out a stamp file | 23:35 |
| mordred | right? | 23:35 |
| * mordred is paging info back in | 23:35 | |
| ianw | right, it won't overwrite the existing network files | 23:35 |
| ianw | they could be cleared out, and it would be re-written ... which i assume cloud-init+nova-agent would do | 23:36 |
| ianw | that was what i tried first | 23:36 |
| ianw | but the netplan file was not re-written on boot ... ergo my thought that i think because no cloud-init, nova-agent doesn't correctly know to re-write it | 23:36 |
| clarkb | cloud-init checks the instance uuid against a value it writes | 23:37 |
| clarkb | if they don't match it assumes a new instance and redoes everything | 23:37 |
| *** rascasoft has joined #openstack-infra | 23:37 | |
| mordred | yeah. so - yeah, I guess as much as it pains me to say it - not deleting cloud-init might be the best choice for some of these | 23:37 |
| ianw | hrm, glean does not do that, but certainly could | 23:37 |
| clarkb | ianw: ya we could update glean to be smarter | 23:37 |
| ianw | glean also has no support for netplan, which sounds like another pita thing to design for | 23:37 |
| mordred | what is netplan? | 23:38 |
| mordred | oh wow | 23:38 |
| mordred | nevermind | 23:38 |
| mordred | I've learned enough | 23:38 |
| ianw | ... yeah ... :) that was me a few days ago looking at this :) | 23:38 |
| clarkb | remember how systemd was going to solve all this? | 23:38 |
| mordred | it's config for the desktop networking systems that have gotten shoved in to server operating systems | 23:39 |
| clarkb | fwiw I think trusty is too old for me to deal with netplan but everything else is likely applicable | 23:39 |
| * mordred cries | 23:39 | |
| ianw | i don't know how to deal with the ephemeral drive thing | 23:42 |
| fungi | wow, netplan looks like ifupdown configuration in yaml with a versioned schema | 23:42 |
| ianw | while nofail in the fstab means the system boots, it also means the snapshot has a ephmeral drive without the disk layout it expects | 23:42 |
| *** rh-jelabarre has quit IRC | 23:43 | |
| fungi | well, sure, it's "ephemeral" after all | 23:43 |
| ianw | i guess, with enough effort, a .service file could be written to do the partitioning if it didn't exist before mounts | 23:43 |
| clarkb | in the case of old trusty machine I need to copy /etc/network/interfaces and not the netplan stuff | 23:44 |
| clarkb | but same idea | 23:44 |
| clarkb | huh though it looks like that may already have been done and my only issue then was trying to mount things that well weren't going to mount | 23:45 |
| ianw | "# Cloud-inti supports the creation of simple partition tables and files systems on disks" | 23:45 |
| ianw | of course it does | 23:45 |
| clarkb | ya that was actually what precipitated our move away from cloud-init | 23:45 |
| fungi | cloud-init will floss your dog and flense your speen | 23:45 |
| clarkb | hpcloud had decided they knew how to partition our disks and iirc partitioned over a disk with contnet | 23:46 |
| clarkb | via cloud-init config | 23:46 |
| clarkb | ianw note that rebooting doesn't seem to exit rescue mode. I've had to click the button in the webui and am trying again | 23:48 |
| ianw | but yeah, on bridge.o.o -- i feel like dmsimard's resize plan is probably good, and hope for the best that it all just works -- but if it doesn't, it's not so hard to recover | 23:48 |
| fungi | another thing i've discovered about rescue mode is that it will cause any userdata script you originally supplied for the instance to be executed again on entering rescue mode... likely doesn't impact our use though | 23:53 |
| *** markvoelker has quit IRC | 23:53 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!