*** wolverineav has joined #openstack-infra | 00:09 | |
*** bobh has quit IRC | 00:11 | |
*** gmann has quit IRC | 00:12 | |
*** gmann has joined #openstack-infra | 00:12 | |
*** Goneri has quit IRC | 00:15 | |
*** sflanigan has joined #openstack-infra | 00:18 | |
*** wolverineav has quit IRC | 00:24 | |
openstackgerrit | Merged openstack/diskimage-builder master: zypper-minimal: No point in preserving the environment here https://review.openstack.org/483550 | 00:26 |
---|---|---|
*** funzo has joined #openstack-infra | 00:31 | |
*** bobh has joined #openstack-infra | 00:31 | |
*** bobh has quit IRC | 00:32 | |
*** bobh has joined #openstack-infra | 00:32 | |
*** funzo has quit IRC | 00:37 | |
openstackgerrit | Merged openstack/diskimage-builder master: Remove additional Bumblebee repository for opensuse element https://review.openstack.org/482708 | 00:50 |
*** wolverineav has joined #openstack-infra | 00:51 | |
*** bobh has quit IRC | 00:56 | |
*** thorst has joined #openstack-infra | 00:59 | |
*** LindaWang has joined #openstack-infra | 01:01 | |
*** bobh has joined #openstack-infra | 01:02 | |
openstackgerrit | Merged openstack/diskimage-builder master: doc: Switch from oslosphinx to openstackdocstheme https://review.openstack.org/483818 | 01:03 |
*** thorst has quit IRC | 01:04 | |
*** wolverineav has quit IRC | 01:07 | |
*** mwarad has quit IRC | 01:16 | |
*** bobh has quit IRC | 01:18 | |
*** zhurong has joined #openstack-infra | 01:20 | |
*** zhurong has quit IRC | 01:23 | |
*** liujiong has joined #openstack-infra | 01:24 | |
*** markvoelker has joined #openstack-infra | 01:29 | |
openstackgerrit | Amrith Kumar proposed openstack/diskimage-builder master: Allow users to specify partition type in the MBR PTE https://review.openstack.org/482396 | 01:31 |
*** funzo has joined #openstack-infra | 01:33 | |
*** liujiong_lj has joined #openstack-infra | 01:36 | |
*** mwarad has joined #openstack-infra | 01:37 | |
*** liujiong has quit IRC | 01:37 | |
*** funzo has quit IRC | 01:37 | |
*** wolverineav has joined #openstack-infra | 01:38 | |
*** liujiong_lj is now known as liujiong | 01:39 | |
*** sbezverk has quit IRC | 01:42 | |
*** bobh has joined #openstack-infra | 01:51 | |
*** wolverineav has quit IRC | 01:55 | |
*** markvoelker has quit IRC | 02:03 | |
*** bobh has quit IRC | 02:08 | |
*** gcb has joined #openstack-infra | 02:11 | |
*** bobh has joined #openstack-infra | 02:11 | |
*** EricGonczer_ has quit IRC | 02:16 | |
*** wolverineav has joined #openstack-infra | 02:22 | |
*** zhurong has joined #openstack-infra | 02:31 | |
*** funzo has joined #openstack-infra | 02:34 | |
*** funzo has quit IRC | 02:38 | |
*** wolverineav has quit IRC | 02:39 | |
*** MatthewLi has joined #openstack-infra | 02:39 | |
*** yamamoto has joined #openstack-infra | 02:47 | |
*** xarses has quit IRC | 02:59 | |
*** xarses has joined #openstack-infra | 02:59 | |
*** ramishra has joined #openstack-infra | 03:00 | |
*** markvoelker has joined #openstack-infra | 03:00 | |
*** xarses has quit IRC | 03:00 | |
*** xarses has joined #openstack-infra | 03:00 | |
*** thorst has joined #openstack-infra | 03:01 | |
*** dave-mccowan has quit IRC | 03:04 | |
*** bobh has quit IRC | 03:05 | |
*** funzo has joined #openstack-infra | 03:05 | |
*** wolverineav has joined #openstack-infra | 03:05 | |
*** thorst has quit IRC | 03:05 | |
*** baoli has quit IRC | 03:05 | |
*** funzo has quit IRC | 03:08 | |
*** yamamoto has quit IRC | 03:09 | |
*** baoli has joined #openstack-infra | 03:16 | |
*** xarses_ has joined #openstack-infra | 03:19 | |
*** wolverineav has quit IRC | 03:20 | |
*** Sukhdev has quit IRC | 03:20 | |
*** andreww has joined #openstack-infra | 03:20 | |
*** xarses has quit IRC | 03:22 | |
*** xarses_ has quit IRC | 03:24 | |
*** andreww has quit IRC | 03:24 | |
*** aeng has quit IRC | 03:25 | |
*** markvoelker has quit IRC | 03:34 | |
*** hongbin has joined #openstack-infra | 03:39 | |
*** baoli has quit IRC | 03:41 | |
*** mikal has quit IRC | 03:42 | |
*** gouthamr has quit IRC | 03:42 | |
*** links has joined #openstack-infra | 03:44 | |
*** wolverineav has joined #openstack-infra | 03:46 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: elements: openstack-ci-mirrors: Use openSUSE mirrors for gating jobs https://review.openstack.org/478443 | 04:00 |
*** yamamoto has joined #openstack-infra | 04:09 | |
*** aeng has joined #openstack-infra | 04:10 | |
*** aeng has quit IRC | 04:10 | |
*** hongbin has quit IRC | 04:13 | |
*** adisky__ has joined #openstack-infra | 04:13 | |
*** aeng has joined #openstack-infra | 04:13 | |
*** yamamoto has quit IRC | 04:14 | |
*** psachin has joined #openstack-infra | 04:18 | |
*** wolverineav has quit IRC | 04:19 | |
*** wolverineav has joined #openstack-infra | 04:30 | |
*** markvoelker has joined #openstack-infra | 04:30 | |
*** gtrxcb has joined #openstack-infra | 04:31 | |
*** chkumar|off is now known as chandankumar | 04:35 | |
AJaeger | ianw, are you going to retire these repos from a second round, please? Or shall I ask somebody else? http://lists.openstack.org/pipermail/openstack-infra/2017-July/005487.html | 04:37 |
*** jerryz has quit IRC | 04:40 | |
AJaeger | jhesketh: I meant to ask you ^ Sorry, ianw | 04:40 |
*** wolverineav has quit IRC | 04:42 | |
*** Guest85796 has quit IRC | 04:46 | |
*** Dinesh_Bhor has joined #openstack-infra | 04:46 | |
*** Sukhdev has joined #openstack-infra | 04:47 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: elements: openstack-ci-mirrors: Use openSUSE mirrors for gating jobs https://review.openstack.org/478443 | 04:48 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Remove DIB_[DISTRO]_DISTRIBUTION_MIRROR https://review.openstack.org/484247 | 04:48 |
AJaeger | project-config cores, please put on your review queue https://review.openstack.org/#/q/status:open+project:openstack-infra/project-config+branch:master+topic:local_conf - this uses local_conf wherever possible | 04:56 |
*** thorst has joined #openstack-infra | 05:01 | |
*** zhurong has quit IRC | 05:04 | |
*** markvoelker has quit IRC | 05:04 | |
*** thorst has quit IRC | 05:06 | |
*** dhajare has joined #openstack-infra | 05:07 | |
*** wolverineav has joined #openstack-infra | 05:09 | |
*** wolverineav has quit IRC | 05:13 | |
*** ykarel has joined #openstack-infra | 05:16 | |
*** armax has joined #openstack-infra | 05:23 | |
*** wolverineav has joined #openstack-infra | 05:23 | |
*** isaacb has joined #openstack-infra | 05:26 | |
*** nicolasbock has joined #openstack-infra | 05:28 | |
*** zhurong has joined #openstack-infra | 05:28 | |
*** armax has quit IRC | 05:30 | |
*** armax has joined #openstack-infra | 05:30 | |
*** armax has quit IRC | 05:31 | |
*** armax has joined #openstack-infra | 05:31 | |
*** armax has quit IRC | 05:32 | |
*** florianf has joined #openstack-infra | 05:32 | |
*** armax has joined #openstack-infra | 05:32 | |
*** armax has quit IRC | 05:32 | |
*** armax has joined #openstack-infra | 05:33 | |
*** armax has quit IRC | 05:33 | |
*** armax has joined #openstack-infra | 05:34 | |
*** sbezverk has joined #openstack-infra | 05:34 | |
*** armax has quit IRC | 05:34 | |
*** armax has joined #openstack-infra | 05:35 | |
*** xarses has joined #openstack-infra | 05:35 | |
*** armax has quit IRC | 05:35 | |
openstackgerrit | Merged openstack/diskimage-builder master: Replace architecture-emulation-binaries with qemu-debootstrap https://review.openstack.org/444588 | 05:36 |
*** cshastri has joined #openstack-infra | 05:37 | |
*** eranrom_ has joined #openstack-infra | 05:39 | |
*** wolverineav has quit IRC | 05:41 | |
*** eranrom has quit IRC | 05:42 | |
*** eranrom_ has quit IRC | 05:43 | |
*** eranrom has joined #openstack-infra | 05:44 | |
*** eranrom has quit IRC | 05:50 | |
*** winggundamth has joined #openstack-infra | 05:53 | |
*** rcernin_ has joined #openstack-infra | 06:00 | |
*** MatthewLi1 has joined #openstack-infra | 06:01 | |
*** MatthewLi has quit IRC | 06:01 | |
*** MatthewLi1 is now known as MatthewLi | 06:01 | |
*** prateek has joined #openstack-infra | 06:03 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Update the documentation link for doc migration https://review.openstack.org/483820 | 06:12 |
*** nicolasbock has quit IRC | 06:13 | |
*** nicolasbock has joined #openstack-infra | 06:15 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: Add tenant column to the buildset reporter table https://review.openstack.org/484256 | 06:15 |
*** wolverineav has joined #openstack-infra | 06:17 | |
*** andreas_s has joined #openstack-infra | 06:23 | |
*** mikal has joined #openstack-infra | 06:24 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: Add tenant column to the buildset reporter table https://review.openstack.org/484256 | 06:28 |
*** prateek has quit IRC | 06:30 | |
*** wolverineav has quit IRC | 06:34 | |
*** ekcs has quit IRC | 06:37 | |
*** pgadiya has joined #openstack-infra | 06:39 | |
openstackgerrit | Spyros Trigazis (strigazi) proposed openstack-infra/project-config master: [magnum] Make swarm-mode job voting https://review.openstack.org/483858 | 06:43 |
*** aeng has quit IRC | 06:50 | |
*** Sukhdev has quit IRC | 06:50 | |
*** namnh has joined #openstack-infra | 06:58 | |
*** wolverineav has joined #openstack-infra | 07:01 | |
*** markvoelker has joined #openstack-infra | 07:01 | |
*** thorst has joined #openstack-infra | 07:02 | |
*** gtrxcb has quit IRC | 07:04 | |
*** rossella_s has joined #openstack-infra | 07:05 | |
*** shardy has joined #openstack-infra | 07:06 | |
*** shardy has quit IRC | 07:07 | |
*** thorst has quit IRC | 07:07 | |
*** cody-somerville has joined #openstack-infra | 07:07 | |
*** cody-somerville has joined #openstack-infra | 07:07 | |
*** csomerville has joined #openstack-infra | 07:09 | |
*** shardy has joined #openstack-infra | 07:09 | |
*** cody-somerville has quit IRC | 07:12 | |
*** rossella_s has quit IRC | 07:13 | |
*** rossella_s has joined #openstack-infra | 07:14 | |
*** wolverineav has quit IRC | 07:15 | |
*** dhellmann has quit IRC | 07:16 | |
*** dhellmann has joined #openstack-infra | 07:17 | |
*** alexchadin has joined #openstack-infra | 07:22 | |
*** alexchad_ has joined #openstack-infra | 07:28 | |
*** alexcha__ has joined #openstack-infra | 07:29 | |
*** alexchadin has quit IRC | 07:30 | |
hwoarang | good morning | 07:31 |
hwoarang | does anyone know how often project-config:jenkins/scripts/ sync on ci nodes? | 07:31 |
hwoarang | This commit https://review.openstack.org/#/c/483549/ was merged on Friday but according to today's http://logs.openstack.org/40/478140/6/experimental/gate-ansible-hardening-ansible-func-opensuse-422/297cbd3/console.html#_2017-07-17_07_29_20_551810 it does not seem the new code is deployed... | 07:32 |
*** tesseract has joined #openstack-infra | 07:32 | |
*** alexchad_ has quit IRC | 07:32 | |
*** Julien-zte has quit IRC | 07:32 | |
*** alexchadin has joined #openstack-infra | 07:33 | |
*** Hal has joined #openstack-infra | 07:33 | |
*** Julien-zte has joined #openstack-infra | 07:34 | |
*** alexcha__ has quit IRC | 07:34 | |
*** markvoelker has quit IRC | 07:35 | |
*** alexchad_ has joined #openstack-infra | 07:36 | |
openstackgerrit | Merged openstack-infra/project-config master: Run tripleo scenario004 in bgpvpn & l2gw gates https://review.openstack.org/480641 | 07:37 |
*** alexcha__ has joined #openstack-infra | 07:37 | |
*** prateek has joined #openstack-infra | 07:37 | |
*** alexchadin has quit IRC | 07:38 | |
*** martinkopec has joined #openstack-infra | 07:38 | |
openstackgerrit | Merged openstack-infra/project-config master: Fix jobs in manila driverfixes branches https://review.openstack.org/484040 | 07:39 |
*** alexchad_ has quit IRC | 07:40 | |
*** egonzalez has joined #openstack-infra | 07:40 | |
openstackgerrit | Merged openstack-infra/project-config master: update congress py35 dsvm job https://review.openstack.org/484158 | 07:41 |
openstackgerrit | Merged openstack/diskimage-builder master: Update the documentation link for doc migration https://review.openstack.org/483820 | 07:42 |
*** ralonsoh has joined #openstack-infra | 07:42 | |
*** wolverineav has joined #openstack-infra | 07:42 | |
*** alexcha__ is now known as alexchadin | 07:42 | |
andreas_s | hi the image build of the ci should be broken (at least it is in the s390x thirdparty CI). The reason is the removal of the trove image in stackr. This patch should fix the issue: https://review.openstack.org/484271 | 07:43 |
*** ccamacho has joined #openstack-infra | 07:46 | |
*** LindaWang has quit IRC | 07:48 | |
openstackgerrit | Merged openstack-infra/project-config master: Make gate-rally-dsvm-rally-heat job non-voting https://review.openstack.org/484055 | 07:48 |
*** wolverineav has quit IRC | 07:50 | |
openstackgerrit | Thomas Herve proposed openstack-infra/project-config master: Add a py3 designate job https://review.openstack.org/484275 | 07:50 |
openstackgerrit | Merged openstack-infra/project-config master: Fix up regex for skipping jobs for certain patrole changes https://review.openstack.org/484044 | 07:50 |
*** LindaWang has joined #openstack-infra | 08:00 | |
*** dizquierdo has joined #openstack-infra | 08:01 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: Fix zuul command default function https://review.openstack.org/484279 | 08:06 |
*** aarefiev has joined #openstack-infra | 08:10 | |
openstackgerrit | Merged openstack-infra/project-config master: Update job name in TripleO https://review.openstack.org/484053 | 08:12 |
openstackgerrit | Merged openstack-infra/project-config master: Start configuring opensuse 42.3 images on the various infra clouds https://review.openstack.org/484099 | 08:13 |
openstackgerrit | Merged openstack-infra/project-config master: Add experimental jobs for openSUSE 42.3 testing (bindep, devstack, dib) https://review.openstack.org/484113 | 08:13 |
openstackgerrit | Merged openstack-infra/project-config master: Restrict driverfixes branches for Manila https://review.openstack.org/483957 | 08:14 |
ianw | hwoarang: with the next build ... but is there an issue with opensuse builds? | 08:15 |
*** isaacb has quit IRC | 08:15 | |
ianw | hwoarang: i would say yes, looking at the age of the builds in http://nodepool.openstack.org/dib-image-list . i will take a look tomorrow my time ... | 08:16 |
openstackgerrit | Merged openstack-infra/project-config master: Switch to tox for running tempest plugin sanity check https://review.openstack.org/474168 | 08:17 |
openstackgerrit | Merged openstack-infra/project-config master: neutron-fwaas: Add a non-voting job to run networking-midonet unit tests https://review.openstack.org/482074 | 08:17 |
openstackgerrit | Merged openstack-infra/project-config master: Fix whitespace https://review.openstack.org/483868 | 08:19 |
ianw | hwoarang: looks like it's hitting this thing mentioned by andreas_s --> /opt/dib_tmp/dib_build.SRGOLc32/hooks/extra-data.d/98-source-repositories: line 49: CIRROS_VERSION: unbound variable | 08:23 |
*** hashar has joined #openstack-infra | 08:26 | |
*** thorst has joined #openstack-infra | 08:27 | |
umbarkar | In my third party setup the DIB image creation is failing .....anyone else having same issue? | 08:29 |
ianw | umbarkar: you are probably seeing issues related to https://review.openstack.org/#/c/484001/ | 08:30 |
ianw | hwoarang: ^ with that merged, hopefully we can get a suse build | 08:30 |
ianw | (and hence your script updated) | 08:30 |
*** markvoelker has joined #openstack-infra | 08:31 | |
*** thorst has quit IRC | 08:32 | |
umbarkar | ianw : yeh .. I think same issue I am facing | 08:32 |
*** lucas-afk is now known as lucasagomes | 08:32 | |
umbarkar | thank you for pointing me to this patch | 08:32 |
ianw | i think we'll need to cherry-pick that for it to work | 08:33 |
umbarkar | ianw : DIB image creation is done via script | 08:34 |
umbarkar | I mean its a automated process | 08:34 |
ianw | sorry, i mean cherry-pick that across branches on devstack | 08:35 |
umbarkar | ok | 08:35 |
ianw | one complication being, that devstack still has a mikata branch, but seems not to pass CI at all, meaning we can't commit the change there :/ | 08:35 |
ianw | hmmm | 08:35 |
*** AJaeger has quit IRC | 08:40 | |
*** AJaeger has joined #openstack-infra | 08:42 | |
*** electrofelix has joined #openstack-infra | 08:49 | |
*** tesseract has quit IRC | 08:50 | |
*** tesseract has joined #openstack-infra | 08:53 | |
*** dingyichen has quit IRC | 08:54 | |
*** markvoelker has quit IRC | 09:05 | |
*** isaacb has joined #openstack-infra | 09:10 | |
*** yamamoto has joined #openstack-infra | 09:13 | |
*** yamamoto has quit IRC | 09:13 | |
*** yamamoto has joined #openstack-infra | 09:14 | |
*** hichihara has quit IRC | 09:15 | |
*** yamamoto has quit IRC | 09:16 | |
*** yamamoto has joined #openstack-infra | 09:17 | |
odyssey4me | morning all - now that setuptools 36.2 is blacklisted in g-r how long will it take all job images to no longer have it installed? | 09:18 |
*** yamamoto has quit IRC | 09:21 | |
*** mwarad has quit IRC | 09:21 | |
*** yamamoto has joined #openstack-infra | 09:21 | |
*** derekh has joined #openstack-infra | 09:22 | |
ianw | odyssey4me / umbarkar / hwoarang: re updated builds, i belive things should start working themselves out as the changes in http://lists.openstack.org/pipermail/openstack-dev/2017-July/119763.html come through, and we rebuild fresh images | 09:23 |
*** sambetts|afk is now known as sambetts | 09:25 | |
odyssey4me | ok, thanks ianw | 09:25 |
umbarkar | ianw : Thanks for the update | 09:25 |
odyssey4me | I think those old branches were left as there were some projects who wanted the old branches to remain for whatever reason | 09:25 |
odyssey4me | however, those projects can always raise the issue | 09:25 |
ianw | odyssey4me: maybe ... but if we can't commit changes to them, well, it's a bad situation | 09:26 |
*** yamamoto has quit IRC | 09:26 | |
ianw | the EOL tags are there, so maybe what they should do instead is clone at that point, rather than the branch | 09:26 |
*** LindaWang has quit IRC | 09:27 | |
ianw | (and probably what we should have told them to do, since i doubt anyone is interested in actually maintaining it) | 09:27 |
odyssey4me | yep, I agree with that philosophy | 09:28 |
*** tuanluong has joined #openstack-infra | 09:28 | |
*** LindaWang has joined #openstack-infra | 09:28 | |
odyssey4me | I expect, then, that the new images are probably going to only be in place late today or perhaps tomorrow? | 09:29 |
*** florianf has quit IRC | 09:29 | |
ianw | odyssey4me: well, that's all relative :) i think that since nodepool is failing, it will keep looping until it gets a good build, which should hopefully be not too long after the changes commit | 09:30 |
*** yamamoto has joined #openstack-infra | 09:30 | |
ianw | odyssey4me: you can check for fresh images at http://nodepool.openstack.org/dib-image-list, and then see what's uploaded with http://nodepool.openstack.org/image-list | 09:31 |
ianw | i'm just about out here, but i imagine pabelanger at least will jump on things in a few hours when he gets online | 09:31 |
*** florianf has joined #openstack-infra | 09:35 | |
*** tosky has joined #openstack-infra | 09:35 | |
*** yamamoto has quit IRC | 09:38 | |
*** dizquierdo has quit IRC | 09:38 | |
hwoarang | ianw: ah thank you for the information | 09:41 |
egonzalez | Hi, noticed kolla ocata centos (source|binary) tar images return 403 Forbidden https://tarballs.openstack.org/kolla/images/ | 09:47 |
openstackgerrit | Rosario Di Somma proposed openstack-infra/shade master: WIP: Don't remove top-container element in the adapter https://review.openstack.org/484178 | 09:48 |
*** csomerville has quit IRC | 09:51 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Fix stackviz collect data https://review.openstack.org/474559 | 09:54 |
*** raissa_ has joined #openstack-infra | 09:54 | |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/diskimage-builder master: elements: openstack-ci-mirrors: Use openSUSE mirrors for gating jobs https://review.openstack.org/478443 | 09:55 |
*** isaacb_ has joined #openstack-infra | 10:01 | |
*** isaacb_ has quit IRC | 10:01 | |
*** markvoelker has joined #openstack-infra | 10:02 | |
*** isaacb has quit IRC | 10:04 | |
*** isaacb has joined #openstack-infra | 10:05 | |
*** gcb has quit IRC | 10:06 | |
openstackgerrit | Rosario Di Somma proposed openstack-infra/shade master: WIP: Don't remove top-container element in the adapter https://review.openstack.org/484178 | 10:06 |
*** liujiong has quit IRC | 10:06 | |
umbarkar | ianw : Looks like issue is still not resolved | 10:07 |
umbarkar | DIB image creation failing with same error | 10:07 |
*** jistr is now known as jistr|afk | 10:09 | |
AJaeger | odyssey4me: could you review https://review.openstack.org/#/c/484206/ , please? | 10:12 |
*** d0ugal has joined #openstack-infra | 10:13 | |
odyssey4me | AJaeger hmm, so the reason the opensuse jobs are 'voting' right now is because they're all in the experimental ipeline | 10:18 |
odyssey4me | *pipeline | 10:18 |
odyssey4me | so I would rather leave just non-voting jobs in place for them and name the experimental jobs accordingly | 10:18 |
odyssey4me | because once they're passing, they'll be propoted to non-voting | 10:19 |
odyssey4me | *promoted | 10:19 |
*** d0ugal has quit IRC | 10:19 | |
*** thorst has joined #openstack-infra | 10:28 | |
*** dizquierdo has joined #openstack-infra | 10:29 | |
*** LindaWang has quit IRC | 10:31 | |
*** thorst has quit IRC | 10:32 | |
*** markvoelker has quit IRC | 10:35 | |
*** yamamoto has joined #openstack-infra | 10:37 | |
*** tuanluong has quit IRC | 10:38 | |
*** wolverineav has joined #openstack-infra | 10:39 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: WIP: Add jobs dashboard https://review.openstack.org/466561 | 10:42 |
*** lucasagomes is now known as lucas-hungry | 10:49 | |
AJaeger | odyssey4me: we can move them once we use them elsewhere, we have far too many jobs defined that nobody uses... | 10:56 |
*** namnh has quit IRC | 10:57 | |
*** hashar has quit IRC | 10:59 | |
odyssey4me | AJaeger yep, I figured as much | 10:59 |
*** LindaWang has joined #openstack-infra | 10:59 | |
*** hashar has joined #openstack-infra | 11:01 | |
andreas_s | umbarkar, yes, the patch needs a backport to newton - newton is the branch that is actually broken... | 11:03 |
*** alexchadin has quit IRC | 11:04 | |
umbarkar | andreas_s : the patch https://review.openstack.org/#/c/484001/ is merged now | 11:05 |
umbarkar | I think this might solve the problem | 11:05 |
andreas_s | umbarkar, that one should solve it finally: https://review.openstack.org/#/c/484298/ | 11:06 |
andreas_s | umbarkar, it was only the newton branch that was broken... | 11:06 |
andreas_s | umbarkar, the cache-devstack elements iterates over all branches... | 11:06 |
umbarkar | andreas_s : ok | 11:08 |
umbarkar | thanks for the info | 11:08 |
*** thorst has joined #openstack-infra | 11:08 | |
*** mandre_away is now known as mandre | 11:08 | |
*** thorst has quit IRC | 11:09 | |
*** thorst has joined #openstack-infra | 11:16 | |
umbarkar | andreas_s : I think this should also merge - https://review.openstack.org/#/c/484299/1 | 11:28 |
umbarkar | to solve the problem | 11:28 |
openstackgerrit | Billy Olsen proposed openstack-infra/project-config master: Add charm-interface-gluster-peer for gluster peer relations https://review.openstack.org/484332 | 11:30 |
*** markvoelker has joined #openstack-infra | 11:32 | |
openstackgerrit | Billy Olsen proposed openstack-infra/project-config master: Add charm-interface-gluster-peer for gluster peer relations https://review.openstack.org/484332 | 11:33 |
*** dmellado_ has joined #openstack-infra | 11:38 | |
*** ldnunes has joined #openstack-infra | 11:44 | |
*** ccamacho is now known as ccamacho|lunch | 11:45 | |
*** ociuhandu has quit IRC | 11:46 | |
*** pgadiya has quit IRC | 11:47 | |
andymccr | Good morning infra - if we want to EOL the openstack-ansible repo (now that we've done a final patch to set all pointers to upstream mitaka-eol branches) is that something I can do, or do I need assistance? | 11:50 |
AJaeger | andymccr: http://lists.openstack.org/pipermail/openstack-infra/2017-July/005487.html - tagging you could do, but closing a branch not | 11:52 |
*** jcoufal has joined #openstack-infra | 11:55 | |
*** markvoelker has quit IRC | 11:56 | |
*** markvoelker has joined #openstack-infra | 11:57 | |
mordred | AJaeger: ++ guidance to teams for sure | 12:00 |
andymccr | AJaeger: thanks for the pointer! | 12:02 |
*** ociuhandu has joined #openstack-infra | 12:10 | |
*** LindaWang has quit IRC | 12:12 | |
*** rhallisey has joined #openstack-infra | 12:13 | |
*** jistr|afk is now known as jistr | 12:17 | |
*** LindaWang has joined #openstack-infra | 12:21 | |
*** dtantsur has joined #openstack-infra | 12:33 | |
*** jaypipes has joined #openstack-infra | 12:33 | |
*** prateek has quit IRC | 12:33 | |
*** blznblzn2 has joined #openstack-infra | 12:34 | |
*** dprince has joined #openstack-infra | 12:35 | |
*** rlandy has joined #openstack-infra | 12:36 | |
smcginnis | Anyone know how to check if we are getting failures syncing mirrors? | 12:37 |
smcginnis | Seeing an os-brick update failing because it couldn't find the released version. | 12:37 |
*** bobh has joined #openstack-infra | 12:37 | |
smcginnis | And other release jobs failing with things like this: http://logs.openstack.org/fc/fc04caefd46a441663ea7e82b380a08de9b2dba0/release-post/static-releases-publish/8ae945b/console.html#_2017-07-17_11_59_00_594690 | 12:37 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Write secrets into their own file, not into inventory https://review.openstack.org/479390 | 12:42 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Fail early if people attempt to add zuul vars or secrets https://review.openstack.org/484000 | 12:42 |
*** jkilpatr has joined #openstack-infra | 12:43 | |
*** BobBall has joined #openstack-infra | 12:47 | |
*** efoley has joined #openstack-infra | 12:48 | |
*** camunoz has joined #openstack-infra | 12:51 | |
*** blznblzn2 has quit IRC | 12:51 | |
*** bobh has quit IRC | 12:51 | |
*** bobh has joined #openstack-infra | 12:52 | |
*** prateek has joined #openstack-infra | 12:53 | |
*** kgiusti has joined #openstack-infra | 12:57 | |
*** alexchadin has joined #openstack-infra | 12:57 | |
*** camunoz has quit IRC | 12:59 | |
*** camunoz has joined #openstack-infra | 12:59 | |
*** gouthamr has joined #openstack-infra | 13:00 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 13:02 |
*** gcb has joined #openstack-infra | 13:06 | |
pabelanger | ianw: ack, watching now | 13:06 |
*** bobh has quit IRC | 13:08 | |
*** lucas-hungry is now known as lucasagomes | 13:09 | |
AJaeger | pabelanger, mordred, could you put https://review.openstack.org/#/q/status:open+project:openstack-infra/project-config+branch:master+topic:local_conf (using local_conf where possible) and https://review.openstack.org/#/c/484206/ (reduce number of unused ansible jobs) on your queues, please? These are just cleanups... | 13:09 |
*** Julien-zte has quit IRC | 13:10 | |
*** baoli has joined #openstack-infra | 13:10 | |
pabelanger | AJaeger: sure | 13:10 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Remove export commands from tox based roles https://review.openstack.org/483936 | 13:10 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Create tox_environment to allow users access to shell variables https://review.openstack.org/483935 | 13:10 |
*** Julien-zte has joined #openstack-infra | 13:10 | |
AJaeger | thanks, pabelanger | 13:10 |
*** bobh has joined #openstack-infra | 13:11 | |
*** gordc has joined #openstack-infra | 13:11 | |
*** adarazs_ has joined #openstack-infra | 13:14 | |
*** baoli has quit IRC | 13:14 | |
AJaeger | EmilienM: could you review https://review.openstack.org/484205 , please? Those tripleo jobs are unused, just want you check that this is your intention. | 13:14 |
EmilienM | AJaeger: ok | 13:15 |
*** adarazs_ is now known as adarazs | 13:15 | |
*** bobh has quit IRC | 13:16 | |
EmilienM | AJaeger: lgtm, thx for the cleanup | 13:16 |
*** sree has joined #openstack-infra | 13:16 | |
AJaeger | thanks for confirming, EmilienM | 13:16 |
dmsimard | clarkb, rcarrillocruz, mordred: does that seem sensible to you ? https://review.openstack.org/#/c/451396/ | 13:17 |
adarazs | infra-root: can I get a review please on https://review.openstack.org/482210 ? it's sitting there for a week and it would be fairly useful to get it in. passed the gates, has a +1. | 13:17 |
adarazs | it's from openstack-infra/puppet-openstackci | 13:18 |
*** ihrachys has joined #openstack-infra | 13:18 | |
openstackgerrit | Merged openstack-infra/project-config master: Use local_conf where possible https://review.openstack.org/484135 | 13:19 |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Create openstack-py35 job with upper-constraints https://review.openstack.org/483987 | 13:20 |
*** zhurong has quit IRC | 13:22 | |
*** scottda has joined #openstack-infra | 13:23 | |
*** lbragstad has quit IRC | 13:26 | |
*** baoli has joined #openstack-infra | 13:26 | |
*** gcb has quit IRC | 13:28 | |
dims | AJaeger : Hi, we are seeing some failures in static-release-publish jobs. have you seen this anywhere else? http://logs.openstack.org/cf/cff8ed7ec4c13da18942a893c1f6f67e5f750bee/release-post/static-releases-publish/f433fd9/console.html | 13:31 |
dims | AJaeger : zuul.exceptions.RevNotFound: Failed to checkout project 'openstack/releases' at revision 'cff8ed7ec4c13da18942a893c1f6f67e5f750bee' | 13:31 |
AJaeger | dims: no idea - let's ask infra-root. Looks like our git repos are not mirrorred correctly | 13:32 |
*** superdan is now known as dansmith | 13:33 | |
dims | Ack thanks AJaeger | 13:33 |
*** markvoelker_ has joined #openstack-infra | 13:33 | |
*** mriedem has joined #openstack-infra | 13:33 | |
dims | smcginnis : dhellmann : ^ | 13:33 |
*** markvoelker has quit IRC | 13:33 | |
rcarrillocruz | dmsimard: lgtm | 13:34 |
*** gordc has quit IRC | 13:35 | |
*** gordc has joined #openstack-infra | 13:35 | |
*** gordc has quit IRC | 13:35 | |
*** ociuhandu has quit IRC | 13:36 | |
pabelanger | AJaeger: dims: ya, looks like a possible mirroring issue. I'll see if I can find something in the logs | 13:36 |
dims | thanks pabelanger | 13:36 |
*** ociuhandu has joined #openstack-infra | 13:36 | |
dims | pabelanger : i have about 6 of them failures - http://lists.openstack.org/pipermail/release-job-failures/2017-July/date.html | 13:37 |
*** links has quit IRC | 13:37 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 13:38 |
*** markvoelker_ has quit IRC | 13:38 | |
*** markvoelker has joined #openstack-infra | 13:39 | |
jlvillal | I wonder why logs.openstack.org is listed as an ad-server? https://hosts-file.net/ad_servers.txt | 13:40 |
jlvillal | Noticed that this morning when my Pi-hole blocked access | 13:40 |
pabelanger | AJaeger: dims: have these jobs worked before? Also, does it make sense to be using zuul-cloner in a release-post pipeline? | 13:40 |
dmsimard | jlvillal: that's odd. "hpHosts is a community managed and maintained hosts file that allows an additional layer of protection against access to ad, tracking and malicious websites." | 13:40 |
jlvillal | dmsimard, Yeah, I was surprised too | 13:41 |
AJaeger | pabelanger: we switched to zuul-cloner some months ago, those should work | 13:41 |
*** bobh has joined #openstack-infra | 13:41 | |
*** ykarel has quit IRC | 13:42 | |
*** penguinolog has joined #openstack-infra | 13:43 | |
pabelanger | http://logs.openstack.org/fc/fc04caefd46a441663ea7e82b380a08de9b2dba0/release-post/tag-releases/c1b8c62/console.html worked with fc04caefd46a441663ea7e82b380a08de9b2dba0 then http://logs.openstack.org/fc/fc04caefd46a441663ea7e82b380a08de9b2dba0/release-post/static-releases-publish/8ae945b/console.html failed as the next job. Both used the same zuul-merger | 13:43 |
pabelanger | looking at logs on zm03 now | 13:43 |
dmsimard | jlvillal: https://hosts-file.net/?s=logs.openstack.org&x=0&y=0 "Added By: MysteryFCM" 03-12-2014 | 13:43 |
dmsimard | ¯\_(ツ)_/¯ | 13:43 |
*** gcb has joined #openstack-infra | 13:44 | |
pabelanger | seeing some puppet errors on zm03 | 13:44 |
pabelanger | http://paste.openstack.org/show/615612/ | 13:45 |
pabelanger | seem to be using python3 on zm03 | 13:45 |
openstackgerrit | Thomas Herve proposed openstack-infra/project-config master: Add py3 gate to heat agents. https://review.openstack.org/484377 | 13:45 |
pabelanger | Wonder if that is left over from a few months back when I added pip3 to servers | 13:45 |
*** xyang1 has joined #openstack-infra | 13:47 | |
pabelanger | ya, some reason zm03 is python3 for pip | 13:47 |
*** beekneemech is now known as bnemec | 13:48 | |
*** gcb has quit IRC | 13:48 | |
*** gcb has joined #openstack-infra | 13:49 | |
*** yamamoto has quit IRC | 13:49 | |
*** sree has quit IRC | 13:50 | |
*** esberglu has joined #openstack-infra | 13:50 | |
*** felipemonteiro has joined #openstack-infra | 13:51 | |
*** sbezverk has quit IRC | 13:51 | |
*** sbezverk has joined #openstack-infra | 13:51 | |
pabelanger | k, pip fixes | 13:52 |
pabelanger | fixed* | 13:52 |
*** felipemonteiro__ has joined #openstack-infra | 13:53 | |
pabelanger | let me watch logs to see if puppet is working first | 13:53 |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Create openstack-py35 job with upper-constraints https://review.openstack.org/483987 | 13:53 |
pabelanger | AJaeger: so, ^ would be a new example of how to setup some tox things | 13:54 |
pabelanger | AJaeger: specifically, we are exporing UPPER_CONSTRAINTS_FILE to bash and pip will install from that path, over copying the file into the working git tree | 13:55 |
pabelanger | AJaeger: so far, seems to be working well | 13:55 |
*** ldnunes has quit IRC | 13:55 | |
pabelanger | AJaeger: https://review.openstack.org/#/c/484027 shows an example of it being run | 13:56 |
*** felipemonteiro has quit IRC | 13:56 | |
pabelanger | mordred: clarkb: fungi: it would be great to land: https://review.openstack.org/#/c/484029/ fixes reloads on zuulv3.o.o | 13:58 |
*** zhurong has joined #openstack-infra | 13:59 | |
*** zhurong has quit IRC | 13:59 | |
AJaeger | pabelanger: interesting - thanks | 14:00 |
fungi | confirmed, gerrit doesn't indicate any trouble syncing to mirrors and those failures look like trouble getting zuul refs from the mergers | 14:01 |
*** sree has joined #openstack-infra | 14:01 | |
dims | fungi : pabelanger : how do we fix it? | 14:02 |
pabelanger | AJaeger: http://logs.openstack.org/27/484027/2/check/openstack-py35/e5492c9/ is the output of openstack-py35 | 14:03 |
*** rbrndt has joined #openstack-infra | 14:03 | |
fungi | pabelanger: to finally fix the python3 default issue on the persistent nodes i had to do `sudo python2.7 -m pip install -U --force pip setuptools tox virtualenv` | 14:03 |
pabelanger | dims: fungi: I am just waiting for puppet to run on the server first, making sure it is running the latest versions of things we expect | 14:03 |
pabelanger | fungi: oh, right. let me confirm | 14:03 |
dims | cool thanks, will hold releases till we get past this | 14:03 |
*** dhajare has quit IRC | 14:03 | |
fungi | pabelanger: though that was also after the symlinks for pip had been corrected, so probably also need double-checking | 14:03 |
pabelanger | fungi: ya, symlinks are correct | 14:04 |
pabelanger | and command run again | 14:04 |
fungi | strange that the failures just now cropped up though | 14:04 |
*** chlong has joined #openstack-infra | 14:05 | |
pabelanger | I think it might be unrelated, but puppet has been failing on the server for a while | 14:05 |
*** EricGonczer_ has joined #openstack-infra | 14:05 | |
pabelanger | fungi: I also was seeing some DNS issues from this morning | 14:06 |
pabelanger | http://paste.openstack.org/show/615615/ | 14:06 |
pabelanger | trying to see if that fits into the timeline that dims is reporting | 14:06 |
fungi | i'm going to git fsck a copy of the releases repo from zm03 | 14:07 |
*** sree_ has joined #openstack-infra | 14:07 | |
*** sree_ is now known as Guest35636 | 14:07 | |
fungi | looks intact | 14:07 |
*** winggundamth has quit IRC | 14:08 | |
fungi | also git show on that rev from the example failed static-releases-publish job works fine | 14:08 |
pabelanger | I am seeing a few errors in merger-debug.log | 14:08 |
pabelanger | but nothing for release.git just yet | 14:08 |
*** EricGonc_ has joined #openstack-infra | 14:08 | |
pabelanger | I wonder if they are normal becase of merge conflicts | 14:09 |
*** yamamoto has joined #openstack-infra | 14:09 | |
*** yamamoto has quit IRC | 14:09 | |
fungi | http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=134 is really weird | 14:09 |
*** rnoriega_ has joined #openstack-infra | 14:09 | |
*** sree has quit IRC | 14:10 | |
pabelanger | odd | 14:10 |
*** chlong has quit IRC | 14:10 | |
fungi | like we lost snmp access to zm03 in mid-september and regained it today around 10:15 utc | 14:10 |
*** EricGonczer_ has quit IRC | 14:10 | |
*** otherwiseguy_ has joined #openstack-infra | 14:10 | |
fungi | er, 10:25 utc i mean | 14:11 |
pabelanger | fungi: that is around the time when DNS finally came back online | 14:11 |
pabelanger | I wonder if firewall was caching old DNS? | 14:11 |
*** hongbin has joined #openstack-infra | 14:11 | |
pabelanger | when new dns started working, it finally updated | 14:11 |
*** alexchadin has quit IRC | 14:11 | |
fungi | why would we have new dns? uptime on this server is 418 days | 14:11 |
pabelanger | doesn't firewall allow inbound requests from cacti.o.o? | 14:12 |
*** adisky__ has quit IRC | 14:12 | |
pabelanger | IIRC, mid-sept is when we did our server upgrades to trusty | 14:12 |
fungi | oh, new ip address for the cacti server | 14:12 |
fungi | 276 days uptime on cacti.o.o | 14:13 |
* fungi does the math | 14:13 | |
pabelanger | Ya, I just guessing right now | 14:13 |
*** ldnunes has joined #openstack-infra | 14:14 | |
fungi | looks like early october was when this was built (october 3 i believe) | 14:14 |
pabelanger | ya, that makes sense, cause I see an outage for other zuul-mergers in Oct | 14:15 |
pabelanger | but they seems to recover much faster | 14:15 |
fungi | but our snmp data for zm03 ceases in mid-september, at least a couple weeks before cacti.o.o was replaced | 14:15 |
pabelanger | Right, but I see the same lose of data around sept for other mergers for some reason | 14:16 |
pabelanger | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=2166&rra_id=all | 14:16 |
jlvillal | Fix for broken ironic-inspector gate job: https://review.openstack.org/483059 | 14:16 |
pabelanger | fungi: wasn't rcarrillocruz playing around with cacti around that time? | 14:16 |
jlvillal | Reviews would be appreciated. Change to devstack-gate ^^^ | 14:16 |
*** rnoriega_ has quit IRC | 14:16 | |
*** otherwiseguy_ has quit IRC | 14:16 | |
fungi | pabelanger: oh, maybe. i do see a brief mid-september gap on zm04 data as well | 14:17 |
*** LindaWang has quit IRC | 14:17 | |
fungi | same on zm01 and zm02 | 14:17 |
*** LindaWang has joined #openstack-infra | 14:18 | |
fungi | though those all look like about a week after zm03 data stops | 14:18 |
fungi | so anyway, snmp data magically wakes up for zm03 at 10:25 today after ~10 months of silence. job failures were going on more than 90 minutes after that | 14:19 |
fungi | so anyway, assuming for a moment that all that is unrelated circumstance and focusing on the job failure logs... | 14:21 |
*** tushar has joined #openstack-infra | 14:22 | |
fungi | are we guaranteed that non-zuul-built refs (in this case post pipeline jobs acting on a commit freshly merged by gerrit) will be available from zuul mergers? | 14:23 |
fungi | looks like it's taken care of these days | 14:28 |
fungi | from the merger-debug.log on zm03: | 14:28 |
fungi | 2017-07-17 11:56:35,126 DEBUG zuul.Repo: Checking out fc04caefd46a441663ea7e82b380a08de9b2dba0 | 14:28 |
*** gordc has joined #openstack-infra | 14:28 | |
pabelanger | Ya, I am not sure | 14:29 |
fungi | that's roughly 2 minutes 25 seconds before the job fails to retrieve the same ref | 14:29 |
pabelanger | Why I was asking why we'd be using zuul cloner for post pipelines | 14:29 |
*** lbragstad has joined #openstack-infra | 14:29 | |
*** marst has quit IRC | 14:30 | |
AJaeger | pabelanger: we have some jobs - think coverage - that run in both post and check/gate pipeles | 14:31 |
AJaeger | pabelanger: we fixed a few bugs in zuul-cloner so that we can use it everywhere. see also https://review.openstack.org/454461 | 14:32 |
pabelanger | AJaeger: okay, thanks | 14:32 |
AJaeger | pabelanger: https://review.openstack.org/452879 | 14:33 |
fungi | yeah, so anyway it _looks_ like that ref should have been available from zm03 well before the job attempted to request it | 14:33 |
*** trown is now known as trown|brb | 14:34 | |
dmsimard | pabelanger: doesn't that ring the same bell as what we've seen in review.rdoproject.org ? Zuul failing to pick up a ref that has already been merged ? | 14:35 |
*** gyee has joined #openstack-infra | 14:37 | |
dmsimard | Not that I have anything worthwhile to share, I haven't noticed the problem happening in recent history (did it disappear?). I know that for some particularly problematic "POST" pipeline jobs, we moved from a zuul cloner to a git clone and that worked around the issue. | 14:37 |
*** trown|brb is now known as trown | 14:39 | |
*** esberglu has quit IRC | 14:40 | |
*** yamamoto has joined #openstack-infra | 14:40 | |
*** cshastri has quit IRC | 14:41 | |
fungi | here are all the entries in the apache access log for zm03 corresponding to the node which ran that failed job: http://paste.openstack.org/show/615619/ | 14:41 |
fungi | the times correspond to when it attempted (and failed) to retrieve fc04caefd46a441663ea7e82b380a08de9b2dba0 | 14:42 |
fungi | nothing from that timeframe in any apache error logs | 14:42 |
fungi | the node seems (as expected) to have communicated only from its ipv6 address. no hits in the apache log for the node's v4 addy | 14:43 |
*** isaacb has quit IRC | 14:45 | |
*** yamamoto has quit IRC | 14:46 | |
*** marst has joined #openstack-infra | 14:46 | |
*** psachin has quit IRC | 14:48 | |
smcginnis | Not safe to recheck anything yet, right? | 14:52 |
*** sshnaidm|off has joined #openstack-infra | 14:52 | |
AJaeger | smcginnis: you cannot recheck a post job | 14:53 |
smcginnis | Jobs that are failing to find things not synced to mirrors. | 14:53 |
*** armax has joined #openstack-infra | 14:53 | |
AJaeger | smcginnis: do you have other examples? | 14:53 |
pabelanger | which job is that? | 14:53 |
smcginnis | U-C patch for os-brick failed with not finding the new version. Maybe unrelated? | 14:54 |
* smcginnis gets link | 14:54 | |
fungi | or... if the actual problem is network connectivity/dns lookup failures then maybe it could be related | 14:55 |
*** esberglu has joined #openstack-infra | 14:55 | |
fungi | but the post(-release) pipeline failures reported looked like an issue retrieving refs from zuul mergers not from git mirrors | 14:56 |
*** esberglu has quit IRC | 14:56 | |
smcginnis | Hmm, this is actually a different failure than I saw earlier, but could be another symptom: https://review.openstack.org/#/c/484342/ | 14:56 |
*** esberglu has joined #openstack-infra | 14:57 | |
AJaeger | smcginnis: do you mean http://logs.openstack.org/42/484342/1/check/gate-requirements-tox-py27-check-uc-ubuntu-xenial/b369b67/console.html#_2017-07-17_12_11_33_232384 ? | 14:57 |
AJaeger | "No matching distribution found for os-brick===1.15.1" ? | 14:57 |
smcginnis | AJaeger: Yep, that's the one. | 14:58 |
*** armax has quit IRC | 14:58 | |
*** yamahata has joined #openstack-infra | 14:59 | |
*** Guest35636 has quit IRC | 14:59 | |
*** LindaWang has quit IRC | 15:02 | |
*** sshnaidm|off has quit IRC | 15:03 | |
*** Goneri has joined #openstack-infra | 15:03 | |
*** csomerville has joined #openstack-infra | 15:03 | |
*** sshnaidm has joined #openstack-infra | 15:05 | |
*** armax has joined #openstack-infra | 15:06 | |
*** sshnaidm is now known as sshnaidm|off | 15:06 | |
*** gyee has quit IRC | 15:06 | |
*** rwsu has joined #openstack-infra | 15:06 | |
*** tushar has quit IRC | 15:06 | |
jeblair | fungi, pabelanger: is there something i need to look into? | 15:06 |
fungi | jeblair: not sure yet. we have an example of post-release jobs failing to checkout refs from zm03 | 15:07 |
*** gyee has joined #openstack-infra | 15:08 | |
fungi | smcginnis: the requirements/constraints check jobs sometimes race with pypi publication, so that failure of yours isn't necessarily alarming (i need to check the timing on it though to see whether it's the known race) | 15:08 |
*** jbadiapa has quit IRC | 15:08 | |
*** jbadiapa has joined #openstack-infra | 15:09 | |
*** andreas_s has quit IRC | 15:10 | |
jeblair | fungi, pabelanger: what's the relation with dns? i don't understand what about dns would have changed recently | 15:10 |
pabelanger | fungi: okay, I have deleted the ipv6 test network we (I) added into la1. I am hoping that will then have openstack drop IPv6 from the mirror server | 15:10 |
pabelanger | fungi: monitoring now | 15:11 |
smcginnis | fungi: That was my assumption at first, but then got suspicious with the other failures. I'll try recheckingn and see if that's the case. | 15:11 |
pabelanger | jeblair: fungi: I don't know DNS is the issue, but I did see DNS failures in zm03 logs this morning | 15:11 |
fungi | jeblair: pabelanger said he saw some dns lookup failures earlier and theorized they might be related, though i see evidence in the zm03 apache log that a node in one of the examples did connect and make requests so that seems an unlikely explanation | 15:11 |
fungi | and in the zm03 merger log that it checked out one of the refs in question successfully (and so should have been able to serve it) minutes before the job node requested it | 15:12 |
jeblair | fungi, pabelanger: it looks like zm03 hasn't been online until this morning | 15:12 |
fungi | smcginnis: that failure is roughly 2 minutes after the pypi upload for the offending release so odds are it tried to hit our pypi mirror before the next 5-minute update pulse completed | 15:13 |
pabelanger | jeblair: online for zuul.o.o? | 15:13 |
fungi | jeblair: i saw in the cacti logs that we had no stats collected between the middle of september and 10:25 utc today | 15:13 |
pabelanger | I mean, where are you looking to see that | 15:13 |
jeblair | pabelanger: correct. the debug logs are filled with failed connection attempts from as far back as they go until this morning. | 15:13 |
pabelanger | Hmm | 15:13 |
fungi | for zm03 specifically | 15:13 |
fungi | so it may have had some sort of network issue up until "something" magically fixed it this morning? | 15:14 |
jeblair | 2017-07-17 10:24:10,466 ERROR gear.Worker.Zuul Merger: Exception while connecting to <gear.Connection 0x7f5cad4e4590 host: zuul.openstack.org port: 4730> | 15:14 |
jeblair | gaierror: [Errno -2] Name or service not known | 15:14 |
jeblair | 2017-07-17 10:24:12,567 DEBUG zuul.MergeServer: Registering | 15:14 |
pabelanger | right, I haven't seen how far back that went | 15:14 |
jeblair | that's the demarcation between broken and fixed | 15:14 |
*** ociuhandu has quit IRC | 15:14 | |
jeblair | a month at least | 15:14 |
fungi | 10:25 is also when cacti suddenly started being able to collect stats from it (give or take 5 mniutes) | 15:14 |
pabelanger | jeblair: ya, I see that now | 15:14 |
pabelanger | didn't check pass this morning | 15:15 |
jeblair | fungi: weirdly, there were snmp connection from cacti before then, only about half as many as after | 15:16 |
pabelanger | have we see a job pass using zm03 this morning? Wonder if we should consider leaving it offline | 15:17 |
fungi | jeblair: snmp over udp, so possible the replies never made it back until today | 15:17 |
fungi | starting to look like maybe the server was able to receive packets but not send packets or something | 15:17 |
jeblair | fungi: that makes sense | 15:18 |
fungi | so thought it was replying to snmp queries but was unaware they never got to the destination | 15:18 |
jeblair | Jul 17 12:54:09 zm03 puppet-user[8471]: (/Stage[main]/Zuul/Exec[install_zuul]) Dependency Package[yappi] has failures: true | 15:19 |
jeblair | Jul 17 12:54:09 zm03 puppet-user[8471]: (/Stage[main]/Zuul/Exec[install_zuul]) Skipping because of failed dependencies | 15:19 |
jeblair | this suggests that we're running an old version of zuul | 15:19 |
jeblair | there have been bugfixes related to having the correct refs for post jobs since, erm, september is when we're saying this server went awol? :) | 15:19 |
fungi | jeblair: pabelanger did mention puppet has been unable to update the server | 15:20 |
fungi | so i wouldn't be surprised at this point | 15:20 |
jeblair | i'm inclined to assume it's related to those bugs and suggest we stop z-m, repair the puppet, install new zuul, and then restart | 15:20 |
fungi | i concur | 15:20 |
pabelanger | Ya, that is what I am doing now | 15:20 |
fungi | thanks pabelanger! | 15:21 |
pabelanger | Puppet is reporting fixed now | 15:21 |
pabelanger | so we should be able to reinstall zuul | 15:21 |
pabelanger | then restart | 15:21 |
jeblair | pabelanger: if puppet is fixed, it should have installed zuul itself | 15:22 |
jeblair | Zuul version: 2.5.1.dev16 | 15:22 |
pabelanger | checking logs | 15:22 |
*** Julien-zte has quit IRC | 15:22 | |
jeblair | i think we're at 2.5.2 now | 15:22 |
pabelanger | Jul 17 14:54:15 zm03 puppet-user[3320]: Finished catalog run in 5.23 seconds | 15:23 |
pabelanger | but no reinstall of puppet | 15:23 |
pabelanger | I think we only reinstall if git changes? | 15:23 |
pabelanger | oh | 15:23 |
pabelanger | it did try to reinstall at 10:35 | 15:23 |
pabelanger | by failed because of python pip2/pip3 issue | 15:24 |
pabelanger | I think we might have to manually install | 15:24 |
jeblair | ok | 15:24 |
fungi | smcginnis: so here's when our pypi mirror updated for os-brick 1.15.1: http://paste.openstack.org/show/615627/ | 15:26 |
smcginnis | fungi: Great, thank you. Looks like the recheck is fine, so just bad timing. | 15:27 |
fungi | smcginnis: that's a minute and 26 seconds after the failed job tried to retrieve it, for what it's worth | 15:27 |
fungi | so yes, the known race we have currently | 15:27 |
pabelanger | jeblair: zuul==2.5.3.dev1 | 15:27 |
pabelanger | that is now installed | 15:27 |
pabelanger | same version we have on zm04 | 15:27 |
fungi | the release team has plans to eventually implement some sort of delay or active wait in the release jobs to solve it in the future | 15:28 |
fungi | smcginnis: ^ | 15:28 |
pabelanger | jeblair: safe to just service zuul-merger stop; service zuul-merger start ? | 15:28 |
jeblair | pabelanger: ++ | 15:28 |
*** Julien-zte has joined #openstack-infra | 15:29 | |
pabelanger | jeblair: fungi: dims okay, zm03.o.o updated to latest zuul (master branch) and restarted | 15:29 |
fungi | thanks pabelanger! | 15:30 |
dims | w00t thanks pabelanger | 15:30 |
pabelanger | jeblair: just looking at puppetmaster logs, can jeblairtest be deleted? puppet is failing to run there too | 15:31 |
fungi | so post mortem here is that there was probably some long-standing network connectivity issue for zm03 which resulted in it missing 10 months of zuul bug fixes, one of which was likely the culprit for the post-release job failing to retrieve that ref? | 15:31 |
*** annegentle has joined #openstack-infra | 15:31 | |
jeblair | pabelanger: yep | 15:31 |
pabelanger | fungi: right, and when it did come back online, pip2 / pip3 was broken, so we didn't pick up latest zuul | 15:32 |
pabelanger | jeblair: thanks | 15:32 |
jeblair | pabelanger, fungi: any other zm servers like this? | 15:32 |
fungi | pabelanger: jeblair: oh, i keep meaning to ask about jeblairtest too. it's been sending cronspam to our sysadmins list for months about unattended upgrades, and subsequently causing backwash delivery failures because most people's mailservers are refusing to accept delivery due to missing reverse dns | 15:32 |
pabelanger | jeblair: fungi: I can audit quickly | 15:33 |
*** sree has joined #openstack-infra | 15:33 | |
fungi | ultimately i get ~4 e-mails a day from jeblairtest (and i may be the only one receiving them since the missing reverse dns isn't quite enough to bump those over my spam classification threshold) | 15:34 |
pabelanger | fungi: jeblair: we have the correct version of zuul running on other mergers | 15:34 |
*** ociuhandu has joined #openstack-infra | 15:35 | |
fungi | pabelanger: thanks for checking | 15:35 |
pabelanger | fungi: ya, I've been getting that too | 15:35 |
*** chlong has joined #openstack-infra | 15:36 | |
*** annegentle has quit IRC | 15:36 | |
*** sree has quit IRC | 15:37 | |
*** chlong has quit IRC | 15:38 | |
pabelanger | okay, jeblairtest server deleted | 15:38 |
*** annegentle has joined #openstack-infra | 15:39 | |
*** david-lyle has joined #openstack-infra | 15:40 | |
*** chlong has joined #openstack-infra | 15:45 | |
*** xarses_ has joined #openstack-infra | 15:48 | |
*** wolverineav has quit IRC | 15:50 | |
*** wolverineav has joined #openstack-infra | 15:50 | |
*** ociuhandu has quit IRC | 15:50 | |
*** ociuhandu has joined #openstack-infra | 15:52 | |
*** camunoz has quit IRC | 15:53 | |
*** wolverineav has quit IRC | 15:54 | |
*** wolverineav has joined #openstack-infra | 15:56 | |
*** isaacb has joined #openstack-infra | 15:56 | |
openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Propose patches to os-service-types from service-types-authority https://review.openstack.org/484407 | 15:57 |
*** Julien-zte has quit IRC | 15:59 | |
*** Julien-zte has joined #openstack-infra | 16:00 | |
*** Julien-zte has quit IRC | 16:00 | |
*** Julien-zte has joined #openstack-infra | 16:01 | |
*** Julien-zte has quit IRC | 16:01 | |
*** xarses_ has quit IRC | 16:01 | |
*** Julien-zte has joined #openstack-infra | 16:01 | |
*** egonzalez has quit IRC | 16:02 | |
*** Julien-zte has quit IRC | 16:02 | |
*** isaacb has quit IRC | 16:02 | |
*** Julien-zte has joined #openstack-infra | 16:02 | |
*** iyamahat has joined #openstack-infra | 16:02 | |
*** rkukura has joined #openstack-infra | 16:02 | |
*** Julien-zte has quit IRC | 16:02 | |
*** Julien-zte has joined #openstack-infra | 16:03 | |
*** armax has quit IRC | 16:03 | |
*** Julien-zte has quit IRC | 16:03 | |
*** Julien-zte has joined #openstack-infra | 16:04 | |
*** Julien-zte has quit IRC | 16:04 | |
*** EricGonc_ has quit IRC | 16:04 | |
*** hashar is now known as hasharAway | 16:04 | |
*** Julien-zte has joined #openstack-infra | 16:04 | |
*** Julien-zte has quit IRC | 16:05 | |
*** EricGonczer_ has joined #openstack-infra | 16:05 | |
*** Julien-zte has joined #openstack-infra | 16:05 | |
*** Julien-zte has quit IRC | 16:06 | |
*** Julien-zte has joined #openstack-infra | 16:06 | |
*** Julien-zte has quit IRC | 16:06 | |
*** Julien-zte has joined #openstack-infra | 16:07 | |
*** Julien-zte has quit IRC | 16:07 | |
*** Hal has quit IRC | 16:08 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Simplify _deleteLocalBuild parameters https://review.openstack.org/484413 | 16:10 |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Support UUID as builder identifier https://review.openstack.org/484414 | 16:10 |
*** prateek has quit IRC | 16:14 | |
*** Apoorva has joined #openstack-infra | 16:18 | |
*** rcernin_ has quit IRC | 16:19 | |
openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Support dynamic dependent pipeline additions https://review.openstack.org/483597 | 16:20 |
*** derekh has quit IRC | 16:23 | |
openstackgerrit | Merged openstack-infra/zuul-jobs master: Update to tox_envlist variable https://review.openstack.org/483934 | 16:24 |
pabelanger | 2017-07-17 16:15:10,910 p=31048 u=root | mirror.la1.citycloud.openstack.org : ok=8 changed=3 unreachable=0 failed=0 | 16:29 |
pabelanger | fungi: ^ | 16:29 |
pabelanger | fungi: so, no need to rebuild our server | 16:29 |
*** csomerville has quit IRC | 16:29 | |
pabelanger | fungi: puppet back to using ipv4 | 16:29 |
pabelanger | which means we can now land our revert: https://review.openstack.org/#/c/484008/ | 16:30 |
fungi | pabelanger: i manually edited the inventory on friday to get it to use ipv4... any idea what's changed to get the dynamic inventory picking the ipv4 address now? | 16:30 |
pabelanger | fungi: I purged the cache file to have it regenerate | 16:31 |
fungi | yeah, i did that a few times as well last week | 16:31 |
pabelanger | fungi: and removed our openstack-network-ipv6 from la1 | 16:31 |
fungi | aha, that may be what did it | 16:31 |
pabelanger | that was providing ipv6 to the server | 16:31 |
*** ralonsoh has quit IRC | 16:31 | |
fungi | indeed, openstack server list there is now only showing the v4 address | 16:31 |
pabelanger | openstack-subnet-ipv6 sorry :) | 16:31 |
fungi | and network show openstackci-network1 only shows the one subnet connected now | 16:32 |
fungi | so that's what seems to have done the trick. thanks! | 16:32 |
pabelanger | sure, np | 16:32 |
fungi | i was having trouble figuring out how to view subnet details with openstackclient | 16:32 |
*** annegentle has quit IRC | 16:37 | |
*** EricGonczer_ has quit IRC | 16:38 | |
*** knikolla has quit IRC | 16:40 | |
*** EricGonczer_ has joined #openstack-infra | 16:40 | |
*** annegentle has joined #openstack-infra | 16:41 | |
*** spotz has quit IRC | 16:42 | |
*** rhagarty has quit IRC | 16:43 | |
*** spotz has joined #openstack-infra | 16:45 | |
*** yamahata has quit IRC | 16:46 | |
*** rhagarty has joined #openstack-infra | 16:47 | |
*** iyamahat has quit IRC | 16:47 | |
*** lucasagomes is now known as lucas-afk | 16:47 | |
*** dizquierdo has quit IRC | 16:48 | |
openstackgerrit | James E. Blair proposed openstack-infra/openstack-zuul-jobs master: Use zuul-jobs style var names in run-docs https://review.openstack.org/484075 | 16:51 |
*** trown is now known as trown|lunch | 16:51 | |
*** vhosakot has joined #openstack-infra | 16:53 | |
openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Use zuul-jobs style var names in run-docs https://review.openstack.org/484075 | 16:54 |
*** ociuhandu has quit IRC | 16:56 | |
*** martinkopec has quit IRC | 16:56 | |
AJaeger | project-config cores, could you put https://review.openstack.org/#/q/status:open+project:openstack-infra/project-config+branch:master+topic:local_conf (using local_conf where possible) and https://review.openstack.org/#/c/484206/ (reduce number of unused ansible jobs) https://review.openstack.org/484205 (remove unused jobs) on your queues, please? These are just cleanups... | 16:57 |
AJaeger | ihrachys, could you review https://review.openstack.org/484207 , please? | 16:58 |
*** vhosakot has quit IRC | 16:58 | |
*** vhosakot has joined #openstack-infra | 16:58 | |
*** vhosakot_ has joined #openstack-infra | 17:01 | |
ihrachys | AJaeger, need to ask old folks about the job. vpnaas is not part of neutron so that's not a question to me whether their job is needed. | 17:02 |
ihrachys | *old -> odl | 17:02 |
openstackgerrit | Merged openstack-infra/project-config master: Use log_path from zuul logserver hostvars https://review.openstack.org/484073 | 17:02 |
*** chlong has quit IRC | 17:03 | |
*** vhosakot has quit IRC | 17:03 | |
AJaeger | ihrachys: those jobs are not run at all, so should be safe - just wanted you to double check that not using them is fine. | 17:06 |
*** iyamahat has joined #openstack-infra | 17:06 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Add project_id parameter to list_volumes https://review.openstack.org/484430 | 17:06 |
AJaeger | ihrachys: but please do ask odl folks | 17:06 |
ihrachys | AJaeger, yeah, that's the main question | 17:06 |
ihrachys | AJaeger, it seems they have a job for v2 driver | 17:06 |
ihrachys | with vpnservice | 17:06 |
ihrachys | whatever it means | 17:06 |
ihrachys | I suspect it's a superset of the one you kill | 17:07 |
ihrachys | but I will reach to them | 17:07 |
AJaeger | ihrachys: thanks | 17:07 |
*** jascott1 has joined #openstack-infra | 17:09 | |
*** ilpianista_ has quit IRC | 17:10 | |
*** masayukig[m] has quit IRC | 17:11 | |
*** armax has joined #openstack-infra | 17:12 | |
openstackgerrit | sebastian marcet proposed openstack-infra/system-config master: OpenStackId release 1.0.22 * updated login form remember me text * added fav icons * updated base url param https://review.openstack.org/484431 | 17:12 |
openstackgerrit | sebastian marcet proposed openstack-infra/system-config master: OpenStackId release 1.0.22 https://review.openstack.org/484431 | 17:12 |
*** jascott1 has quit IRC | 17:12 | |
*** yamahata has joined #openstack-infra | 17:13 | |
*** ldnunes has quit IRC | 17:15 | |
*** GheRiver1 has joined #openstack-infra | 17:15 | |
*** GheRiver1 has quit IRC | 17:15 | |
openstackgerrit | Merged openstack-infra/project-config master: Revert "Set citycloud-la1 max-server to 0" https://review.openstack.org/484008 | 17:15 |
*** harlowja has joined #openstack-infra | 17:17 | |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Ensure we load roles for linting https://review.openstack.org/484043 | 17:18 |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Include ansible-playbook syntax-check for tox pep8 https://review.openstack.org/484045 | 17:18 |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Rename pep8 to linters for tox https://review.openstack.org/484046 | 17:18 |
pabelanger | mordred: jeblair: ^ is ready for review | 17:18 |
*** ihrachys has quit IRC | 17:18 | |
*** jascott1 has joined #openstack-infra | 17:18 | |
pabelanger | mordred: jeblair: once landed, I'll make the same update to zuul-jobs for linting | 17:19 |
*** chlong has joined #openstack-infra | 17:20 | |
*** ilpianista_ has joined #openstack-infra | 17:20 | |
fungi | anyone up for a very quick review which changes one character in the system-config repo? https://review.openstack.org/484431 (bumps openstackid release in production) | 17:22 |
fungi | this will bring it back into sync with openstackid-dev | 17:22 |
pabelanger | fungi: trade you: https://review.openstack.org/#/c/482592/ | 17:24 |
pabelanger | fedora-26 mirror | 17:24 |
fungi | oh right, thanks! i meant to review that one | 17:24 |
fungi | lgtm | 17:26 |
*** smarcet has joined #openstack-infra | 17:26 | |
*** ldnunes has joined #openstack-infra | 17:28 | |
*** yamahata has quit IRC | 17:33 | |
*** yamahata has joined #openstack-infra | 17:34 | |
*** prateek has joined #openstack-infra | 17:34 | |
*** tosky has quit IRC | 17:35 | |
*** masayukig[m] has joined #openstack-infra | 17:37 | |
*** sambetts is now known as sambetts|afk | 17:38 | |
pabelanger | fungi: thanks | 17:38 |
*** efoley has quit IRC | 17:38 | |
fungi | y | 17:40 |
*** eranrom has joined #openstack-infra | 17:56 | |
*** iyamahat_ has joined #openstack-infra | 17:57 | |
*** iyamahat has quit IRC | 17:57 | |
*** eranrom has quit IRC | 17:58 | |
*** eranrom has joined #openstack-infra | 17:58 | |
*** Douhet has quit IRC | 17:59 | |
*** trown|lunch is now known as trown | 18:00 | |
dmsimard | pabelanger: are nodepool builder logs still available ? I had a bookmark for http://nb01.openstack.org/dib.centos-7.log but it doesn't look like that works | 18:00 |
fungi | dmsimard: checked on nb02? | 18:00 |
fungi | or 03 or 04 | 18:00 |
*** tesseract has quit IRC | 18:01 | |
fungi | i think 01 and 02 are decommissioned, replaced by 03 and 04 now | 18:01 |
pabelanger | dmsimard: nb03, nb04 now | 18:01 |
dmsimard | ah 03 and 04 works, 01 and 02 don't | 18:01 |
dmsimard | tahnks | 18:01 |
fungi | rebuilt on ubuntu xenial instead of trusty a month or so ago | 18:01 |
dmsimard | thanks* | 18:01 |
pabelanger | images are down atm | 18:01 |
pabelanger | waiting on devstack fix to land | 18:01 |
pabelanger | hopefully today | 18:01 |
fungi | pabelanger: we can enqueue/promote those changes if the devstack reviewers approve them | 18:02 |
fungi | since it sounds like the old images are stuck on a problematic setuptools version as well | 18:02 |
pabelanger | fungi: sure, we can do that | 18:02 |
pabelanger | let me promote | 18:03 |
fungi | the sooner those get rebuilt, the sooner teh jobs stuck on setuptools issues will get moving again | 18:03 |
pabelanger | 484299 is the last we need | 18:03 |
pabelanger | ++ | 18:03 |
*** electrofelix has quit IRC | 18:04 | |
*** Douhet has joined #openstack-infra | 18:04 | |
pabelanger | k, promoted | 18:05 |
*** dtantsur is now known as dtantsur|afk | 18:07 | |
*** felipemonteiro__ has quit IRC | 18:07 | |
openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Fix reference to zuul logserver https://review.openstack.org/484441 | 18:07 |
*** tosky has joined #openstack-infra | 18:09 | |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: WIP Testing changes required to move 3nodes job to quickstart https://review.openstack.org/483077 | 18:09 |
*** electrofelix has joined #openstack-infra | 18:10 | |
*** electrofelix has quit IRC | 18:14 | |
inc0 | hey, so zuul v3 secrets, how will I access them? | 18:15 |
inc0 | I don't assume there will be ENV with them?:) | 18:15 |
fungi | inc0: there will be a command-line tool/recipe you can use to encrypt them for use by zul's rsa keypair | 18:16 |
fungi | er, zuul's | 18:17 |
fungi | sorry zul! | 18:17 |
inc0 | encrypt or decryt? | 18:17 |
inc0 | I'll have to run docker login $username $password, how do I do that? | 18:17 |
fungi | inc0: oh, now i see what you're asking. zuul will provide it to the job in a decrypted form yes. double-checking what that protocol looks like now | 18:18 |
fungi | inc0: http://specs.openstack.org/openstack-infra/infra-specs/specs/zuulv3.html#secrets addresses the management aspects of those values but i don't see where it says whether they will be pushed in a file onto the node or provided in the calling environment an as envvar | 18:20 |
fungi | reading the friendly source now | 18:21 |
openstackgerrit | Merged openstack-infra/project-config master: Fix reference to zuul logserver https://review.openstack.org/484441 | 18:22 |
inc0 | I'll be publishing "pusher" change today probably | 18:22 |
inc0 | first run at it at least | 18:22 |
inc0 | I'm doing this in a way that I'll just need docker installed on node | 18:22 |
inc0 | and have access to kolla code and well...secrets | 18:22 |
fungi | http://git.openstack.org/cgit/openstack-infra/zuul/tree/doc/source/user/encryption.rst?h=feature/zuulv3 also doesn't address that question | 18:23 |
*** Sukhdev has joined #openstack-infra | 18:24 | |
fungi | i wonder if the unspoken assumption there is that the value will be available via some ansible-ism? | 18:24 |
inc0 | well if it's available by ansible it's available somewhere, but I'm not big at usage of ansible vault (I assume that's where it'll land?) | 18:26 |
*** rcernin has joined #openstack-infra | 18:26 | |
*** asingh_ has quit IRC | 18:27 | |
*** asingh_ has joined #openstack-infra | 18:29 | |
fungi | yeah, it's not at all clear to me yet from the implementation in source either | 18:30 |
inc0 | heh, well, let me know when you figure it out and I'll write docs for it | 18:31 |
fungi | jeblair: if you're around, do you know whether plaintext access to secrets by jobs is implemented in feature/zuulv3 yet, or what form that handoff will take in the build? | 18:31 |
fungi | i remember following the design up to the handoff from the scheduler to the executor via gearman | 18:32 |
jeblair | o/ | 18:32 |
jeblair | fungi, inc0: the decrypted form is an ansible variable with the name of the secret | 18:33 |
jeblair | so you can use it directly in ansible, or if the job isn't ansible-based, interpolate it into whatever runs the 'real' job | 18:34 |
inc0 | ansible run by what and how can I add my own task to it? | 18:34 |
jeblair | (eg, a shell script) | 18:34 |
jeblair | inc0: yeah, if you don't have ansible playbooks for what you're doing, which is fine, you can just write a shell script, and then we'll have ansible export those variables as env vars and call the shell script. i expect we'll have code to easily do that by launch | 18:36 |
inc0 | I need to run docker login -u {{ dockerhub_username }} -p {{ dockerhub_password }} | 18:36 |
inc0 | I'll need to check if docker login is session-specific tho | 18:37 |
jeblair | inc0, fungi: indeed it looks like https://docs.openstack.org/infra/zuul/feature/zuulv3/user/jobs.html could use an additional section on the variables/secrets which are available to jobs :) | 18:38 |
fungi | jeblair: cool, thanks. that confirms my suspicion as to why it wasn't spelled out how jobs access those values... it's just assumed they access them like any other ansible vars | 18:38 |
*** otherwiseguy has quit IRC | 18:38 | |
*** rnoriega has quit IRC | 18:38 | |
openstackgerrit | Merged openstack-infra/system-config master: OpenStackId release 1.0.22 https://review.openstack.org/484431 | 18:38 |
fungi | so easy enough to make a minimal role which sticks them in an envvar or in a file on disk or whatever we want for use by non-ansible stuff | 18:39 |
jeblair | fungi, inc0: we do at least mention it in the docs for the actual secret definition: https://docs.openstack.org/infra/zuul/feature/zuulv3/user/config.html#secret | 18:39 |
*** rwsu has quit IRC | 18:39 | |
*** ociuhandu has joined #openstack-infra | 18:39 | |
*** felipemonteiro has joined #openstack-infra | 18:39 | |
jeblair | fungi, inc0: and yes, this is all implemented. we're about to start exercising it in our roll-out preparations, so i certainly expect this to be ready for use by the time we go live. | 18:40 |
inc0 | wonderful | 18:40 |
inc0 | I'll read into it and include this to my flow | 18:40 |
inc0 | yay for being guinea pig of zuulv3 features;) | 18:40 |
*** felipemonteiro_ has joined #openstack-infra | 18:40 | |
fungi | aha, i did see that config doc section but thought maybe it was missing details as to how to make use of those values | 18:41 |
jeblair | inc0: that page and the encryption page (which fungi linked earlier, but is rendered here: https://docs.openstack.org/infra/zuul/feature/zuulv3/user/config.html#secret ) should cover it. let me know if you have further questions (and i'll answer them in the form of doc updates :) | 18:41 |
fungi | and the missing details is "you're running ansible so just use them directly" | 18:41 |
jeblair | yep. i'll definitely add that | 18:41 |
fungi | i kept assuming it was less simple than that | 18:42 |
fungi | ;) | 18:42 |
jeblair | i am very lazy | 18:42 |
fungi | meh, it's not something you would necessarily think you'd have to spell out | 18:42 |
fungi | and yes, i looked to see if we had any real-world examples of using them, i just looked a little to soon | 18:43 |
fungi | er, too soon | 18:43 |
*** felipemonteiro has quit IRC | 18:44 | |
*** bobh has quit IRC | 18:45 | |
jeblair | yeah. we do have unit test 'examples': http://git.openstack.org/cgit/openstack-infra/zuul/tree/tests/fixtures/config/ansible/git/common-config/zuul.yaml?h=feature/zuulv3#n36 | 18:45 |
*** jbernard has quit IRC | 18:45 | |
*** jbernard has joined #openstack-infra | 18:45 | |
jeblair | used by http://git.openstack.org/cgit/openstack-infra/zuul/tree/tests/fixtures/config/ansible/git/common-config/playbooks/python27.yaml?h=feature/zuulv3 | 18:46 |
jeblair | which just splats the contents into a file | 18:46 |
openstackgerrit | Julia Kreger proposed openstack-infra/project-config master: Correct docs publish location for sushy https://review.openstack.org/484450 | 18:46 |
fungi | oh, neat. i missed that in the tests | 18:47 |
*** SamYaple has quit IRC | 18:47 | |
fungi | jeblair: thanks! very useful | 18:47 |
jeblair | inc0: but it does illustrate an interesting thing that we built into secrets -- they aren't single values, they are collections. so that's a username+password pair, but only the password is encrypted. that's probably your use case. | 18:47 |
*** SamYaple has joined #openstack-infra | 18:47 | |
jeblair | (you could obviously provide the username some other way, but this lets you manage the data together) | 18:48 |
*** otherwiseguy has joined #openstack-infra | 18:48 | |
*** rnoriega has joined #openstack-infra | 18:49 | |
fungi | yep, i remember that from the original design discussions. definitely useful | 18:50 |
inc0 | lol I just noticed that when you run docker login it will spit out your creds to file in base64 | 18:51 |
inc0 | that's kinda concerning | 18:51 |
fungi | eep | 18:51 |
jeblair | inc0: it should at least be rot13-base64! | 18:51 |
fungi | indeed that's a little weird. i guess it's a hacky way of making a single-sign-on implementation? | 18:51 |
fungi | presumably you can tell it where to stick its base64 (e.g., /dev/null) | 18:52 |
*** EricGonc_ has joined #openstack-infra | 18:52 | |
fungi | or better, some option to be able to turn off that behavior entirely | 18:52 |
*** EricGonczer_ has quit IRC | 18:53 | |
inc0 | well you can stick it to dev null but I wouldn't be surprised if then docker wouldn't work | 18:53 |
inc0 | login stuff that is | 18:53 |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: WIP: Add settings for ovb in rdocloud https://review.openstack.org/480950 | 18:53 |
*** rwsu has joined #openstack-infra | 18:55 | |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: WIP: Add settings for ovb in rdocloud https://review.openstack.org/480950 | 18:55 |
inc0 | ok that's not horrible, you can configure keychain | 18:55 |
fungi | oh, so it uses a file on disk to marshall the credentials from the login command to the processes which will actually use them, rather than doing that in-memory or through a pipe? | 18:56 |
inc0 | yeah | 18:57 |
fungi | questionable design choice there. assumes a lot more security from the filesystem | 18:57 |
*** ekcs has joined #openstack-infra | 18:59 | |
inc0 | there are few alternatives tho | 18:59 |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: WIP: Add settings for ovb in rdocloud https://review.openstack.org/480950 | 18:59 |
inc0 | well, I might end up just crafting this docker config.json file with base64 | 19:00 |
inc0 | from our ansible | 19:00 |
inc0 | https://docs.ansible.com/ansible/docker_login_module.html | 19:00 |
fungi | yeah, i guess the job could very carefully template the password into the config in such a way as to avoid echoing it in the console log | 19:02 |
*** nicolasbock has quit IRC | 19:03 | |
inc0 | I really really hope ansible docker_login module won't spit it out to console;) | 19:03 |
*** bobh has joined #openstack-infra | 19:04 | |
*** nicolasbock has joined #openstack-infra | 19:05 | |
inc0 | so that's all I need from zuul http://paste.openstack.org/raw/615654/ | 19:07 |
inc0 | where do I put it and how do I create these values? | 19:08 |
*** cmurphy has quit IRC | 19:09 | |
pabelanger | it will likely go into project-config as a trusted playbook | 19:09 |
*** tbarron has quit IRC | 19:09 | |
*** cmurphy has joined #openstack-infra | 19:10 | |
*** tbarron has joined #openstack-infra | 19:11 | |
*** jcoufal has quit IRC | 19:13 | |
inc0 | as in here? https://github.com/openstack-infra/project-config/tree/master/playbooks/base | 19:13 |
*** knikolla has joined #openstack-infra | 19:14 | |
pabelanger | Right, the is the location of our trusted jobs. But, trusted jobs are only just after code has been merged, for now, you can just add the playbook to your local repo to test | 19:14 |
*** kklimonda has joined #openstack-infra | 19:18 | |
*** tushar has joined #openstack-infra | 19:19 | |
tushar | Hi All | 19:19 |
tushar | DIB Image creation is failing in third partty CI | 19:20 |
pabelanger | Ya, fixes are in the gate right now | 19:20 |
pabelanger | https://review.openstack.org/#/c/484299/ should be the last patch we need | 19:21 |
tushar | I think this needs to merge ? https://review.openstack.org/#/c/484299/ | 19:21 |
tushar | right? | 19:21 |
pabelanger | tushar: right, it is top of gate pipline right now should be 8mins out or so | 19:22 |
tushar | okk | 19:22 |
pabelanger | assuming linuxbridge test passes this time | 19:22 |
tushar | thank you | 19:23 |
pabelanger | sure, np | 19:23 |
*** MarkAtwood has left #openstack-infra | 19:25 | |
*** jkilpatr_ has joined #openstack-infra | 19:25 | |
*** tushar has quit IRC | 19:25 | |
*** jkilpatr has quit IRC | 19:27 | |
*** aviau has quit IRC | 19:27 | |
*** aviau has joined #openstack-infra | 19:28 | |
*** harlowja has quit IRC | 19:32 | |
*** dougwig has joined #openstack-infra | 19:34 | |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add IPMI validation before undercloud deploy https://review.openstack.org/484462 | 19:36 |
*** camunoz has joined #openstack-infra | 19:39 | |
*** Douhet has quit IRC | 19:43 | |
*** dave-mccowan has joined #openstack-infra | 19:45 | |
*** Douhet has joined #openstack-infra | 19:45 | |
*** sree has joined #openstack-infra | 19:46 | |
dirk | pabelanger: could you help me understand why the nodepool builder nb03/nb04 do not show a opensuse-423 build log even though https://review.openstack.org/#/c/468117/ merged a few days ago? | 19:46 |
*** boris-42__ has joined #openstack-infra | 19:48 | |
fungi | dirk: i'm going to bet that the service needs a reload/restart to pick up changes in the logging config, and we don't trigger that automatically | 19:48 |
pabelanger | looking at that now | 19:48 |
fungi | hrm... i lose that bet | 19:49 |
fungi | -r--r--r-- 1 root root 756 May 23 14:11 /etc/nodepool/logging.conf | 19:49 |
pabelanger | fungi: builder-logging.conf | 19:50 |
AJaeger | ;/ | 19:50 |
fungi | ohhh | 19:50 |
fungi | okay, cool that file is current | 19:50 |
fungi | i forgot we had multiple logging configs installing | 19:50 |
fungi | so i'm back to my original assertion | 19:51 |
*** sree has quit IRC | 19:51 | |
fungi | yeah, service nodepool-builder requires /etc/nodepool/builder-logging.conf but there is no notification or subscription | 19:52 |
pabelanger | we likely need to add https://review.openstack.org/#/c/446172/ but for nodepool | 19:52 |
openstackgerrit | Julia Kreger proposed openstack-infra/project-config master: Correct docs publish location for sushy https://review.openstack.org/484450 | 19:53 |
pabelanger | fungi: ya, I think it has always been a manual restart of builders to pick up new logging | 19:54 |
fungi | looks like it's that way for all of nodepool's daemons | 19:54 |
pabelanger | would be nice to sighup for logging changes | 19:54 |
pabelanger | zuul is the same way | 19:54 |
pabelanger | hey, we built new images too | 19:55 |
pabelanger | cool | 19:55 |
fungi | it's one thing for zuul, where the logging config changes infrequently, but for nodepool-builder we update the logging every time we add or remove an image | 19:55 |
pabelanger | so, we can reload nodepool-builders now to pickup logging changes | 19:55 |
pabelanger | fungi: agree, I can work on a patch for nodepool | 19:55 |
pabelanger | dirk: fungi: http://nb04.openstack.org/dib.opensuse-423.log | 19:56 |
pabelanger | builders restarted | 19:57 |
pabelanger | dirk: are we planning on dropping 422? | 19:57 |
*** nicolasbock has quit IRC | 19:58 | |
*** shardy has quit IRC | 19:58 | |
*** gtmanfred has quit IRC | 19:58 | |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Add opensuse 42.3 support to nodepool-dsvm jobs https://review.openstack.org/484472 | 20:00 |
openstackgerrit | Merged openstack-infra/shade master: De-client-ify Service Create https://review.openstack.org/482194 | 20:01 |
*** gtmanfred has joined #openstack-infra | 20:01 | |
pabelanger | AJaeger: yolanda: ^ can we confirm next time that images in nodepool.yaml also are being built in the gate. It will help cut down on failures releasing diskimage-builder | 20:01 |
*** skelso has joined #openstack-infra | 20:01 | |
dirk | pabelanger: once everything is converted to 423 (we need a couple of more reviews for that), then I'm open for dropping 422, yes | 20:03 |
pabelanger | dirk: okay, cool. going to bump that now in nodepool dsvm yest | 20:03 |
pabelanger | test* | 20:03 |
*** jkilpatr_ has quit IRC | 20:05 | |
*** yland has joined #openstack-infra | 20:05 | |
dirk | pabelanger: see telnet://158.69.90.102:19885 for the first 423 job.. | 20:06 |
*** yland is now known as Guest84612 | 20:06 | |
dirk | it would be good to get https://review.openstack.org/484115 , https://review.openstack.org/473959 and https://review.openstack.org/477773 merged though | 20:07 |
*** annegentle has quit IRC | 20:07 | |
*** csomerville has joined #openstack-infra | 20:10 | |
*** florianf has quit IRC | 20:11 | |
pabelanger | fungi: we should be ready to now remove the mysql.qcow2 image from tarballs.o.o. It is no longer showing up in nodepool-builder images logs | 20:11 |
*** dklyle has joined #openstack-infra | 20:12 | |
*** david-lyle has quit IRC | 20:13 | |
*** SotK is now known as SotK_ | 20:16 | |
*** dave-mccowan has quit IRC | 20:17 | |
openstackgerrit | Merged openstack-infra/system-config master: Create fedora-26 mirror in openstack-infra https://review.openstack.org/482592 | 20:19 |
openstackgerrit | Dirk Mueller proposed openstack-infra/nodepool master: Add support for nodepool testing of openSUSE 42.3 https://review.openstack.org/484476 | 20:19 |
dirk | pabelanger: ^^ | 20:19 |
fungi | thanks pabelanger! i'll do it in a bit | 20:20 |
openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Test the openSUSE 42.3 opensuse-minimal image in nodepool tests https://review.openstack.org/484477 | 20:21 |
*** SotK_ has left #openstack-infra | 20:22 | |
*** SotK has joined #openstack-infra | 20:22 | |
pabelanger | dirk: see: https://review.openstack.org/#/c/484472/ TL;DR is I dropped . between 42.3. Since we run 423 in nodepool.yaml | 20:24 |
pabelanger | didn't bother changing 42_2_2 since we plan to drop it | 20:24 |
*** dprince has quit IRC | 20:24 | |
*** david-lyle has joined #openstack-infra | 20:26 | |
*** rossella_s has quit IRC | 20:26 | |
openstackgerrit | Dirk Mueller proposed openstack-infra/nodepool master: Add support for nodepool testing of openSUSE 42.3 https://review.openstack.org/484476 | 20:27 |
dirk | pabelanger: wfm | 20:27 |
dirk | pabelanger: updated the nodepool review accordingly | 20:27 |
*** dklyle has quit IRC | 20:27 | |
*** chlong has quit IRC | 20:27 | |
pabelanger | dirk: left comment on PS1 | 20:28 |
*** rossella_s has joined #openstack-infra | 20:28 | |
dirk | pabelanger: should be fixed in PS2 ;-) | 20:30 |
*** chlong has joined #openstack-infra | 20:32 | |
pabelanger | dirk: you still have opensuse-42.3, I was recommending we update it to opensuse-423 also | 20:32 |
*** sridhar_ram has joined #openstack-infra | 20:33 | |
*** prateek has quit IRC | 20:33 | |
dirk | pabelanger: ah, you meant one other place, sorry. fixed now | 20:34 |
openstackgerrit | Dirk Mueller proposed openstack-infra/nodepool master: Add support for nodepool testing of openSUSE 42.3 https://review.openstack.org/484476 | 20:34 |
*** jkilpatr has joined #openstack-infra | 20:37 | |
openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Add openSUSE 42.3 tempest run graph https://review.openstack.org/484481 | 20:38 |
fungi | #status log /srv/static/tarballs/trove/images/ubuntu/mysql.qcow2 has been removed from static.openstack.org again | 20:39 |
openstackstatus | fungi: finished logging | 20:39 |
*** kgiusti has quit IRC | 20:40 | |
openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Update base job to content in base-test https://review.openstack.org/484484 | 20:40 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Add sample base job https://review.openstack.org/484485 | 20:45 |
openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Upgrade bindep-fallback check on opensuse-423 to voting https://review.openstack.org/484486 | 20:47 |
openstackgerrit | James E. Blair proposed openstack-infra/openstack-zuul-roles master: Remove last remaining roles https://review.openstack.org/484487 | 20:48 |
*** skelso has quit IRC | 20:49 | |
openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Update base job to content in base-test https://review.openstack.org/484484 | 20:50 |
openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder master: opensuse-minimal: install glibc-locale https://review.openstack.org/473959 | 20:50 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Ensure we load roles for linting https://review.openstack.org/484488 | 20:50 |
*** jcoufal has joined #openstack-infra | 20:50 | |
*** Goneri has quit IRC | 20:51 | |
*** EricGonc_ has quit IRC | 20:51 | |
*** EricGonczer_ has joined #openstack-infra | 20:53 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Include ansible-playbook syntax-check for tox pep8 https://review.openstack.org/484490 | 20:54 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Rename pep8 to linters for tox https://review.openstack.org/484491 | 20:54 |
*** harlowja has joined #openstack-infra | 20:56 | |
*** EricGonc_ has joined #openstack-infra | 20:57 | |
*** EricGonczer_ has quit IRC | 20:58 | |
*** baoli has quit IRC | 20:59 | |
*** trown is now known as trown|outtypewww | 21:05 | |
openstackgerrit | Ashwin Agate proposed openstack-infra/project-config master: Add publish-to-pypi job for monasca-ceilometer https://review.openstack.org/484494 | 21:05 |
*** cody-somerville has joined #openstack-infra | 21:06 | |
*** cody-somerville has joined #openstack-infra | 21:06 | |
*** panda is now known as panda|off | 21:07 | |
*** csomerville has quit IRC | 21:08 | |
*** mandre has quit IRC | 21:08 | |
*** thorst has quit IRC | 21:10 | |
*** ldnunes has quit IRC | 21:13 | |
*** iyamahat has joined #openstack-infra | 21:14 | |
*** iyamahat_ has quit IRC | 21:14 | |
openstackgerrit | Merged openstack-infra/project-config master: Update base job to content in base-test https://review.openstack.org/484484 | 21:19 |
*** smarcet has left #openstack-infra | 21:19 | |
openstackgerrit | Ashwin Agate proposed openstack-infra/project-config master: Add publish-to-pypi job for monasca-ceilometer https://review.openstack.org/484494 | 21:22 |
*** gordc has quit IRC | 21:24 | |
*** gtrxcb has joined #openstack-infra | 21:26 | |
*** Sukhdev has quit IRC | 21:26 | |
*** chlong has quit IRC | 21:26 | |
*** jerryz has joined #openstack-infra | 21:31 | |
*** rcernin has quit IRC | 21:33 | |
*** dave-mccowan has joined #openstack-infra | 21:34 | |
*** sree_ has joined #openstack-infra | 21:36 | |
*** sree_ is now known as Guest50476 | 21:36 | |
*** annegentle has joined #openstack-infra | 21:40 | |
*** Guest50476 has quit IRC | 21:40 | |
*** Guest84612 has left #openstack-infra | 21:45 | |
openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Adding more openSUSE 42.3 variants to existing 42.2 jobs https://review.openstack.org/484499 | 21:48 |
*** annegentle has quit IRC | 21:53 | |
*** EricGonc_ has quit IRC | 21:54 | |
*** aeng has joined #openstack-infra | 21:54 | |
*** EricGonczer_ has joined #openstack-infra | 21:54 | |
*** jcoufal has quit IRC | 21:57 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/shade master: Updated from global requirements https://review.openstack.org/483327 | 21:59 |
jeblair | it's zuul meeting time in #openstack-meeting alt | 22:00 |
jeblair | or rather | 22:00 |
jeblair | it's zuul meeting time in #openstack-meeting-alt | 22:00 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder master: Updated from global requirements https://review.openstack.org/484503 | 22:00 |
openstackgerrit | Ashwin Agate proposed openstack-infra/project-config master: Add publish-to-pypi job for monasca-ceilometer https://review.openstack.org/484494 | 22:01 |
*** bobh has quit IRC | 22:02 | |
*** felipemonteiro_ has quit IRC | 22:03 | |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: WIP: Add settings for ovb in rdocloud https://review.openstack.org/480950 | 22:03 |
*** Goneri has joined #openstack-infra | 22:04 | |
*** esberglu has quit IRC | 22:05 | |
*** hasharAway has quit IRC | 22:09 | |
*** thorst has joined #openstack-infra | 22:10 | |
*** mriedem has quit IRC | 22:10 | |
*** gouthamr has quit IRC | 22:12 | |
*** gouthamr has joined #openstack-infra | 22:14 | |
*** thorst has quit IRC | 22:15 | |
*** mriedem has joined #openstack-infra | 22:16 | |
*** apuimedo has quit IRC | 22:16 | |
openstackgerrit | Ashwin Agate proposed openstack-infra/project-config master: Add publish-to-pypi job for monasca-ceilometer https://review.openstack.org/484494 | 22:16 |
*** apuimedo has joined #openstack-infra | 22:17 | |
*** esberglu has joined #openstack-infra | 22:20 | |
*** EricGonczer_ has quit IRC | 22:23 | |
openstackgerrit | Merged openstack-infra/zuul-jobs master: Create tox_environment to allow users access to shell variables https://review.openstack.org/483935 | 22:24 |
openstackgerrit | Ashwin Agate proposed openstack-infra/project-config master: Add publish-to-pypi job for monasca-ceilometer https://review.openstack.org/484494 | 22:25 |
*** esberglu has quit IRC | 22:25 | |
*** baoli has joined #openstack-infra | 22:25 | |
*** rossella_s has quit IRC | 22:25 | |
*** baoli has quit IRC | 22:26 | |
*** rossella_s has joined #openstack-infra | 22:27 | |
*** xyang1 has quit IRC | 22:29 | |
*** wolverineav has quit IRC | 22:29 | |
*** Goneri has quit IRC | 22:29 | |
*** wolverineav has joined #openstack-infra | 22:30 | |
*** darvon has joined #openstack-infra | 22:30 | |
openstackgerrit | Ashwin Agate proposed openstack-infra/project-config master: Add publish-to-pypi job for monasca-ceilometer https://review.openstack.org/484494 | 22:34 |
*** rwsu has quit IRC | 22:34 | |
*** wolverineav has quit IRC | 22:34 | |
*** vhosakot_ has quit IRC | 22:35 | |
*** rwsu has joined #openstack-infra | 22:36 | |
*** marst has quit IRC | 22:37 | |
*** thorst has joined #openstack-infra | 22:41 | |
*** rbrndt has quit IRC | 22:41 | |
*** thorst has quit IRC | 22:43 | |
*** funzo has joined #openstack-infra | 22:44 | |
*** vhosakot has joined #openstack-infra | 22:45 | |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Add callback plugin to emit json https://review.openstack.org/484515 | 22:47 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Only output result details on error https://review.openstack.org/484516 | 22:47 |
*** armax has quit IRC | 22:47 | |
*** funzo has quit IRC | 22:50 | |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: WIP: Validate size of subunit for tox https://review.openstack.org/484518 | 22:53 |
*** mriedem has quit IRC | 22:54 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Remove subunit file size check for tox role https://review.openstack.org/484519 | 22:55 |
*** Apoorva has quit IRC | 22:55 | |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: WIP: Validate size of subunit for tox https://review.openstack.org/484518 | 22:55 |
*** Apoorva has joined #openstack-infra | 22:56 | |
openstackgerrit | Paul Belanger proposed openstack-infra/shade master: DNM - testing https://review.openstack.org/484520 | 22:56 |
*** EricGonczer_ has joined #openstack-infra | 22:58 | |
*** aeng has quit IRC | 23:01 | |
*** baoli has joined #openstack-infra | 23:02 | |
*** baoli has quit IRC | 23:02 | |
*** iyamahat_ has joined #openstack-infra | 23:03 | |
*** iyamahat has quit IRC | 23:03 | |
*** Apoorva_ has joined #openstack-infra | 23:04 | |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: WIP: Validate size of subunit for tox https://review.openstack.org/484518 | 23:04 |
*** vhosakot has quit IRC | 23:06 | |
*** Apoorva has quit IRC | 23:07 | |
*** mriedem has joined #openstack-infra | 23:08 | |
openstackgerrit | Ashwin Agate proposed openstack-infra/project-config master: Enable py35 job for Monasca Transform https://review.openstack.org/484522 | 23:08 |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: WIP: Validate size of subunit for tox https://review.openstack.org/484518 | 23:15 |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Create openstack-py35 job with upper-constraints https://review.openstack.org/483987 | 23:15 |
pabelanger | fungi: clarkb: mordred: https://review.openstack.org/#/c/484029/ will be helpful for zuulv3.o.o. Fixes reloading | 23:18 |
*** aeng has joined #openstack-infra | 23:18 | |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: WIP: Validate size of subunit for tox https://review.openstack.org/484518 | 23:19 |
*** rlandy has quit IRC | 23:24 | |
*** sree_ has joined #openstack-infra | 23:24 | |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Add ansible-role-bindep to zuulv3.o.o https://review.openstack.org/484526 | 23:24 |
*** sree_ is now known as Guest1203 | 23:24 | |
*** chlong has joined #openstack-infra | 23:25 | |
*** hongbin has quit IRC | 23:28 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add more information on variables in jobs https://review.openstack.org/484530 | 23:28 |
jeblair | fungi, inc0: ^ doc update from this morning's chat | 23:28 |
*** Guest1203 has quit IRC | 23:28 | |
inc0 | thank you jeblair | 23:29 |
jeblair | the cross references are waiting on my adding anchors to all of the config attributes | 23:29 |
jeblair | so i just left a note there for now | 23:29 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Remove subunit file size check for tox role https://review.openstack.org/484519 | 23:31 |
openstackgerrit | Ashwin Agate proposed openstack-infra/project-config master: Enable py35 job for Monasca Transform https://review.openstack.org/484522 | 23:31 |
openstackgerrit | Merged openstack-infra/puppet-zuul master: Send SIGHUP for zuul-scheduler reload https://review.openstack.org/484029 | 23:31 |
openstackgerrit | Ashwin Agate proposed openstack-infra/project-config master: Enable py35 job for monasca-transform https://review.openstack.org/484522 | 23:31 |
*** gouthamr has quit IRC | 23:32 | |
*** tosky has quit IRC | 23:40 | |
*** bobh has joined #openstack-infra | 23:41 | |
openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: WIP: Validate size of subunit for tox https://review.openstack.org/484518 | 23:45 |
*** aeng has quit IRC | 23:46 | |
*** funzo has joined #openstack-infra | 23:46 | |
*** aeng has joined #openstack-infra | 23:46 | |
*** funzo has quit IRC | 23:51 | |
*** gouthamr has joined #openstack-infra | 23:52 | |
*** gouthamr has quit IRC | 23:53 | |
*** gouthamr has joined #openstack-infra | 23:53 | |
*** ramishra has quit IRC | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!