Monday, 2017-07-17

*** wolverineav has joined #openstack-infra00:09
*** bobh has quit IRC00:11
*** gmann has quit IRC00:12
*** gmann has joined #openstack-infra00:12
*** Goneri has quit IRC00:15
*** sflanigan has joined #openstack-infra00:18
*** wolverineav has quit IRC00:24
openstackgerritMerged openstack/diskimage-builder master: zypper-minimal: No point in preserving the environment here  https://review.openstack.org/48355000:26
*** funzo has joined #openstack-infra00:31
*** bobh has joined #openstack-infra00:31
*** bobh has quit IRC00:32
*** bobh has joined #openstack-infra00:32
*** funzo has quit IRC00:37
openstackgerritMerged openstack/diskimage-builder master: Remove additional Bumblebee repository for opensuse element  https://review.openstack.org/48270800:50
*** wolverineav has joined #openstack-infra00:51
*** bobh has quit IRC00:56
*** thorst has joined #openstack-infra00:59
*** LindaWang has joined #openstack-infra01:01
*** bobh has joined #openstack-infra01:02
openstackgerritMerged openstack/diskimage-builder master: doc: Switch from oslosphinx to openstackdocstheme  https://review.openstack.org/48381801:03
*** thorst has quit IRC01:04
*** wolverineav has quit IRC01:07
*** mwarad has quit IRC01:16
*** bobh has quit IRC01:18
*** zhurong has joined #openstack-infra01:20
*** zhurong has quit IRC01:23
*** liujiong has joined #openstack-infra01:24
*** markvoelker has joined #openstack-infra01:29
openstackgerritAmrith Kumar proposed openstack/diskimage-builder master: Allow users to specify partition type in the MBR PTE  https://review.openstack.org/48239601:31
*** funzo has joined #openstack-infra01:33
*** liujiong_lj has joined #openstack-infra01:36
*** mwarad has joined #openstack-infra01:37
*** liujiong has quit IRC01:37
*** funzo has quit IRC01:37
*** wolverineav has joined #openstack-infra01:38
*** liujiong_lj is now known as liujiong01:39
*** sbezverk has quit IRC01:42
*** bobh has joined #openstack-infra01:51
*** wolverineav has quit IRC01:55
*** markvoelker has quit IRC02:03
*** bobh has quit IRC02:08
*** gcb has joined #openstack-infra02:11
*** bobh has joined #openstack-infra02:11
*** EricGonczer_ has quit IRC02:16
*** wolverineav has joined #openstack-infra02:22
*** zhurong has joined #openstack-infra02:31
*** funzo has joined #openstack-infra02:34
*** funzo has quit IRC02:38
*** wolverineav has quit IRC02:39
*** MatthewLi has joined #openstack-infra02:39
*** yamamoto has joined #openstack-infra02:47
*** xarses has quit IRC02:59
*** xarses has joined #openstack-infra02:59
*** ramishra has joined #openstack-infra03:00
*** markvoelker has joined #openstack-infra03:00
*** xarses has quit IRC03:00
*** xarses has joined #openstack-infra03:00
*** thorst has joined #openstack-infra03:01
*** dave-mccowan has quit IRC03:04
*** bobh has quit IRC03:05
*** funzo has joined #openstack-infra03:05
*** wolverineav has joined #openstack-infra03:05
*** thorst has quit IRC03:05
*** baoli has quit IRC03:05
*** funzo has quit IRC03:08
*** yamamoto has quit IRC03:09
*** baoli has joined #openstack-infra03:16
*** xarses_ has joined #openstack-infra03:19
*** wolverineav has quit IRC03:20
*** Sukhdev has quit IRC03:20
*** andreww has joined #openstack-infra03:20
*** xarses has quit IRC03:22
*** xarses_ has quit IRC03:24
*** andreww has quit IRC03:24
*** aeng has quit IRC03:25
*** markvoelker has quit IRC03:34
*** hongbin has joined #openstack-infra03:39
*** baoli has quit IRC03:41
*** mikal has quit IRC03:42
*** gouthamr has quit IRC03:42
*** links has joined #openstack-infra03:44
*** wolverineav has joined #openstack-infra03:46
openstackgerritIan Wienand proposed openstack/diskimage-builder master: elements: openstack-ci-mirrors: Use openSUSE mirrors for gating jobs  https://review.openstack.org/47844304:00
*** yamamoto has joined #openstack-infra04:09
*** aeng has joined #openstack-infra04:10
*** aeng has quit IRC04:10
*** hongbin has quit IRC04:13
*** adisky__ has joined #openstack-infra04:13
*** aeng has joined #openstack-infra04:13
*** yamamoto has quit IRC04:14
*** psachin has joined #openstack-infra04:18
*** wolverineav has quit IRC04:19
*** wolverineav has joined #openstack-infra04:30
*** markvoelker has joined #openstack-infra04:30
*** gtrxcb has joined #openstack-infra04:31
*** chkumar|off is now known as chandankumar04:35
AJaegerianw, are you going to retire these repos from a second round, please? Or shall I ask somebody else? http://lists.openstack.org/pipermail/openstack-infra/2017-July/005487.html04:37
*** jerryz has quit IRC04:40
AJaegerjhesketh: I meant to ask you ^ Sorry, ianw04:40
*** wolverineav has quit IRC04:42
*** Guest85796 has quit IRC04:46
*** Dinesh_Bhor has joined #openstack-infra04:46
*** Sukhdev has joined #openstack-infra04:47
openstackgerritIan Wienand proposed openstack/diskimage-builder master: elements: openstack-ci-mirrors: Use openSUSE mirrors for gating jobs  https://review.openstack.org/47844304:48
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Remove DIB_[DISTRO]_DISTRIBUTION_MIRROR  https://review.openstack.org/48424704:48
AJaegerproject-config cores, please put on your review queue https://review.openstack.org/#/q/status:open+project:openstack-infra/project-config+branch:master+topic:local_conf - this uses local_conf wherever possible04:56
*** thorst has joined #openstack-infra05:01
*** zhurong has quit IRC05:04
*** markvoelker has quit IRC05:04
*** thorst has quit IRC05:06
*** dhajare has joined #openstack-infra05:07
*** wolverineav has joined #openstack-infra05:09
*** wolverineav has quit IRC05:13
*** ykarel has joined #openstack-infra05:16
*** armax has joined #openstack-infra05:23
*** wolverineav has joined #openstack-infra05:23
*** isaacb has joined #openstack-infra05:26
*** nicolasbock has joined #openstack-infra05:28
*** zhurong has joined #openstack-infra05:28
*** armax has quit IRC05:30
*** armax has joined #openstack-infra05:30
*** armax has quit IRC05:31
*** armax has joined #openstack-infra05:31
*** armax has quit IRC05:32
*** florianf has joined #openstack-infra05:32
*** armax has joined #openstack-infra05:32
*** armax has quit IRC05:32
*** armax has joined #openstack-infra05:33
*** armax has quit IRC05:33
*** armax has joined #openstack-infra05:34
*** sbezverk has joined #openstack-infra05:34
*** armax has quit IRC05:34
*** armax has joined #openstack-infra05:35
*** xarses has joined #openstack-infra05:35
*** armax has quit IRC05:35
openstackgerritMerged openstack/diskimage-builder master: Replace architecture-emulation-binaries with qemu-debootstrap  https://review.openstack.org/44458805:36
*** cshastri has joined #openstack-infra05:37
*** eranrom_ has joined #openstack-infra05:39
*** wolverineav has quit IRC05:41
*** eranrom has quit IRC05:42
*** eranrom_ has quit IRC05:43
*** eranrom has joined #openstack-infra05:44
*** eranrom has quit IRC05:50
*** winggundamth has joined #openstack-infra05:53
*** rcernin_ has joined #openstack-infra06:00
*** MatthewLi1 has joined #openstack-infra06:01
*** MatthewLi has quit IRC06:01
*** MatthewLi1 is now known as MatthewLi06:01
*** prateek has joined #openstack-infra06:03
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Update the documentation link for doc migration  https://review.openstack.org/48382006:12
*** nicolasbock has quit IRC06:13
*** nicolasbock has joined #openstack-infra06:15
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: Add tenant column to the buildset reporter table  https://review.openstack.org/48425606:15
*** wolverineav has joined #openstack-infra06:17
*** andreas_s has joined #openstack-infra06:23
*** mikal has joined #openstack-infra06:24
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: Add tenant column to the buildset reporter table  https://review.openstack.org/48425606:28
*** prateek has quit IRC06:30
*** wolverineav has quit IRC06:34
*** ekcs has quit IRC06:37
*** pgadiya has joined #openstack-infra06:39
openstackgerritSpyros Trigazis (strigazi) proposed openstack-infra/project-config master: [magnum] Make swarm-mode job voting  https://review.openstack.org/48385806:43
*** aeng has quit IRC06:50
*** Sukhdev has quit IRC06:50
*** namnh has joined #openstack-infra06:58
*** wolverineav has joined #openstack-infra07:01
*** markvoelker has joined #openstack-infra07:01
*** thorst has joined #openstack-infra07:02
*** gtrxcb has quit IRC07:04
*** rossella_s has joined #openstack-infra07:05
*** shardy has joined #openstack-infra07:06
*** shardy has quit IRC07:07
*** thorst has quit IRC07:07
*** cody-somerville has joined #openstack-infra07:07
*** cody-somerville has joined #openstack-infra07:07
*** csomerville has joined #openstack-infra07:09
*** shardy has joined #openstack-infra07:09
*** cody-somerville has quit IRC07:12
*** rossella_s has quit IRC07:13
*** rossella_s has joined #openstack-infra07:14
*** wolverineav has quit IRC07:15
*** dhellmann has quit IRC07:16
*** dhellmann has joined #openstack-infra07:17
*** alexchadin has joined #openstack-infra07:22
*** alexchad_ has joined #openstack-infra07:28
*** alexcha__ has joined #openstack-infra07:29
*** alexchadin has quit IRC07:30
hwoaranggood morning07:31
hwoarangdoes anyone know how often project-config:jenkins/scripts/ sync on ci nodes?07:31
hwoarangThis commit https://review.openstack.org/#/c/483549/ was merged on Friday but according to today's http://logs.openstack.org/40/478140/6/experimental/gate-ansible-hardening-ansible-func-opensuse-422/297cbd3/console.html#_2017-07-17_07_29_20_551810 it does not seem the new code is deployed...07:32
*** tesseract has joined #openstack-infra07:32
*** alexchad_ has quit IRC07:32
*** Julien-zte has quit IRC07:32
*** alexchadin has joined #openstack-infra07:33
*** Hal has joined #openstack-infra07:33
*** Julien-zte has joined #openstack-infra07:34
*** alexcha__ has quit IRC07:34
*** markvoelker has quit IRC07:35
*** alexchad_ has joined #openstack-infra07:36
openstackgerritMerged openstack-infra/project-config master: Run tripleo scenario004 in bgpvpn & l2gw gates  https://review.openstack.org/48064107:37
*** alexcha__ has joined #openstack-infra07:37
*** prateek has joined #openstack-infra07:37
*** alexchadin has quit IRC07:38
*** martinkopec has joined #openstack-infra07:38
openstackgerritMerged openstack-infra/project-config master: Fix jobs in manila driverfixes branches  https://review.openstack.org/48404007:39
*** alexchad_ has quit IRC07:40
*** egonzalez has joined #openstack-infra07:40
openstackgerritMerged openstack-infra/project-config master: update congress py35 dsvm job  https://review.openstack.org/48415807:41
openstackgerritMerged openstack/diskimage-builder master: Update the documentation link for doc migration  https://review.openstack.org/48382007:42
*** ralonsoh has joined #openstack-infra07:42
*** wolverineav has joined #openstack-infra07:42
*** alexcha__ is now known as alexchadin07:42
andreas_shi the image build of the ci should be broken (at least it is in the s390x thirdparty CI). The reason is the removal of the trove image in stackr. This patch should fix the issue: https://review.openstack.org/48427107:43
*** ccamacho has joined #openstack-infra07:46
*** LindaWang has quit IRC07:48
openstackgerritMerged openstack-infra/project-config master: Make gate-rally-dsvm-rally-heat job non-voting  https://review.openstack.org/48405507:48
*** wolverineav has quit IRC07:50
openstackgerritThomas Herve proposed openstack-infra/project-config master: Add a py3 designate job  https://review.openstack.org/48427507:50
openstackgerritMerged openstack-infra/project-config master: Fix up regex for skipping jobs for certain patrole changes  https://review.openstack.org/48404407:50
*** LindaWang has joined #openstack-infra08:00
*** dizquierdo has joined #openstack-infra08:01
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: Fix zuul command default function  https://review.openstack.org/48427908:06
*** aarefiev has joined #openstack-infra08:10
openstackgerritMerged openstack-infra/project-config master: Update job name in TripleO  https://review.openstack.org/48405308:12
openstackgerritMerged openstack-infra/project-config master: Start configuring opensuse 42.3 images on the various infra clouds  https://review.openstack.org/48409908:13
openstackgerritMerged openstack-infra/project-config master: Add experimental jobs for openSUSE 42.3 testing (bindep, devstack, dib)  https://review.openstack.org/48411308:13
openstackgerritMerged openstack-infra/project-config master: Restrict driverfixes branches for Manila  https://review.openstack.org/48395708:14
ianwhwoarang: with the next build ... but is there an issue with opensuse builds?08:15
*** isaacb has quit IRC08:15
ianwhwoarang: i would say yes, looking at the age of the builds in http://nodepool.openstack.org/dib-image-list .  i will take a look tomorrow my time ...08:16
openstackgerritMerged openstack-infra/project-config master: Switch to tox for running tempest plugin sanity check  https://review.openstack.org/47416808:17
openstackgerritMerged openstack-infra/project-config master: neutron-fwaas: Add a non-voting job to run networking-midonet unit tests  https://review.openstack.org/48207408:17
openstackgerritMerged openstack-infra/project-config master: Fix whitespace  https://review.openstack.org/48386808:19
ianwhwoarang: looks like it's hitting this thing mentioned by andreas_s --> /opt/dib_tmp/dib_build.SRGOLc32/hooks/extra-data.d/98-source-repositories: line 49: CIRROS_VERSION: unbound variable08:23
*** hashar has joined #openstack-infra08:26
*** thorst has joined #openstack-infra08:27
umbarkarIn my third party setup the DIB image creation is failing .....anyone else having same issue?08:29
ianwumbarkar: you are probably seeing issues related to https://review.openstack.org/#/c/484001/08:30
ianwhwoarang: ^ with that merged, hopefully we can get a suse build08:30
ianw(and hence your script updated)08:30
*** markvoelker has joined #openstack-infra08:31
*** thorst has quit IRC08:32
umbarkarianw : yeh .. I think same issue I am facing08:32
*** lucas-afk is now known as lucasagomes08:32
umbarkarthank you for pointing me to this patch08:32
ianwi think we'll need to cherry-pick that for it to work08:33
umbarkarianw : DIB image creation is done via script08:34
umbarkarI mean its a automated process08:34
ianwsorry, i mean cherry-pick that across branches on devstack08:35
umbarkarok08:35
ianwone complication being, that devstack still has a mikata branch, but seems not to pass CI at all, meaning we can't commit the change there :/08:35
ianwhmmm08:35
*** AJaeger has quit IRC08:40
*** AJaeger has joined #openstack-infra08:42
*** electrofelix has joined #openstack-infra08:49
*** tesseract has quit IRC08:50
*** tesseract has joined #openstack-infra08:53
*** dingyichen has quit IRC08:54
*** markvoelker has quit IRC09:05
*** isaacb has joined #openstack-infra09:10
*** yamamoto has joined #openstack-infra09:13
*** yamamoto has quit IRC09:13
*** yamamoto has joined #openstack-infra09:14
*** hichihara has quit IRC09:15
*** yamamoto has quit IRC09:16
*** yamamoto has joined #openstack-infra09:17
odyssey4memorning all - now that setuptools 36.2 is blacklisted in g-r how long will it take all job images to no longer have it installed?09:18
*** yamamoto has quit IRC09:21
*** mwarad has quit IRC09:21
*** yamamoto has joined #openstack-infra09:21
*** derekh has joined #openstack-infra09:22
ianwodyssey4me / umbarkar / hwoarang: re updated builds, i belive things should start working themselves out as the changes in http://lists.openstack.org/pipermail/openstack-dev/2017-July/119763.html come through, and we rebuild fresh images09:23
*** sambetts|afk is now known as sambetts09:25
odyssey4meok, thanks ianw09:25
umbarkarianw : Thanks for the update09:25
odyssey4meI think those old branches were left as there were some projects who wanted the old branches to remain for whatever reason09:25
odyssey4mehowever, those projects can always raise the issue09:25
ianwodyssey4me: maybe ... but if we can't commit changes to them, well, it's a bad situation09:26
*** yamamoto has quit IRC09:26
ianwthe EOL tags are there, so maybe what they should do instead is clone at that point, rather than the branch09:26
*** LindaWang has quit IRC09:27
ianw(and probably what we should have told them to do, since i doubt anyone is interested in actually maintaining it)09:27
odyssey4meyep, I agree with that philosophy09:28
*** tuanluong has joined #openstack-infra09:28
*** LindaWang has joined #openstack-infra09:28
odyssey4meI expect, then, that the new images are probably going to only be in place late today or perhaps tomorrow?09:29
*** florianf has quit IRC09:29
ianwodyssey4me: well, that's all relative :)  i think that since nodepool is failing, it will keep looping until it gets a good build, which should hopefully be not too long after the changes commit09:30
*** yamamoto has joined #openstack-infra09:30
ianwodyssey4me: you can check for fresh images at http://nodepool.openstack.org/dib-image-list, and then see what's uploaded with http://nodepool.openstack.org/image-list09:31
ianwi'm just about out here, but i imagine pabelanger at least will jump on things in a few hours when he gets online09:31
*** florianf has joined #openstack-infra09:35
*** tosky has joined #openstack-infra09:35
*** yamamoto has quit IRC09:38
*** dizquierdo has quit IRC09:38
hwoarangianw: ah thank you for the information09:41
egonzalezHi, noticed kolla ocata centos (source|binary) tar images return 403 Forbidden https://tarballs.openstack.org/kolla/images/09:47
openstackgerritRosario Di Somma proposed openstack-infra/shade master: WIP: Don't remove top-container element in the adapter  https://review.openstack.org/48417809:48
*** csomerville has quit IRC09:51
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Fix stackviz collect data  https://review.openstack.org/47455909:54
*** raissa_ has joined #openstack-infra09:54
openstackgerritMarkos Chandras (hwoarang) proposed openstack/diskimage-builder master: elements: openstack-ci-mirrors: Use openSUSE mirrors for gating jobs  https://review.openstack.org/47844309:55
*** isaacb_ has joined #openstack-infra10:01
*** isaacb_ has quit IRC10:01
*** markvoelker has joined #openstack-infra10:02
*** isaacb has quit IRC10:04
*** isaacb has joined #openstack-infra10:05
*** gcb has quit IRC10:06
openstackgerritRosario Di Somma proposed openstack-infra/shade master: WIP: Don't remove top-container element in the adapter  https://review.openstack.org/48417810:06
*** liujiong has quit IRC10:06
umbarkarianw  : Looks like issue is still not resolved10:07
umbarkarDIB  image creation failing with same error10:07
*** jistr is now known as jistr|afk10:09
AJaegerodyssey4me: could you review https://review.openstack.org/#/c/484206/ , please?10:12
*** d0ugal has joined #openstack-infra10:13
odyssey4meAJaeger hmm, so the reason the opensuse jobs are 'voting' right now is because they're all in the experimental ipeline10:18
odyssey4me*pipeline10:18
odyssey4meso I would rather leave just non-voting jobs in place for them and name the experimental jobs accordingly10:18
odyssey4mebecause once they're passing, they'll be propoted to non-voting10:19
odyssey4me*promoted10:19
*** d0ugal has quit IRC10:19
*** thorst has joined #openstack-infra10:28
*** dizquierdo has joined #openstack-infra10:29
*** LindaWang has quit IRC10:31
*** thorst has quit IRC10:32
*** markvoelker has quit IRC10:35
*** yamamoto has joined #openstack-infra10:37
*** tuanluong has quit IRC10:38
*** wolverineav has joined #openstack-infra10:39
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: WIP: Add jobs dashboard  https://review.openstack.org/46656110:42
*** lucasagomes is now known as lucas-hungry10:49
AJaegerodyssey4me: we can move them once we use them elsewhere, we have far too many jobs defined that nobody uses...10:56
*** namnh has quit IRC10:57
*** hashar has quit IRC10:59
odyssey4meAJaeger yep, I figured as much10:59
*** LindaWang has joined #openstack-infra10:59
*** hashar has joined #openstack-infra11:01
andreas_sumbarkar, yes, the patch needs a backport to newton - newton is the branch that is actually broken...11:03
*** alexchadin has quit IRC11:04
umbarkarandreas_s : the patch https://review.openstack.org/#/c/484001/ is merged now11:05
umbarkarI think this might solve the problem11:05
andreas_sumbarkar, that one should solve it finally: https://review.openstack.org/#/c/484298/11:06
andreas_sumbarkar, it was only the newton branch that was broken...11:06
andreas_sumbarkar, the cache-devstack elements iterates over all branches...11:06
umbarkarandreas_s : ok11:08
umbarkarthanks for the info11:08
*** thorst has joined #openstack-infra11:08
*** mandre_away is now known as mandre11:08
*** thorst has quit IRC11:09
*** thorst has joined #openstack-infra11:16
umbarkarandreas_s : I think this should also merge  - https://review.openstack.org/#/c/484299/111:28
umbarkarto solve the problem11:28
openstackgerritBilly Olsen proposed openstack-infra/project-config master: Add charm-interface-gluster-peer for gluster peer relations  https://review.openstack.org/48433211:30
*** markvoelker has joined #openstack-infra11:32
openstackgerritBilly Olsen proposed openstack-infra/project-config master: Add charm-interface-gluster-peer for gluster peer relations  https://review.openstack.org/48433211:33
*** dmellado_ has joined #openstack-infra11:38
*** ldnunes has joined #openstack-infra11:44
*** ccamacho is now known as ccamacho|lunch11:45
*** ociuhandu has quit IRC11:46
*** pgadiya has quit IRC11:47
andymccrGood morning infra - if we want to EOL the openstack-ansible repo (now that we've done a final patch to set all pointers to upstream mitaka-eol branches) is that something I can do, or do I need assistance?11:50
AJaegerandymccr: http://lists.openstack.org/pipermail/openstack-infra/2017-July/005487.html - tagging you could do, but closing a branch not11:52
*** jcoufal has joined #openstack-infra11:55
*** markvoelker has quit IRC11:56
*** markvoelker has joined #openstack-infra11:57
mordredAJaeger: ++ guidance to teams for sure12:00
andymccrAJaeger: thanks for the pointer!12:02
*** ociuhandu has joined #openstack-infra12:10
*** LindaWang has quit IRC12:12
*** rhallisey has joined #openstack-infra12:13
*** jistr|afk is now known as jistr12:17
*** LindaWang has joined #openstack-infra12:21
*** dtantsur has joined #openstack-infra12:33
*** jaypipes has joined #openstack-infra12:33
*** prateek has quit IRC12:33
*** blznblzn2 has joined #openstack-infra12:34
*** dprince has joined #openstack-infra12:35
*** rlandy has joined #openstack-infra12:36
smcginnisAnyone know how to check if we are getting failures syncing mirrors?12:37
smcginnisSeeing an os-brick update failing because it couldn't find the released version.12:37
*** bobh has joined #openstack-infra12:37
smcginnisAnd other release jobs failing with things like this: http://logs.openstack.org/fc/fc04caefd46a441663ea7e82b380a08de9b2dba0/release-post/static-releases-publish/8ae945b/console.html#_2017-07-17_11_59_00_59469012:37
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Write secrets into their own file, not into inventory  https://review.openstack.org/47939012:42
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Fail early if people attempt to add zuul vars or secrets  https://review.openstack.org/48400012:42
*** jkilpatr has joined #openstack-infra12:43
*** BobBall has joined #openstack-infra12:47
*** efoley has joined #openstack-infra12:48
*** camunoz has joined #openstack-infra12:51
*** blznblzn2 has quit IRC12:51
*** bobh has quit IRC12:51
*** bobh has joined #openstack-infra12:52
*** prateek has joined #openstack-infra12:53
*** kgiusti has joined #openstack-infra12:57
*** alexchadin has joined #openstack-infra12:57
*** camunoz has quit IRC12:59
*** camunoz has joined #openstack-infra12:59
*** gouthamr has joined #openstack-infra13:00
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574713:02
*** gcb has joined #openstack-infra13:06
pabelangerianw: ack, watching now13:06
*** bobh has quit IRC13:08
*** lucas-hungry is now known as lucasagomes13:09
AJaegerpabelanger, mordred, could you put https://review.openstack.org/#/q/status:open+project:openstack-infra/project-config+branch:master+topic:local_conf (using local_conf where possible) and https://review.openstack.org/#/c/484206/ (reduce number of unused ansible jobs) on your queues, please? These are just cleanups...13:09
*** Julien-zte has quit IRC13:10
*** baoli has joined #openstack-infra13:10
pabelangerAJaeger: sure13:10
openstackgerritPaul Belanger proposed openstack-infra/zuul-jobs master: Remove export commands from tox based roles  https://review.openstack.org/48393613:10
openstackgerritPaul Belanger proposed openstack-infra/zuul-jobs master: Create tox_environment to allow users access to shell variables  https://review.openstack.org/48393513:10
*** Julien-zte has joined #openstack-infra13:10
AJaegerthanks, pabelanger13:10
*** bobh has joined #openstack-infra13:11
*** gordc has joined #openstack-infra13:11
*** adarazs_ has joined #openstack-infra13:14
*** baoli has quit IRC13:14
AJaegerEmilienM: could you review https://review.openstack.org/484205 , please? Those tripleo jobs are unused, just want you check that this is your intention.13:14
EmilienMAJaeger: ok13:15
*** adarazs_ is now known as adarazs13:15
*** bobh has quit IRC13:16
EmilienMAJaeger: lgtm, thx for the cleanup13:16
*** sree has joined #openstack-infra13:16
AJaegerthanks for confirming, EmilienM13:16
dmsimardclarkb, rcarrillocruz, mordred: does that seem sensible to you ? https://review.openstack.org/#/c/451396/13:17
adarazsinfra-root: can I get a review please on https://review.openstack.org/482210 ? it's sitting there for a week and it would be fairly useful to get it in. passed the gates, has a +1.13:17
adarazsit's from  openstack-infra/puppet-openstackci13:18
*** ihrachys has joined #openstack-infra13:18
openstackgerritMerged openstack-infra/project-config master: Use local_conf where possible  https://review.openstack.org/48413513:19
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: Create openstack-py35 job with upper-constraints  https://review.openstack.org/48398713:20
*** zhurong has quit IRC13:22
*** scottda has joined #openstack-infra13:23
*** lbragstad has quit IRC13:26
*** baoli has joined #openstack-infra13:26
*** gcb has quit IRC13:28
dimsAJaeger : Hi, we are seeing some failures in static-release-publish jobs. have you seen this anywhere else? http://logs.openstack.org/cf/cff8ed7ec4c13da18942a893c1f6f67e5f750bee/release-post/static-releases-publish/f433fd9/console.html13:31
dimsAJaeger : zuul.exceptions.RevNotFound: Failed to checkout project 'openstack/releases' at revision 'cff8ed7ec4c13da18942a893c1f6f67e5f750bee'13:31
AJaegerdims: no idea - let's ask infra-root. Looks like our git repos are not mirrorred correctly13:32
*** superdan is now known as dansmith13:33
dimsAck thanks AJaeger13:33
*** markvoelker_ has joined #openstack-infra13:33
*** mriedem has joined #openstack-infra13:33
dimssmcginnis : dhellmann : ^13:33
*** markvoelker has quit IRC13:33
rcarrillocruzdmsimard: lgtm13:34
*** gordc has quit IRC13:35
*** gordc has joined #openstack-infra13:35
*** gordc has quit IRC13:35
*** ociuhandu has quit IRC13:36
pabelangerAJaeger: dims: ya, looks like a possible mirroring issue. I'll see if I can find something in the logs13:36
dimsthanks pabelanger13:36
*** ociuhandu has joined #openstack-infra13:36
dimspabelanger : i have about 6 of them failures - http://lists.openstack.org/pipermail/release-job-failures/2017-July/date.html13:37
*** links has quit IRC13:37
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574713:38
*** markvoelker_ has quit IRC13:38
*** markvoelker has joined #openstack-infra13:39
jlvillalI wonder why logs.openstack.org is listed as an ad-server?  https://hosts-file.net/ad_servers.txt13:40
jlvillalNoticed that this morning when my Pi-hole blocked access13:40
pabelangerAJaeger: dims: have these jobs worked before? Also, does it make sense to be using zuul-cloner in a release-post pipeline?13:40
dmsimardjlvillal: that's odd. "hpHosts is a community managed and maintained hosts file that allows an additional layer of protection against access to ad, tracking and malicious websites."13:40
jlvillaldmsimard, Yeah, I was surprised too13:41
AJaegerpabelanger: we switched to zuul-cloner some months ago, those should work13:41
*** bobh has joined #openstack-infra13:41
*** ykarel has quit IRC13:42
*** penguinolog has joined #openstack-infra13:43
pabelangerhttp://logs.openstack.org/fc/fc04caefd46a441663ea7e82b380a08de9b2dba0/release-post/tag-releases/c1b8c62/console.html worked with fc04caefd46a441663ea7e82b380a08de9b2dba0 then http://logs.openstack.org/fc/fc04caefd46a441663ea7e82b380a08de9b2dba0/release-post/static-releases-publish/8ae945b/console.html failed as the next job. Both used the same zuul-merger13:43
pabelangerlooking at logs on zm03 now13:43
dmsimardjlvillal: https://hosts-file.net/?s=logs.openstack.org&x=0&y=0 "Added By: MysteryFCM" 03-12-201413:43
dmsimard¯\_(ツ)_/¯13:43
*** gcb has joined #openstack-infra13:44
pabelangerseeing some puppet errors on zm0313:44
pabelangerhttp://paste.openstack.org/show/615612/13:45
pabelangerseem to be using python3 on zm0313:45
openstackgerritThomas Herve proposed openstack-infra/project-config master: Add py3 gate to heat agents.  https://review.openstack.org/48437713:45
pabelangerWonder if that is left over from a few months back when I added pip3 to servers13:45
*** xyang1 has joined #openstack-infra13:47
pabelangerya, some reason zm03 is python3 for pip13:47
*** beekneemech is now known as bnemec13:48
*** gcb has quit IRC13:48
*** gcb has joined #openstack-infra13:49
*** yamamoto has quit IRC13:49
*** sree has quit IRC13:50
*** esberglu has joined #openstack-infra13:50
*** felipemonteiro has joined #openstack-infra13:51
*** sbezverk has quit IRC13:51
*** sbezverk has joined #openstack-infra13:51
pabelangerk, pip fixes13:52
pabelangerfixed*13:52
*** felipemonteiro__ has joined #openstack-infra13:53
pabelangerlet me watch logs to see if puppet is working first13:53
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: Create openstack-py35 job with upper-constraints  https://review.openstack.org/48398713:53
pabelangerAJaeger: so, ^ would be a new example of how to setup some tox things13:54
pabelangerAJaeger: specifically, we are exporing UPPER_CONSTRAINTS_FILE to bash and pip will install from that path, over copying the file into the working git tree13:55
pabelangerAJaeger: so far, seems to be working well13:55
*** ldnunes has quit IRC13:55
pabelangerAJaeger: https://review.openstack.org/#/c/484027 shows an example of it being run13:56
*** felipemonteiro has quit IRC13:56
pabelangermordred: clarkb: fungi: it would be great to land: https://review.openstack.org/#/c/484029/ fixes reloads on zuulv3.o.o13:58
*** zhurong has joined #openstack-infra13:59
*** zhurong has quit IRC13:59
AJaegerpabelanger: interesting - thanks14:00
fungiconfirmed, gerrit doesn't indicate any trouble syncing to mirrors and those failures look like trouble getting zuul refs from the mergers14:01
*** sree has joined #openstack-infra14:01
dimsfungi : pabelanger : how do we fix it?14:02
pabelangerAJaeger: http://logs.openstack.org/27/484027/2/check/openstack-py35/e5492c9/ is the output of openstack-py3514:03
*** rbrndt has joined #openstack-infra14:03
fungipabelanger: to finally fix the python3 default issue on the persistent nodes i had to do `sudo python2.7 -m pip install -U --force pip setuptools tox virtualenv`14:03
pabelangerdims: fungi: I am just waiting for puppet to run on the server first, making sure it is running the latest versions of things we expect14:03
pabelangerfungi: oh, right. let me confirm14:03
dimscool thanks, will hold releases till we get past this14:03
*** dhajare has quit IRC14:03
fungipabelanger: though that was also after the symlinks for pip had been corrected, so probably also need double-checking14:03
pabelangerfungi: ya, symlinks are correct14:04
pabelangerand command run again14:04
fungistrange that the failures just now cropped up though14:04
*** chlong has joined #openstack-infra14:05
pabelangerI think it might be unrelated, but puppet has been failing on the server for a while14:05
*** EricGonczer_ has joined #openstack-infra14:05
pabelangerfungi: I also was seeing some DNS issues from this morning14:06
pabelangerhttp://paste.openstack.org/show/615615/14:06
pabelangertrying to see if that fits into the timeline that dims is reporting14:06
fungii'm going to git fsck a copy of the releases repo from zm0314:07
*** sree_ has joined #openstack-infra14:07
*** sree_ is now known as Guest3563614:07
fungilooks intact14:07
*** winggundamth has quit IRC14:08
fungialso git show on that rev from the example failed static-releases-publish job works fine14:08
pabelangerI am seeing a few errors in merger-debug.log14:08
pabelangerbut nothing for release.git just yet14:08
*** EricGonc_ has joined #openstack-infra14:08
pabelangerI wonder if they are normal becase of merge conflicts14:09
*** yamamoto has joined #openstack-infra14:09
*** yamamoto has quit IRC14:09
fungihttp://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=134 is really weird14:09
*** rnoriega_ has joined #openstack-infra14:09
*** sree has quit IRC14:10
pabelangerodd14:10
*** chlong has quit IRC14:10
fungilike we lost snmp access to zm03 in mid-september and regained it today around 10:15 utc14:10
*** EricGonczer_ has quit IRC14:10
*** otherwiseguy_ has joined #openstack-infra14:10
fungier, 10:25 utc i mean14:11
pabelangerfungi: that is around the time when DNS finally came back online14:11
pabelangerI wonder if firewall was caching old DNS?14:11
*** hongbin has joined #openstack-infra14:11
pabelangerwhen new dns started working, it finally updated14:11
*** alexchadin has quit IRC14:11
fungiwhy would we have new dns? uptime on this server is 418 days14:11
pabelangerdoesn't firewall allow inbound requests from cacti.o.o?14:12
*** adisky__ has quit IRC14:12
pabelangerIIRC, mid-sept is when we did our server upgrades to trusty14:12
fungioh, new ip address for the cacti server14:12
fungi276 days uptime on cacti.o.o14:13
* fungi does the math14:13
pabelangerYa, I just guessing right now14:13
*** ldnunes has joined #openstack-infra14:14
fungilooks like early october was when this was built (october 3 i believe)14:14
pabelangerya, that makes sense, cause I see an outage for other zuul-mergers in Oct14:15
pabelangerbut they seems to recover much faster14:15
fungibut our snmp data for zm03 ceases in mid-september, at least a couple weeks before cacti.o.o was replaced14:15
pabelangerRight, but I see the same lose of data around sept for other mergers for some reason14:16
pabelangerhttp://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=2166&rra_id=all14:16
jlvillalFix for broken ironic-inspector gate job: https://review.openstack.org/48305914:16
pabelangerfungi: wasn't rcarrillocruz playing around with cacti around that time?14:16
jlvillalReviews would be appreciated. Change to devstack-gate ^^^14:16
*** rnoriega_ has quit IRC14:16
*** otherwiseguy_ has quit IRC14:16
fungipabelanger: oh, maybe. i do see a brief mid-september gap on zm04 data as well14:17
*** LindaWang has quit IRC14:17
fungisame on zm01 and zm0214:17
*** LindaWang has joined #openstack-infra14:18
fungithough those all look like about a week after zm03 data stops14:18
fungiso anyway, snmp data magically wakes up for zm03 at 10:25 today after ~10 months of silence. job failures were going on more than 90 minutes after that14:19
fungiso anyway, assuming for a moment that all that is unrelated circumstance and focusing on the job failure logs...14:21
*** tushar has joined #openstack-infra14:22
fungiare we guaranteed that non-zuul-built refs (in this case post pipeline jobs acting on a commit freshly merged by gerrit) will be available from zuul mergers?14:23
fungilooks like it's taken care of these days14:28
fungifrom the merger-debug.log on zm03:14:28
fungi2017-07-17 11:56:35,126 DEBUG zuul.Repo: Checking out fc04caefd46a441663ea7e82b380a08de9b2dba014:28
*** gordc has joined #openstack-infra14:28
pabelangerYa, I am not sure14:29
fungithat's roughly 2 minutes 25 seconds before the job fails to retrieve the same ref14:29
pabelangerWhy I was asking why we'd be using zuul cloner for post pipelines14:29
*** lbragstad has joined #openstack-infra14:29
*** marst has quit IRC14:30
AJaegerpabelanger: we have some jobs - think coverage - that run in both post and check/gate pipeles14:31
AJaegerpabelanger: we fixed a few bugs in zuul-cloner so that we can use it everywhere. see also https://review.openstack.org/45446114:32
pabelangerAJaeger: okay, thanks14:32
AJaegerpabelanger: https://review.openstack.org/45287914:33
fungiyeah, so anyway it _looks_ like that ref should have been available from zm03 well before the job attempted to request it14:33
*** trown is now known as trown|brb14:34
dmsimardpabelanger: doesn't that ring the same bell as what we've seen in review.rdoproject.org ? Zuul failing to pick up a ref that has already been merged ?14:35
*** gyee has joined #openstack-infra14:37
dmsimardNot that I have anything worthwhile to share, I haven't noticed the problem happening in recent history (did it disappear?). I know that for some particularly problematic "POST" pipeline jobs, we moved from a zuul cloner to a git clone and that worked around the issue.14:37
*** trown|brb is now known as trown14:39
*** esberglu has quit IRC14:40
*** yamamoto has joined #openstack-infra14:40
*** cshastri has quit IRC14:41
fungihere are all the entries in the apache access log for zm03 corresponding to the node which ran that failed job: http://paste.openstack.org/show/615619/14:41
fungithe times correspond to when it attempted (and failed) to retrieve fc04caefd46a441663ea7e82b380a08de9b2dba014:42
funginothing from that timeframe in any apache error logs14:42
fungithe node seems (as expected) to have communicated only from its ipv6 address. no hits in the apache log for the node's v4 addy14:43
*** isaacb has quit IRC14:45
*** yamamoto has quit IRC14:46
*** marst has joined #openstack-infra14:46
*** psachin has quit IRC14:48
smcginnisNot safe to recheck anything yet, right?14:52
*** sshnaidm|off has joined #openstack-infra14:52
AJaegersmcginnis: you cannot recheck a post job14:53
smcginnisJobs that are failing to find things not synced to mirrors.14:53
*** armax has joined #openstack-infra14:53
AJaegersmcginnis: do you have other examples?14:53
pabelangerwhich job is that?14:53
smcginnisU-C patch for os-brick failed with not finding the new version. Maybe unrelated?14:54
* smcginnis gets link14:54
fungior... if the actual problem is network connectivity/dns lookup failures then maybe it could be related14:55
*** esberglu has joined #openstack-infra14:55
fungibut the post(-release) pipeline failures reported looked like an issue retrieving refs from zuul mergers not from git mirrors14:56
*** esberglu has quit IRC14:56
smcginnisHmm, this is actually a different failure than I saw earlier, but could be another symptom: https://review.openstack.org/#/c/484342/14:56
*** esberglu has joined #openstack-infra14:57
AJaegersmcginnis: do you mean http://logs.openstack.org/42/484342/1/check/gate-requirements-tox-py27-check-uc-ubuntu-xenial/b369b67/console.html#_2017-07-17_12_11_33_232384 ?14:57
AJaeger"No matching distribution found for os-brick===1.15.1" ?14:57
smcginnisAJaeger: Yep, that's the one.14:58
*** armax has quit IRC14:58
*** yamahata has joined #openstack-infra14:59
*** Guest35636 has quit IRC14:59
*** LindaWang has quit IRC15:02
*** sshnaidm|off has quit IRC15:03
*** Goneri has joined #openstack-infra15:03
*** csomerville has joined #openstack-infra15:03
*** sshnaidm has joined #openstack-infra15:05
*** armax has joined #openstack-infra15:06
*** sshnaidm is now known as sshnaidm|off15:06
*** gyee has quit IRC15:06
*** rwsu has joined #openstack-infra15:06
*** tushar has quit IRC15:06
jeblairfungi, pabelanger: is there something i need to look into?15:06
fungijeblair: not sure yet. we have an example of post-release jobs failing to checkout refs from zm0315:07
*** gyee has joined #openstack-infra15:08
fungismcginnis: the requirements/constraints check jobs sometimes race with pypi publication, so that failure of yours isn't necessarily alarming (i need to check the timing on it though to see whether it's the known race)15:08
*** jbadiapa has quit IRC15:08
*** jbadiapa has joined #openstack-infra15:09
*** andreas_s has quit IRC15:10
jeblairfungi, pabelanger: what's the relation with dns?  i don't understand what about dns would have changed recently15:10
pabelangerfungi: okay, I have deleted the ipv6 test network we (I) added into la1. I am hoping that will then have openstack drop IPv6 from the mirror server15:10
pabelangerfungi: monitoring now15:11
smcginnisfungi: That was my assumption at first, but then got suspicious with the other failures. I'll try recheckingn and see if that's the case.15:11
pabelangerjeblair: fungi: I don't know DNS is the issue, but I did see DNS failures in zm03 logs this morning15:11
fungijeblair: pabelanger said he saw some dns lookup failures earlier and theorized they might be related, though i see evidence in the zm03 apache log that a node in one of the examples did connect and make requests so that seems an unlikely explanation15:11
fungiand in the zm03 merger log that it checked out one of the refs in question successfully (and so should have been able to serve it) minutes before the job node requested it15:12
jeblairfungi, pabelanger: it looks like zm03 hasn't been online until this morning15:12
fungismcginnis: that failure is roughly 2 minutes after the pypi upload for the offending release so odds are it tried to hit our pypi mirror before the next 5-minute update pulse completed15:13
pabelangerjeblair: online for zuul.o.o?15:13
fungijeblair: i saw in the cacti logs that we had no stats collected between the middle of september and 10:25 utc today15:13
pabelangerI mean, where are you looking to see that15:13
jeblairpabelanger: correct.  the debug logs are filled with failed connection attempts from as far back as they go until this morning.15:13
pabelangerHmm15:13
fungifor zm03 specifically15:13
fungiso it may have had some sort of network issue up until "something" magically fixed it this morning?15:14
jeblair2017-07-17 10:24:10,466 ERROR gear.Worker.Zuul Merger: Exception while connecting to <gear.Connection 0x7f5cad4e4590 host: zuul.openstack.org port: 4730>15:14
jeblairgaierror: [Errno -2] Name or service not known15:14
jeblair2017-07-17 10:24:12,567 DEBUG zuul.MergeServer: Registering15:14
pabelangerright, I haven't seen how far back that went15:14
jeblairthat's the demarcation between broken and fixed15:14
*** ociuhandu has quit IRC15:14
jeblaira month at least15:14
fungi10:25 is also when cacti suddenly started being able to collect stats from it (give or take 5 mniutes)15:14
pabelangerjeblair: ya, I see that now15:14
pabelangerdidn't check pass this morning15:15
jeblairfungi: weirdly, there were snmp connection from cacti before then, only about half as many as after15:16
pabelangerhave we see a job pass using zm03 this morning? Wonder if we should consider leaving it offline15:17
fungijeblair: snmp over udp, so possible the replies never made it back until today15:17
fungistarting to look like maybe the server was able to receive packets but not send packets or something15:17
jeblairfungi: that makes sense15:18
fungiso thought it was replying to snmp queries but was unaware they never got to the destination15:18
jeblairJul 17 12:54:09 zm03 puppet-user[8471]: (/Stage[main]/Zuul/Exec[install_zuul]) Dependency Package[yappi] has failures: true15:19
jeblairJul 17 12:54:09 zm03 puppet-user[8471]: (/Stage[main]/Zuul/Exec[install_zuul]) Skipping because of failed dependencies15:19
jeblairthis suggests that we're running an old version of zuul15:19
jeblairthere have been bugfixes related to having the correct refs for post jobs since, erm, september is when we're saying this server went awol? :)15:19
fungijeblair: pabelanger did mention puppet has been unable to update the server15:20
fungiso i wouldn't be surprised at this point15:20
jeblairi'm inclined to assume it's related to those bugs and suggest we stop z-m, repair the puppet, install new zuul, and then restart15:20
fungii concur15:20
pabelangerYa, that is what I am doing now15:20
fungithanks pabelanger!15:21
pabelangerPuppet is reporting fixed now15:21
pabelangerso we should be able to reinstall zuul15:21
pabelangerthen restart15:21
jeblairpabelanger: if puppet is fixed, it should have installed zuul itself15:22
jeblairZuul version: 2.5.1.dev1615:22
pabelangerchecking logs15:22
*** Julien-zte has quit IRC15:22
jeblairi think we're at 2.5.2 now15:22
pabelangerJul 17 14:54:15 zm03 puppet-user[3320]: Finished catalog run in 5.23 seconds15:23
pabelangerbut no reinstall of puppet15:23
pabelangerI think we only reinstall if git changes?15:23
pabelangeroh15:23
pabelangerit did try to reinstall at 10:3515:23
pabelangerby failed because of python pip2/pip3 issue15:24
pabelangerI think we might have to manually install15:24
jeblairok15:24
fungismcginnis: so here's when our pypi mirror updated for os-brick 1.15.1: http://paste.openstack.org/show/615627/15:26
smcginnisfungi: Great, thank you. Looks like the recheck is fine, so just bad timing.15:27
fungismcginnis: that's a minute and 26 seconds after the failed job tried to retrieve it, for what it's worth15:27
fungiso yes, the known race we have currently15:27
pabelangerjeblair: zuul==2.5.3.dev115:27
pabelangerthat is now installed15:27
pabelangersame version we have on zm0415:27
fungithe release team has plans to eventually implement some sort of delay or active wait in the release jobs to solve it in the future15:28
fungismcginnis: ^15:28
pabelangerjeblair: safe to just service zuul-merger stop; service zuul-merger start ?15:28
jeblairpabelanger: ++15:28
*** Julien-zte has joined #openstack-infra15:29
pabelangerjeblair: fungi: dims okay, zm03.o.o updated to latest zuul (master branch) and restarted15:29
fungithanks pabelanger!15:30
dimsw00t thanks pabelanger15:30
pabelangerjeblair: just looking at puppetmaster logs, can jeblairtest be deleted? puppet is failing to run there too15:31
fungiso post mortem here is that there was probably some long-standing network connectivity issue for zm03 which resulted in it missing 10 months of zuul bug fixes, one of which was likely the culprit for the post-release job failing to retrieve that ref?15:31
*** annegentle has joined #openstack-infra15:31
jeblairpabelanger: yep15:31
pabelangerfungi: right, and when it did come back online, pip2 / pip3 was broken, so we didn't pick up latest zuul15:32
pabelangerjeblair: thanks15:32
jeblairpabelanger, fungi: any other zm servers like this?15:32
fungipabelanger: jeblair: oh, i keep meaning to ask about jeblairtest too. it's been sending cronspam to our sysadmins list for months about unattended upgrades, and subsequently causing backwash delivery failures because most people's mailservers are refusing to accept delivery due to missing reverse dns15:32
pabelangerjeblair: fungi: I can audit quickly15:33
*** sree has joined #openstack-infra15:33
fungiultimately i get ~4 e-mails a day from jeblairtest (and i may be the only one receiving them since the missing reverse dns isn't quite enough to bump those over my spam classification threshold)15:34
pabelangerfungi: jeblair: we have the correct version of zuul running on other mergers15:34
*** ociuhandu has joined #openstack-infra15:35
fungipabelanger: thanks for checking15:35
pabelangerfungi: ya, I've been getting that too15:35
*** chlong has joined #openstack-infra15:36
*** annegentle has quit IRC15:36
*** sree has quit IRC15:37
*** chlong has quit IRC15:38
pabelangerokay, jeblairtest server deleted15:38
*** annegentle has joined #openstack-infra15:39
*** david-lyle has joined #openstack-infra15:40
*** chlong has joined #openstack-infra15:45
*** xarses_ has joined #openstack-infra15:48
*** wolverineav has quit IRC15:50
*** wolverineav has joined #openstack-infra15:50
*** ociuhandu has quit IRC15:50
*** ociuhandu has joined #openstack-infra15:52
*** camunoz has quit IRC15:53
*** wolverineav has quit IRC15:54
*** wolverineav has joined #openstack-infra15:56
*** isaacb has joined #openstack-infra15:56
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Propose patches to os-service-types from service-types-authority  https://review.openstack.org/48440715:57
*** Julien-zte has quit IRC15:59
*** Julien-zte has joined #openstack-infra16:00
*** Julien-zte has quit IRC16:00
*** Julien-zte has joined #openstack-infra16:01
*** Julien-zte has quit IRC16:01
*** xarses_ has quit IRC16:01
*** Julien-zte has joined #openstack-infra16:01
*** egonzalez has quit IRC16:02
*** Julien-zte has quit IRC16:02
*** isaacb has quit IRC16:02
*** Julien-zte has joined #openstack-infra16:02
*** iyamahat has joined #openstack-infra16:02
*** rkukura has joined #openstack-infra16:02
*** Julien-zte has quit IRC16:02
*** Julien-zte has joined #openstack-infra16:03
*** armax has quit IRC16:03
*** Julien-zte has quit IRC16:03
*** Julien-zte has joined #openstack-infra16:04
*** Julien-zte has quit IRC16:04
*** EricGonc_ has quit IRC16:04
*** hashar is now known as hasharAway16:04
*** Julien-zte has joined #openstack-infra16:04
*** Julien-zte has quit IRC16:05
*** EricGonczer_ has joined #openstack-infra16:05
*** Julien-zte has joined #openstack-infra16:05
*** Julien-zte has quit IRC16:06
*** Julien-zte has joined #openstack-infra16:06
*** Julien-zte has quit IRC16:06
*** Julien-zte has joined #openstack-infra16:07
*** Julien-zte has quit IRC16:07
*** Hal has quit IRC16:08
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Simplify _deleteLocalBuild parameters  https://review.openstack.org/48441316:10
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Support UUID as builder identifier  https://review.openstack.org/48441416:10
*** prateek has quit IRC16:14
*** Apoorva has joined #openstack-infra16:18
*** rcernin_ has quit IRC16:19
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Support dynamic dependent pipeline additions  https://review.openstack.org/48359716:20
*** derekh has quit IRC16:23
openstackgerritMerged openstack-infra/zuul-jobs master: Update to tox_envlist variable  https://review.openstack.org/48393416:24
pabelanger2017-07-17 16:15:10,910 p=31048 u=root |  mirror.la1.citycloud.openstack.org : ok=8    changed=3    unreachable=0    failed=016:29
pabelangerfungi: ^16:29
pabelangerfungi: so, no need to rebuild our server16:29
*** csomerville has quit IRC16:29
pabelangerfungi: puppet back to using ipv416:29
pabelangerwhich means we can now land our revert: https://review.openstack.org/#/c/484008/16:30
fungipabelanger: i manually edited the inventory on friday to get it to use ipv4... any idea what's changed to get the dynamic inventory picking the ipv4 address now?16:30
pabelangerfungi: I purged the cache file to have it regenerate16:31
fungiyeah, i did that a few times as well last week16:31
pabelangerfungi: and removed our openstack-network-ipv6 from la116:31
fungiaha, that may be what did it16:31
pabelangerthat was providing ipv6 to the server16:31
*** ralonsoh has quit IRC16:31
fungiindeed, openstack server list there is now only showing the v4 address16:31
pabelangeropenstack-subnet-ipv6 sorry :)16:31
fungiand network show openstackci-network1 only shows the one subnet connected now16:32
fungiso that's what seems to have done the trick. thanks!16:32
pabelangersure, np16:32
fungii was having trouble figuring out how to view subnet details with openstackclient16:32
*** annegentle has quit IRC16:37
*** EricGonczer_ has quit IRC16:38
*** knikolla has quit IRC16:40
*** EricGonczer_ has joined #openstack-infra16:40
*** annegentle has joined #openstack-infra16:41
*** spotz has quit IRC16:42
*** rhagarty has quit IRC16:43
*** spotz has joined #openstack-infra16:45
*** yamahata has quit IRC16:46
*** rhagarty has joined #openstack-infra16:47
*** iyamahat has quit IRC16:47
*** lucasagomes is now known as lucas-afk16:47
*** dizquierdo has quit IRC16:48
openstackgerritJames E. Blair proposed openstack-infra/openstack-zuul-jobs master: Use zuul-jobs style var names in run-docs  https://review.openstack.org/48407516:51
*** trown is now known as trown|lunch16:51
*** vhosakot has joined #openstack-infra16:53
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Use zuul-jobs style var names in run-docs  https://review.openstack.org/48407516:54
*** ociuhandu has quit IRC16:56
*** martinkopec has quit IRC16:56
AJaegerproject-config cores, could you put https://review.openstack.org/#/q/status:open+project:openstack-infra/project-config+branch:master+topic:local_conf (using local_conf where possible) and https://review.openstack.org/#/c/484206/ (reduce number of unused ansible jobs) https://review.openstack.org/484205 (remove unused jobs) on your queues, please? These are just cleanups...16:57
AJaegerihrachys, could you review https://review.openstack.org/484207 , please?16:58
*** vhosakot has quit IRC16:58
*** vhosakot has joined #openstack-infra16:58
*** vhosakot_ has joined #openstack-infra17:01
ihrachysAJaeger, need to ask old folks about the job. vpnaas is not part of neutron so that's not a question to me whether their job is needed.17:02
ihrachys*old -> odl17:02
openstackgerritMerged openstack-infra/project-config master: Use log_path from zuul logserver hostvars  https://review.openstack.org/48407317:02
*** chlong has quit IRC17:03
*** vhosakot has quit IRC17:03
AJaegerihrachys: those jobs are not run at all, so should be safe - just wanted you to double check that not using them is fine.17:06
*** iyamahat has joined #openstack-infra17:06
openstackgerritMonty Taylor proposed openstack-infra/shade master: Add project_id parameter to list_volumes  https://review.openstack.org/48443017:06
AJaegerihrachys: but please do ask odl folks17:06
ihrachysAJaeger, yeah, that's the main question17:06
ihrachysAJaeger, it seems they have a job for v2 driver17:06
ihrachyswith vpnservice17:06
ihrachyswhatever it means17:06
ihrachysI suspect it's a superset of the one you kill17:07
ihrachysbut I will reach to them17:07
AJaegerihrachys: thanks17:07
*** jascott1 has joined #openstack-infra17:09
*** ilpianista_ has quit IRC17:10
*** masayukig[m] has quit IRC17:11
*** armax has joined #openstack-infra17:12
openstackgerritsebastian marcet proposed openstack-infra/system-config master: OpenStackId release 1.0.22 * updated login form remember me text * added fav icons * updated base url param  https://review.openstack.org/48443117:12
openstackgerritsebastian marcet proposed openstack-infra/system-config master: OpenStackId release 1.0.22  https://review.openstack.org/48443117:12
*** jascott1 has quit IRC17:12
*** yamahata has joined #openstack-infra17:13
*** ldnunes has quit IRC17:15
*** GheRiver1 has joined #openstack-infra17:15
*** GheRiver1 has quit IRC17:15
openstackgerritMerged openstack-infra/project-config master: Revert "Set citycloud-la1 max-server to 0"  https://review.openstack.org/48400817:15
*** harlowja has joined #openstack-infra17:17
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: Ensure we load roles for linting  https://review.openstack.org/48404317:18
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: Include ansible-playbook syntax-check for tox pep8  https://review.openstack.org/48404517:18
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: Rename pep8 to linters for tox  https://review.openstack.org/48404617:18
pabelangermordred: jeblair: ^ is ready for review17:18
*** ihrachys has quit IRC17:18
*** jascott1 has joined #openstack-infra17:18
pabelangermordred: jeblair: once landed, I'll make the same update to zuul-jobs for linting17:19
*** chlong has joined #openstack-infra17:20
*** ilpianista_ has joined #openstack-infra17:20
fungianyone up for a very quick review which changes one character in the system-config repo? https://review.openstack.org/484431 (bumps openstackid release in production)17:22
fungithis will bring it back into sync with openstackid-dev17:22
pabelangerfungi: trade you: https://review.openstack.org/#/c/482592/17:24
pabelangerfedora-26 mirror17:24
fungioh right, thanks! i meant to review that one17:24
fungilgtm17:26
*** smarcet has joined #openstack-infra17:26
*** ldnunes has joined #openstack-infra17:28
*** yamahata has quit IRC17:33
*** yamahata has joined #openstack-infra17:34
*** prateek has joined #openstack-infra17:34
*** tosky has quit IRC17:35
*** masayukig[m] has joined #openstack-infra17:37
*** sambetts is now known as sambetts|afk17:38
pabelangerfungi: thanks17:38
*** efoley has quit IRC17:38
fungiy17:40
*** eranrom has joined #openstack-infra17:56
*** iyamahat_ has joined #openstack-infra17:57
*** iyamahat has quit IRC17:57
*** eranrom has quit IRC17:58
*** eranrom has joined #openstack-infra17:58
*** Douhet has quit IRC17:59
*** trown|lunch is now known as trown18:00
dmsimardpabelanger: are nodepool builder logs still available ? I had a bookmark for http://nb01.openstack.org/dib.centos-7.log but it doesn't look like that works18:00
fungidmsimard: checked on nb02?18:00
fungior 03 or 0418:00
*** tesseract has quit IRC18:01
fungii think 01 and 02 are decommissioned, replaced by 03 and 04 now18:01
pabelangerdmsimard: nb03, nb04 now18:01
dmsimardah 03 and 04 works, 01 and 02 don't18:01
dmsimardtahnks18:01
fungirebuilt on ubuntu xenial instead of trusty a month or so ago18:01
dmsimardthanks*18:01
pabelangerimages are down atm18:01
pabelangerwaiting on devstack fix to land18:01
pabelangerhopefully today18:01
fungipabelanger: we can enqueue/promote those changes if the devstack reviewers approve them18:02
fungisince it sounds like the old images are stuck on a problematic setuptools version as well18:02
pabelangerfungi: sure, we can do that18:02
pabelangerlet me promote18:03
fungithe sooner those get rebuilt, the sooner teh jobs stuck on setuptools issues will get moving again18:03
pabelanger484299 is the last we need18:03
pabelanger++18:03
*** electrofelix has quit IRC18:04
*** Douhet has joined #openstack-infra18:04
pabelangerk, promoted18:05
*** dtantsur is now known as dtantsur|afk18:07
*** felipemonteiro__ has quit IRC18:07
openstackgerritJames E. Blair proposed openstack-infra/project-config master: Fix reference to zuul logserver  https://review.openstack.org/48444118:07
*** tosky has joined #openstack-infra18:09
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: WIP Testing changes required to move 3nodes job to quickstart  https://review.openstack.org/48307718:09
*** electrofelix has joined #openstack-infra18:10
*** electrofelix has quit IRC18:14
inc0hey, so zuul v3 secrets, how will I access them?18:15
inc0I don't assume there will be ENV with them?:)18:15
fungiinc0: there will be a command-line tool/recipe you can use to encrypt them for use by zul's rsa keypair18:16
fungier, zuul's18:17
fungisorry zul!18:17
inc0encrypt or decryt?18:17
inc0I'll have to run docker login $username $password, how do I do that?18:17
fungiinc0: oh, now i see what you're asking. zuul will provide it to the job in a decrypted form yes. double-checking what that protocol looks like now18:18
fungiinc0: http://specs.openstack.org/openstack-infra/infra-specs/specs/zuulv3.html#secrets addresses the management aspects of those values but i don't see where it says whether they will be pushed in a file onto the node or provided in the calling environment an as envvar18:20
fungireading the friendly source now18:21
openstackgerritMerged openstack-infra/project-config master: Fix reference to zuul logserver  https://review.openstack.org/48444118:22
inc0I'll be publishing "pusher" change today probably18:22
inc0first run at it at least18:22
inc0I'm doing this in a way that I'll just need docker installed on node18:22
inc0and have access to kolla code and well...secrets18:22
fungihttp://git.openstack.org/cgit/openstack-infra/zuul/tree/doc/source/user/encryption.rst?h=feature/zuulv3 also doesn't address that question18:23
*** Sukhdev has joined #openstack-infra18:24
fungii wonder if the unspoken assumption there is that the value will be available via some ansible-ism?18:24
inc0well if it's available by ansible it's available somewhere, but I'm not big at usage of ansible vault (I assume that's where it'll land?)18:26
*** rcernin has joined #openstack-infra18:26
*** asingh_ has quit IRC18:27
*** asingh_ has joined #openstack-infra18:29
fungiyeah, it's not at all clear to me yet from the implementation in source either18:30
inc0heh, well, let me know when you figure it out and I'll write docs for it18:31
fungijeblair: if you're around, do you know whether plaintext access to secrets by jobs is implemented in feature/zuulv3 yet, or what form that handoff will take in the build?18:31
fungii remember following the design up to the handoff from the scheduler to the executor via gearman18:32
jeblairo/18:32
jeblairfungi, inc0: the decrypted form is an ansible variable with the name of the secret18:33
jeblairso you can use it directly in ansible, or if the job isn't ansible-based, interpolate it into whatever runs the 'real' job18:34
inc0ansible run by what and how can I add my own task to it?18:34
jeblair(eg, a shell script)18:34
jeblairinc0: yeah, if you don't have ansible playbooks for what you're doing, which is fine, you can just write a shell script, and then we'll have ansible export those variables as env vars and call the shell script.  i expect we'll have code to easily do that by launch18:36
inc0I need to run docker login -u {{ dockerhub_username }} -p {{ dockerhub_password }}18:36
inc0I'll need to check if docker login is session-specific tho18:37
jeblairinc0, fungi: indeed it looks like https://docs.openstack.org/infra/zuul/feature/zuulv3/user/jobs.html could use an additional section on the variables/secrets which are available to jobs :)18:38
fungijeblair: cool, thanks. that confirms my suspicion as to why it wasn't spelled out how jobs access those values... it's just assumed they access them like any other ansible vars18:38
*** otherwiseguy has quit IRC18:38
*** rnoriega has quit IRC18:38
openstackgerritMerged openstack-infra/system-config master: OpenStackId release 1.0.22  https://review.openstack.org/48443118:38
fungiso easy enough to make a minimal role which sticks them in an envvar or in a file on disk or whatever we want for use by non-ansible stuff18:39
jeblairfungi, inc0: we do at least mention it in the docs for the actual secret definition: https://docs.openstack.org/infra/zuul/feature/zuulv3/user/config.html#secret18:39
*** rwsu has quit IRC18:39
*** ociuhandu has joined #openstack-infra18:39
*** felipemonteiro has joined #openstack-infra18:39
jeblairfungi, inc0: and yes, this is all implemented.  we're about to start exercising it in our roll-out preparations, so i certainly expect this to be ready for use by the time we go live.18:40
inc0wonderful18:40
inc0I'll read into it and include this to my flow18:40
inc0yay for being guinea pig of zuulv3 features;)18:40
*** felipemonteiro_ has joined #openstack-infra18:40
fungiaha, i did see that config doc section but thought maybe it was missing details as to how to make use of those values18:41
jeblairinc0: that page and the encryption page (which fungi linked earlier, but is rendered here: https://docs.openstack.org/infra/zuul/feature/zuulv3/user/config.html#secret ) should cover it.  let me know if you have further questions (and i'll answer them in the form of doc updates :)18:41
fungiand the missing details is "you're running ansible so just use them directly"18:41
jeblairyep.  i'll definitely add that18:41
fungii kept assuming it was less simple than that18:42
fungi;)18:42
jeblairi am very lazy18:42
fungimeh, it's not something you would necessarily think you'd have to spell out18:42
fungiand yes, i looked to see if we had any real-world examples of using them, i just looked a little to soon18:43
fungier, too soon18:43
*** felipemonteiro has quit IRC18:44
*** bobh has quit IRC18:45
jeblairyeah.  we do have unit test 'examples': http://git.openstack.org/cgit/openstack-infra/zuul/tree/tests/fixtures/config/ansible/git/common-config/zuul.yaml?h=feature/zuulv3#n3618:45
*** jbernard has quit IRC18:45
*** jbernard has joined #openstack-infra18:45
jeblairused by http://git.openstack.org/cgit/openstack-infra/zuul/tree/tests/fixtures/config/ansible/git/common-config/playbooks/python27.yaml?h=feature/zuulv318:46
jeblairwhich just splats the contents into a file18:46
openstackgerritJulia Kreger proposed openstack-infra/project-config master: Correct docs publish location for sushy  https://review.openstack.org/48445018:46
fungioh, neat. i missed that in the tests18:47
*** SamYaple has quit IRC18:47
fungijeblair: thanks! very useful18:47
jeblairinc0: but it does illustrate an interesting thing that we built into secrets -- they aren't single values, they are collections.  so that's a username+password pair, but only the password is encrypted.  that's probably your use case.18:47
*** SamYaple has joined #openstack-infra18:47
jeblair(you could obviously provide the username some other way, but this lets you manage the data together)18:48
*** otherwiseguy has joined #openstack-infra18:48
*** rnoriega has joined #openstack-infra18:49
fungiyep, i remember that from the original design discussions. definitely useful18:50
inc0lol I just noticed that when you run docker login it will spit out your creds to file in base6418:51
inc0that's kinda concerning18:51
fungieep18:51
jeblairinc0: it should at least be rot13-base64!18:51
fungiindeed that's a little weird. i guess it's a hacky way of making a single-sign-on implementation?18:51
fungipresumably you can tell it where to stick its base64 (e.g., /dev/null)18:52
*** EricGonc_ has joined #openstack-infra18:52
fungior better, some option to be able to turn off that behavior entirely18:52
*** EricGonczer_ has quit IRC18:53
inc0well you can stick it to dev null but I wouldn't be surprised if then docker wouldn't work18:53
inc0login stuff that is18:53
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: WIP: Add settings for ovb in rdocloud  https://review.openstack.org/48095018:53
*** rwsu has joined #openstack-infra18:55
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: WIP: Add settings for ovb in rdocloud  https://review.openstack.org/48095018:55
inc0ok that's not horrible, you can configure keychain18:55
fungioh, so it uses a file on disk to marshall the credentials from the login command to the processes which will actually use them, rather than doing that in-memory or through a pipe?18:56
inc0yeah18:57
fungiquestionable design choice there. assumes a lot more security from the filesystem18:57
*** ekcs has joined #openstack-infra18:59
inc0there are few alternatives tho18:59
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: WIP: Add settings for ovb in rdocloud  https://review.openstack.org/48095018:59
inc0well, I might end up just crafting this docker config.json file with base6419:00
inc0from our ansible19:00
inc0https://docs.ansible.com/ansible/docker_login_module.html19:00
fungiyeah, i guess the job could very carefully template the password into the config in such a way as to avoid echoing it in the console log19:02
*** nicolasbock has quit IRC19:03
inc0I really really hope ansible docker_login module won't spit it out to console;)19:03
*** bobh has joined #openstack-infra19:04
*** nicolasbock has joined #openstack-infra19:05
inc0so that's all I need from zuul http://paste.openstack.org/raw/615654/19:07
inc0where do I put it and how do I create these values?19:08
*** cmurphy has quit IRC19:09
pabelangerit will likely go into project-config as a trusted playbook19:09
*** tbarron has quit IRC19:09
*** cmurphy has joined #openstack-infra19:10
*** tbarron has joined #openstack-infra19:11
*** jcoufal has quit IRC19:13
inc0as in here? https://github.com/openstack-infra/project-config/tree/master/playbooks/base19:13
*** knikolla has joined #openstack-infra19:14
pabelangerRight, the is the location of our trusted jobs. But, trusted jobs are only just after code has been merged, for now, you can just add the playbook to your local repo to test19:14
*** kklimonda has joined #openstack-infra19:18
*** tushar has joined #openstack-infra19:19
tusharHi All19:19
tusharDIB Image creation is failing in third partty CI19:20
pabelangerYa, fixes are in the gate right now19:20
pabelangerhttps://review.openstack.org/#/c/484299/ should be the last patch we need19:21
tusharI think this needs to merge ? https://review.openstack.org/#/c/484299/19:21
tusharright?19:21
pabelangertushar: right, it is top of gate pipline right now should be 8mins out or so19:22
tusharokk19:22
pabelangerassuming linuxbridge test passes this time19:22
tusharthank you19:23
pabelangersure, np19:23
*** MarkAtwood has left #openstack-infra19:25
*** jkilpatr_ has joined #openstack-infra19:25
*** tushar has quit IRC19:25
*** jkilpatr has quit IRC19:27
*** aviau has quit IRC19:27
*** aviau has joined #openstack-infra19:28
*** harlowja has quit IRC19:32
*** dougwig has joined #openstack-infra19:34
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Add IPMI validation before undercloud deploy  https://review.openstack.org/48446219:36
*** camunoz has joined #openstack-infra19:39
*** Douhet has quit IRC19:43
*** dave-mccowan has joined #openstack-infra19:45
*** Douhet has joined #openstack-infra19:45
*** sree has joined #openstack-infra19:46
dirkpabelanger: could you help me understand why the nodepool builder nb03/nb04 do not show a opensuse-423 build log even though https://review.openstack.org/#/c/468117/ merged a few days ago?19:46
*** boris-42__ has joined #openstack-infra19:48
fungidirk: i'm going to bet that the service needs a reload/restart to pick up changes in the logging config, and we don't trigger that automatically19:48
pabelangerlooking at that now19:48
fungihrm... i lose that bet19:49
fungi-r--r--r-- 1 root root 756 May 23 14:11 /etc/nodepool/logging.conf19:49
pabelangerfungi: builder-logging.conf19:50
AJaeger;/19:50
fungiohhh19:50
fungiokay, cool that file is current19:50
fungii forgot we had multiple logging configs installing19:50
fungiso i'm back to my original assertion19:51
*** sree has quit IRC19:51
fungiyeah, service nodepool-builder requires /etc/nodepool/builder-logging.conf but there is no notification or subscription19:52
pabelangerwe likely need to add https://review.openstack.org/#/c/446172/ but for nodepool19:52
openstackgerritJulia Kreger proposed openstack-infra/project-config master: Correct docs publish location for sushy  https://review.openstack.org/48445019:53
pabelangerfungi: ya, I think it has always been a manual restart of builders to pick up new logging19:54
fungilooks like it's that way for all of nodepool's daemons19:54
pabelangerwould be nice to sighup for logging changes19:54
pabelangerzuul is the same way19:54
pabelangerhey, we built new images too19:55
pabelangercool19:55
fungiit's one thing for zuul, where the logging config changes infrequently, but for nodepool-builder we update the logging every time we add or remove an image19:55
pabelangerso, we can reload nodepool-builders now to pickup logging changes19:55
pabelangerfungi: agree, I can work on a patch for nodepool19:55
pabelangerdirk: fungi: http://nb04.openstack.org/dib.opensuse-423.log19:56
pabelangerbuilders restarted19:57
pabelangerdirk: are we planning on dropping 422?19:57
*** nicolasbock has quit IRC19:58
*** shardy has quit IRC19:58
*** gtmanfred has quit IRC19:58
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Add opensuse 42.3 support to nodepool-dsvm jobs  https://review.openstack.org/48447220:00
openstackgerritMerged openstack-infra/shade master: De-client-ify Service Create  https://review.openstack.org/48219420:01
*** gtmanfred has joined #openstack-infra20:01
pabelangerAJaeger: yolanda: ^ can we confirm next time that images in nodepool.yaml also are being built in the gate. It will help cut down on failures releasing diskimage-builder20:01
*** skelso has joined #openstack-infra20:01
dirkpabelanger: once everything is converted to 423 (we need a couple of more reviews for that), then I'm open for dropping 422, yes20:03
pabelangerdirk: okay, cool. going to bump that now in nodepool dsvm yest20:03
pabelangertest*20:03
*** jkilpatr_ has quit IRC20:05
*** yland has joined #openstack-infra20:05
dirkpabelanger: see telnet://158.69.90.102:19885 for the first 423 job..20:06
*** yland is now known as Guest8461220:06
dirkit would be good to get https://review.openstack.org/484115 , https://review.openstack.org/473959 and https://review.openstack.org/477773 merged though20:07
*** annegentle has quit IRC20:07
*** csomerville has joined #openstack-infra20:10
*** florianf has quit IRC20:11
pabelangerfungi: we should be ready to now remove the mysql.qcow2 image from tarballs.o.o. It is no longer showing up in nodepool-builder images logs20:11
*** dklyle has joined #openstack-infra20:12
*** david-lyle has quit IRC20:13
*** SotK is now known as SotK_20:16
*** dave-mccowan has quit IRC20:17
openstackgerritMerged openstack-infra/system-config master: Create fedora-26 mirror in openstack-infra  https://review.openstack.org/48259220:19
openstackgerritDirk Mueller proposed openstack-infra/nodepool master: Add support for nodepool testing of openSUSE 42.3  https://review.openstack.org/48447620:19
dirkpabelanger: ^^20:19
fungithanks pabelanger! i'll do it in a bit20:20
openstackgerritDirk Mueller proposed openstack-infra/project-config master: Test the openSUSE 42.3 opensuse-minimal image in nodepool tests  https://review.openstack.org/48447720:21
*** SotK_ has left #openstack-infra20:22
*** SotK has joined #openstack-infra20:22
pabelangerdirk: see: https://review.openstack.org/#/c/484472/ TL;DR is I dropped . between 42.3. Since we run 423 in nodepool.yaml20:24
pabelangerdidn't bother changing 42_2_2 since we plan to drop it20:24
*** dprince has quit IRC20:24
*** david-lyle has joined #openstack-infra20:26
*** rossella_s has quit IRC20:26
openstackgerritDirk Mueller proposed openstack-infra/nodepool master: Add support for nodepool testing of openSUSE 42.3  https://review.openstack.org/48447620:27
dirkpabelanger: wfm20:27
dirkpabelanger: updated the nodepool review accordingly20:27
*** dklyle has quit IRC20:27
*** chlong has quit IRC20:27
pabelangerdirk: left comment on PS120:28
*** rossella_s has joined #openstack-infra20:28
dirkpabelanger: should be fixed in PS2 ;-)20:30
*** chlong has joined #openstack-infra20:32
pabelangerdirk: you still have opensuse-42.3, I was recommending we update it to opensuse-423 also20:32
*** sridhar_ram has joined #openstack-infra20:33
*** prateek has quit IRC20:33
dirkpabelanger: ah, you meant one other place, sorry. fixed now20:34
openstackgerritDirk Mueller proposed openstack-infra/nodepool master: Add support for nodepool testing of openSUSE 42.3  https://review.openstack.org/48447620:34
*** jkilpatr has joined #openstack-infra20:37
openstackgerritDirk Mueller proposed openstack-infra/project-config master: Add openSUSE 42.3 tempest run graph  https://review.openstack.org/48448120:38
fungi#status log /srv/static/tarballs/trove/images/ubuntu/mysql.qcow2 has been removed from static.openstack.org again20:39
openstackstatusfungi: finished logging20:39
*** kgiusti has quit IRC20:40
openstackgerritJames E. Blair proposed openstack-infra/project-config master: Update base job to content in base-test  https://review.openstack.org/48448420:40
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: Add sample base job  https://review.openstack.org/48448520:45
openstackgerritDirk Mueller proposed openstack-infra/project-config master: Upgrade bindep-fallback check on opensuse-423 to voting  https://review.openstack.org/48448620:47
openstackgerritJames E. Blair proposed openstack-infra/openstack-zuul-roles master: Remove last remaining roles  https://review.openstack.org/48448720:48
*** skelso has quit IRC20:49
openstackgerritJames E. Blair proposed openstack-infra/project-config master: Update base job to content in base-test  https://review.openstack.org/48448420:50
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: opensuse-minimal: install glibc-locale  https://review.openstack.org/47395920:50
openstackgerritPaul Belanger proposed openstack-infra/zuul-jobs master: Ensure we load roles for linting  https://review.openstack.org/48448820:50
*** jcoufal has joined #openstack-infra20:50
*** Goneri has quit IRC20:51
*** EricGonc_ has quit IRC20:51
*** EricGonczer_ has joined #openstack-infra20:53
openstackgerritPaul Belanger proposed openstack-infra/zuul-jobs master: Include ansible-playbook syntax-check for tox pep8  https://review.openstack.org/48449020:54
openstackgerritPaul Belanger proposed openstack-infra/zuul-jobs master: Rename pep8 to linters for tox  https://review.openstack.org/48449120:54
*** harlowja has joined #openstack-infra20:56
*** EricGonc_ has joined #openstack-infra20:57
*** EricGonczer_ has quit IRC20:58
*** baoli has quit IRC20:59
*** trown is now known as trown|outtypewww21:05
openstackgerritAshwin Agate proposed openstack-infra/project-config master: Add publish-to-pypi job for monasca-ceilometer  https://review.openstack.org/48449421:05
*** cody-somerville has joined #openstack-infra21:06
*** cody-somerville has joined #openstack-infra21:06
*** panda is now known as panda|off21:07
*** csomerville has quit IRC21:08
*** mandre has quit IRC21:08
*** thorst has quit IRC21:10
*** ldnunes has quit IRC21:13
*** iyamahat has joined #openstack-infra21:14
*** iyamahat_ has quit IRC21:14
openstackgerritMerged openstack-infra/project-config master: Update base job to content in base-test  https://review.openstack.org/48448421:19
*** smarcet has left #openstack-infra21:19
openstackgerritAshwin Agate proposed openstack-infra/project-config master: Add publish-to-pypi job for monasca-ceilometer  https://review.openstack.org/48449421:22
*** gordc has quit IRC21:24
*** gtrxcb has joined #openstack-infra21:26
*** Sukhdev has quit IRC21:26
*** chlong has quit IRC21:26
*** jerryz has joined #openstack-infra21:31
*** rcernin has quit IRC21:33
*** dave-mccowan has joined #openstack-infra21:34
*** sree_ has joined #openstack-infra21:36
*** sree_ is now known as Guest5047621:36
*** annegentle has joined #openstack-infra21:40
*** Guest50476 has quit IRC21:40
*** Guest84612 has left #openstack-infra21:45
openstackgerritDirk Mueller proposed openstack-infra/project-config master: Adding more openSUSE 42.3 variants to existing 42.2 jobs  https://review.openstack.org/48449921:48
*** annegentle has quit IRC21:53
*** EricGonc_ has quit IRC21:54
*** aeng has joined #openstack-infra21:54
*** EricGonczer_ has joined #openstack-infra21:54
*** jcoufal has quit IRC21:57
openstackgerritOpenStack Proposal Bot proposed openstack-infra/shade master: Updated from global requirements  https://review.openstack.org/48332721:59
jeblairit's zuul meeting time in #openstack-meeting alt22:00
jeblairor rather22:00
jeblairit's zuul meeting time in #openstack-meeting-alt22:00
openstackgerritOpenStack Proposal Bot proposed openstack/diskimage-builder master: Updated from global requirements  https://review.openstack.org/48450322:00
openstackgerritAshwin Agate proposed openstack-infra/project-config master: Add publish-to-pypi job for monasca-ceilometer  https://review.openstack.org/48449422:01
*** bobh has quit IRC22:02
*** felipemonteiro_ has quit IRC22:03
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: WIP: Add settings for ovb in rdocloud  https://review.openstack.org/48095022:03
*** Goneri has joined #openstack-infra22:04
*** esberglu has quit IRC22:05
*** hasharAway has quit IRC22:09
*** thorst has joined #openstack-infra22:10
*** mriedem has quit IRC22:10
*** gouthamr has quit IRC22:12
*** gouthamr has joined #openstack-infra22:14
*** thorst has quit IRC22:15
*** mriedem has joined #openstack-infra22:16
*** apuimedo has quit IRC22:16
openstackgerritAshwin Agate proposed openstack-infra/project-config master: Add publish-to-pypi job for monasca-ceilometer  https://review.openstack.org/48449422:16
*** apuimedo has joined #openstack-infra22:17
*** esberglu has joined #openstack-infra22:20
*** EricGonczer_ has quit IRC22:23
openstackgerritMerged openstack-infra/zuul-jobs master: Create tox_environment to allow users access to shell variables  https://review.openstack.org/48393522:24
openstackgerritAshwin Agate proposed openstack-infra/project-config master: Add publish-to-pypi job for monasca-ceilometer  https://review.openstack.org/48449422:25
*** esberglu has quit IRC22:25
*** baoli has joined #openstack-infra22:25
*** rossella_s has quit IRC22:25
*** baoli has quit IRC22:26
*** rossella_s has joined #openstack-infra22:27
*** xyang1 has quit IRC22:29
*** wolverineav has quit IRC22:29
*** Goneri has quit IRC22:29
*** wolverineav has joined #openstack-infra22:30
*** darvon has joined #openstack-infra22:30
openstackgerritAshwin Agate proposed openstack-infra/project-config master: Add publish-to-pypi job for monasca-ceilometer  https://review.openstack.org/48449422:34
*** rwsu has quit IRC22:34
*** wolverineav has quit IRC22:34
*** vhosakot_ has quit IRC22:35
*** rwsu has joined #openstack-infra22:36
*** marst has quit IRC22:37
*** thorst has joined #openstack-infra22:41
*** rbrndt has quit IRC22:41
*** thorst has quit IRC22:43
*** funzo has joined #openstack-infra22:44
*** vhosakot has joined #openstack-infra22:45
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add callback plugin to emit json  https://review.openstack.org/48451522:47
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Only output result details on error  https://review.openstack.org/48451622:47
*** armax has quit IRC22:47
*** funzo has quit IRC22:50
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: WIP: Validate size of subunit for tox  https://review.openstack.org/48451822:53
*** mriedem has quit IRC22:54
openstackgerritPaul Belanger proposed openstack-infra/zuul-jobs master: Remove subunit file size check for tox role  https://review.openstack.org/48451922:55
*** Apoorva has quit IRC22:55
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: WIP: Validate size of subunit for tox  https://review.openstack.org/48451822:55
*** Apoorva has joined #openstack-infra22:56
openstackgerritPaul Belanger proposed openstack-infra/shade master: DNM - testing  https://review.openstack.org/48452022:56
*** EricGonczer_ has joined #openstack-infra22:58
*** aeng has quit IRC23:01
*** baoli has joined #openstack-infra23:02
*** baoli has quit IRC23:02
*** iyamahat_ has joined #openstack-infra23:03
*** iyamahat has quit IRC23:03
*** Apoorva_ has joined #openstack-infra23:04
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: WIP: Validate size of subunit for tox  https://review.openstack.org/48451823:04
*** vhosakot has quit IRC23:06
*** Apoorva has quit IRC23:07
*** mriedem has joined #openstack-infra23:08
openstackgerritAshwin Agate proposed openstack-infra/project-config master: Enable py35 job for Monasca Transform  https://review.openstack.org/48452223:08
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: WIP: Validate size of subunit for tox  https://review.openstack.org/48451823:15
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: Create openstack-py35 job with upper-constraints  https://review.openstack.org/48398723:15
pabelangerfungi: clarkb: mordred: https://review.openstack.org/#/c/484029/ will be helpful for zuulv3.o.o. Fixes reloading23:18
*** aeng has joined #openstack-infra23:18
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: WIP: Validate size of subunit for tox  https://review.openstack.org/48451823:19
*** rlandy has quit IRC23:24
*** sree_ has joined #openstack-infra23:24
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Add ansible-role-bindep to zuulv3.o.o  https://review.openstack.org/48452623:24
*** sree_ is now known as Guest120323:24
*** chlong has joined #openstack-infra23:25
*** hongbin has quit IRC23:28
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add more information on variables in jobs  https://review.openstack.org/48453023:28
jeblairfungi, inc0: ^ doc update from this morning's chat23:28
*** Guest1203 has quit IRC23:28
inc0thank you jeblair23:29
jeblairthe cross references are waiting on my adding anchors to all of the config attributes23:29
jeblairso i just left a note there for now23:29
openstackgerritPaul Belanger proposed openstack-infra/zuul-jobs master: Remove subunit file size check for tox role  https://review.openstack.org/48451923:31
openstackgerritAshwin Agate proposed openstack-infra/project-config master: Enable py35 job for Monasca Transform  https://review.openstack.org/48452223:31
openstackgerritMerged openstack-infra/puppet-zuul master: Send SIGHUP for zuul-scheduler reload  https://review.openstack.org/48402923:31
openstackgerritAshwin Agate proposed openstack-infra/project-config master: Enable py35 job for monasca-transform  https://review.openstack.org/48452223:31
*** gouthamr has quit IRC23:32
*** tosky has quit IRC23:40
*** bobh has joined #openstack-infra23:41
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: WIP: Validate size of subunit for tox  https://review.openstack.org/48451823:45
*** aeng has quit IRC23:46
*** funzo has joined #openstack-infra23:46
*** aeng has joined #openstack-infra23:46
*** funzo has quit IRC23:51
*** gouthamr has joined #openstack-infra23:52
*** gouthamr has quit IRC23:53
*** gouthamr has joined #openstack-infra23:53
*** ramishra has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!