Sunday, 2017-09-17

*** claudiub has quit IRC00:01
*** thorst has quit IRC00:01
*** cody-somerville has quit IRC00:01
*** bobh has joined #openstack-infra00:08
clarkbhttp://www.nbu.gov.sk/skcsirt-sa-20170909-pypi/ is a fun read00:12
clarkbfungi: ^00:12
clarkbprometheanfire: ^ we probably want to do a quick check of the constraints file to make sure nothing snuck in unexpectedly00:13
*** cody-somerville has joined #openstack-infra00:30
*** bobh has quit IRC00:32
dmsimardclarkb: this isn't new00:34
*** jdandrea has quit IRC00:34
clarkbits new in that someone published a giant list of typo names00:34
clarkbzuul queue under 70 now00:34
clarkbI think I am about ready to restart zuul00:35
clarkbthere seem to be a few changes predicted to be done in a few minutes and the rest are at 30 minutes or more so will let the last few trickle thorugh then restart00:35
dmsimardclarkb: http://incolumitas.com/2016/06/08/typosquatting-package-managers/ :)00:36
*** dave-mccowan has joined #openstack-infra00:41
*** ijw has quit IRC00:47
fungihome at last00:50
clarkbfungi: o/00:50
clarkbfungi: I'm just about to restart zuul00:50
clarkbthen we can either get the unrevert in tonight or do that in the morning00:50
fungiclarkb: there have been regular discussions on distutils-sig about the typo squatters on pypi, but i agree that's a large set00:50
fungiyeah, i'm here to help. lemme know if you need anythinfg00:51
fungianything00:51
clarkbok00:51
clarkbonce that senlin dashboard job finishes and it exits the gate I am saving check and gate queues and restarting00:51
clarkbhrm I guess I should let the openstacksdk post change finish too00:53
*** bobh has joined #openstack-infra00:55
clarkbsaving queues now00:56
clarkband restarting00:56
*** dave-mccowan has quit IRC00:56
*** thorst has joined #openstack-infra00:58
clarkbok zuul appears to have started back up again but its not enqueuing the gate changes00:59
clarkbah there it goes00:59
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Integration tests for multinode  https://review.openstack.org/50473400:59
clarkbstartup is very slow01:00
prometheanfireclarkb: sure01:00
clarkbwill get revert revert change up01:00
* fungi is ready to reapprove01:01
openstackgerritClark Boylan proposed openstack-infra/project-config master: Revert "Revert "Use case sensitive gerrit labels""  https://review.openstack.org/50473501:02
clarkbthere01:02
*** thorst has quit IRC01:02
clarkb#status notice Zuul has been restarted to pick up a bug fix in prep for Gerrit upgrade. Changes have been reenqueued for you.01:03
openstackstatusclarkb: sending notice01:03
-openstackstatus- NOTICE: Zuul has been restarted to pick up a bug fix in prep for Gerrit upgrade. Changes have been reenqueued for you.01:04
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Integration tests for multinode  https://review.openstack.org/50473401:05
openstackstatusclarkb: finished sending notice01:06
*** cshastri has joined #openstack-infra01:07
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Integration tests for multinode  https://review.openstack.org/50473401:16
*** patriciadomin has quit IRC01:16
clarkbfungi: ok it is in the gate now and should merge shortly01:17
*** zz_ja has quit IRC01:17
*** ekhugen has quit IRC01:18
*** mdrabe has quit IRC01:18
*** patriciadomin has joined #openstack-infra01:19
*** zz_ja has joined #openstack-infra01:19
*** mdrabe has joined #openstack-infra01:19
*** patriciadomin_ has joined #openstack-infra01:20
*** ekhugen| has joined #openstack-infra01:20
*** jab has joined #openstack-infra01:21
*** zz_ja has quit IRC01:23
*** patriciadomin has quit IRC01:23
*** jdandrea has joined #openstack-infra01:23
fungicool01:24
clarkb0130 UTC is the next puppet run too if we can get that in beforehand01:25
openstackgerritMerged openstack-infra/project-config master: Revert "Revert "Use case sensitive gerrit labels""  https://review.openstack.org/50473501:26
clarkbwoot01:26
*** baoli has joined #openstack-infra01:30
*** baoli has quit IRC01:30
*** baoli has joined #openstack-infra01:31
clarkbERROR! Attempted to execute "/etc/ansible/hosts/openstack" as inventory script: Inventory script (/etc/ansible/hosts/openstack) had an execution error: Traceback (most recent call last)01:31
clarkbthe run all process is still going at least01:32
clarkbthat may just prevent us from updating inventory for now?01:32
clarkblooks like a keystone auth error of some sort01:32
* clarkb makes a mental note to look into that01:32
clarkbalso the git backends are failing to puppet01:33
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473601:33
clarkbpython-paramiko fails to be installed by yum. Guessing it is centos 7.4 fallout01:35
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473601:35
clarkbsecond mental note to look into that01:35
dmsimardclarkb: where are you seeing that paramiko issue ?01:36
clarkbdmsimard: in puppet syslog on git0X.openstack.org01:36
clarkbdmsimard: http://paste.openstack.org/show/621281/ its a bunch of file conflicts like that01:37
*** bobh has quit IRC01:37
fungiseems fairly likely01:37
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473601:38
clarkbdmsimard: if you'd like to look into that feel free. I won't get to it until tomorrow at the earlist so just holler if you poke at it01:38
dmsimardclarkb: I have no access to be poking at anything :P01:39
clarkbwell I imagine it is reproduceable by installing the old version then upgrading, but fair enough :)01:39
dmsimardwe're doing an ensure latest in puppet ?01:39
dmsimardoh, nm, from absent to present01:40
clarkbdmsimard: looks like just ensure => present01:40
clarkbit is coming from puppet-jeebpy01:40
clarkb*puppet-jeepyb01:40
clarkbpuppet running on zuul.o.o now01:41
clarkband done01:41
dmsimardyou have just base repositories on there right ? no RDO ?01:41
clarkblooks like we have epel but no rdo01:42
clarkbfungi: I hve rechecked https://review.openstack.org/#/c/501887/2 to see if votes happen as expected01:42
dmsimardclarkb: yeah it looks like there was a rebase of python-paramiko in extras01:45
dmsimardhttps://pkgs.org/download/python2-paramiko01:45
openstackgerritzhangbailin proposed openstack-infra/puppet-ansible master: Update outdated url in pupet-ansible  https://review.openstack.org/50473701:46
dmsimardclarkb: the version in centos7-extras is more recent than the one in EPEL, would need to understand why EPEL is enabled in the first place01:48
clarkbdmsimard: I think because rax enables it by default on their images so we inherit from that. But there is a good chance we install things form epel too as a result01:49
dmsimardlooks like something first installs paramiko from base centos extras, then something installs epel, then something tries to install paramiko again but the version from epel is junk01:49
*** ramishra has joined #openstack-infra01:49
clarkbfungi: ok first change rechecked got a comment from jenkins01:49
clarkbI've got a couple other changes that should report shortly open and will refresh them to double check01:50
fungiif the lib is installed on an rh platform both from pip and rpm, then when the rpm gets auto-updated it will blindly overwrite the corresponding pip-installed files no matter whether they were older or newer. such is the issue with pip on rh using /usr rather than /usr/local01:50
openstackgerritzhangbailin proposed openstack-infra/puppet-gerrit master: Update outdated url in pup-gerrit  https://review.openstack.org/50473801:50
dmsimardfungi: the error is about two packages, there's no pip involved01:51
clarkbthough pip does report paramiko 2.2.101:51
clarkbso maybe part of it?01:51
dmsimardpip will report rpm installs01:52
dmsimardfile /usr/lib/python2.7/site-packages/paramiko/__init__.pyc from install of python-paramiko-2.1.1-2.el7.noarch conflicts with file from package python2-paramiko-1.16.1-2.el7.noarch01:52
fungipip will report whatever pkg-info files it finds in the libpath01:52
dmsimardfile from "centos-extras" package conflicts with "epel" package01:52
fungibut yeah, looks like that is two rpms conflicting with one another01:53
fungipython-paramiko and python2-paramiko01:53
dmsimardthis is why RDO stays away from EPEL as much as we can :D01:53
dmsimardfungi: both the EPEL and the base CentOS 'provides' python and python2-paramiko01:53
clarkbfungi: https://review.openstack.org/#/c/504737/ got a completely new +1 after the zuul config update01:54
fungiso presumably epel is not centos/rhel 7.4 ready yet01:54
clarkbI've got 3 more chnages I am going to check but I think the restart of zuul fixed the case sensitivity chnage01:55
fungiclarkb: agreed, looks that way01:56
clarkbhttps://review.openstack.org/#/c/495239/ got a new -101:57
clarkbso that is both positive and negative votes01:57
clarkbfungi: I think the last thing to check is if https://review.openstack.org/502834 merges when it gets  +2 verified01:58
*** thorst has joined #openstack-infra01:58
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473601:59
*** dave-mccowan has joined #openstack-infra02:00
*** thorst has quit IRC02:03
*** spzala has joined #openstack-infra02:06
*** spzala has quit IRC02:06
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473602:07
dmsimardclarkb: omg :/02:11
dmsimard2017-09-17 02:09:32.219400 | primary | /bin/sh: ip: command not found02:11
dmsimardon our CentOS images lol02:12
dmsimardI guess I should add that to infra package needs ?02:12
clarkbdmsimard: ya that is reasonable to add02:12
*** jascott1 has joined #openstack-infra02:14
dmsimardhmm, apparently it's already in the package-installs.yaml, weird02:14
clarkbpath issue maybe?02:14
clarkbif it is in /usr/sbin/ or /sbin?02:14
dmsimardthere's iproute2 and then a map that maps it (correctly) to iproute02:14
dmsimardsbin02:14
dmsimardI'll check the build image logs to see if it ends up being installed properly ..02:15
dmsimardyeah it's installed in the image.. wtf ?02:15
clarkbmy guess is /sbin isn't in the PATH then02:16
dmsimardo_O02:17
*** jascott1 has quit IRC02:18
dmsimardclarkb: I did find this bit of interesting info https://github.com/openstack/diskimage-builder/blob/master/diskimage_builder/lib/common-defaults#L4602:18
clarkb Ithink that may only apply to the image build itself02:20
dmsimardyup, looks like /sbin isn't there when using sudo so we'll have to hardcode that one, thanks integration tests02:20
clarkbbut does imply we may need it when running on the jobs themselvs02:20
dmsimardhttps://serverfault.com/questions/734560/ansible-become-user-not-picking-up-path-correctly02:20
clarkbfungi: https://review.openstack.org/#/c/502834/ merged so I think we are good02:23
fungiagreed, excellent02:25
fungithanks!02:25
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Append /sbin and /usr/sbin to $PATH for 'ip' commands  https://review.openstack.org/50474302:32
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Append /sbin and /usr/sbin to $PATH for 'ip' commands  https://review.openstack.org/50474302:33
*** bobh has joined #openstack-infra02:41
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473602:42
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Append /sbin and /usr/sbin to $PATH for 'ip' commands  https://review.openstack.org/50474302:50
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473602:50
*** bobh has quit IRC02:55
*** jamesdenton has quit IRC02:56
*** e0ne has joined #openstack-infra02:57
*** thorst has joined #openstack-infra02:59
*** mat128 has joined #openstack-infra02:59
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473603:05
*** thorst has quit IRC03:05
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473603:06
dmsimardalmost there ...03:07
dmsimardour known_hosts module is not idempotent :/03:10
dmsimardour usage of*03:10
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473603:11
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473603:17
*** baoli has quit IRC03:19
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473603:21
*** e0ne_ has joined #openstack-infra03:23
*** e0ne has quit IRC03:27
*** bobh has joined #openstack-infra03:29
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473603:33
*** bobh has quit IRC03:34
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473603:43
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473603:48
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473603:51
*** raginbajin has quit IRC03:56
*** dave-mccowan has quit IRC03:57
*** thorst has joined #openstack-infra03:57
*** thorst has quit IRC03:58
*** e0ne_ has quit IRC04:05
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473604:16
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473604:21
*** jdandrea has quit IRC04:36
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473604:36
*** cody-somerville has quit IRC04:39
*** cody-somerville has joined #openstack-infra04:40
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473604:43
*** psachin has joined #openstack-infra04:48
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473604:50
*** gouthamr has quit IRC04:52
*** thorst has joined #openstack-infra04:59
*** e0ne has joined #openstack-infra05:03
*** thorst has quit IRC05:04
*** e0ne has quit IRC05:07
*** gouthamr has joined #openstack-infra05:23
*** psachin has quit IRC05:24
SamYaplewhile im sure this has been discussed, i havent been able to find an answer to this question directly. I want to do an automated build on dockerhub pointed at https://github.com/openstack/loci but would require git permissions to install a hook to allow dockerhub build to trigger05:25
SamYapleis this hook something infra would allow?05:26
AJaegerinfra-root, something still broken - https://review.openstack.org/#/c/503626/ has been approed 90mins ago and has no "Starting" message05:38
AJaegerinfra-root, similar https://review.openstack.org/#/c/495782/ and https://review.openstack.org/#/c/492532/05:38
*** cody-somerville has quit IRC05:39
*** psachin has joined #openstack-infra05:39
AJaegerand https://review.openstack.org/#/c/502605/05:39
AJaegerSo, looks like change queue is fine with recording changes but we do not gate anything at all ;/05:40
AJaeger#status alert Zuul is currently not moving any changes into the gate queue. Wait with approving changes until this is fixed.05:46
openstackstatusAJaeger: sending alert05:46
-openstackstatus- NOTICE: Zuul is currently not moving any changes into the gate queue. Wait with approving changes until this is fixed.05:49
*** ChanServ changes topic to "Zuul is currently not moving any changes into the gate queue. Wait with approving changes until this is fixed."05:49
openstackstatusAJaeger: finished sending alert05:52
*** yamahata has joined #openstack-infra05:57
*** thorst has joined #openstack-infra06:00
*** thorst has quit IRC06:05
AJaegermordred: looked some more into pypy - our cryptography version does not work with the pypy we use, see http://logs.openstack.org/09/504709/1/check/gate-os-client-config-pypy/816e854/console.html#_2017-09-17_01_12_12_313997 . this breaks all python-*client modules and some more repos06:05
AJaegeros.middleware uses features of python that pypy not supports ;( http://logs.openstack.org/52/503652/1/check/gate-oslo.middleware-pypy/4095680/console.html#_2017-09-13_13_52_01_03777706:05
*** yamahata has quit IRC06:07
*** e0ne has joined #openstack-infra06:08
*** mat128 has quit IRC06:08
*** bobh has joined #openstack-infra06:14
*** e0ne has quit IRC06:15
*** bobh has quit IRC06:18
*** gouthamr has quit IRC06:18
prometheanfirepike is 2.0.2 for cryptography, but I'm guessing that's probably too new as well, is there a reason we use old pypy?06:23
AJaegerprometheanfire: is there a way to update pypy?06:24
prometheanfirewell....06:24
prometheanfireon gentoo emerge =dev-python/pypy-5.8.006:25
prometheanfireor pypy-bin or pypy3(-bin)06:25
prometheanfirenot sure on other OS's06:25
prometheanfireI'm guessing it's just the only version they ship in their repos06:26
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Remove some pypy jobs that don't work  https://review.openstack.org/50474806:26
* AJaeger will send an email for further discussion...06:26
prometheanfireya, probably will need changes to the image-build for new pypy (enable external repo and install)06:28
prometheanfireya, not live, unless binary install.  iirc pypy takes forever and a ton of mem to compile06:31
AJaegerprometheanfire: I'll send my email later today to openstack-dev, now offline again. Change is marked as WIP - if anybody fixes it, I'm happy to abandon.06:33
prometheanfirenn06:35
*** thorst has joined #openstack-infra07:01
*** e0ne has joined #openstack-infra07:04
*** thorst has quit IRC07:06
*** xinliang has quit IRC07:07
*** bobh has joined #openstack-infra07:15
*** bobh has quit IRC07:19
*** xinliang has joined #openstack-infra07:20
*** afazekas has quit IRC07:31
*** afazekas has joined #openstack-infra07:32
*** jascott1 has joined #openstack-infra07:34
*** jascott1 has quit IRC07:39
*** ramishra has quit IRC07:44
*** e0ne has quit IRC07:54
*** claudiub has joined #openstack-infra07:57
*** ramishra has joined #openstack-infra08:01
*** thorst has joined #openstack-infra08:02
*** thorst has quit IRC08:06
*** Shrews has quit IRC08:10
*** Shrews has joined #openstack-infra08:23
*** Shrews has quit IRC08:44
*** thorst has joined #openstack-infra09:02
*** thorst has quit IRC09:07
*** Shrews has joined #openstack-infra09:11
*** bobh has joined #openstack-infra09:17
*** ramishra has quit IRC09:20
*** bobh has quit IRC09:21
AJaegerprometheanfire: http://lists.openstack.org/pipermail/openstack-dev/2017-September/122212.html09:21
*** dhajare has joined #openstack-infra09:22
*** leifmadsen_ has quit IRC09:39
*** bswartz has quit IRC09:41
*** Jeffrey4l has quit IRC09:41
*** Diabelko has quit IRC09:41
*** flaper87 has quit IRC09:41
*** gibi has quit IRC09:42
*** gibi has joined #openstack-infra09:43
*** leifmadsen has joined #openstack-infra09:44
*** Jeffrey4l has joined #openstack-infra09:46
*** HeOS has joined #openstack-infra09:48
*** flaper87 has joined #openstack-infra09:53
*** Diabelko has joined #openstack-infra09:54
*** cshastri has quit IRC10:01
*** thorst has joined #openstack-infra10:03
*** thorst has quit IRC10:08
*** ramishra has joined #openstack-infra10:17
*** bobh has joined #openstack-infra10:17
*** dhajare has quit IRC10:17
*** bobh has quit IRC10:22
*** ramishra has quit IRC10:23
*** thorst has joined #openstack-infra11:04
lifelessotherwiseguy: we could look at making the dependencies conditional sure, but I wouldn't want to duplicate code11:06
*** thorst has quit IRC11:08
*** bobh has joined #openstack-infra11:18
*** rossella_s has quit IRC11:19
*** bobh has quit IRC11:23
*** rossella_s has joined #openstack-infra11:25
*** psachin has quit IRC11:34
*** HeOS has quit IRC11:44
*** rossella_s has quit IRC11:45
*** rossella_s has joined #openstack-infra11:47
*** thorst has joined #openstack-infra11:51
*** thorst has quit IRC11:53
*** thorst has joined #openstack-infra12:03
*** mwarad has quit IRC12:07
*** thorst has quit IRC12:11
*** thorst has joined #openstack-infra12:14
*** thorst has quit IRC12:14
openstackgerritAndreas Florath proposed openstack/diskimage-builder master: Unify apt-sources handling  https://review.openstack.org/45445612:16
fungiAJaeger: clarkb: so i guess what we failed to confirm after the restart and reconfiguration was that changes successfully transition from check to gate after passing. here's the query for 503626 at 04:11 utc when i believe it should have been enqueued: http://paste.openstack.org/show/62128312:22
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473612:26
*** eumel8 has joined #openstack-infra12:27
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Append /sbin and /usr/sbin to $PATH for 'ip' commands  https://review.openstack.org/50474312:31
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Multi-node: Streamline multi-node-known-hosts  https://review.openstack.org/50462912:31
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Multi-node: Set up connectivity with default OVS bridge  https://review.openstack.org/50455412:31
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Multi-node: Set up firewalls  https://review.openstack.org/50455312:31
*** ociuhandu has quit IRC12:33
*** ccamacho has quit IRC12:34
*** claudiub has quit IRC12:35
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Append /sbin and /usr/sbin to $PATH for 'ip' commands  https://review.openstack.org/50474312:40
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Multi-node: Streamline multi-node-known-hosts  https://review.openstack.org/50462912:40
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Multi-node: Set up connectivity with default OVS bridge  https://review.openstack.org/50455412:40
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Multi-node: Set up firewalls  https://review.openstack.org/50455312:40
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473612:42
AJaegerfungi, should we revert the project-config change again?12:42
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Revert "Revert "Revert "Use case sensitive gerrit labels"""  https://review.openstack.org/50476912:44
AJaegerfungi, clarkb ^ Note this needs manual merge. If you have better changes, go ahead - just preparing one option12:44
fungiAJaeger: that's what i was trying to figure out. it's not immediately obvious to me whether this is a behavior change between the versions of zuul before and after the restart, or a result of it still not being entirely compatible with the capitalization in the config12:44
AJaegerfungi: I don't know enough to help here with debugging ;(12:45
fungii don't see any indication it's using invalid ssh api commands to gerrit this time, nor can i tell in the logs that it's decided for sure that change wasn't fit to enqueue (the only missing submit check was on verify, which i believe it's supposed to ignore?)12:46
fungiomitted from that paste are its subsequent queries to find git parents (which it saw as already merged) and needed-by (which was just the change itself)12:47
fungiand then it remarks in the log that its done processing the comment-added event but never goes on to enqueue anything12:47
AJaegerline 201 of the paste contains "NOT_READY" - that's the only thing I noticed12:49
fungiyeah, comparing to others from before the restart (and my own recollection) that seems to be typical of the way in which we're using the gerrit api query12:51
*** Sree has joined #openstack-infra12:51
fungii_think_ that's because there's not already a verify +2 (which zuul is supposed to ignore since it will be the one to add that)12:52
AJaegerfungi: I can't really help ;/12:54
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config master: Add validate-host to base-minimal  https://review.openstack.org/50477113:00
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473613:05
dmsimard(╯°□°)╯︵ ┻━┻13:06
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473613:10
dmsimardI'm definitely going to have to set up a local zuul instance at home to test things...13:11
*** HeOS has joined #openstack-infra13:13
*** thorst has joined #openstack-infra13:15
clarkbAJaeger: fungi does it successfully enqueue if you workflow +1 something that already has the verified vote?13:17
*** bobh has joined #openstack-infra13:20
*** thorst has quit IRC13:20
fungiclarkb: yep13:20
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473613:20
fungiclarkb: er, i mean no13:21
fungithe example at hand (503626) is exactly that13:21
AJaegerclarkb: I can +A a translation update if want to see what happens...13:22
fungipassed check, got verify +1 from zuul, core reviewer provides code-review +2 and workflow +113:22
fungiwell, s/zuul/jenkins/ account-wise13:22
*** bobh has quit IRC13:24
dmsimardDo the usernames have a different format in the new gerrit maybe ?13:25
clarkbok the trigger is Workflow: 1 vote added so that implies something specifically in the trigger section isnt working13:25
*** tosky has joined #openstack-infra13:27
*** eumel8 has quit IRC13:27
clarkbis it possibly that zuul has hardcoded the check for need against verifird as lower case verified?13:27
*** ociuhandu has joined #openstack-infra13:27
clarkbsince I think zuul knows it provodes the verified vote so ignores needing it13:28
clarkbI'm tempted to install the unmerged zuul fix and test that it works today before reverting13:31
clarkbbecause if it doesnt work it may not work against 2.13 either13:31
clarkbhttps://github.com/openstack-infra/zuul/blob/773651ad7bf0fc6adba2357173ffb657d874478a/zuul/source/gerrit.py#L128 could be failing that check13:36
clarkbfungi ^ ya I think that is it as it is built from the list of label updates in the success and failure section of the pipeline config13:38
clarkband tobiash fix addresses that specific line13:39
*** thorst has joined #openstack-infra13:40
clarkbso I think our two options are revert again or install tobias' zuul 2.5 change. I am partial to updating zuul just as a sanity check pre gerrit upgrade13:41
AJaegerclarkb: yeah, that line looked suspicious when I read code, so worth trying tobiash's change https://review.openstack.org/#/c/48285613:41
*** thorst has quit IRC13:42
AJaegerclarkb: if you need a testcase, feel free to +A https://review.openstack.org/#/c/50475213:42
* AJaeger will be back later13:42
clarkbok13:42
clarkbfungi ^ what do you think? I can get it installed and zuul restarted in ~10 minutes or so13:43
AJaeger(that's translation update, so single core approval)13:43
clarkbthere isn't much in the zuul queues so I am going to go ahead and install tobias' change and restart the service again13:51
fungiclarkb: yes, let's go for it13:56
clarkbzuul is starting back up now13:56
clarkbthis took a few minutes last time13:56
fungisorry, have inlaws inbound in about 2 hours so am mostly busy cleaning13:56
clarkbno problem13:56
clarkbit is the weekend after all13:56
fungiwell, also shouldn't have told relatives it was okay to come into town to visit the morning after i get home13:57
clarkbI rebased tobias' change on master on zuul.o.o and installed that then restarted zuul service13:57
fungithanks!13:57
clarkbchanges are reenqueued, going to approve the change AJaeger listed above13:58
clarkboh I don't have approval rights /me finds something else to Workflow +113:58
clarkbI approved https://review.openstack.org/#/c/504505/3 but don't see it in the gate14:00
clarkboh it has a depends on? /me looks closer14:02
clarkbya it does /me looks for another change14:02
*** mwarad has joined #openstack-infra14:02
clarkbhttps://review.openstack.org/503848 successfully enqueued into the gate after a Workflow +114:05
dmsimardI don't understand what's going on with the multi node known_hosts stuff...14:05
*** alex_xu has quit IRC14:05
clarkbI think that was it, the comparison against NEEDS wasn't treating labels that zuul updates as unneeded because zuul would supply the new value as result of gating14:06
clarkbAJaeger: fungi ^ I think that means we can avoid a revert for now?14:06
clarkbhopeflly with that all out of the way I can spend some time with the kids and not debug zuul today :)14:08
dmsimardlol14:08
dmsimardclarkb: did we want a spec for the replacement of puppetboard btw ?14:09
*** mwarad has quit IRC14:09
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473614:10
clarkbdmsimard: it is probably worth a small one so that we have an idea of the plan (espceially since things may change with ara 1.0.0)14:10
clarkbbut I don't think we need to dig into alternatives too much. Bsaically either fiure out how to make ansible-puppet talk to puppetdb or just use ara14:11
openstackgerritMerged openstack-infra/project-config master: Add 10 minutes to linuxbridge job  https://review.openstack.org/50384814:13
dmsimardk14:15
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: WIP: Add multi-node role integration  https://review.openstack.org/50473614:19
*** bobh has joined #openstack-infra14:20
*** eranrom_ has quit IRC14:22
dmsimardI finally got the known_hosts integration tests passing but I don't know what was happening before ..14:24
dmsimard¯\_(ツ)_/¯14:24
*** Sree has quit IRC14:27
dmsimardif any project-config cores are around, https://review.openstack.org/#/c/504771/ would help me understand what is going on14:27
*** makowals has joined #openstack-infra14:29
*** makowals has quit IRC14:29
*** eranrom has joined #openstack-infra14:30
clarkbdmsimard: you have my +2 I'm going to do morning things now though. Maybe mordred is around for second +2?14:31
dmsimardyeah, there's something very weird going on with known_hosts.. either a bug in the known_hosts module or a bug in our implementation that generates all the possible host combinations14:32
*** eranrom has quit IRC14:41
*** ykarel has joined #openstack-infra14:41
*** thorst has joined #openstack-infra14:42
*** thorst has quit IRC14:47
*** olaph has quit IRC14:53
*** ykarel has quit IRC14:56
*** alex_xu has joined #openstack-infra14:56
*** olaph has joined #openstack-infra14:58
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: Split zuul.yaml into different zuul.d files  https://review.openstack.org/50478215:01
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove openstack-doc-build-to-move  https://review.openstack.org/50478515:05
*** armax has joined #openstack-infra15:14
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Fix typos with openstack-doc-build job  https://review.openstack.org/50478615:15
AJaegerdmsimard: +2A15:16
dmsimardAJaeger: thanks !15:16
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: Add multinode integration jobs and integration tests for known_hosts  https://review.openstack.org/50478715:16
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: Add integration tests for multi-node-firewall  https://review.openstack.org/50478815:16
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: Add integration tests for multi-node-bridge  https://review.openstack.org/50478915:16
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Fix typos with openstack-doc-build job  https://review.openstack.org/50478615:17
*** sdake_ is now known as sdake15:20
AJaeger#status ok Zuul has been fixed, you can approve changes again.15:24
openstackstatusAJaeger: sending ok15:24
AJaegerclarkb, fungi, all looks fine again - thanks15:24
*** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/"15:27
-openstackstatus- NOTICE: Zuul has been fixed, you can approve changes again.15:27
openstackgerritMerged openstack-infra/project-config master: Add validate-host to base-minimal  https://review.openstack.org/50477115:27
openstackstatusAJaeger: finished sending ok15:30
openstackgerritzhangyangyang proposed openstack-infra/gerritbot master: Remove py26 support  https://review.openstack.org/50479215:31
openstackgerritzhangyangyang proposed openstack-infra/grafyaml master: Remove py26 support  https://review.openstack.org/50479315:33
*** jdandrea has joined #openstack-infra15:35
openstackgerritzhangyangyang proposed openstack-infra/jeepyb master: Remove py26 support  https://review.openstack.org/50479415:37
openstackgerritMerged openstack-infra/project-config master: Fix typos with openstack-doc-build job  https://review.openstack.org/50478615:38
*** jdandrea has quit IRC15:39
*** jdandrea has joined #openstack-infra15:40
*** gouthamr has joined #openstack-infra15:42
*** thorst has joined #openstack-infra15:43
pabelangermordred: yay it worked: http://docs-draft.openstack.org/85/504785/1/check/openstack-doc-build/97151a2/15:47
*** thorst has quit IRC15:48
*** armax has quit IRC15:48
*** jkilpatr has joined #openstack-infra15:54
*** sbezverk has quit IRC16:02
pabelangermordred: however, I'm at a loss how to change the domain name in success-url. I don't think we currently support multiple domains in zuul_return16:04
pabelangermordred: also, was looking at the zuul-migrate script on the flight home. Things like http://logs.openstack.org/76/504276/5/check/zuul-migrate/75955f2/playbooks/legacy/ansible-func-centos-7/ansible-func-centos-7-02.sh should we be updating the script to actually call ansible roles?16:16
*** kambiz has quit IRC16:17
pabelangermordred: I'm guessing the effort is likely better spend re-writing the legacy jobs then making the migrate script smarter16:17
*** kambiz has joined #openstack-infra16:18
*** kambiz has quit IRC16:20
mordredpabelanger: yes - that's right - intent is to get it good enough and then just rewrite jobs after the fact16:25
*** Sree has joined #openstack-infra16:27
pabelangermordred: wfm16:30
*** Sree has quit IRC16:31
mordredpabelanger: oh - bother - so I put up a patch follow up to your patch yesterday that I guess you didn't see16:32
pabelangermordred: 504622? If so, I left a comment16:33
mordredpabelanger: that one - and https://review.openstack.org/#/c/504623/16:34
mordredpabelanger: but I guess it doesn't matter, as long as we fix up 504622 and extract a base job from it - I'll fix that one real quick16:34
mordred(the base job is needed by the migration script, so that's the important bit)16:35
mordredI'll abandon the revert16:35
pabelangermordred: Ya, so I was originally going to write it like that, but after discussions about other jobs parenting to base publishing jobs I opted to start with all in project-config approach.16:35
pabelangerby happy to do 504623 approach16:36
mordredyah - I think in this particular case it's safe - since the base job doesn't take an argument and just publishes to zuul.project.short_name16:36
pabelangerack16:36
mordredpabelanger: I think we can totally leave openstack-doc-build in p-c though - the dance has been done already ;)16:37
pabelangermordred: sure, will defer to you :)16:37
mordredpabelanger: actually - if you hav ea sec, could you look at the stack that ends in https://review.openstack.org/#/c/504610 ?16:39
* mordred is losing his mind trying to keep track of them all16:39
*** thorst has joined #openstack-infra16:44
mordredpabelanger: oh - on 504785 - that was to verify the new job, then you were going to respin it or do a followup to get the other instances? I'd like to go ahead and +2 that ... :)16:46
pabelangermordred: 504785 was just to confirm job works as we all expected. Then refactor into something else if needed. So, if we want to do 504623, we can likely do that and just copy bits from project-config first16:47
pabelangermordred: I'll have to look at 504610 in a bit, #dadops ATM16:48
mordredpabelanger: #dadops !16:48
*** thorst has quit IRC16:49
AJaegerpabelanger, mordred, should we link to zuulv3 from our status page? Could you review https://review.openstack.org/502341 , please?16:49
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Don't set nonvoting based on name suffix  https://review.openstack.org/50376916:50
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Make a publish-docs-draft base job  https://review.openstack.org/50462216:53
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add mapping entries for proposal jobs  https://review.openstack.org/50460816:53
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add specs publication jobs  https://review.openstack.org/50450616:53
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add publish-service-types-authority job and mapping  https://review.openstack.org/50460916:53
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add xstatic-check-version and openstack-tox-pypy  https://review.openstack.org/50461016:53
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add tag-releases to the mapping  https://review.openstack.org/50450516:53
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Rework openstack doc publishing to not be overridable  https://review.openstack.org/50423316:53
*** claudiub has joined #openstack-infra16:53
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Emit job definitions  https://review.openstack.org/50387416:55
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Split output into jobs+project_templates and projects  https://review.openstack.org/50412316:55
mordredAJaeger: I don't think we should - although I'll go ahead and review that- when we roll out v3 the current status page will just become the v3 status page16:55
AJaegermordred: I expect it - I was wondering whether it's helpfull for transition? If you don't think, just give a -1 for that reason...16:56
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Actually emit job content  https://review.openstack.org/50427616:59
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Order post playbook content properly  https://review.openstack.org/50450216:59
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Don't try to write jobs that came from mappings  https://review.openstack.org/50460616:59
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Cleanup migration script pep8 errors  https://review.openstack.org/50461717:01
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Make a publish-docs-draft base job  https://review.openstack.org/50462217:08
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add mapping entries for proposal jobs  https://review.openstack.org/50460817:08
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add specs publication jobs  https://review.openstack.org/50450617:08
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add publish-service-types-authority job and mapping  https://review.openstack.org/50460917:08
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add xstatic-check-version and openstack-tox-pypy  https://review.openstack.org/50461017:08
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add tag-releases to the mapping  https://review.openstack.org/50450517:08
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Rework openstack doc publishing to not be overridable  https://review.openstack.org/50423317:08
mordredAJaeger: yah - the transition should be fairly sudden for most folks17:08
AJaegerdmsimard, mordred, both of you have a change up called "Split zuul.yaml into different zuul.d files" - see https://review.openstack.org/504611 and https://review.openstack.org/#/c/504782 - which one to take?17:09
AJaegermordred: ok, then I'll abandon...17:09
AJaegerpabelanger, mordred: since we currently have no ongoing meetings, what about merging https://review.openstack.org/#/c/503757/ to remove one logged irc channel?17:12
mordredAJaeger: done17:13
AJaegerthanks17:13
mordredAJaeger: also, funny that dmsimard and I have the same patch up :) his has patches built on top - so I'll abandon mine and redo my other two patches on top of his17:13
AJaegermordred: with same titel - just different message ;)17:14
*** bobh has quit IRC17:14
AJaegermordred: avoids a rebase of your change ;)17:14
AJaegermordred: we have quite a few unreviewed zuul v3 changes - and some with merge conflict. Would it make sense to push (and update if needed9  those through the next days?17:16
dmsimardDidn't even see mordred's patch lol17:16
dmsimardSomething something great minds think alike? ;)17:16
AJaeger;)17:17
AJaegerdmsimard: now you need to fix it ;)17:17
AJaegerah, was a timeout...17:17
dmsimardit's timeout'd twice now, not sure what that is about17:18
*** e0ne has joined #openstack-infra17:18
openstackgerritMonty Taylor proposed openstack-infra/openstack-zuul-jobs master: Add xstatic-check-version and xstatic-publish-to-pypi  https://review.openstack.org/50386617:18
openstackgerritMonty Taylor proposed openstack-infra/openstack-zuul-jobs master: Add pypy project-templates  https://review.openstack.org/50411617:18
openstackgerritMerged openstack-infra/system-config master: Remove #openstack-neutron-ovn.  https://review.openstack.org/50375717:19
dmsimardmordred: do you know why the doc job has timeout'd twice in https://review.openstack.org/#/c/504782/ ?17:19
dmsimardweird, I submitted https://review.openstack.org/#/c/504789/ and https://review.openstack.org/#/c/504788/ and neither were enqueued for check17:21
dmsimardbut their parent patch did: https://review.openstack.org/#/c/504787/17:21
dmsimardanyway, need to run some errands, bbl17:21
mordreddmsimard: yup. it's zuul-sphinx17:21
mordreddmsimard: it does not support zuul.d17:22
mordreddmsimard: so I think we're going to need to not do the split until that's fixed17:22
openstackgerritMonty Taylor proposed openstack-infra/openstack-zuul-jobs master: Add xstatic-check-version and xstatic-publish-to-pypi  https://review.openstack.org/50386617:24
openstackgerritMonty Taylor proposed openstack-infra/openstack-zuul-jobs master: Add pypy project-templates  https://review.openstack.org/50411617:24
*** supertakumi86 has joined #openstack-infra17:24
dmsimardHuh, okay.17:29
*** mattmceuen has joined #openstack-infra17:42
openstackgerritMonty Taylor proposed openstack-infra/zuul-sphinx master: Support zuul.d directories  https://review.openstack.org/50479717:44
mordreddmsimard: I think that should do it17:44
*** thorst has joined #openstack-infra17:45
*** dave-mccowan has joined #openstack-infra17:45
*** dave-mcc_ has joined #openstack-infra17:47
*** thorst has quit IRC17:50
*** dave-mccowan has quit IRC17:50
*** claudiub has quit IRC17:56
*** openstackstatus has quit IRC17:57
*** openstack has joined #openstack-infra17:58
openstackgerritMerged openstack/os-client-config master: Updated from global requirements  https://review.openstack.org/50470918:00
*** baoli has joined #openstack-infra18:21
*** timburke has quit IRC18:22
*** timburke has joined #openstack-infra18:23
*** thorst has joined #openstack-infra18:26
*** bobh has joined #openstack-infra18:27
*** Douhet has quit IRC18:28
*** bobh has quit IRC18:29
*** thorst has quit IRC18:30
pabelangermordred: -1 on 504622, I think you do some of the refactor in the following patch, but I believe tox_upper_constraints was missed18:30
*** ociuhandu has quit IRC18:32
*** bobh has joined #openstack-infra18:33
*** ociuhandu has joined #openstack-infra18:34
*** supertakumi86 has quit IRC18:34
pabelangermordred: stack at 504610 looks good in general. Will be good once we start running a few of them in check next week to see if things actually work.18:37
*** baoli has quit IRC18:40
*** baoli has joined #openstack-infra18:41
*** bobh has quit IRC18:41
*** bobh has joined #openstack-infra18:43
*** bobh has quit IRC18:49
*** e0ne has quit IRC18:50
*** tinwood has quit IRC18:51
*** tinwood has joined #openstack-infra18:52
*** jdandrea has quit IRC18:57
*** eumel8 has joined #openstack-infra19:01
*** jkilpatr has quit IRC19:04
*** sbezverk has joined #openstack-infra19:09
*** thorst has joined #openstack-infra19:30
*** thorst has quit IRC19:36
*** eumel8 has quit IRC19:42
*** bobh has joined #openstack-infra19:50
*** bobh has quit IRC19:55
*** Douhet has joined #openstack-infra20:14
*** eranrom has joined #openstack-infra20:14
*** HeOS has quit IRC20:22
*** thorst has joined #openstack-infra20:23
*** jascott1 has joined #openstack-infra21:02
*** mattmceuen has quit IRC21:04
*** jascott1 has quit IRC21:14
*** dave-mcc_ has quit IRC21:24
*** panda has joined #openstack-infra21:31
*** mattmceuen has joined #openstack-infra21:42
*** thorst has quit IRC21:45
*** bobh has joined #openstack-infra21:52
*** bobh has quit IRC21:56
*** jkilpatr has joined #openstack-infra22:11
*** mattmceuen has quit IRC22:27
*** cody-somerville has joined #openstack-infra22:36
*** mattmceuen has joined #openstack-infra22:38
*** aeng has joined #openstack-infra22:40
*** panda has quit IRC22:41
*** panda has joined #openstack-infra22:42
*** felipemonteiro_ has joined #openstack-infra22:54
*** felipemonteiro__ has joined #openstack-infra22:56
*** felipemonteiro_ has quit IRC22:59
*** felipemonteiro__ has quit IRC22:59
*** threestrands has joined #openstack-infra23:02
*** bswartz has joined #openstack-infra23:05
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Make a publish-docs-draft base job  https://review.openstack.org/50462223:11
mordredpabelanger: ah - cool! how's that? ^23:11
*** gouthamr has quit IRC23:28
*** panda has quit IRC23:29
*** gouthamr has joined #openstack-infra23:29
*** panda has joined #openstack-infra23:30
*** thorst has joined #openstack-infra23:46
*** thorst has quit IRC23:51
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: Add integration tests for multi-node-firewall  https://review.openstack.org/50478823:51
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: Add integration tests for multi-node-bridge  https://review.openstack.org/50478923:51
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: Add multinode integration jobs and integration tests for known_hosts  https://review.openstack.org/50478723:51
*** tosky has quit IRC23:53
openstackgerritMatthew Treinish proposed openstack-infra/storyboard master: Bump minimum os-testr requirement to 1.0.0  https://review.openstack.org/50452523:54
*** lihi has quit IRC23:55
dmsimardinfra-root: I've witnessed two patches not get enqueued twice on zuul v3, looks like something's up with those two: https://review.openstack.org/#/c/504788/ https://review.openstack.org/#/c/504789/23:55
dmsimardOnly their parent change is currently in the check queue: https://review.openstack.org/#/c/504787/23:55
dmsimardPerhaps I'm missing something obvious but I thought I'd point it out in case I'm hitting a bug.23:56
*** lihi has joined #openstack-infra23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!