Tuesday, 2018-11-27

*** jesusaur has quit IRC00:02
*** threestrands has joined #zuul00:22
*** jesusaur has joined #zuul00:23
* SpamapS watching zuul deploy his almost-gone-live-RSN django app with glee00:33
* SpamapS has a pile of kubernetes and AWS roles to upstream00:33
ianwtox minversion = 3.1 ... hrm that's not in fedora29 yet00:51
ianwshould make it soon though ... https://bugzilla.redhat.com/show_bug.cgi?id=165265700:52
openstackbugzilla.redhat.com bug 1652657 in python-tox "upgrade python-tox" [Unspecified,On_qa] - Assigned to mhroncok00:52
ianwinteresting ... "tox -e docs" doesn't seem to work with it though00:52
ianwoh, haha helps if  you run it in the right repo00:53
openstackgerritIan Wienand proposed openstack-infra/zuul master: Add gearman stats reference  https://review.openstack.org/62019201:04
ianwcorvus: ^ re our prior discussion01:04
*** threestrands has quit IRC01:28
*** threestrands has joined #zuul01:32
*** bhavikdbavishi has joined #zuul02:55
tobiashianw: cool05:13
ianwtobiash: i've since realised the nodepool stats are a bit wonky ... change coming :)05:15
tobiash:)05:16
*** chandan_kumar has joined #zuul05:26
*** chandan_kumar is now known as chkumar|ruck05:28
openstackgerritMerged openstack-infra/zuul master: Add support for Gerrit v2.16's change URL schema  https://review.openstack.org/61953305:45
openstackgerritMerged openstack-infra/nodepool master: Update node during lockNode  https://review.openstack.org/61645005:47
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: Add allowed-labels tenant setting  https://review.openstack.org/61774006:00
*** bjackman has joined #zuul06:05
*** bhavikdbavishi has quit IRC06:16
*** bhavikdbavishi has joined #zuul06:35
openstackgerritTobias Henkel proposed openstack-infra/nodepool master: Fix test race in test_hold_expiration_higher_than_default  https://review.openstack.org/62022206:44
tobiashShrews, corvus: that should fix a test race of a test case that failed several times in the stack ^06:48
*** pwhalen has quit IRC06:51
*** pcaruana has joined #zuul07:24
*** threestrands has quit IRC07:44
openstackgerritMerged openstack-infra/nodepool master: Add extra safety belt when reusing a node  https://review.openstack.org/61646507:49
*** themroc has joined #zuul08:18
*** gtema has joined #zuul08:39
*** jpena|off is now known as jpena08:51
*** hashar has joined #zuul08:56
*** nilashishc has joined #zuul10:12
openstackgerritIan Wienand proposed openstack-infra/zuul master: Add gearman stats reference  https://review.openstack.org/62019210:19
openstackgerritIan Wienand proposed openstack-infra/zuul master: Remove STATE_PENDING  https://review.openstack.org/62028410:19
openstackgerritIan Wienand proposed openstack-infra/zuul master: [wip] Rework zuul nodepool stats reporting  https://review.openstack.org/62028510:19
*** bhavikdbavishi has quit IRC10:22
*** bjackman_ has joined #zuul10:31
*** bjackman has quit IRC10:34
openstackgerritSorin Sbarnea proposed openstack-infra/zuul master: Bump ansible from 2.5 to 2.6  https://review.openstack.org/62029110:56
*** electrofelix has joined #zuul11:17
*** bhavikdbavishi has joined #zuul11:19
*** dkehn has quit IRC11:29
*** chkumar|ruck is now known as chkumar|away11:32
*** rfolco is now known as rfolco_doctor11:45
*** bhavikdbavishi has quit IRC11:54
*** jpena is now known as jpena|lunch12:36
*** arxcruz is now known as arxcruz|brb13:00
openstackgerritBenoĆ®t Bayszczak proposed openstack-infra/zuul master: add fetch_vault_secrets Ansible module  https://review.openstack.org/62031113:05
*** themroc has quit IRC13:10
*** themroc has joined #zuul13:12
*** rlandy has joined #zuul13:28
*** jpena|lunch is now known as jpena13:38
*** jhesketh_ has joined #zuul13:44
*** dkehn has joined #zuul13:46
*** jhesketh has quit IRC13:50
*** bjackman_ has quit IRC14:20
*** bjackman_ has joined #zuul14:22
Shrewspabelanger: you ask a good question re: metadata. I left a comment that hopefully clarifies things. And we should probably clarify in the docs the difference in instance-properties and the new field.14:24
Shrewstobiash: why not just use cached=False there?14:27
tobiashShrews: oh yes, that will work too14:30
openstackgerritAntoine Musso proposed openstack-infra/zuul master: gerrit: use change: when querying changes  https://review.openstack.org/62032814:30
pabelangerShrews: ack, will look after this meeting14:35
*** mordred has joined #zuul14:36
Shrewstobiash: when you change that, could you take a quick scan for other tests that might be affected?14:40
Shrewsi have a feeling there's probably more than the one14:41
tobiashShrews: yes, but will do it tomorrow14:41
Shrews++14:41
tobiashI'm not really here today14:41
*** nilashishc has quit IRC14:41
Shrewslies!14:42
* mordred is also not really here today14:44
*** rfolco_doctor is now known as rfolco14:53
*** ianychoi_ is now known as ianychoi15:06
*** zigo has joined #zuul15:20
ttxtristanC: hey, was wondering about status for the Azure nodepool driver. Kata containers got an Azure account to test Kata/Azure compatibility, and they are OK with us using it to manually test the Azure nodepool driver as needed. Did you plan to further work on that, or should I just take over ?15:22
*** bhavikdbavishi has joined #zuul15:31
*** bjackman_ has quit IRC15:49
mordredttx: I believe tristanC would be fine with you taking over work on it16:19
*** gtema has quit IRC16:21
ttxnoted :)16:23
corvusttx, mordred: i'd love to have a nodepool functional test job for azure like we added for k8s.  we can add the azure creds as a secret to the nodepool repo for that.16:24
corvusi'm happy to help with that when we're ready16:24
ttxcorvus: yes that's the long-term goal... I thought I should first do the heavy lifting in making it work using manual tests16:25
clarkbcorvus: the k8s test uses a locak k8s though right?16:25
corvusttx: yeah, it's not going to be easy to iterate on the functional test job16:25
*** j^2 has joined #zuul16:25
corvusclarkb: yes, so this will be structurally different16:25
corvusclarkb: the internal test framework can be similar, but the test setup will involve new playbooks and zuul secrets to use the real external cloud.  also a new "restricted check" pipeline.16:26
corvus(runs check jobs after code-review +2, and can use secrets)16:26
ttxI still need to wrap my head around the concept of using nodepool to test nodepool inception16:31
ttxOne thing at a time. Like all my development work it will likely go slowly :)16:32
*** arxcruz|brb is now known as arxcruz16:54
*** themroc has quit IRC16:57
*** sshnaidm|afk is now known as sshnaidm17:08
*** j^2 has quit IRC17:29
clarkbpabelanger: corvus Shrews trying to catch up on the executor zone changes. Is the zuul side change ready now? any reason to not merge that yet? and for the nodepool side I left some thoughts re metadata being generic17:48
SpamapScorvus: I could probably donate a wee bit of EC2 quota for something similar for the EC2 driver.17:49
*** hashar has quit IRC17:49
pabelangerclarkb: yah, I'll need to also update the zuul side.17:51
pabelangerI should be able to do that later today17:51
clarkbpabelanger: oh right zuul side will need to look for that info in a different location?17:52
SpamapSbtw.. I'm working on putting this behind an oauth proxy, but for now, you can watch our zuul work.. https://zuul.gdmny.co/17:52
pabelangerclarkb: yup17:53
corvusSpamapS: re ec2: thanks!17:55
corvusSpamapS: also there's been a new zuul release with a much improved dashboard :)17:57
corvusSpamapS: which is my way of saying "neat, thanks for the link!"17:58
corvusclarkb: once i realized you were saying "key-prime" in your nodepool comment (and it was not a comment about yaml quoting) it made sense and i agree :)18:00
clarkbcorvus: oh sorry, I shouldn't realize that that was maybe ambiguous yaml18:00
corvuswell, it's not, but my brain is used to parsing yaml so that's where i went first18:01
corvusbrains are weird18:01
SpamapScorvus: yeah, I have to choose between rebasing my patches or waiting until they land to upgrade. ;)18:06
SpamapSoh .. hm. maybe my patches landed18:07
SpamapSZuul: Change has been successfully merged by Zuul (2018-11-26 15:09:23-0800)18:08
SpamapSw000t18:08
*** bhavikdbavishi has quit IRC18:08
*** jpena is now known as jpena|off18:09
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul-jobs master: Add a markdownlint job and role  https://review.openstack.org/60769118:20
*** rlandy is now known as rlandy|brb18:28
tobiashShrews: I think tomorrow I'll run tox in an endless loop and try to fix any test race there. I thought I found most of them but that doesn't seem to be the case :/18:37
Shrewstobiash: something does seem off  :/18:46
fungiSpamapS: neat! your zuul doesn't look terribly busy at the moment?18:47
*** j^2 has joined #zuul18:57
Shrewspabelanger: Given the current meeting results, if it would help you, I could manage the nodepool side of the new metadata node attribute if you'd like. Just let me know.18:58
pabelangerShrews: Sure, I don't mind if you want to work on that18:59
Shrewspabelanger: k. i'll handle it18:59
pabelangerthank you!18:59
Shrewsnp19:00
*** rlandy|brb is now known as rlandy19:09
*** electrofelix has quit IRC19:25
openstackgerritMerged openstack-infra/nodepool master: Update devstack test to Fedora 28  https://review.openstack.org/61437519:44
*** lennyb_ has joined #zuul20:17
*** lennyb has quit IRC20:20
*** pcaruana has quit IRC21:46
SpamapSfungi: yeah I only have 5 nodes of capacity to work with at the moment and the EC2 driver does NODE_FAILURE if we try to allocate nodes too fast.. working on that. :-P21:48
fungisounds like a treat ;)22:04
clarkbcorvus: with currently deployed openstack zuul and the error reporting that we now have, are there still cases we need to worry about a project globally hosing the zuul config?22:18
clarkbcorvus: like maybe redefining the tempest job? and creating an ambiguous config?22:19
AJaeger_clarkb: we had one broken setup where a repo was branched - branched from an older git commit and then we had a list of broken jobs22:19
AJaeger_But not a global hosing zuul config.22:20
clarkbAJaeger_: ya I'm wondering how broad the potential reach of such a change or merge could be22:20
AJaeger_clarkb: but that's in general the only situation that I am aware.22:20
clarkbput in other words, is gating still required to protect zuul from its config22:20
dmsimardcommits are gated22:21
dmsimardbranches are not22:21
dmsimardif we manage branches through version control, perhaps it'd be possible but it may also be too much overhead, I don't know.22:22
clarkbdmsimard: only if you've configured your zuul to gate every commit22:22
clarkbopenstack currently has22:22
clarkbbut in general this isn't required with zuul and I'm trying to understand how badlythings can break if not done22:22
pabelangeryah, this is my fear in ansible-network with our zuul22:25
pabelangerhumans are able to create a branch at any point in time, since they are direct push access22:26
pabelangerso far, we haven't run into the issue yet, but I think if it happens in an untrusted project, I think we are somewhat protected in zuul22:26
dmsimardlet's all move back to svn22:26
dmsimardno more branches22:26
corvusclarkb: gating will protect zuul in the normal course of events; adding projects or branches (as mentioned) can break parts of the config, but damage is likely to be contained to those projects.22:28
corvusclarkb: a snafu with tempest would be bad.  but a random project won't be able to break tempest because we carefully ordered the tenant config to give devstack/tempest priority.22:28
clarkbcorvus: is zuul restartable in the general its a broken project case?22:28
clarkbI know it wasn't in the past but I think zuul may have grown guards against that22:29
corvusclarkb: zuul is actually *operable* in the case of a broken project22:29
corvusclarkb: and yes, (re-)startable too22:29
clarkbcool22:29
openstackgerritMerged openstack-infra/zuul master: Improve resource usage with semaphores  https://review.openstack.org/61900422:34
openstackgerritMerged openstack-infra/zuul master: Display ref instead of NA for time triggered items  https://review.openstack.org/61925222:34
openstackgerritMerged openstack-infra/zuul master: Fix manual dequeue of github items  https://review.openstack.org/61927222:35
openstackgerritMerged openstack-infra/zuul master: Retry queries for commits  https://review.openstack.org/57513722:35
pabelangerin other news, thanks to the help of logan- and his limestone OSA configuration, I'm now able to CD openstack-ansible via zuul: https://github.com/ansible-network/packet-ci-cloud22:39
mordredpabelanger: \o/22:56
mordredpabelanger: that's super cool22:56
pabelangermordred: yah, it's worked well so far23:00
clarkbpabelanger: are you basically redeploying the limestone cloud on different hardware?23:01
clarkbthat is really neat if so23:01
pabelangerclarkb: yup, this is a top of packet.net, but almost the same OSA config that limestone is running23:01
clarkbnice23:01
pabelangerI told john s, once this is up and running happy to help him also do the same for openstack nodepool. He wants to see what else, besides platform9 can be installed on packet.net23:03
pabelangerI also want to send an ML post to openstack-discuss and see if any other operators want to help manage the cloud23:03
pabelangeralso think that would be a cool talk too23:03
mordred++23:04
tristanCttx: the azure driver has not actually been tested, i wrote it purely based on doc and blog post. i do not plan further work on that, please go ahead and take over.23:26
*** rlandy has quit IRC23:27
pabelangermordred: oh, if you have time, do you mind looking at https://review.openstack.org/618634/ and depends-on, I don't think our wheels on pypi have yarn files in them. Or, I just don't fully understand how it works23:32
pabelangerthat patch at least gets our branch-tarball job and release job working the same way23:33
*** mattclay has left #zuul23:50
*** jhesketh_ is now known as jhesketh23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!