Monday, 2017-10-16

dmsimardmnaser: we discussed job variants last week. Turns out that's a thing.00:14
dmsimardmnaser: it's another way of writing things: https://gist.github.com/dmsimard/b5a85109cffde40c5e6699bdc4e5c2d100:14
dmsimardThose three are equivalent, the "variant" is original.yaml00:15
dmsimardEr, there's probably a typo in original.yaml00:16
openstackgerritPaul Belanger proposed openstack-infra/zuul feature/zuulv3: Enabled ssh retries for ansible  https://review.openstack.org/51213000:30
pabelangerclarkb: mordred: jeblair: maybe something to discuss in the morning^ to help improve SSH connection issues. Ansible how has the ability to retry attempt since 2.000:32
pabelangerI've added a note on zuulv3-issues to discuss later00:35
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Ignore parents on job variants  https://review.openstack.org/51213401:08
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Ignore parents on job variants  https://review.openstack.org/51213401:46
*** mrhillsman has quit IRC03:00
*** mrhillsman has joined #zuul03:01
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Start ssh persistent connections outside bwrap  https://review.openstack.org/51215804:09
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Start ssh persistent connections outside bwrap  https://review.openstack.org/51215804:12
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Disable sql_reporter alembic downgrades  https://review.openstack.org/51215904:16
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Clarify how the sql database is managed  https://review.openstack.org/51216004:16
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Move alembic_reporter back to alembic  https://review.openstack.org/51216104:16
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Allow the pool_recycle to be configured  https://review.openstack.org/51216204:16
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Clarify how the sql database is managed  https://review.openstack.org/51216004:32
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Move alembic_reporter back to alembic  https://review.openstack.org/51216104:32
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Allow the pool_recycle to be configured  https://review.openstack.org/51216204:32
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Allow the pool_recycle to be configured  https://review.openstack.org/51216204:55
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Make statsd import failure raise exception  https://review.openstack.org/51197806:11
*** mattclay has quit IRC06:24
*** kmalloc has quit IRC06:24
*** hogepodge has quit IRC06:24
*** TheJulia has quit IRC06:25
*** hogepodge has joined #zuul06:26
*** kmalloc has joined #zuul06:26
*** TheJulia has joined #zuul06:27
*** mattclay has joined #zuul06:27
*** openstackgerrit has quit IRC06:28
*** openstackgerrit has joined #zuul07:23
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: zuul-cloner-shim: don't link if owners different  https://review.openstack.org/51219407:23
*** toabctl has joined #zuul07:32
*** xinliang has joined #zuul07:37
*** xinliang has quit IRC07:37
*** xinliang has joined #zuul07:37
*** hashar has joined #zuul08:27
*** smyers has quit IRC09:04
*** sambetts|afk is now known as sambetts09:27
*** smyers has joined #zuul09:28
*** Shrews has quit IRC09:53
*** Shrews has joined #zuul10:01
*** openstackgerrit has quit IRC10:33
*** rbergeron has joined #zuul10:38
*** Shrews has quit IRC11:10
*** Shrews has joined #zuul11:12
*** jkilpatr_ has joined #zuul11:15
*** Shrews has quit IRC11:27
*** Shrews has joined #zuul11:29
*** dkranz has joined #zuul12:26
*** openstackgerrit has joined #zuul12:50
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Make git repos writable so that hard links work  https://review.openstack.org/51228512:50
*** Shrews has quit IRC12:56
*** Shrews has joined #zuul12:59
*** Shrews has quit IRC13:04
*** Shrews has joined #zuul13:06
Shrewsmnaser: Is vexxhost having any network issues right now? My irc bouncer hosted there keeps losing net connections today13:07
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Make git repos writable so that hard links work  https://review.openstack.org/51228513:12
*** Shrews has quit IRC13:19
mnaserShrews: yes, one of our core routers failed this morning.  everything should be okay now13:20
mnaser(but he's not there to see this :<)13:21
*** Shrews has joined #zuul13:21
mnaser(repasting)13:23
mnaserShrews: yes, one of our core routers failed this morning.  everything should be okay now13:23
mnaserif you're still seeing issues, let me know, but things should be in a stable state13:23
*** Shrews has quit IRC13:27
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Collapse job header lines into a single statement  https://review.openstack.org/51182113:51
openstackgerritMerged openstack-infra/zuul-jobs master: Make git repos writable so that hard links work  https://review.openstack.org/51228514:01
*** hashar is now known as hasharAway14:12
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Start ssh persistent connections outside bwrap  https://review.openstack.org/51215814:18
*** Shrews has joined #zuul15:01
*** Shrews has quit IRC15:12
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Work around non-standard envdir locations  https://review.openstack.org/51232515:14
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Ignore missing tox log directories  https://review.openstack.org/51232715:19
*** Shrews has joined #zuul15:29
*** Shrews has quit IRC15:29
*** Shrews has joined #zuul15:29
Shrewsmnaser: yeah, still having issues. falling back to xchat on my laptop for now15:30
mnaserShrews should be ironed out by eod when we have replacement hardware in15:30
mnasersorry :(15:31
Shrewsmnaser: ++. thx15:31
mrhillsmanchanges to the configuration/trusted project require restarting executor and scheduler?16:11
*** sambetts is now known as sambetts|afk16:37
openstackgerritJavier Peña proposed openstack-infra/zuul feature/zuulv3: Fix ref calculation for ZUUL_CHANGES legacy var  https://review.openstack.org/51235916:42
* Shrews has a gift for jeblair and pabelanger 16:44
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: New client command for printing autohold requests  https://review.openstack.org/51236016:44
jeblairShrews: it's just what i've always wanted!16:46
jeblairmrhillsman: no, changes to trusted projects should automatically be effective as soon as they merge (zuul watches for those merge events)16:52
jeblairmrhillsman: a change to main.yaml (the tenant config file) *does* need a restart or manual reconfiguration (currently triggered by sending zuul a SIGHUP)16:52
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Fix ref calculation for ZUUL_CHANGES legacy var  https://review.openstack.org/51235917:00
mrhillsmanthx jeblair17:11
openstackgerritMerged openstack-infra/zuul-jobs master: Work around non-standard envdir locations  https://review.openstack.org/51232518:10
openstackgerritMerged openstack-infra/zuul-jobs master: Ignore missing tox log directories  https://review.openstack.org/51232718:29
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Executor: stop jobs in parallel on shutdown  https://review.openstack.org/51238318:45
jlkjeblair: I'm reviewing your ssh outside bwrap change, and I'm not seeing where the first task to establish the socket is ran. A git grep of "ping" isn't revealing anything either. Can you direct me to where this is happening?18:47
jeblairjlk: runAnsibleSetup18:48
jeblairjlk: apparently we run 'setup' not ping, sorry18:48
jlkah18:48
jeblairjlk: also, i wrote that late at night sunday when tired, so definitely don't give me the benefit of the doubt on that one.  :)18:48
*** dkranz has quit IRC18:57
jlklets give it a spin!19:03
* jlk +ws19:03
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Start ssh persistent connections outside bwrap  https://review.openstack.org/51215819:21
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Use weakref for change cache  https://review.openstack.org/51135519:27
*** mordred has quit IRC19:31
*** dkranz has joined #zuul19:34
*** mordred has joined #zuul19:42
*** hasharAway has quit IRC20:33
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add flag to allow disabling sudo revocation  https://review.openstack.org/51240820:34
*** dkranz has quit IRC20:39
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Use dest for template: not path  https://review.openstack.org/51240920:42
openstackgerritDoug Hellmann proposed openstack-infra/zuul-jobs master: fix the template instruction for writing launchpadlib/creds  https://review.openstack.org/51241020:42
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Harden exception handling around instance deletes  https://review.openstack.org/51241320:44
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Harden exception handling around instance deletes  https://review.openstack.org/51241320:45
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Harden exception handling around instance deletes  https://review.openstack.org/51241320:48
Shrewspabelanger: jeblair: just giving the nodepool cleanup code a once over ^^^^ and discovered some potentially problematic areas that could leave nodes locked (and might explain what pabelanger saw earlier with the long locked ready nodes)20:49
Shrewsbut i'm sort of doubtful about that last part since those nodes disappeared after a zuul restart20:50
* Shrews just realizes that "unallocate" as a verb is not a thing20:54
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Harden exception handling around instance deletes  https://review.openstack.org/51241320:55
jlkdeallocate ?21:02
Shrewsjlk: yes, but it was unobvious to me at the time!  :)21:03
dmsimarddestroy ? annihilate ? reap ? murder ? :D21:03
jlkhah21:03
Shrews"Me fail English? That's unpossible!"  -- Ralph Wiggum21:04
jlkthey can be "unallocated" but you cannot unallocate them.21:04
jlkweird eh?21:04
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Executor: stop jobs in parallel on shutdown  https://review.openstack.org/51238321:04
dmsimardhey so long as it's not suicidal messages like dovecot https://github.com/dovecot/core/blob/cfc6ae77ffef274f79a24b1d944b2b59dc444905/src/lib-storage/mail-storage-service.c#L88321:05
pabelangerI won't be attending the meeting in #openstack-meeting-alt today. I'll be sure to read the IRC logs later this evening21:07
openstackgerritMerged openstack-infra/zuul-jobs master: fix the template instruction for writing launchpadlib/creds  https://review.openstack.org/51241021:09
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Harden exception handling around instance deletes  https://review.openstack.org/51241321:41
Shrewshrm, we seem to have tox-py27 jobs enabled on nodepool for some reason21:42
SpamapSon feature/zuulv3/21:56
*** Shrews has quit IRC22:06
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Set ansible stdin to /dev/null  https://review.openstack.org/51243422:08
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Executor: stop jobs in parallel on shutdown  https://review.openstack.org/51238322:17
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Set ansible stdin to /dev/null  https://review.openstack.org/51243422:17
clarkbcan we get second reviews on ^22:30
clarkbI can't really fix zuul executor filesystems until the /dev/null fix is in place22:30
jeblairSpamapS: ^ those are up your alley; i'm going to merge now so we can restart our executors with them, but i'd appreciate a retro-review22:41
*** Shrews has joined #zuul22:47
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Executor: stop jobs in parallel on shutdown  https://review.openstack.org/51238322:54
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Set ansible stdin to /dev/null  https://review.openstack.org/51243423:01
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Handle tox environments via tox config  https://review.openstack.org/51244823:45
openstackgerritJames E. Blair proposed openstack-infra/zuul-sphinx master: Add support for project-templates  https://review.openstack.org/51244923:46
jeblairmordred: ^23:47
jeblair23:41 < SamYaple> i just want to say, great job on zuulv3. even the seemingly obscure scenarios seem already well thoughtout23:47
jeblair23:41 < SamYaple> im more and more impressed the more i use it23:47
jeblairdidn't want that to be missed by folks here23:47
mordredjeblair: \o/ to both23:48

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!