Monday, 2018-04-23

*** dkranz has quit IRC01:11
*** swest has quit IRC01:44
*** swest has joined #zuul01:59
*** swest has quit IRC04:18
*** swest has joined #zuul05:09
*** swest1 has joined #zuul05:12
*** swest1 has quit IRC05:14
*** swest has quit IRC05:14
*** swest has joined #zuul05:15
*** hashar has joined #zuul06:02
*** AJaeger has quit IRC06:12
*** jpena|off is now known as jpena07:10
*** xinliang has joined #zuul07:14
*** xinliang has quit IRC07:14
*** xinliang has joined #zuul07:14
*** nguyenhai has joined #zuul07:54
*** threestrands has quit IRC08:17
*** ssbarnea_ has joined #zuul08:27
*** sshnaidm|off is now known as sshnaidm08:41
*** AJaeger has joined #zuul09:38
*** sshnaidm has quit IRC10:10
*** sshnaidm has joined #zuul11:03
*** trishnag has quit IRC11:06
*** trishnag has joined #zuul11:24
*** jpena is now known as jpena|lunch11:33
*** pwhalen has quit IRC11:42
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Deploy ssh key as root for non-root users  https://review.openstack.org/56358411:43
*** elyezer has joined #zuul12:06
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Deploy ssh key as root for non-root users  https://review.openstack.org/56358412:07
*** pwhalen has joined #zuul12:14
*** pwhalen has joined #zuul12:14
*** elyezer has quit IRC12:16
*** rlandy has joined #zuul12:19
*** jpena|lunch is now known as jpena12:27
*** elyezer has joined #zuul12:28
*** dkranz has joined #zuul12:35
*** dmsimard|off is now known as dmsimard12:51
*** pwhalen_ has joined #zuul14:32
*** pwhalen has quit IRC14:32
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Make config objects freezable  https://review.openstack.org/56281614:34
corvusclarkb, tobiash: that ^ should pass tests now and be ready for real review.14:35
*** pwhalen_ is now known as pwhalen14:35
*** pwhalen has quit IRC14:35
*** pwhalen has joined #zuul14:35
corvusthere's a chance that will expose a hole in our testing when we roll that out to a production system.  well, there's always a chance, but this one seems like a slightly higher than normal chance.  :)14:36
tobiashcorvus: ok, will look later at home, currently leaving office14:38
corvustobiash: no rush14:38
clarkbcorvus: https://groups.google.com/forum/#!topic/repo-discuss/O2KIkHEoU38 is an interesting gerrit ml thread14:59
clarkbtl'dr they need zuul14:59
*** sshnaidm is now known as sshnaidm|afk15:41
corvusmaybe we should reply to that after the zuul simulation video lands on the website...15:43
*** jpena is now known as jpena|brb15:43
*** sshnaidm|afk has quit IRC15:46
*** sshnaidm has joined #zuul15:48
*** sshnaidm has quit IRC15:49
corvusi just read through the configloader, and i think we've severed all the dirrect references between the different object types.  so they're all referenced by name now.15:56
corvusi think that means i can start in on caching the objects themselves instead of the yaml.15:57
Shrewscorvus: where are we on the stestr switch? wondering if it's worth fixing that up for mordred for nodepool to get it merged16:04
Shrewsi think there were issues with the zuul patch, yeah?16:04
Shrewsor maybe that merged already16:05
Shrewsah, merged then reverted16:06
corvusShrews: i think it merged, was reverted, and maybe hasn't been re-proposed?  i think all the issues have been worked out and should be straightforward...16:06
Shrewscorvus: i can't find what the actual issues were, but i'll start poking at the nodepool change16:07
corvusShrews: istr at least one of them was operator error :).  there were some other minor things which i don't remember except i think are probably easily resolvable enough if we just want to try it again.16:10
*** jpena|brb is now known as jpena16:22
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Remove layout from ParseContext  https://review.openstack.org/56369516:31
*** jpena is now known as jpena|off16:50
*** sshnaidm has joined #zuul17:00
*** sshnaidm is now known as sshnaidm|off17:02
openstackgerritClark Boylan proposed openstack-infra/zuul-jobs master: Better zuul debug info debugging info  https://review.openstack.org/56175817:17
tobiashandreaf: commented on https://review.openstack.org/56358417:19
SpamapS2018-04-21 00:04:11.568609 | godaddy-c7 | TASK [Gathering Facts] *********************************************************17:24
SpamapS2018-04-21 00:04:27.056581 | godaddy-c7 | ok: [zuul0]17:24
SpamapSderp17:25
SpamapSThat setup module is just getting too aggressive17:25
SpamapSwho has 16 seconds? :-P17:25
clarkbSpamapS: I think we really only need ti for a tiny fraction of the facts too17:26
SpamapSActually I pasted that just as I was mis-reading the seconds as minutes17:28
SpamapSI had a job timeout which surprised me and thought it was a 16 minute setup17:28
SpamapSIn fact though, the actual thing that took forever was more confusing than that17:29
SpamapShttp://paste.openstack.org/show/719759/17:29
SpamapSGuessing whatever VM I was on had a long hypervisor pause or something.17:29
SpamapSor ssh got routed through a 300 baud modem17:29
Shrewsas someone who owned a 300 baud modem, i resemble that remark17:31
Shrewsoh the bbs's17:31
SpamapS16800 zyxel ftw17:39
SpamapS"Screw standards, let's bet this whole BBS world on a brief flash in the pan"17:39
tobiashShrews, SpamapS thanks, now I feel young :)17:52
corvustobiash: this will help you feel old: https://www.telnetbbsguide.com/17:54
corvusmust....close....tab....17:58
Shrewsheh, i remember the 1st one I joined required a telephone call from the bbs owner to verify my identity. i must have been about 11 or 12 and this was well before "beware Internet strangers"17:58
pabelangercool, start playing LORD and VGA planets again17:58
corvusShrews: one of the first ones i called had a irl bbq every month or so17:59
Shrewscorvus: it was obviously before computers were used to AVOID other people  :)18:00
corvusShrews: heh.  either that, or we were just doing it wrong :)18:00
* SpamapS lost a couple days to trade wars a few months ago ;)18:01
tobiashcorvus: I still feel young ;)18:01
corvusSpamapS: i lost years to tw2002, what's a few more days?18:02
SpamapSso true18:02
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Switch to stestr  https://review.openstack.org/53686218:08
Shrewscorvus: so, hrm... now that I've rebased that, I can't seem to get ttrun to output like it used to18:12
Shrewsbut the tests will run18:12
Shrewsperhaps this was the operator error you found before18:13
Shrews?18:13
corvusShrews: the, erm, operator error i recall was that i was trying to run a test that didn't exist on the branch i was on (because i switched branches to test out stestr).  maybe you need to recreate the venv or something?18:15
corvusShrews: that was certainly the symptom i had though :)18:15
Shrewsi did that with 'tox -epy36 -r'18:16
corvusShrews: do we have a py36?18:16
Shrewsi do18:16
Shrewsthere's no target in tox.ini18:17
corvusi guess it should work18:17
clarkbpyxy targets are implicit in tox18:17
Shrewsif you have python3.5 installed, tox will give you a py3518:17
clarkband will just be based off the baseenv if not explicitly defined18:17
corvusjust scraping the bottom of the barrel on ideas here :)18:17
clarkbhttps://review.openstack.org/#/c/553618/16 is quite the daunting diff to review18:18
corvusclarkb: yeah, sorry about that.  i'm trying to do it in as small steps as possible; but i don't think i can split that up further (at least, not without major temporary scaffolding or something)18:19
clarkbya I'll just have to dig through it18:19
clarkbI've done the earlier changes in the stack but not approved them as I get the sort of sense this whole thing should go in together so the end result is consistent quickly18:20
clarkb(rather than being in halfway state for a time)18:20
Shrewsmordred: when you are around, I left a question for you on 53686218:20
corvustheoretically they could go in at any point, but there are a couple of places where it would make sense to merge a batch of changes18:21
corvusmerging up to 553618 or 562816 would be good i think.18:21
clarkbShrews: ttrun basically just runs python -m testtools.run $testnames iirc18:21
clarkbShrews: you probably want to strace it or find where it does that exec to amke sure it is execing the correct things18:22
clarkb(that should be completely independent of stestr and testr too,)18:22
*** harlowja has joined #zuul18:44
Shrewsianw: Did you ever create an equivalent logging change for Zuul to match https://review.openstack.org/547889 as corvus requested? I'm not seeing it.18:45
*** harlowja has quit IRC19:07
*** ssbarnea_ has quit IRC19:42
clarkbcorvus: I'm still not sure I've fully grokked https://review.openstack.org/#/c/553618/16 but I've +2'd it. I did leave a few comments, I think the second two are me just thinking out loud to myself to udnerstand that change but the first may be worth a look19:48
corvusclarkb: responded (with footnotes!)20:05
clarkbtobiash: commented on https://review.openstack.org/#/c/535713/8 there is at least one bug that needs to be fixed. I think my other comment is not a bug just harder to undersatnd (but it may be a bug if I've misunderstood it)20:09
clarkbcorvus: your comment implies that voluptuous schema entries are not required by default? For some reason I thought they were20:11
corvusclarkb: ProjectTemplateParser has a 'validate' argument which ProjectParser sets to False; so we skip schema validation in ProjectTemplateParser (because ProjectParser validates the schema for it)20:12
clarkbaha20:12
corvusclarkb: (and in the schema for ProjectParser, name is optional)20:12
corvusprojecttemplateparser is actually getting really small these days, we could probably refactor it so that projectparser doesn't delegate to it anymore20:13
corvus(i would like that as sometimes this is difficult to think about)20:13
corvusmaybe just pull out the shared bit into a helper function20:14
clarkbcorvus: line 101 https://review.openstack.org/#/c/562816/9/zuul/model.py the use of super there is so that Freezable can be used as a mixin?20:24
corvusclarkb: yep20:26
corvustobiash has blown my mind with his comment on that change20:27
corvusas soon as i'm done with this, i want to change that everywhere20:27
corvusi hate having to type the arguments to super20:27
clarkbya its a neat new thing I learned recently too20:28
clarkbyou still have to use the old style in some cases but not these cases20:28
clarkb(the cases where you are overriding some MRO default)20:28
clarkbok thats is me through the entire related stack  that is passing. Including tobiash's regex project templates20:30
clarkbcorvus: https://review.openstack.org/#/c/563695/1 has unhappy test20:30
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Remove 'base' from UnparsedAbideConfig  https://review.openstack.org/56375720:32
corvusclarkb: thanks; that shouldn't be too hard to fix20:33
corvusi'll probably leave it for later, after i get through this current attempt to reuse config objects20:33
clarkbI'm now poking at shrews' stestr change and tox is broken for me so first I must unbreak tox20:36
*** dkranz has quit IRC20:44
clarkbShrews: ttrun worked for me and py36. But I got an interesting error message.20:49
clarkb/usr/lib64/python3.6/runpy.py:125: RuntimeWarning: 'testtools.run' found in sys.modules after import of package 'testtools', but prior to execution of 'testtools.run'; this may result in unpredictable behaviour20:49
clarkbs/error/warning/20:49
Shrewsclarkb: by "worked" you mean you saw the debug logging output?20:50
clarkbShrews: oh is that specifically what we are looking for? For that I think you need to flip the env var over to emit it. I'll try that20:50
Shrewsclarkb: yes. see my latest comment on that review20:51
clarkbShrews: ya I had to set the three OS_*_CAPTURE env vars to 020:53
clarkbShrews: the change there updates them to default to true (1) rather than false. With testr we had that inverted. They defaulted to false and testr set them to true in its config file20:53
corvusso testr would capture the output, but ttrun would not20:54
corvusnow they both do?20:54
Shrewsi'm not sure i like that20:54
clarkbcorvus: correct20:55
clarkbI'm looking to see if stestr can set env vars in a similar manner20:55
Shrewswhy don't we just set them in tox.ini?20:55
clarkbya that would be one way of doing it20:56
clarkbsincei t is just going to run stestr anyways20:56
corvusShrews, clarkb: yeah, i think that's what the zuul change did.  ++20:56
corvusoh, though i guess that means that "stestr run" will spew output20:57
corvusbasically, i think tox and 'testr run' should be quiet, and ttrun should be verbose20:57
clarkbconfirmed stestr run will spew output in that case20:58
Shrewsis that a problem though?20:58
clarkbit can be quite confusing to people to have interleaved test output emit that way20:59
Shrewsi only ever call tox or ttrun20:59
corvusShrews: i don't do it as much as ttrun, but i do still run the unit tests locally -- i used 'testr run --failing' a lot last week actually20:59
Shrewsi see20:59
Shrewsthat's a valid use case21:00
clarkbya not finding a way to do this in stestr itself21:04
clarkbfeature request to mtreinish maybe21:04
clarkbShrews: corvus another option could be to inspect argv[0] in the test run to see how it was invoked21:09
clarkbif running under ttrun then flip that value21:09
Shrewsmight be just as easy to add the env var feature to ttrun via a new config file21:17
corvusi heard that stestr had something like ttrun; i wonder how that fits in21:18
*** hashar has quit IRC21:54
clarkbbefore I forget, it would be nice to try and do another zuul reelase soon I think22:22
clarkbthere are a few user facing improvments that we should get out there in addition to a bunch of small bugfixes22:22
*** threestrands has joined #zuul22:41
*** threestrands has quit IRC22:41
*** threestrands has joined #zuul22:41
corvusclarkb: ++ should we restart openstack-infra to beta test it?22:53
openstackgerritClark Boylan proposed openstack-infra/zuul-jobs master: Split logging of inventory to its own role  https://review.openstack.org/56378722:55
clarkbcorvus: ya probably23:00
openstackgerritClark Boylan proposed openstack-infra/zuul-jobs master: Stop logging inventory in validate-host  https://review.openstack.org/56379023:02

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!