Wednesday, 2016-01-13

*** coolsvap|away is now known as coolsvap03:37
*** mrmartin has joined #storyboard05:29
*** mrmartin has quit IRC06:01
*** mrmartin has joined #storyboard06:03
*** mrmartin has quit IRC06:08
*** jtomasek has joined #storyboard07:28
*** coolsvap is now known as coolsvap|away09:56
Zaramorning, storyboard!10:09
SotKmorning!10:15
ZaraI think the characters issue strikes again: https://storyboard.openstack.org/#!/story/200045811:01
Zarathough I can't see what's strange about it11:02
Zaraseems like the same behaviour, though11:02
Zarawell, the list does eventually load in this case, but it takes a long time, and there's a prompt to debug/stop script on the description page11:04
SotKweird, it seems ok (though slow) in chrome11:06
ZaraI get errors in the web console11:06
Zararror: [$sanitize:badparse] The sanitizer was unable to parse the following block of html:11:07
Zarathe description is different in the web console11:08
Zarahttp://paste.openstack.org/show/483730/11:09
Zaraso that doesn't match the description in the story11:10
SotKdoes that happen if you refresh the story page?11:10
Zarahm, seems not11:11
Zarastill getting the error11:11
Zarasorry, an error11:11
Zarabut a different one11:11
ZaraError: [$rootScope:inprog] $digest already in progress11:12
Zarahttp://errors.angularjs.org/1.3.13/$rootScope/inprog?p0=%24digest11:12
ZaraI wonder what's going on, since that makes it sound like a more general bug, but it seems to only affects that story?11:18
Zara*affect11:18
SotKidk, pretty weird11:18
SotKI don't know what would cause that11:18
Zarastill going with my 'sb doesn't like some syntax' theory but hard to narrow down.11:19
SotKso the "db is really slow" issue is caused by the session hook11:26
Zarayay, you found the cause? :D11:28
ZaraI wanted to look at email templates again today. currently sidetracked debugging thing above (since that will affect the jenkins job builder team)11:30
SotKI think so, though I don't really know why it didn't take ages with query.count() separate from the query which retrieves the records11:32
SotKI suspect there is some sqlalchemy magic at work that I don't understand11:32
Zarareplicated story bug on my own instance by copying over title and description11:33
Zaraokay the problem is somewhere in the block of text after the bit starting 'Moving the config check...'11:39
Zaraso that's: http://paste.openstack.org/show/483740/11:45
ZaraI don't think it's an issue with a character now; I do think that some of the syntax is making storyboard interpret the subsequent code differently (maybe trying to run it? :/)11:50
Zaracopying in that whole block causes issue. copying in just first line seems to slow it down a little, but not lots (seems to get worse with each subsequent line). copying in all but first line has no effect.11:53
Zaraokay, so it dislikes             allow_empty_variables = self.config \11:56
Zarabut only when it's indented11:56
Zaraany idea what that might signify?11:57
SotKwhat if it's indented by only four spaces?11:59
Zarayeah, that's the indentation that seems to affect it12:00
SotKI guess something about it causes the markdown parser to be slow12:00
Zaraand loop, it seems (in iceweasel anyway) I wondered but didn't know if the markdown parser worked when the save or preview button wasn't clicked12:01
Zaramy guess is that the markdown parser is reading it as an instruction (I'd think it was just confused but the other lines are similar syntactically and don't cause the same problem)12:03
SotKwhat happens if you delete the \ from the end?12:04
Zarait still dislikes it12:04
SotK:S12:05
Zaraokay, swapping first line for just allow_empty_variables still causes issue12:09
Zaraswapping it for allow_fluffy_cats doesn't12:09
Zaraso that's the instruction that's making things go haywire12:09
Zaraooh, but it doesn't like allow_fluffy_variables12:10
Zaraallow_variables doesn't trigger it, fluffy_variables doesn't trigger it, sleepy_fluffy_variables does. suggests it may be anything of form x_x_variables12:12
Zaraactually, also getting one without 'variables', so maybe it's to do with the length of the strings between underscores too12:15
Zaraor total length?12:15
paulsherwoodah, ok12:17
paulsherwoodoops ww12:19
Zaraheh. :)12:19
Zaraas for this, I think I've got it!12:20
Zarait's because the first string in the markdown description is too long12:20
Zarawhere strings are separated by spaces12:20
Zaraif you indent four spaces and then start typing the alphabet, you can see the effect in realtime12:39
Zarahave commented on the affected story, anyway12:39
Zararight, back to email templates! we're so close! I might have to ask for help getting them displaying urls; there was a mention of pecan and I'm still confused by it, though I'll look for a while before bothering anyone else.12:50
Zaraack, I have 51 emails automatically sent from my test instance in the process of debugging that story.12:51
* pedroalvarez wonders if sending diffs for the changes in the description makes sense12:53
pedroalvarez@Line number for context12:55
pedroalvarezThings that haven't changed12:55
pedroalvarez- Thing that has been deleted12:55
pedroalvarez+ Think That has been added12:55
pedroalvarezAnother thing that hasn't been modified12:55
pedroalvarez@12:55
pedroalvarez(just a thought)12:55
Zarasounds interesting. I don't know that line number would help, since I don't think those are displayed on the story detail pages. the current template leaves the user to infer the difference between the old and new description, by posting 'from: {old description} to: {new description}' it'd be nice to have a future version of the template that narrowed it down, though.12:59
ZaraI'd like to improve that but I'm okay with the current implementation as the first step, provided it links to the story. (right now the user comment template and task deleted template are my priorities, because we have nothing there yet.)13:01
SotKI've finally reached the bottom of the API slowness hole13:02
Zara'task deleted' seems a bit odd; I just get an error in the worker instead of a 'template not found'13:02
Zara\o/13:02
Zaraexcellent13:02
Zarawait, maybe I should hang on until you say what it is :P13:02
SotKfor some insane reason, it decides that all 682 (or however many stories you have) stories have been changed and need writing back to the database13:03
Zaraeep13:03
Zarahm, okay, so when I comment on a story, I get an odd message from the worker13:05
Zarahttp://paste.openstack.org/show/483753/13:05
SotKo.O13:06
Zaraand deleting a task gives me: http://paste.openstack.org/show/483756/13:07
Zarahm, actually, I also get the first one when I edit a description (though maybe not always)13:10
Zaraso maybe the problem here is more that commenting isn't having any effect on the worker13:10
Zarastill coming up in recent events, though13:10
SotKaha, the insane reason turns out to be that summarize_task_statuses makes the objects "dirty" because it deletes some attributes and adds a new one13:32
SotKargh13:32
Zaraso the lack of a TemplateNotFound for comments makes me think it's not trying to build the email13:49
Zara        if resource not in ['task', 'project_group', 'project', 'story',13:51
Zara                            'branch', 'milestone', 'tag']:13:51
Zara            return13:51
ZaraI wonder if that's why.13:51
Zarahm, added 'comment', no dice13:57
SotKoh, its the meeting in an hour!14:00
Zara\o/14:02
Zaragrr, having no luck with these mysterious user comments14:04
* SotK has no ideas about it14:04
SotKI'll look when I finish fighting stories14:04
Zaraheh, thanks14:06
Zarahm, this also suggests they're treated differently:14:10
Zara    def handle_timeline_events(self, session, event, author, subscribers):14:10
Zara        for user_id in subscribers:14:10
Zara            if event.event_type == 'user_comment':14:10
Zara                event_info = json.dumps(14:10
Zara                    self.resolve_comments(session=session, event=event)14:10
Zara                )14:10
Zara            else:14:10
Zara                event_info = event.event_info14:10
SotKheh, with a fix to stop stories becoming dirty, GETting 100 stories takes 364ms on storyboard.sotk.co.uk... on storyboard.o.o it takes 1.65s14:13
Zara\o/14:13
Zarayes please!14:13
pedroalvarezthat is awesome14:15
* SotK pokes around to see if it can get any quicker14:16
pedroalvarezbtw, you should compare the times in the same host, they might have different hardware14:16
Zaratbf making it four times faster sounds pretty nice. iirc storyboard.sotk.co.uk has worse hardware?14:16
SotKpedroalvarez: I know, I was just being lazy with that :)14:17
pedroalvarezZara: I would hope it has worse hardware :)14:17
Zaraso would I but tbf I don't know xD14:18
SotKok, I stopped being lazy with my speed comparison14:40
SotKon storyboard.sotk.co.uk, after fix: 338ms14:40
SotKon storyboard.sotk.co.uk, before fix: 5.93s14:40
Zaraooooooooooo~14:41
pedroalvarezsee, it's even better than we thought14:41
Zaraso... nearly 20 times faster?14:41
Zara17.5 according to a calculator14:43
betherlywoah SotK :D thats so awesome14:51
Zara:D14:56
Zarameeting in 4 minutes! so exciting!14:56
*** davidlenwell has quit IRC14:57
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Speed up story GET requests  https://review.openstack.org/26696114:58
Zaraoooooooo14:58
* SotK imagines he broke some tests14:59
*** davidlenwell has joined #storyboard14:59
ZaraI'll wait a bit before reviewing, then. still very excited!14:59
* SotK did15:18
Zara\o/15:20
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Speed up story GET requests  https://review.openstack.org/26696115:22
SotKTests pass now \o/15:57
Zaraooooooooooo again15:57
Zarawill test now15:57
Zarafuelled by doughnut15:57
* SotK sends https://review.openstack.org/#/c/267002/16:00
Zarahm, in testing I noticed that there are no project groups listed in search (there are for dropdown for quicknav)16:04
Zarathat's not related to the patch, just noticed it now16:05
Zarahah, but now it makes boards seem much slower by comparison xD16:06
SotKwhich search has no project groups?16:11
SotKoh, the main search page16:12
Zarayeah16:14
Zara(or the header search after pressing enter, which I think links to the same in practice)16:14
Zarahaving tested the GETs patch it seems fine. :) the only thing I'm wondering about is whether we'll encounter hidden issues with this after prolonged use that were avoided by SQLAlchemy flushing every story16:21
SotKit still flushes everything that has changed, just now nothing has changed for no real reason16:22
Zaraheh, cool :) I'm always wary with anything that has such a great impact on performance, but really hope it's all fine and we can merge it ASAP16:24
SotKoh, I just realised there is already an established icon for tasks (see the search page)16:30
SotKand all this time I've been using that weird one16:30
ZaraI dislike that one tbh16:31
ZaraI think it look smore like a 'tag' icon16:31
Zarabecause it's literally a tag16:31
SotKit suggests tag to me too16:32
ZaraI've even seen it and thought 'oh hey tags *are* already searchable, I was wrong', only to then squint and realise it says 'tasks'16:32
Zaraso I'd prefer that to change to being the tags icon.16:33
pedroalvarezreviewed: https://review.openstack.org/#/c/266961/216:35
pedroalvarezsorry I'm not reviewing a lot of things this year, but I couldn't not review this one16:36
SotKno worries pedroalvarez, thanks for the review!16:36
Zara\o/ yeah, any help is appreciated. and it's only the start of the year! :D16:37
Zarahm, fa-pencil-square is still used on admin page, otherwise I'd say we should use that16:38
Zarafa-pencil-square-o, even16:38
Zarafor a tasks icon, I mean16:38
SotKthe icon I've been using is pretty terrible, anything would be an improvement :)16:40
ZaraI'd suggest we use a normal pencil for the admin page edit button, since everywhere else uses that. then we free up the other icon for tasks16:41
Zara( http://fortawesome.github.io/Font-Awesome/icon/pencil-square-o/ )16:41
pedroalvarezthat's the icon we are using for edits buttons16:42
pedroalvarezright?16:42
Zaraonly for one that I can find16:42
Zaraso that's why I was thinking of swapping that one for the usual pencil. but I might have missed some elsewhere16:43
SotKits used for editing tasks in stories too16:43
Zaraoh, so it is, wah16:43
pedroalvarezhm.. what about checkboxes?16:50
pedroalvareztasks are something that when you do, you tick a check box, right :)16:51
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Show Project Groups on search page  https://review.openstack.org/26702716:52
pedroalvarez( check-circle-o or check-square-o )16:55
* SotK likes check-square-o16:57
pedroalvarezjust an idea, I didn't find anything else interesting16:58
Zarayeah, I think I liked the pencil-square because it was reminiscent of a checkbox without being one (concerned that using it as tasks icon might make users think they can check/uncheck it)17:00
Zaraanyone got a moment for looking at email comments weirdness17:05
SotKoh yeah, I forgot I was going to peek at that :)17:05
Zara:P well tbf you were busy making storyboard SEVENTEEN POINT FIVE TIMES FASTER17:06
ZaraI'm going to say that whenever I can17:07
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Improve "add card" UI  https://review.openstack.org/26700217:07
Zaraanyone opposed to me merging speedups? was going to hold off 'til the morning so we'd be around to fix anything that might go wrong, or in case anyone suddenly realised anything in the interim17:16
Zarabut maybe that's going too far.17:16
* pedroalvarez reviews a couple of things more that are ready to be merged17:17
pedroalvarezif you ask me my answer is " merge all the things"17:18
ZaraI like to stagger it a bit because we don't have as many eyes on the code (glad I waited with the unlimited pagination patch, hehe), but this one has been tested on production data tbf17:19
Zaraokay, people want it merged and we can revert if necessary17:19
Zarahere goes...17:19
pedroalvarezyay!17:19
pedroalvarezbrave Zara is brave!17:20
SotK\o/17:20
ZaraI'm less worried with this because we've all tested it in different ways with different amounts of data17:21
SotKthanks Zara :)17:21
Zarabut stilllll... speedups always scare me xD17:21
SotKI wonder why openstackgerrit doesn't notify us of things sometimes17:27
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Show Project Groups on search page  https://review.openstack.org/26702717:35
Zaranight-night, storyboard! :)17:59
openstackgerritMerged openstack-infra/storyboard-webclient: Improve "add card" UI  https://review.openstack.org/26700218:03
*** jjardon has quit IRC18:08
*** betherly has quit IRC18:08
*** jjardon has joined #storyboard18:23
*** betherly has joined #storyboard18:23
*** davidlenwell has quit IRC19:57
*** davidlenwell has joined #storyboard19:58
*** jtomasek has quit IRC21:32
* SotK realises too late he meant to reduce the live search results count from 500 to 5023:29

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!