Saturday, 2018-06-09

*** tosky has quit IRC00:10
*** lifeless has quit IRC01:12
*** jamesmcarthur has joined #storyboard02:03
*** jamesmcarthur has quit IRC02:08
*** jamesmcarthur has joined #storyboard05:26
*** jamesmcarthur has quit IRC05:31
*** lifeless has joined #storyboard06:40
*** Clovencrow has joined #storyboard06:52
*** Clovencrow has quit IRC06:55
*** lifeless has quit IRC09:41
*** lifeless has joined #storyboard09:42
*** lifeless_ has joined #storyboard10:14
*** lifeless has quit IRC10:14
strigazihello folks, I get 500 when I try to login to storyboard cc fungi diablo_rojo_phon10:15
strigazi/api/v1/openid/token?grant_type=authorization_code&code=<some_code> No error details available.10:15
*** lifeless_ has quit IRC10:40
*** lifeless has joined #storyboard10:41
*** lifeless_ has joined #storyboard11:33
*** lifeless has quit IRC11:33
*** tosky has joined #storyboard12:17
fungistrigazi: me too, looking to see if there's an issue with the database or whether we merged a regression in the past 12 hours12:44
fungii can reach the db at least12:45
fungiLock wait timeout exceeded; try restarting transaction12:47
fungiraised by: UPDATE users SET updated_at=%(updated_at)s, last_login=%(last_login)s WHERE users.id = %(users_id)s12:48
fungii get an empty set from: show open tables where in_use>0;12:50
fungiand i can see 10 sleeping processes from: show processlist;12:52
fungirestarting apache2 didn't help, and neither did restarting storyboard-workers13:04
fungii've now noticed that our "sanity" trove configuration wasn't applied (so was relying on rackspace's default with extremely short idle socket timeouts). i've applied that and restarted the trove instance13:05
fungialso doesn't seem to have helped13:07
fungiat this point i think i'm down to trying to revert changes which merged around 2200-2300z13:10
fungistrigazi: yep, reverting to f38f3bc seems to have solved it. later today i'll try to bisect the issue13:19
*** jtomasek has joined #storyboard17:17
*** krotscheck has quit IRC18:08
*** krotscheck has joined #storyboard18:09
*** jtomasek has quit IRC18:14
*** lifeless_ is now known as lifeless19:40
*** lifeless has quit IRC20:38
*** lifeless has joined #storyboard21:09
*** lifeless has quit IRC22:55
*** tosky has quit IRC23:50

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!