Wednesday, 2016-05-25

*** jamesmcarthur has joined #storyboard01:39
*** jamesmcarthur has quit IRC01:43
*** jamesmcarthur has joined #storyboard01:47
*** jamesmcarthur has quit IRC01:54
*** jamesmcarthur has joined #storyboard02:02
*** anteaya has quit IRC02:02
*** jamesmcarthur has quit IRC02:16
*** jamesmcarthur has joined #storyboard02:21
*** jamesmcarthur has quit IRC02:33
*** jamesmcarthur has joined #storyboard02:38
*** jamesmcarthur has quit IRC02:39
*** jamesmcarthur has joined #storyboard03:10
*** jamesmcarthur has quit IRC03:11
*** jamesmcarthur has joined #storyboard03:11
*** jamesmcarthur has quit IRC03:18
*** jamesmcarthur has joined #storyboard03:26
*** jamesmcarthur has quit IRC03:33
*** jamesmcarthur has joined #storyboard03:41
*** jamesmcarthur has quit IRC03:49
*** jamesmcarthur has joined #storyboard03:54
*** jamesmcarthur has quit IRC04:04
*** jamesmcarthur has joined #storyboard04:11
*** jamesmcarthur has quit IRC04:20
*** jamesmcarthur has joined #storyboard04:25
*** jamesmcarthur has quit IRC04:34
*** jamesmcarthur has joined #storyboard04:41
*** jamesmcarthur has quit IRC04:53
*** jamesmcarthur has joined #storyboard04:58
*** jamesmcarthur has quit IRC05:08
*** jamesmcarthur has joined #storyboard05:12
*** jamesmcarthur has quit IRC05:25
*** jamesmcarthur has joined #storyboard05:26
*** jamesmcarthur has quit IRC05:33
*** jamesmcarthur has joined #storyboard05:39
*** alexismonville has joined #storyboard05:42
*** jamesmcarthur has quit IRC05:44
*** jamesmcarthur has joined #storyboard06:41
*** jamesmcarthur has quit IRC06:46
*** jtomasek has joined #storyboard07:20
*** fay_ has joined #storyboard07:59
*** jamesmcarthur has joined #storyboard08:02
*** jamesmcarthur has quit IRC08:07
SotKmorning storyboard!08:13
*** alexismonville has quit IRC09:01
Zaramorning!09:02
ZaraI return from illness!09:02
SotK\o/09:08
*** bethwhite has joined #storyboard09:10
*** tlbr has quit IRC09:49
*** tlbr has joined #storyboard09:52
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Add a modal to create Teams  https://review.openstack.org/32051710:00
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Implement UI for managing team membership  https://review.openstack.org/32003710:00
Zara:)10:01
ZaraI'm catching up on mountains of backscroll etc, should be able to look at some patches soon.10:09
Zaraprobably time to close some of my 59 irc windows10:10
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Stop allowing duplicate users to be added to private stories  https://review.openstack.org/32089511:02
*** openstackgerrit has quit IRC11:18
*** openstackgerrit has joined #storyboard11:18
*** alexismonville has joined #storyboard11:32
Zaraoh yeah, storyboard meeting 15:00UTC in #openstack-meeting12:16
*** alexismonville has quit IRC12:24
Zaraargh, I had emails turned on on my test instance, but the worker turned off12:30
Zaraand my instance has been automatically updated from gerrit a bunch, while working on my wip thing12:30
Zaraso ALL THE EMAILS have arrived12:30
Zara168 emails, all for the same auto-updated task12:31
Zaraoh, they're still arriving12:31
ZaraI'll give the final total when it settles down12:34
*** alexismonville has joined #storyboard12:39
*** jamesmcarthur has joined #storyboard12:48
*** jamesmcarthur has quit IRC12:52
Zarait's still going... so I guess the good news is that the email worker will keep > 1800 emails waiting for you if it gets shut off13:09
*** anteaya has joined #storyboard13:24
dmsimardHi Zara !13:43
Zarahi!13:43
dmsimardI was pointed at https://review.openstack.org/#/c/302912/13:43
*** jamesmcarthur has joined #storyboard13:44
dmsimardContext is that I'm in the process of moving a project under the OpenStack umbrella and we would've loved to skip launchpad entirely and go straight to storyboard to save the eventual migration13:44
dmsimardOne thing I was wondering about was the hooks between gerrit < - > storyboard for bug references, bug updates and so on based on gerrit reviews13:45
dmsimardI guess that review is a good proof of concept of how things could work, is there a lot of work involved in getting things ready for prime time ?13:45
krotscheckbrains13:47
*** tlbr has quit IRC13:47
*** jamesmcarthur has quit IRC13:49
*** tlbr has joined #storyboard13:49
Zaradmsimard: I don't think there's that much. at the moment it's slow because I'm the one working on it and can't give it my full attention, plus I have minimal python knowledge13:50
ZaraI think the only thing we're fuzzy about is how to get authentication working in the proper thing13:50
Zarawe know what the rest *should* do, just a question of actually coding it13:50
*** jamesmcarthur has joined #storyboard13:51
Zaraso yeah, it's not complex in theory, at least13:51
pedroalvarezI looked yesterday at creating automation users in storyboard13:52
dmsimardZara: fair enough, would you like a candidate for beta testing things ? My hands are full so I can't exactly help code wise but if I can help by going through the process of integrating a new project in storyboard and using the workflow between it and gerrit, I'll be happy to.13:52
Zaradmsimard: sounds good to me :)13:55
dmsimardZara: Cool, we'll stay in touch and I'll idle around here if you have any questions. I don't really know how to add a project to storyboard yet, is there some docs I should be looking at ?13:57
*** jamesmcarthur has quit IRC13:59
*** jamesmcarthur has joined #storyboard13:59
Zaradmsimard: as far as I'm aware, infra projects are added to storyboard automatically. I'm not sure about the rules for all other projects; it's probably best asking about it in #infra.14:00
Zaraan admin user can add projects but I think there's also automation for it14:01
dmsimardWill do14:01
Zaraaha, I think you need to set 'project-config: use storyboard' to true, going by backscroll14:02
dmsimardZara: I'll try and ask and add a documentation bit on http://docs.openstack.org/infra/manual/creators.html :)14:02
Zarathank you :)14:02
*** jamesmcarthur has quit IRC14:12
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Remove extraneous <tbody> elements from the dashboard  https://review.openstack.org/32101714:19
Zaraoh yeah, storyboard meeting in half an hour14:34
ZaraI got distracted, sorry; mayyyy have accidentally spammed my company's mailserver with > 20000 emails from my test instance and broken everyone's access to email14:35
Zarain case anyone was wondering how that story ended.14:35
Zarain other news, don't mix wip gerrit scripts with email notifications14:36
anteayaoh my14:38
anteayagood work for a wednesday14:38
ZaraI got about 5000 emails all titled 'hi how are you'14:39
Zara(it took a while between sending and receiving; I'd received 5000 2 hours after the emails were sent.)14:39
* Zara disables notification emails forever14:42
krotscheckZara: How many people hit "Reply all"?14:46
Zarakrotscheck: luckily, the emails only went to me. they just went through the same mailserver everyone uses14:47
krotscheckZara: Google Apps. I hear that's a thing.14:47
Zaraso people were wondering why they weren't getting email...14:47
Zarabut storyboard itself seemed to cope well with it!14:48
Zaraso that's a robust little email worker!14:48
Zara... but yeah... wondering how much we should worry about it as a potential vector for spammers.14:50
anteayaZara: nice load testing14:52
krotscheckZara: yeah, there's things that will eventually have to happen. API rate limiting, outgoing email filter, etc.14:52
anteayaZara: jeblair knows quite a bit about mail servers, you might ask him14:53
Zarayeah, right now I don't think there's any protection against some random person wreaking havoc via s.o.o.14:56
Zaraoh, meeting in 1 minute!14:59
SotKha, well remembered14:59
Zarawell, I forgot to update the agenda with anything, so hey15:00
* Zara -> meeting15:00
*** jamesmcarthur has joined #storyboard15:11
*** alexismonville has quit IRC15:57
anteayathanks for the meeting, sorry I was late16:00
SotKno worries :)16:00
anteayaI'm offline for a while but if we need to discuss anything further, let me know16:00
Zaranp :)16:01
fungiSotK: Zara: krotscheck: anteaya: the trusty-based storyboard.o.o replacement is at 2001:4800:7815:103:be76:4eff:fe06:b5c and 23.253.85.15516:06
fungiit even seems to think i'm still logged in (thanks to session backend in the trove database i assume) and browsing around it shows the content i expect16:07
Zaraooh, nice16:07
anteayafungi: yay, thank you16:07
fungijust to be sure, i fired up tcpdump on the new server and confirmed it was the one my requests were hitting16:07
anteayayay16:08
fungidns ttl for the storyboard.openstack.org resource records have been set down to 5 minutes for a couple days now, so if someone gives the go-ahead i'll change them to the new addresses16:08
* anteaya waits for Zara and SotK 16:09
ZaraI don't know enough to know any problems it would cause, so I'm not against it if someone with more experience thinks it will be fine. sotk just had to dash off home.16:10
pedroalvarezsame opinion here, I don't know how the current setup is, and I don't know about what problems can happen16:11
pedroalvarezI thought that the DB, the API and the webclient were in the same host a few days ago :)16:12
ZaraI don't know if we'll see SotK again tonight16:14
pedroalvarezfungi: so, are both using same DB? If so I see no possible problems16:17
Zaranow you've jinxed it16:17
pedroalvarezI .. I... :/16:17
Zara:D16:18
Zaraahhhh, I'm so happy to get emails that aren't from my storyboard instance, at last16:19
krotscheckI'm guessing that the database was cloned.16:19
krotscheckAnd retained some existing login information.16:19
fungipedroalvarez: krotscheck: same db. it's a "remote db" provided by an openstack trove instance16:19
fungiso there are actually two storyboard servers (dangerously?) sharing that database at the moment16:20
SotKI'll be non-mobile in about 40 minutes16:20
fungii was sort of surprised to see it not be disruptive16:20
krotscheckfungi: Well, as long as they're running the same version it'd be fine, but as soon as one of them tries to run an auto DB migration that's going to be a problem.16:21
krotscheckAlso, worker functionality may conflict.16:21
pedroalvarezhm... db dump and swich? :)16:22
fungiwe do periodic database dumps anyway16:23
fungibut i can run an ad-hoc one now too16:23
pedroalvarezI feel like the 'precise' server should be taken down as soon as we swich16:24
pedroalvarezs/swich/switch/16:24
fungithe last one is midnight utc16:24
fungipedroalvarez: yep, i'll halt it right after dns starts to propagate16:24
fungiand then delete it once we're comfortable we don't need to switch back16:25
pedroalvarezWe use a haproxy on our infra, so that we don't rely on dns propagation16:26
* fungi wonders how you move your haproxy server to a different ip address16:27
fungiturtles all the way down16:27
pedroalvarezhaha :)16:27
fungianyway, i've dumped and copied off a copy of the db just in case something weird transpires after the new server begins to use it more heavily16:27
pedroalvarezgreat16:28
Zaraokay, thank you :)16:28
pedroalvarezso, plan: switch, and test in the next 30 min, and if something goes wrong, we switch back?16:28
* pedroalvarez hopes all other bits of openstack infra use the domain name, and not the ip16:30
pedroalvarez(deploy jobs from zuul, e.g)16:30
pedroalvareznobody liked my plan :'(16:47
*** fay_ has quit IRC16:48
ZaraI just didn't know enough about any of it116:48
Zara!16:48
Zarasee I can't even remember how to type exclamation marks16:48
Zarayou don't want me weighing in on a plan16:48
krotscheckIt should be fine.16:48
ZaraI'm heading off soon16:51
pedroalvarezme too16:52
*** bethwhite has quit IRC16:59
SotKhi!17:00
Zarahi SotK! I'm just about to leave!17:00
* SotK wonders what ended up happening17:20
persiaI think we are in the pre-migration validation phase, and a signal needs be sent to reach the post-migration validation phase.17:23
persiaMy read of the above is that there is a desire to have someone familiar with internals around for migration, just in case there is an unexpected result.17:24
persia"SotK" was mentioned as a possible candidate to be that person.17:25
* SotK is around17:31
SotKfungi: feel free to press the button :)17:31
fungiyep, button-pushing is my specialty17:32
* fungi cracks knuckles and readies his button finger17:32
nibalizerbutton button button!17:35
fungii'm having to wait for my primary system to shed some excess heat, so doing this from a suboptimal alternate machine17:37
* SotK trembles with anticipation17:39
fungiokay, dns records have been updated. in a few minutes i'll halt the old server so it doesn't do unexpected things17:39
anteayafungi: still no fan yet for the primary machine?17:39
anteayayay dns records updated17:39
fungianteaya: nope, when i ordered a replacement for that machine to use for spare parts (because they wouldn't tell me who makes the fan), the supplier i guess decided that they didn't have them in stock after all and helpfully shipped me a newer model than i ordered17:41
anteayaoh my17:41
anteayahow disappointing17:41
fungiso i've been hesitant to try again after i sent that back17:41
anteayano kidding17:41
anteayaperhaps maybe clarkb's suggestion from the -sprint channel then? a bucket of ice?17:42
fungiand i'm at the point where it's time for me to research newer systems anyway, so i'll just migrate to something else soon17:42
anteayaah17:45
anteayahopefully newer system has replacement fans17:45
fungihopefully newer system doesn't need fans17:45
anteayaeven better17:45
fungii'm a big fan of passive cooling17:46
anteayaha ha ha17:46
persiaOil reservoirs17:48
*** jamesmcarthur has quit IRC17:54
fungiwatching tcpdump on the old server for any new https traffic... it's died off for some minutes now17:55
anteayayay17:55
fungigoing to go ahead and halt it now17:57
fungiup 448 days since last reboot17:58
krotscheckNeat. So, can we migrate to xenial now? ;)17:59
SotK:D17:59
pleia2hah17:59
anteayafungi: thank you17:59
SotKthanks fungi17:59
pleia2I started poking at what it would take on Monday, it'll be a bit of a chore (though we do need it for Zanata soon)17:59
anteayapleia2: thanks for looking at that18:00
anteayapleia2: did you create a xenial story?18:00
pleia2anteaya: yep18:00
anteayacool18:00
pleia2just didn't want to sidetrack too much from trusty upgrades18:00
* krotscheck was joking18:00
anteayathere it is18:00
* krotscheck backtracks18:00
* krotscheck was not joking at all!18:00
anteayapleia2: good call, but the story exists18:00
krotscheck:D18:00
anteayapleia2: so that's helpful18:01
anteayapleia2: did you want to add your findings as a link to an etherpad or tasks or notes in a task?18:01
pleia2anteaya: turned out it would take too long, I need to open stories in our various puppet modules18:02
anteayapleia2: ah18:03
*** jamesmcarthur has joined #storyboard22:34
*** jamesmcarthur has quit IRC22:44
*** jamesmcarthur has joined #storyboard22:46
*** jamesmcarthur has quit IRC22:46
*** jamesmcarthur has joined #storyboard23:18
*** jamesmcarthur has quit IRC23:24
*** jamesmcarthur has joined #storyboard23:32

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!