Sunday, 2013-10-27

*** fungi has quit IRC00:08
*** DennyZha` has joined #openstack-infra00:10
*** DennyZhang has quit IRC00:12
*** DennyZha` has quit IRC00:15
*** michchap has joined #openstack-infra00:21
*** sarob has joined #openstack-infra00:25
*** sarob_ has joined #openstack-infra00:28
*** sarob has quit IRC00:29
*** sarob_ has quit IRC00:33
*** dims has quit IRC00:45
*** sarob has joined #openstack-infra00:47
*** dims has joined #openstack-infra00:49
*** sarob has quit IRC00:51
*** dims has quit IRC00:54
*** yongli has quit IRC01:01
*** kpepple_ has joined #openstack-infra01:01
*** dripton_ has joined #openstack-infra01:02
*** fungi has joined #openstack-infra01:02
*** Steap_ has joined #openstack-infra01:03
*** ekarlso- has joined #openstack-infra01:06
*** fungi has quit IRC01:08
*** ekarlso has quit IRC01:08
*** Steap has quit IRC01:08
*** terriyu has quit IRC01:08
*** dripton has quit IRC01:08
*** jpeeler has quit IRC01:08
*** rwsu has quit IRC01:08
*** kpepple has quit IRC01:08
*** rwsu has joined #openstack-infra01:14
*** jpeeler has joined #openstack-infra01:15
*** terriyu has joined #openstack-infra01:15
*** fungi has joined #openstack-infra01:16
*** michchap has quit IRC01:25
*** michchap has joined #openstack-infra01:28
*** sarob has joined #openstack-infra01:47
*** sarob has quit IRC01:52
*** wenlock has joined #openstack-infra02:01
pleia2terriyu: we have some ruby stuff related to puppet on the back burner, but not enough for a full internship and it's sysadmin focused (so ruby is helpful but not a focus)02:37
terriyuthanks pleia202:38
terriyuwe got ahold of anteaya and she said something similar02:38
* pleia2 nods02:38
*** changbl has quit IRC02:47
*** sarob has joined #openstack-infra02:48
*** sarob has quit IRC02:53
*** nati_ueno has joined #openstack-infra02:59
*** changbl has joined #openstack-infra03:02
*** esheffield has quit IRC03:07
*** lascii has quit IRC03:07
*** esheffield has joined #openstack-infra03:11
*** dcramer_ has joined #openstack-infra03:18
*** esheffield has quit IRC03:20
*** sarob has joined #openstack-infra03:48
*** sarob has quit IRC03:53
*** terriyu has quit IRC04:09
*** wenlock has quit IRC04:20
*** lnxnut has quit IRC04:26
*** lnxnut has joined #openstack-infra04:31
*** reed has quit IRC04:41
*** sarob has joined #openstack-infra04:49
*** sarob has quit IRC04:53
*** dcramer_ has quit IRC04:55
*** esheffield has joined #openstack-infra04:57
*** ArxCruz has quit IRC04:58
*** ArxCruz has joined #openstack-infra05:02
*** esheffield has quit IRC05:06
*** zojoncj has joined #openstack-infra05:24
*** sarob has joined #openstack-infra05:49
*** sarob has quit IRC05:54
*** moted has quit IRC06:19
*** SergeyLukjanov has joined #openstack-infra06:24
*** sarob has joined #openstack-infra06:50
*** tkammer has joined #openstack-infra06:53
*** sarob has quit IRC06:55
*** tkammer has quit IRC07:18
*** ericw has joined #openstack-infra07:18
*** ericw has quit IRC07:23
*** nati_ueno has quit IRC07:24
*** nati_ueno has joined #openstack-infra07:24
*** nati_ueno has quit IRC07:29
*** SergeyLukjanov has quit IRC07:39
*** SergeyLukjanov has joined #openstack-infra07:46
*** pvo has quit IRC07:48
*** SergeyLukjanov_ has joined #openstack-infra07:48
*** boris-42 has quit IRC07:48
*** fifieldt has joined #openstack-infra07:48
*** pvo has joined #openstack-infra07:50
*** sarob has joined #openstack-infra07:50
*** SergeyLukjanov has quit IRC07:51
*** ArxCruz has quit IRC07:51
*** sarob has quit IRC07:55
*** SergeyLukjanov_ has quit IRC08:00
*** tkammer has joined #openstack-infra08:19
*** tkammer_ has joined #openstack-infra08:27
*** tkammer has quit IRC08:31
lifelessI want to stab python 2's confused unicode handling so badly08:37
lifelessstabbity stabbity stab stab stab08:37
fifieldt+108:44
*** sarob has joined #openstack-infra08:51
*** rakhmerov has joined #openstack-infra08:55
*** sarob has quit IRC08:55
*** rakhmerov has quit IRC08:56
*** dkliban has joined #openstack-infra09:09
*** rakhmerov has joined #openstack-infra09:40
*** rakhmerov has quit IRC09:45
lifelessand yay, Python3 compat fixed for crcache.09:48
*** marun has joined #openstack-infra09:51
*** sarob has joined #openstack-infra09:52
*** sarob has quit IRC10:00
*** rakhmerov has joined #openstack-infra10:10
*** ericw has joined #openstack-infra10:18
*** Bada has joined #openstack-infra10:22
*** ericw has quit IRC10:23
*** Bada has quit IRC10:38
*** rakhmerov has quit IRC10:44
*** marun_ has joined #openstack-infra11:08
*** alexpilotti has joined #openstack-infra11:09
*** marun has quit IRC11:10
*** marun_ is now known as marun11:10
*** fbo_away is now known as fbo11:15
*** boris-42 has joined #openstack-infra11:15
*** rakhmerov has joined #openstack-infra11:40
*** rakhmerov has quit IRC11:44
marunlifeless: ping11:49
*** rakhmerov has joined #openstack-infra11:56
*** sarob has joined #openstack-infra11:57
*** rakhmerov has quit IRC12:00
*** sarob has quit IRC12:01
*** michchap_ has joined #openstack-infra12:06
*** michchap has quit IRC12:06
*** fifieldt has quit IRC12:09
*** annegentle_ has quit IRC12:23
openstackgerritA change was merged to openstack-infra/os-loganalyze: add tempest log to the list of level supporting logs  https://review.openstack.org/5343912:53
*** rakhmerov has joined #openstack-infra12:57
*** davidhadas_ has joined #openstack-infra13:16
*** davidhadas has quit IRC13:17
*** sarob has joined #openstack-infra13:28
*** rakhmerov has quit IRC13:31
*** sarob has quit IRC13:32
*** ericw has joined #openstack-infra14:13
*** dims has joined #openstack-infra14:16
*** rakhmerov has joined #openstack-infra14:25
*** sarob has joined #openstack-infra14:28
*** sarob has quit IRC14:32
*** sarob has joined #openstack-infra14:39
*** anteaya has joined #openstack-infra15:00
*** tkammer_ has quit IRC15:28
*** tkammer has joined #openstack-infra15:28
*** tkammer has quit IRC15:31
*** Bada has joined #openstack-infra15:33
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Create a seafile instance.  https://review.openstack.org/5403015:41
anteayadon't bother looking yet, still much to do15:42
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Create a seafile instance.  https://review.openstack.org/5403015:54
*** changbl has quit IRC15:55
*** fbo is now known as fbo_away15:56
*** marun has quit IRC15:56
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Create a seafile instance.  https://review.openstack.org/5403015:58
*** Steap_ is now known as Steap16:00
*** Bada has quit IRC16:01
*** ericw has quit IRC16:24
*** oubiwann has joined #openstack-infra16:27
*** tkammer has joined #openstack-infra16:39
*** tkammer_ has joined #openstack-infra16:41
*** dims has quit IRC16:42
*** tkammer has quit IRC16:44
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Create a seafile instance.  https://review.openstack.org/5403016:49
*** fbo_away is now known as fbo16:51
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Create a seafile instance.  https://review.openstack.org/5403016:53
*** dkliban has quit IRC16:54
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Create a seafile instance.  https://review.openstack.org/5403017:03
*** SergeyLukjanov has joined #openstack-infra17:08
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Create a seafile instance.  https://review.openstack.org/5403017:08
anteayaif any bored, kind soul feels like giving 54030 a pass for syntax and suggestions on what the root directory of this app should be, I'm grateful17:10
* anteaya goes for a walk in the sunshine17:10
*** SergeyLukjanov has quit IRC17:13
*** SergeyLukjanov_ has joined #openstack-infra17:13
*** SergeyLukjanov_ has quit IRC17:24
*** Bada has joined #openstack-infra17:26
*** SergeyLukjanov has joined #openstack-infra17:31
*** SergeyLukjanov is now known as _SergeyLukjanov17:35
*** _SergeyLukjanov has quit IRC17:36
*** tkammer_ has quit IRC17:36
*** SergeyLukjanov has joined #openstack-infra17:49
*** dcramer_ has joined #openstack-infra17:50
*** pabelanger has quit IRC17:50
*** reed has joined #openstack-infra17:58
*** rakhmerov has quit IRC17:59
*** pabelanger has joined #openstack-infra18:03
*** che-arne has quit IRC18:06
pleia2anteaya: my review isn't exceptionally thorough, but I'll be able to see more clearly once the things I noted are looked at :)18:19
mordredanteaya: I also recommend potentially getting youreslf set up to be able to run the puppet code on a cloud server18:21
mordredanteaya: that way you can test locally and ensure it's doing what you think it should do18:21
mordredthe time spent to grok how that works is probably well worth it in the long run18:21
pleia2++18:21
pleia2during the sprint in NYC we fixed up http://ci.openstack.org/sysadmin.html#making-a-change-in-puppet so it should be accurate for testing changes on a cloud server18:22
clarkbI really like that the summit sessions don't seem to be nova day one, neutron day two, all other projects day three then QA/process/infra day four18:22
*** rakhmerov has joined #openstack-infra18:23
pleia2clarkb: yeah18:23
sdagueclarkb: yeh, though still with so many tracks, it's going to be tough.18:23
sdagueat least ttx didn't overlap qa and infra this time :) that was kind of rough18:24
lifelesso/18:24
*** SergeyLukjanov has quit IRC18:25
*** dkliban has joined #openstack-infra18:27
mordredclarkb: ++18:28
sdagueI'm assuming we'll talk more more generic logstash/elasticsearch things in the elastic-recheck session. Been doing experiments to figure out the limits of what we can get out of it for those discussions.18:29
*** che-arne has joined #openstack-infra18:30
clarkbsdague: ++ I am really excited to hear feedback from the query side. I feel like I spend so much time making it go that I haven't had a chance to play with the query API18:30
clarkbI think nodepool is having a hard time spinning up rackspace nodes for that d-g change. We should allow the d-g jobs to run on hpcloud too and look at nodepool logs18:31
clarkbfungi: ^18:31
sdagueyeh, there are some really neat things you can get out of it per - http://dague.net/2013/10/27/openstack-ci-by-the-numbers/ - at the same time I'm completely unable to get other answers out of it that I'd like (I think basically because there is no server side reduce opperation)18:32
* mordred is very happy that there is a session on CI/CD Automation for TripleO the same slot as the Updates to hacking oslo session he's running18:32
sdagueheh18:32
sdagueyeh, I noticed that this morning18:32
sdaguethe summit schedule looked so nice on thursday18:33
sdaguewhen only 1/4 of talks were out there18:33
dhellmannmordred: I might be able to juggle that hacking session. I was trying to schedule you around the infra slots that conflict with oslo18:33
clarkbsdague: woah! that set of numbers is neat18:33
mordreddhellmann: it's ok - clark and jim can probably handle the TripleO CI/CD session18:34
clarkbhalf a million qemu guests (I think they aren't technically kvm)18:34
mordredI know which bits of hacking jeblair hates already18:34
dhellmannmordred: ok18:34
sdagueclarkb: bah, sure :)18:34
clarkbsdague: I prefer graphite for collecting metrics like that, but elasticsearch is handy because you don't ahve to preconfigure the thing you need numbers on18:35
clarkbmuch more flexibility18:35
sdaguehonestly, graphite still makes no sense to me. Maybe I need to sit down with you at some point to figure it out.18:36
mordredsdague: ++18:37
mordredsdague: when I want a graphite graph, I just mention it offhand and hope that clarkb or jeblair will make it for me18:37
lifelessmordred: btw today is a public holiday here18:37
mordredlifeless: ossum18:37
lifelessmordred: if I had not mentioned it18:37
clarkbsdague: mordred: I find myself going to the graphs in zuul, copying their urls and working from there. If you open in firefox you get all of the special characters in ascii rather than escape codes which makes it much easier18:38
sdagueclarkb: yeh, what I find, I think, is I've got pretty strong data model / query notions in my head from years of sql. And spent a lot of time with matplotlib in the last year. And graphite's ideas of both series and data query are different enough I'm just always with a square peg and round hole.18:42
*** rakhmerov has quit IRC18:53
*** rakhmerov has joined #openstack-infra18:54
*** dkliban has quit IRC18:55
mordreddhellmann: actually, could you swap the tuesday python-openstackclient session with the hacking session?18:57
dhellmannmordred: let me look18:57
mordredI have no sessions I need to go to that chunk18:57
dhellmannyeah, I can do that18:58
*** rakhmerov has quit IRC18:58
dhellmannmordred: done, but it may take a little bit before sched reflects the changes19:00
*** Bada has quit IRC19:00
mordreddhellmann: thanks!19:02
mordredsdague, jgriffith: there is a cinder talk on rolling upgrades and a QA talk on rolling upgrades at the exact same time19:02
mordredsdague, jgriffith: they may be tlaking about different things, but it's possible that they might be related :)19:03
sdagueheh, nice19:03
* dhellmann pictures the next summit being a month-long retreat to allow for all sessions to be in a single track19:03
*** fbo is now known as fbo_away19:03
sdagueso they are, the QA session is about nova in gate testing for this19:03
sdagueat least upgrade is getting plenty of attention at this summit19:06
*** fbo_away is now known as fbo19:07
clarkbif the d-g change is still stuck tomorrow, I think a ninja fix for it may be to add the label it wants to some unused hpcloud instances19:07
clarkbjust trick into running the tests there19:08
mordredsdague:, dhellmann: yeah - I still think we're missing the big-picture track19:09
mordredfor things like "hey, all the cores and all the ptls, let's talk for a few minutes all in the same place about rolling upgrades/CD"19:09
sdaguemordred: how can you have a big picture track, competing against *6* project tracks19:09
mordredsdague: that's just the thing - I think we can't19:09
mordredbut - I think we're getting bit enough that we really need one19:10
clarkbI think you need a big picture track19:10
mordredyou need one that's exclusive19:10
clarkbthat doesn't conflcit with anything else19:10
clarkbright19:10
mordred++19:10
mordrednot many sessions, because the cost of each big-picture session is pretty high19:10
mordredor - maybe we just need to get better about pre-coordinating some of those topics at the TC level19:10
sdagueyeh, that might be another option19:11
mordredand then getting the individual projects to work on how to accomplish the stuff the tc/ptls work out should be overall project direction19:11
mordredso we can say things lke "yup. rolling upgrades/continuous deploying is important" - so that each project doesn't have to decide the if19:11
mordredI dunno19:12
mordredit's hard19:12
mordredI don't want to centralize things or anything19:12
clarkbI think most people seem to agree on the if. Sorting out how is hard19:12
sdaguehonestly, a lot of these things also can just go to the list. That's why I didn't bother trying to do the log harmonization thing as a summit thing, because you just needed more people in the thread19:12
mordredmy friday schedule isn't silly!19:12
mordredsdague: ++19:12
mordredclarkb: yah19:12
mordredthere's actually two contiguous sessions on friday that do not require my attention!19:13
sdaguemordred: only 1/2 the schedule is up19:13
*** reed has quit IRC19:13
mordredsdague: oh dear god. you're kidding19:13
sdaguewe have 6 tracks19:13
mordredand here I was getting excited19:13
clarkbspeaking of upgrade testing. what if grenade started on a VM that already had a cloud running at the base version?19:13
sdagueI see only 4 blocks max in each session19:13
clarkbsdague: in theory we could have nodepool build those VMs for us then we only need to worry about upgrade and test in grenade and not setup tests upgrade test19:14
sdagueclarkb: it would have running services by the time we start?19:14
sdagueis there an advantage on nodepool doing that vs. grenade?19:15
clarkbsdague: yes have everything going on the node by the time zuul runs a test on it. Advantage would be simplifying logic in grenade possibly. Grenade doesn't need to know how to set up the various base clouds instead it would just know how to upgrade from them19:16
sdagueclarkb: remember, and important piece of grenade is the javelin piece, which creates a sample project and resources, so it's not an empty environment that we upgrade19:16
*** rcleere has joined #openstack-infra19:16
sdagueI guess, it would completely tie grenade to the zuul env though. it is kind of nice to be able to just run it19:16
clarkbsdague: right that could happen at the beginning (it is just an idea that occurred to me as it seems grenade spends a lot of time dealing with "known" good)19:16
clarkbsdague: good point19:17
*** ericw has joined #openstack-infra19:17
mordredsdague: well, if grenade had phases19:18
mordredthen we could just have the nodepool piece run phase 1, the gate run phase 219:18
mordredand a local run could run both19:18
sdagueI'm not sure we'd save a lot of grenade code doing that, it's all devstack lib calls. But it would be worth chatting about maybe. dansmith had some other thoughts about grenade upgrade scripts being extracted.19:18
* mordred waves hands19:18
clarkbsdague: grenade is very induction like, and I was thinking that we should treat the base version as "true"19:18
clarkbrather than going through the steps to build and test it19:18
mordredyeah. since we tested the base version elsewhere already19:18
sdagueclarkb: sure, I just wonder if we'd find how sensitive things are to initial conditions19:18
sdaguemordred: with what config... :)19:19
lifelessactually, I should ask here19:19
lifelesswhats grokmirror ?19:19
lifelesshow is it different to mr? or config-manager, if that supported git?19:19
sdagueanyway, I'm being called off to yard tasks, back in a bit19:19
*** Bada has joined #openstack-infra19:19
mordredsdague: nod19:19
mordredlifeless: grokmirror is a thign that linux kernel folks wrote19:20
mordredyou run it on your git servers - so git.openstack.org -19:20
mordredand then you can use the grokmirror client to mirror in the set of repos19:20
mordredhttps://www.linux.com/news/featured-blogs/203-konstantin-ryabitsev/720132-set-up-your-own-git-mirror-with-new-grokmirror-tool19:20
mordredhttps://github.com/mricon/grokmirror19:20
mordredlifeless: what are mr and config-manager ?19:21
lifelessmordred: apt-cache show $119:22
lifelessthanks, I see the difference w.r.t. grokmirror19:22
mordredwoot!19:23
mordredah. mr looks pretty cool19:23
fungisdague: mordred: i think pre-setup for the starting point of grenade may not be viable 100% of the time... since we should also use grenade to test that proposed stable branch patches are still creating an environment which can be upgraded to the next stable branch or (if most recent stable branch) tip of master19:27
mordredfungi: that's an excellent point19:28
lifelessmordred: config-manager predates mr by oh 6 or more years19:29
clarkbso in theory induction still works in that case19:29
clarkbmordred: fungi: you still assume the truth of the base19:29
lifelessmordred: but I haven't maintained it in nearly that long :- I haven't added git support19:29
mordredclarkb: not if your change is a change to base19:29
clarkbmordred: in maths you would, but this isn't maths19:29
fungiclarkb: well, agreed. induction of the base is fine since we have separate tests confirming that anyway19:29
mordredclarkb: forward grenade tests test new change to base against assumed already good next version19:30
mordredclarkb: so, a change to stable/havana gets tested for its upgradabiliy to trunk19:30
mordredin that case, you cannot assume base is good at the time you're running the test19:30
clarkbmordred: right, and if grenade runs and says trunk didn't break you have still done induction19:30
clarkbmordred: you can, as you use N+1 to see if it falls apart19:30
clarkbthe problem here is that might not be reliable enough for our case19:31
mordredyah. ok. off to the airport19:31
mordredbecause, you know, that's what I do19:31
clarkbmordred: you should come to seattle some time and see the new office19:31
mordredclarkb: yah19:32
*** Bada has quit IRC19:33
anteayapleia2: thanks19:34
anteayamordred: I can work on that, I don't think I can do that before summit though19:35
anteayaand my belief I am holding is that you want this available for the board by summit19:35
anteayacorrect me if I am in error19:35
* anteaya makes some food and continues to read the backscroll19:35
mordredI do - BUT - I think being able to run a puppet command locally will let you iterate and grok more quickly19:36
mordredanteaya: I could be wrong - but I have a hunch that if you can cycle on "oh, this change causes that result" and see it happening, the puppet crazy will click sooner19:36
anteayaokay, i can head in that direction19:37
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Run devstack-gate stable jobs on all providers  https://review.openstack.org/5403319:37
fungiclarkb: ^19:37
anteayaI have no estimate if the puppet crazy will click before summit though19:37
anteayabut here is hoping19:37
mordredanteaya: well, it'll be easier now that you have a cloud account19:40
mordredwhereas before, you know, you did not so much have one of those19:40
anteayathat is true19:40
anteayaall hail the cloud account19:40
*** rcleere has quit IRC19:40
clarkbfungi: +2 from me. probably safe to approve that when you have time19:41
lifelessanteaya: as a recent learner of puppet crazy19:41
fungiclarkb: doing and monitoring19:41
* anteaya goes to watch toaster so the second piece doesn't set off the fire alarm19:41
lifelessanteaya: bringing up a full clone of openstack-infra and learning by doing was fairly essential19:41
lifelessanteaya: there's lots of deeply coupled stuff in puppet19:41
lifelessanteaya: like where things are found, that it takes a while to internalise19:42
anteayayes19:42
anteayaso given this is Sunday19:42
lifelessmeh, you ancients19:42
lifelessMonday, it's Monday19:42
anteayaand I need Thursday for errands like laundry and banking19:42
anteayaand Friday for travel19:42
anteayaI have 3.5 days to be effective19:43
anteayathe goal I had been shooting for was make mordred happy19:43
openstackgerritA change was merged to openstack-infra/config: Run devstack-gate stable jobs on all providers  https://review.openstack.org/5403319:43
lifelessoh well that goal is easy19:43
lifelessmordred: your next drink is on anteaya :)19:43
lifelesstada.19:43
anteayabut I can realign and do the clone of -infra19:43
anteayaha ha ha19:43
anteayaokay whew19:43
lifelessanteaya: oh! seriously, I wasn't saying do the clone of -infra thing, just do the local puppet recipe in a cloud server.19:44
lifelessanteaya: thats what pleia2 pointed you at19:44
anteayaoh okay19:44
anteayalet me eat and then try again19:44
fungiclarkb: sdague: maurosr: i'm going to cancel the pending stable checks running for https://review.openstack.org/53940 and then recheck in about 10 minutes so it'll run on available nodes19:44
fungioh, wait, i can't cancel those via jenkins since they're not running19:45
fungimaybe once gearman reports the difference to zuul they'll pick up automagically?19:45
fungiguess we'll know here shortly19:46
fungiyep--they're running already. magic!19:48
*** mestery has joined #openstack-infra19:54
*** rakhmerov has joined #openstack-infra19:54
*** ericw has quit IRC19:55
openstackgerritlifeless proposed a change to openstack-dev/pbr: Move base test case logic out of __init__.py  https://review.openstack.org/4886020:04
*** marun has joined #openstack-infra20:05
lifelessfungi: IIRC you're organising a keysigning in HK ?20:07
lifelessfungi: a) when [please don't say 'evening'] and b) have you announced it on d-d ?20:07
fungilifeless: no, what i said was we want to organize an official ksp at the j summit20:08
lifelessfungi: oh20:08
lifelessfungi: cause I have this shiny new 4K key20:08
lifelessfungi: and I wants sigs :>20:08
fungilifeless: i'll have my passport and cards with my key fingerprint on it. still (at this very moment in fact) drafting up the beginnings of recommendations for our community (drawing mostly from an amalgam of ubuntu/debian/suse/et al)20:10
lifelessfungi: cool20:10
lifelessfungi: I will get you and zigo_ and thats enough to have it in the web of trust to make it official in Debian20:11
fungiwant something more succinct that a laundry lists of links to other communities recommendations, for obvious reasons20:11
*** reed has joined #openstack-infra20:11
fungiwow, that was some horrible typing on my part20:11
fungisomething more succinct THAN a laundry list of linke20:11
fungilinks20:11
* fungi gives up typing20:11
fungihoping i'll have a message to the -dev ml this evening (my time) with a link to the initial wiki article20:12
fungiin hk i'm primarily focused on getting strong signatures between all the core members of the release cycle management program, but will encourage ad hoc signing between anyone who wants to do so20:13
lifelessif you have a small ksp for that group, count me in20:14
fungiand then at the j summit, the goal is to hopefully get string wot ties between the rcm cores and anyone signing official things (announcements, tarballs, whatev)20:15
fungiyou bet20:15
lifelessI was thoroughly in the scc some years back :)20:15
fungier, strong wot... i seriously need to get used to this new keyboard20:15
lifelessfungi: wearable?20:17
fungilifeless: not going to try to get my wearable gear through customs into hk. i'll have it (or its successor) with me at the next one in the usa20:18
lifelessfungi: I mean what you're using now?20:19
anteayamordred: keep in mind that seafile configuration generates two secret key/ids which I have no idea how to do20:19
fungioh, a ducky channel mechanical at my standing desk. cherry mx blue switches with #50 cushions on the stems to reduce travel and noise20:19
anteayafungi had said on Friday that we would feed them in via hiera or something and I don't know how to do that20:20
lifelessanteaya: hiera is a k:v store within puppet, stored on the puppet master and queryable by puppet rules20:20
anteayaright20:21
fungianteaya: you make them variables in the template for that file and then we fill those variables in the global site.pp file20:21
anteayahow20:21
anteayahow do we get the right values?20:21
anteayaI don't know how to do that20:21
lifelessanteaya: thats done by hand following the seafiles installation instructions20:21
fungianteaya: you could install it and then tell us what initial values it put in the files if the means by which it generates them is so opaque that we can't figure it out straight away20:22
lifelessanteaya: and then copied into hiera20:22
anteayathe _entire_ reason I am doing this with seafile and not using owncloud is to avoid doing anything by hand20:22
anteayaif I am allowed to do anything by hand, I vote owncloud, it is way simplier20:22
anteayafor user and for me20:22
fungianteaya: we want it to be repeatable without doing anything by hand, but presumably something gets installed by hand once on a dev system to reverse-engineer the configuration and stiff20:23
fungistuff20:23
lifelessanteaya: these secrets, are they per-user, or per-install ?20:23
anteayalifeless per install20:23
lifelessanteaya: ok, so putting secrets into hiera doesn't count as 'by hand' the same way 'apt-get install' or other actions do.20:23
lifelessanteaya: strange but true20:24
fungifrom earlier discussions, it's sounded like both owncloud and seafile generate initial admin accounts when the first user connects to the webui and store the initial creds in files as a one-way hash20:24
anteayabut the only way I know of to get the values to stick into hiera is to execute the install script20:24
anteayafungi: mostly correct20:24
anteayathat is true for owncloud20:25
anteayafor seafile the user runs an interactive script on the server20:25
lifelessanteaya: ok so you would do the generation somewhere secure, copy the files and gpg encrypt them to e.g. fungi, and he can decrypt and put in hiera20:25
fungianteaya: but if you execute the install script on a dev system once and figure those values out, then we can put them in puppet so subsequent installations just get configuration applied by puppet20:25
fungiright, what lifeless said20:25
anteayagreat20:25
anteayaso for seafile installation, I can assume that I can ssh to the server and run the generation script?20:26
fungithe trick comes when we want to change what those values are in the future, which involves either changing them through the application in question and copying the results or reverse-engineering the code which stores those values so we can perform the same transformations on our own20:27
*** rakhmerov has quit IRC20:27
anteayafungi yes, but do we expect that we need to change the RSA key for that server to use seafile20:28
anteayaor the uuid for one of the databases20:28
fungianteaya: ssh into your dev system, run the installation script, copy off the configuration files that generates and put them in puppet. files with sensitive data in them, turn into templates, replace the sensitive bits with variable substitutions (which we'll replace through hiera) and tell us what they were20:28
anteayasince I can put the other stuff in the puppet templates20:28
anteayaokay20:28
lifelessanteaya: if the secrets are meant to be unique per installation20:29
lifelessanteaya: then the other option is to just encode running the setup script on each server as it's brought up20:29
fungiif we need to replace keys or passwords later, we can work out a pragmatic means of creating new ones (either through the application or by reverse-engineering as i mentioned)20:29
lifelessanteaya: one would do that if each server (even serving the same hostname) should have unique creds20:30
anteayalifeless: I would love to do that, any examples of how I can encode running the setup script?20:30
fungirunning an interactive setup script through stdin redirection or expect-like automation tends to be a bit fragile, so if we can just use/template the configs directly that would be preferable20:30
anteayaokay20:31
anteayacan I get some direction on what the root directory of the app should be?20:31
lifelessanteaya: there are plenty, but we'd need to see if this situation qualifies20:31
anteayathe manual has it in home/user20:31
anteayaless than ideal by my estimation20:31
anteayalifeless: okay thanks20:32
fungianteaya: probably something in /srv like maybe /srv/seafile or /srv/owncloud if it's going to contain a lot of data. putting it under /usr/local is maybe better if it's mostly executables/libs and not really data. /opt is also a potential but, meh, feels like the 90s called and they want their mountpoint back20:33
anteayaha ha ha20:34
*** marun has quit IRC20:34
anteayame thinks it will run heavier to data than executables20:34
anteayainto /srv/seafile it goes20:34
fungithat sounds good. we do most of our web content on other servers in /srv similarly20:35
anteayak20:36
anteayanow for my vm I need to set up dbs using mysql, but I know we are going to use trove so I won't puppet the creation of the dbs20:36
anteayait asks for a db user, db pass, dp ip and db name20:37
anteayaso that tells me we can use trove, correct?20:37
fungiyep20:37
*** UtahDave has joined #openstack-infra20:37
anteayagreat20:37
fungiuse a local mysql service to mock that for now, and then we'll change it in the config to use hiera variables which we'll fill with the trove connection/auth details20:38
fungiso on your dev system it's probably 127.0.0.1 or localhost for the db ip, but we'll change that in production to use the trove instance dns name instead20:38
fungiand we'll similarly generate db auth credentials which we'll set in trove and in hiera20:39
*** markmcclain has joined #openstack-infra20:40
*** dcramer_ has quit IRC20:40
*** markwash has joined #openstack-infra20:43
*** dims has joined #openstack-infra20:44
*** senk has joined #openstack-infra20:45
anteayaokay20:51
*** chuck_ is now known as zul20:52
*** markmcclain has quit IRC20:53
*** Bada has joined #openstack-infra20:53
sdagueclarkb: yeh, so I think summarize was a missing piece of my understanding of graphite21:05
sdaguethat being said, having to define the counters in advance, and having to do everything via url edit, makes me kind of sad21:05
*** ArxCruz has joined #openstack-infra21:06
sdaguehttp://graphite.openstack.org/graphlot/?from=00:00_20130701&until=23:59_20131027&target=summarize(sumSeries(stats_counts.zuul.pipeline.check.all_jobs),%20'1d') - is that just because the meter is new? or do we only keep a couple months of data in graphite?21:07
anteayamordred: you want a modules/seafile/manifests/site.pp file, as well as or instead of manifests/site.pp?21:08
clarkbsdague: I think it is new, before then we didn't distinguish on pipeline maybe21:09
clarkbsdague: these are the sorts of things that graphite isn't great at, its much more rigid21:10
sdagueyeh21:10
clarkbanteaya: you should only have a modules/seafile/manifests/site.pp if you need it21:10
sdagueit would be nice if there were gerrit counters for official programs, incubated, and stackforge21:10
clarkbmanifests/site.pp is where we will configure host(s) to use seafile21:10
*** nati_ueno has joined #openstack-infra21:11
anteayaokay, mordred wants me to have that21:11
anteayaso I will nuke what I have in manifests/site.pp at the moment21:11
clarkbanteaya: you need to edit manifests/site.pp for sure21:11
anteayaI do21:11
clarkbyes that is the file where you tell puppet what to do with individual nodes that call home21:11
anteayaso I need both then21:11
sdaguehttp://graphite.openstack.org/graphlot/?from=00:00_20130401&until=23:59_20131027&target=summarize(sumSeries(stats_counts.gerrit.event.change-merged),%20'1d') is cool (total merges per day)21:11
clarkbanteaya: maybe, depends on what you need modules/seafile/manifests/site.pp for :)21:12
anteayato edit manifests/site.pp and to create modules/seafile/manifests/site.pp21:12
sdaguebut hard to slice it21:12
anteayaclarkb: yeah, I think mordred wants me to have the same info in it that I current have in manifests/site.pp21:12
clarkbah21:12
anteayabut I am unsure why21:13
anteayaI'll do both for now21:13
anteayadeleting is easy21:13
clarkbanteaya: your changes to manifests/site.pp look fine to me21:13
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Create a seafile instance.  https://review.openstack.org/5403021:13
anteayaclarkb: thanks21:14
anteaya:D21:14
clarkbanteaya: the contents of modules/seafile/manifests/site.pp don't do anything though21:14
clarkbanteaya: the reason mordred wants a modules/seafile/manifests/site.pp is probably due to https://review.openstack.org/#/c/54030/8/modules/openstack_project/manifests/seafile.pp line 3121:15
clarkbthat line attempts to include a thing that would be in modules/seafile/manifests/site.pp21:15
anteayaoh21:15
anteayaI just copied what I saw from other modules21:16
anteaya19 different variables for this configuration21:16
clarkbanteaya: right, some modules use modules/thing/manifests/site.pp to do site specific configuration and modules/thing/manifests/init.pp to do installation21:16
anteayaI am brewing a talk on creating auto configurable apps21:17
anteayaokay21:17
clarkbI don't think you can auto config everything in all but the most trivial cases, but people writing software do need to stop pretending that anyone wants to isntall and configure their software by hand21:17
sdagueclarkb: so where did we move devstack launches to in graphite?21:18
sdaguehttp://graphite.openstack.org/graphlot/?width=586&height=308&_salt=1382908610.338&from=00%3A00_20130401&until=23%3A59_20131027&lineMode=staircase&connectedLimit=&areaMode=first&drawNullAsZero=true&minXStep=&xFormat=%25m%2F%25d&target=summarize(sumSeries(stats_counts.devstack.launch.*)%2C%20'1d')&target=summarize(sumSeries(stats_counts.devstack.job.*.builds)%2C%20'1d')&target=summarize(sumSeries(stats_counts.zuul.job.*devstack*)%2C%20'1d')21:18
sdagueall of those end suspiciously around the same time21:18
clarkbsdague: this is why I start with zuul's graphs, let me look21:18
clarkbstats_counts.zuul.pipeline.*.all_jobs is what zuul summarizes, I think it is in that *21:19
clarkber no21:19
clarkbit should be something like stats_counts.zuul.pipeline.*.*-tempest-devstack-*21:19
clarkbhmm no data21:20
sdagueyeh, I actually want *devstack* to get the largeops and swift jobs21:21
clarkbsdague: stats_counts.zuul.pipeline.*.job.*-tempest-devstack-*.*21:21
*** senk has quit IRC21:22
clarkbfirst splat is for the various queues, second splat is for gate/check third splat for the variations on devstack deployments and last splat is for job result, failure/success/abort21:22
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Create a seafile instance.  https://review.openstack.org/5403021:23
*** senk has joined #openstack-infra21:23
sdagueok, it seems to be "thinking"21:23
*** rakhmerov has joined #openstack-infra21:24
*** DennyZhang has joined #openstack-infra21:26
sdagueany idea if there is an easy way to do series division?21:27
fungisdague: as far as official/incubated/other categories, we also need somewhere to track which programs are in what state and what projects they contain. that's hopefully going to live in a registry within openstack/governance which should hopefully make it a little easier to start auto-categorizing project-specific data along those lines once there is a single source of truth for it21:28
clarkbsdague: http://graphite.readthedocs.org/en/1.0/functions.html#graphite.render.functions.divideSeries ?21:28
fungiright now we have several places where we guess at the state of various projects, which has a tendency to diverge and go stale21:29
fungiso (i think at least subconsciously) we're avoiding making more of those places21:29
fungiclarkb: looking at the test nodes graph, do you get the feeling that we're accumulating cruft/ghost nodes in a deleting state?21:30
clarkbfungi: yes, for rax I think21:31
fungigrr21:31
clarkbfungi: I don't think nodepool is able to successfully bring them up so they go into the delete pool and we just spin there21:31
fungioh, that makes slightly more sense at least. i wonder what happened with the rax images21:31
clarkbeither boot timeouts or the image is bad21:32
fungihopefully i'll have a moment to start looking once i wrap up my cleaning frenzy here21:33
fungi(a tidy laboratory is an efficient laboratory!)21:33
sdagueok, that seemed to work - http://graphite.openstack.org/graphlot/?from=00:00_20130728&until=23:59_20131027&target=divideSeries(summarize(sumSeries(stats_counts.zuul.pipeline.gate.job.*devstack*.FAILURE),%20'1d'),%20summarize(sumSeries(stats_counts.zuul.pipeline.gate.job.*devstack*.*),%20'1d'))21:36
sdaguethat's the devstack fail percentage in the gate21:36
sdaguethough from a user point of view, the zuul reset rate might be more interesting. Guess we need counters on that.21:37
*** juice has quit IRC21:39
*** juice has joined #openstack-infra21:39
fungithat's something we might be able to infer based on the pipeline (as least as an upper bound) but definitely need to hear it explicitly from zuul for any real accuracy21:39
clarkbany failure in the gate pipeline is a reset21:41
clarkbwith a * next to that saying its one per change21:41
clarkbwhich I don't think graphite captures21:41
fungiand a ** next to it reminding you that there are multiple shared queues in the gate pipeline, so which one are you tracking21:43
*** senk has quit IRC21:44
*** rakhmerov has quit IRC21:57
sdagueis there a way to get graphite to dump the data sets out in json or something for local graphing?21:58
clarkbsdague: there is21:59
clarkbsdague: &format=json21:59
sdaguecool22:01
sdagueman, their date format is crazy pants HH:MM_yyyymmdd22:04
sdagueso I take it the "login" in graphite to save graphs on our instance is a myth?22:05
*** dcramer_ has joined #openstack-infra22:08
*** DennyZha` has joined #openstack-infra22:09
*** DennyZhang has quit IRC22:12
clarkbsdague: I think you might be able to save them somehow, but jeblair has deleted that data in the past22:13
sdagueheh22:15
mordredfungi: I can has +2/+A here https://review.openstack.org/#/c/52776/ ?22:20
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Create a seafile instance.  https://review.openstack.org/5403022:22
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Create a seafile instance.  https://review.openstack.org/5403022:25
openstackgerritA change was merged to openstack-infra/gerritlib: Remove use of d2to1  https://review.openstack.org/5277622:26
fungimordred: is gerritlib getting added to the projects list in openstack/requirements?22:26
fungi(so as to receive future magic requirements update patches?22:26
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Gate current clients on stable branches  https://review.openstack.org/4193122:31
mordredfungi: I do not believe that would be appropriate, as it is not required to only use those moving forward22:32
fungimordred: oops--in that case the comment line you added to gerritlib's setup.py in 52776 was wrong22:35
mordredfungi: nod. there you go22:37
openstackgerritMonty Taylor proposed a change to openstack-infra/gerritlib: Remove erroneous comment  https://review.openstack.org/5403722:37
*** Bada has quit IRC22:38
openstackgerritA change was merged to openstack-infra/gerritlib: Remove erroneous comment  https://review.openstack.org/5403722:38
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Use pip install instead of setup.py install  https://review.openstack.org/5100422:39
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Create a seafile instance.  https://review.openstack.org/5403022:46
*** fbo is now known as fbo_away22:50
*** rakhmerov has joined #openstack-infra22:54
anteayapleia2: do you know where is an example in the puppet files of downloading and unpacking a tarball?22:56
openstackgerritA change was merged to openstack-dev/pbr: Prevent ordereddict installation on 2.7  https://review.openstack.org/5215222:58
*** rakhmerov has quit IRC22:59
anteayaI can find how to use git to clone a repo or set up a ppa22:59
anteayabut so far, no examples of downloading a tarball22:59
pleia2anteaya: grepping through the repo the only one I can find is drupal + modules/openstack_project/manifests/groups_dev.pp23:06
pleia2but it's not using puppet to do it, it's calling a script23:07
pleia2not sure how we actually use this23:07
*** senk has joined #openstack-infra23:09
anteayathanks pleia2, I'll take a look23:09
anteayathen probably going to pack it in for the night23:10
anteayaI haven't had the time to set up puppet on a vm and take this patch for a drive23:10
anteayaso review or not as you please23:11
*** saper has quit IRC23:19
*** blamar has quit IRC23:20
anteayayup, my brain is done23:23
anteayaI'll continue tomorrow23:23
anteayanight23:23
*** anteaya has quit IRC23:23
*** saper has joined #openstack-infra23:25
*** DennyZha` has quit IRC23:31
*** blamar has joined #openstack-infra23:32
*** michchap_ has quit IRC23:37
*** michchap has joined #openstack-infra23:39
*** oubiwann-lambda has quit IRC23:42
*** DennyZha` has joined #openstack-infra23:52
*** rakhmerov has joined #openstack-infra23:55
*** DennyZha` has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!