Monday, 2013-08-12

*** Ryan_Lane has quit IRC00:03
*** dina_belova has joined #openstack-infra00:04
*** dina_belova has quit IRC00:09
*** annegentle has quit IRC00:09
*** dkliban has quit IRC00:13
*** sarob has joined #openstack-infra00:21
*** sarob has quit IRC00:26
*** changbl has quit IRC00:40
*** changbl has joined #openstack-infra00:43
*** dkliban has joined #openstack-infra00:44
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Allow build info to be updated  https://review.openstack.org/4102000:47
*** changbl has quit IRC00:47
*** mriedem has quit IRC01:02
*** mberwanger has joined #openstack-infra01:02
*** dina_belova has joined #openstack-infra01:05
*** dina_belova has quit IRC01:10
*** erfanian has quit IRC01:12
*** erfanian has joined #openstack-infra01:16
*** changbl has joined #openstack-infra01:20
*** sarob has joined #openstack-infra01:22
*** sarob has quit IRC01:27
*** jhesketh has quit IRC01:30
*** dkliban has quit IRC01:39
*** jhesketh has joined #openstack-infra01:51
*** dina_belova has joined #openstack-infra02:05
*** dguitarbite has joined #openstack-infra02:07
*** dina_belova has quit IRC02:10
*** yaguang has joined #openstack-infra02:11
*** tian has joined #openstack-infra02:21
*** erfanian has quit IRC02:22
*** sarob has joined #openstack-infra02:22
*** sdake_ has quit IRC02:25
*** sdake_ has joined #openstack-infra02:25
*** sdake_ has quit IRC02:25
*** sdake_ has joined #openstack-infra02:25
*** dguitarbite has quit IRC02:26
*** sarob has quit IRC02:27
*** SergeyLukjanov has joined #openstack-infra02:34
*** cody-somerville_ has joined #openstack-infra02:36
*** cody-somerville has quit IRC02:37
*** erfanian has joined #openstack-infra02:38
jeblairclarkb, Alex_Gaynor: something went wrong there; I've pulled the jenkins logs i need to figure out what.  not sure if it's new plugin behavior -- it may be related to stopping/starting jenkins instead.02:41
jeblairclarkb, Alex_Gaynor: i canceled one of the jobs from jenkins' queue; that unstuck one of the changes; the other one will either need to be unstuck with a new patchset or a zuul restart.02:43
*** sgviking has quit IRC02:47
*** sgviking has joined #openstack-infra02:56
*** dina_belova has joined #openstack-infra03:06
jeblairrestarted zuul03:07
*** dina_belova has quit IRC03:10
*** cody-somerville_ is now known as cody-somerville03:19
*** annegentle has joined #openstack-infra03:20
*** SergeyLukjanov has quit IRC03:21
*** sarob has joined #openstack-infra03:23
*** sarob has quit IRC03:28
*** dkliban has joined #openstack-infra03:46
*** dkliban has quit IRC03:57
*** dkliban has joined #openstack-infra03:58
*** erfanian has quit IRC03:59
*** rcleere has joined #openstack-infra04:03
*** rcleere has quit IRC04:09
*** dguitarbite has joined #openstack-infra04:23
*** pcrews has joined #openstack-infra04:23
*** sarob has joined #openstack-infra04:24
*** sarob has quit IRC04:29
*** vogxn has joined #openstack-infra04:44
*** mberwanger has quit IRC04:51
*** boris-42 has joined #openstack-infra04:55
*** dina_belova has joined #openstack-infra05:09
*** dina_bel_ has joined #openstack-infra05:14
*** dina_belova has quit IRC05:14
*** dina_belova has joined #openstack-infra05:21
*** boris-42 has quit IRC05:23
*** dina_be__ has joined #openstack-infra05:23
*** dina_bel_ has quit IRC05:23
*** sarob has joined #openstack-infra05:24
*** boris-42 has joined #openstack-infra05:25
*** dina_belova has quit IRC05:27
*** SergeyLukjanov has joined #openstack-infra05:28
*** sarob has quit IRC05:29
*** SergeyLukjanov has quit IRC05:37
*** SergeyLukjanov has joined #openstack-infra05:42
*** nicedice_ has quit IRC05:46
*** nayward has joined #openstack-infra05:48
*** SergeyLukjanov has quit IRC06:05
*** dguitarbite has quit IRC06:22
*** dina_be__ has quit IRC06:23
*** sarob has joined #openstack-infra06:25
*** SergeyLukjanov has joined #openstack-infra06:27
*** dina_belova has joined #openstack-infra06:28
*** sarob has quit IRC06:29
*** SergeyLukjanov has quit IRC06:48
*** afazekas_ has joined #openstack-infra06:52
*** SergeyLukjanov has joined #openstack-infra06:56
*** SergeyLukjanov has quit IRC07:01
*** dina_belova has quit IRC07:05
*** vogxn has quit IRC07:06
*** odyssey4me has joined #openstack-infra07:06
*** dina_belova has joined #openstack-infra07:13
*** SergeyLukjanov has joined #openstack-infra07:20
*** sarob has joined #openstack-infra07:25
*** sarob has quit IRC07:31
*** SergeyLukjanov has quit IRC07:35
*** nayward_ has joined #openstack-infra07:36
*** nayward has quit IRC07:39
*** jpich has joined #openstack-infra07:39
*** koolhead11 has joined #openstack-infra07:42
*** Ryan_Lane has joined #openstack-infra07:44
*** xchu has joined #openstack-infra07:47
*** SpamapS has quit IRC07:48
*** dina_belova has quit IRC07:49
*** dina_belova has joined #openstack-infra07:49
*** derekh has joined #openstack-infra07:55
*** Mikhail has joined #openstack-infra07:56
*** Mikhail is now known as Guest7173007:56
*** fbo_away is now known as fbo07:58
openstackgerritKui Shi proposed a change to openstack-dev/hacking: H233 regex can not match some print operator  https://review.openstack.org/4135508:01
*** morganfainberg is now known as morganfainberg_a08:02
*** BobBall_AFK is now known as Bobba08:02
*** morganfainberg_a is now known as morganfainberg08:02
*** SpamapS has joined #openstack-infra08:10
*** SpamapS has quit IRC08:15
*** SpamapS has joined #openstack-infra08:19
openstackgerritMichael Basnight proposed a change to openstack-infra/reviewstats: Fixing minor misspelling  https://review.openstack.org/4135708:22
*** sarob has joined #openstack-infra08:26
*** sarob has quit IRC08:31
*** dina_belova has quit IRC08:32
*** dina_belova has joined #openstack-infra08:33
*** CliMz has joined #openstack-infra08:37
*** SergeyLukjanov has joined #openstack-infra08:44
*** vogxn has joined #openstack-infra08:46
*** SergeyLukjanov has quit IRC08:55
*** SergeyLukjanov has joined #openstack-infra08:55
*** ruhe has joined #openstack-infra09:08
*** Ryan_Lane has quit IRC09:08
EmilienMHi, could we have reviews from core on https://review.openstack.org/#/c/41128/ ? thank's :)09:11
*** SpamapS has quit IRC09:13
*** SpamapS has joined #openstack-infra09:19
*** SpamapS has quit IRC09:19
*** SpamapS has joined #openstack-infra09:19
*** markmc has joined #openstack-infra09:20
openstackgerritTom Fifield proposed a change to openstack-infra/config: Add build job for Japanese Operations Guide  https://review.openstack.org/3984609:21
*** nayward_ has quit IRC09:22
*** SpamapS has quit IRC09:24
*** ruhe has quit IRC09:24
*** sarob has joined #openstack-infra09:27
*** sarob has quit IRC09:31
*** SpamapS has joined #openstack-infra09:35
*** vogxn has quit IRC09:35
*** nayward has joined #openstack-infra09:36
*** dina_belova has quit IRC09:37
*** nayward has quit IRC09:40
*** SpamapS has quit IRC09:47
*** SpamapS has joined #openstack-infra09:48
*** ruhe has joined #openstack-infra09:49
*** psedlak has joined #openstack-infra09:56
*** dina_belova has joined #openstack-infra09:56
*** xchu has quit IRC10:02
*** afazekas has quit IRC10:07
*** afazekas_ is now known as afazekas10:07
*** ruhe has quit IRC10:09
*** vipul-away has quit IRC10:14
*** SergeyLukjanov has quit IRC10:16
*** ruhe has joined #openstack-infra10:18
*** SergeyLukjanov has joined #openstack-infra10:18
openstackgerritSergey Kolekonov proposed a change to openstack-infra/jenkins-job-builder: Existing plugins improvements  https://review.openstack.org/4137510:20
*** vipul has joined #openstack-infra10:23
*** vogxn has joined #openstack-infra10:24
*** pcm_ has joined #openstack-infra10:27
*** sarob has joined #openstack-infra10:27
*** sarob has quit IRC10:32
*** fbo is now known as fbo_away10:39
*** enikanorov-w has joined #openstack-infra10:45
*** enikanorov-w_ has quit IRC10:45
*** CliMz has quit IRC10:50
*** mjfork has joined #openstack-infra10:53
*** w_ is now known as olaph10:54
*** vogxn has quit IRC11:17
openstackgerritMark McLoughlin proposed a change to openstack/requirements: Allow use of oslo.messaging 1.2.0a1  https://review.openstack.org/4138111:17
*** SpamapS has quit IRC11:20
*** Ryan_Lane has joined #openstack-infra11:27
*** sarob has joined #openstack-infra11:28
*** sarob has quit IRC11:32
*** yaguang has quit IRC11:36
*** woodspa has joined #openstack-infra11:40
*** fbo_away is now known as fbo11:41
*** pabelanger_ has joined #openstack-infra11:42
*** lcestari has joined #openstack-infra11:46
*** pabelanger_ has quit IRC11:47
*** pabelanger_ has joined #openstack-infra11:47
*** pabelanger has quit IRC11:47
*** pabelanger_ is now known as pabelanger11:47
*** pabelanger_ has joined #openstack-infra11:48
*** pabelanger has quit IRC11:49
*** pabelanger has joined #openstack-infra11:49
*** weshay has joined #openstack-infra11:51
*** luis_ has quit IRC11:52
*** rscottcoyle has joined #openstack-infra12:01
sdaguedoes something else need to happen to get the status.html to flush?12:02
*** thomasm has joined #openstack-infra12:02
*** rfolco has joined #openstack-infra12:04
*** ArxCruz has joined #openstack-infra12:08
*** Ryan_Lane has quit IRC12:09
*** dprince has joined #openstack-infra12:16
*** pabelanger has quit IRC12:25
*** sandywalsh has quit IRC12:33
*** pabelanger has joined #openstack-infra12:35
*** dina_belova has quit IRC12:42
*** dina_belova has joined #openstack-infra12:44
*** beagles has joined #openstack-infra12:45
*** dina_belova has quit IRC12:45
*** sandywalsh has joined #openstack-infra12:46
pabelangermorning12:52
pabelangerSo, I see -infra no longer cherry-picks commits with gerrit: https://github.com/openstack-infra/config/commit/87bd7eb02655f66acb149fcb11a6ce4830a9d2d112:52
pabelangerwas curious if the plan was to try and move back to it or not?12:53
*** dkliban has quit IRC12:53
pabelangereg: This was a good test and we learned a lot by doing it, but I think what we learned is that using merges and sacrificing some clean git history avoids more problems than it causes.12:53
mordredpabelanger: no, I think we decided that we don't think the workflow headache is worth it - especially when thinking about how zuul does things12:54
mordredyes. what you siad12:54
mordred:)12:54
pabelangermordred: Ya, looked at the review notes, and clarkb said that in a review12:54
openstackgerritwill soula proposed a change to openstack-infra/jenkins-job-builder: Adding support for the Warnings plugin  https://review.openstack.org/4062112:57
*** sarob has joined #openstack-infra12:59
*** mriedem has joined #openstack-infra13:00
*** vogxn has joined #openstack-infra13:03
*** sarob has quit IRC13:03
*** ewindisch has joined #openstack-infra13:04
*** jaypipes has joined #openstack-infra13:05
openstackgerritwill soula proposed a change to openstack-infra/jenkins-job-builder: Adding support for the Warnings plugin  https://review.openstack.org/4062113:08
fungijust a heads up, i'm mostly awol for a good chunk of the day (christine threw her back out over the weekend, so i'm connecting by wireless modem from medical office lobbies when waiting around)13:09
mordredfungi: lovely. hope her back becomes less suck13:11
*** anteaya has joined #openstack-infra13:16
*** ewindisch has quit IRC13:17
mordredfungi: https://review.openstack.org/#/c/41199/1 and https://review.openstack.org/#/c/40856/2 should be easy to do in a doctor's office13:20
*** adalbas has quit IRC13:23
*** dhellmann is now known as dhellmann_13:24
*** dhellmann_ is now known as dhellmann13:24
*** mgagne has joined #openstack-infra13:26
mordredjog0: https://review.openstack.org/#/c/40686/ needs a rebase13:29
*** jpeeler has joined #openstack-infra13:36
*** adalbas has joined #openstack-infra13:39
*** cppcabrera has joined #openstack-infra13:39
*** jergerber has joined #openstack-infra13:39
*** cppcabrera has left #openstack-infra13:39
EmilienMmordred: Hi, any chance to review https://review.openstack.org/#/c/41128/ today ?13:42
*** ruhe has quit IRC13:45
mordredEmilienM: done13:46
EmilienMmordred: wow, fast. Thank's ;)13:46
openstackgerritA change was merged to openstack-infra/jeepyb: Update Launchpad projects for puppet modules  https://review.openstack.org/4112813:47
*** dkliban has joined #openstack-infra13:47
*** prad_ has joined #openstack-infra13:47
*** beagles has quit IRC13:48
*** beagles has joined #openstack-infra13:49
*** fifieldt has quit IRC13:50
*** vijendar has joined #openstack-infra13:55
*** ruhe has joined #openstack-infra13:58
*** sarob has joined #openstack-infra13:59
*** changbl has quit IRC14:01
*** dina_belova has joined #openstack-infra14:01
*** sdake has quit IRC14:01
*** sdake has joined #openstack-infra14:02
*** sdake has quit IRC14:02
*** sdake has joined #openstack-infra14:02
openstackgerritSergey Kolekonov proposed a change to openstack-infra/jenkins-job-builder: Existing plugins improvements  https://review.openstack.org/4137514:03
*** sarob has quit IRC14:04
openstackgerritA change was merged to openstack-infra/config: Add tuskar and tuskarclient to stackforge  https://review.openstack.org/4085614:04
openstackgerritRussell Bryant proposed a change to openstack-infra/reviewstats: Tweak disagreement ratio calcuation  https://review.openstack.org/4142514:05
*** prad_ has quit IRC14:05
*** mgagne1 has joined #openstack-infra14:05
*** mgagne1 has quit IRC14:05
*** mgagne1 has joined #openstack-infra14:05
openstackgerritA change was merged to openstack-infra/reviewstats: Tweak disagreement ratio calcuation  https://review.openstack.org/4142514:05
*** vijendar1 has joined #openstack-infra14:05
*** dina_belova has quit IRC14:06
*** dkehn has quit IRC14:08
*** prad_ has joined #openstack-infra14:09
*** prad_ has quit IRC14:10
*** mgagne has quit IRC14:10
*** vijendar has quit IRC14:10
*** mgagne1 is now known as mgagne14:10
*** dina_belova has joined #openstack-infra14:11
*** burt has joined #openstack-infra14:12
openstackgerritJordan OMara proposed a change to openstack-infra/config: Add tuskar-ui to stackforge  https://review.openstack.org/4119914:12
*** luisg has joined #openstack-infra14:13
*** dina_belova has quit IRC14:16
*** ruhe has quit IRC14:18
openstackgerritJordan OMara proposed a change to openstack-infra/config: Add tuskar-ui to stackforge  https://review.openstack.org/4119914:21
*** pcrews has quit IRC14:22
*** openstackgerrit has quit IRC14:24
*** openstackgerrit has joined #openstack-infra14:24
openstackgerritA change was merged to openstack-infra/reviewstats: Fixing minor misspelling  https://review.openstack.org/4135714:24
*** wayneeseguin has quit IRC14:24
*** wayneeseguin has joined #openstack-infra14:24
*** markmcclain has joined #openstack-infra14:26
*** krtaylor has joined #openstack-infra14:26
openstackgerritA change was merged to openstack-infra/config: Add tuskar-ui to stackforge  https://review.openstack.org/4119914:26
*** datsun180b has joined #openstack-infra14:27
openstackgerritMark McLoughlin proposed a change to openstack/requirements: Allow use of oslo.messaging 1.2.0a1  https://review.openstack.org/4138114:27
openstackgerritMark McLoughlin proposed a change to openstack/requirements: Allow use of oslo.messaging 1.2.0a2  https://review.openstack.org/4138114:28
*** markmcclain has quit IRC14:30
*** markmcclain has joined #openstack-infra14:30
sdaguemordred: you know why http://status.openstack.org/zuul/ hasn't refreshed yet?14:31
fungisdague: what do you mean by refreshed? it looks like it's refreshing to me14:32
sdaguefungi: the style changes that merged this weekend14:33
sdagueto status.html14:33
fungioh, that. i thought you meant the content of the status page had gone stale14:33
fungii'll see if i can tell what's up. could be puppet's hung on static.o.o14:33
fungisdague: what files should have changed?14:34
*** dina_belova has joined #openstack-infra14:34
sdaguestatus.html14:34
fungiahh14:34
sdagueall the content should be there14:35
fungi-rw-r--r-- 1 root root 4950 Aug  1 21:54 /srv/static/status/zuul/index.html14:36
*** ruhe has joined #openstack-infra14:36
fungiso not updated, agreed14:36
openstackgerritMonty Taylor proposed a change to openstack-dev/hacking: Add check for deprecated method assertEquals  https://review.openstack.org/3596214:36
fungidigging in puppet logs now14:36
*** dkehn has joined #openstack-infra14:37
*** pentameter has joined #openstack-infra14:38
*** openstackgerrit has quit IRC14:40
*** openstackgerrit has joined #openstack-infra14:40
fungiweird, puppet is still running and has no child processes but stopped updating (both according to the dashboard and its local syslog) at midnight utc friday morning14:41
fungistrace shows it quietly idling in a select() call14:41
mordredfungi: I've been seeing puppet get hung a lot recently14:42
fungimordred: yeah, wish it actually provided some indication of why it's hung14:43
fungianyway, i've restarted the agent cleanly so it should update shortly now sdague14:43
fungiafter restarting it returned a failure log for that midnight run, but all it included was "Caught TERM; calling stop" so unfortunately not a lot to go on there either14:45
*** dina_belova has quit IRC14:47
*** SpamapS has joined #openstack-infra14:47
*** SpamapS has quit IRC14:47
*** SpamapS has joined #openstack-infra14:47
*** dina_belova has joined #openstack-infra14:48
*** boris-42 has quit IRC14:48
*** pcrews has joined #openstack-infra14:51
*** lascii is now known as alaski14:56
*** vandervenv is now known as devananda14:57
* fungi is afk again for a bit14:59
*** rnirmal has joined #openstack-infra15:00
*** sarob has joined #openstack-infra15:00
*** rnirmal has quit IRC15:00
*** rnirmal has joined #openstack-infra15:00
*** sarob has quit IRC15:05
annegentlejeblair: clarkb: or other infra-ers, up for Docs Boot Camp? The registration form is on https://wiki.openstack.org/wiki/Docs_Bootcamp_201315:11
*** UtahDave has joined #openstack-infra15:11
*** changbl has joined #openstack-infra15:11
*** sarob has joined #openstack-infra15:12
jeblairannegentle: done!  based on the schedule, i put myself down for day 1, but if you want me there both days i can do that too.15:13
annegentlejeblair: awesome thank you! I am hoping you can do a "hands on lab" -- like an example yaml file?15:13
annegentlejeblair: definitely join us for dinner Monday evening, we're working on something fun15:14
jeblairannegentle: yeah, i'll try to prepare something in advance; i'll probably talk to you about it more when we're a little closer.15:14
annegentlejeblair: cool, sounds good15:15
annegentlejeblair: we should have 20 people, maybe 2515:15
jeblairannegentle: excellent!15:15
annegentlejeblair: yeah!15:16
mordredjeblair: morning!15:16
mordredjeblair: I don't know if you saw in the scrollback - but we're narrowed the devstack-on-pristine-ubuntu problem down to "works with our mirror, does not work with not our mirror"15:17
mordredfor reasons thus-far surpassing understanding15:17
jeblairmordred: i did see that.  that is wacky.15:17
*** sarob has quit IRC15:17
mordredmy favorite part is that for some reason our mirror prevents the prettytable permissions problem15:18
*** psedlak has quit IRC15:18
*** ruhe has quit IRC15:21
dtroyermordred: peek inside the prettytable package in the mirror to see if it has the same broken permissions and the one on pypi15:22
dtroyerI don't know why it would change, but I don't know why this wasn't a problem before pip 1.4 either15:23
*** prad_ has joined #openstack-infra15:24
* anteaya fires up an ubuntu devstack15:24
mordreddtroyer: all three copies have the same md5sum - tar.gz, tar.bz2 and .zip15:26
mordreddtroyer: I'm wondering if perhaps the logic changed and is getting zip by default over .tar.gz or something like that15:26
dtroyercould be, 1.4 is using the zip file15:27
mordredbut is different on our mirror beause we're using autoindex15:27
sdaguefungi: man, takes a lot of refreshing to get all that stuff to clear cache15:27
sdaguefungi: maybe we should default mod_expires everything after 24 hrs15:28
mordreddtroyer: there it is15:28
mordreddtroyer: I get the tarball from the openstack mirror15:28
mordreddtroyer: and I get the zipfile from pypi.o.o15:28
jeblairsdague: ? i just hit reload.  anyway, looks great!15:28
mordredgah. pypi.python.org15:28
*** ruhe has joined #openstack-infra15:29
sdaguejeblair: I had to go to the status.js and refresh it directly15:29
*** dina_belova has quit IRC15:29
jeblairttx: ^ sdague granted your wish about right-alignment on zuul-status15:29
sdaguemaybe chrome likes to cache too much :)15:29
mordreddstufft: any way to get pip to prefer tarballs over zip files?15:29
jeblairsdague: maybe chrome is only compatible with the way google caches things.  :P15:30
mordredfungi: ^^ problem figured out15:30
*** vijendar1 has quit IRC15:30
jeblairmordred, fungi, clarkb: a couple random thoughts i had:15:30
jeblairmordred, fungi, clarkb: 1) i think we'll be able to do a smooth transition between current devstack-gate -> nodepool15:31
jeblairmordred, fungi, clarkb: 2) the combined dib-kexec system makes using nodepool for standard unit test slaves much more compelling15:31
jeblairmordred: so when i wrap up moving to the new system, i think i'll want to work with you on incorporating that next.15:32
mordredjeblair: cool!15:33
mordredjeblair: I think it's basically functional, but needs more testing (clearly) and more brainspace looking at what I might have missed15:34
sdaguejeblair: probably :)15:34
mordredjeblair: I also want to work out a smarter way to re-use/re-copy caching between how dib is doing it and how we're doing it15:34
mordredsdague: did you see above that we figured out one of the reasons why we're not seeing prettytable issues in the gate, but are seeing them elsehwere?15:36
dtroyermordred: the permissions in all three archives are the same, 0600.  looks like they're handled differently though somewhere15:36
*** dina_belova has joined #openstack-infra15:36
*** dina_bel_ has joined #openstack-infra15:37
*** dina_belova has quit IRC15:37
sdaguenope, but that's good15:37
mordreddtroyer: but do unzip and untar copy the permissions in the same way is what I'm thinking15:37
dtroyeri'm checking on that now15:38
mordredsdague, dtroyer: also, I got MUCH further with the global venv patch. swift refuses to start properly now, and I'm not sure why15:38
notmynamemordred: take out the "is_monty_trying_to_run_swift" config variable. or set the "just_DWIM" env var15:39
mordreddtroyer: also, I learned from dstufft over the weekend that we should be able to stop mucking with setuptools: https://review.openstack.org/#/c/41281/15:40
mordrednotmyname: AH. I forgot those15:40
dtroyermordred: I saw that…I wasn't sure if I'm ready to nuke that yet, but maybe15:40
dtroyerit isn't being used now though15:40
openstackgerritSergey Kolekonov proposed a change to openstack-infra/jenkins-job-builder: Existing plugins improvements  https://review.openstack.org/4137515:41
mordreddtroyer: yeah.not important to nuke - but potentially good to know15:41
openstackgerritA change was merged to openstack/requirements: Allow use of oslo.messaging 1.2.0a2  https://review.openstack.org/4138115:41
dtroyerman unzip15:42
dtroyerthat looks bad out of context!15:42
mordredsdague, lifeless: also, pip has protections against instaling binary wheels from pypi - so we are safe to use them for now15:43
mordredsdague, lifeless: and the protection is specific to pypi.python.org - so we _can_ upload binary wheels to pypi.o.o and make use of them15:44
*** rcleere has joined #openstack-infra15:45
mordrednotmyname: btw, I got the docs updated per our last conversation: http://docs.openstack.org/developer/pbr/15:47
mordrednotmyname: with a new page for packagers15:47
dstufftmordred: Uhhh, I'm not sure offhand15:48
dstufftthere's not a way exposed15:48
notmynamemordred: great, thanks!15:49
mordreddstufft: ok. I think dtroyer is still verifying, but it seems like the difference between installing from zip and installing from tar.gz may be what's causing the bad permissions problems we're seeing when we install prettytable15:49
dstufftmordred: interesting, does the zip and tar.gz have different perms inside the archives?15:51
mordreddstufft: nope. same perms15:51
mordreddstufft: but we verified that if you use our mirror, you get the tarball, and if you use pypi, you get the zip15:52
devanandamordred: g'morning!15:52
mordreddstufft: and that running devstack against our mirror with nothing else changed works15:52
mordredand runing it without our mirror set does not work15:52
mordredso - I'm making some logical jumps now15:52
mordreddevananda: morning!15:52
*** Ryan_Lane has joined #openstack-infra15:53
devanandamordred: when you have a moment -- thoughts on https://review.openstack.org/#/c/41086/ would be appreciated15:53
devanandahopefully it's trivial to approve15:53
dstufftmordred: yea pip respects the version of the files listed on the index in absence of something else pushing one link higher or lower15:54
mordreddevananda: it's pretty trivial - are we assuming the pyghmi is going to not break things with new releases?15:54
dstufftso if you look I bet the .zip appears first on the simple page on pypi, bu the tar.gz on the openstac mirror15:54
dtroyerI think I found the difference from 1.3.1 to 1.4…pip-1.4.1/pip/util.py line 500:15:55
dtroyer                    if unix_attributes:15:55
dtroyer                        os.chmod(fn, unix_attributes)15:55
*** ruhe has quit IRC15:55
devanandamordred: we should assume nothing of pyghmi at this point. i'm slowly pulling it more into stackforge's purvue, but for the most part, jbjohnson is developing/maintaining it15:55
dtroyernot present before 1.4.  looks to be .zip only15:55
mordreddtroyer: awesome. so - pip is setting the files to the permissions in the zip archive nly if it's a zip archive, and it's not performing that 'help' on tarballs15:57
dtroyermordred: exactly.  so what is the bug?  the addition of the perm preservation or the bad perms in existing packages?15:57
devanandamordred: IMHO, pyghmi is kinda like pecan in that it's depended on by an openstack project, written by folks involved in openstack, and developed partly for openstack but partly not.15:58
*** lcestari_ has joined #openstack-infra15:58
mordreddtroyer: I'm going to say the combination of those things. I think if it's goingto chmod things, it should do so in a way that makes them sensible15:58
dtroyerbut who is to say that the package contents aren't sensible?  in our use case the aren't for sure15:59
mordredbut we seem to be getting the perfect storm of downloading-zip+pip 1.4+bad-perms-in-package - remove any of those things and it works15:59
mordreddtroyer: I'd say any package contents that are only readable by root are probably rpetty weird :)16:00
dtroyerbit I'd expect pip to behave more like tar(1) or unzip(1) does…that's what threw me on Friday, tar and unzip did what I expected16:00
mordreddtroyer: what do they do different?16:00
dtroyerthe preserve the permissions inside the archive by default16:01
*** lcestari has quit IRC16:01
dtroyerso honestly, it's pip's tar extract that is now doing-what-i-don't-expect16:01
dtroyerexcept that it's exposed a bunck of semi-borken packages16:02
*** mrodden has quit IRC16:02
dtroyerand o course, in a venv you don't notice as it's all readable by the user16:02
mordredcry16:02
* anteaya admires her "Keystone did not start" error in a fresh devstack on ubuntu - https://gist.github.com/anteaya/18c24018181e1131da4016:04
mordredanteaya: yup!16:05
mordredthat would be the prettytale issue16:05
mordredprettytable16:05
anteayayay, I got it right16:05
anteayaany I can do now to help?16:05
openstackgerritwill soula proposed a change to openstack-infra/jenkins-job-builder: Adding support for the Warnings plugin  https://review.openstack.org/4062116:06
anteayas/any/anything16:06
mordredanteaya: there is a workaroud for it here: https://review.openstack.org/#/c/41209/16:07
*** marun has joined #openstack-infra16:07
clarkbmorning16:08
anteayamorning clarkb16:09
*** pcrews has quit IRC16:09
dtroyerdstufft, mordred: looks like the chmod during unzip came in the wheel support, explaining why it is zip only?16:10
dtroyerso I'm not sure what the 'correct' fix is here…other than fixing a bunch of packages or forcing tar-only16:11
*** afazekas has quit IRC16:11
*** lcestari_ has quit IRC16:12
dstufftheh16:12
*** mrodden has joined #openstack-infra16:12
dstufftthat's an interesting question16:12
*** pentameter has quit IRC16:12
*** lcestari has joined #openstack-infra16:13
mordreddtroyer: maybe just a recursive chmod on the site-packages location to make it ugo+r (and ugo+rx for dirs) once we're done installing things?16:13
dstufftprobably what makes the most sense is for pip to keep the executable bit as it exists in the package, but reset the permissions otherwise to what a new file would be created as with the umask16:13
dtroyerI hate to do the whole thing, it would have to be done in every call to pip_install()16:13
dtroyeror after anything similar16:14
mordreddtroyer: yuck16:14
*** vogxn has quit IRC16:14
*** pentameter has joined #openstack-infra16:14
*** vogxn has joined #openstack-infra16:14
mordreddstufft: wouldnt' that still leave us unable to read files in the package though? (prettytable is installing mode 600 things, iirc)16:14
dtroyerI'm more of a mind to keep the hack-around in fixup_stuff.sh and make a list of the packages with the problem and start filing bugs.16:15
dstufftdtroyer: well pip should at the very least be consistent, either apply the permissions in the package to tar and zip, or don't do it in either16:16
mordreddtroyer: I'm fine with that16:16
mordreddstufft: ++16:16
mordreddstufft: it seems that not doing it breaks less things, although it's also possibly less correct16:16
dstufftmordred: my proposal would install them to whatever the umask would cause a new file to be created as16:17
mordredAH. I grok what you were saying earlier better now16:17
pleia2all settled in back at home, good morning :)16:18
mordreddstufft: I think that sounds more righter - because these aren't general zip/tar files - they are specific with a specific purpose in mind16:19
anteayamorning pleia216:19
anteayaglad you are home safe16:19
dstufftI think as to which one to do depends mostly on who you think should control the file mode of the newly created files. The packager or the installer. I lean towards giving control to the installer as I think people generally suck at packaging things (and it's also hard to know what file permissions are reasonable in every installation environment)16:19
dstufftand fixing it in pip is easier than getting a bunch of random people fix their packages16:20
anteayapleia2: highlights so far, zuul has a fresher look thanks to jeblair and sdague also devstack on ubuntu fails right now due to permissions on files (tar, zip) being set differently on install16:21
dtroyerdstufft: [puts on SA hat]  I'll buy that…16:21
pleia2anteaya: thanks!16:21
anteayanp16:21
anteayaalso fungi is here intermittently, he is being supportive in hospital waiting rooms16:22
*** jpich has quit IRC16:23
*** derekh has quit IRC16:25
*** markmc has quit IRC16:25
zaroanteaya: nice highlig16:25
zaromordred: thanks.  Wow! builds have become super snappy since the additional jenkins masters.~16:25
dstufftdtroyer: can you post an issue with details?16:25
dtroyerdstufft: yup, witing it now16:26
dstufftdtroyer: thanks16:26
anteayazaro: thanks and morning16:26
zarosorry, network hiccup.  but yeah, you got my gist.16:27
mordredpleia2: woot. welcome back16:27
mordredpleia2: I have not tested that jeepyb change at all, btw16:27
*** ruhe has joined #openstack-infra16:28
pleia2mordred: it's first up on my list, I also am thinking of adding a .backup rotation of the file for in case things go sideways during generation (it doesn't exactly have syntax checking)16:28
pleia2well, after catching up on email :)16:29
mordreddtroyer: I'm going to write a note to the -dev list teling people what's up16:29
mordredpleia2: good idea16:29
*** annegentle_ has joined #openstack-infra16:32
*** annegentle has quit IRC16:32
*** pentameter has quit IRC16:33
*** dkehn has quit IRC16:33
dtroyerdstufft: https://github.com/pypa/pip/issues/1133  I didn't spell out a solution, just tried to describe what we're seeing.16:34
dstufftdtroyer: thanks16:35
mordreddtroyer: http://paste.openstack.org/show/43956/ look ok to you?16:36
annegentle_hey infra, just fyi, once https://review.openstack.org/#/c/41071/ merges, we'll only validate/build modified files in the openstack-manuals directory for our "gate" testing.16:37
mordredannegentle_: neat16:37
*** dkehn has joined #openstack-infra16:38
dtroyermordred: I think I'd add a link to either the devstack review with fixup_stuff.sh or a pointer to the commit if it goes in befoe you send this.  otherwise its good16:38
*** afazekas has joined #openstack-infra16:41
mordreddtroyer: good call. added.16:42
*** dina_bel_ has quit IRC16:42
*** ruhe has quit IRC16:44
openstackgerritSergey Kolekonov proposed a change to openstack-infra/jenkins-job-builder: Existing plugins improvements  https://review.openstack.org/4137516:45
*** UtahDave has quit IRC16:46
dtroyersdague, mordred: is https://review.openstack.org/41209 ready to approve?  I'm ok with Maru's addition of httplib216:47
*** vogxn has quit IRC16:47
*** UtahDave has joined #openstack-infra16:47
*** pentameter has joined #openstack-infra16:47
anteaya41209,4 works for me16:50
anteayaas a side note sourcing openrc gets me an odd response: $ source openrc16:50
anteayaNo packages found matching xenserver-core.16:50
clarkbI was going to suggest attempting to test pbx again but cacti is currently out of commision16:50
anteayathat is new and could be upsetting to a newcomer16:51
clarkbfungi: ^ any update on your request to get that fixed?16:51
Shrewsmordred: Happy birthday old man16:52
*** ^d has joined #openstack-infra16:52
*** ^d has joined #openstack-infra16:52
*** odyssey4me has quit IRC16:52
*** pentameter has quit IRC16:52
*** dina_belova has joined #openstack-infra16:53
clarkbmordred: thank you for the devstack update. very helpful in my attempt to catch up after the weekend16:53
clarkbalso happy birthday!16:53
mordreddtroyer: I'm good with landing that patch16:53
mordredShrews, clarkb thanks!16:53
*** sdake__ has joined #openstack-infra16:54
*** pentameter has joined #openstack-infra16:54
fungisdague: jeblair: ttx: likey the new result/progress alignment on the zuul status page, for sure16:54
* fungi is scrollbacking for a bit16:54
*** sdake has quit IRC16:55
*** fbo is now known as fbo_away16:55
fungialso, dib/kexec to turn minimal vm into devstack slave or unit test slave or whatever is very interesting16:56
anteayafiled it as a bug: https://bugs.launchpad.net/devstack/+bug/121141316:57
uvirtbotLaunchpad bug 1211413 in devstack "No packages found matching xenserver-core. response when sourcing openrc" [Undecided,New]16:57
openstackgerritJoe Gordon proposed a change to openstack-infra/config: Remove oslo gerritbot posts from openstack-nova  https://review.openstack.org/4068616:58
jog0mordred: just pressed the magical 'rebase' button on gerrit hopefully that workd as expected16:59
fungiand yeah, pypi.o.o uses apache mod_index which does alpha order by file name, so .tar.somethng would sort before .zip16:59
jog0ahh that is how the commiter becomes gerrit16:59
dstufftPyPI orders by upload date I think17:00
*** sarob has joined #openstack-infra17:00
dstufftor possibly by whatever order they are in the DB17:00
*** rscottcoyle has quit IRC17:02
fungiclarkb: bug 1210822 seems to be waiting for someone to debuild patched packages and request a security sponsor. i was actually going to give it a shot yesterday until i suddenly had to deal with real life more than anticipated. the package maintainer's interpretation seems to suggest that these vulnerabilities are only only post-authentication though, so i'm on the fence about just turning it back on17:05
uvirtbotLaunchpad bug 1210822 in cacti "Please import 0.8.8b+dfsg-2 from Debian and backport security fixes to 12.04 LTS" [Undecided,Triaged] https://launchpad.net/bugs/121082217:05
clarkbfungi: good to know, thanks17:06
*** jjmb has joined #openstack-infra17:06
*** dina_belova has quit IRC17:08
*** SergeyLukjanov has quit IRC17:09
jeblairclarkb, zaro: i believe the gearman-plugin error we saw over the weekend (where two jobs were stuck in the jenkins queue) is related to race conditions around onlining and offlining nodes17:11
jeblairclarkb, zaro: the node in question was flapping, and i'm pretty sure it ended up with at least two gearman executor threads.17:11
jeblairclarkb, zaro: i'm working on a fix17:12
*** sarob has quit IRC17:12
clarkbjeblair: ok, thank you for the update17:12
mordredthx17:12
*** sarob has joined #openstack-infra17:12
*** jjmb1 has joined #openstack-infra17:14
*** sarob_ has joined #openstack-infra17:14
*** sarob has quit IRC17:15
*** pcrews has joined #openstack-infra17:15
*** jjmb has quit IRC17:17
openstackgerritwill soula proposed a change to openstack-infra/jenkins-job-builder: Adding support for the Warnings plugin  https://review.openstack.org/4062117:17
*** dirk has joined #openstack-infra17:17
dirkis there a way to change the owner of an abandoned review request?17:18
*** rscottcoyle has joined #openstack-infra17:18
clarkbdirk: I don't think we would want to do that (for CLA related reasosn and stuff). Are you trying to unabandon it?17:20
dirkclarkb: yes17:20
clarkbdirk: members of the project's core group should be able to do that17:20
clarkbdirk: or I can do it if you provide a link to the change17:20
dirkhttps://review.openstack.org/#/c/28819/17:20
dirkclarkb: ^^17:22
clarkbdirk: done17:23
*** ladquin has joined #openstack-infra17:23
dirkclarkb: thank you!17:25
*** nicedice_ has joined #openstack-infra17:25
clarkbno problem17:26
*** nati_ueno has joined #openstack-infra17:28
*** jjmb1 has quit IRC17:29
*** jjmb has joined #openstack-infra17:30
*** gyee has joined #openstack-infra17:30
sdagueclarkb: ok, I figured out why the 404 catching I did was no good17:31
sdaguebecause it's in a generator, so we actually throw the exception too late17:31
*** fungi has quit IRC17:31
*** fungi has joined #openstack-infra17:32
*** dirk has quit IRC17:33
*** afazekas has quit IRC17:34
*** jfriedly has joined #openstack-infra17:35
*** rscottcoyle has quit IRC17:40
nati_uenohi guys how do you think this bug?17:44
nati_uenohttps://bugs.launchpad.net/neutron/+bug/121039117:44
uvirtbotLaunchpad bug 1210391 in neutron "Intermittent neutron-adv-test related failure in gate" [High,Confirmed]17:44
nati_uenoIt looks like we are missing SERVICE_TIMEOUT17:45
*** ruhe has joined #openstack-infra17:52
*** fbo_away is now known as fbo17:55
*** pentameter has quit IRC17:56
*** jjmb has quit IRC17:57
mordreddude. I cannot drive a truck this well: http://humortrain.com/post/5800867021718:01
*** SergeyLukjanov has joined #openstack-infra18:03
*** ruhe has quit IRC18:04
clarkbnati_ueno: does that command have $SERVICE_TIMEOUT in it and we are not setting the value?18:05
*** sarob_ has quit IRC18:05
nati_uenoclarkb: Thanks. I figued out the issue. TIMEOUT value was ok but it fails getting ip from nova show command18:05
*** sarob has joined #openstack-infra18:05
nati_uenoclarkb: I'll continue investigation18:05
clarkbnati_ueno: well I don't see a timeout value in the command18:06
clarkbnati_ueno: 2013-08-09 02:59:55.883 | timeout: invalid time interval `sh' is a result of that18:06
nati_uenoclarkb: yes. so the func using $1(name) $2(ip) $2(timeout)18:07
nati_uenoclarkb: but in previous command we faild to get the $2(ip)18:07
nati_uenoclarkb: so $1(name) $3(timeout) passed to the command18:07
nati_uenoclarkb: so it looks we are lacking timeout value18:07
nati_uenoclarkb: but the cause was getting ip address18:07
*** sarob has quit IRC18:10
clarkbI see18:10
*** pentameter has joined #openstack-infra18:11
jeblairwhy doesn't a java List, which is a generic, parameterize its "contains" method so the compiler checks that it's even possible for a list to contain the kind of object you're asking about?18:11
*** jpeeler1 has joined #openstack-infra18:11
clarkbnati_ueno: should there be a more aggressive check of the arguments so that we can give better error messages?18:12
nati_uenoclarkb: yes I agree. also we should add error handing for getting ip18:13
fungijeblair: i take it that was the bug which resulted in the flapping slave getting multiple workers?18:13
nati_uenoclarkb: currently there is no error if we can't get ip address. and the result of nova show is missing18:13
fungijeblair: wrong type passed in a contains() method call?18:13
openstackgerritSean Dague proposed a change to openstack-infra/config: robustify htmlifier for logs  https://review.openstack.org/4148618:13
sdagueclarkb: so, I think that's the fix18:13
clarkbsdague: looking18:13
clarkbsdague: also "robustify" is an excellent18:14
*** pentameter has quit IRC18:14
clarkb*excellent word18:14
sdagueI also put a couple of other things in that patch which I think we need18:14
mordredjeblair: late binding? maybe it's expecting that ... no, nevermind. I've got nothing18:14
fungiha! cloud relevant... zooko/leastauthority.com has a tahoe/lafs-backed cloud storage service now called "s4" (simple secure storage service)18:14
*** jpeeler has quit IRC18:14
* fungi lol'd18:15
*** mrmartin has joined #openstack-infra18:15
fungii'm tempted to pay the $50/mo rate for 350gb storage with them, just on principle18:15
*** sarob has joined #openstack-infra18:15
*** sarob has quit IRC18:16
fungi"discounts are available for [...] open source projects"18:16
*** sarob has joined #openstack-infra18:17
fungitoo bad they're putting it on top of s3 for the moment, but they claim to be targeting hpcloud as a backend with a future iteration18:18
*** fbo is now known as fbo_away18:18
fungiand rackspace18:18
openstackgerritJames E. Blair proposed a change to openstack-infra/gearman-plugin: Rework starting/stopping executors  https://review.openstack.org/4148818:21
jeblairzaro: ^18:21
clarkbfungi: jeblair https://review.openstack.org/#/c/41486/ lgtm and mordred. Did you want to review sdague's robustification before I approve it?18:21
*** sarob has quit IRC18:21
* fungi looks18:21
jeblairclarkb: yeah, i'd like to take a look18:22
sdagueclarkb: mordred already +2ed it actually18:22
sdaguejeblair's eyes would be good18:22
fungilgtm. mostly just wanted to confirm we weren't doing unsafe things with the query string18:25
* fungi is probably unnecessarily paranoid about web-facing code18:26
* anteaya is grateful for fungi's paranoia18:26
clarkbme too18:26
anteayastay paranoid, fungi18:27
zarojeblair: looking18:27
*** dina_belova has joined #openstack-infra18:27
*** pentameter has joined #openstack-infra18:28
clarkbjeblair: does that change enforce a 1:1 slave to executor mapping?18:28
clarkbor is a Computer roughly equivalent to an executor?18:29
jeblairclarkb: no, a Computer contains Executors18:30
jeblairclarkb: so it may well have some problems with multiple executors18:30
jeblairsdague: why not open() the file, then pass the open filehandle to the generator (instead of using fileinput)?18:33
jeblairsdague: (and actually, you could probably open the file with fileinput.hook_compressed(fname) instead of open())18:34
openstackgerritA change was merged to openstack-infra/config: Remove oslo gerritbot posts from openstack-nova  https://review.openstack.org/4068618:34
jeblairs/filehandle/file object/18:34
sdaguejeblair: so you actually can't18:35
sdagueI tried18:35
fungiif you could, that would presumably solve the race18:35
sdaguethe way it does closes is weird, and fails in the plain text case18:35
jeblairlying doc writers18:35
jeblairsdague: the way open() closes?18:35
sdagueno, the way the implicit fileinput.hook_compressed(fname) works18:36
clarkbjeblair: I really like that gearman plugin change18:36
clarkbsimplifies the race condition surface area18:36
jeblairclarkb: do you think it has multi-executor problems?  i haven't gone through and done a pass thinking about that.18:36
clarkbjeblair: I think it does18:37
clarkbjeblair: because each executor gets a thread but we are comparing against node stuff18:37
clarkbjeblair: which means a node iwth more than one executor might go sideways, but I believe this has been a restriction on the gearman plugin use18:38
clarkbzaro: is that correct?18:38
jeblairsdague: in the plain text case, hook_compressed just calls "open(filename, mode)"18:38
sdaguewell, when I tried to just open the stream before the first yield, it wouldn't trigger the IOError early enough18:40
*** jjmb has joined #openstack-infra18:40
jeblairsdague: oh, ok, i meant something different18:40
sdagueone of the other nice things about fileinput, is it means you can test on the command line really easily18:41
sdagueas it auto handles stdin18:41
*** pabelanger has quit IRC18:41
annegentle_basic, basic question: how do I set the fqdn for a server I've already spun up on Rackspace Cloud? IP address? (Trying to spin up a jenkins slave to test translation processing)18:42
clarkbannegentle_: edit /etc/hostname and /etc/hosts18:43
*** Ryan_Lane has quit IRC18:44
clarkboh hostname should not contain the full fqdn18:44
clarkbso /etc/hostname should just have the hostname then you can set the fqdn in /etc/hosts18:44
*** sarob has joined #openstack-infra18:45
annegentle_clarkb: okay, does it matter what I name a throwaway slave server?18:47
clarkbannegentle_: it shouldn't18:47
annegentle_clarkb: you just name them slave1, slave2, etc.18:47
clarkbprecise1 centos6-1 and so on18:48
annegentle_clarkb: ok makes sense now thanks18:50
*** openstackgerrit has quit IRC18:50
*** openstackgerrit has joined #openstack-infra18:50
*** sarob has quit IRC18:51
jeblairsdague: the stdin case is handled separately anyway, so you wouldn't lose that.  i left more detailed inline comments.18:51
*** sarob has joined #openstack-infra18:52
jeblairclarkb, zaro: istr that gearman-plugin should handle multiple executors, except that changing the number of executors on on online node isn't well supported18:55
jeblairclarkb, zaro: so we want to make sure we don't break that (we do have nodes with multiple executors)18:55
*** annegentle_ has quit IRC18:58
jeblairclarkb: heh, i actually think that patch doesn't break multi-exec support any more than currently, but i think i have found another case where the current state is broken.18:58
clarkbjeblair: ya, I think it may be the same degree of broken18:59
clarkbwhich is why I gave it a +218:59
*** annegentle has joined #openstack-infra18:59
jeblairall the exec workers get added, but only one is removed18:59
jeblairnew patchset after lunch19:02
sdaguejeblair: ok, I can't quite get that other approach of yours to work without generating other fileinput exceptions19:05
sdagueso unless you really object to the current approach, I'd suggest we land it.19:05
*** nati_ueno has quit IRC19:06
sdaguealso, in the office for 2 - 3 more hours before vacation :) so something new and big won't be coming from me until we get to sept.19:06
openstackgerritAnne Gentle proposed a change to openstack-infra/config: Point to README.rst instead of .md for Devstack Gate.  https://review.openstack.org/4149519:07
*** nati_ueno has joined #openstack-infra19:07
*** ruhe has joined #openstack-infra19:08
zarojeblair, clarkb : yes, you remember correctly.  handles multiple executors but does not update state when executors are added or removed.19:09
*** fbo_away is now known as fbo19:14
*** jpeeler1 is now known as jpeeler19:16
mordredoff to the airport...19:17
mordredI may not be online again for several hours - I do not think that domestic flights have wifi down here19:17
sdagueI feel like you should be wearing a cape when you say that19:17
mordredsdague: :)19:17
pleia2mordred: enjoy!19:18
sdaguesafe travels19:18
mrmartinre19:18
dtroyersdague: if you have time can you take a look at Sam Alba's responses in https://review.openstack.org/#/c/40759/ (Docker).  I added a bit too, I'd like to not wait until you get back to finish that.19:18
clarkbsdague: is the problem that we need to s/IOError/FileInputError/ in the try except block because fileinput throws things other than IOError?19:18
sdagueclarkb: no, we get an IOError19:19
sdaguebut we get it later19:19
sdaguebecause that is all written as a generator19:19
clarkboh I bet fobj doesn't actually open it because it is a generator itself19:19
sdagueso we're completely outside of our code19:19
clarkbya19:19
*** mrodden has quit IRC19:19
clarkbok I am still happy with my +219:20
sdagueso the real answer, is a more complicated framework like flash19:20
sdagueflask19:20
sdaguebut... that would mean you'd need to wait for all this19:20
sdaguedtroyer: can do19:20
mrmartinguys, the http://ci.openstack.org/puppet.html page mentions a common.yaml file. Where could I find an example of this common.yaml?19:20
clarkbsdague: ya, no rush the slight race condition in what you have doesn't bother me too much as we still get a 50019:20
clarkbmrmartin: we don't currently have an example hiera data yaml file19:21
mrmartinok, so grepping out hiera( from config files could provide a list of possible keys.19:21
clarkbmrmartin: we didn't think we needed one because we only ever refer to hiera data in site.pp. But enough people have asked for it that I may put one together19:21
clarkbmrmartin: yup and you only need to grep site.pp19:21
clarkbmrmartin: you can also forego hiera completely and hard code your own data in site.pp or an ENC19:22
mrmartinclarkb, thanks when I want to add a brand new server I guess I just need to add sysadmins entry19:22
sdaguedtroyer: ok, I'm ok being 0 on that19:24
sdagueas I get we're sort of defining new policy as we go19:25
*** dkliban has quit IRC19:25
mrmartinand we have some hard-coded value in modules/openstack_project/templates/puppet.conf.erb, like server name and reporturl parameters19:25
clarkbmrmartin: sysadmins is a list of email addresses for people that should receive root email19:25
annegentleclarkb: hm so if I ran a puppet apply pointing to my local.pp manifest, what would I see if it were successful? Just returned to the prompt for me.19:25
mrmartinclarkb: thanks19:25
clarkbmrmartin: we pulled it out of the repo so that we would stop getting email for other people's servers19:25
sdagueI also threw russellb on the review because I think it opens up what should be a summit session about coming up with the agreed path by all the various programs and projects on how something like a new nova driver needs to land19:25
dtroyersdague: thanks.  it's the PPA I'm not sure what to do with for now until they get it into at least one distro19:26
annegentleclarkb: should I now have a docbook-properties.sh script in usr/local/jenkins/slave_scripts or would that only be if I made a jenkins server19:26
sdaguebut I don't want to overly penalize the team that trips over the fact that we haven't thought it all through first :)19:26
openstackgerritMathieu Gagné proposed a change to openstack-infra/config: Mark puppet-lint jobs as voting  https://review.openstack.org/4150219:26
annegentleclarkb: oh sorry have to go for a bit but I want to keep trying this19:26
sdagueclarkb: well any chance you want to land things through? would love to see the last 2 patches I have in review hit before I leave today, which is that one, plus actually turning it on19:27
sdaguealso the ?content-type=text/plain is probably going to be an important thing for people to know, as the nova-api log at least cratered dhellmann's laptop19:28
clarkbannegentle: you should get that script in your slave19:29
clarkbsdague: I can do it, but would like jeblair to update his vote19:29
sdagueyep, that's cool19:30
clarkbeg I don't want to override his -119:30
sdaguehe actually 0ed it19:30
clarkboh19:30
* clarkb looks again19:30
clarkbok, jeblair should be back from lunch in a bit I can approve if he doesn't feel strongly about it19:31
*** ruhe has quit IRC19:32
*** mrodden has joined #openstack-infra19:34
*** mrodden1 has joined #openstack-infra19:36
*** mrodden has quit IRC19:39
openstackgerritA change was merged to openstack-infra/jenkins-job-builder: ignore instead of fail when reading empty config files  https://review.openstack.org/3852019:41
*** jjmb has quit IRC19:44
*** UtahDave has quit IRC19:45
*** UtahDave has joined #openstack-infra19:45
*** adalbas has quit IRC19:48
*** jpmelos has joined #openstack-infra19:50
jpmelosHello.19:50
jpmelosI'm using the -t to test my layout file, I get the error voluptuous.MultipleInvalid @ data['pipelines'][0]['trigger'].19:51
jpmelosI'm following the syntax correctly, so I don't know what might be causing this.19:51
jpmelosThis even happened with the sample provided in the repository.19:51
jpmelosCould someone give me some help here?19:52
clarkbjpmelos: can you paste the example zuul layout file?19:52
jpmelosclarkb: Sure, just a minute.19:52
clarkbjpmelos: as used by you19:52
clarkbI guess I want the file that -t is failing on19:53
jpmeloshttp://hastebin.com/detuminaje.sm <-- This is the one.19:54
clarkbjpmelos: if you remove line 5 'gerrit:' does it work?19:54
clarkbjpmelos: that was a recently addition and I wonder if your zuul version is old enough that they isn't valid19:55
clarkbs/recently/recent/19:55
jpmelosclarkb: Wow, actually worked!19:56
clarkbjpmelos: cool, now we know what the problem is. If you use a newer version of zuul (like tip of master) you can avoid that19:56
clarkbjpmelos: zuul has recently grown the idea of different types of triggers. triggers may come from gerrit events or time based events and so on19:56
jpmelosclarkb: Yea, I saw. I installed it from PIP so I thought it was a recent version. My mistake. :)19:57
jpmelosI think I'll stick with the PIP version, assuming it's a tested version and the tip of the branch might be somewhat unstable and untested?19:58
mgagnejpmelos: I think master is used by openstack infra in prod19:59
clarkbjpmelos: we deploy directly from master19:59
mgagnejpmelos: what clarkb said19:59
clarkbso it is fairly well tested. The last release was the last time we support the jenkins http call backs though19:59
clarkbif you are using that method you will want to stick with it until you are ready to switch to gearman20:00
clarkbat this point I think we are recommending the gearman stuff beacuse it is awesome20:00
jpmelosOh, since it's a fresh install I guess it's wiser to go straight to the tip of the branch then.20:00
*** adalbas has joined #openstack-infra20:00
jpmelosclarkb: I've looked into Gearman, thanks to Zuul, and it is indeed awesome, haha.20:01
mgagneclarkb: could it be possible to support both?20:01
clarkbmgagne: jeblair was pretty firm in only supporting the one we use20:01
clarkbmgagne: because we definitely won't test the old method like we do the gearman stuff20:02
mgagneclarkb: less code to maintain, I understand that =)20:02
clarkband he feels strongly that gearman is the correct way to do this stuff20:02
clarkbthe http call backs were a giant hack that required weird firewally rules and so on20:02
clarkbwith gearman you can do client ssl auth and you only need to allow connections into the master20:03
mgagneclarkb: remind me of some dark stories...20:03
*** woodspa has quit IRC20:03
*** jjmb has joined #openstack-infra20:05
jeblairclarkb, sdague: lgtm20:06
jeblairaprvd20:06
clarkbjeblair: ty20:06
clarkbmy turn to go quickly grab lunch. back soo20:06
clarkb*soon20:06
jpmelosclarkb: Installed Zuul from master, works beautifully. Thank you!20:07
clarkbjpmelos: no problem. Good luck!20:07
clarkbjeblair: maybe we should consider a new zuul release?20:07
jpmelos:q20:07
jpmelosops... -.-20:07
openstackgerritA change was merged to openstack-infra/config: robustify htmlifier for logs  https://review.openstack.org/4148620:08
openstackgerritJames E. Blair proposed a change to openstack-infra/gearman-plugin: Rework starting/stopping executors  https://review.openstack.org/4148820:08
jeblairclarkb, zaro: ^ updated to make multi-exec work better20:08
*** sandywalsh has quit IRC20:09
sdagueclarkb: once you get back from lunch, you need to +A this then - https://review.openstack.org/#/c/38785/ :)20:11
openstackgerritA change was merged to openstack-infra/config: A few updates for RHEL based systems  https://review.openstack.org/3778920:13
Shrewsjeblair: so, the ssl changes i made to gear a while back won't actually work correctly until we can do some exception handling around the send() and recv() calls. There were lots of send()'s when I looked, so I just haven't had time to make that change.20:16
*** dina_belova has quit IRC20:16
jeblairShrews: good to know; i don't have a lot of practical experience in that area20:17
ShrewsIf it were redesigned to limit those to a single call, that would be super mcawesomesauce20:17
Shrewsjeblair: i didn't either until i had to make python-gearman actually work  :)20:18
jog0looking for one last review on https://review.openstack.org/#/c/41218/20:19
jog0if anyone has a moment, its a reqs change20:20
openstackgerritDoug Hellmann proposed a change to openstack-infra/config: Add logging to the openstack-metering IRC channel  https://review.openstack.org/4151220:20
*** sandywalsh has joined #openstack-infra20:20
*** melwitt has joined #openstack-infra20:23
*** sandywalsh has quit IRC20:23
*** jjmb has quit IRC20:29
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Remove unneeded node label parameters  https://review.openstack.org/4151620:29
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Make all devstack-vm jobs single-use  https://review.openstack.org/4151720:29
*** dkliban has joined #openstack-infra20:30
fungimordred: when you're near an internet again, is gate-requirements-install assumed to be working yet? if so, have a look at the end of http://logs.openstack.org/18/41218/1/check/gate-requirements-install/f8cdc4d/console.html.gz from saturday20:31
*** pentameter has quit IRC20:37
*** pabelanger_ has quit IRC20:37
*** pabelanger has joined #openstack-infra20:38
*** pentameter has joined #openstack-infra20:38
*** sandywalsh has joined #openstack-infra20:38
fungijog0: lgtm. it will still take me some time to get used to the requirements project having requirements of its own ;)20:38
*** vipul is now known as vipul-away20:38
*** vipul-away is now known as vipul20:38
jog0fungi: wait, I was trying to change the cap on global requirments20:39
fungijog0: oh! in that case i was going to ask whether you had tested that all current integrated projects were clean against the new hacking release :/20:40
fungibut since you were just changing the version of hacking used by the pep8 job on the requirements project itself, and it succeeded, i was fine with it as is20:41
jog0fungi: so my understanding was: changing in reqs would change for integration tests in devstack20:41
*** andreaf has quit IRC20:41
jog0but not the unit tests where pep8 is done20:41
fungijog0: oh, i thought you had to change global-requirements.txt to get that behavior20:41
jog0because I know for a fact that not all projects pass hacking 0.720:41
jog0fungi: gah20:41
jog0fungi: but hacking is only a testing requirment20:43
jog0which is why I put it in testing20:43
* jog0 is confused20:43
fungijog0: but i could be mistaken. i think this may be a corner case since we can only really exercise it by running the pep8 jobs for all requirements-enforced projects with their requirements edited inline20:43
fungijog0: a while back requirements.txt and test-requirements.txt in openstack/requirements got merged into one common list, and then renamed to global-requirements.txt20:44
fungijog0: because the requirements project itself was growing supporting tools which would in turn have their own requirements and test requirements20:44
jog0then what test-requirments?20:44
*** dprince has quit IRC20:44
fungitest-requirements.txt is the requirements needed for testing the requirements project itself20:45
fungiat this point20:45
* fungi looks back at the commit history to confirm when that changed20:45
jog0git show f7fbf480daf8dbb09650a6de4f21c1a487bfdedb20:45
fungijog0: https://review.openstack.org/3935820:46
jog0yeah your right, now for the follow up question if I change global-reqs does that mean unit tests use those?20:46
fungiahh, yeah you found it20:46
jog0or just devstack20:46
fungijog0: if you change global-requirements.txt as of right now it will propose patches against all enforced projects to match the change20:47
fungijog0: soon it will also keep projects from being able to merge any new changes until they correct their requirements lists to match what global-requirements.txt dictates20:47
jog0fungi: propose patches is fine some will fail20:48
jog0fungi: whoa intense20:48
jog0although for hacking that is doable, just update the ignore list for a bit20:48
fungijog0: i think there was a future to-do list item to perhaps run the unit and static analysis tests for all projects when a change is proposed to global-requirements.txt to confirm it won't break anyone20:48
jog0fungi: we have a very basic test for that in hacking today20:49
jog0it does nova only20:49
jog0 and always is green20:49
jog0 but the logs are useful20:49
fungiso as of right now, upping it won't break anyone, but i believe the goal is to have everyone on a common set of requirements by havana release time (mordred/sdague can confirm), so if this is something you expect to be working everywhere by then it's probably okay20:50
openstackgerritJoe Gordon proposed a change to openstack/requirements: Bump hacking to 0.7 globally  https://review.openstack.org/4152320:50
*** SergeyLukjanov has quit IRC20:51
jog0fungi: thanks for the clarification, perhaps test-reqs should have a big warning for dumb people like me20:51
fungijog0: that's a great idea. and i think the pbr bug regarding comment lines in the requirements lists is fixed now, so i doubt there would be any resistance to some good boiler plate in the requirements-project-specfic requirements lists saying "these are not the global requirements you're looking for" or similar20:52
fungii think the assumption when 39358 merged was that people would see the insanely short lists of requirements and test requirements and realize it was far from complete20:53
*** vipul is now known as vipul-away20:53
fungibut that's probably not a great assumption in reality20:53
openstackgerritJoe Gordon proposed a change to openstack/requirements: Add note to test-requirements saying its local only  https://review.openstack.org/4152420:54
fungiand anyway, your previous patch won't go to waste. we'd have wanted to update the requirements requirements to match what went in global requirements20:54
jog0fungi: right20:54
*** ArxCruz has quit IRC20:56
clarkbsdague: https://review.openstack.org/#/c/38785/ has been approved20:57
clarkbfungi: jeblair ^ I will keep an eye on that20:57
fungiclarkb: k20:57
jog0$ source devstack/openrc20:58
jog0No packages found matching xenserver-core.20:58
jog0huh?20:58
jog0from devstack20:58
*** emagana has joined #openstack-infra20:58
fungirun locally or in a ci job?20:58
jog0fungi: locally20:59
openstackgerritA change was merged to openstack-infra/config: enable htmlify on main log vhost  https://review.openstack.org/3878520:59
clarkbjog0: openrc sources stackrc which runs is_package_installed xenserver-core21:02
clarkbjog0: is that an error or just a helpful message?21:02
jog0clarkb: its an anyoing message21:02
jog0not useful21:02
jog0I am using libvirt and qemu why do I have to ever see a xenserver msg21:02
fungiit's advertising xenserver support in devstack, clearly ;)21:02
jog0fungi: thats what I am thinking too :)21:03
clarkbthe /dev/null redirect for dpkg does not include stderr21:04
jpmelosGuys, I created a new flag 'Built' in Gerrit. I added a line "built: 1" to the layout.yaml but apparently Zuul didn't respond to that... Can I use new labels with Zuul, somehow?21:07
openstackgerritA change was merged to openstack-infra/config: Mark puppet-lint jobs as voting  https://review.openstack.org/4150221:07
*** ^d has quit IRC21:10
clarkbjpmelos: https://github.com/openstack-infra/config/blob/master/modules/openstack_project/files/zuul/layout.yaml#L27-L29 is how we do it21:10
clarkbso you should be able to do something similar21:10
*** ^d has joined #openstack-infra21:12
*** ^d has joined #openstack-infra21:12
*** mrmartin has quit IRC21:13
anteayais this the reference for the wheels that were onboarded over the weekend? https://pypi.python.org/pypi/wheel21:13
jpmelosclarkb: I didn't mean to use the new flag to trigger, but instead to be set by Zuul.21:13
*** vipul-away is now known as vipul21:14
jpmelosclarkb: And it actually worked, I had forgotten to add the permissions in Gerrit for Zuul user. I'm sorry!21:14
clarkbjpmelos: https://github.com/openstack-infra/config/blob/master/modules/openstack_project/files/zuul/layout.yaml#L32-L38 sets that21:14
clarkbcool21:14
clarkbanteaya: that is a tool for dealing with wheels. The actuall format is documented in PEP 427 which is linked off of that page21:15
anteayaah okay thanks, will dig21:15
anteayaI do believe this is it: http://www.python.org/dev/peps/pep-0427/21:16
clarkbyup21:16
anteayata21:17
*** dina_belova has joined #openstack-infra21:17
*** sarob has quit IRC21:19
*** sarob has joined #openstack-infra21:20
*** dina_belova has quit IRC21:22
*** sarob has quit IRC21:24
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Don't compress very, very recent log files  https://review.openstack.org/4154421:27
*** dina_belova has joined #openstack-infra21:27
fungionce we eventually merge that, i'll do one final cleanup of the files the compression cron job keeps spamming us about21:28
*** jjmb has joined #openstack-infra21:28
*** sarob has joined #openstack-infra21:28
*** thomasm has quit IRC21:29
*** blamar has quit IRC21:29
*** sarob has quit IRC21:30
*** sarob has joined #openstack-infra21:30
*** sarob has quit IRC21:31
*** sarob has joined #openstack-infra21:31
openstackgerritA change was merged to openstack/requirements: Bump hacking to 0.7  https://review.openstack.org/4121821:31
*** dina_belova has quit IRC21:31
*** emagana has quit IRC21:33
*** emagana has joined #openstack-infra21:35
*** svarnau has joined #openstack-infra21:38
*** jjmb has quit IRC21:39
*** mriedem has quit IRC21:39
zarojeblair, clarkb: i get this when deleting slaves. http://paste.openstack.org/show/43975/21:42
zarojeblair, clarkb : problem was probably around before your patch.21:43
*** emagana has quit IRC21:48
*** emagana has joined #openstack-infra21:49
*** sandywalsh has quit IRC21:50
*** jergerber has quit IRC21:54
*** jjmb has joined #openstack-infra21:54
*** jpeeler has quit IRC21:56
*** rfolco has quit IRC21:57
*** emagana has quit IRC21:59
*** HenryG has quit IRC22:01
*** HenryG has joined #openstack-infra22:02
openstackgerritA change was merged to openstack-infra/config: Create new repo to host legacy heat-cfn client.  https://review.openstack.org/3822622:03
clarkbstevebaker: ^22:03
*** burt has quit IRC22:03
*** lcestari has quit IRC22:04
* stevebaker does the happy dance22:04
stevebakerthanks22:05
openstackgerritRyan Petrello proposed a change to openstack-infra/config: Add pecan project.  https://review.openstack.org/4155222:06
*** sandywalsh has joined #openstack-infra22:06
clarkbjeblair: any concern approving https://review.openstack.org/#/c/39329/5 it updates most (maybe all) of our jobs22:07
clarkbjeblair: but your comments indicated you were confident the changes wouldn't matter22:07
*** koobs has quit IRC22:08
clarkbfungi: where are we on releasing a new git-review so that we can push the pbr migration and unittesting through?22:08
*** koobs has joined #openstack-infra22:08
jeblairclarkb: i think it's good to go22:09
clarkbjeblair: ok I will approve22:09
clarkbfungi: I am reviewing that pair of git-review changes now22:10
fungiclarkb: yes, want to get some eyes on https://review.openstack.org/40799 and https://review.openstack.org/40800 as last-minute tweaks before we release22:10
fungii assume those are the two you mean22:10
fungibasically the first gets pep8 (hacking) passing again, and the second is a cosmetic fix for the expanded multi-commit output22:11
*** changbl has quit IRC22:11
clarkbthe pbr change needs updating, but I will leave those comments on the review22:11
*** datsun180b has quit IRC22:12
clarkbfungi: isn't hacking <0.6 really old?22:12
fungiahh, yeah i figured the pbr change was somewhat out of date with pbr state of the art since that evolved after the patch22:12
fungiclarkb: alternatively we get git-review working with hacking 0.7 and then adjust the pbr addition accordingly22:12
clarkbfungi: put another way should we update git-review to deal with new hacking?22:12
clarkbfungi: what about hacking 0.6?22:13
fungiclarkb: either. i think 0.5 was simply the latest when that patch was originally drafted22:13
fungiso at the time <0.6 was the recommendation22:13
clarkbgotcha22:13
fungibut we didn't previously pin hacking at all, so we drifted out of compliance with the job22:14
clarkbya22:14
fungii was trying not to cause too much churn underneath the pbr and integration test patches figuring we could address latest hacking and whatever else after merging those22:14
fungibut i'm fine changig direction there if you think that's bad22:15
clarkbfungi: I am running the pep8 job locally to see how bad it is22:15
clarkblooks like it is just the shebang? is that something that will need to be fixed in hacking? if so I am fine with the current pin change22:16
fungii think 0.7 was merely having trouble finding the apache license in the script22:16
fungior might have been 0.6 actually22:16
fungipart of why i wasn't keen on bringing current git-review up to date with those checks is that there's some refactoring/moving of files going on in the pbrizaton change, so what is and isn't compliant will change there22:17
fungithus it seemed like a lot of wasted energy to change it between them22:18
fungifigured i'd just stack another change on top of the integration test one to raise the hacking pin and make whatever adjustments were needed to bring that into compliance with the newer checks22:18
clarkbfungi: I am happy with that change now that I have thought about it22:20
clarkbfungi: in particular because I think hacking will need to learn how to treat shebangs22:20
cody-somervilleDoes anybody here know anything about this problem and what might the solution be?: https://answers.launchpad.net/devstack/+question/23379322:20
fungiyeah, and then we'll be turning right around and getting rid of the shebang anyway (from its perspective)22:20
*** jjmb has quit IRC22:20
fungicody-somerville: aww, you got my hopes up that someone had asked a ci/infrastructure services question on ask.o.o :(22:21
clarkbcody-somerville: I think it is related to the setuptools distribute merge and fedora being braindead about pip22:22
*** HenryG has quit IRC22:22
clarkbcody-somerville: apparently if you ensure pip 1.4 is installed everything just works22:22
cody-somervilleI'm getting it on Ubuntu when I try to do python setup.py develop on heat trunk22:22
fungiright, lemme dig up a link to the relevant ml thread22:22
*** pentameter has quit IRC22:22
*** HenryG has joined #openstack-infra22:22
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Add nodepool project  https://review.openstack.org/4156522:23
fungicody-somerville: i think it was this monster thread where most of the discussion on it took place... http://lists.openstack.org/pipermail/openstack-dev/2013-August/013039.html22:24
clarkbfungi: https://review.openstack.org/#/c/40800/ has a comment but I +2'd it22:24
clarkbcody-somerville: long story short is setuptools and distribute did not merge in a very nice way22:24
*** openstackgerrit has quit IRC22:24
clarkbcody-somerville: pip is smart enough to work around the brokenness so upgrading pip is the path of least resistance22:25
*** openstackgerrit has joined #openstack-infra22:25
*** HenryG_ has joined #openstack-infra22:25
clarkbjeblair: does nodepool get its own project because it is doing the general purpose pool management?22:26
*** jerryz has joined #openstack-infra22:26
*** jjmb has joined #openstack-infra22:26
clarkbjeblair: and does that change invalidate the WIP change to add it to d-g?22:26
*** dina_belova has joined #openstack-infra22:28
jeblairclarkb: that's my current line of thinking; feel free to consider the review a referendum on that.  it's not devstack-gate specific, so it doesn't make sense to clutter up that repo with it (and have it share a change queue).  being in its own repo also means pbr, entrypoints, and other boilerplate makes a bit more sense.22:28
fungiclarkb: i'd love to override print with a call to textwrap.wrap() but that's a little harder to do in python 2.x :(22:29
fungiooh, unless i pull in print_function22:29
*** HenryG has quit IRC22:29
jeblairclarkb: i have responded to your review of the wip change.  if/when nodepool repo exists, i'll repropose there, but will update the existing change until then.22:29
jeblairthough, heh, i think i did miss something.  :)22:30
fungiclarkb: yeah, with print_function we can do print(*textwrap.wrap(stuff))22:30
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Add nodepool project  https://review.openstack.org/4156522:31
*** jjmb has quit IRC22:32
openstackgerritA change was merged to openstack-infra/jenkins-job-builder: Added more options to the Build Timeout plugin  https://review.openstack.org/3932922:32
*** rfolco has joined #openstack-infra22:33
*** dina_belova has quit IRC22:34
*** emagana has joined #openstack-infra22:34
clarkbjeblair: https://review.openstack.org/#/c/39773/ has my +2, but I figure you can approve when you are comfortable22:35
clarkbthough it seems like a low risk change. The user input is only interpreted within the browser so worst case they pwn themselves22:35
clarkband it is just doing string comparisons which should be safe anyways22:35
jeblairclarkb: the best kind of pwning22:35
pleia2fungi: re: git replication - is it not creating the required git directories+files with the ssh sync at all, or just not `git init`-ing them?22:36
fungipleia2: i do not believe it will do either22:36
fungipleia2: though if you have test results to the contrary, i am likely to believe them22:36
pleia2fungi: no results yet, just trying to figure out where we are22:37
pleia2fungi: I am concerned that if we create and init the directories, then rsync them over it'll be weird for git22:37
fungipleia2: i don't really think we need rsync22:37
pleia2sorry, s/rsync/ssh22:37
fungipleia2: git should push commits into them, starting from sha 0x022:38
pleia2fungi: ok, so git init in an empty directory shouldn't cause the incoming sync via ssh to get confused?22:38
fungipleia2: i don't think so. it's worth looking at manage_projects.py to see what it does in new project directories on the gerrit server, particularly the local mirror in /var/lib/git22:39
* fungi looks too, can't remember exactly22:39
pleia2fungi: well, new project directories should be ok because it's all new, my concern is sshing data from an existing repo to a newly inited directory22:40
clarkbiirc it is just mkdir then chown22:40
clarkbor rather git init then chown22:40
*** pcm_ has quit IRC22:41
*** pcm_ has joined #openstack-infra22:41
fungiwell, to pleia2's point, that's what it does for creating a new empty project, so the ~gerrit2 copy and the mirror start in the same state in that case22:41
* pleia2 doing some tests22:42
fungibut i believe gerrit will simply mirror any missing commits into the remote copy, though i strongly suspect it needs it to be a git repo first (thus the init is lkely required)22:42
clarkbfungi: it does the same thing if it is importing an existing project too22:42
clarkbwhere existing project is a project in gerrit with content, possible created in the same manage_projects run22:43
pleia2fungi: ok, I'll test to confirm the strong suspicion22:43
pleia2thanks22:43
fungioh, good point. i was looking at the wrog directory i think22:43
pleia2clarkb: ah, good22:43
fungiyup, git --bare init %s22:43
*** prad_ has quit IRC22:44
fungiunconditionally for the copy in /var22:44
fungipleia2: https://github.com/openstack-infra/jeepyb/blob/master/jeepyb/cmd/manage_projects.py#L36022:45
clarkbjeblair: https://review.openstack.org/#/c/40651/ looks like the sort of thing you may be interested in22:45
jeblairclarkb: indeed, thanks.22:49
clarkbfungi: https://review.openstack.org/#/c/40973/ is that something that should be abandoned or are we keeping it open to track the potential fix?22:49
*** HenryG__ has joined #openstack-infra22:50
fungiclarkb: i haven't had a chance yet to test whether the {{ }} escaping workaround will work22:50
fungiif it does, i think the fix is to just document it22:51
fungibut was waiting to see if anyone else had any serious judo they could suggest to make deep_format smarter there22:51
clarkbfungi: I don't. Weird issues like this are what make me think we should use a proper template format like jinja222:52
clarkbso that the library can worry about it22:52
clarkbbut that is a very heavy dependency compared to what we currently depend on22:52
openstackgerritA change was merged to openstack-infra/jenkins-job-builder: Added ignore-cache and flush-cache options  https://review.openstack.org/4065122:52
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Add nodepool project  https://review.openstack.org/4156522:53
clarkbgoogle search pyghmi and google searches for pygmy instead22:53
clarkbthank you google22:53
*** HenryG_ has quit IRC22:53
fungiclarkb: pyghmi seems to be the python-ipmi project renamed22:54
clarkbya, I wanted the pypi page and google normally gives that to me as thefirst hit22:54
fungiahh, hah22:54
clarkbdevananda: you about?22:54
openstackgerritJames E. Blair proposed a change to openstack-infra/devstack-gate: WIP: new nodepool  https://review.openstack.org/4095222:54
pleia2fungi: does the sshed content from gerrit include a .git directory?22:55
*** pcm_ has quit IRC22:55
pleia2(it should, but dot files can be funny with ssh)22:55
fungipleia2: no, it mirrors into a bare git repo, so your directory is roughly equivalent to what the .git directory would have been in a non-bare repo22:55
pleia2ah, hm22:55
clarkbfungi: the first thing that strikes me as odd is the version at https://pypi.python.org/pypi/pyghmi/22:55
jeblairpleia2: it's a 'git push' over ssh; so it's not a shell-level operation, it's running git receive-pack22:56
clarkbit definitely won't make pip happy22:56
*** pcm_ has joined #openstack-infra22:56
fungiwhich is why those directories typically end in .git22:56
pleia2jeblair: ah, git push22:56
fungiclarkb: oh, ew. that is not sortable either22:56
pleia2fungi: got it, thanks22:56
clarkbfungi: and we need to rename the project in stackforge and stuff too otherwise a lot of the publishing type tools will not work22:57
mordredscrollback. eww22:57
fungimordred: i had something for you, way, way back up there22:57
clarkbmordred: don't read all of the scrollback just look at python-ipmi/pyghmi since that makes sense to you I think22:57
mordredfungi: awesome22:57
mordredok22:57
mordredlooking22:57
mordredso - the version is what you get from pbr before you tag anything22:58
fungimordred: something about a requirements job which is succeeding while still chucking exceptions/tracebacks which look to me like the job should probably fail22:58
fungibut wanted a second opinion22:58
*** svarnau has quit IRC22:58
*** HenryG_ has joined #openstack-infra22:58
*** pcm__ has joined #openstack-infra22:59
clarkbhttps://review.openstack.org/#/c/41086/ reviewed with the info about pbr and what I think needs to happen to make the switch cleanly23:00
mordredclarkb: the first thing is not an issue with pip >= 1.423:02
mordredas the git sha has a letter, which marks it as pre-release23:02
mordredclarkb: what is it about the stackforge things that you think won't work?23:02
*** pcm_ has quit IRC23:02
*** HenryG__ has quit IRC23:03
jeblairmordred: python-ipmi half-renamed itself to pyghmi23:03
clarkbmordred: our publishing jobs depend on the name of the repo to do the right stuff23:03
clarkbso python-ipmi claiming to be pyghmi is not sufficient23:03
jeblairmordred: the contents of the repo have changed, but the repo itself has not; further, someone has registered pyghmi and uploaded a (poorly constructed) version to pypi, and has not made openstackci the owner.23:04
mordredgreat. thank you jeblair. that is clear23:04
mordreddevananda: ^^23:04
*** rnirmal has quit IRC23:06
mordreddevananda: you need to be one or the other. also, which ever one you are, you need to get openstackci made owner of the pypi entry23:06
mordreddevananda: if you decide to stick with pyghmi, you'll need us to lump in a repo rename with the next time we do a batch of renames23:07
jeblairwe should make that an agenda topic for tomorrow23:07
clarkb++23:07
devanandamordred: yep. jbjohnso_ set up the pypi stuff. I'll nag him again to xfer it to me (or you guys)23:07
mordredjeblair: ++23:08
mordredI've been not doing anything about the ones on my plate due to travel - I should be able to be involved/do it this weekend/friday/whenever23:09
*** rcleere has quit IRC23:09
ttxfungi: I do like it23:11
clarkbjog0: still around?23:11
ttx(the zuul status aligned progress bar thing)23:11
fungittx: ahh, yes23:11
*** ^d has quit IRC23:11
clarkbjog0: for your hacking bump you should actually bump it in both files as requirements should use a subset of the global requirements for its own testing23:11
fungittx: also did you see my code snippet for consuming the zuul status.json to find the jenkins job url on the right server?23:12
fungittx: was a few days ago23:12
ttxyes, just copypasted the url, will check later23:13
ttxfungi: thx23:13
fungiokay, great. hope that helps with the transition23:13
*** fifieldt has joined #openstack-infra23:15
jog0clarkb: that was a seperate patch, because I didn't know better23:16
jog0that was merged23:16
jog0by both I mean global and test23:17
*** weshay has quit IRC23:17
clarkbjog0: I see, your second change confused me because it still shows <0.723:18
clarkbI will lift my -123:18
clarkbfungi: https://review.openstack.org/#/c/41544/1/modules/openstack_project/files/log_archive_maintenance.sh do we need to worry about order there to make sure we don't do a bunch of extra work. would it be easier on find to check the mod time after matching all of the other criteria?23:18
jog0clarkb: it needs a rebase I think23:19
openstackgerritJoe Gordon proposed a change to openstack/requirements: Bump hacking to 0.7 globally  https://review.openstack.org/4152323:20
jog0there23:20
fungiclarkb: maybe... i'd have to play around with ordering and see if it works. some of find's options change their meaning a bit when reordered23:20
clarkbjog0: https://review.openstack.org/#/c/41524/ is the one that confused me23:21
clarkbwe'll see what happens if I approve that one23:21
clarkbthat one needs a rebase23:22
jog0ahh, will rebase in a few23:23
*** rfolco has quit IRC23:25
*** dina_belova has joined #openstack-infra23:28
*** pcrews has quit IRC23:31
*** lifeless has quit IRC23:32
*** dina_belova has quit IRC23:33
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Allow url to be updated  https://review.openstack.org/4102023:33
clarkbmordred: jog0 https://review.openstack.org/#/c/41355/1 isn't the example in the commit message something that is not py3k compatible and should result in an error?23:37
*** ^d has joined #openstack-infra23:38
*** ^d has joined #openstack-infra23:38
*** rcleere has joined #openstack-infra23:39
jog0clarkb: I think that is py33 compat the 'print ()' is py3323:44
jeblairzaro: i think that exception was the NPE we were getting earlier that you worked around; i suspect that it may have been a race condition, and we've eliminated or changed the race so that now when a node is deleted, the node does not have a computer by the time that is called.23:45
jeblairzaro: i'll update the change to make that better23:45
openstackgerritJoe Gordon proposed a change to openstack/requirements: Add note to test-requirements saying its local only  https://review.openstack.org/4152423:46
*** moted has quit IRC23:47
*** nati_ueno has quit IRC23:47
*** moted has joined #openstack-infra23:47
jog0clarkb: ^23:50
*** sdake__ has quit IRC23:51
*** sdake has joined #openstack-infra23:52
*** mberwanger has joined #openstack-infra23:52
*** dkliban has quit IRC23:53
*** dkliban has joined #openstack-infra23:54
ttxjeblair: looks like we have a lot of bugs not being marked FixCommitted in LP lately23:55
*** nati_ueno has joined #openstack-infra23:55
ttxjeblair: there might be some issue in the recent patch. I thought it was just the ugs with lots of tasks doing timeouts, but last week there were several mono-tasks that failed too23:56
*** gyee has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!