Monday, 2013-10-21

openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: add an es_query tool  https://review.openstack.org/5284700:11
*** SlickNik has quit IRC00:13
*** SlickNik has joined #openstack-infra00:14
*** senk has joined #openstack-infra00:16
*** matsuhashi has joined #openstack-infra00:25
*** nati_ueno has joined #openstack-infra00:30
*** wenlock has quit IRC00:32
*** senk has quit IRC00:44
*** adalbas has joined #openstack-infra00:48
sdaguejog0: some point early tomorrow if you can run through my stack of er patches and figure out what you like / don't like on the refactor, that would be cool. The stack is too deep to really go much further until the direction of slicing out bits is acked00:53
*** nosnos has joined #openstack-infra00:56
fungiharlowja: speaking of your curses interface, did you see dansmith's https://github.com/kk7ds/openstack-gerrit-dashboard00:57
harlowjaya, i've seen that00:57
harlowjasimilar, except the one i made is much more GUI like :)00:57
harlowjaand takes advantage of alot more of curses00:58
* fungi spends as much of his time in xterms as possible. always love that people still hack on terminal-based tools00:58
harlowjadef00:58
harlowjahttps://github.com/harlowja/gerrit_view/#curse_gerrit is much more pretty imho ;)00:58
fungii can't wait to try it out00:58
harlowjadef, adding word highlighting right now00:58
harlowjaso things like 'failed' show up in red00:58
harlowjamaybe column sorting someday00:58
fungidansmith's thing has zuul status integration going for it... did you add anything similar?00:58
harlowjai'm hooked into whatever jenkins sends out00:59
harlowjaso maybe thats not zuul, idk, it gets all comments added, all status changes00:59
fungiahh, okay, so more gerrit-centric then00:59
harlowjaya, i think01:00
harlowjalet me know what u think01:01
harlowjai like seeing it in realtime, thats neat01:01
harlowjahttp://excess.org/urwid/ was a big help in making it work easily01:02
harlowjaonce u figure urwid out, its pretty easy to use it01:03
fungilooks like a great toolkit. hadn't stumbled across that one before01:03
harlowjaya, just an initial learning period01:04
*** senk has joined #openstack-infra01:08
*** SlickNik has quit IRC01:08
*** oubiwann has quit IRC01:09
*** SlickNik has joined #openstack-infra01:09
*** oubiwann has joined #openstack-infra01:09
harlowjanice thing is that library also makes it so pgdown works, scroll keys...01:10
harlowjastuff i would of had to make curses do myself01:10
*** nosnos has quit IRC01:10
*** nosnos has joined #openstack-infra01:11
*** dkranz has quit IRC01:17
harlowjafeel free to add zuul progress bars, that'd be cool :)01:18
harlowjamaybe using, http://excess.org/urwid/docs/reference/widget.html#progressbar01:18
*** wenlock has joined #openstack-infra01:21
*** juice has quit IRC01:23
*** juice has joined #openstack-infra01:23
*** juice has joined #openstack-infra01:24
*** juice has joined #openstack-infra01:24
*** juice has joined #openstack-infra01:25
*** juice has quit IRC01:25
*** juice has joined #openstack-infra01:26
*** juice has joined #openstack-infra01:26
*** ericw has joined #openstack-infra01:28
harlowjaor maybe i'll add that next weekend, ha01:29
*** amotoki has quit IRC01:32
fungiyeah, as much as i'd love to, my dance card is currently full ;)01:34
fungithe urwid does look wonderfully straightforward. i expect i'll probably end up using it in stuff now that i know it's there01:36
harlowja:)01:36
harlowjaall good01:36
*** yolanda has quit IRC01:36
fungier, i meant the urwid *tutorial* does look wonderfully straightforward01:37
harlowjaits not so bad01:38
* fungi sometimes leaves a word01:38
harlowjahttps://github.com/harlowja/gerrit_view/blob/master/curse_gerrit#L333 can help :)01:38
harlowjaits still confusing a little, ha01:38
fungiooh, nice example01:39
*** ericw has quit IRC01:41
harlowja:)01:41
*** nicedice_ has joined #openstack-infra01:45
*** xchu has joined #openstack-infra01:45
harlowjathe above uses gerritlib, so thx u guys for that (i think infra maintains that)01:47
*** dcramer_ has joined #openstack-infra01:48
*** nicedice has quit IRC01:48
*** ljjjustin has joined #openstack-infra01:49
*** ericw has joined #openstack-infra01:49
*** SergeyLukjanov has joined #openstack-infra01:53
*** Guest25369 has joined #openstack-infra01:59
*** Guest25369 has quit IRC01:59
*** senk has quit IRC01:59
*** wenlock_ has joined #openstack-infra02:01
*** dcramer_ has quit IRC02:13
*** adalbas has quit IRC02:19
*** dcramer_ has joined #openstack-infra02:25
*** sdake has joined #openstack-infra02:28
*** dims has quit IRC02:34
*** simonmcc has quit IRC02:36
*** simonmcc has joined #openstack-infra02:37
*** erfanian has joined #openstack-infra02:39
*** ericw has quit IRC02:41
*** SergeyLukjanov has quit IRC02:45
*** sandywalsh has quit IRC02:56
*** oubiwann_ has quit IRC03:04
*** dkranz has joined #openstack-infra03:09
openstackgerritMatthew Treinish proposed a change to openstack-infra/elastic-recheck: Convert test_classifier to be a unit test  https://review.openstack.org/5073303:11
*** dkranz has quit IRC03:20
*** ftcjeff_ has joined #openstack-infra03:24
*** xchu has quit IRC03:25
*** jeremyb has quit IRC03:25
*** ftcjeff__ has quit IRC03:25
*** xchu has joined #openstack-infra03:25
*** jeremyb has joined #openstack-infra03:26
*** D30 has joined #openstack-infra03:33
*** ljjjustin has quit IRC03:33
*** rakhmerov has joined #openstack-infra03:33
*** senk has joined #openstack-infra03:38
*** ericw has joined #openstack-infra03:49
*** xchu has quit IRC03:54
*** yaguang has joined #openstack-infra03:58
*** yaguang has quit IRC03:58
*** yaguang has joined #openstack-infra03:59
openstackgerritA change was merged to openstack-infra/elastic-recheck: don't explode if a query no longer has failures  https://review.openstack.org/5250904:04
*** xchu has joined #openstack-infra04:06
*** basha has joined #openstack-infra04:11
*** erfanian has quit IRC04:14
*** wenlock_ has quit IRC04:16
*** yaguang has quit IRC04:19
*** yaguang has joined #openstack-infra04:19
*** jeremyb has quit IRC04:24
*** jeremyb has joined #openstack-infra04:24
*** senk has quit IRC04:24
*** basha has quit IRC04:28
*** xchu has quit IRC04:37
*** oubiwann has quit IRC04:42
*** oubiwann has joined #openstack-infra04:43
*** xchu has joined #openstack-infra04:54
*** senk has joined #openstack-infra04:56
*** yamahata has joined #openstack-infra05:12
*** nicedice_ has quit IRC05:14
*** marun has joined #openstack-infra05:18
*** matsuhashi has quit IRC05:20
*** yaguang has quit IRC05:21
*** matsuhashi has joined #openstack-infra05:21
*** ericw has quit IRC05:21
*** sdake has quit IRC05:41
*** basha has joined #openstack-infra05:43
*** boris-42 has joined #openstack-infra05:52
*** senk has quit IRC05:57
*** SergeyLukjanov has joined #openstack-infra06:00
*** nosnos has quit IRC06:00
*** nosnos_ has joined #openstack-infra06:00
*** pblaho has joined #openstack-infra06:00
*** matsuhas_ has joined #openstack-infra06:01
*** matsuhashi has quit IRC06:01
*** wenlock has quit IRC06:06
*** thomasbiege has joined #openstack-infra06:08
*** thomasbiege2 has joined #openstack-infra06:09
*** thomasbiege has quit IRC06:12
*** jcoufal has joined #openstack-infra06:16
*** odyssey4me has joined #openstack-infra06:19
*** odyssey4me has quit IRC06:23
*** sdake has joined #openstack-infra06:29
*** nati_ueno has quit IRC06:30
*** nati_ueno has joined #openstack-infra06:31
*** davidhadas has joined #openstack-infra06:36
*** nati_ueno has quit IRC06:36
*** yamahata has quit IRC06:36
*** matsuhas_ has quit IRC06:44
*** matsuhashi has joined #openstack-infra06:45
*** nosnos has joined #openstack-infra06:47
*** sdake has quit IRC06:48
*** boris-42 has quit IRC06:48
*** nosnos_ has quit IRC06:48
*** matsuhashi has quit IRC06:49
*** xchu has quit IRC06:57
*** pabelanger has quit IRC06:57
*** zul has quit IRC06:58
*** basha has quit IRC07:00
*** matsuhashi has joined #openstack-infra07:02
*** afazekas_ has joined #openstack-infra07:07
*** pabelanger has joined #openstack-infra07:09
*** zul has joined #openstack-infra07:11
*** basha has joined #openstack-infra07:11
*** garyk has joined #openstack-infra07:13
*** flaper87|afk is now known as flaper8707:13
*** rakhmerov has quit IRC07:13
*** rpodolyaka has left #openstack-infra07:13
garykhi, anyone know why stable patch gating is not working?07:13
garykthat is, after a patch is approved07:14
*** xchu has joined #openstack-infra07:16
*** guohliu has joined #openstack-infra07:18
*** dirk has joined #openstack-infra07:18
*** thomasbiege2 has quit IRC07:20
*** basha has quit IRC07:21
*** SlickNik has quit IRC07:24
*** SlickNik has joined #openstack-infra07:24
*** hashar has joined #openstack-infra07:25
*** basha has joined #openstack-infra07:26
*** basha has quit IRC07:27
*** dirk has quit IRC07:32
*** Alssi has joined #openstack-infra07:33
*** SergeyLukjanov is now known as _SergeyLukjanov07:37
*** _SergeyLukjanov has quit IRC07:38
*** SergeyLukjanov has joined #openstack-infra07:44
*** Alssi has quit IRC07:44
*** Alssi has joined #openstack-infra07:45
*** SergeyLukjanov has quit IRC07:49
*** rakhmerov has joined #openstack-infra07:52
*** thomasbiege has joined #openstack-infra07:54
LinuxJedihttps://review.openstack.org/#/c/52866/ <- anyone know what is going on there, locally I don't need a rebase08:00
hasharLinuxJedi: noob support answer: are you sure you updated your remote and rebased on the remote release-v4 branch ?08:01
LinuxJedihttp://paste.openstack.org/show/48825/08:02
hashar:(08:03
LinuxJedithese problems only seem to happen to me when I have management breathing down my neck :)08:03
hasharmaybe ttx has access to Zuul log to find out why your change 52866 can't be merged automatically08:03
ttxhashar: I haven't.08:04
* ttx looks at LinuxJedi's patch08:04
hasharat least stackforge/libra tip of release-v4 has sha1 7025c177cc029e152caea1695dd811a45eff59b708:05
hasharhttps://review.openstack.org/#/admin/projects/stackforge/libra,branches08:05
hasharwhich is the parent of https://review.openstack.org/#/c/52866/ patchset208:05
LinuxJediack, that is what I see locally too08:06
hasharbut then Zuul has its own local git repo08:06
ttxLinuxJedi: yeah, it looks like it should be OK08:07
ttxdon't see any blatant FAIL on your side08:07
*** dkliban has joined #openstack-infra08:07
LinuxJediapart from my existence :)08:10
hashara few other changes are failing as well08:10
hasharie https://review.openstack.org/#/c/52873/08:10
hashar(while looking for open changes, there is a bunch of them having v-1 https://review.openstack.org/#/q/is:open,n,z )08:11
*** derekh has joined #openstack-infra08:11
hasharand the IRC bot does not seem to emit new patch notifications08:12
*** ericw has joined #openstack-infra08:13
LinuxJediit doesn't for the release-4 branch for us anyway.  I'm pretty sure it is configured that way08:16
hasharZuul events for the last 4 hours summarized per 5 minutes https://tinyurl.com/nwf5bth08:16
hasharI am not sure what is the server date, I guess it is not UTC08:17
hasharlast merge happened 2 hours and 40 minutes ago08:17
LinuxJedilooks like it is EDT time or something.  Or the graph has frozen08:18
LinuxJedieither way it is fail :)08:18
hasharand Zuul queue is empty http://zuul.openstack.org/status.json :D08:18
hasharso I guess the Zuul daemon can't reach Gerrit anymore08:18
*** jpich has joined #openstack-infra08:19
hasharguess you guys want to page someone with access on Zuul08:19
hasharnot sure whether you have any root awake already08:19
*** yassine has joined #openstack-infra08:20
tsufievclarkb, mordred: hi, guys! speaking of the fix to zuul - https://review.openstack.org/#/c/52689/ - it is not merged yet, and it seems still affecting murano-repository with the same issue (see https://review.openstack.org/#/c/52871/)08:23
LinuxJedihashar: I've done a local tag and built packages from that instead.  I can keep doing that for today08:23
tsufievclarkb, mordred: or is it some new bug? I've created a bug on launchpad https://bugs.launchpad.net/openstack-ci/+bug/124256908:24
uvirtbotLaunchpad bug 1242569 in openstack-ci "No patchset can be merged into murano-repository repo" [Undecided,New]08:24
LinuxJeditsufiev: same problem we are seeing08:24
hashartsufiev: seems Zuul is borked right now :/08:25
*** katyafervent has joined #openstack-infra08:25
*** thomasbiege2 has joined #openstack-infra08:25
*** basha has joined #openstack-infra08:26
tsufievLinuxJedi, hashar: sad :(. have you filed a bug?08:27
*** matsuhashi has quit IRC08:27
LinuxJedinope, I'll just beat up mordred08:28
*** thomasbiege has quit IRC08:28
*** matsuhashi has joined #openstack-infra08:28
* LinuxJedi believes he is in my tz right now08:28
hashartsufiev: no bug, but you just filled one apparently :]08:30
hasharI guess  launchpad bug 1242569 covers it08:30
uvirtbotLaunchpad bug 1242569 in openstack-ci "No patchset can be merged into murano-repository repo" [Undecided,New] https://launchpad.net/bugs/124256908:30
hasharnot much I can do myself :-] I just happen to maintain the Wikimedia Zuul setup08:31
tsufievhashar, LinuxJedi: then can you please press the button 'This bug affects me'? More attention won't hurt :)08:32
*** fbo_away is now known as fbo08:33
*** alexpilotti has joined #openstack-infra08:34
*** CaptTofu has quit IRC08:37
*** Ryan_Lane has quit IRC08:38
*** CaptTofu has joined #openstack-infra08:39
hashartsufiev: done :)08:39
hashareven updated the summary08:40
tsufievhashar: thanks :)08:41
*** pblaho has quit IRC08:45
*** basha has quit IRC08:48
*** pblaho has joined #openstack-infra08:49
*** tian has joined #openstack-infra08:49
*** johnthetubaguy has joined #openstack-infra08:50
*** boris-42 has joined #openstack-infra08:53
*** pblaho has quit IRC08:55
*** che-arne has joined #openstack-infra08:59
*** HenryG_ has joined #openstack-infra08:59
*** basha has joined #openstack-infra08:59
*** nosnos has quit IRC09:01
lifelessany insight anyone has on https://review.openstack.org/#/c/51547/ - it's based on trunk, but gerrit is claiming cannot merge.09:01
*** johnthetubaguy1 has joined #openstack-infra09:01
lifelessprobably needs admin access to gerrit to debug?09:01
*** nosnos has joined #openstack-infra09:01
*** HenryG has quit IRC09:01
lifelessmordred: I suspect you're the first person with such access to see this ^ :)09:02
*** dizquierdo has joined #openstack-infra09:03
garyklifeless: i had similar issues with stable patches09:03
jpichThat seems to be happening to every project right now, looking at the open reviews09:04
lifelessoh, so 'gerrit is bust' ...09:04
*** johnthetubaguy has quit IRC09:05
*** rpodolyaka has joined #openstack-infra09:05
garykmaybe the old and grumpy jenkins also needs a few days off to drink his tea09:06
jog0sdague: ack, I may be a little slow for the next few days, at linuxcon and got a presentation to do tomorrow09:07
*** basha has quit IRC09:07
ogelbukhhttp://status.openstack.org/zuul/09:08
*** Ryan_Lane has joined #openstack-infra09:08
hasharThe Zuul issue has been reported at https://bugs.launchpad.net/openstack-ci/+bug/124256909:09
uvirtbotLaunchpad bug 1242569 in openstack-ci "No patchset can be merged into any repository" [Undecided,Confirmed]09:09
hasharneeds someone with access on the Zuul box to fix it up I guess09:10
jog0sdague:  ping me again later and I will take a look09:10
jog0took a quick glance, overall direction sounds good09:10
*** basha has joined #openstack-infra09:12
*** osanchez has joined #openstack-infra09:13
*** Ryan_Lane has quit IRC09:15
*** markmc has joined #openstack-infra09:22
*** lcestari has joined #openstack-infra09:35
*** Ryan_Lane has joined #openstack-infra09:43
*** xchu has quit IRC09:44
*** thomasbiege2 has quit IRC09:48
*** Ryan_Lane has quit IRC09:51
*** ken1ohmichi has joined #openstack-infra09:51
*** thomasbiege1 has joined #openstack-infra09:55
*** pblaho has joined #openstack-infra09:58
*** pblaho has joined #openstack-infra09:58
*** pblaho has quit IRC10:00
*** pblaho has joined #openstack-infra10:00
*** ifarkas has joined #openstack-infra10:03
*** pblaho has quit IRC10:05
*** pblaho has joined #openstack-infra10:05
jeblairrestarted zuul10:07
*** thomasbiege1 has quit IRC10:08
*** basha has quit IRC10:09
*** d0ugal has joined #openstack-infra10:11
jeblairerror was too many open files; not in a position to debud as i'm on bad conference wifi10:12
jeblairi did save the lsof -p output10:14
jeblairmordred, clarkb, fungi ^10:15
ttxjeblair: how is Scotland treating you ?10:16
*** Ryan_Lane has joined #openstack-infra10:19
*** guohliu has quit IRC10:20
*** Ryan_Lane has quit IRC10:23
*** sergmelikyan has quit IRC10:24
sdaguejog0: man, what tz are you on?10:24
*** thomasbiege1 has joined #openstack-infra10:28
*** matsuhashi has quit IRC10:32
*** matsuhashi has joined #openstack-infra10:32
*** flaper87 is now known as flaper87|afk10:33
*** thomasbiege1 has quit IRC10:36
*** matsuhashi has quit IRC10:37
jog0sdague: scotland, watching Jim talk rigt now10:41
sdagueah cool10:41
jog0so UTC+110:42
LinuxJedimordred: assuming you are in Scotland, can you pick my up a Fedora sticker?10:43
*** CaptTofu has quit IRC10:44
LinuxJedis/my/me10:44
*** HenryG_ has quit IRC10:45
Shrewsmordred: and I'll take the best bottle of scotch HP can afford10:46
*** HenryG has joined #openstack-infra10:46
sdaguejog0: cool, well if you can swing around on code review today, I think I'm 6 patches deep in my er queue, and I hesitate going too much deeper as the rebasing gets *fun* if they need substantial changes :)10:47
jog0sdague: Augyeah I took a quick glance overall LGTM, one big comment though -- some docstrings would be nice10:48
LinuxJediShrews: I'd rather not have the scotch.  For one I don't think you can get good scotch for $1.99.  Also the way I feel I'd probably down it in one10:48
sdaguejog0: sure. You want those back into the patches at hand? or layering them on afterwards ok?10:49
*** Ryan_Lane has joined #openstack-infra10:49
jog0sdague: yes (either way)10:49
*** fifieldt has quit IRC10:49
jog0I would prefer ammend patches but not by much10:50
mikalAnyone around who understands our gerrit configs10:50
mikal?10:50
LinuxJedimikal: I think you are looking for someone who isn't human ;)10:52
LinuxJedialso, I think everyone who can help is asleep or in conference rooms in Scotland10:53
mikalSlackers10:53
jog0mikal: jeblair is giving a talk right now, I know just enough to get in trouble10:53
mikalI just want to know if we deliberately set the font on the review index pages to something I can't read10:53
mikali.e. can I trick people into changing it, or should I just write a grease monkey script?10:53
*** pblaho has quit IRC10:54
*** Ryan_Lane has quit IRC10:54
*** pblaho has joined #openstack-infra10:55
jog0mikal: ohh don't know that one. but jeblair should when he is free10:55
sdaguemikal: I'm pretty sure that all comes from gerrit10:56
sdagueand is just baked in10:56
*** ArxCruz has joined #openstack-infra10:57
mikalUgh10:57
mikalThe difference between bold and not in the index page is just too subtle for me to make out easily10:58
mikalSo I want a font which isn't as terrible at that10:58
mikalI'm going to go to bed soon, so if someone wants to ask jeblair when we resurfaces, that would be appreciated10:58
*** thomasbiege1 has joined #openstack-infra11:01
jog0mikal: sure11:06
*** dirk has joined #openstack-infra11:07
dirkwho maintains this "Updated from global requirements" jenkins bot / how to file bugreports against it?11:08
jog0dirk: mordred11:09
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: add docstrings to ResultSet  https://review.openstack.org/5289811:15
*** fallenpegasus has joined #openstack-infra11:17
*** pblaho has quit IRC11:18
*** Ryan_Lane has joined #openstack-infra11:20
*** fallenpegasus has quit IRC11:21
*** dims has joined #openstack-infra11:22
*** fallenpegasus has joined #openstack-infra11:22
*** flaper87|afk is now known as flaper8711:24
*** pblaho has joined #openstack-infra11:24
*** Ryan_Lane has quit IRC11:24
*** fallenpegasus has quit IRC11:25
*** fallenpegasus has joined #openstack-infra11:30
*** Bada has joined #openstack-infra11:36
*** adalbas has joined #openstack-infra11:41
*** fallenpegasus has quit IRC11:42
*** ruhe has joined #openstack-infra11:48
*** ifarkas has quit IRC11:49
*** Ryan_Lane has joined #openstack-infra11:50
*** dizquierdo has left #openstack-infra11:50
*** Ryan_Lane has quit IRC11:50
*** Ryan_Lane has joined #openstack-infra11:50
*** davidhadas has quit IRC11:52
*** jcoufal has quit IRC11:53
*** jcoufal has joined #openstack-infra11:53
*** thomasbiege2 has joined #openstack-infra11:54
*** Ryan_Lane has quit IRC11:55
*** jcoufal has quit IRC11:56
*** jcoufal has joined #openstack-infra11:56
*** dkranz has joined #openstack-infra11:56
*** thomasbiege1 has quit IRC11:57
*** thomasbiege2 has quit IRC11:59
*** weshay has joined #openstack-infra12:03
*** dkliban has quit IRC12:05
*** blamar has quit IRC12:05
*** dims has quit IRC12:09
*** fallenpegasus has joined #openstack-infra12:10
*** amotoki has joined #openstack-infra12:14
*** thomasm has joined #openstack-infra12:17
*** thomasm is now known as Guest2069012:17
*** rakhmerov has quit IRC12:17
*** dizquierdo has joined #openstack-infra12:17
*** Ryan_Lane has joined #openstack-infra12:21
D30hi guys,, can you suggest a howto/setup using grizzly or havana in a single node setup?12:21
D30im trying to use this https://github.com/mseknibilel/OpenStack-Grizzly-Install-Guide/blob/OVS_SingleNode/OpenStack_Grizzly_Install_Guide.rst as my reference12:22
D30but i cant make the network work :(12:22
*** ruhe has quit IRC12:22
D30VMs created dont have IPs upon launching...12:22
*** dims has joined #openstack-infra12:22
*** Ryan_Lane has quit IRC12:26
*** fallenpegasus has quit IRC12:27
fungiD30: this channel is where we discuss and support the community infrastructure systems. people who know more about running openstack are likely to be hanging out in #openstack or #openstack-10112:28
D30ooopss im sorry..12:29
D30i just did it again :(12:29
*** ruhe has joined #openstack-infra12:29
fungino worries12:29
*** ruhe has quit IRC12:29
*** rakhmerov has joined #openstack-infra12:31
*** anteaya has joined #openstack-infra12:31
*** davidhadas has joined #openstack-infra12:31
*** rakhmerov has quit IRC12:33
*** rakhmerov has joined #openstack-infra12:33
*** johnthetubaguy1 has quit IRC12:34
*** johnthetubaguy has joined #openstack-infra12:35
*** johnthetubaguy1 has joined #openstack-infra12:37
*** johnthetubaguy1 has quit IRC12:37
*** johnthetubaguy has quit IRC12:37
*** Ryan_Lane has joined #openstack-infra12:38
*** pblaho has quit IRC12:41
*** pblaho has joined #openstack-infra12:42
anteayamorning12:42
anteayaI added a link to a comment and the text was changed by the time the comment was posted: https://review.openstack.org/#/c/52624/12:43
*** Ryan_Lane has quit IRC12:43
anteayathinking the error was mine I created a new comment with the link but the url was again altered by the time it was posted12:43
anteayafirst time I have seen this12:43
*** davidhadas has quit IRC12:44
*** davidhadas has joined #openstack-infra12:45
*** leifmadsen has quit IRC12:47
*** ruhe has joined #openstack-infra12:48
*** dprince has joined #openstack-infra12:51
*** dkranz has quit IRC12:54
*** johnthetubaguy has joined #openstack-infra12:55
*** davidhadas has quit IRC12:57
*** ken1ohmichi has quit IRC12:57
*** davidhadas has joined #openstack-infra12:57
fungijeblair: clarkb: mordred: first pass over zuul.openstack.org:/root/zuul-files from this morning's lsof shows that 2000 of the 2044 regular files the zuul-serv process had open were in /var/lib/zuul/git/.*/.git/objects/pack/ directories. 784 either had a status of "DEL" or a comment of "(deleted)" at the end of the name field, but the remaining 1216 were regular memory-mapped files13:00
*** amotoki has quit IRC13:00
*** dcramer_ has quit IRC13:01
fungianteaya: did you simply put in the bare url or did you try to wrap it in some sort of html tags? i know gerrit tries to strip out a lot of the latter13:03
anteayaI pasted the bare url, I attempted no wrapping13:05
anteayaand morning fungi13:06
*** thomasbiege1 has joined #openstack-infra13:06
fungithen gerrit's probably having trouble with the pattern of that particular url. possibly the underscore13:06
anteayafungi: I updated the filed bug: https://bugs.launchpad.net/openstack-ci/+bug/124256913:06
uvirtbotLaunchpad bug 1242569 in openstack-ci "No patchset can be merged into any repository" [Undecided,Confirmed]13:06
*** nosnos has quit IRC13:09
*** julim has joined #openstack-infra13:09
*** nosnos has joined #openstack-infra13:10
*** julim has joined #openstack-infra13:11
*** sergmelikyan has joined #openstack-infra13:12
*** nosnos has quit IRC13:14
ttxmordred: let me know if you need my help for any of those meta-repo postrelease tasks13:14
*** sergmelikyan has quit IRC13:15
sdaguettx: what's the general policy around pushing schedules to sched.org? we supposed to wait until things are properly finalized? or once some things look locked down, let it fly?13:19
ttxsdague: I would wait at least until the meeting tomorrow13:20
katyaferventHi there! Could you please take a look at  https://review.openstack.org/#/c/52092/ I hope everythings is ok for this time)13:20
sdaguettx: sure13:20
ttxsdague: we can't push right now since i don't have the sched APi key yet anyway :)13:20
sdagueheh13:21
ttxsdague: but yes, the idea will be to push, realize how many conflicts there are and fix them13:21
*** blamar has joined #openstack-infra13:22
sdagueok, good13:22
*** CaptTofu has joined #openstack-infra13:26
*** wenlock has joined #openstack-infra13:28
*** matty_dubs|gone is now known as matty_dubs13:30
*** davidhadas_ has joined #openstack-infra13:34
*** davidhadas has quit IRC13:34
anteayakatyafervent: many infra core folks are at a conference today, so your response may be slow13:35
*** rakhmerov has quit IRC13:36
sdaguettx: in your py33 release session, are we expecting that's also going to talk about py26 deprecation?13:36
ttxsdague: that would make sense. Don't hesitate to add a comment so that it's covered too13:38
sdaguewill do13:38
*** alcabrera has joined #openstack-infra13:40
*** davidhadas_ has quit IRC13:42
*** thomasbiege1 has quit IRC13:43
*** che-arne has quit IRC13:46
*** oubiwann_ has joined #openstack-infra13:47
*** ruhe has quit IRC13:48
katyaferventandreaf, thanks for your replay. I'll wait :) Is it one-day conference?13:48
katyaferventandreaf, sorry I typed wrong nick13:49
katyaferventanteaya,  thanks for your replay. I'll wait :) Is it one-day conference?13:49
anteayait is linuxcon eu, http://events.linuxfoundation.org/events/linuxcon-europe so 3 days13:51
anteayaand thanks for your patience and understanding :D13:52
anteayakatyafervent:13:52
*** thomasbiege1 has joined #openstack-infra13:52
*** dkranz has joined #openstack-infra13:54
*** prad_ has joined #openstack-infra13:55
*** DennyZhang has joined #openstack-infra13:56
*** alexpilotti_ has joined #openstack-infra13:57
*** thomasbiege1 has quit IRC13:57
*** che-arne has joined #openstack-infra13:59
*** alexpilotti has quit IRC14:00
*** alexpilotti_ is now known as alexpilotti14:00
*** luhrs1 has joined #openstack-infra14:03
*** luhrs1 has quit IRC14:03
*** ruhe has joined #openstack-infra14:04
*** davidhadas has joined #openstack-infra14:06
*** datsun180b has joined #openstack-infra14:07
*** ianw has quit IRC14:08
*** thedodd has joined #openstack-infra14:08
*** slong has quit IRC14:09
*** rwsu-away is now known as rwsu14:09
*** jaypipes has joined #openstack-infra14:09
*** ianw has joined #openstack-infra14:11
openstackgerritA change was merged to openstack-infra/elastic-recheck: The key's value is misleading in the config sample.  https://review.openstack.org/5273414:11
*** dstufft has quit IRC14:11
*** dstufft has joined #openstack-infra14:12
*** eharney has joined #openstack-infra14:12
*** dkranz has quit IRC14:14
*** changbl has quit IRC14:17
*** dkliban has joined #openstack-infra14:23
*** dcramer_ has joined #openstack-infra14:25
*** rakhmerov has joined #openstack-infra14:26
*** D30 has quit IRC14:28
*** jcoufal has quit IRC14:33
*** rnirmal has joined #openstack-infra14:37
*** rcleere has joined #openstack-infra14:40
clarkbfungi, jeblair, not really awake yet but should we bump the file descriptor ulimit in the zuul init script then restart again?14:41
*** fungi has quit IRC14:41
clarkbor more aggressively garbage collect git repo objects in zuul?14:42
*** wenlock_ has joined #openstack-infra14:43
*** rpodolyaka has quit IRC14:46
*** guohliu has joined #openstack-infra14:47
*** thedodd has quit IRC14:51
*** thedodd has joined #openstack-infra14:51
*** mgagne has joined #openstack-infra14:52
*** amotoki has joined #openstack-infra14:54
mgagneI would need someone to answer bug #124070214:56
*** osanchez has quit IRC14:56
uvirtbotLaunchpad bug 1240702 in openstack-ci "Create new Gerrit group for puppet-ceph" [Undecided,New] https://launchpad.net/bugs/124070214:56
*** osanchez has joined #openstack-infra14:56
mgagnemainly to add myself into the group14:56
*** OlivierSanchez has joined #openstack-infra14:57
*** osanchez has quit IRC14:57
rakhmerovwould you please be able to review https://review.openstack.org/#/c/51205. It's been there for a while :) We made some changes so we hope it should be fine14:59
*** garyk has quit IRC14:59
*** fungi has joined #openstack-infra15:02
mgagnemordred: ping15:02
openstackgerritAntoine Musso proposed a change to openstack-infra/jenkins-job-builder: cloverphp publisher  https://review.openstack.org/5294015:04
*** mrodden has quit IRC15:06
fungiclarkb: grr, freenode issues apparently, but just saw your comments in the weblog from while i was reconnecting15:07
*** hashar has quit IRC15:08
openstackgerritA change was merged to openstack/requirements: Add rtslib-fb to requirements  https://review.openstack.org/5105615:08
fungiclarkb: i wonder if the open fd leak is in gitpython15:08
mgagnefungi: do you have the power to add people to gerrit groups?15:09
fungimgagne: i do, but generally so do the people in those groups15:09
mgagnefungi: group is empty =)15:09
fungimgagne: what group? i'll check for you15:09
mgagnefungi: puppet-ceph-core please. bug #124070215:09
uvirtbotLaunchpad bug 1240702 in openstack-ci "Create new Gerrit group for puppet-ceph" [Undecided,New] https://launchpad.net/bugs/124070215:09
fungimgagne: and if there's an open infra bug for it, lemme know so i can mark it resolved while i'm in there15:09
fungioh, you're already a step ahead of me ;)15:10
rakhmerovthanks guys for mistral :) Appreciate15:10
fungiclarkb: if that's the case, what do you think our options are? del() the repo objects when we're done performing merges and what have you?15:11
*** marun has quit IRC15:14
*** marun has joined #openstack-infra15:15
clarkbfungi: yes I think it is in gitpython, it caches the pack and loose file stuff. I think we discard the repo objects after use or bump ulimits or both15:16
mgagnefungi: thanks!15:16
fungimgagne: you're welcome15:17
fungiclarkb: i'm more on board with manual gc than upping max open files for zuul. the latter seems like it's just delaying the inevitable15:18
*** marun has quit IRC15:19
*** mrodden has joined #openstack-infra15:19
*** guohliu has quit IRC15:19
*** pblaho has quit IRC15:19
clarkbfungi I agree, but ulimit bump may be a good short term solution as manual gc may not be trivial (I haven't looked at how interesting that change may be15:19
clarkbin theory not horrible as we do have a repo wrapper object. could make it be more of a context manager and do the needful on exit15:20
*** luisg has joined #openstack-infra15:21
fungido we know how long the zuul-serv process had been running since its previous restart? if it was through the last rc or so then we may have some time (i'm guessing it's proportional to the number of merges it tests or something)15:21
*** thomasbiege1 has joined #openstack-infra15:21
fungimay have to go on an archaeological dig through the logs15:22
*** senk has joined #openstack-infra15:22
*** thedodd has quit IRC15:23
clarkbI think it is proportional to number of repos ish15:24
*** thedodd has joined #openstack-infra15:24
clarkbas we add more projects there are more repo objects open with open files for loose objects and pack files15:24
*** changbl has joined #openstack-infra15:24
openstackgerritA change was merged to openstack-infra/elastic-recheck: Convert test_classifier to be a unit test  https://review.openstack.org/5073315:25
*** dkliban is now known as dkliban_afk15:25
*** sdake has joined #openstack-infra15:25
*** sdake has quit IRC15:25
*** sdake has joined #openstack-infra15:25
*** dkranz has joined #openstack-infra15:28
*** marun has joined #openstack-infra15:28
*** yaguang has joined #openstack-infra15:30
*** ruhe has quit IRC15:32
*** ruhe has joined #openstack-infra15:33
*** dkranz has quit IRC15:36
*** pblaho has joined #openstack-infra15:37
fungiclarkb: i'm unconvinced it's proportional to the number of repositories http://paste.openstack.org/show/4887615:39
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: add SearchResultSet and Hit objects  https://review.openstack.org/5269815:39
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: refactor templates into query_builder  https://review.openstack.org/5281815:40
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: add an es_query tool  https://review.openstack.org/5284715:40
clarkbfungi: hmm, maybe we need to pack those repos?15:40
fungii mean, some of it may be, but i think that's in a long-tail which probably isn't contributing the bulk of the handles compared to whatever's leaking there15:40
clarkbyup I think you are right15:41
*** wenlock has quit IRC15:45
*** chuck_ has joined #openstack-infra15:48
*** fallenpegasus has joined #openstack-infra15:49
*** changbl has quit IRC15:49
openstackgerritMatthew Treinish proposed a change to openstack-infra/elastic-recheck: Add query for bug 1225024  https://review.openstack.org/5296015:50
uvirtbotLaunchpad bug 1225024 in tempest "tempest.api.compute.admin.test_hosts.HostsAdminTestXML.test_list_hosts_with_zone[gate]  unixpeced conductor service" [High,Confirmed] https://launchpad.net/bugs/122502415:50
*** garyk has joined #openstack-infra15:50
*** fallenpegasus has quit IRC15:51
*** garyk has quit IRC15:52
*** ryanpetrello has joined #openstack-infra15:52
*** ruhe has quit IRC15:53
dhellmannmordred: ping?15:54
openstackgerritA change was merged to openstack-infra/elastic-recheck: Change test_queries from logical AND to OR  https://review.openstack.org/5016015:55
*** ruhe has joined #openstack-infra15:55
katyaferventdhellmann, Hi! Probably he is on conference right now (see chat history)15:56
*** fallenpegasus has joined #openstack-infra15:56
dhellmannkatyafervent, thanks :-)15:56
*** thomasbiege1 has quit IRC15:56
*** dizquierdo has left #openstack-infra15:56
*** markmc has quit IRC15:58
*** UtahDave has joined #openstack-infra15:58
*** garyk has joined #openstack-infra15:58
*** fallenpegasus has quit IRC15:59
openstackgerritMatthew Treinish proposed a change to openstack-infra/elastic-recheck: Remove bug 1229475 from queries.yaml  https://review.openstack.org/5296316:00
uvirtbotLaunchpad bug 1229475 in python-neutronclient "terminate_instance(): RuntimeError: Second simultaneous read on fileno 16 detected" [High,Fix committed] https://launchpad.net/bugs/122947516:00
*** matty_dubs is now known as matty_dubs|lunch16:02
openstackgerritMatthew Treinish proposed a change to openstack-infra/elastic-recheck: Add query for bug 1225024  https://review.openstack.org/5296016:03
openstackgerritZhi Yan Liu proposed a change to openstack/requirements: Raise iso8601 requirement  https://review.openstack.org/5296416:03
uvirtbotLaunchpad bug 1225024 in tempest "tempest.api.compute.admin.test_hosts.HostsAdminTestXML.test_list_hosts_with_zone[gate]  unexpected conductor service" [High,Confirmed] https://launchpad.net/bugs/122502416:03
*** ruhe has quit IRC16:04
*** gyee has joined #openstack-infra16:04
*** boris-42 has quit IRC16:06
*** pblaho has quit IRC16:06
*** zhiyan1 has joined #openstack-infra16:06
zhiyan1hi, anybody can help me for a requirement bump question?16:07
fungizhiyan1: probably--ask the question and i'll see what i can tell you16:10
zhiyan1fungi: cool. i'm fixing https://bugs.launchpad.net/glance/+bug/1242501 , actually this issue cased all glance patchs Jenkins UT failed.16:11
uvirtbotLaunchpad bug 1242501 in glance "Jenkins failed due to TestGlanceAPI.test_get_details_filter_changes_since" [Undecided,In progress]16:11
*** oubiwan__ has joined #openstack-infra16:12
zhiyan1fungi: in here, https://review.openstack.org/52894 , you can see i'm try to raise iso8601 version16:12
openstackgerritBen Nemec proposed a change to openstack-dev/hacking: Enforce import grouping  https://review.openstack.org/5222116:13
zhiyan1i'm try to make sure, can i do that safely, current requirement is https://github.com/openstack/requirements/blob/master/global-requirements.txt#L23 , seems someone using different version limitation.16:14
zhiyan1fungi: ^16:14
*** oubiwann_ has quit IRC16:15
fungizhiyan1: so you want to switch to require iso8601>=0.1.7 in all projects?16:15
zhiyan1yes, but need to make sure here. https://review.openstack.org/#/c/5296416:15
*** rnirmal_ has joined #openstack-infra16:15
*** cody-somerville has quit IRC16:16
fungizhiyan1: right, looks like you based your change on a two-month-old state in that repository, so it's had a lot of changes merged since what you started from16:17
*** fbo is now known as fbo_away16:18
*** DennyZhang has quit IRC16:18
fungiperhaps you already had a checkout of openstack/requirements and had not updated it before writing your patch, so you'll need to rebase it (preferably on the current tip of the master branch)16:18
zhiyan1fungi: i will rebase when my network back to ok. for #5296416:18
*** Guest20690 is now known as thomasem16:18
*** rnirmal_ has quit IRC16:20
*** rnirmal has quit IRC16:20
*** rnirmal has joined #openstack-infra16:20
zhiyan1fungi: so, i'm not sure which project using 'iso8601>=0.1.4,!=0.1.5,!=0.1.6' version requirement. And i'm try to make sure who/where should i go for ask this version raise request?16:20
fungizhiyan1: once it's rebased, we'll run some integration tests on it to find out if it works in devstack, then if it gets approved by the requirements core reviewers all projects will get an automated change proposed to increase their version spec for that dependency16:21
zhiyan1fungi: cool got it. so can you tell me some names who you prefer I add the review list? :)16:22
fungizhiyan1: though if you want to find references to why it was set to >=0.1.4,!=0.1.5,!=0.1.6 previously, you can use git blame or git pickaxe to find and review the associated commit messages16:23
jeblairclarkb: fungi ps listing from zuul before restart said it was running since oct 516:23
zhiyan1fungi: you know this is really a urgent case for glance, so i'd like to accelerate the resolving progress...16:23
*** moted has quit IRC16:24
pleia2I'm currently blocked a bit on https://review.openstack.org/#/c/52714/ (clarkb helped get some patches through on friday, if this works it should be the last for stage one of my tripleo testing plan)16:25
fungizhiyan1: you generally shouldn't need to add specific reviewers to a change. those of us who review requirements changes already subscribe to them in gerrit anyway, so we'll see it. just make sure its commit message and you add a Closes-Bug: #1242501 header rather than the way you're mentioning it now16:25
fungizhiyan1: er, i was going to say make sure its commit message and the bug you link with a proper closes-bug header reflect the urgency of that change16:26
fungipleia2: having a look16:26
zhiyan1fungi: thanks.16:27
*** mkerrin has quit IRC16:27
*** hogepodge has joined #openstack-infra16:27
*** moted has joined #openstack-infra16:29
zhiyan1fungi: btw, what should i do if the requirement change meet a problem on the auto-integration tests after I commit the bump patch?16:31
*** derekh has quit IRC16:31
*** davidhadas has quit IRC16:32
fungizhiyan1: figure out what other projects are encountering problems with the newer version and possibly help them troubleshoot why they and glance suffer from an incompatibility over that version of the dependency (but since iso8601 isn't currently capped at a maximum version anyway, i don't expect this will be the case--should test clean)16:32
pleia2fungi: thanks16:33
funginp16:33
*** dkranz has joined #openstack-infra16:34
fungiclarkb: if https://review.openstack.org/52714 lgty (it's a very, very short review), we can get pleia2 unblocked by approving that16:34
pleia2clarkb, fungi - once it's approved we'll need to nudge nodepool to regenerate the existing images16:35
pleia2well, image + servers16:35
annegentlemordred: or jeblair: either of you avaialble today or tomorrow to get on a concall with O'Reilly about Operations Guide? There may be changes on their side that they want to talk through.16:37
mordredannegentle: we're both in edinburgh today16:37
*** eharney has quit IRC16:38
*** jpich has quit IRC16:38
*** yassine has quit IRC16:38
zhiyan1fungi: cool. thanks again16:39
annegentlemordred: ah, ok, it's your end of day now then. How about tomorrow?16:39
*** CaptTofu_ has joined #openstack-infra16:40
fungipleia2: i can regen images for you whenever you need16:41
annegentlemordred: how about clarkb or fungi? They'll know more than me16:41
*** ruhe has joined #openstack-infra16:41
annegentleclarkb: fungi: are you in Edinburgh too?16:41
*** CaptTofu has quit IRC16:43
*** chuck_ is now known as zul_16:44
fungiannegentle: no, i'm at home and around all day tomorrow. today i'm around until about 19:30z when i'll be heading out to a local osug meetup16:45
fungiwednesday and thursday i'll be mostly unavailable at a software conference though16:45
fungibut can probably break away for a call if needed16:46
annegentlefungi: ok thanks, I'll send your info (pm me your preferred email address). Appreciate it, sooner is better :)16:46
*** dkliban_afk is now known as dkliban16:47
*** rnirmal_ has joined #openstack-infra16:47
fungiannegentle: i usually notice that slightly more often than my openstack.org address anyway16:47
*** senk has quit IRC16:47
*** changbl has joined #openstack-infra16:47
*** Ryan_Lane has joined #openstack-infra16:47
clarkbI will be around, but am going to try and upgrade a bunch of logstash related things today. Tomorrow would be better for me16:49
annegentlefungi: hehe16:49
annegentleclarkb: ok, thanks, I'll see what they come back with and add you16:49
*** rnirmal has quit IRC16:50
*** rnirmal_ is now known as rnirmal16:50
*** changbl has quit IRC16:51
clarkbsdague: mtreinish: I am going to finish prepping the elasticsearch/logstash upgrades. Can I start that at any time or are there particular things you would like to get done first (I know a lot of e-r work is happening too which I am happy to accomodate)16:51
clarkbbut first I need to finish the nodejs stuff from friday night16:53
mtreinishclarkb: there's nothing from me that I need to wait for16:54
clarkbmtreinish: thanks16:54
mtreinishsdague is working on some code refactoring in e-r16:54
mtreinishbut I don't think he needs to wait16:54
mtreinishI'm not sure though16:54
*** ruhe has quit IRC16:55
clarkbfungi: https://review.openstack.org/#/c/52729/1 do you want to look at that before I approve (it is bookkeeping for the new nodejs version)16:57
fungilookin16:57
fungilgtm. approved it16:58
clarkbthanks16:59
openstackgerritZhi Yan Liu proposed a change to openstack/requirements: Raise iso8601 requirement  https://review.openstack.org/5296417:00
*** oubiwan__ is now known as oubiwann-lambda17:00
*** zul_ has quit IRC17:00
openstackgerritA change was merged to openstack-infra/config: Upgrade the version of node for etherpad-lite.  https://review.openstack.org/5272917:00
clarkbI will restart puppet on the two hosts shortly (though a puppet agent --test shows it is a noop)17:03
*** changbl has joined #openstack-infra17:03
*** zul_ has joined #openstack-infra17:04
*** sarob has joined #openstack-infra17:04
*** dcramer_ has quit IRC17:05
*** matty_dubs|lunch is now known as matty_dubs17:05
*** rnirmal has quit IRC17:06
*** rnirmal has joined #openstack-infra17:06
*** amotoki has quit IRC17:07
*** ruhe has joined #openstack-infra17:07
harlowjai hope your guys ssh connections aren't getting overloaded, lol :-/17:11
clarkbharlowja: ?17:11
harlowjaoh, just https://github.com/harlowja/gerrit_view#curse_gerrit might cause more ssh connections17:11
harlowja*but maybe not a big deal, idk, ha17:12
*** dkranz has quit IRC17:12
clarkbharlowja: I think it can be an issue, but there was a bunch of java/gerrit tuning about a year ago that made many of the problems go away17:13
*** flaper87 is now known as flaper87|afk17:13
harlowjaclarkb ok, depends on how many people start using that i guess17:13
*** boris-42 has joined #openstack-infra17:13
*** davidhadas has joined #openstack-infra17:14
*** SergeyLukjanov has joined #openstack-infra17:15
*** dizquierdo has joined #openstack-infra17:16
openstackgerritClark Boylan proposed a change to openstack-infra/config: Upgrade Logstash to 1.2.1.  https://review.openstack.org/5245317:18
openstackgerritClark Boylan proposed a change to openstack-infra/config: Upgrade elasticsearch to version 0.90.3.  https://review.openstack.org/5245217:18
*** senk has joined #openstack-infra17:18
*** zhiyan1 has quit IRC17:20
sdagueclarkb: any time should be fine17:23
clarkbI have restarted puppet on both etherpad hosts, we should be all caught up after friday's maintenance17:24
clarkbsdague: great, thanks17:24
clarkbI am going to start stopping puppet on the logstash hosts so that it doesn't interfere (and will be noop applying things before I dive in)17:25
fungisounds good17:25
*** senk has quit IRC17:27
*** esker has joined #openstack-infra17:27
*** rnirmal has quit IRC17:30
*** rnirmal has joined #openstack-infra17:31
*** zul_ has quit IRC17:32
*** mriedem has joined #openstack-infra17:33
fungii just saw http://libgit2.github.com/ and started to wonder if zuul's use of gitpython could be easily replaced with http://www.pygit2.org/ and whether that would be likely to improve its performance17:34
*** SergeyLukjanov is now known as _SergeyLukjanov17:35
*** _SergeyLukjanov has quit IRC17:35
*** Bada has quit IRC17:36
clarkbpossibly17:39
*** nicedice_ has joined #openstack-infra17:41
pleia2discovered http://gerrithub.io/ over the weekend17:42
pleia2no tests like us, but nice to see for reviews17:42
fungiannegentle: the proposed 14:30-15:00z looks fine to me, though i just remembered i have a foundation staff call at 15:00z so making sure we wrap up by then would be great17:43
clarkbfungi: annegentle is that tomorrow?17:43
clarkbso early :)17:43
fungiclarkb: annegentle: oh, wait, i think i misread because it line-wrapped between the "GMT" and "-0500"17:44
fungididn't strike me as odd for them to schedule in gmt since it also said "Site: Cambridge"17:45
fungiwrong cambridge ;)17:45
*** ruhe has quit IRC17:45
pleia2hehe17:45
clarkbfungi: sdague: mtreinish: I am  about to begin the logstash stuff, puppet is disabled everywhere and I have disabled elasticsearch shard allocations (hopefulyl that prevents a shard movement storm as I bring the cluster back up). I will stop just about everything but the gearman client/server on logstash.o.o so that the jobs will remain queued then bring everything back up in this order,17:46
clarkbelasticsearch, logstash indexer, log gearman worker17:46
fungihowever their gmt-0500 actually means utc-0400 at the moment (i *so* hate that people's calendar apps can't figure out how to calculate timezones properly)17:46
clarkblog gearman workers stopped, logstash next17:47
jeblairfungi: matthew garrett calls it "actual cambridge"17:47
fungiha!17:47
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: add SearchResultSet and Hit objects  https://review.openstack.org/5269817:47
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: refactor templates into query_builder  https://review.openstack.org/5281817:47
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: add an es_query tool  https://review.openstack.org/5284717:47
*** yaguang has quit IRC17:47
pleia2fungi: yes, the whole purpose of computers is to do things like time zones correctly (humans are bad at it)17:49
clarkband now for elasticsearch17:49
sdagueclarkb: coolio17:49
*** rakhmerov has quit IRC17:49
clarkbeverything is down, upgrading elasticserach now17:50
*** rakhmerov has joined #openstack-infra17:50
*** rakhmerov has quit IRC17:50
*** fallenpegasus has joined #openstack-infra17:51
*** SergeyLukjanov has joined #openstack-infra17:52
mtreinishclarkb: ok cool17:53
*** SergeyLukjanov has quit IRC17:53
*** SergeyLukjanov has joined #openstack-infra17:54
*** fallenpegasus has quit IRC17:55
*** jerryz has joined #openstack-infra17:55
*** ruhe has joined #openstack-infra17:57
*** yolanda has joined #openstack-infra17:57
*** chuck_ has joined #openstack-infra17:58
*** dirk has quit IRC17:59
*** ruhe has quit IRC18:00
*** fallenpegasus has joined #openstack-infra18:00
*** yaguang has joined #openstack-infra18:00
*** markmcclain has joined #openstack-infra18:00
*** CaptTofu_ has quit IRC18:00
*** zul has quit IRC18:00
*** chuck_ is now known as zul18:01
*** zul has quit IRC18:01
*** zul has joined #openstack-infra18:01
*** sarob has quit IRC18:01
clarkbcluster health is "red" it is recovering indexes and I think possibly converting them from lucene 3 to 418:01
zulmordred:  ping...when are you going to cut a new pbr?18:01
*** sarob has joined #openstack-infra18:01
*** chuck_ has joined #openstack-infra18:01
mordredzul: soon18:01
sdagueclarkb: cool, how long you think it's going to chug on it?18:02
zulmordred:  soon as in tomorrow? soon as in next week?18:02
clarkbsdague: I don't think it will be too long, it seems to be recovering and not relocating (relocating is what takes forever)18:02
*** changbl has quit IRC18:04
clarkbreplica shards are coming back now18:05
*** dkehn is now known as dkehn_lunch18:05
sdaguecool, ok, I'm going to go out for a bike ride now for a bit while the weather is still good. So if there are issues later on I can help play.18:05
*** sarob has quit IRC18:06
clarkbsdague: sounds good. I will wait for full cluster recovery before starting the gearman workers again18:06
*** CaptTofu has joined #openstack-infra18:07
openstackgerritJoshua Harlow proposed a change to openstack-infra/gerritlib: Add connection attempt limit  https://review.openstack.org/5298618:08
*** hashar has joined #openstack-infra18:08
*** rnirmal has quit IRC18:12
*** fallenpegasus has quit IRC18:12
*** rnirmal has joined #openstack-infra18:12
*** dcramer_ has joined #openstack-infra18:17
*** hashar has quit IRC18:17
*** fallenpegasus has joined #openstack-infra18:17
*** fallenpegasus has quit IRC18:19
*** yolanda has quit IRC18:19
*** changbl has joined #openstack-infra18:19
*** markmcclain has quit IRC18:20
*** rakhmerov has joined #openstack-infra18:20
*** sarob has joined #openstack-infra18:22
clarkbhmm recovering the replicas is taking more time than I expected18:22
*** sarob has joined #openstack-infra18:23
*** sarob has quit IRC18:24
*** alexpilotti_ has joined #openstack-infra18:24
*** julim has quit IRC18:24
*** sarob has joined #openstack-infra18:24
*** fallenpegasus has joined #openstack-infra18:25
*** rakhmerov has quit IRC18:25
*** dprince has quit IRC18:25
*** ArxCruz has quit IRC18:26
*** marun has quit IRC18:26
fungiclarkb: anyway, so that call is scheduled for the half hour prior to the infra team meeting, if you wanted the dial-in info18:26
clarkbfungi: sure18:26
*** alexpilotti has quit IRC18:26
*** alexpilotti_ is now known as alexpilotti18:26
*** jcoufal has joined #openstack-infra18:27
*** dcramer_ has quit IRC18:27
*** SergeyLukjanov is now known as _SergeyLukjanov18:27
*** _SergeyLukjanov has quit IRC18:28
clarkbI am avoiding spinning up the log workers until after I am in a green state so that I can avoid debugging two things at once if stuff goes sideways, but I may spin up one worker if this continues to be very slow18:28
*** OlivierSanchez has quit IRC18:29
*** sarob has quit IRC18:29
harlowjahey guys, can i get a look over on https://review.openstack.org/#/c/52283/, https://review.openstack.org/#/c/52462/ (pretty please)18:29
harlowjaif u guys get some free time18:29
*** SergeyLukjanov has joined #openstack-infra18:32
clarkbharlowja: re 52462, we typically give the ptl (or equivalent group) tag access instead of all of core. This is because if a tag is not done correctly we usually have to get involved in the cleanup. That is less likely when a small group of people are doing it and doing it consistently18:32
clarkbharlowja: so I think we should use taskflow-ptl instead18:33
harlowjaclarkb  k18:33
harlowjawill change18:33
harlowjaalthough i think taskflow-ptl  == me :-P18:33
harlowjaguess i should make that group18:33
* harlowja forget how groups are made,18:34
clarkbharlowja: just change 52462 to use taskflow-ptl instaed of taskflow-core and the backend will sort it out for you18:34
harlowjak18:35
clarkbharlowja: then we will add you to the group18:35
harlowjaok dokie18:35
harlowjathx clarkb18:35
*** CaptTofu has quit IRC18:35
*** alcabrera has quit IRC18:35
*** CaptTofu has joined #openstack-infra18:35
*** fallenpegasus has quit IRC18:36
fungii was going to say all the same things18:36
openstackgerritA change was merged to openstack-infra/config: Add pypi jobs for taskflow  https://review.openstack.org/5228318:36
openstackgerritJoshua Harlow proposed a change to openstack-infra/config: Allow taskflow-ptl tag create/push  https://review.openstack.org/5246218:37
harlowjathx guys18:37
fungilgtm now18:37
harlowjacoolness18:37
harlowjaok, guess after this will see how to make the pypi magic happen18:38
harlowja*chant or dance or something18:38
*** cody-somerville has joined #openstack-infra18:38
*** ruhe has joined #openstack-infra18:38
*** changbl has quit IRC18:39
harlowjafungi gerrit curses thing working for u?18:39
harlowja*if u tried it18:39
*** dcramer_ has joined #openstack-infra18:39
*** CaptTofu has quit IRC18:40
fungiharlowja: haven't tried it yet. discovered my monday was very busy18:40
harlowjanp18:40
harlowjaits supercool18:40
harlowjaha18:40
clarkbfungi: right! and it isn't even noon yet18:40
fungiclarkb: on your end of the rock anyway18:40
harlowjahttps://review.openstack.org/#/c/52986/ will help with the detection of connection errors i think18:40
harlowjacurrently not such a good way to detect if the initial connect will fail18:41
*** rnirmal has quit IRC18:41
*** rnirmal has joined #openstack-infra18:41
harlowjaanyways, i was adding zuul stuff lastnight, so might have that soon, just zuul is pull based, which means its not very accurate :-/18:42
harlowja*repeated pulling of status.json18:42
*** ruhe has quit IRC18:43
*** dkehn_lunch is now known as dkehn18:43
harlowjais there a push based api :)18:44
clarkb~18:44
*** zul has quit IRC18:45
clarkbwhoops18:47
clarkbharlowja: there is no push based api18:47
harlowjaits ok18:47
harlowjajust means that hard to get accurate view of zuul18:48
*** johnthetubaguy has quit IRC18:48
clarkbharlowja: also spot on why the ssh api for gerrit is useful18:48
clarkbI get why the new REST api is also useful, but I think they complement each other18:48
*** yolanda has joined #openstack-infra18:48
harlowjadef18:48
clarkbrather than one supplanting the other18:48
harlowjaeach has its uses18:48
*** hashar has joined #openstack-infra18:48
clarkbexactly18:48
harlowjai was just adding a zuul thread to get zuul information yesterday, hard to know how often to pull 'status.json'18:49
clarkbharlowja: the status page pulls it every 60 minutes if the window is in open to the user18:49
clarkber 60 seconds18:49
harlowjak18:49
harlowjaso curses i guess could do the same18:49
harlowjajust i'm unsure what to do if a thing undergoing zuul progress diseappers, do i declare it 100% done, failed, idk18:50
harlowja*diseappers from status.json18:50
*** ryanpetrello has quit IRC18:50
harlowjaunless there is an API to ask for the zuul status for a given review18:50
harlowja*which i could then ask for a individual reviews status18:51
*** ryanpetrello has joined #openstack-infra18:51
clarkbharlowja: there isn't today though that particular feature may not be hard to add18:51
harlowjanp18:51
harlowjaall good :)18:51
pleia2clarkb: if I could bother you for a quick browse of https://review.openstack.org/5271418:52
clarkbpleia2: sure, looking now18:52
*** senk has joined #openstack-infra18:53
clarkbpleia2: approved18:54
pleia2thank you :)18:55
openstackgerritA change was merged to openstack-infra/config: Fix location of toci script in JJB and clone toci  https://review.openstack.org/5271418:55
*** sarob has joined #openstack-infra18:55
clarkbpleia2: we might want to consider doing the cloing and tool setup in the cache step, but also doing it in the job itself if the data has not been cached (to avoid needing a new image when things change)18:55
*** sarob has quit IRC18:56
*** sarob has joined #openstack-infra18:56
*** nati_ueno has joined #openstack-infra18:56
*** senk has quit IRC18:58
*** changbl has joined #openstack-infra18:59
*** CaptTofu has joined #openstack-infra19:00
mgagneIs there a unique key on the email address with gerrit?19:01
mgagneUser 4556 and 2064 look to have the same email19:01
fungimgagne: gerrit fails at enforcing it. we sometimes wind up with dupes when people change openid urls and whatnot19:02
*** rnirmal_ has joined #openstack-infra19:02
fungiin those cases we have to identify and clear the e-mail addresses on the defunct account(s)19:02
mgagnefungi: that's sad. It makes it hard to add members to group when dups are found.19:03
fungi(via mysql queries locally on the gerrit server)19:03
*** rnirmal_ has quit IRC19:03
*** rnirmal_ has joined #openstack-infra19:03
fungimgagne: agreed. documented here at least http://ci.openstack.org/gerrit.html#duplicate-accounts-in-gerrit19:03
*** rnirmal has quit IRC19:03
*** rnirmal_ is now known as rnirmal19:03
clarkbI am going to start one logstash worker, taking too long for me to wait19:04
mgagnefungi: ok thanks. I'll wait on the user for the correct user id.19:06
*** afazekas_ has quit IRC19:07
*** nati_ueno has quit IRC19:08
*** nati_ueno has joined #openstack-infra19:08
fungimgagne: fwiw, in the database it looks like 2064 has filed a cla and contact info, and has logged in via an lp openid while 4556 has done none of those things and may merely be an artifact from our old sync script19:10
mgagnefungi: 2064 looks like the right one, yes.19:11
fungimgagne: fixed19:11
clarkbone worker is up, looks good initially, I will keep poking at it19:11
mgagnefungi: you're the man! thanks!19:11
*** hogepodge has quit IRC19:11
fungimgagne: my pleasure19:12
mgagnefungi: bad news, looks like gerrit still won't accept my request to add him to a group. Telling me he isn't a registered user.19:12
mgagnefungi: is a cache required to be cleared?19:13
*** CaptTofu has quit IRC19:13
fungimgagne: possibly. clearing19:14
*** CaptTofu has joined #openstack-infra19:14
*** zul has joined #openstack-infra19:14
fungimgagne: any better? i'll try to remember to update the doc to suggest that step if so19:15
mgagnefungi: working now. thanks!19:15
fungimgagne: good call--guess that was it19:16
fungisorry for the false start there19:16
mgagnefungi: it's all right ;)19:16
clarkbthe first worker seems to be fine I am going to fire up the rest of them19:18
*** CaptTofu has quit IRC19:19
*** rakhmerov has joined #openstack-infra19:21
*** reed has joined #openstack-infra19:21
*** hogepodge has joined #openstack-infra19:23
*** yamahata has joined #openstack-infra19:23
*** dirk has joined #openstack-infra19:24
*** ArxCruz has joined #openstack-infra19:25
*** rakhmerov has quit IRC19:25
clarkball 8 workers are chewing through the backlog now19:27
clarkbI will start e-r after all shards are recovered19:27
*** zul has quit IRC19:28
pleia2so hopefully 52714 is in now, fungi did you want to try to rebuild the tripleo image + spin up the new instances so I can run tests against them?19:29
*** miqui has joined #openstack-infra19:31
fungipleia2: sure i can get those running real quick. they take a bit of time to complete though19:32
miquito zuul experts: trying to install zuul, as root ran: python setup.py install19:32
pleia2yeah, 25 minutes or so for the image to build19:32
miquiget this error...19:32
pleia2fungi: thanks :)19:32
miquiWriting /tmp/easy_install-CPeKQ7/pycrypto-2.6.1/setup.cfg19:33
miquiRunning pycrypto-2.6.1/setup.py -q bdist_egg --dist-dir /tmp/easy_install-CPeKQ7/pycrypto-2.6.1/egg-dist-tmp-CmUbvf19:33
miquiwarning: GMP or MPIR library not found; Not building Crypto.PublicKey._fastmath.19:33
miquisrc/MD2.c:31:20: fatal error: Python.h: No such file or directory19:33
miquicompilation terminated.19:33
*** melwitt has joined #openstack-infra19:33
miquierror: Setup script exited with error: command 'gcc' failed with exit status 119:33
*** melwitt has quit IRC19:33
miquiclarkb: any ideas?19:33
clarkbsdague: mtreinish: jog0: at this point I htink you can hit elasticsearch, there are a few more things I need to do like update the default field for kibana, and start e-r, but es itself as well as the indexers are up19:33
clarkbmiqui: yes, you need to install the python development headers19:33
fungimiqui: sounds like you probably are missing build dependencies for pycrypto, looks like maybe at least the python dev headers19:33
*** melwitt has joined #openstack-infra19:34
fungior what clarkb just said ;)19:34
clarkbpython-dev on ubuntu iirc19:34
miquiam testing on good 'ol precise32...19:34
fungipleia2: image is rebuilding now19:34
pleia2\o/19:35
miquiso i think i need python-all-dev19:35
*** gyee has quit IRC19:35
fungipleia2: i'm going to be in transit to cisco offices in a bit, but will check in on the image update when i get there and let you know if it failed for some reason19:36
clarkbmiqui: sounds right19:36
pleia2fungi: sure, have fun :)19:36
clarkbfungi: I think pleia is able to watch on the remote end too.19:36
clarkbpleia2: is that right?19:36
pleia2yeah, I can watch nova19:36
pleia2and keep an eye on jenkins web dashboard if image succeeds19:37
fungiclarkb: oh, good point. or clarkb can check the nodepool image-list output for you worst case, if i disappear in transit19:37
clarkbindeed, have fun at the ug19:37
fungipleia2: the jenkins web dashboard probably won't tell you anything about the image update? (nodepool doesn't do that as a jenkins job)19:38
pleia2fungi: not image, but it will tell me if the nodes have different names (so they've rebuilt)19:38
fungioh, sure. i can also delete the available nodes once the update completes19:39
fungiso that it will make new ones sooner19:39
pleia2yeah, that would be good19:39
miquiclarkb, fungi: thanks... it is installed...19:39
miquiclarkb: looking at the puppet install for zuul, why does it need pip module?19:40
clarkbmiqui: we use pip to install zuul19:40
miqui@clarkb: thats what i thought thanks..19:44
*** nati_ueno has quit IRC19:47
*** nati_ueno has joined #openstack-infra19:47
fungipleia2: http://paste.openstack.org/show/48895/19:49
fungipleia2: i'm going to retry it just in case that was a transient connection issue19:50
*** jcoufal has quit IRC19:50
* fungi heads out, afk for a bit19:50
pleia2I think that happened before once, thinking19:50
*** nati_ueno has quit IRC19:52
*** CaptTofu has joined #openstack-infra19:52
*** senk has joined #openstack-infra19:55
*** senk has quit IRC20:00
*** dkranz has joined #openstack-infra20:02
*** CaptTofu has quit IRC20:04
*** CaptTofu has joined #openstack-infra20:04
mtreinishclarkb: awesome20:05
mtreinishthat seems far more painless then you were expecting20:05
mtreinish(or far less painful?)20:05
lifelesspleia2: so the queue is up?20:06
lifelesspleia2: ish?20:06
pleia2working on it, image is failing to build now20:06
clarkbmtreinish: yeah, it went really well. I did a bunch of testing locally first and ironed out the kinks. Without that it would've been bad20:06
*** prad_ has quit IRC20:06
*** CaptTofu has quit IRC20:09
clarkbI am going to go grab lunch, after that shard recovery should be done and I will finish up20:10
lifelesspleia2: 'yay' :P20:10
*** vipul is now known as vipul-away20:10
*** vipul-away is now known as vipul20:10
*** CaptTofu has joined #openstack-infra20:10
*** senk has joined #openstack-infra20:13
*** dirk_ has joined #openstack-infra20:13
*** dirk_ has quit IRC20:13
*** dirk has quit IRC20:13
fungipleia2: seems to have succeeded the second time20:21
fungideleting old nodes now20:21
pleia2\o/20:21
pleia2great20:21
*** rakhmerov has joined #openstack-infra20:21
*** prad has joined #openstack-infra20:22
anteayapleia2: yay20:23
*** vipul is now known as vipul-away20:25
fungipleia2: all done--should hopefully fill future node demand from the 1382385024 image now20:25
*** rakhmerov has quit IRC20:26
*** CaptTofu has quit IRC20:26
*** CaptTofu has joined #openstack-infra20:26
ryanpetrellookay, general installation question20:27
ryanpetrellolet's say I want to install "the latest stable release" for a project20:27
ryanpetrelloe.g.,20:27
ryanpetrellohttp://tarballs.openstack.org/ceilometer/20:27
ryanpetrellothere's ceilometer-master.tar.gz20:27
ryanpetrelloand ceilometer-stable-havana.tar.gz20:27
ryanpetrellois there any merit in ceilometer-stable-latest.tar.gz ?20:27
*** melwitt has quit IRC20:28
fungiryanpetrello: like, maintained as a symlink or something?20:28
ryanpetrello(that'd be fine)20:28
*** atiwari has joined #openstack-infra20:28
*** thomasbiege1 has joined #openstack-infra20:29
fungiwe talked about something similar as a rolling tag for the latest stable branch name on projects and i put together a poc at one point, but it ended up having limited interest and never went into production20:29
*** nati_ueno has joined #openstack-infra20:29
fungiif revisited, the same metadata could be used to determine the corresponding branch tarball symlink target as well20:30
*** CaptTofu has quit IRC20:31
ryanpetrelloI ask all of this20:32
*** zul has joined #openstack-infra20:32
ryanpetrellobecause I'm trying to come up w/ a way to gate pecan for development20:32
ryanpetrelloagainst core projects20:32
dhellmannwe will apply the same process to wsme, when we figure it out20:32
ryanpetrelloe.g., if you opened a pecan review, it would be really nice to make sure it isn't going to break grizzly/havana/master ceilometer20:33
*** CaptTofu has joined #openstack-infra20:34
fungiryanpetrello: we already run backward-compat jobs against stable branches for other projects. can't we do pecan/wsme the same way?20:34
*** yamahata has quit IRC20:35
dhellmannfungi: I think what we're asking is, how does that work?20:35
ryanpetrello(yep)20:35
fungidhellmann: multiple jobs each with a branch override20:35
fungithe current jobs we have which do that use the proposed change on the project being tested along with a stable/something branch of all other projects being integrated (with a fallback to master for projects which don't have the corresponding stable/whatever branch)20:37
reednice, another candidate system for translation management! java based, woot20:37
ryanpetrellofungi: how would I repurpose this for stackforge projects like pecan + wsme?20:38
fungiryanpetrello: depends on what sorts of tests you want to perform, but basically the same mechanics could be reused/duplicated20:39
ryanpetrellowell, really what we mainly want to do is run other projects unit tests (e.g., wsme, tuskar) against pending reviews of pecan20:40
fungido you want to run ceilometer stable/havana unit tests with a pecan rebuilt to include the proposed patch?20:40
*** pmoosh has joined #openstack-infra20:40
ryanpetrello(yep)20:40
fungiokay, as i guessed20:40
fungiso you'd have a job which does the same thing as the tuskar unit test job does, but override the branch name to stable/havana and preinstall pecan into the virtualenv from the checked out source repo? would probably need to put a little thought into that last bit20:42
*** danger_fo_away is now known as danger_fo20:42
*** pmoosh has left #openstack-infra20:42
ryanpetrello*reading that slowly20:44
ryanpetrello(yep, that's correct)20:44
ryanpetrellowe kind of figured it would be smart to test against e.g., stable/havana *and* master20:45
ryanpetrelloor maybe the last two "stable releases", not sure20:45
ryanpetrellobut basically, gate to ensure we're not breaking newish or bleeding-edge installs20:45
*** CaptTofu has quit IRC20:46
fungiwell, it would be the same job configuration as a template/builder in jjb configuration, and then run multiple instances of it one for each branch of interest20:46
*** CaptTofu has joined #openstack-infra20:46
pleia2fungi: gate-tripleo-deploy SUCCESS in 9m 29s20:47
pleia2yay!!20:47
*** gyee has joined #openstack-infra20:47
pleia2time to find some lunch foods20:47
ryanpetrellofungi: right20:49
ryanpetrelloso you mentioned tuskar20:49
ryanpetrelloare they doing something similar?20:49
*** thomasbiege1 has quit IRC20:49
fungiryanpetrello: i mentioned tuskar because you used it in your example, no other particular reason20:50
ryanpetrelloah, got it20:50
*** vipul-away is now known as vipul20:50
fungii'm at an osug meetup, but can probably look up some examples later if nobody beats me to it20:50
ryanpetrelloso I'm hearing that the backward-compat jobs probably wouldn't serve us well here?20:50
ryanpetrelloand that we'd need to do something different?20:51
ryanpetrellookay, no rush20:51
ryanpetrellojust sort of brainstorming20:51
*** CaptTofu has quit IRC20:51
*** mika has joined #openstack-infra20:51
fungiryanpetrello: didn't mean to suggest backward-compat jobs were a poor fit, just that our current examples are built around integration tests rather than unit tests20:51
ryanpetrellogot it20:52
*** yamahata has joined #openstack-infra20:52
fungiso the "use this same model but with unit tests" bit is what would need a little brainstorming20:52
*** lcestari has quit IRC20:52
openstackgerritDavid Peraza proposed a change to openstack/requirements: Adding sqlalchemy db2 dialect dependencies  https://review.openstack.org/4874520:53
fungii think (others may pipe up saying we've already done it and i'm just unaware)20:53
*** melwitt has joined #openstack-infra20:57
*** emagana has joined #openstack-infra21:00
*** markmcclain has joined #openstack-infra21:00
*** markmcclain has quit IRC21:01
*** markmcclain has joined #openstack-infra21:02
*** yamahata has quit IRC21:03
*** ryanpetrello has quit IRC21:03
*** anteaya_ has joined #openstack-infra21:03
*** yamahata has joined #openstack-infra21:03
*** weshay has quit IRC21:04
sdaguedamn, I missed the pecan discussion, I actually had something useful to say in that :)21:05
*** hashar has quit IRC21:06
dhellmannsdague: I'm still here, but I think ryan is having connectivity issues21:06
*** anteaya has quit IRC21:06
sdaguedhellmann: so look at what we do with oslo.config21:07
sdaguein devstack, so we're actually using the git version all the time21:07
dhellmannyeah, we'd like to do something like that as weel21:08
dhellmannwell21:08
dhellmannbut it would be really nice if we could run some basic tests locally, too, before pushing a commit21:08
*** yamahata has quit IRC21:08
sdagueyeh, so that you'd still need to cover with your unit tests, but if you actually want to verify compatibility, lighting it just like oslo.config in devstack is the way to go21:09
dhellmannsdague: dumb question: do the devstack jobs run the project unit tests, or is that when tempest runs? or both?21:11
fungithough if the goal is to make sure that, say, running nova unit tests on stable/havana works when importing the proposed change for oslo.config rather than the version of oslo.config it would normally use, that's something we haven't done (yet)21:11
*** gyee has quit IRC21:12
dhellmannthat's one goal, but if we're not set up to do something like that already I don't know if we want to break new ground right away21:12
fungibut i think we could do the branch selection bits in much the same was as we do for devstack backward-compat integration tests21:12
dhellmannI'd be happy to have the tests running against master as a first step, and then work with you guys on regression testing21:12
*** luisg has quit IRC21:14
fungidhellmann: if you're happy with integration tests instead, you could just add the devstack-based tests of interest to pecan or wsme's pipelines in zuul's layout.yaml and then backward-compat versions with branch overrides are easy to add21:14
*** gyee has joined #openstack-infra21:14
*** luisg has joined #openstack-infra21:14
dhellmannfungi: that would require updating the devstack test script to use a git clone of pecan & wsme, right?21:15
fungiit's the "run another project's unit tests with our proposed changes" which would need some work still21:15
dhellmannok21:15
fungidhellmann: ahh, right, if we're installing those from pypi in devstack/tempest tests now, then we'd need a very trivial variant of those jobs which uses a git checkout of them instead21:16
dhellmannfungi: yeah, or change devstack to install those from source all the time as sdague suggested21:17
fungiright21:18
clarkbI am back from lunch, going to start e-r shortly21:19
clarkbcluster is green21:19
*** luisg has quit IRC21:19
*** rakhmerov has joined #openstack-infra21:22
clarkbmtreinish: sdague: I think we are completely back up now21:23
*** yamahata has joined #openstack-infra21:24
mtreinishclarkb: nice21:24
*** gyee has quit IRC21:26
*** gyee has joined #openstack-infra21:26
*** rakhmerov has quit IRC21:27
ekarlsodoesn't git merge --abort work on the centos 6 git default version ?21:28
*** changbl has quit IRC21:28
*** marun has joined #openstack-infra21:29
clarkbekarlso: the man page for git on centos6 doesn't show a --abort option21:34
*** dkranz has quit IRC21:35
clarkbekarlso: you can probably use git reset or resolve the merge on a different machine21:35
miqui@clarkb: when i do: sudo zuul-server -h  (btw, installed zuul with latest puppet scripts from config)...i get no module message...21:35
miquipbr.version seems missing given the error i see...21:35
clarkbmiqui: can you paste the output to paste.openstack.org and link to the paste?21:35
miquiPaste #4890221:37
ekarlsoclarkb: you know what version of git centos 6 has ?21:37
miquinew to pastebin...21:37
miquiwas looking for a url to paste here...21:37
clarkbekarlso: 1.7.121:38
miqui@ekarlso: 1.6.x21:38
clarkbmiqui: after you click the paste button the url in your browser updates21:38
miquihmm ..need to check again on Centos ...21:39
*** vipul is now known as vipul-away21:39
miquihttp://paste.openstack.org/show/48902/21:39
miquithere...thanks.21:39
clarkbmiqui: 1.7.1 may come from epel, I am not sure21:39
ekarlso1.7.1 is right21:39
clarkbmiqui: so for pbr.version... you installed zuul with `python setup.py install` ?21:39
clarkbmiqui: it should install pbr as part of that but may not have, you can try pip installing pbr manually to see if that makes the problem go away21:40
miqui@clarkb: i installed zuul using the puppet scripts21:40
clarkbmiqui: in that case there may be something missing from the puppet since we haven't done a fresh install in a while. I would try `pip install pbr` then run zuul --version again21:40
*** vipul-away is now known as vipul21:40
*** yolanda has quit IRC21:41
*** sarob has quit IRC21:41
miquiyup... manual pip made it go away..21:41
*** sarob has joined #openstack-infra21:41
clarkbmiqui: asking mordred about how he would fix that is probably a good place to start if you want to fix the puppet21:41
clarkbmordred: ^ if you aren't too busy in edinbumumble21:41
miqui@clarkrb: is there something then that?21:42
miquiok..21:42
miquiwill ping mordred...21:42
miqui@clarkb: thanks!21:42
clarkbmiqui: I think mordred may say we should use `pip install .` instead of `python setup.py install`21:42
miquik...will see what he says..gotta run now..21:43
miquithanks..21:43
clarkbnp21:44
*** miqui has quit IRC21:45
*** sarob has quit IRC21:46
*** mriedem has quit IRC21:46
clarkbfungi: https://review.openstack.org/#/c/52453/ and its parent are what I have running on the cluster now. I plan on approving those today so that I can turn puppet back on, but figure I will give you some time to review if you like. Changes are actually pretty minimal and are basically make new versions of stuff work21:47
fungik21:47
*** danger_fo is now known as danger_fo_away21:47
*** mdenny has joined #openstack-infra21:48
fungiclarkb: as for pip install . vs python setup.py install there was/is a change proposed to do just that across all our puppetry i think? still pending?21:49
clarkbfungi: ah, I will look for it thanks21:49
fungii recall reviewing it at least once, but i'm so behind again, as usual21:50
clarkbme too21:50
*** ryanpetrello has joined #openstack-infra21:52
*** emagana has quit IRC21:53
openstackgerritMorgan Fainberg proposed a change to openstack/requirements: Set a floor on the python-memcache library  https://review.openstack.org/5218321:55
fungii should have added an infra proposal for the design summit to discuss warping spacetime to find extra hours in the day for, well, everything21:55
clarkbI would have gone to that session21:56
*** dkliban has quit IRC21:57
*** luhrs1 has joined #openstack-infra21:58
clarkbfungi: thanks for the review and sorry for the mess in indexer.conf.erb. I removed all deprecated conf stuff to help future proof us, which led to a pretty big diff21:58
*** shardy is now known as shardy_afk21:58
fungiyeah, still digesting21:58
*** yamahata has quit IRC21:58
sdaguedhellmann: sorry, phone call hit me. yeh, having an option to install a set of stackforge libraries like wsme and pecan from git is something that would be definitely cool. Plus it would give us the first piece in my CI the world idea of tracking all our python dependencies nightly to see if anyone is going to break us on their next release :)21:59
dhellmannsdague: that's what we're trying to do, since both pecan and wsme have broken things unexpectedly21:59
sdagueyep22:00
*** che-arne has quit IRC22:00
*** che-arne has joined #openstack-infra22:00
*** Loquacity has quit IRC22:00
sdaguedhellmann: so we could actually probably land that in a couple hours if you care, it would be super easy to duplicate the oslo.config model22:01
*** datsun180b has quit IRC22:02
*** luhrs1 has quit IRC22:02
dhellmannsdague: that sounds good. we're going to work on an option that lets us run the tests locally, too, but if you want to add a devstack-based gate job, I think that would be welcome, too22:03
*** prad has quit IRC22:05
fungiheading back home and then out to dinner for a while. bbl22:09
*** anteaya_ has quit IRC22:12
*** UtahDave has quit IRC22:12
sdaguedhellmann:  https://review.openstack.org/5302622:13
mtreinishclarkb, jeblair: can you take a quick look at https://review.openstack.org/50952 and https://review.openstack.org/51916 (jeblair already +2d the first one :))22:14
mtreinishthey should be straightforward22:14
clarkbmtreinish: yup looking22:15
*** SergeyLukjanov is now known as _SergeyLukjanov22:15
*** _SergeyLukjanov is now known as SergeyLukjanov22:15
clarkbmtreinish: in 50952 does tempest unittests work on stable/havana?22:16
clarkbfungi: speaking of we should remember to rip out folsom and insert havana jobs this week22:16
mtreinishclarkb: I believe so, let me just double check the havana branch to make sure the patch was included22:16
clarkbmtreinish: thanks22:16
dhellmannsdague: are we just relying on pip to recognize that the libs are already installed and not update them from pypi?22:16
*** thomasem has quit IRC22:16
mtreinishclarkb: yep: https://git.openstack.org/cgit/openstack/tempest/commit/?h=stable/havana&id=717fb564b1f56173c63aaa9c1478f31949fe799522:17
clarkbmtreinish: cool I will approve 50952 then22:17
*** senk has quit IRC22:17
mtreinishclarkb: great thanks22:17
*** senk has joined #openstack-infra22:19
openstackgerritA change was merged to openstack-infra/config: Add gating tempest unit test job  https://review.openstack.org/5095222:19
sdaguedhellmann: yes, we process the git trees first, then pip install after22:20
*** atiwari has quit IRC22:21
dhellmannsdague: ok, that should work well22:22
sdaguedhellmann: it will actually be really interesting to see what those results come back as :)22:22
*** rakhmerov has joined #openstack-infra22:22
sdaguedhellmann: so that's basically step #122:22
* dhellmann crosses fingers22:23
sdaguestep #2 is we need to gate wsme and pecan on the full tempest run22:23
openstackgerritA change was merged to openstack-infra/config: Upgrade elasticsearch to version 0.90.3.  https://review.openstack.org/5245222:23
openstackgerritA change was merged to openstack-infra/config: Upgrade Logstash to 1.2.1.  https://review.openstack.org/5245322:23
sdaguethen you'll never be able to break openstack, because you can't land changes that could break it22:23
dhellmannsdague: yes, that's what we want22:24
sdagueyep22:24
sdagueso lets see how that job fairs with the current git trees22:24
*** sarob has joined #openstack-infra22:24
* dhellmann nods22:25
*** rakhmerov has quit IRC22:27
*** esker has quit IRC22:28
*** SergeyLukjanov is now known as _SergeyLukjanov22:28
*** _SergeyLukjanov is now known as SergeyLukjanov22:28
*** CaptTofu has joined #openstack-infra22:28
*** sarob has quit IRC22:29
ryanpetrellohttps://pypi.python.org for anybody else atm?22:30
clarkbryanpetrello: it is up for me22:31
ryanpetrelloweird22:31
ryanpetrellomust've been a network blip22:31
clarkbryanpetrello: are you seeing trouble installing packages? if so that happens and is why we run a mirror22:31
sdaguedhellmann: http://summit.openstack.org/cfp/details/106 when did you schedule that one for?22:31
ryanpetrellonope, just noticed PyPI had a weird blip a moment ago for me22:31
ryanpetrello(weird)22:31
sdagueryanpetrello: our experience is it does that a lot22:32
ryanpetrello(yea, that's my experience, too :D)22:32
sdaguewhich is why we have our own mirror in the gate22:32
dhellmannsdague: last session in oslo on friday22:32
sdaguedhellmann: ok, cool, I can work with that22:32
sdagueI want to be in that one22:32
dhellmannsdague: the session just before is the global 'state of oslo" roundup to talk about breaking out libs for existing modules, and I wanted to save the breakup discussion for after that22:33
sdaguedhellmann: ok, cool22:33
dhellmannsdague: I would rather spend the effort on making the libraries stable and moving them out of the incubator, but I could be convinced that I'm wrong to keep them together. :-)22:33
sdagueI can only probably skip out on one QA session, but I can do that one22:33
dhellmannsdague: ah, yeah22:34
sdagueI think mordred has some of the same crazy ideas I do after doing global requirements22:34
sdaguebut sometimes we crazy in different directions22:34
dhellmannlol22:34
*** markmcclain has quit IRC22:34
*** dims has quit IRC22:38
*** oubiwann-lambda has quit IRC22:39
*** dhellmann is now known as dhellmann-afk22:41
*** dizquierdo has left #openstack-infra22:43
sdaguedhellmann-afk: doh, I didn't actually connect the last bit on that change22:44
dhellmann-afksdague: ?22:44
*** dhellmann-afk is now known as dhellmann22:44
sdagueI screwed up the devstack review, it didn't actually try to use the new libraries :)22:45
sdagueupdated22:45
*** SergeyLukjanov has quit IRC22:45
dhellmannsdague: oh, heh, I didn't catch that22:46
* dhellmann hears the dinner bell ring22:46
*** SergeyLukjanov has joined #openstack-infra22:46
*** dhellmann is now known as dhellmann-afk22:46
sdagueyeh, I'll have to run off to it soon as well22:46
*** SergeyLukjanov is now known as _SergeyLukjanov22:46
clarkbfungi: puppet restarted on all logstash related hosts22:47
*** _SergeyLukjanov has quit IRC22:48
*** Bada has joined #openstack-infra22:48
*** thedodd has quit IRC22:49
*** blamar has quit IRC22:50
*** yolanda has joined #openstack-infra22:51
*** rcleere has quit IRC22:54
sdagueclarkb: is it just me, or can you not get the time dropdown to work on new logstash?22:54
clarkbsdague: it works for me22:55
sdaguehmm... chrome restart fixed it22:55
sdaguewho know22:55
clarkbsdague: I did restart the kibana service to pick up a small config change22:55
clarkb(it made message the default field instead of @message)22:55
sdaguewell it fixed it once, then if I loose focus and come back it doesn't work22:55
*** dims has joined #openstack-infra22:55
clarkbsdague: I don't use it in chrome because it is known to have some bugs in chrom*22:55
*** matty_dubs is now known as matty_dubs|gone22:56
sdagueor does so oddly...22:56
sdaguehmmm bummer22:56
clarkbkibana3 seems to be ebtter in chrome22:56
clarkbI have a change up to add kibana3 but it needs a little extra work22:56
clarkbit is really close though22:56
clarkbI am not going to swap one out for the other at least not initially, giving folks options22:57
sdagueok22:58
clarkbpleia2: how are nodepool nodes doing?22:59
clarkbpleia2: I have time now if there is more work that needs doing around that23:00
*** rnirmal has quit IRC23:01
mordreddhellmann-afk: I do have crazy idea23:02
mordredideas23:02
mordreddhellmann-afk: it also depends a little bit on the new wheel/1.4-based code23:02
mgagneAre old design sessions deleted once openstack summit is passed?23:02
mgagne-> propositions23:02
openstackgerritClark Boylan proposed a change to openstack-infra/config: Add ironic translation jobs.  https://review.openstack.org/5303023:04
clarkbdevananda: NobodyCam ^23:04
clarkbmgagne: I think so, but you should have links to their etherpads on the old summit wiki pages23:04
*** yamahata has joined #openstack-infra23:04
mgagneclarkb: only link I have is https://blueprints.launchpad.net/glance/+spec/glance-api-extensions/ and link in whiteboard leads to 404.23:05
*** rockyg has joined #openstack-infra23:06
clarkbthat is unfortunate, judging by the date on the bp it would have been for the havana summit23:06
*** vipul is now known as vipul-away23:06
clarkbmgagne: https://wiki.openstack.org/wiki/Summit/Havana/Etherpads#Glance none of those map directly as far as I can tell23:07
*** hogepodge has quit IRC23:07
mgagneclarkb: thanks for looking =)23:08
clarkbmgagne: ttx may have backups for the summit site from previous cycles23:08
*** senk has quit IRC23:09
*** Bada has quit IRC23:09
*** SergeyLukjanov has joined #openstack-infra23:10
*** rockyg has quit IRC23:10
pleia2clarkb: they are working! thanks though :)23:10
*** nicedice_ has quit IRC23:11
*** nicedice__ has joined #openstack-infra23:11
mordredSergeyLukjanov: ping23:16
*** vipul-away is now known as vipul23:20
clarkbpleia2: does that mean you are able to run the script and everything? \o/23:20
*** Loquacity has joined #openstack-infra23:21
pleia2clarkb: yep, see https://review.openstack.org/#/c/52607/23:21
pleia2now it's just a simple echo script for now that doesn't actually do anything useful, but baby steps23:21
clarkbexciting23:22
*** changbl has joined #openstack-infra23:22
*** nicedice__ has quit IRC23:23
*** rakhmerov has joined #openstack-infra23:25
*** sarob has joined #openstack-infra23:25
*** oubiwann_ has joined #openstack-infra23:29
*** alexpilotti has quit IRC23:29
*** CaptTofu has quit IRC23:29
*** rakhmerov has quit IRC23:29
*** CaptTofu has joined #openstack-infra23:29
*** nicedice_ has joined #openstack-infra23:29
*** sarob has quit IRC23:30
*** boris-42 has quit IRC23:30
*** senk has joined #openstack-infra23:32
*** markmcclain has joined #openstack-infra23:33
*** SergeyLukjanov is now known as _SergeyLukjanov23:33
*** _SergeyLukjanov is now known as SergeyLukjanov23:33
*** SergeyLukjanov is now known as _SergeyLukjanov23:34
*** oubiwann_ has quit IRC23:34
*** _SergeyLukjanov is now known as SergeyLukjanov23:34
SergeyLukjanovmordred, pong23:35
mordredSergeyLukjanov: do you have anything to do with stackalytics?23:35
SergeyLukjanovmordred, I'm not working on it23:36
SergeyLukjanovany questions/suggestions?23:37
mordredSergeyLukjanov: well, we fixed a metadata issue with the employer of SpamapS23:38
mordredSergeyLukjanov: and it shows him as working for HP now - but it still counts his stuff for Savana for Canonical23:39
mordredit doesn't matter - I only noticed becuse my boss asked me to run a report for him :)23:39
mordredSergeyLukjanov: hrm. weird. it DOES'T show them for Canonical - but it also doesn't show them as HP23:41
SergeyLukjanovhm, interesting :)23:41
SergeyLukjanovyou can contact Ilya Shakhat (ishakhat@mirantis.com) he's the stackalytics maintainer23:41
mordredSergeyLukjanov: it's only reviews - commits works :)23:42
*** markmcclain has quit IRC23:43
mordredSergeyLukjanov: thanks - email sent23:44
SergeyLukjanovmordred, np23:45
clarkbre https://review.openstack.org/#/c/52092/ there are already 10 murano repositories23:47
clarkbis there a reason we need to split things up so finely for the murano project?23:47
clarkbI am not against more repos, it just seems a bit odd that one project would be so different than everything else23:48
*** Alssi has quit IRC23:49
*** hemna is now known as hemnafk23:49
SergeyLukjanovclarkb, I'm not on murano project too :)23:50
clarkbSergeyLukjanov: yeah, I was more just throwing it out there wondering if anyone knows why23:50
*** Alssi has joined #openstack-infra23:51
*** vipul is now known as vipul-away23:52
SergeyLukjanovbut afaik they trying to keep it as modular as possible23:53
*** senk has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!