Thursday, 2013-08-29

notmynameclarkb: I asked peluse to try it (in -swift)00:01
clarkbhttps://pypi.python.org/pypi/setuptools/1.1#backward-incompatible-changes may be biting us00:01
clarkbnotmyname: If versions 1.0 and 1.1 are giving you trouble I would try 0.9 as that is before the incompatible changes00:04
notmynameclarkb: thanks for looking00:04
*** olaph has joined #openstack-infra00:06
clarkbnotmyname: but anything >= 0.7 *should* work00:07
*** hemna is now known as hemnafk00:08
*** jamiem has quit IRC00:10
*** xBsd has quit IRC00:11
*** Ryan_Lane has quit IRC00:14
*** Ryan_Lane has joined #openstack-infra00:14
*** Ryan_Lane has quit IRC00:14
*** jamiem has joined #openstack-infra00:14
*** Ryan_Lane has joined #openstack-infra00:15
openstackgerritA change was merged to openstack-infra/jenkins-job-builder: Sort entry_points in setup.py for maintainability  https://review.openstack.org/4392400:15
clarkbmgagne: ^ success00:16
mgagne:D00:16
*** jamiem has quit IRC00:17
clarkbmgagne: is https://review.openstack.org/#/c/44136/ puppet-pacemaker a non openstack related project (at least not direclty?)00:21
clarkbif so that is really cool :)00:21
clarkbjeblair: ^00:21
clarkbit implies people want to use our tools and not just because OpenStack00:21
mgagneclarkb: I'm curious about the plan for this module and how stackforge can help =)00:21
openstackgerritA change was merged to openstack-infra/config: Move location of haproxy rsyslog conf file.  https://review.openstack.org/4417300:22
mgagneclarkb: I'm not fully aware of the stackforge policy neither00:23
clarkbmgagne: basically anything open source is fair game I think00:23
clarkbmgagne: sqlalchemy migrate and that dhellman project for example00:24
*** jamiem has joined #openstack-infra00:24
mgagneclarkb: fair to me00:24
clarkbwe consume them so there is a relationship there but they don't do the CLA or intend on incubating or anything00:24
*** olaph has quit IRC00:24
*** krtaylor has quit IRC00:25
*** moted has quit IRC00:26
*** moted has joined #openstack-infra00:26
mgagneclarkb: I'm glad to see more puppet modules using the infra and pipeline system to validate their changes. Can't be bad ;)00:26
Alex_Gaynorclarkb: Does http://bpaste.net/show/127311/ look right for adding the pypy jobs to some more projects? And is there anything I could be doing to have less duplication00:27
clarkbAlex_Gaynor: there is a way to reduce duplication in layout.yaml but we don't use it yet so lets ignore that for now. To reduce duplication in projects.yaml you can make gate-{name}-pypy part of the python-jobs job group00:28
clarkbAlex_Gaynor: it is at the bottom of the python-jobs.yaml file00:28
*** olaph has joined #openstack-infra00:28
Alex_Gaynorclarkb: if I make it a part of python-jobs does it run for everything, or do I still need to list it in projects.yml?00:28
Alex_Gaynor(OBviously many projects don't yet pass)00:28
clarkbAlex_Gaynor: it will only run if you add it to layout.yaml00:30
Alex_Gaynorclarkb: ok cool00:30
*** morganfainberg is now known as morganfainberg|a00:30
clarkbAlex_Gaynor: the jobs will be created for everyone though00:30
clarkbbut we can live with that00:30
Alex_Gaynorclarkb: so like http://bpaste.net/show/127312/00:31
*** w_ has joined #openstack-infra00:32
*** krtaylor has joined #openstack-infra00:33
clarkbAlex_Gaynor: yup00:33
Alex_Gaynorclarkb: awesome, need to wait for the things to add the tox jobs to be approved, but sweet!00:33
*** olaph has quit IRC00:34
*** gyee has quit IRC00:35
*** dims has quit IRC00:37
*** svarnau has quit IRC00:37
*** sarob has quit IRC00:39
*** dims has joined #openstack-infra00:39
*** jamiem has quit IRC00:41
clarkblifeless: Alex_Gaynor: https://jenkins02.openstack.org/job/gate-nova-python26/1966/console failed and I think that is because it relies on a timeout to know when to check for the processes that should be killed. http://git.openstack.org/cgit/openstack/nova/tree/nova/tests/integrated/test_multiprocess_api.py#n16300:45
clarkblifeless: Alex_Gaynor: any good ideas for making a test like that better?00:45
*** dims has quit IRC00:45
Alex_Gaynorclarkb: os.waitpid?00:45
Alex_Gaynoror something else from the wait* family?00:45
mgagneclarkb: someone needs to highlight the line linked to =)00:45
clarkbAlex_Gaynor: can those be given a timeout?00:45
Alex_Gaynorclarkb: excellent question!00:46
Alex_Gaynorclarkb: let me go ask some people who'll know the answer00:46
clarkbAlex_Gaynor: I guess the test timeout should handle that question. I think having a timeout is valid00:46
*** dims has joined #openstack-infra00:46
mgagneclarkb: I retract myself, worst html ever00:46
clarkbmgagne: and it is written by a C program :)00:46
mgagneclarkb: yes, I'm aware of that part... :-/00:47
*** nati_ueno has quit IRC00:47
mgagneclarkb: working to improve cgit is like that gif: http://d3j5vwomefv46c.cloudfront.net/photos/large/795272903.gif?1375176386 (whoever sent it last time)00:47
clarkbmgagne: I briefly looked at the code when trying to sort out notes and it was a bit eye opening00:47
mgagneclarkb: how?00:48
lifelessclarkb: so yeah thats buggy00:49
*** sarob has joined #openstack-infra00:49
clarkbjust if(notes_buf) { html(<insertstuff here>); html(notes_buf); }00:49
lifelessclarkb: it's eating the TimeOut exception and not re-raising00:49
mgagneclarkb: =)00:49
lifelessclarkb: waitpid etc either block, or poll, depending on parameters IIRC>00:49
clarkblifeless: only the child processes are doing that00:49
mgagneclarkb: time to go, cya!00:49
lifelessclarkb: no.. line 10600:50
lifelessclarkb: oh, I see,00:50
lifelessclarkb: but thats in tearDown which often /won't/ see the exception anyhow00:51
clarkbya00:51
lifelessclarkb: I'm quite sure this is substantially broken00:51
lifelessclarkb: what is it's goal ?00:51
clarkblifeless: aiui the goal is to test nova's signal handling. In that it should die when given a sigkill or sigterm00:51
clarkblifeless: I just noticed it caused a gate reset and it seems like silly code00:51
lifelessclarkb: actually, not - line 106 is the parent process00:52
lifelessclarkb: the children in spawn never return00:52
clarkblifeless: yeah only 52-76 is children00:52
lifelessalso it's using tearDown which is also buggy by design00:52
clarkbthe children don't actually *need* to go away before the test exits00:54
clarkbonce testr dies the children should get reparented to init and killed right?00:55
lifelessno; children escaping is nontrivial :)00:56
lifelessif they want to hang around, you have to kill -9 them; all depends on what failure modes we're willing to tolerate00:56
clarkbI think jenkins deals with that but $testbox won't00:57
*** w_ has quit IRC01:00
lifelessso if the parent dies, SIGsomething is sent to the children01:02
lifelessand the parent's parent has to reap01:02
lifelessif the children don't exit, they don't.01:02
lifelessif the parent's parent doesn't reap, you get a zombie.01:02
lifelessif the parent had made a new pgroup then it's parent might be init01:02
lifelessbut init won't stomp01:03
*** shardy has quit IRC01:08
clarkbSo I think passing WNOHANG to waitpid for the two pids in a poll loop with a reasonable timeout may at least pass more often01:11
clarkbthen we can worry about the timeout exception. I will file a bug01:11
*** ArxCruz has joined #openstack-infra01:11
clarkblifeless: does cleanupCode run after a timeout exception? I think it will01:17
*** olaph has joined #openstack-infra01:17
clarkblifeless: Alex_Gaynor https://bugs.launchpad.net/nova/+bug/121813301:18
uvirtbotLaunchpad bug 1218133 in nova "MultiprocessWSGITest.test_terminate_sigterm fails because the wait for workes to die is unreliable." [Undecided,New]01:18
clarkbtime to go home now01:18
*** olaph has quit IRC01:23
*** lbragstad has joined #openstack-infra01:26
*** lbragstad1 has joined #openstack-infra01:33
*** lbragstad has quit IRC01:34
*** jaypipes has joined #openstack-infra01:34
*** olaph has joined #openstack-infra01:36
*** w_ has joined #openstack-infra01:41
*** olaph has quit IRC01:44
*** nati_ueno has joined #openstack-infra01:46
*** pcrews has quit IRC01:54
*** w_ has quit IRC01:59
*** anteaya has quit IRC02:05
*** yaguang has joined #openstack-infra02:06
*** adalbas has joined #openstack-infra02:10
*** dims has quit IRC02:10
*** dims has joined #openstack-infra02:10
*** Ryan_Lane has quit IRC02:12
*** morganfainberg|a is now known as morganfainberg02:13
*** dims has quit IRC02:13
*** sarob has quit IRC02:15
*** olaph has joined #openstack-infra02:16
jheskethjeblair: ping02:19
*** zul has quit IRC02:20
*** michchap has quit IRC02:20
*** michchap has joined #openstack-infra02:21
*** thomasm has joined #openstack-infra02:22
Alex_Gaynorclarkb: if we switch to plan9 we can just select on /proc/{n}/wait02:22
clarkbAlex_Gaynor: good to know :)02:23
*** olaph has quit IRC02:24
*** olaph has joined #openstack-infra02:27
*** prad_ has quit IRC02:37
*** prad_ has joined #openstack-infra02:39
dkehnclarkb, I'm a little confused in that I've got a review https://review.openstack.org/#/c/30447/ that failed the gate-tempest-devstack-vm-full, which didn't look quite right so I submitted it again and it passed that test but failed the gate-tempest-devstack-vm-postgres-full, which it passed previously, any thoughts, or just keep rececking unitl it works.02:39
*** prad_ has left #openstack-infra02:42
clarkbdkehn: there is flakyness in the gate. recheck/reverify with proper bug number as necessary02:43
dkehnclarkb, ok, thx02:44
Alex_Gaynorclarkb: FWIW flakiness is way down since mtreinish's patch landed02:46
clarkbAlex_Gaynor: which one?02:47
Alex_Gaynorclarkb: #121716302:48
Alex_Gaynorhttps://bugs.launchpad.net/nova/+bug/121716302:48
uvirtbotLaunchpad bug 1217163 in nova "tempest test_aggregate_add_host_create_server_with_az fails with "server failed to build and is ERROR status"" [High,Fix committed]02:48
*** SergeyLukjanov has joined #openstack-infra02:50
clarkbAlex_Gaynor: I think there is still flakiness in one of the keystone cli tests02:54
clarkbAlex_Gaynor: mtreinish proposed a fix for that late today02:54
*** olaph has quit IRC02:54
*** thomasm has quit IRC02:54
Alex_Gaynorclarkb: yeah, that's the other big one on rechecks, if the numbers are accurate though that's 50% as much as the nova one was, so we cleared out ~2/3 of them :)02:54
Alex_Gaynorwell, mtreinish did02:55
*** melwitt has quit IRC03:01
*** rcleere has joined #openstack-infra03:01
*** nati_ueno has quit IRC03:03
*** olaph has joined #openstack-infra03:08
dkehnclarkb, wow 3rd times a charm, 3 try and it worked03:09
*** jfriedly has quit IRC03:22
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Add support for emailing results via SMTP  https://review.openstack.org/4264503:22
*** w_ has joined #openstack-infra03:24
*** olaph has quit IRC03:28
*** jjmb has joined #openstack-infra03:32
*** jjmb has quit IRC03:32
*** olaph has joined #openstack-infra03:32
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Add support for emailing results via SMTP  https://review.openstack.org/4264503:32
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Separate reporters from triggers  https://review.openstack.org/4264303:32
*** w_ has quit IRC03:34
*** SergeyLukjanov has quit IRC03:34
*** x05h has joined #openstack-infra03:34
*** w_ has joined #openstack-infra03:35
*** pcrews has joined #openstack-infra03:37
*** olaph has quit IRC03:38
*** Ryan_Lane has joined #openstack-infra03:40
*** w_ has quit IRC03:45
*** olaph has joined #openstack-infra03:46
lifelessis ruby-puppet-hiera the same as puppet-hiera?03:50
*** olaph has quit IRC03:53
*** dina_belova has joined #openstack-infra03:54
*** dina_belova has quit IRC03:56
*** dina_belova has joined #openstack-infra03:57
*** olaph has joined #openstack-infra03:57
*** vogxn has joined #openstack-infra03:58
lifelessoh, it's in puppet-common now04:00
lifelesswhy do we use such an old puppet ?04:01
*** dina_belova has quit IRC04:01
clarkblifeless: becase new puppet isn't compatible04:01
clarkbits like the python2.X to 3k transition04:02
clarkbthere is a lot of work that could go into making out puppet better04:02
clarkbbut that requires time and it works today :/04:02
lifelessclarkb: ok, so how does one install puppet-hiera on raring?04:02
clarkblifeless: no clue04:03
lifelessclarkb: ok, so what distro release *does* work ?04:03
clarkblifeless: we install everything from puppetlabs apt repo do they not have a package there?04:03
clarkblifeless: precise, quantal, fedora 19, centos604:03
lifelessclarkb: i have that repo added, the copy n paste command just barfed04:03
lifelessok04:03
lifelessrespinning from that :)04:03
clarkboh I wonder if raring has the same issue that fedora19 has with the puppetlabs repos04:05
lifelessthat being ?04:05
clarkbthey stopped building packages because new ruby and old puppet don't play nice together04:05
morganfainbergclarkb / lifeless: looking for some insight into jenkins and running tests.  Will jenkins in our configuration capture stdout and stderr? or just stdout from tests?  (not sure who else to ask)04:05
clarkbwe use fedora's puppet package on fedora 1904:05
clarkbmorganfainberg: should grab both04:05
lifelessmorganfainberg: jenkins always captures stdout and stderr04:05
morganfainbergok04:05
lifelessmorganfainberg: however, if tests capture stuff, jenkins won't see it :)04:05
morganfainbergi wasn't sure, since there is this review https://review.openstack.org/#/c/43480/04:05
lifelessmorganfainberg: so "I don't see X" doesn't imply jenkins failing to capture.04:06
morganfainbergi just wanted to be sure not to lose important data04:06
clarkbmorganfainberg: ugh04:06
morganfainberg(yes debug data can be important! :P)04:06
clarkbmorganfainberg: keystone shouldn't do either04:06
lifelessclarkb: is install-puppet.sh ok to use as part of starting the puppetmaster ?04:06
clarkbtest output should be captured by individual tests so that you can run them in parallel04:06
clarkblifeless: I think so04:06
morganfainbergclarkb: we're using oslo's logging04:07
*** w_ has joined #openstack-infra04:07
morganfainbergnow, so, however that gets handled… meaning likely we need some adjustments04:07
clarkbmorganfainberg: yeah but anything written to stdout or stderr will be jumbled when you run tsets in parallel04:07
*** HenryG has quit IRC04:07
lifelessmorganfainberg: commented on the review04:07
morganfainberglifeless: thanks04:07
lifelessmorganfainberg: a more full answer is to use a unique file per test, and attach it as described04:07
clarkbmorganfainberg: what we have done for nova and others is capture stdout and stderr per test and use lifeless's logging module04:08
clarkbs/module/fixture04:08
morganfainberglifeless: that was what i was looking for.  appriciate it :)04:08
lifelessor what clarkb says too04:08
clarkblifeless: morganfainberg don't add detail explicitly just use the logging fixture04:08
clarkbworks great04:08
lifelessif it's in-process logging,the logging fake is more efficient04:08
lifelessif it's out-of-process e.g. a server,then grabbing a file is the way to go04:08
lifelessclarkb: ^04:08
clarkbI see04:09
*** vogxn has quit IRC04:09
morganfainberglifeless, clarkb, i'll go check out nova's setup and … recommend moving to that.04:09
lifelessclarkb: I did not know if it was in-process or out of process, assumed out of when I answered :)04:09
clarkbmorganfainberg: I am finding you a link04:09
morganfainbergclarkb: you rock dude!04:09
clarkbmorganfainberg: http://git.openstack.org/cgit/openstack/nova/tree/nova/test.py#n220 to line 23004:10
*** olaph has quit IRC04:10
lifelessclarkb: on http://ci.openstack.org/puppet.html#id204:12
lifelessclarkb: can the initial install be made simpler by running install-puppet.sh or will that mess stuff up ?04:12
morganfainbergclarkb: thanks.04:12
*** vogxn has joined #openstack-infra04:12
lifelessclarkb: e.g. to avoid manually fiddling with prefs files etc04:13
clarkblifeless: I think you can use install puppet then will need to install the missing master packages04:14
lifelessThe following packages have unmet dependencies:04:16
lifeless puppetmaster-passenger : Depends: puppetmaster-common (= 3.2.4-1puppetlabs1) but 2.7.23-1puppetlabs1 is to be i04:16
lifelessneed a broader pin in the script version04:16
lifelessthats easy fixed04:16
fifieldtclarkb, do you know if any progress was made on the transifex "source language" problem?04:18
*** x05h has quit IRC04:19
clarkbfifieldt: what problem is that?04:20
fifieldtabout half of the projects have source language=en-US, when it should be language=en04:20
clarkbwhy?04:20
clarkben_US is a thing04:20
clarkbI don't think that is a bug04:20
fifieldtwhatever it is04:20
fifieldtit needs to be the same04:20
fifieldtotherwise we can't share translatino memory04:21
clarkboh I see04:21
clarkbno I hadn't even ehard of the issue04:21
fifieldtlast I can see is daisy's email [OpenStack-Infra] Need help on Transifex setting from last week04:21
*** olaph has joined #openstack-infra04:21
clarkbthat tells you how far behind email I fell last week. let me pull it up04:21
fifieldtno worries04:22
fifieldtI've  just got no idea how to proceed it, so I thought I'd ask04:22
clarkbso it looks like django is partially the problem here04:23
clarkbit doesn't support en_US...04:24
*** w_ has quit IRC04:24
fifieldtinteresting, horizon is one of the ones with source set to en_US :)04:24
clarkbwhich means we would need to standardize on en to be consistent and share translation memory. I am not sure I like that because lifeless definitely speaks a different language than I do04:24
clarkbfifieldt: it is en_US on transifex but en in the code and it is causing problems https://bugs.launchpad.net/horizon/+bug/117952604:24
uvirtbotLaunchpad bug 1179526 in horizon "source_lang in Horizon repo is overwritten by Transifex" [High,In progress]04:24
fifieldtright!04:25
fifieldtI think choosing a sub-type of en is arrogant :)04:25
fifieldtin the case of our international dev community04:25
fifieldtbut *shrug*04:25
clarkbfifieldt: thats how gettext works iirc04:25
clarkbor is it internationalization and localization04:25
clarkbthe localization bit is important04:25
clarkben_US tells you to format dats in mm/dd/yyyy not dd/mm/yyyy04:26
* fifieldt is well aware :)04:26
clarkbit is important in subtle ways04:26
fifieldtin any case04:26
fifieldtanything I can do to help progress this?04:27
fifieldtit appears to just be a transifex problem, yes?04:27
clarkbfifieldt: I think there are two pieces. fixing transifex and also making sure that the projects don't regenerate en_US and go with that04:27
fifieldtok, my impression is the latter is solved-ish by the scripts?04:28
clarkbfifieldt: I think so. Where we do an extract_catalog in the jenkins scripts we may need to enforce the source locale04:28
fifieldtcool04:28
clarkbfwiw my local is en_US.UTF-8 locally04:29
fifieldtI vary between en_AU.UTF8, zh_CN, zh_TW and ja_JP :)04:29
clarkbsee it matters :)04:29
fifieldtnever argued with that :)04:30
*** boris-42 has joined #openstack-infra04:30
clarkbor maybe we should set the source local to C04:30
fifieldtha!04:30
fifieldtwhat do they use on plan9 ?04:30
clarkbno idea04:30
fifieldt;)04:30
*** arezadr has quit IRC04:31
fifieldtok, I'm going to email to find out if anyone asked transifex yet04:31
fifieldtthanks for your help decoding that04:31
fifieldtconfusing as hell :)04:31
clarkbno problem04:31
*** amotoki has joined #openstack-infra04:33
*** arezadr has joined #openstack-infra04:33
*** arezadr has quit IRC04:36
*** arezadr has joined #openstack-infra04:37
*** reed has quit IRC04:37
*** sandywalsh has quit IRC04:37
*** olaph has quit IRC04:41
openstackgerritlifeless proposed a change to openstack-infra/config: Make setting up a Puppetmaster easier.  https://review.openstack.org/4420904:49
lifelessclarkb: I think I'm 7 patches deep now :)04:51
*** olaph has joined #openstack-infra04:56
*** w_ has joined #openstack-infra05:00
*** olaph has quit IRC05:03
*** CaptTofu has quit IRC05:03
*** CaptTofu has joined #openstack-infra05:03
*** dina_belova has joined #openstack-infra05:07
*** sandywalsh has joined #openstack-infra05:07
*** CaptTofu has quit IRC05:08
*** rcleere has quit IRC05:11
*** SergeyLukjanov has joined #openstack-infra05:11
*** dina_belova has quit IRC05:12
*** SergeyLukjanov has quit IRC05:13
*** SergeyLukjanov has joined #openstack-infra05:16
*** w_ has quit IRC05:17
*** nicedice_ has quit IRC05:20
*** SergeyLukjanov has quit IRC05:21
*** SergeyLukjanov has joined #openstack-infra05:23
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Translation update jobs now supports any org  https://review.openstack.org/4421205:27
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Enable translation jobs for the savanna project  https://review.openstack.org/4421305:27
*** SergeyLukjanov has quit IRC05:32
*** SergeyLukjanov has joined #openstack-infra05:48
*** SergeyLukjanov has quit IRC05:53
*** SergeyLukjanov has joined #openstack-infra05:56
*** SergeyLukjanov has quit IRC06:02
*** sgviking has quit IRC06:26
*** sgviking has joined #openstack-infra06:27
*** amotoki has quit IRC06:38
*** amotoki has joined #openstack-infra06:39
*** amotoki_ has joined #openstack-infra06:42
*** jpich has joined #openstack-infra06:43
*** amotoki has quit IRC06:46
*** pcm_ has quit IRC06:56
*** lbragstad has joined #openstack-infra06:58
*** lbragstad1 has quit IRC06:59
*** thomasbiege has joined #openstack-infra07:00
*** thomasbiege has quit IRC07:00
*** michchap has quit IRC07:05
*** michchap has joined #openstack-infra07:05
openstackgerritafazekas proposed a change to openstack-infra/devstack-gate: Missing space at the end of the conditional expression  https://review.openstack.org/4422307:08
*** jhesketh has quit IRC07:11
*** jhesketh has joined #openstack-infra07:12
*** amotoki_ is now known as amotoki07:15
*** olaph has joined #openstack-infra07:15
*** hashar has joined #openstack-infra07:17
openstackgerritafazekas proposed a change to openstack-infra/devstack-gate: Missing default value  https://review.openstack.org/4422607:20
*** afazekas has joined #openstack-infra07:21
*** Bada has joined #openstack-infra07:29
*** vogxn has quit IRC07:29
*** w_ has joined #openstack-infra07:30
*** dkehn has quit IRC07:31
*** SergeyLukjanov has joined #openstack-infra07:32
*** olaph has quit IRC07:33
*** shardy has joined #openstack-infra07:33
*** SergeyLukjanov has quit IRC07:33
*** hashar_ has joined #openstack-infra07:35
*** SergeyLukjanov has joined #openstack-infra07:36
*** DennyZhang has joined #openstack-infra07:38
*** hashar has quit IRC07:38
*** hashar_ is now known as hashar07:38
*** michchap has quit IRC07:43
*** w_ has quit IRC07:47
*** fbo_away is now known as fbo07:48
*** SergeyLukjanov has quit IRC07:51
*** SergeyLukjanov has joined #openstack-infra07:58
*** SergeyLukjanov has quit IRC07:59
*** w_ has joined #openstack-infra07:59
*** michchap has joined #openstack-infra08:04
*** vogxn has joined #openstack-infra08:07
*** derekh has joined #openstack-infra08:10
*** w_ has quit IRC08:21
*** olaph has joined #openstack-infra08:21
*** SergeyLukjanov has joined #openstack-infra08:27
openstackgerritEmilien Macchi proposed a change to openstack-infra/jenkins-job-builder: Add Plot plugin support  https://review.openstack.org/4368508:31
*** w_ has joined #openstack-infra08:35
*** olaph has quit IRC08:38
*** olaph has joined #openstack-infra08:38
*** w_ has quit IRC08:40
*** dizquierdo has joined #openstack-infra08:42
*** olaph has quit IRC08:52
*** olaph has joined #openstack-infra08:52
*** SergeyLukjanov has quit IRC08:54
*** pcm_ has joined #openstack-infra08:57
*** ruhe has joined #openstack-infra09:00
*** pcm_ has quit IRC09:01
*** johnthetubaguy has joined #openstack-infra09:02
*** alexpilotti has joined #openstack-infra09:03
*** olaph has quit IRC09:04
*** olaph has joined #openstack-infra09:05
*** johnthetubaguy has left #openstack-infra09:11
openstackgerritJulien Danjou proposed a change to openstack-infra/config: Run tests against pypy on pbr  https://review.openstack.org/4424609:11
*** w_ has joined #openstack-infra09:11
*** olaph has quit IRC09:14
*** olaph has joined #openstack-infra09:17
*** vogxn has quit IRC09:17
*** morganfainberg is now known as morganfainberg|a09:17
openstackgerritJulien Danjou proposed a change to openstack-dev/hacking: Add pypy on tox envlist  https://review.openstack.org/4424809:17
*** w_ has quit IRC09:18
openstackgerritJulien Danjou proposed a change to openstack-infra/config: Run tests against pypy for pbr and hacking  https://review.openstack.org/4424609:18
openstackgerritEmilien Macchi proposed a change to openstack-infra/jenkins-job-builder: Add Plot plugin support  https://review.openstack.org/4368509:28
openstackgerritEmilien Macchi proposed a change to openstack-infra/jenkins-job-builder: Add Plot plugin support  https://review.openstack.org/4368509:28
*** vogxn has joined #openstack-infra09:30
*** yongli has quit IRC09:32
*** pcm_ has joined #openstack-infra09:34
openstackgerritDaniel Izquierdo proposed a change to openstack-infra/config: bug 1218252  https://review.openstack.org/4405709:37
uvirtbotLaunchpad bug 1218252 in openstack-ci "New core member for community-metrics-dash stackforge project" [Undecided,New] https://launchpad.net/bugs/121825209:37
openstackgerritLucas Alvares Gomes proposed a change to openstack/requirements: Add jsonpatch  https://review.openstack.org/4425309:40
*** markmc has joined #openstack-infra09:47
*** vogxn has quit IRC09:48
*** DennyZhang has quit IRC09:53
*** DennyZhang has joined #openstack-infra09:55
*** senk has quit IRC09:57
*** w_ has joined #openstack-infra09:59
*** olaph has quit IRC09:59
openstackgerritEmilien Macchi proposed a change to openstack-infra/jenkins-job-builder: Add IRCbot plugin support  https://review.openstack.org/4403209:59
*** w_ has quit IRC10:02
*** olaph has joined #openstack-infra10:05
*** SlickNik has quit IRC10:07
*** spiffxp has quit IRC10:07
openstackgerritEmilien Macchi proposed a change to openstack-infra/jenkins-job-builder: Add IRCbot plugin support  https://review.openstack.org/4403210:07
derekhhi, I'm wondering if somebody might find some time to look at https://bugs.launchpad.net/openstack-ci/+bug/1217815 , no major hurry I just wanna stop using my gerrit account for automated reviews10:10
uvirtbotLaunchpad bug 1217815 in openstack-ci "Tripleo ci service account in gerrit" [Undecided,New]10:10
*** senk has joined #openstack-infra10:13
*** dkehn has joined #openstack-infra10:13
*** spiffxp has joined #openstack-infra10:16
*** SlickNik has joined #openstack-infra10:16
*** ruhe has quit IRC10:18
*** w_ has joined #openstack-infra10:24
openstackgerritlifeless proposed a change to openstack-infra/config: Document bootstrapping a new infrastructure.  https://review.openstack.org/4426210:25
openstackgerritlifeless proposed a change to openstack-infra/config: Port across params and puppet_cron.  https://review.openstack.org/4426310:25
openstackgerritlifeless proposed a change to openstack-infra/config: Initial bootstrap configuration.  https://review.openstack.org/4426410:25
openstackgerritlifeless proposed a change to openstack-infra/config: Fix semantic error in example config.  https://review.openstack.org/4400010:25
openstackgerritlifeless proposed a change to openstack-infra/config: Add a pointer to launch/README for root operators.  https://review.openstack.org/4416310:25
openstackgerritlifeless proposed a change to openstack-infra/config: Make setting up a Puppetmaster easier.  https://review.openstack.org/4420910:25
openstackgerritlifeless proposed a change to openstack-infra/config: Make root-only information clear in sysadmin.rst.  https://review.openstack.org/4416210:25
openstackgerritlifeless proposed a change to openstack-infra/config: Start documenting running your own CI infra.  https://review.openstack.org/4417710:25
openstackgerritlifeless proposed a change to openstack-infra/config: Correct launch README.  https://review.openstack.org/4415410:26
*** olaph has quit IRC10:26
lifelessbooyah10:26
lifelessjeblair: clarkb: is there an example hiera production file in the docs anywhere? I see reference to it being yaml, but not to what keys are needed, nor what they might look like.10:27
*** vogxn has joined #openstack-infra10:27
*** olaph has joined #openstack-infra10:29
*** fifieldt has quit IRC10:29
*** pcm_ has quit IRC10:31
*** w_ has quit IRC10:31
*** olaph has quit IRC10:32
*** olaph has joined #openstack-infra10:33
*** w_ has joined #openstack-infra10:37
*** olaph has quit IRC10:40
*** w_ has quit IRC10:43
*** DennyZhang has quit IRC10:45
*** ruhe has joined #openstack-infra10:53
*** weshay has quit IRC10:53
*** weshay has joined #openstack-infra10:54
*** yaguang has quit IRC10:59
*** dprince has joined #openstack-infra11:01
*** ruhe has quit IRC11:01
*** ruhe has joined #openstack-infra11:02
*** hashar has quit IRC11:09
*** ruhe has quit IRC11:10
*** ruhe has joined #openstack-infra11:10
lifelessjeblair: clarkb: how does the config checkout on the puppetmaster get updated?11:14
lifelessjeblair: clarkb: and what size node should the dashboard be?11:14
openstackgerritlifeless proposed a change to openstack-infra/config: Make the adduser commands copy-pasteable.  https://review.openstack.org/4427011:20
openstackgerritlifeless proposed a change to openstack-infra/config: Stage 2 - dashboard.  https://review.openstack.org/4427111:20
openstackgerritlifeless proposed a change to openstack-infra/config: Initial bootstrap configuration.  https://review.openstack.org/4426411:20
openstackgerritlifeless proposed a change to openstack-infra/config: Port across params and puppet_cron.  https://review.openstack.org/4426311:20
openstackgerritlifeless proposed a change to openstack-infra/config: Document bootstrapping a new infrastructure.  https://review.openstack.org/4426211:20
*** vogxn has quit IRC11:25
*** dstufft has quit IRC11:27
*** dstufft has joined #openstack-infra11:28
*** dstufft has quit IRC11:30
*** dstufft has joined #openstack-infra11:31
*** dprince has quit IRC11:42
*** pcm_ has joined #openstack-infra11:44
*** HenryG has joined #openstack-infra11:46
*** prad_ has joined #openstack-infra11:47
*** prad_ has quit IRC11:47
*** michchap has quit IRC11:58
*** michchap has joined #openstack-infra11:59
*** thomasm has joined #openstack-infra11:59
*** rfolco has joined #openstack-infra12:00
thomasmHey all!12:02
*** dstufft has quit IRC12:08
*** weshay has quit IRC12:09
*** SergeyLukjanov has joined #openstack-infra12:15
*** dstufft has joined #openstack-infra12:16
*** SergeyLukjanov has quit IRC12:20
*** CaptTofu has joined #openstack-infra12:20
*** jamiem has joined #openstack-infra12:21
*** dkranz has quit IRC12:21
*** ruhe has quit IRC12:22
*** dstufft has quit IRC12:25
*** dstufft has joined #openstack-infra12:26
*** dims has joined #openstack-infra12:26
*** hashar has joined #openstack-infra12:28
*** jergerber has joined #openstack-infra12:30
*** hashar has quit IRC12:42
*** BadaBoum has joined #openstack-infra12:42
*** tianst20 has joined #openstack-infra12:43
*** Bada has quit IRC12:44
*** tianst20 has quit IRC12:44
*** sandywalsh has quit IRC12:46
*** anteaya has joined #openstack-infra12:51
*** hashar has joined #openstack-infra12:54
*** afazekas has quit IRC12:57
*** markmc has quit IRC12:59
*** sandywalsh has joined #openstack-infra13:01
*** weshay has joined #openstack-infra13:02
anteayazuul is quite, 3 in the gate, 9 in check13:03
anteayaquiet13:03
*** vogxn has joined #openstack-infra13:04
BobBallMakes me think something must be broken with that few in the queue...13:04
BobBall:P13:04
BobBallAm I too paranoid?13:04
anteayayes13:05
anteayaI am going by the log I just read from the last 8 hours13:06
anteayaif something was broken, there would have been more people posting questions about random failures in channel13:07
anteayait is good to be paranoid, so glad to have the paranoia in the crowd13:07
anteayazuul is really good at clearing a queue now13:08
*** ruhe has joined #openstack-infra13:08
anteayato check pipelines in the check queue, post queue is completing tests in about half the time it was - freeing up nodes13:08
anteayaother tweaks on merging to get the most patches in with a chance of merging by removing those patches with a low chance of merging as early as possible13:09
anteayazuul has changed a lot in the last week and a half13:10
anteayas/to check pipelines/two check pipelines13:10
*** dstanek has joined #openstack-infra13:19
*** mriedem has joined #openstack-infra13:22
*** olaph has joined #openstack-infra13:22
*** ruhe has quit IRC13:25
*** [wchrisj_ has joined #openstack-infra13:26
*** ruhe has joined #openstack-infra13:27
*** dkliban has joined #openstack-infra13:32
*** afazekas has joined #openstack-infra13:33
*** ruhe_ has joined #openstack-infra13:34
*** olaph has quit IRC13:34
*** ruhe has quit IRC13:35
*** olaph has joined #openstack-infra13:37
*** marun has joined #openstack-infra13:37
*** dkehn_ has joined #openstack-infra13:38
*** dkehn has quit IRC13:40
*** changbl has quit IRC13:43
*** dkehn_ is now known as dkehn13:44
*** olaph has quit IRC13:45
*** lbragstad has quit IRC13:52
*** dkranz has joined #openstack-infra13:58
*** olaph has joined #openstack-infra13:59
*** codenamekt has joined #openstack-infra14:02
*** prad has quit IRC14:02
*** hashar has quit IRC14:03
*** cppcabrera has joined #openstack-infra14:03
*** hashar has joined #openstack-infra14:04
*** alexpilotti has quit IRC14:10
*** michchap has quit IRC14:16
*** olaph has quit IRC14:19
*** alexpilotti has joined #openstack-infra14:20
*** dukhlov_ has joined #openstack-infra14:20
dukhlov_Hi all14:20
dukhlov_I have a problem with openstack review14:20
dukhlov_fatal: ICLA contributor agreement requires current contact information.14:21
dukhlov_but it seems that all fields where filled14:21
dukhlov_Could anybody help me?14:21
mriedemdukhlov_: you have a launchpad account?14:22
dukhlov_yes14:22
mriedemhttps://launchpad.net/~dukhlov14:23
mriedemsee that14:23
mriedemdukhlov_: joined the foundation? https://www.openstack.org/join/14:23
*** adalbas has quit IRC14:23
dukhlov_mriedem: yes14:24
mriedemdukhlov_: can you get here? https://review.openstack.org/#/settings/agreements14:24
dukhlov_yes14:24
mriedemdoes it show the ICLA?14:24
mriedemas verified?14:24
*** alexpilotti has quit IRC14:25
dukhlov_VerifiedICLAOpenStack Individual Contributor License14:25
mriedemdukhlov_: has someone at mirantis signed the corporate contributor license agreement on your behalf?14:25
mriedemdukhlov_: otherwise check this FAQ: https://wiki.openstack.org/wiki/CLA-FAQ#Why_am_I_getting_an_error_message_about_the_ICLA_requiring_contact_information_when_trying_to_submit_patches_for_review.3F14:26
mriedemdukhlov_: otherwise there are other FAQs that might help you on that same page14:27
mriedemor maybe talk to boris-4214:27
boris-42mriedem hi14:28
mriedemboris-42: ^14:29
boris-42mriedem what;s up?)14:29
*** dhellmann_ is now known as dhellmann14:29
dukhlov_boris-42: hi14:30
*** olaph has joined #openstack-infra14:30
dukhlov_I have a probleb with creating review14:30
dukhlov_I've got "fatal: ICLA contributor agreement requires current contact information."14:31
dukhlov_and I cann't find out my mistake14:31
dukhlov_can you check what is the problem?14:32
*** rnirmal has joined #openstack-infra14:32
anteayadukhlov_: have you tried re-entering your contact information in the ICLA and trying to submit to gerrit again?14:33
anteayaif no, I suggest it14:33
*** yaguang has joined #openstack-infra14:34
dukhlov_sure I did that14:34
dukhlov_many times :)14:34
anteayaokay14:34
anteayaat this point then the only suggestion I have is to wait for either jeblair or clarkb to check the db manually and see what your account says14:35
anteayakeep in mind your contact information is not kept in the same database for security reasons so I don't know what entry the main user database will have regarding your ICLA contact information14:36
*** dkehn_ has joined #openstack-infra14:36
anteayaI don't have access to the database so I can't check it myself14:36
anteayaone of them should be around in a couple of hours14:36
dukhlov_maybe we have some rules or filter for contact info fields and I entered not valid data?14:36
anteayadid you enter valid data?14:37
dukhlov_yes, but maybe format is wrong14:37
anteayapossible14:37
anteayaI don't recall verification filters being put into place14:38
*** olaph has quit IRC14:38
anteayain the past some fields have accepted a dot "." as a valid entry14:38
*** dkehn has quit IRC14:38
anteayadukhlov_: mind if I get a full stack trace on a paste, including the command you are trying to run?14:39
anteayapaste.openstack.org14:39
*** ruhe_ has quit IRC14:39
*** ruhe has joined #openstack-infra14:40
dukhlov_no, please14:41
anteayaokay so run your command, copy the stack trace to a paste and then post the url for the paste in channel14:41
anteayathanks14:41
anteayaplease include the command you are trying to run14:42
*** olaph has joined #openstack-infra14:42
*** dstanek has quit IRC14:43
*** adalbas has joined #openstack-infra14:44
*** dkehn_ is now known as dkehn14:44
boris-42dukhlov_ biab soon14:45
*** wenlock has joined #openstack-infra14:45
*** michchap has joined #openstack-infra14:47
*** changbl has joined #openstack-infra14:47
clarkbmorning14:48
Alex_Gaynormorning!14:48
anteayamorning clarkb14:48
anteayamorning Alex_Gaynor14:48
*** rcleere has joined #openstack-infra14:49
clarkbdukhlov_: anteaya: The contact needs to be semi complete. If there are fields left out the foundation server may not give gerrit a 200 OK back14:49
*** datsun180b has joined #openstack-infra14:50
clarkbdukhlov_: anteaya: you also need to make sure that gerrit has the same email address that is used for signing up to the foundation14:50
anteayaclarkb: but you can't see which fields have or have not been completed in our user database, correct?14:50
anteayafor the contact info14:50
jog0clarkb: ping14:50
clarkbanteaya: right. That is all on the foundation side which I have no access to14:51
clarkbjog0: pong14:51
anteayadukhlov_: can you check your email addesses are the same in gerrit, launchpad and the foundation website?14:51
jog0clarkb: added an inline question to https://review.openstack.org/#/c/43781/14:52
jog0was hoping to confoirm with you before I respin14:52
clarkbjog0: looking14:52
dukhlov_anteaya: yes its the same14:53
clarkbjog0: done, I also added more info to my previous comment14:54
anteayadukhlov_: any success creating a paste of your output yet? does my request make sense to you?14:54
jog0clarkb: thanks14:54
dukhlov_sory guys, I have to leave now, thank you for help, I will come back in 2 hours14:54
anteayadukhlov_: okay14:55
*** michchap_ has joined #openstack-infra14:55
*** michchap has quit IRC14:55
openstackgerritJoe Gordon proposed a change to openstack-infra/config: Add gate-tempest-devstack-vm-large-ops job  https://review.openstack.org/4378114:55
jog0clarkb: this experimential pipeline is pretty slick14:55
clarkbjog0: ya I think it was a good idea from mordred14:56
*** yaguang has quit IRC14:56
*** michchap has joined #openstack-infra14:56
*** michcha__ has joined #openstack-infra14:59
*** michchap_ has quit IRC14:59
*** michchap has quit IRC15:01
*** michchap has joined #openstack-infra15:01
*** olaph has quit IRC15:02
*** michchap_ has joined #openstack-infra15:03
*** michcha__ has quit IRC15:03
*** dstanek has joined #openstack-infra15:03
*** pentameter has joined #openstack-infra15:05
*** michchap has quit IRC15:06
*** michchap_ has quit IRC15:08
openstackgerritDan Prince proposed a change to openstack-infra/reviewday: Added time-based score for patches  https://review.openstack.org/3883615:10
anteayahey soren, I am finally getting around to the ml and found the post the motivated your question yesterday: http://lists.openstack.org/pipermail/openstack-dev/2013-August/014307.html sorry I was not up on current events15:10
openstackgerritA change was merged to openstack-infra/reviewday: Added time-based score for patches  https://review.openstack.org/3883615:11
openstackgerritClark Boylan proposed a change to openstack-infra/config: Rotate gearman log worker logs.  https://review.openstack.org/4430315:18
*** hashar_ has joined #openstack-infra15:19
*** hashar has quit IRC15:22
*** hashar_ is now known as hashar15:22
*** gyee has joined #openstack-infra15:27
*** olaph has joined #openstack-infra15:27
*** derekh has quit IRC15:29
*** w_ has joined #openstack-infra15:30
*** jpich has quit IRC15:30
jeblairjog0: thanks for walking me through your idea about restarting zuul jobs for changes that are not at the head15:32
jeblairjog0: i think i've worked out how the algorithm can be changed to do that in a fairly simple and generalized way15:33
*** olaph has quit IRC15:33
jog0jeblair: \o/ thanks for taking the time to entertain my ideas, which turned out to be mordred's idea too15:33
jog0I have learned that 9/10 times when I ask a random question like that the answer is, we are already working on it15:34
*** alexpilotti has joined #openstack-infra15:34
jeblairjog0: in fact, the way i'm currently conceiving it would be a fairly simple change, except that it may remove some signficant chunks of code.  :)15:35
anteayajog0 but it helps us in the cheap seats follow the action15:35
jog0jeblair: awesome that the best kind of improvment15:36
*** w_ has quit IRC15:37
jeblairjog0: basically, each change should be tested against the 'nearest non-failing queue item'; that will allow it to skip any number of failing items in the queue, essentially anticipating what is eventually going to happen ahead of it.15:37
clarkbjeblair: jog0: what happens when something ahead in the queue fails?15:38
jeblairjog0: tha crazy part is that there will be wild swings in what the queue tests -- if a change halfway down fails, then half the queue is immediately restarted, and then if one at the top fails, nearly the whole queue is immediately restarted (including the one that failed halfway down); if the one halfway down fails again, then again, half the queue is restarted15:38
clarkbafter you have branched? cancle and start again?15:38
clarkbthat answers my question :)15:38
jeblairall told, though, it probably works out to about the same number of cpus used, however, it greatly compresses the time scale; basically, we don't wait for a gate reset to finish to have another gate reset15:39
jog0jeblair: slick15:40
openstackgerritJulien Danjou proposed a change to openstack-dev/hacking: Add pypy on tox envlist  https://review.openstack.org/4424815:40
jeblairand it simplifies things because we don't need severed heads any more15:40
jeblairthough i will be sad to lose them15:40
jeblair(what would have been a severed head is now just another skipped change)15:40
jog0that a very elagent solution15:40
jeblairi'm going to go ahead and work on this while the idea is fresh, but i don't anticipate rolling it out until after h3; i've beat up on the system enough, we need some stability for a little bit15:42
jog0jeblair: woot15:43
jeblairi also think it shouldn't be hard to implement, but it's probably going to take a lot of work to update the tests15:43
jeblairas an aside, you can see gate resets on the test node graph; and you can see how flakey things are by how bumpy it is15:44
*** svarnau has joined #openstack-infra15:46
Alex_Gaynorjd__: FYI, as soon as another python-client lands my tox patch I'll send some portion of http://bpaste.net/show/127461/ along which makes it easy to add pypy jobs15:46
*** jfriedly has joined #openstack-infra15:47
jeblairclarkb, mgagne: hrm, so stackforge was not set up with any sort of curatorial policy; and i'm definitely not interested in being such a curator; however, we're stewards of some significant technical resources that folks have donated to us to help openstack development...15:49
clarkbya15:50
jeblairclarkb, mgagne: so i'm not sure stackforge should be accepting project with _no_ relationship to openstack15:50
jd__Alex_Gaynor: ah cool 'cause my patch https://review.openstack.org/#/c/44246/ fails and I've no clue why15:50
jog0whoa the gate is empty15:51
jeblairquick fill it up again15:52
mgagnejeblair: sorry, I'm done with all my puppet-lint changes :D15:52
mgagnejeblair: I thought I broke the gate yesterday ^^'15:52
*** BadaBoum has quit IRC15:54
*** danger_fo_away is now known as danger_fo15:54
*** changbl has quit IRC15:55
Alex_Gaynorjd__: you need them added to python jobs like my patch does15:59
jd__Alex_Gaynor: I wonder why it worked for marconi then16:00
Alex_Gaynorjd__: Marconi manually adds it in two places. My patch removes it from one of them16:00
*** datsun180b has quit IRC16:01
*** UtahDave has joined #openstack-infra16:03
*** jhesketh has quit IRC16:03
jd__Alex_Gaynor: yeah, I knew that I was stupid anyway, if you add me to your future patch I'll base this one on yours :)16:03
Alex_Gaynorjd__: sure.16:03
*** weshay has quit IRC16:04
*** alexpilotti has quit IRC16:06
*** ojacques has joined #openstack-infra16:08
*** swann has joined #openstack-infra16:11
*** changbl has joined #openstack-infra16:12
*** alexpilotti has joined #openstack-infra16:14
*** weshay has joined #openstack-infra16:19
*** amotoki has quit IRC16:19
*** arezadr has quit IRC16:19
*** Ryan_Lane has quit IRC16:21
*** hashar has quit IRC16:21
codenamektWhen I go to do a `git remote update` on the openstack-infra/config repo I am getting a key_read: uudecode error while dirung the fetching gerrit stage. I've checked my ssh key and re-entered it into review.openstack.org but with no luck.16:22
*** dina_belova has joined #openstack-infra16:22
*** mkerrin has quit IRC16:23
clarkbcodenamekt: can you paste the full output of git remote update and git remote -v ?16:25
*** SergeyLukjanov has joined #openstack-infra16:26
codenamektclarkb: Thanks! I found the problem. It was with my ssh_dss server host key. Does this change? It was working a couple days ago. Don't know what happened today to cause this.16:28
openstackgerritClark Boylan proposed a change to openstack-infra/git-review: Longer ssh-keyscan timeout and log scan failures.  https://review.openstack.org/4431816:28
clarkbcodenamekt: host keys shouldn't change often16:29
openstackgerritAlex Gaynor proposed a change to openstack-infra/config: Make pypy part of python-jobs and run it for novaclient  https://review.openstack.org/4431916:30
Alex_Gaynorjd__: if you rebase your patch on top of ^ it should work16:30
*** reed has joined #openstack-infra16:32
*** mestery has joined #openstack-infra16:35
clarkbhmm that git-review change doesn't appear related to the fail :/16:35
jeblairjog0: https://review.openstack.org/#/c/44226/  do you need a change like that for large-ops?16:47
*** Bada has joined #openstack-infra16:47
*** ruhe has quit IRC16:48
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Translation update jobs now supports any org  https://review.openstack.org/4421216:49
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Enable translation jobs for the savanna project  https://review.openstack.org/4421316:49
jeblairSergeyLukjanov: you're fast.  :)16:49
SergeyLukjanovjeblair, :)16:49
clarkbjeblair: https://review.openstack.org/#/c/43779/3/devstack-vm-gate.sh quotes the variable so it should evaluate to "" -eq "1" which is a valid test expression16:50
clarkbjeblair: however probably not a bad idea to set a default to be defensive16:50
SergeyLukjanovjeblair, should I add https://www.transifex.com/accounts/profile/openstackjenkins/ to the savanna maintainers at transifex?16:51
jeblairclarkb: gotcha; i didn't really look into it, i was just making assumptions based on consistency16:51
jeblairclarkb: can you answer SergeyLukjanov's question?  he's setting up transifex jobs for savanna16:51
*** morganfainberg|a is now known as morganfainberg16:51
clarkbSergeyLukjanov: yes the openstackjenkins account is necessary for our script to be able to update the .pot files in transifex16:52
*** morganfainberg is now known as morganfainberg|a16:52
SergeyLukjanovclarkb, jeblair, ok, thank you16:52
*** morganfainberg|a is now known as morganfainberg16:53
jeblairAlex_Gaynor: do pypy jobs pass for novaclient?16:54
Alex_Gaynorjeblair: yup!16:54
*** dina_belova has quit IRC16:54
jeblairAlex_Gaynor: okiedokie :)16:54
*** dina_belova has joined #openstack-infra16:55
openstackgerritAnne Gentle proposed a change to openstack-infra/config: Update Japanese Ops Guide build job.  https://review.openstack.org/4373416:55
Alex_Gaynorjeblair: turns out the clients don't have a lot of super exciting code that challenges PyPy, http: a relevatively simple thing :)16:56
*** saper has quit IRC16:57
*** dina_belova has quit IRC16:59
jeblairI created feature/nnfi branch on zuul17:01
jeblair(nearest non-failing item)17:01
*** fbo is now known as fbo_away17:01
* jeblair hacks17:01
*** weshay has quit IRC17:02
annegentle_jeblair: or clarkb: any opinions on having multiple /tools directories in multiple docs repos for the translation efforts?17:04
annegentle_jeblair: clarkb Tom is quite upset about it but Daisy sounds like that's fine.17:04
clarkbannegentle_: is this to carry the scripts that chop up docs for translation and substitute in translated strings/17:05
annegentle_The thread is on http://lists.openstack.org/pipermail/openstack-docs/2013-August/002432.html17:05
annegentle_clarkb: yupppers17:05
* clarkb reads17:05
annegentle_clarkb: sorry you want http://lists.openstack.org/pipermail/openstack-docs/2013-August/002588.html17:05
annegentle_clarkb: my first thought is to maintain the slicing in infra17:06
*** nicedice_ has joined #openstack-infra17:07
annegentle_clarkb: and step one to the bug fix is  https://review.openstack.org/4373417:07
clarkbannegentle_: I think there are two decent options. One is to stick the script in our config repo so that it gets installed on all of the slaves (downside to this is it is hard to get at the script without puppet). The other (and I think better) option is to make the tools their own pip installable project17:07
annegentle_clarkb: but we have a larger issue17:07
clarkbannegentle_: we can do option 1 while we work on making option 2 possible17:07
annegentle_clarkb: ohhh own pip installable17:07
annegentle_clarkb: are you on the openstack-docs mailing list to reply to that thread17:08
clarkbannegentle_: I am not but I can join to draft up a response17:08
clarkbwell maybe I never got the original to respond too...17:09
annegentle_clarkb: awesome thanks.17:09
clarkbs/too/to/17:09
annegentle_clarkb: ah well17:09
clarkbannegentle_: let me join, I will write up a thing that you can send then I will be on the thread17:09
clarkbI am sure there is some way to lie with email headers but meh17:09
annegentle_clarkb: ha17:09
annegentle_clarkb: just one other longer-range thought17:10
clarkbannegentle_: https://etherpad.openstack.org/docs-translation-tools I am workong on it there17:10
annegentle_clarkb: if we move to a publican-based toolchain, where translations are done another way, is this wasted work? I don't see us doing that for ages if ever but a consideration17:10
annegentle_clarkb: publican is what fedora uses to generate output and translated output17:11
clarkbit might be if publican already has a toolchain that we would switch to17:11
clarkbbut having this stuff now is worth something so not entirely wasted17:11
annegentle_clarkb: yeah for sure. Ok, good.17:12
openstackgerritTobias Stevenson proposed a change to openstack-infra/config: Added comment-added to yaml so that gerritbot enters into comment_added method and will find x-vrif-minus-2 message per Edward Raigosa's suggestion.  https://review.openstack.org/4432617:13
jeblairclarkb: easiest way is to have annegentle_ resend (bounce) the message to you17:14
*** Protux has quit IRC17:14
annegentle_jeblair: how do I do that?17:14
clarkbI have joined the list now and  https://etherpad.openstack.org/docs-translation-tools has approximately what I want to say17:14
annegentle_jeblair: oh in the admin area?17:14
* annegentle_ looks17:14
jeblairannegentle_: what email program do you use?17:14
*** weshay has joined #openstack-infra17:15
jeblairannegentle_: (no, it's not a mailman thing)17:15
annegentle_jeblair: gmail17:15
jeblairannegentle_: well then it's not easy.  :(  http://webapps.stackexchange.com/questions/3479/can-i-bounce-messages-not-forward-but-a-true-bounce-in-gmail17:16
annegentle_clarkb: oh and there's also what Daisy said - that it could be like oslo common17:16
annegentle_jeblair: impossible! Wowsa :)17:17
jeblairdefinitely not worth it for one message17:17
annegentle_clarkb: I'll just forward you the latest in the thread and you can reply to me and openstack-docs?17:17
clarkbannegentle_: sure17:17
annegentle_clarkb: your gmail address ok?17:18
clarkbyup17:18
annegentle_clarkb: woosh!17:18
annegentle_like my email sound effects?17:18
clarkbspeaking of I finally bought a domain and potentially have working non gmail mail. Maybe the long weekend will give me an opportunity to use that for this stuff17:18
*** dizquierdo has quit IRC17:19
annegentle_clarkb: good on ya.17:22
*** pabelanger_ has joined #openstack-infra17:25
*** pabelanger_ has quit IRC17:25
*** pabelanger_ has joined #openstack-infra17:25
*** pabelanger has quit IRC17:25
*** pabelanger_ is now known as pabelanger17:26
*** pabelanger_ has joined #openstack-infra17:26
jeblairclarkb: the secret is: use spamhaus17:26
*** HenryG has quit IRC17:27
*** HenryG has joined #openstack-infra17:27
*** Protux has joined #openstack-infra17:28
*** pcm_ has quit IRC17:28
*** dstufft has quit IRC17:30
jeblairclarkb, jog0: i also think the dequeue-on-conflict behavior can be dropped with the nnfi algorithm; which may make markmc happy.17:30
*** datsun180b has joined #openstack-infra17:30
*** dstufft has joined #openstack-infra17:30
jeblairclarkb, jog0: (a conflicting change is just another failing change that can be skipped)17:31
*** dprince has joined #openstack-infra17:31
clarkband if something ahead fails that you conflict with you will be retried without that conflict17:31
clarkbI like it17:31
openstackgerritA change was merged to openstack-infra/config: Add gate-tempest-devstack-vm-large-ops job  https://review.openstack.org/4378117:32
*** Protux has quit IRC17:32
*** pcm_ has joined #openstack-infra17:33
clarkbjog0: ^ that will get on the slaves in about 25 minutes then we can check experimental the d-g change17:33
clarkbjeblair: re https://review.openstack.org/#/c/44303/1/modules/openstack_project/manifests/logstash_worker.pp the copytruncate line deals with the problem you describe17:34
clarkbjeblair: it does something similar to `cp log log.1 && cat /dev/null > log`17:35
*** dstufft has quit IRC17:35
clarkbbut the scripts are using python logging so I could make the logging stuff more natively rich17:36
*** thedodd has joined #openstack-infra17:36
*** dstufft has joined #openstack-infra17:36
openstackgerritTobias Stevenson proposed a change to openstack-infra/config: Added comment-added to yaml so that gerritbot enters into comment_added method and will find x-vrif-minus-2 message per Edward Raigosa's suggestion.  https://review.openstack.org/4432617:36
*** dstufft has quit IRC17:38
clarkbjeblair: pelase see comments on that change17:39
*** hemnafk is now known as hemna17:39
*** dstufft has joined #openstack-infra17:39
sorenanteaya: Actually, my motivation was entirely different. I needed the numbers for a blog post: http://blog.linux2go.dk/2013/08/28/openstack-design-tenets/17:40
*** dstufft has quit IRC17:40
*** dstufft has joined #openstack-infra17:40
*** Protux has joined #openstack-infra17:41
*** dstufft has quit IRC17:41
anteayasoren: ah sorry, thanks for the link17:41
* anteaya reads17:41
*** dstufft has joined #openstack-infra17:41
*** dstanek has quit IRC17:42
openstackgerritA change was merged to openstack-infra/config: Make pypy part of python-jobs and run it for novaclient  https://review.openstack.org/4431917:42
jeblairclarkb: are you sure that will work with python logging?17:42
jeblairclarkb: as in, are you certain that won't, say, cause an exception that will just stop all logging?17:43
*** dstufft has quit IRC17:43
*** dstufft has joined #openstack-infra17:43
clarkbjeblair: I am fairly sure. I did the cp and truncate by hand and logging continues17:44
*** pabelanger has quit IRC17:44
*** pabelanger has joined #openstack-infra17:44
clarkbjeblair: I can apply that puppet manifest to one of the nodes to double check if you want17:44
clarkbbefore approving the change17:45
jeblairclarkb: ok.  i've always had bad luck using logrotate with python modules, but maybe i was missing copytruncate.  we can try it out if you want; but you should keep an eye on it.17:45
clarkbjeblair: ok17:45
*** Protux has quit IRC17:46
*** thedodd has quit IRC17:46
*** dstufft has quit IRC17:46
*** dstufft has joined #openstack-infra17:46
*** thedodd has joined #openstack-infra17:47
anteayasoren, an interesting overview of the design history, I will digest what you have written17:47
reeddesign history? i'd like to read that17:48
reedanteaya, where was it written?17:48
reedoh, saw it17:48
reedhi soren, long time no read :)17:48
anteayak17:48
jeblairreed: https://review.openstack.org/#/c/44057/17:51
jeblairreed: i didn't realize at first that was the bitgeria folks...17:51
*** olaph has joined #openstack-infra17:51
*** SergeyLukjanov has quit IRC17:52
jeblairreed: so i told them they shouldn't call their project 'openstack-metrics' or whatever for trademark reasons17:52
jeblairreed: (it just looked like a random new stackforge project)17:52
*** vogxn has quit IRC17:52
SpamapSam I the only one who has trouble with the gerrit "download" section in firefox?17:52
*** SergeyLukjanov has joined #openstack-infra17:53
SpamapSI see the text for 'pull', but if I click anything around that area, the text disappears17:53
jeblairreed: anyway, if it's part of an official thing you're working on, i'm sure they can use openstack in the name if they want, and you can put it in openstack-infra too instead of stackforge if you want17:53
SpamapSjavascript console shows17:53
SpamapS--17:53
SpamapS[10:53:00.244] uncaught exception: Class$MZb: One or more exceptions caught, see full set in UmbrellaException#getCauses17:53
clarkbSpamapS: it is a known bug. It seems to not like double clicking. single click to select should work17:53
jeblairSpamapS: you are not the only one; it's done that since day 1, and is fixed in gerrit 2.717:53
*** dina_belova has joined #openstack-infra17:53
jeblairSpamapS: or use 'git review -d' or 'git review -x'17:54
reedjeblair, I am thinking of stackforge them first, get the -dev server up and have them test integration, then go to full infra17:54
SpamapSjeblair: can't use git review -d without my ssh keys17:54
SpamapSor perhaps I can but I don't know how17:54
clarkbSpamapS: you can't, try click, hold drag, copy17:54
SpamapSyeah thats what I do17:54
SpamapScarefully17:54
SpamapSif I click anywhere around the end.. disappears17:54
reedjeblair, mainly because I still don't know what to do with the confluence part17:54
SpamapSjust was wondering if I was alone or needed to report a bug17:55
reedthey'll have to stay where they are I guess, for a while at least17:55
clarkbSpamapS: it is a deterministic URL too. I think if you run git review in verbose noop mode if might print it out for you17:55
jeblairreed: ok17:56
*** codenamekt has quit IRC17:56
reedjeblair, we can rename the project once it moves to official infra project, right?17:56
*** tstevenson has joined #openstack-infra17:56
*** olaph has quit IRC17:56
*** Ryan_Lane has joined #openstack-infra17:57
reedsoren, where are you going with that blog post? what do you expect will happen?17:57
jeblairreed: yeah; we don't like to do that because of downtime, but if it's something that requires proprietary software, we don't want it in infra.  :)17:58
*** woodspa has joined #openstack-infra17:58
reedjeblair, renaming requires downtime?17:58
jeblairreed: yep; requires some filesystem and database munging in gerrit.17:58
reedargh17:59
yjiang5clarkb: I'm always confused by the first item in "Add dependency" at https://wiki.openstack.org/wiki/Gerrit_Workflow#Review17:59
jeblairreed: not much, about 5-15 minutes; though it also requires a couple hours prep time.17:59
*** rcleere_ has joined #openstack-infra17:59
reedthen i'd rather call the project with its real name from the beginning17:59
reedlet me comment on the review17:59
jeblairreed: can it run without confluence?18:00
clarkbyjiang5: if you commit on top of an existing commit you create a dependency. The line about the -R is wrong and should be removed18:00
reedjeblair, the bitergia bit is basically static html files18:00
*** rcleere has quit IRC18:00
*** rcleere_ is now known as rcleere18:00
clarkbugh so is that second section...18:01
clarkbyjiang5: I should rewrite that to make it more clear18:01
jeblairreed: oh, ok.  i guess you mentioned confluence because you don't know what to do with the _other_ project; but this one is all free software?18:01
reedjeblair, so, in short, yes, it can run with simple static server ... the mysql server is needed for the backend elaboration (we're not running those at the moment, will need to integrate that on a later stage)18:01
yjiang5clarkb: yes, please do that when you have spare time. Really thanks.18:01
jeblairreed: ok; +1 getting the name right to start then.  :)18:01
reedjeblair, all pure and blessed free as in freedom18:01
reeddamn, naming is hard18:03
*** dina_belova has quit IRC18:03
reedi wonder how parents ever name their children... it's so much responsibility18:03
*** dina_belova has joined #openstack-infra18:04
*** gyee has quit IRC18:04
*** thomasm has quit IRC18:05
jeblairreed: it's so hard that we ended up with a project called 'jeepyb'.18:05
reedeww18:05
openstackgerritDan Radez proposed a change to openstack-infra/config: adding puppet-pacemaker to stackforge  https://review.openstack.org/4413618:07
echoheadhey #openstack-infra, do you have any tips for running openstack apis over ssl with a self-signed cert?18:08
echoheadi'm finding that the various openstack clients use different http libraries, which have different ways of pointing to a trusted cert on disk, which feels messy.18:08
*** dina_belova has quit IRC18:08
SpamapSechohead: agreed on messy. Many client libs though, will respect a CA in the system cert store..18:09
*** thomasbiege has joined #openstack-infra18:09
echoheadSpamapS: yeah the system cert store was the first place i tried to install it. but it's not picked up by requests library or httplib there, seemingly.18:09
SpamapSgah18:10
SpamapSI'd have expected requests to DTRT18:10
jog0clarkb: trying it now18:10
SpamapSechohead: this seems bug worthy.. client libs should have one way to specify private certs/CA's18:10
SpamapSthat will be an extremely common usage pattern18:10
echoheadrequests library at least accepts $CURL_CA_BUNDLE, but httplib (used by glance-client) is giving me trouble.18:10
*** ruhe_ has joined #openstack-infra18:10
SpamapSespecially for testing18:10
echoheadagreed18:11
SpamapSechohead: seems like OS_CERT_BUNDLE or something should be used by all if CURL_CA_BUNDLE is not set.18:11
jog0clarkb: didn't work running the wrong test18:11
echoheadOS_CACERT, yes - that gets passed into requests, but not httplib.18:12
clarkbjog0: I think that means zuul hasn't reloaded its config18:12
jog0clarkb: ahh18:13
clarkbjog0: actually18:13
echoheadSpamapS: guess i'll dig around for a bit - thought maybe i was missing something obvious.18:13
echoheadthanks18:13
clarkbjog0: it ran http://logs.openstack.org/79/43779/3/experimental/gate-tempest-devstack-vm-large-ops/7d519e8/18:13
clarkbwhich ran some of the default tempest tests18:14
*** Ryan_Lane has quit IRC18:14
clarkbjog0: I think you may need to fiddle with some extra toggles to make sure only your thing runs18:14
*** dstufft has quit IRC18:15
jog0clarkb: hmm I will dig in18:15
*** dstufft has joined #openstack-infra18:15
*** Bada has quit IRC18:15
Alex_Gaynorjd__: my patch landed, yours should be landable now18:16
thedoddanteaya: ping18:17
*** Ryan_Lane has joined #openstack-infra18:18
anteayahello thedodd18:19
*** wenlock has quit IRC18:20
thedoddHi. I wanted to introduce you to a friend of mine, who happens to be my coworker as well. tstevenson. He's is getting into the openstack swing of things and I wanted to point you out to him because you've been very helpful to me!18:20
openstackgerritJoe Gordon proposed a change to openstack-infra/devstack-gate: Add support for large_ops tempest test  https://review.openstack.org/4377918:21
thedoddtstevenson anteaya, anteaya tstevenson.18:21
clarkbyjiang5: https://wiki.openstack.org/wiki/Gerrit_Workflow#Add_dependency is that better?18:21
thedoddanteaya, if he causes you any trouble just let me know! :)18:21
tstevensonHello anteaya. thedodd, I think I already have. :)18:21
anteayahello tstevenson welcome18:22
anteayaha ha ha18:22
anteayatstevenson: I trust you got my link to commit messages?18:22
tstevensonanteaya, yes I did. It looks like I made the branch for the bug but forgot to switch to it. This is the problem, correct?18:23
clarkbjog0: what do you think about updating the variable in the jenkins job if that fix works? it is doing TEMPEST tests18:23
anteayanow I look again, I see your point, not the best approach but not what I was commenting on18:23
jog0clarkb: agreed18:24
*** dina_belova has joined #openstack-infra18:24
*** melwitt has joined #openstack-infra18:24
anteayatstevenson: if you go open this in a browser: https://review.openstack.org/#/c/44326/18:24
jog0but wanted to make sure this worked first. and that there are no other bugs18:24
clarkbjog0: ++18:24
*** ojacques has quit IRC18:24
anteayatstevenson: see how the title of the commit scrolls off the screen to the right? make the title 50 characters and don't end with a period18:24
*** nicedice_ has quit IRC18:25
clarkbthe thing about periods is questionable unless hacking is enforcing it for that project then I guess it must be done18:25
anteayatstevenson: see my commit message in this commit? https://review.openstack.org/#/c/43002/18:25
*** nicedice_ has joined #openstack-infra18:25
anteayatitle above and message below, hard returns on the message to keep the correct width18:25
*** dmakogon_ has joined #openstack-infra18:26
anteayaand yes tstevenson next time `git checkout -b <name of new branch>` before you begin your changes, or at least before you commit18:27
tstevensonanteaya: Should I continue and just ammend the commit message?18:28
anteayayes18:28
anteayause `git commit --amend`18:28
tstevensonanteaya: Great, thanks!18:28
anteayathat will let you edit the commit message and create a new patchset for your patch, keeping the change id18:28
anteayanp18:28
anteayagerrit tracks on the change id18:28
anteayaone change id per patch, as long as you keep the same change id, gerrit will know it is the same patch and will create a new patchset for it18:29
*** vipul is now known as vipul-away18:34
*** vipul-away is now known as vipul18:35
tstevensonanteaya: Great, thanks!18:35
anteayanp18:35
anteayawelcome to OpenStack, I hope you enjoy yourself18:35
jog0clarkb: it worked18:36
jog0but got a funny stack trace18:36
jog0http://logs.openstack.org/79/43779/4/experimental/gate-tempest-devstack-vm-large-ops/d913283/logs/screen-n-cpu.txt.gz18:36
clarkbjog0: which stacktrace? You can link directly to it the timestamps are anchor tags18:37
* jog0 just found out he can click the timestamps18:37
jog0http://logs.openstack.org/79/43779/4/experimental/gate-tempest-devstack-vm-large-ops/d913283/logs/screen-n-cpu.txt.gz#_2013-08-29_18_32_00_18518:37
jog0its because of the fakevirt driver18:37
jog0ceilometer doesn't know that I guess18:38
*** thomasm has joined #openstack-infra18:38
jeblairyay integration testing!18:38
clarkbjog0: you can probably disable ceilometer in the enable services list or fix the fake libvirt driver18:38
*** thomasbiege has quit IRC18:38
clarkbjeblair: I am testing my logrotate change on logstash-worker2 and pbr + setuptools + pip is causing all sorts of problems18:38
jog0clarkb: good idea, I will disable ceilometer.  for this18:39
*** sarob has joined #openstack-infra18:39
clarkbjeblair: gear appears to suffer from the same issue with new setuptools that swift ran into18:39
jeblairclarkb: i think we ran into that on zuul, yeah?18:39
anteayabtw clarkb 43002 is good to go, it was announced so anyone who wanted to weigh in has had the chance, ttx says there is nothing we are waiting for, jeblair has already reviewed18:39
*** pabelanger has quit IRC18:40
clarkbjeblair: yeah same issue I think18:40
clarkbjeblair: I got around it by removing pbr installs, downgrading setuptools to 0.9.8, then pip installing pbr followed by gear18:40
openstackgerritJoe Gordon proposed a change to openstack-infra/devstack-gate: Add support for large_ops tempest test  https://review.openstack.org/4377918:40
jog0clarkb: also going to experiment with a larger large ops number18:40
clarkbjeblair: new setuptools has added an extra element of broken to the mix, but clag is working on a fix for upstream18:41
clarkbs/clag/clayg/18:41
clarkbjeblair: anyways just an FYI. I will let logrotate burn in on logstash-worker2 and if it all looks good fix pbr/setuptools/gear across the board18:42
clarkbanteaya: looking18:43
*** pabelanger has joined #openstack-infra18:43
jog0clarkb: how do I disable ceilometer in d-g?18:43
clarkbjog0: doesn't look like we made it toggleable when we added it :(18:44
jog0clarkb: ahh well the test will work even with the ceilo stack traces18:45
jog0I wonder if celiometer works with xen or just libvirt18:45
clarkbthe tests use libvirt + qemu18:45
jog0clarkb: anyway its not a blocker so will just let it be for now18:46
*** ruhe_ has quit IRC18:46
sorenreed: I expect I'll post the follow up later today or tomorrow.18:46
reedsoren, oh... new tenets or proposal for new architectures?18:47
sorenreed: Other than that... Dunno. Just pointing it out. Someone needs to say it.18:47
sorenreed: The tenets are fine.18:47
*** dstanek_ has joined #openstack-infra18:47
clarkbjog0: ok, do those traces happen with regular libvirt?18:47
sorenreed: We're just, for some reason, ignoring them.18:47
reedsoren, fair enough :)18:48
openstackgerritJoe Gordon proposed a change to openstack-infra/config: Add word tempest to large_ops variable  https://review.openstack.org/4434318:49
jog0clarkb: don't think so let me check ... they are  :/18:50
*** Mithrandir has quit IRC18:50
jog0http://logs.openstack.org/38/43938/1/check/gate-tempest-devstack-vm-full/9fb5890/logs/screen-n-cpu.txt.gz#_2013-08-28_03_23_24_66518:50
clarkbjd__: dhellmann ^ is that something you guys are aware of?18:51
*** dina_belova has quit IRC18:51
jd__loading18:52
*** dina_belova has joined #openstack-infra18:52
jd__clarkb: nop18:52
jd__never heard of this18:52
openstackgerritTobias Stevenson proposed a change to openstack-infra/config: Updated yaml configuration for gerritbot  https://review.openstack.org/4432618:53
clarkbmtreinish: is the qa team aware of the ceilometer stack traces in devstack gate nova logs/18:54
mtreinishclarkb: yeah (well at least I know about them) it's a ceilometer bug I thought18:54
jog0anyone know what this means: http://logs.openstack.org/79/43779/5/experimental/gate-tempest-devstack-vm-large-ops/7eeaddb/logs/screen-n-cpu.txt.gz#_2013-08-29_18_48_47_63218:56
*** dina_belova has quit IRC18:57
clarkbjog0: jd__ mtreinish https://bugs.launchpad.net/ceilometer/+bug/1206731 found what looks like the bug.18:57
uvirtbotLaunchpad bug 1206731 in ceilometer "notifier should not log traceback if there is a problem getting stats from the instance" [High,In progress]18:57
clarkbjog0: you are running 10 nova somethings maybe related to that?18:58
jog0clarkb: perhaps or trying to run 95 VMs at once18:58
jog0so the RPC queue to nova-compute will get backed up18:59
jog0clarkb: oh and we are logging only one n-cpu18:59
clarkblogging more than on n-cpu seems like a devstack thing. if it is logging the files d-g can grab them19:00
jog0clarkb: hmm, I know theere are 10 screens running but tahts it19:01
jog0checking on devstack if it writes out seperte log files or not19:02
jog0clarkb: good new is the job passes19:03
jog0I wonder what it will take to fail19:03
*** boris-42 has quit IRC19:03
openstackgerritJoe Gordon proposed a change to openstack-infra/devstack-gate: Add support for large_ops tempest test  https://review.openstack.org/4377919:03
*** sarob_ has joined #openstack-infra19:04
clarkbjog0: restrict the number of n-cpu's?19:05
jeblairclarkb, jog0: https://review.openstack.org/#/c/44346/   WIP nnfi scheduler algorithm   +49, -13919:05
clarkbdoes 2 just fall over with that number of requests? I guess that may negate some of the value in the test if we are trying to generate async fails19:05
jog0clarkb: in the past nova-network was the bottleneck not n-cpu actually19:06
jeblairclarkb, jog0: i haven't started testing or working on tests, but i think that's roughly the changes necessary19:06
jog0clarkb: trying 595 vms this time :)19:07
* jog0 checks out jeblair's magic19:07
*** sarob has quit IRC19:07
*** sarob has joined #openstack-infra19:07
jog0jeblair: nnfi?19:07
*** dstanek_ is now known as dstanek19:07
jeblairnearest non-failing item19:08
*** ianw has quit IRC19:08
*** sarob_ has quit IRC19:08
*** sarob has quit IRC19:09
jog0jeblair: ahh, so mordred told me the zuul code was clean but I just ignored him .. he was right this is nice19:09
*** sarob has joined #openstack-infra19:09
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Add new savanna repos  https://review.openstack.org/4434819:10
clarkbjog0: it removes prime \o/19:11
clarkber jeblair ^19:11
clarkbtab complete has been failing me lately. Too make j's in this channel19:11
*** sarob_ has joined #openstack-infra19:12
*** sarob has quit IRC19:13
jeblairclarkb: yeah, pretty neat, huh?  I originally envisioned it as a single pointer, but ended up using a list because several things expect a list (the merger and launcher).  They don't actually need it, so i might change that in a follow-up change.19:15
jog0clarkb: sorry heh19:16
jog0jeblair: pretty slick19:16
clarkbjeblair: when are items removed from base_items?19:17
jeblairclarkb: in the model or scheduler?19:18
clarkbscheduler. Doesn't look like we remove them instead the list is build each time19:18
clarkbin processQueue19:19
clarkbbuild iteratively19:19
jeblairclarkb: yep, that's the case. each run through the queue builds that list one item at a time as it processes the queue19:19
jeblairclarkb: if that list changes (specifically, the tail -- this is why the algo only needs a pointer, not a list) then it needs to cancel/recompute19:20
*** Ryan_Lane has quit IRC19:20
jeblairclarkb: oh, i think i need to leave the recursive aspect of cancelJobs in place19:22
clarkbjeblair: yes, but you don't need prime19:22
jeblairyep.  if we compared the whole list, instead of the tail, we probably could remove the recursive cancelJobs, and we might be able to do neat things like inserting things into the queue at arbitrary points.19:24
jeblairso that's a reason to keep the list around.  but again, different change.19:24
clarkbanteaya: 43002 approved. It may need a rebase. Happy to push it through again if it does19:24
anteayaclarkb: thanks, let's see what the gods say19:25
clarkbok AFK time for lunch and stuff19:25
anteayaenjoy lunch19:25
pleia2enjoy19:25
anteayahey pleia219:26
pleia2anteaya: hey, oh, I guess I've been quiet today :)19:26
anteayayup19:26
anteayathat's okay19:26
openstackgerritA change was merged to openstack-infra/config: Creating/adding the openstack/governance repository  https://review.openstack.org/4300219:27
jeblairrussellb, pabelanger_: when do you think you might have some time to test out various pbx vms?19:27
anteayaseemed to work19:28
anteaya30 minutes or so before it shows up in git.o.o?19:29
*** boris-42 has joined #openstack-infra19:32
*** SergeyLukjanov has quit IRC19:32
*** vipul is now known as vipul-away19:32
*** vipul-away is now known as vipul19:32
*** Mithrandir has joined #openstack-infra19:33
openstackgerritJoe Gordon proposed a change to openstack-infra/devstack-gate: Add support for large_ops tempest test  https://review.openstack.org/4377919:36
*** pabelanger has quit IRC19:37
*** gyee has joined #openstack-infra19:39
* anteaya heads out for a walk19:40
*** nati_ueno has joined #openstack-infra19:40
openstackgerritTobias Stevenson proposed a change to openstack-infra/config: Add -2 comment event reporting to Gerritbot  https://review.openstack.org/4432619:41
*** SergeyLukjanov has joined #openstack-infra19:41
*** Protux has joined #openstack-infra19:42
*** nati_ueno has quit IRC19:42
*** nati_ueno has joined #openstack-infra19:43
*** vipul is now known as vipul-away19:47
*** Protux has quit IRC19:47
*** branen__ has joined #openstack-infra19:49
ArxCruzanteaya: hey, thanks for all the tips, I was able (after several hours fighting with ssl) to run gerrit with puppet :)19:51
ArxCruzanteaya: now, for my next challenge, I need to ran zuul :)19:52
*** branen_ has quit IRC19:52
ArxCruzanteaya: quick question, can I ran zuul in my infrastructure connecting with review.openstack.org, using my own credentials, just to listen the stream, without necessarily request a services account ?19:54
*** prad has joined #openstack-infra19:54
*** saper has joined #openstack-infra19:54
*** saper has quit IRC19:57
*** SergeyLukjanov has quit IRC19:59
*** pcm_ has quit IRC20:00
*** fbo_away is now known as fbo20:00
*** dina_belova has joined #openstack-infra20:02
*** HenryG has quit IRC20:02
lifelessmorning20:03
lifelessjeblair: clarkb: I have more things to pester you about; is today an ok day to do that?20:04
*** dstanek has left #openstack-infra20:05
mgagneArxCruz: http://ci.openstack.org/third_party.html20:05
ArxCruzmgagne: yeah, I read this document, however, it's kinda just say what, but not how :/20:05
ArxCruzI mean, it says you can connect with review.openstack.org, but don't say: If you need/want to connect, follow these steps 1, 2 ,320:06
*** dina_belova has quit IRC20:07
clarkblifeless: yes but lunching now20:07
clarkbArxCrux you can connect zuul as yoi describe20:08
*** ianw has joined #openstack-infra20:08
mgagneArxCruz: I was able to run this command to get event stream: ssh -l mgagne -p 29418 review.openstack.org gerrit stream-events20:08
clarkbthar is one way to do third party testing20:08
clarkbsystem accounts are preferred if you leave comments in gerrit20:08
*** boris-42 has quit IRC20:09
ArxCruzclarkb: right now, I just want to see the changes, and run some tests, later maybe I can do the reverse way :)20:09
*** dprince has quit IRC20:11
*** olaph has joined #openstack-infra20:13
lifelessclarkb: ok so - what does a hiera production config file look like - not the secrets obviously, but *what* settings does it need?20:13
*** Protux has joined #openstack-infra20:13
lifelessclarkb: how does the config checkout on the puppetmaster get updated?20:14
lifelessclarkb: what size node should the dashboard be? Or is it a default 'launch-node' size?20:14
lifelessclarkb: and https://bugs.launchpad.net/openstack-ci/+bug/121832620:14
uvirtbotLaunchpad bug 1218326 in openstack-ci "puppetmaster install doesn't install novaclient" [Undecided,New]20:14
*** cppcabrera has left #openstack-infra20:15
*** hashar has joined #openstack-infra20:15
*** saper has joined #openstack-infra20:16
*** afazekas has quit IRC20:16
openstackgerritJulien Danjou proposed a change to openstack-infra/config: Run tests against pypy for pbr and hacking  https://review.openstack.org/4424620:17
*** Protux has quit IRC20:18
*** olaph has quit IRC20:19
*** wenlock has joined #openstack-infra20:19
*** wenlock_ has joined #openstack-infra20:21
*** wenlock has quit IRC20:21
ianwmgagne: ping20:23
mgagneianw: pong20:23
*** NobodyCam_ has joined #openstack-infra20:23
*** sandywalsh has quit IRC20:23
*** NobodyCam_ has quit IRC20:23
ianwmgagne: hi; is your rename change ready to go, or should i revert the rename parts of the consolidated heat.conf patch?20:23
*** moted has quit IRC20:24
mgagneianw: I think it is ready to go, isn't it?20:24
ianwyes, i'm fine with it20:24
mgagneianw: I can poke bodepd for approval20:24
mgagneianw: we are on #puppet-openstack ;)20:25
*** nati_ueno has quit IRC20:26
*** dstufft has quit IRC20:27
*** dstufft has joined #openstack-infra20:27
*** dstufft has quit IRC20:28
*** dstufft has joined #openstack-infra20:28
*** vipul-away is now known as vipul20:32
*** saper has quit IRC20:33
*** saper has joined #openstack-infra20:34
*** sandywalsh has joined #openstack-infra20:35
*** nati_ueno has joined #openstack-infra20:35
*** dmakogon_ has quit IRC20:37
*** wenlock_ has quit IRC20:38
openstackgerritlifeless proposed a change to openstack-infra/config: Stage 2 - dashboard.  https://review.openstack.org/4427120:39
openstackgerritlifeless proposed a change to openstack-infra/config: Make the adduser commands copy-pasteable.  https://review.openstack.org/4427020:39
openstackgerritlifeless proposed a change to openstack-infra/config: Initial bootstrap configuration.  https://review.openstack.org/4426420:39
openstackgerritlifeless proposed a change to openstack-infra/config: Add a pointer to launch/README for root operators.  https://review.openstack.org/4416320:39
openstackgerritlifeless proposed a change to openstack-infra/config: Make setting up a Puppetmaster easier.  https://review.openstack.org/4420920:39
openstackgerritlifeless proposed a change to openstack-infra/config: Port across params and puppet_cron.  https://review.openstack.org/4426320:39
openstackgerritlifeless proposed a change to openstack-infra/config: Document bootstrapping a new infrastructure.  https://review.openstack.org/4426220:39
openstackgerritlifeless proposed a change to openstack-infra/config: Start documenting running your own CI infra.  https://review.openstack.org/4417720:39
*** sarob has joined #openstack-infra20:41
*** sarob has quit IRC20:43
anteayaArxCruz: sorry just got back from a walk, congratulations on launching gerrit with puppet. I suggest you start following lifeless' work because he is currently doing the same thing that you want to do and is working on improving the documentation for the process20:43
*** sarob__ has joined #openstack-infra20:43
ArxCruzanteaya: cool20:44
anteayaArxCruz: I would suggest any of his current patches: https://review.openstack.org/#/dashboard/419020:44
ArxCruzanteaya: I was able to install zuul too, just need to work in the permissions, right now I'm getting a lot of git errors when I try start the process20:44
anteayalook at the started by lifeless category20:44
lifelessArxCruz: well, dunno if I'm a good person to follow, but certainly this seems to be a popular path to walk down :)20:44
anteayalifeless: you are the trailblazer, hope you don't mind me pointing folks your way20:45
*** sarob_ has quit IRC20:45
lifelessanteaya: I don't mind at all ;)20:45
anteayaArxCruz: well to help you troubleshoot any of your errors, I/we would need to see a stacktrace, please use a pastebin for the output20:46
anteayalifeless: thanks :D20:46
pleia2lifeless: so for my test puppet instance, I just put exactly what I need for each thing in hiera, at the most basic:20:46
pleia2elizabeth@puppet:~$ cat /var/lib/hiera/global.yaml20:46
pleia2^^ that's it20:46
uvirtbotpleia2: Error: "^" is not a valid command.20:46
pleia2---20:46
pleia2sysadmins: 'elizabeth'20:46
* pleia2 gives uvirtbot a cookie20:46
ArxCruzanteaya: it's some git access errors, I think I know what's wrong20:47
yjiang5clarkb: yes, it's much clear :)20:47
ArxCruzlifeless: I can help you with documentation if you want :)20:47
lifelessanteaya: pleia2 you mean one line with sysadmins: 'myname'\n ?20:47
lifelessbah20:47
lifelesspleia2: ^20:47
pleia2lifeless: yes20:47
anteayaArxCruz: no need to wait for a request, just jump in20:48
lifelesspleia2: how can you determine what things need to be in heira? Like, does puppet log somewhere when it's missing?20:48
ArxCruzanteaya: I know, just don't know where to start20:48
pleia2lifeless: look at manifests/site.pp20:48
anteayaif you need a hand getting set up to post reviews on his patches, or to make patches yourself20:48
* ArxCruz is new in openstack[-infra]20:48
anteayaArxCruz: great20:48
anteayalet's talk in -10120:48
anteayaand I can get you set up there20:49
*** alexpilotti has quit IRC20:49
anteayaso join #openstack-10120:49
lifelesspleia2: ok20:49
lifelesspleia2: how do you determine the type of things for hiera?20:49
pleia2lifeless: oh oh, *type*20:49
lifelesspleia2: I mean, you probably have it all internalised; I don't ;)20:50
pleia2lifeless: I don't know, strings like sysadmins: have always worked ok for me20:50
lifelesspleia2: cause, I'd have expected that to be ['userfoo']20:50
pleia2I think I just guessed20:50
anteayastrictly speaking ruby considers foo: to be a symbol20:51
lifelesspleia2: is hiera generally flat? e.g.20:51
anteayanot a string20:51
lifelessanteaya: sure but thats the key, not the value.20:51
anteayayes20:51
lifelesspleia2: sysadmins: ['foo', 'bar']20:51
lifelesspleia2: dasboard_password: '12312d12213'20:52
pleia2lifeless: ah, when you have multiple, that may be the case (I haven't)20:52
pleia2in mine I also had dashboard_password: 'not-really-my-password'20:52
pleia2(launched a puppet dashboard in my test world)20:52
*** dkliban has quit IRC20:53
lifelesspleia2: what does a puppet dashboard do?20:53
lifelesspleia2: I just get an error from p-d.o.o20:53
pleia2lifeless: oh gosh, p-d is broken20:54
clarkblifeless: the hiera data file is a yaml file with key:value pairs in it. The keys are what you see in site.pp in hiera() lookups. It doesn't need any settings if you replace those values, if you don't erplace those values it needs any that you make use of20:54
pleia2clarkb: passenger error on puppet dashboard20:54
lifelessclarkb: your last sentence failed to parse.20:54
lifelessclarkb: pleia2: What I actually need help with atm is https://bugs.launchpad.net/openstack-ci/+bug/121832620:55
uvirtbotLaunchpad bug 1218326 in openstack-ci "puppetmaster install doesn't install novaclient" [Undecided,New]20:55
lifelessThat being a genuine would-break-openstack-redeploying-own-infra bug20:55
pleia2lifeless: p-d allows you to see all the puppet clients that report in, including changes to those systems and logs, super helpful when you merge a change and wonder why it hasn't worked (you can see the errors puppet runs into without bugging clarkb, et al)20:55
clarkblifeless: the puppet config is updated with a cron https://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/puppetmaster.pp#n1320:55
pleia2lifeless: so I think you'll find that out-of-the-box deployment-wise, we aren't quite there yet :) so thank you for working on this20:55
lifelessclarkb: thanks20:56
clarkblifeless: in manifests/site.pp there are hiera lookups to pass parameters into classes20:56
clarkblifeless: if you replace them you don't need any hiera data20:56
clarkblifeless: if you do not replace them then any that you intend on using will need to be in the data file20:56
lifelessclarkb: oh right, you were saying 'you can make them static'20:56
lifelesswhen I tried to lookup locally on the puppetmaster using heira I got a 40320:57
lifelessis that normal?20:57
clarkbI am not sure. You may need something like https://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/puppetmaster/hiera.yaml to tell hiera where the data is20:58
lifelessclarkb: https://review.openstack.org/#/c/44264/3 is my config20:59
lifelessclarkb: which is to say, I"m using the openstack_project hiera.yaml unmodified.21:00
clarkblifeless: do you have a yaml file with the actual data in in somewhere?21:00
clarkbthat somewhere is listed in your hiera.yaml21:00
lifelessnot yet; see above asking about it ;>21:00
*** sarob__ has quit IRC21:01
lifelesswhat mode and ownership should should /etc/puppet/hieradata/production and /etc/puppet/hieradata/production/common.yaml21:01
lifelesshave?21:01
*** sarob has joined #openstack-infra21:01
lifelessoh and hieradata ?21:02
clarkbpuppet dashboard is a 4GB node and often feels slow. not sure if giving it bigger nodes will help much though21:02
openstackgerritJoe Gordon proposed a change to openstack-infra/devstack-gate: Add support for large_ops tempest test  https://review.openstack.org/4377921:02
*** dina_belova has joined #openstack-infra21:03
clarkblifeless: hieradata is puppet:puppet 711 and common.yaml is puppet:puppet 60021:04
lifelessclarkb: production would be puppet:puppet 711 too then ?21:04
clarkblifeless: under hieradata? yes21:04
*** sarob has quit IRC21:05
*** Mithrandir has quit IRC21:07
*** nati_ueno has quit IRC21:07
*** dina_belova has quit IRC21:08
*** rfolco has quit IRC21:08
*** nati_ueno has joined #openstack-infra21:09
lifelessclarkb: since you're back.. https://bugs.launchpad.net/openstack-ci/+bug/121832621:09
uvirtbotLaunchpad bug 1218326 in openstack-ci "puppetmaster install doesn't install novaclient" [Undecided,New]21:09
clarkbso for that one... we used ot install a special version of novaclient iirc because of weird auth stuff (as you may haev discovered) but that situation is better now21:09
clarkbit is possible we can have a package { 'python-novaclient': ensure => latest } in the puppetmaster.pp and be fine21:10
openstackgerritlifeless proposed a change to openstack-infra/config: Stage 2 - dashboard.  https://review.openstack.org/4427121:10
openstackgerritlifeless proposed a change to openstack-infra/config: Make the adduser commands copy-pasteable.  https://review.openstack.org/4427021:10
clarkblifeless: it would be good to double check with jeblair because he was around for the history of why novalcient is/was special21:10
openstackgerritlifeless proposed a change to openstack-infra/config: Initial bootstrap configuration.  https://review.openstack.org/4426421:10
openstackgerritlifeless proposed a change to openstack-infra/config: Port across params and puppet_cron.  https://review.openstack.org/4426321:10
openstackgerritlifeless proposed a change to openstack-infra/config: Document bootstrapping a new infrastructure.  https://review.openstack.org/4426221:10
lifelessclarkb: should puppet enforce the hiera modes?21:11
*** Mithrandir has joined #openstack-infra21:11
lifelessclarkb: or should I just document them?21:11
clarkblifeless: probably better to document. We have avoided puppet getting its hands on the actual data21:12
clarkbto avoid chicken and egg issues21:12
jog0clarkb: ping21:12
clarkbjog0: pong21:12
jog0the test isn't to exercise libvirt mainly our internal stuff21:13
jog0so using fakevirt seems like a better chose21:13
clarkbI see. So the actual backend doesn't matter21:13
jog0tried 500 VMs with only a few errors21:13
clarkbya I agree, makes it easier to exercise nova without worrying about disk IO for example21:14
jog0clarkb: right, sow ith fakevirt driver a VM  is a DB entry and thats it21:14
*** thomasbiege has joined #openstack-infra21:14
*** nati_ueno has quit IRC21:15
jog0just ran 195 VMs with no issues at all https://review.openstack.org/#/c/43779/21:15
*** sarob has joined #openstack-infra21:15
openstackgerritlifeless proposed a change to openstack-infra/config: Document hiera setup a bit more comprehensively.  https://review.openstack.org/4435721:15
openstackgerritlifeless proposed a change to openstack-infra/config: Stage 2 - dashboard.  https://review.openstack.org/4427121:15
openstackgerritlifeless proposed a change to openstack-infra/config: Make the adduser commands copy-pasteable.  https://review.openstack.org/4427021:15
openstackgerritlifeless proposed a change to openstack-infra/config: Initial bootstrap configuration.  https://review.openstack.org/4426421:15
openstackgerritlifeless proposed a change to openstack-infra/config: Port across params and puppet_cron.  https://review.openstack.org/4426321:15
openstackgerritlifeless proposed a change to openstack-infra/config: Document bootstrapping a new infrastructure.  https://review.openstack.org/4426221:15
*** sarob has quit IRC21:16
*** thomasbiege has quit IRC21:16
clarkbjog0: cool. Let me know when you have settled on a default tset setup for the large ops test and I can merge the remaining changes21:16
*** ryanpetrello has joined #openstack-infra21:16
*** sarob has joined #openstack-infra21:16
jog0clarkb: I won't get to that till tomorrow I think21:16
*** Ryan_Lane has joined #openstack-infra21:16
clarkbjog0: ok, no rush21:16
jog0it will be between 200 and 600 ... but more testing is needed21:17
jog0anyway thanks for the help clarkb21:17
clarkbno problem.21:17
clarkbjog0: https://bugs.launchpad.net/nova/+bug/1218133 have you seen that happen often?21:18
uvirtbotLaunchpad bug 1218133 in nova "MultiprocessWSGITest.test_terminate_sigterm fails because the wait for workers to die is unreliable." [Undecided,New]21:18
clarkbjog0: there were no rechecks for anything like that bug so I created a new bug21:18
clarkbok back to trying to make git-review tests pass more often21:19
jog0doesn't ring a bell have to go AFK For abit21:19
*** sgviking has quit IRC21:22
jeblairlifeless, clarkb: i think novaclient and cinderclient can be installed globally on the puppetmaster; i assume we'll still need a venv for rackdns21:28
jeblairi believe we do need current novaclient for use with cinder21:29
jeblairso we'd probably want to pip install them21:29
*** hashar has quit IRC21:29
pleia2clarkb, jeblair - disk filled up on puppet-dashboard http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=375&rra_id=all21:30
pleia2that's why passenger is complaining21:30
pleia2(hooray for reading the error message passenger gives!)21:30
jeblairpleia2: doesn't that host need to be rebuilt or something?21:31
clarkbjeblair: it does because it is rax legacy21:31
pleia2good opportunity to move it then?21:31
clarkbI am semi inclined to leave the existing node as is and focus on building a new one21:31
jeblairi thought there were current database problems as well as the 'delete old reports' functionality was broken21:31
jeblairpossibly because of the database problems21:31
jeblairpleia2: but you're the expert.  :)21:31
pleia2I know fungi was manually cleaning things out for a while21:31
pleia2but it's been a few months21:32
jeblairthat's no way to run things21:32
pleia2indeed21:32
jeblairpleia2: do you know what to do to make it better?21:32
pleia2if we want to build a new one, it may be time for me to get my ssh key up on a server21:32
pleia2jeblair: not precisely, but I have some thoughts21:33
clarkbpleia2: jeblair I think making it better involves starting with a new database21:33
*** thomasbiege has joined #openstack-infra21:33
pleia2clarkb: +121:33
clarkbpleia2: jeblair then using the suggested practices to optimize the DB and roll out old logs21:33
clarkbwe can probably get away wit ha month of logs21:33
clarkbor less21:33
pleia2I didn't see the same errors on my local install, so I think there is some unspecified cruft causing problems21:34
clarkbpleia2: I think number of reports and not deleting anything is part of the problem21:34
jeblairclarkb: are the suggested practices implemented in our puppet yet?21:34
clarkbjeblair: no I don't think they are21:34
pleia2clarkb: yeah, volume is something I don't have on mine21:34
clarkbjeblair: pleia2 let me find the page with suggestions for tuning dashboard21:34
*** dkranz has quit IRC21:35
jeblairpleia2, clarkb: so we'll spin up a new server, pleia2 can you do the puppet to implement the tuning, and if you find you still need shell access to figure out what's going wrong, i'm ok with that.21:36
jeblairpleia2: s/tuning,/tuning?/21:36
pleia2jeblair: wfm21:36
clarkbpleia2: http://docs.puppetlabs.com/dashboard/manual/1.2/configuring.html#Performance21:37
clarkbpleia2: optimize and prune is what we are missing iirc21:37
pleia2clarkb: thanks, I'll have a look21:37
pleia2anteaya: do you happen to remember what you and fungi tried several months ago on the database and didn't go so well?21:38
*** danger_fo is now known as danger_fo_away21:38
jeblairyeah, basically i think we only care about (a) what has happened in the last 30 minutes?  and (b) what hosts are broken?21:38
clarkbhttps://groups.google.com/forum/#!topic/repo-discuss/JE7OM6o7DMs is what the git-review test appears to be hitting21:38
jeblairso a month of reports should be more than enough.  a week is probably fine if a month is a problem.21:38
openstackgerritWilliam Van Hevelingen proposed a change to openstack-infra/config: Fix stackforge description for Neutron module  https://review.openstack.org/4436121:39
*** kspear has quit IRC21:42
*** dkliban has joined #openstack-infra21:44
pleia2anteaya: nm, I found it, and what we need to do https://review.openstack.org/#/c/23112/21:44
*** thomasbiege has quit IRC21:48
pleia2and https://review.openstack.org/#/c/23127/ did the passenger optimizations, looks like we just need to reconfigure mysql and set up pruning21:49
*** datsun180b has quit IRC21:50
clarkbpleia2: I think the optimizations on the performance page are different21:51
clarkbthey optimize the DB records or log files or something. Independent of passenger21:51
pleia2clarkb: "Optimize your database once a month" thing is the one 23112 addressed and didn't play well with Ubuntu mysql defaults21:52
pleia2so was abandoned21:52
clarkboh I see21:52
pleia2"Tune the number of processes Dashboard" did get through though, we're using it21:53
pleia2writing a patch for "Regularly prune your old reports"21:53
clarkbpleia2: I think pruning is the important one21:53
* pleia2 nods21:53
clarkbtestr run --parallel --until-failure ftw21:54
clarkbthese git review test failures are really odd21:54
*** kspear has joined #openstack-infra21:55
*** dina_belova has joined #openstack-infra22:03
*** mriedem has quit IRC22:07
*** dina_belova has quit IRC22:08
*** Ryan_Lane has quit IRC22:08
clarkbI think the problem may be using upstream gerrit's build of gerrit22:09
clarkbI am running the tests now with our gerrit builds in a loop and that seems happy so far22:09
clarkbactually I didn't delete the old war so it probably isn't using our war...22:10
*** pentameter has quit IRC22:10
*** tstevenson has quit IRC22:10
*** burt has quit IRC22:11
*** dolphm has joined #openstack-infra22:12
*** weshay has quit IRC22:14
*** prad has quit IRC22:17
chmouelI just made that emacs mode to gerrit-review/change https://github.com/chmouel/gerrit-download.el22:17
chmoueljeblair, mordred and any emacs users out there ^22:18
chmouelprobbaly should move all that to gerrit when i found out how to do that22:18
clarkbperhaps put it in the git-review repo?22:20
*** portante is now known as portante|afk22:20
clarkbthen setup.py can in theory install it to wherever it should go22:20
*** olaph has joined #openstack-infra22:20
*** jhesketh has joined #openstack-infra22:21
lifelessjeblair: clarkb: ok, so is there an example of 'install in a venv' for -infra/config ?22:22
chmouelclarkb: yeah why not :) let's see what the others suggests22:22
*** jhesketh__ has quit IRC22:22
lifelessjeblair: clarkb: or should I just do it by hand for now and move on?22:22
clarkblifeless: for rax DNS?22:22
lifelessclarkb: and novaclient and cinderclient, per jeblair above22:23
lifelessjeblair: initial feedback on the modules/openstack_project stuff I'm copying across: most of it doesn't seem openstack specific.22:24
lifelessjeblair: e.g. firewalls - everyone should have host firewalls.22:24
clarkblifeless: novaclient and cinderclient can be global installs. no venv22:24
*** adalbas has quit IRC22:24
clarkblifeless: re not being openstack specific I was pointed at the roles and profiles way of doing things https://github.com/hunner/roles_and_profiles22:25
lifelessclarkb: 09:29 < jeblair> i believe we do need current novaclient for use with cinder22:25
lifelessclarkb: 09:29 < jeblair> so we'd probably want to pip install them22:25
*** fbo is now known as fbo_away22:25
clarkblifeless: refactoring to do that may simplify what you are discribing as being duplication22:25
clarkblifeless: you can install with pip globally22:26
*** w_ has joined #openstack-infra22:26
lifelessclarkb: sure; my question remains: should I hand-do this, or is there something I can cargo cult within puppet to do it {and submit as a patch to fix the bug I filed}22:26
clarkbpackage { 'python-novaclient': ensure => latest, provider=> pip, }22:26
*** changbl has quit IRC22:26
pleia2any reason we don't have openstackgerrit report on openstack-infra/puppet-dashboard here? or -vcsrepo, -apparmor (if not, I will add it)22:28
openstackgerritAlex Gaynor proposed a change to openstack-infra/config: Added PyPy to gate and check for python-swiftclient  https://review.openstack.org/4436922:28
anteayapleia2: sorry haven't read all the backscroll, dinner with my parents - I don't recommend using that patch22:28
pleia2anteaya: agreed, thanks22:28
*** olaph has quit IRC22:28
anteayapleia2: that patch invokes a rake task that is unlike any I have encountered before22:28
anteayait assumes you have maintained your database a certain way prior to running the cron job22:29
pleia2anteaya: yeah, we're having a look at puppet-dashboard tuning again, so I was just digging up the history22:29
anteayapleia2: okay, happy to talk about it and include fungi once he is back22:29
pleia2anteaya: we're creating a new puppet-dashboard server, so if we could start fresh with a properly optimized database that'd be nice22:29
pleia2anteaya: sounds good, thanks :)22:29
anteayapleia2: yes22:29
clarkbpleia2: probably because they are low volume and we didn't notice they were missing :)22:29
anteayapleia2: let me finish the evening with my parents and I will read the backscroll and talk to you tomorrow22:30
pleia2clarkb: ok :) I'll add bot patch, in the meantime I did do https://review.openstack.org/#/c/44368/22:30
lifelesshow can one check hiera is setup correctly?22:30
clarkbI think you can query directly running the hiera command?22:31
lifelessI've added a file22:31
lifelesshiera sysadmins22:31
lifelessnil22:31
clarkblifeless: https://github.com/puppetlabs/hiera#querying-from-cli22:31
lifelessoh, wrong config file :(22:32
*** rnirmal has quit IRC22:33
*** w_ has quit IRC22:33
openstackgerritElizabeth Krumbach Joseph proposed a change to openstack-infra/config: Add puppet modules we maintain to gerrit bot  https://review.openstack.org/4437022:34
svarnaulifeless: I started with hieradata/production/common.yaml, and things worked.22:34
lifelessclarkb: doesn't seem to cover telling it that we're in the 'production' environment22:34
jgriffithlifeless: that's correct (re novaclient)22:34
lifelesssvarnau: the command line query?22:34
lifelessjgriffith: released cinderclient needs trunk novaclient?22:35
jgriffithguess that was a while ago :)22:35
svarnaulifeless: I found what places it searched by doing puppet apply --debug22:35
jgriffithlifeless: cinderclient doesn't need it, but cinder trunk now needs novaclient22:35
*** ArxCruz has quit IRC22:36
lifelessjgriffith: oh! different thing :) We're talking about the puppetmaster setup for inta.22:36
lifelesss/inta/infra/.22:36
*** adalbas has joined #openstack-infra22:36
lifelessclarkb: $ hiera -c /etc/puppet/hiera.yaml environment=production sysadmins22:37
lifelesssysadmins22:37
lifelessincoming :)22:37
openstackgerritlifeless proposed a change to openstack-infra/config: Document hiera setup a bit more comprehensively.  https://review.openstack.org/4435722:38
openstackgerritlifeless proposed a change to openstack-infra/config: Stage 2 - dashboard.  https://review.openstack.org/4427122:38
openstackgerritlifeless proposed a change to openstack-infra/config: Make the adduser commands copy-pasteable.  https://review.openstack.org/4427022:38
openstackgerritlifeless proposed a change to openstack-infra/config: Initial bootstrap configuration.  https://review.openstack.org/4426422:38
openstackgerritlifeless proposed a change to openstack-infra/config: Port across params and puppet_cron.  https://review.openstack.org/4426322:38
openstackgerritlifeless proposed a change to openstack-infra/config: Document bootstrapping a new infrastructure.  https://review.openstack.org/4426222:38
*** rcleere has quit IRC22:40
*** thedodd has quit IRC22:41
*** w_ has joined #openstack-infra22:47
*** thomasm has quit IRC22:48
lifeless[sorry about the deep spam; I'll figure out how to keep my parallel infra patches from coming up soon]22:49
clarkbswapping in our gerrit way just makes it fail. I think there must be something different about the gerrit configs22:50
clarkbI suppose I can try building a local war of 2.6.1 to see if that helps ssh. Would at least point to the upstream war being less than ideal22:51
*** pabelanger_ has quit IRC22:53
*** pabelanger has joined #openstack-infra22:53
jgriffithlifeless: :(  sorry, that's what I get for just catching my highlights22:54
lifelessheh ;)22:54
*** nati_ueno has joined #openstack-infra22:55
*** Ryan_Lane has joined #openstack-infra22:57
*** jhesketh has quit IRC23:03
*** ryanpetrello has quit IRC23:04
*** dina_belova has joined #openstack-infra23:04
*** w_ has quit IRC23:04
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Add image logging config for nodepool  https://review.openstack.org/4437223:04
openstackgerritJames E. Blair proposed a change to openstack-infra/nodepool: Add image logging  https://review.openstack.org/4437323:05
*** olaph has joined #openstack-infra23:06
*** dina_belova has quit IRC23:09
*** hemna is now known as hemnafk23:12
openstackgerritJames E. Blair proposed a change to openstack-infra/nodepool: Add image logging  https://review.openstack.org/4437323:13
*** sarob has quit IRC23:14
*** sarob has joined #openstack-infra23:14
*** sarob has quit IRC23:18
*** nati_ueno has quit IRC23:19
*** dims has quit IRC23:19
openstackgerritJames E. Blair proposed a change to openstack-infra/nodepool: Add image logging  https://review.openstack.org/4437323:20
clarkbjudging by the way these tests are failing there are quite a few changes between gerrit 2.4 and 2.623:23
clarkblooks like admins can force push into repos by default with 2.6 but not 2.423:24
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Add image logging config for nodepool  https://review.openstack.org/4437223:24
jeblairclarkb: i really hope we can acl that out; that's very very bad.23:25
clarkbjeblair: the git-review tests assume that the admin that is created can just push back into origin master. This fails when I use our 2.4 way23:27
clarkbs/way/war/23:27
*** jhesketh_ has joined #openstack-infra23:27
clarkbafter pushing to the local repo I get past the setup steps, but now git-review fails because it needs verified email addresses23:29
clarkbdid they relax a bunch of CLs?23:29
clarkbon one hand it is kind of nice because it makes the tests simple, but the default behavior is less what you would want in production imo23:30
clarkbthings to keep in mind when we switch (hopefully our All-Projects acls that come from 2.4 will set things right23:31
echoheadclarkb: do you know where stackalytics pulls affiliation from?23:31
clarkbechohead: linkedin? I don't actually23:32
echohead:)23:32
*** dims has joined #openstack-infra23:32
*** jamiem has quit IRC23:34
*** jamiem has joined #openstack-infra23:35
pleia2echohead: if this is kept up to date, there is some logic for determining here: https://wiki.openstack.org/wiki/Stackalytics#Git_commits_history23:36
*** w_ has joined #openstack-infra23:36
pleia2but hm, now I'm curious23:38
*** olaph has quit IRC23:39
pleia2I guess the question is how etc/default_data.json is created, since affiliations are staticly defined in that file in the repo23:39
pleia2echohead: ^^23:39
*** w_ has quit IRC23:41
*** sarob has joined #openstack-infra23:45
*** sgviking has joined #openstack-infra23:47
*** sarob_ has joined #openstack-infra23:48
*** jamiem has quit IRC23:48
*** jhesketh_ has quit IRC23:51
*** jhesketh_ has joined #openstack-infra23:52
*** sarob has quit IRC23:52
*** w_ has joined #openstack-infra23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!