Wednesday, 2015-09-23

crinklenibalizer: I think I understand but if you're up for it that would probably save some time00:01
nibalizerya ill try to do that00:01
*** hodos has quit IRC00:01
*** tsekiyam_ has joined #openstack-infra00:04
*** jerrygb_ has joined #openstack-infra00:05
*** mtanino has quit IRC00:07
*** tsekiyama has quit IRC00:08
*** jerrygb_ has quit IRC00:08
*** tsekiyam_ has quit IRC00:09
openstackgerritSpencer Krum proposed openstack-infra/project-config: Run a puppet apply test against infracloud node defs  https://review.openstack.org/22659700:09
*** jerrygb has quit IRC00:09
nibalizercrinkle: ^^00:11
openstackgerritAkash Gangil proposed openstack-infra/system-config: Add #openstack-vmware-nsx to eavesdrop bot  https://review.openstack.org/22659800:12
crinklenibalizer: I don't think we actually need infracloud.pp, do we?00:12
crinklenibalizer: the apply test will work the same with site.pp, just a different module file00:13
*** tiswanso has joined #openstack-infra00:13
openstackgerritSachi King proposed openstack-infra/project-config: Add non-voting constraints jobs to nova  https://review.openstack.org/21958200:13
*** Guest18166 is now known as dims_00:17
Nakatoclarkb: re: https://review.openstack.org/#/c/219582/ rebased00:17
asselinnibalizer, I would like your review of this: https://review.openstack.org/#/c/200330/00:18
*** thorst has joined #openstack-infra00:18
asselinnibalizer, I plan to write some documentation next, but would like your opinion first in case it's all wrong00:19
*** sridhar_ram has quit IRC00:19
nibalizercrinkle: so how do we prevent the cloud-apply-test from trying to run node definitons for trusty machines like review.o.o ?00:20
*** larainema has quit IRC00:20
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Fix verbose option inialization  https://review.openstack.org/22660100:20
*** larainema has joined #openstack-infra00:20
crinklenibalizer: oh I see00:21
*** larainema has quit IRC00:21
crinklenibalizer: cool00:21
anteayamtreinish: so I understand tomorrow is not eating day00:21
anteayamtreinish: may you survive00:21
mtreinishheh, thanks00:21
anteaya:)00:22
anteayaenjoy the fainting00:22
anteayamay their be couches for all the family members00:22
*** ivar-lazzaro has quit IRC00:22
mtreinishwell I'm not spending the day with my family, just going down there for all the food in the evening00:22
mtreinishso I don't have to worry about dealing with that this year00:23
anteayanice way to spend not eating day00:23
*** larainema has joined #openstack-infra00:23
anteayanice timing00:23
anteaya"May you be sealed in the Book of Life"00:23
* anteaya is learning so much00:23
pleia2mtreinish: G'mar Tov! then00:23
nibalizercrinkle: so we could introduce another comment tag that would describe purpose00:23
pleia2anyway, time for me to leave for services and things, will be back on thursday00:23
nibalizeror inspect the 'role' variable we're setting on all these nodes00:23
anteayapleia2: have fun00:23
*** tiswanso has quit IRC00:24
nibalizerim becomming more and more tempted to use yaml to replace site.pp though I know that may not be actually popular00:24
crinklenibalizer: i hear yaml is pretty popular around these parts00:24
crinklenibalizer: but you're right, just splitting it to a separate file is simplest00:24
anteayaof all the hills I am prepared to die on, yaml is not one of them00:25
*** larainema has quit IRC00:25
nibalizerheh00:25
anteayayaml is a field00:25
anteayawith rabbits and 8 point bucks, eating the grass00:25
*** dimtruck is now known as zz_dimtruck00:28
openstackgerritPaul Van Eck proposed openstack-infra/puppet-refstack: Update RefStack repo name  https://review.openstack.org/22660300:28
openstackgerritPaul Van Eck proposed openstack-infra/puppet-refstack: Correct API url in refstack.conf template  https://review.openstack.org/22660400:28
*** sridhar_ram has joined #openstack-infra00:29
*** madhu_ak has quit IRC00:30
*** austin811 has left #openstack-infra00:31
*** spzala has joined #openstack-infra00:31
openstackgerritColleen Murphy proposed openstack-infra/system-config: Make apply test more configurable  https://review.openstack.org/22660500:31
crinklenibalizer: ^00:31
*** spzala has quit IRC00:32
*** spzala has joined #openstack-infra00:32
anteayajhesketh: you about for a question on https://review.openstack.org/#/c/214207/6/os_loganalyze/generator.py00:33
nibalizerthat looks pretty good00:33
*** stevemar has joined #openstack-infra00:33
anteayajhesketh: it is possible I don't understand a python ism00:33
anteayajhesketh: old code had if log_path:00:33
anteayajhesketh: new code has if log_path is not None:00:33
anteayajhesketh: why is the is not None necessary?00:34
*** stevemar has quit IRC00:36
anteayajhesketh: and commented since I found something else00:36
*** davideagnello has quit IRC00:37
*** davideagnello has joined #openstack-infra00:37
*** julim has quit IRC00:39
*** markvoelker has joined #openstack-infra00:40
*** thorst has quit IRC00:40
*** achanda has quit IRC00:41
openstackgerritColleen Murphy proposed openstack-infra/system-config: (WIP) Add compute class for Infra Cloud  https://review.openstack.org/21398000:42
openstackgerritColleen Murphy proposed openstack-infra/system-config: (WIP) Add controller class for Infra Cloud  https://review.openstack.org/20969800:42
*** xyang1 has quit IRC00:42
*** ddieterly has joined #openstack-infra00:43
*** geoffarnold has quit IRC00:44
*** pvaneck has quit IRC00:47
*** gyee has quit IRC00:49
*** davideagnello has quit IRC00:49
*** davideagnello has joined #openstack-infra00:49
*** Sukhdev has quit IRC00:50
*** asettle has joined #openstack-infra00:50
*** tiswanso has joined #openstack-infra00:55
*** alexsyip has quit IRC00:56
*** asettle has quit IRC00:56
*** asettle has joined #openstack-infra00:56
*** larainema has joined #openstack-infra00:57
*** abitha has quit IRC00:57
*** tiswanso_ has joined #openstack-infra00:57
*** ok_delta has joined #openstack-infra00:59
*** tiswanso has quit IRC01:00
*** angdraug has quit IRC01:04
*** bharathm has quit IRC01:05
*** sridhar_ram has quit IRC01:06
*** asettle has quit IRC01:06
*** asettle has joined #openstack-infra01:07
*** DericHorn-HP has joined #openstack-infra01:07
*** sflanigan has quit IRC01:08
*** aeng_ has quit IRC01:08
*** pahuang has quit IRC01:08
*** zz_dimtruck is now known as dimtruck01:10
*** achanda has joined #openstack-infra01:11
*** stevemar has joined #openstack-infra01:11
*** tonytan4ever has quit IRC01:13
*** bpokorny has quit IRC01:13
*** puranamr has joined #openstack-infra01:15
*** ybathia has quit IRC01:16
*** DericHorn-HP has quit IRC01:17
*** spzala has quit IRC01:18
*** hdd has quit IRC01:18
*** moravec has joined #openstack-infra01:19
*** aeng_ has joined #openstack-infra01:21
*** sflanigan has joined #openstack-infra01:24
*** sflanigan has joined #openstack-infra01:24
*** pahuang has joined #openstack-infra01:25
*** hdd has joined #openstack-infra01:26
*** DericHorn-HP has joined #openstack-infra01:27
*** nelsnels_ has joined #openstack-infra01:30
*** sabeen has joined #openstack-infra01:30
*** jerryz has quit IRC01:31
*** jyuso1 has joined #openstack-infra01:32
*** nelsnelson has quit IRC01:33
*** jyuso1 has quit IRC01:34
*** moravec has quit IRC01:36
*** woodster_ has quit IRC01:39
*** nijaba_ has joined #openstack-infra01:40
*** puranamr has quit IRC01:40
*** nijaba has quit IRC01:40
mordredClint: \o/01:41
mordredlifeless: yes - and I like it01:41
lifelessmordred: it?01:42
mordredlifeless: I'm lifelessing my scrollback01:43
*** jerrygb has joined #openstack-infra01:44
mordredlifeless: ;)01:44
mordredlifeless: (you mentioned shellvars - and yes you shwed it to me, and I liked it)01:44
lifelessah yes, thanks01:44
*** jerrygb has quit IRC01:45
*** jerrygb has joined #openstack-infra01:45
*** salv-orlando has joined #openstack-infra01:46
*** Daisy has joined #openstack-infra01:47
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Use tripleo.sh to drive ci  https://review.openstack.org/22577601:48
*** gildub has quit IRC01:50
*** larainema has quit IRC01:54
*** doug-fish has joined #openstack-infra01:55
*** salv-orlando has quit IRC01:56
*** dims_ has quit IRC01:57
*** baoli has joined #openstack-infra01:57
*** dims_ has joined #openstack-infra01:57
* ruagair still boggles at the need to run ansible to run puppet.01:58
*** aeng_ has quit IRC01:59
*** michchap_ has joined #openstack-infra01:59
*** sflanigan has quit IRC01:59
*** pahuang has quit IRC01:59
mordredruagair: aw, comeon. it's fun!02:00
mordredruagair: we landed a module in upstream ansible for it even02:00
*** wenlock has joined #openstack-infra02:01
*** michchap has quit IRC02:01
*** kiranr has joined #openstack-infra02:01
ruagairWe talked about it briefly in Brisbane mordred.02:02
mordredruagair: yah. just saying. .. it's still fun :)02:02
ruagairI was just freshly reminded by reading the renaming change.02:03
ruagair:-)02:03
ruagairIt is fun.02:03
ruagairGet's my OCD ticking over too :-)02:03
ianwmordred: re the user credentials after keystone is up, it's non-trivial to run create_userrc before all the services are up, it wants to make ec2 keys and stuff.  would https://review.openstack.org/#/c/226609/ (modulo bugs) suffice?02:03
mordredruagair: I personally enjoy the repos "ansible-puppet", "puppet-ansible" and "ansible-infra"02:03
*** weshay_xchat has joined #openstack-infra02:03
*** weshay_xchat is now known as weshay02:03
mordredianw: yes. I tink so.02:04
ruagairI actually bumped into a puppeteer in Sydney who claimed it was just because we didn't understand puppet. Things deteriorated from there.02:04
mordredianw: of course, don't even get me started on why in th  heck we're still making ec2 and s3 things in devstack02:04
mordredruagair: hahahahahahaha02:04
*** DericHorn-HP has quit IRC02:04
mordredruagair: oh my02:04
mordredruagair: I kind of which I'd been there for that02:04
*** DericHorn-HP has joined #openstack-infra02:05
mordredianw: ut yes - I tink your patch is excellent and gets at the heart of the matter ... giving an easy way to poke at whatever state of the cloud happens to have gotten up02:05
mordredianw: and if that doesn't have aws creds ... shrug02:05
ruagairIt started badly before we met him. He was drinking alone with a puppet shirt on. I *may* have photographed from the back and posted on twitter with smart arse remarks about puppet people drinking alone.02:06
mordredianw: actually - what _do_ we use the ec2/s3 creds for at this point? isn't it kind of understaood that ec2 in tree of nova is abandonware?02:06
mordred(not trolling, actually asking)02:06
mordredruagair: you are continuing to make me wish I'd been there02:06
ianwmordred: well it does a bunch of other stuff like setting up swift users for tempest02:06
*** DericHorn-HP has quit IRC02:06
ianwmordred: well i guess it breaks stackforge/ec2-api ci02:06
mordredianw: shouldn't that be in stackforge/ec2-api's devstack plugin?02:07
mordredianw: and why can't swift users be made with normal keystone api calls?02:07
*** DericHorn-HP has joined #openstack-infra02:07
mordredianw: (I've been ignoring a chunk of this for a while, so sometimes when I learn things I have to ask a ton more questions)02:07
ianwi think it's just an ordering thing ,in that when we do it before the services are up ,the credentials are not created because it thinks it is not there02:08
mordredfascinating02:08
*** yamahata has joined #openstack-infra02:08
ianwand although it looks like the script is idempotent, i don't know, and frankly not sure i want to debug that02:08
*** dims_ has quit IRC02:10
*** asettle has quit IRC02:10
*** aeng_ has joined #openstack-infra02:12
*** sflanigan has joined #openstack-infra02:12
*** sflanigan has joined #openstack-infra02:12
*** pahuang has joined #openstack-infra02:12
*** dims_ has joined #openstack-infra02:13
*** ddieterl_ has joined #openstack-infra02:14
*** ddieterly has quit IRC02:17
*** dims__ has joined #openstack-infra02:18
mordred++02:18
*** dims_ has quit IRC02:18
*** bswartz has joined #openstack-infra02:19
openstackgerritMikhail S Medvedev proposed openstack-infra/infra-specs: Host an initial CI monitoring dashboard service  https://review.openstack.org/19443702:20
*** mwagner_lap has joined #openstack-infra02:21
*** darrenc is now known as darrenc_afk02:21
*** wenlock has quit IRC02:22
*** larainema has joined #openstack-infra02:22
*** dims__ has quit IRC02:23
*** MarkAtwood has quit IRC02:25
mmedvedeanteaya: I have addressed asselin 's comments on the spec, per your request earlier02:26
*** yamahata has quit IRC02:29
*** unicell has quit IRC02:33
*** DericHorn-HP has quit IRC02:34
*** baoli has quit IRC02:37
*** DericHorn-HP has joined #openstack-infra02:37
*** baoli has joined #openstack-infra02:38
*** michchap has joined #openstack-infra02:42
*** michchap_ has quit IRC02:44
*** wenlock has joined #openstack-infra02:45
*** niska has quit IRC02:47
*** michchap has quit IRC02:47
*** michchap has joined #openstack-infra02:47
*** asettle has joined #openstack-infra02:49
*** darrenc_afk is now known as darrenc02:49
*** michchap has quit IRC02:52
*** niska has joined #openstack-infra02:54
*** markvoelker has quit IRC03:01
Clintmordred: who what now03:02
*** DericHorn-HP has quit IRC03:04
*** doug-fish has quit IRC03:04
*** DericHorn-HP has joined #openstack-infra03:05
*** gildub has joined #openstack-infra03:06
*** nelsnels_ has quit IRC03:08
*** boris-42 has quit IRC03:09
*** michchap has joined #openstack-infra03:09
openstackgerritClark Boylan proposed openstack-infra/nodepool: Add a test for the list command  https://review.openstack.org/22659103:11
*** david-lyle has joined #openstack-infra03:13
*** Daisy has quit IRC03:14
*** nelsnelson has joined #openstack-infra03:14
*** Daisy has joined #openstack-infra03:14
*** markvoelker has joined #openstack-infra03:16
*** michchap has quit IRC03:16
*** otter768 has quit IRC03:21
clarkbwoo I think new coverage may actually break the rendering of coverage html from swift03:21
clarkbbecause our "is this html" check is far too simple03:21
clarkbhrm maybe not I dunno03:23
clarkboh ya thats definitely it03:24
lifelessNakato: did I end up stalling you and tchaypo on that pbr bug, or its done ?03:24
clarkbproblem for another day03:25
clarkbjhesketh: if you are around and interested http://logs.openstack.org/91/226591/2/check/nodepool-coverage/92c0ac6/cover/ is an example. The leading whitespace seems to break us03:26
clarkbjhesketh: since we only chekc the first line to determine if it is html03:26
*** ddieterl_ has quit IRC03:26
clarkbos loganalyze likely needs to read until it gets a non whitespace line, check that, then return what it read properly in both case03:26
openstackgerritMerged openstack/requirements: Update neutron and openstack client constraints for liberty  https://review.openstack.org/22643903:28
*** fawadkhaliq has joined #openstack-infra03:32
*** baoli has quit IRC03:32
*** dimtruck is now known as zz_dimtruck03:32
*** Daisy has quit IRC03:33
*** Daisy has joined #openstack-infra03:33
*** michchap has joined #openstack-infra03:33
*** MarkAtwood has joined #openstack-infra03:34
*** olaph has quit IRC03:36
*** DericHorn-HP has quit IRC03:38
*** Daisy has quit IRC03:38
greghaynesjeblair: Mostly PTOing this week, but replied to your nodepool builder comments03:40
*** tiswanso_ has quit IRC03:41
*** DericHorn-HP has joined #openstack-infra03:41
*** olaph has joined #openstack-infra03:43
SpamapShm, I forget all the places one needs to update company affiliation03:44
greghaynesSpamapS: got a list handy?03:44
SpamapSI know the stackalytics json03:44
greghaynes;)03:44
*** armax has quit IRC03:44
SpamapSand I think the foundation profile maybe? But I never can remember that password :-P03:44
greghaynesalso if youre speaking and such theres conference info, and eventbrite summit stuff03:45
* SpamapS will just make another random one :-P03:45
*** ayoung has quit IRC03:45
*** hrubi has quit IRC03:47
*** dims_ has joined #openstack-infra03:47
lifelessthre used to be more places03:51
*** moravec has joined #openstack-infra03:52
lifelesshmm, we still have .mailmap in each repo03:52
*** hrubi has joined #openstack-infra03:53
*** wenlock has quit IRC03:54
*** geoffarnold has joined #openstack-infra03:54
*** dims_ has quit IRC03:54
*** geoffarn_ has joined #openstack-infra03:55
*** wenlock has joined #openstack-infra03:56
*** jerrygb has quit IRC03:56
*** moravec has quit IRC03:56
*** geoffarnold has quit IRC03:58
tchaypolifeless: I saw your comments last night and I agree with them. I haven't had a chance to work on it this morning, but I hope to have something a bit more detailed to push up tonight03:58
*** sridhar_ram has joined #openstack-infra03:59
*** DericHorn-HP has quit IRC03:59
*** tlian2 has joined #openstack-infra04:01
*** tlian has quit IRC04:02
*** changbl has quit IRC04:04
*** wenlock has quit IRC04:07
*** geoffarn_ has quit IRC04:07
*** changbl has joined #openstack-infra04:09
*** achanda has quit IRC04:17
*** salv-orlando has joined #openstack-infra04:17
*** wenlock has joined #openstack-infra04:24
*** ddieterly has joined #openstack-infra04:27
*** aeng_ is now known as aeng04:31
*** ddieterly has quit IRC04:31
*** kiranr has quit IRC04:32
*** fawadk has joined #openstack-infra04:33
*** salv-orlando has quit IRC04:35
*** fawadkhaliq has quit IRC04:35
*** mrmartin has joined #openstack-infra04:38
*** michchap_ has joined #openstack-infra04:40
*** michchap has quit IRC04:41
*** Sree has joined #openstack-infra04:44
*** BharatK has joined #openstack-infra04:45
*** Sree_ has joined #openstack-infra04:46
*** Sree_ is now known as Guest1466204:46
*** achanda has joined #openstack-infra04:48
*** Sree has quit IRC04:49
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Order get_tests_run_dicts_from_run_id response by date  https://review.openstack.org/21346404:49
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add tests for get_tests_run_dicts_from_run_id() and fix issues  https://review.openstack.org/22662204:49
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Use ostestr for running unit tests  https://review.openstack.org/21356504:49
*** harlowja_at_home has joined #openstack-infra04:51
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add more db api tests  https://review.openstack.org/21356604:51
*** geoffarnold has joined #openstack-infra04:53
*** asettle has quit IRC04:55
*** deepakcs has joined #openstack-infra04:56
*** hdd has quit IRC04:59
*** Sree has joined #openstack-infra04:59
*** Zhongjun_ has joined #openstack-infra04:59
*** Guest14662 has quit IRC05:02
*** asselin_ has quit IRC05:08
*** kushal has joined #openstack-infra05:10
*** Sukhdev has joined #openstack-infra05:11
*** sergmelikyan has joined #openstack-infra05:13
*** harlowja_at_home has quit IRC05:14
*** sergmelikyan has quit IRC05:17
*** Sukhdev has quit IRC05:17
*** jyuso1 has joined #openstack-infra05:20
*** ildikov has quit IRC05:21
*** otter768 has joined #openstack-infra05:22
*** BharatK has quit IRC05:24
*** otter768 has quit IRC05:26
*** ddieterly has joined #openstack-infra05:28
*** Zhongjun_ is now known as Zhongjun05:28
*** ddieterly has quit IRC05:33
*** doug-fish has joined #openstack-infra05:34
*** doug-fish has quit IRC05:39
*** BharatK has joined #openstack-infra05:40
*** ashleighfarnham has joined #openstack-infra05:44
*** salv-orlando has joined #openstack-infra05:45
*** boris-42 has joined #openstack-infra05:47
*** Sukhdev has joined #openstack-infra05:48
*** dims_ has joined #openstack-infra05:50
*** hrubi has quit IRC05:52
*** hrubi has joined #openstack-infra05:52
*** salv-orlando has quit IRC05:52
*** kiran-r has joined #openstack-infra05:54
*** dims_ has quit IRC05:55
*** kiranr has joined #openstack-infra05:58
*** sridhar_ram has quit IRC05:59
*** geoffarnold has quit IRC06:00
*** ildikov has joined #openstack-infra06:00
*** kiran-r has quit IRC06:02
*** kiranr has quit IRC06:02
*** flepied has quit IRC06:04
*** AJaeger has joined #openstack-infra06:04
*** nadya has joined #openstack-infra06:04
*** madong_ has joined #openstack-infra06:06
*** jerryz has joined #openstack-infra06:07
*** Sree has quit IRC06:07
*** larainema has quit IRC06:08
*** jerrygb has joined #openstack-infra06:08
*** Sree has joined #openstack-infra06:08
*** jerrygb has quit IRC06:12
*** fawadk has quit IRC06:14
AJaegerIs our proposal slave offline? None of the translation jobs move forward...06:17
*** fawadkhaliq has joined #openstack-infra06:17
*** jerryz has quit IRC06:17
*** scheuran has joined #openstack-infra06:17
*** cloudnull has quit IRC06:18
*** MarkAtwood has quit IRC06:18
*** bswartz has quit IRC06:18
AJaegerjhesketh, clarkb, fungi, jeblair, pleia2 is anybody of you around? ^06:20
*** bswartz has joined #openstack-infra06:21
*** cloudnull has joined #openstack-infra06:21
*** bharathm has joined #openstack-infra06:21
StevenKAJaeger: "Disconnected by cboylan : Clarkb is testing a thing on this slave against zanata-dev and doesn't want a job to come by and override the config." from https://jenkins.openstack.org/computer/proposal.slave.openstack.org/06:22
*** stevemar has quit IRC06:23
*** shardy has joined #openstack-infra06:25
AJaegerStevenK: I guess clark forgot to enable it again ;(06:26
AJaegerLooking at the reviews, he did the testing.06:26
AJaegerOk, let's wait until he's awake again and then let's run all the proposals...06:27
*** Sukhdev has quit IRC06:28
StevenKAJaeger: I use a test proposal slave for this stuff, takes ~20 minutes for me to spin one up06:28
* AJaeger was eager to see whether all the proposals run after my consolidation patch series...06:28
AJaeger;)06:28
StevenKHeh06:28
*** ddieterly has joined #openstack-infra06:28
StevenKAJaeger: Indeed, brilliant work for that, I love two scripts rather than eight06:29
*** nadya has quit IRC06:29
*** vlaza has joined #openstack-infra06:31
*** fawadk has joined #openstack-infra06:32
*** ashleighfarnham has quit IRC06:32
*** fawadkhaliq has quit IRC06:33
*** ddieterly has quit IRC06:33
AJaegerAs pleia2 said yesterday, we're on the road to perfection ;) But it looks far better. If you have some more ideas for refaktor/cleanup, please propose them.06:33
AJaegerStevenK: could you have a look at https://review.openstack.org/#/c/226485/ , please? If you're fine with it as well, we can merge that also06:34
AJaegerAnd there's the version support starting at https://review.openstack.org/#/c/225951/206:35
*** flepied has joined #openstack-infra06:36
*** docaedo has quit IRC06:37
StevenKAJaeger: My only concern with that patch (226485) is you're dropping the -manuals 8 percent comment, which I think is useful.06:37
*** tlian2 has quit IRC06:37
AJaegerThen let's add it back, let me check...06:38
AJaegerStevenK: thanks!06:40
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Translations: Merge pull_from_zanata  https://review.openstack.org/22648506:40
*** sabeen has quit IRC06:41
AJaegerStevenK: hope it's fine now06:41
*** docaedo has joined #openstack-infra06:43
AJaegerStevenK: I will +2A https://review.openstack.org/#/c/225951/ - but not the rest of that stack for now unless you raise a flag...06:43
*** flepied1 has joined #openstack-infra06:44
StevenKAJaeger: 225951 is fine to +2A, I share your concern with the next patch in the stack, and I find the variable name ZANATA_VERSION to be a little distasteful06:45
AJaegerStevenK: please comment so that clarkb can see it in the review.06:46
*** flepied has quit IRC06:47
AJaegerYou mean ZANATA_VERSION could be misread as version of the Zanata server?06:47
*** moravec has joined #openstack-infra06:48
*** sergmelikyan has joined #openstack-infra06:50
openstackgerritMerged openstack-infra/project-config: Support different translations versions  https://review.openstack.org/22595106:50
StevenKI don't think so -- more like gratuitous use of ZANATA_ where there is no need to be that explicit?06:50
*** ParsectiX has quit IRC06:50
*** fawadkhaliq has joined #openstack-infra06:51
*** bexelbie has joined #openstack-infra06:51
*** serg_melikyan has joined #openstack-infra06:51
*** kiranr has joined #openstack-infra06:51
openstackgerritEli Qiao proposed openstack-infra/project-config: WIP: Remove barbican plugin from magnum  https://review.openstack.org/22663406:52
*** fawadk has quit IRC06:52
*** moravec has quit IRC06:53
*** sergmelikyan has quit IRC06:54
*** serg_melikyan has quit IRC06:54
*** matrohon has joined #openstack-infra06:55
openstackgerritIan Wienand proposed openstack-infra/nodepool: Enable a fake statsd server for devstack testing  https://review.openstack.org/22663506:55
AJaegerunderstood, StevenK06:57
*** fawadk has joined #openstack-infra06:58
*** peristeri has joined #openstack-infra06:59
*** fawadkhaliq has quit IRC07:00
openstackgerrityolanda.robla proposed openstack-infra/nodepool: Update nodepool to use secure.conf file  https://review.openstack.org/18976207:01
*** Zhongjun has quit IRC07:07
AJaegeryolanda: welcome to infra-core/root! Did you see your action item from yesterday's meeting? http://eavesdrop.openstack.org/meetings/infra/2015/infra.2015-09-22-19.02.html07:09
yolandahi AJaeger, no, i wasn't able to join the meeting, and i was just reading backlog07:09
yolandachecking07:09
yolandaand thanks!07:09
*** fawadkhaliq has joined #openstack-infra07:09
yolandacool, i'm doing that today07:09
*** fawadk has quit IRC07:10
AJaegeryolanda: best base it on top of https://review.openstack.org/#/c/226526/1 - to avoid conflicts07:11
yolandaok07:11
*** Hal has joined #openstack-infra07:13
*** achanda has quit IRC07:14
*** markvoelker has quit IRC07:15
AJaegerStevenK, yolanda: Have a great day, I'm going offline again...07:16
*** AJaeger has quit IRC07:16
yolandaAJaeger, thanks , same to you07:16
*** otter768 has joined #openstack-infra07:23
*** stevemar has joined #openstack-infra07:23
*** Ala has joined #openstack-infra07:25
openstackgerrityolanda.robla proposed openstack-infra/system-config: Add yolanda to infra-root  https://review.openstack.org/22664007:25
*** MarkAtwood has joined #openstack-infra07:27
*** stevemar has quit IRC07:27
*** otter768 has quit IRC07:28
*** ddieterly has joined #openstack-infra07:29
*** MarkAtwood has quit IRC07:31
*** ifarkas has joined #openstack-infra07:32
*** ddieterly has quit IRC07:34
*** salv-orlando has joined #openstack-infra07:40
*** jordanP has joined #openstack-infra07:41
*** HeOS has quit IRC07:41
openstackgerrityolanda.robla proposed openstack-infra/system-config: Add yolanda to infra root  https://review.openstack.org/22664307:42
*** Sree_ has joined #openstack-infra07:42
*** mrmartin has quit IRC07:43
*** Sree_ is now known as Guest8906307:43
*** arxcruz has joined #openstack-infra07:43
*** madong_ has quit IRC07:44
*** madong_ has joined #openstack-infra07:44
*** Sree has quit IRC07:46
openstackgerritIan Wienand proposed openstack-infra/nodepool: Enable a fake statsd server for devstack testing  https://review.openstack.org/22663507:46
*** jlanoux has joined #openstack-infra07:46
openstackgerritsvasheka proposed openstack-infra/project-config: Alter horizon.yaml to get screenshots copied.  https://review.openstack.org/22636407:46
openstackgerritsvasheka proposed openstack-infra/project-config: Alter horizon.yaml to get screenshots copied.  https://review.openstack.org/22636407:47
*** salv-orl_ has joined #openstack-infra07:47
*** salv-orlando has quit IRC07:48
*** fawadkhaliq has quit IRC07:49
*** flepied1 is now known as flepied07:49
*** fawadkhaliq has joined #openstack-infra07:50
*** k4n0 has joined #openstack-infra07:51
*** dims_ has joined #openstack-infra07:52
*** notnownikki has joined #openstack-infra07:53
openstackgerrityolanda.robla proposed openstack-infra/system-config: Add yolanda to infra root  https://review.openstack.org/22664307:58
openstackgerritEli Qiao proposed openstack-infra/project-config: Remove barbican plugin from magnum  https://review.openstack.org/22663407:58
*** salv-orl_ has quit IRC07:59
*** salv-orlando has joined #openstack-infra07:59
*** dims_ has quit IRC07:59
*** dtantsur|afk is now known as dtantsur07:59
openstackgerritEli Qiao proposed openstack-infra/project-config: Remove barbican plugin from magnum  https://review.openstack.org/22663408:01
openstackgerritJames Polley proposed openstack-dev/pbr: WIP: Add test for pbr_info_writer check  https://review.openstack.org/22664608:02
*** BobBall_AWOL is now known as BobBall08:04
*** shardy_ has joined #openstack-infra08:04
*** hashar has joined #openstack-infra08:04
openstackgerrityolanda.robla proposed openstack-infra/system-config: Add yolanda to infra root  https://review.openstack.org/22664308:04
*** shardy has quit IRC08:04
*** markus_z has joined #openstack-infra08:06
*** shardy_ has quit IRC08:09
*** shardy has joined #openstack-infra08:09
*** _skolekonov is now known as skolekonov08:12
*** derekh has joined #openstack-infra08:13
*** shardy has quit IRC08:14
*** fhubik has joined #openstack-infra08:14
*** shardy has joined #openstack-infra08:14
*** markvoelker has joined #openstack-infra08:15
openstackgerrityolanda.robla proposed openstack-infra/system-config: Add yolanda to infra root  https://review.openstack.org/22664308:17
*** matbu has quit IRC08:18
*** matbu has joined #openstack-infra08:19
*** rossella_s has quit IRC08:19
*** rossella_s has joined #openstack-infra08:19
*** markvoelker has quit IRC08:20
*** rossella_s has quit IRC08:25
openstackgerritJames Polley proposed openstack-dev/pbr: Add test for pbr_info_writer check  https://review.openstack.org/22664608:25
openstackgerritJames Polley proposed openstack-dev/pbr: Add test for pbr_info_writer check  https://review.openstack.org/22664608:25
*** fhubik is now known as fhubik_brb08:28
*** kiran-r has joined #openstack-infra08:29
*** ddieterly has joined #openstack-infra08:30
*** wenlock has quit IRC08:32
*** fhubik_brb is now known as fhubik08:33
*** bharathm has quit IRC08:33
*** kiran-r has quit IRC08:34
*** ddieterly has quit IRC08:34
*** rossella_s has joined #openstack-infra08:36
*** Daisy has joined #openstack-infra08:39
*** kiran-r has joined #openstack-infra08:41
*** kushal has quit IRC08:44
openstackgerritsvasheka proposed openstack-infra/project-config: Alter horizon.yaml to get screenshots copied.  https://review.openstack.org/22636408:45
*** ihrachys has joined #openstack-infra08:45
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Use tripleo.sh to drive ci  https://review.openstack.org/22577608:45
*** pelix has joined #openstack-infra08:46
*** kushal has joined #openstack-infra08:47
*** mrmartin has joined #openstack-infra08:47
*** HeOS has joined #openstack-infra08:50
*** kushal has quit IRC08:52
*** Sree has joined #openstack-infra08:57
derekhIs there anybody around who can take a look at a change to ci jobs https://review.openstack.org/#/c/221457/08:58
*** Guest89063 has quit IRC09:00
openstackgerritThierry Carrez proposed openstack-infra/project-config: Standard stable ACLs for new managed projects  https://review.openstack.org/22665809:01
openstackgerritThierry Carrez proposed openstack-infra/project-config: Pre-release stable/liberty ACLs  https://review.openstack.org/22665909:01
ttxfungi: I realized we forgot to set up the stable/liberty pre-release-specific ACLs and we already cut some of those branches, so this is a bit urgent: ^09:01
*** kiranr has quit IRC09:02
openstackgerritThierry Carrez proposed openstack-infra/project-config: Standard release/stable ACLs for new managed projects  https://review.openstack.org/22665809:02
*** hashar has quit IRC09:03
openstackgerritThierry Carrez proposed openstack-infra/project-config: Pre-release stable/liberty ACLs  https://review.openstack.org/22665909:04
*** hashar has joined #openstack-infra09:04
*** BharatK has quit IRC09:06
openstackgerritMateusz Matuszkowiak proposed openstack-infra/project-config: Added new Openstack repository for PureStorage Cinder Fuel plugin  https://review.openstack.org/22666209:07
*** jerrygb has joined #openstack-infra09:08
*** dims_ has joined #openstack-infra09:11
*** jerrygb has quit IRC09:13
*** rossella_s has quit IRC09:14
*** devvesa has joined #openstack-infra09:14
*** MarkAtwood has joined #openstack-infra09:15
*** kiranr has joined #openstack-infra09:15
*** moravec has joined #openstack-infra09:15
*** e0ne has joined #openstack-infra09:15
*** mrmartin has quit IRC09:17
*** fhubik is now known as fhubik_brb09:18
*** moravec has quit IRC09:20
*** MarkAtwood has quit IRC09:20
*** BharatK has joined #openstack-infra09:20
ianwderekh: someone else will probably wake up soon to approve it :)09:20
*** cdent has joined #openstack-infra09:20
derekhianw: thanks09:21
openstackgerritIan Wienand proposed openstack-infra/nodepool: Add dib success or failues to statsd  https://review.openstack.org/22648109:22
*** gildub has quit IRC09:24
*** otter768 has joined #openstack-infra09:24
*** stevemar has joined #openstack-infra09:25
*** sergmelikyan has joined #openstack-infra09:25
*** nadya has joined #openstack-infra09:27
*** stevemar has quit IRC09:28
*** otter768 has quit IRC09:28
*** fhubik_brb is now known as fhubik09:29
*** rossella_s has joined #openstack-infra09:29
*** sergmelikyan has quit IRC09:30
*** ddieterly has joined #openstack-infra09:31
*** alexpilotti has joined #openstack-infra09:32
openstackgerritMerged openstack-infra/project-config: Alter horizon.yaml to get screenshots copied.  https://review.openstack.org/22636409:33
*** ddieterly has quit IRC09:36
*** ociuhandu has quit IRC09:36
*** mrmartin has joined #openstack-infra09:39
*** fhubik is now known as fhubik_brb09:39
*** Daisy has quit IRC09:39
*** Daisy has joined #openstack-infra09:40
*** shardy_ has joined #openstack-infra09:41
*** shardy has quit IRC09:41
*** Daisy has quit IRC09:44
*** Daisy has joined #openstack-infra09:44
*** dims_ has quit IRC09:44
*** jyuso1 has quit IRC09:45
*** shardy_ has quit IRC09:46
*** shardy has joined #openstack-infra09:46
*** e0ne has quit IRC09:49
openstackgerritThierry Carrez proposed openstack-infra/project-config: Pre-release stable/liberty ACLs  https://review.openstack.org/22665909:49
*** e0ne has joined #openstack-infra09:50
*** Sree has quit IRC09:52
*** Hal has quit IRC09:55
*** fhubik_brb is now known as fhubik09:57
*** nilasae has joined #openstack-infra09:57
*** claudiub has joined #openstack-infra10:00
*** Daisy has quit IRC10:01
*** lawrancejing has joined #openstack-infra10:01
*** Kennan_Vacation has quit IRC10:01
*** Daisy has joined #openstack-infra10:02
*** Kennan_Vacation has joined #openstack-infra10:02
*** BharatK has quit IRC10:04
*** Daisy has quit IRC10:05
*** Daisy has joined #openstack-infra10:05
*** lawrancejing has quit IRC10:06
*** fhubik is now known as fhubik_brb10:07
*** lawrancejing has joined #openstack-infra10:07
*** lawrancejing has quit IRC10:07
*** pc_m has joined #openstack-infra10:09
*** dims_ has joined #openstack-infra10:09
*** kiran-r has quit IRC10:10
*** markvoelker has joined #openstack-infra10:17
*** BharatK has joined #openstack-infra10:17
*** mrmartin has quit IRC10:18
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/22618210:18
*** trown|outttypeww is now known as trown10:19
*** mrmartin has joined #openstack-infra10:20
*** weshay has quit IRC10:20
*** markvoelker has quit IRC10:21
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: Update python-novaclient for new release 2.30.0  https://review.openstack.org/22599310:23
*** Daisy has quit IRC10:25
*** Daisy has joined #openstack-infra10:26
*** ociuhandu has joined #openstack-infra10:29
*** Daisy has quit IRC10:30
*** Daisy has joined #openstack-infra10:30
*** Daisy has quit IRC10:31
*** ddieterly has joined #openstack-infra10:32
*** Daisy has joined #openstack-infra10:32
*** trown is now known as trown|relocating10:34
*** ddieterly has quit IRC10:36
*** Daisy has quit IRC10:36
*** mrmartin has quit IRC10:42
*** mrmartin has joined #openstack-infra10:43
*** zns has joined #openstack-infra10:49
*** zns has quit IRC10:52
*** zns has joined #openstack-infra10:52
*** kiran-r has joined #openstack-infra10:53
*** mrunge has joined #openstack-infra10:54
*** notnownikki has quit IRC10:55
*** notnownikki has joined #openstack-infra10:58
*** kushal has joined #openstack-infra11:02
*** MarkAtwood has joined #openstack-infra11:03
*** nadya has quit IRC11:04
*** Daisy has joined #openstack-infra11:06
*** fhubik_brb is now known as fhubik11:06
*** MarkAtwood has quit IRC11:08
robcresswellHi there, sorry if this is the wrong place to ask. We have a rather important requirements change sitting in g-r at the moment: https://review.openstack.org/#/c/225255/11:08
*** doug-fish has joined #openstack-infra11:11
*** kushal has quit IRC11:11
*** salv-orlando has quit IRC11:12
*** salv-orlando has joined #openstack-infra11:13
*** Daisy has quit IRC11:14
*** Daisy has joined #openstack-infra11:15
*** Daisy has quit IRC11:17
*** markvoelker has joined #openstack-infra11:17
*** Daisy has joined #openstack-infra11:19
*** kushal has joined #openstack-infra11:21
*** mrmartin has quit IRC11:21
*** markvoelker has quit IRC11:22
*** baoli has joined #openstack-infra11:23
*** moravec has joined #openstack-infra11:24
*** otter768 has joined #openstack-infra11:25
*** otter768 has quit IRC11:29
openstackgerritsvasheka proposed openstack-infra/project-config: Last change made all job runs end with success. We need to save exit status in order to mark failed jobs.  https://review.openstack.org/22670611:32
*** Sree has joined #openstack-infra11:32
*** ddieterly has joined #openstack-infra11:32
openstackgerritsvasheka proposed openstack-infra/project-config: Last change made all job runs end with success.   https://review.openstack.org/22670611:32
*** baoli_ has joined #openstack-infra11:33
*** bharathm has joined #openstack-infra11:33
*** jerrygb has joined #openstack-infra11:35
*** baoli has quit IRC11:36
*** weshay_xchat has joined #openstack-infra11:36
*** weshay_xchat is now known as weshay11:36
*** ddieterly has quit IRC11:37
*** hashar has quit IRC11:37
*** gordc has joined #openstack-infra11:37
*** mwagner_lap has quit IRC11:37
*** bharathm has quit IRC11:38
*** Daisy has quit IRC11:39
*** jerrygb has quit IRC11:39
TheJuliaHi, change 225636 landed yesterday changing the release group for bifrost to bifrost-release.  Any chance someone can add me to the group?11:39
*** kashyap has left #openstack-infra11:39
openstackgerritsvasheka proposed openstack-infra/project-config: Last change made all job runs end with success.  https://review.openstack.org/22670611:42
*** michchap_ has quit IRC11:43
*** ddieterly has joined #openstack-infra11:44
*** michchap has joined #openstack-infra11:45
*** k4n0 has quit IRC11:46
openstackgerritThierry Carrez proposed openstack-infra/project-config: Pre-release stable/liberty ACLs  https://review.openstack.org/22665911:48
*** jerrygb has joined #openstack-infra11:48
*** Daisy has joined #openstack-infra11:49
*** Daisy has quit IRC11:51
*** ParsectiX has joined #openstack-infra11:51
*** zns has quit IRC11:54
*** dprince has joined #openstack-infra11:55
*** thorst has joined #openstack-infra11:58
*** nadya has joined #openstack-infra11:58
*** zns has joined #openstack-infra11:59
*** krtaylor has quit IRC12:01
*** sergmelikyan has joined #openstack-infra12:02
*** Daisy has joined #openstack-infra12:02
openstackgerritMerged openstack/requirements: Bump os-client-config upper-constraint to 1.7.5  https://review.openstack.org/22536312:03
*** achanda has joined #openstack-infra12:03
*** Hal has joined #openstack-infra12:03
*** fhubik has quit IRC12:04
*** fhubik has joined #openstack-infra12:06
openstackgerritZhao Lei proposed openstack/diskimage-builder: Remove quotes from subshell call in bash script  https://review.openstack.org/22672012:08
*** mrmartin has joined #openstack-infra12:09
*** kiran-r has quit IRC12:10
*** trown|relocating is now known as trown12:12
*** Zhongjun has joined #openstack-infra12:12
openstackgerritZhao Lei proposed openstack/requirements: Remove quotes from subshell call in bash script  https://review.openstack.org/22672812:13
*** krtaylor has joined #openstack-infra12:13
*** e0ne has quit IRC12:13
openstackgerritZhao Lei proposed openstack/requirements: Fix a little spelling typo in README and error message  https://review.openstack.org/22672912:14
*** aysyd has joined #openstack-infra12:15
*** deepakcs has quit IRC12:15
*** achanda has quit IRC12:18
*** ParsectiX has quit IRC12:19
*** Sree has quit IRC12:20
*** markvoelker has joined #openstack-infra12:20
*** fawadkhaliq has quit IRC12:21
*** kiranr has quit IRC12:22
*** fawadkhaliq has joined #openstack-infra12:22
*** mwagner_lap has joined #openstack-infra12:23
*** zhenguo has quit IRC12:24
ttxgordc: around ?12:27
gordcttx: yes, didn't want to interrupt your discussion in relmgr-office12:28
ttxoops wrong channel12:29
*** Sree has joined #openstack-infra12:29
*** hashar has joined #openstack-infra12:31
*** dramalho has joined #openstack-infra12:32
*** bswartz has quit IRC12:32
*** edmondsw has joined #openstack-infra12:32
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API  https://review.openstack.org/22196412:34
*** ParsectiX has joined #openstack-infra12:36
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for server tasks  https://review.openstack.org/22675112:36
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for floating ips  https://review.openstack.org/22675212:36
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Remove floating ip code  https://review.openstack.org/22675312:36
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for keypairs  https://review.openstack.org/22675412:36
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for flavors  https://review.openstack.org/22675512:36
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for images  https://review.openstack.org/22675612:36
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for networks  https://review.openstack.org/22675712:36
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Just let shade and os-client-config handle clouds  https://review.openstack.org/22675812:36
mordredjeblair: ^^ COMPLETELY untested - I wrote all that offline with no access to internet to pull testing stuff12:37
mordredjeblair: but there's the first draft12:37
*** thorst has left #openstack-infra12:38
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API  https://review.openstack.org/22196412:38
StevenKmordred: -1 for no "Use shade for all the things" :-P12:38
mordredStevenK: hehe12:38
*** maiteb has joined #openstack-infra12:40
openstackgerritSergey Reshetnyak proposed openstack-infra/project-config: Install sahara for dsvm saharaclient job  https://review.openstack.org/22676212:41
dhellmannjeblair, fungi, clarkb : I don't have permission to add someone to the release-tools group. I thought groups were self-serve by default? Is that a separate ACL I need to enable? https://review.openstack.org/#/admin/groups/249,members12:43
*** smarcet has joined #openstack-infra12:43
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci: Turn introspection back on  https://review.openstack.org/22593412:44
openstackgerritSergey Reshetnyak proposed openstack-infra/project-config: Install sahara for dsvm saharaclient job  https://review.openstack.org/22676212:45
*** shardy_ has joined #openstack-infra12:45
*** Daisy has quit IRC12:46
mordreddhellmann: that group is owned by infra-ptl12:47
*** shardy has quit IRC12:47
mordreddhellmann: I do not know if that is on purpose or by accident, so I'd like to wait for fungi to awaken before taking remediating action12:47
dhellmannmordred: ah! it's probably on purpose, since it's for a repo under openstack-infra12:48
*** Sree has quit IRC12:49
svashekamordred, fungi , guys sorry for pinging you again about this, but last putch made all jobs being green even if there was errors https://review.openstack.org/#/c/226706/3 new patch :)12:49
*** Sree has joined #openstack-infra12:49
dhellmannfungi: if you'd like to retain ownership of the release-tools-core team, please add dims_. If you're ok changing ownership, it would make sense to move that to the release manager in some way. I don't know if we have a good group for that. Maybe "Release Managers"?12:50
*** shardy_ has quit IRC12:51
*** shardy has joined #openstack-infra12:51
*** MarkAtwood has joined #openstack-infra12:52
openstackgerritSergey Reshetnyak proposed openstack-infra/project-config: Install sahara for dsvm saharaclient job  https://review.openstack.org/22676212:53
openstackgerritDoug Hellmann proposed openstack/requirements: Update os-brick for new release 0.5.0  https://review.openstack.org/22651412:54
*** amuller has joined #openstack-infra12:55
openstackgerritDoug Hellmann proposed openstack/requirements: Update python-novaclient for new release 2.30.0  https://review.openstack.org/22599312:56
*** MarkAtwood has quit IRC12:57
*** bswartz has joined #openstack-infra12:57
openstackgerritMerged openstack-infra/release-tools: add a tool to compare the constraints file with existing releases  https://review.openstack.org/22523012:59
openstackgerritMerged openstack-infra/release-tools: Report all unreleased library changes  https://review.openstack.org/19122012:59
*** lawrancejing has joined #openstack-infra12:59
*** thorst1 has joined #openstack-infra13:00
openstackgerritMerged openstack-infra/release-tools: add a consistent topic to all .gitreview updates  https://review.openstack.org/22601713:00
openstackgerritMerged openstack-infra/release-tools: remove duplicate function title  https://review.openstack.org/22601813:00
openstackgerritMerged openstack-infra/release-tools: provide a better error message when a team is not found  https://review.openstack.org/22605113:00
openstackgerritMerged openstack-infra/release-tools: change Oslo to oslo  https://review.openstack.org/22605213:01
*** kiran-r has joined #openstack-infra13:01
openstackgerritMerged openstack-infra/release-tools: handle unicode characters in commit messages  https://review.openstack.org/22651813:01
*** flepied has quit IRC13:01
openstackgerritMerged openstack-infra/release-tools: show the command used to build the release notes  https://review.openstack.org/22651913:01
*** flepied has joined #openstack-infra13:02
*** mrmartin has quit IRC13:06
*** kgiusti has joined #openstack-infra13:06
zigoHow come, in global-reqs.txt we have pbr >= 1.6, but the setup.py has 1.8 ?!?13:07
zigoThis propagated to keystone.13:07
zigoShould I do a new CR to fix global-reqs?13:07
*** salv-orlando has quit IRC13:07
zigolifeless mordred Your thoughts? ^13:08
*** ddieterly has quit IRC13:08
mordredzigo: I do not know - but yes, I think if setup.py is saying 1.8, then global-reqs should too13:09
*** julim has joined #openstack-infra13:11
*** tlian has joined #openstack-infra13:11
*** moravec has quit IRC13:15
openstackgerritThomas Goirand proposed openstack/requirements: Bump pbr to 1.8  https://review.openstack.org/22677413:15
*** moravec has joined #openstack-infra13:16
*** thiagop has joined #openstack-infra13:16
openstackgerritDoug Hellmann proposed openstack-infra/project-config: Remove pypy jobs from the requirements repository  https://review.openstack.org/22677513:17
*** tiswanso has joined #openstack-infra13:18
*** jsavak has joined #openstack-infra13:18
*** bdemers has joined #openstack-infra13:18
*** mrmartin has joined #openstack-infra13:20
*** regXboi has joined #openstack-infra13:20
*** dims_ has quit IRC13:21
*** dims_ has joined #openstack-infra13:21
*** alexpilotti has quit IRC13:22
*** jsavak has quit IRC13:23
*** jsavak has joined #openstack-infra13:23
*** burgerk has joined #openstack-infra13:24
*** otter768 has joined #openstack-infra13:25
*** stevemar has joined #openstack-infra13:26
*** olaph has quit IRC13:28
*** pradk has joined #openstack-infra13:28
*** stevemar has quit IRC13:29
*** ildikov has quit IRC13:30
*** otter768 has quit IRC13:30
clarkbStevenK ots explocitly the version zanata demands...13:31
clarkbwe have to rename the veraion because zanata does not accept /sI dont understand what is distasteful about being explicit about that13:32
clarkboh I need to reenable the slave13:32
*** amuller_ has joined #openstack-infra13:33
openstackgerritMerged openstack-infra/puppet-ansible: Add acceptance tests for puppet-ansible.  https://review.openstack.org/22608013:33
*** amuller has quit IRC13:34
*** ddieterly has joined #openstack-infra13:35
clarkbproposal slave is online13:35
*** bradjones has quit IRC13:35
*** ddieterly has quit IRC13:35
*** jaypipes has joined #openstack-infra13:36
*** amuller_ has quit IRC13:36
*** amuller__ has joined #openstack-infra13:36
*** ddieterly has joined #openstack-infra13:36
clarkbAJaeger StevenK you cannot restrict post jobs to specific branches13:36
clarkbthis is why the old code exit 0'd when not on master13:37
*** Sree has quit IRC13:39
*** xyang1 has joined #openstack-infra13:39
StevenKclarkb: I'm not against the script running, I'm against it failing. Once juno and kilo are dead we can remove it, but until then exit 0 if it's them.13:40
clarkbthere is no way around that us my point13:40
clarkbthe script has to run on ever commit merge if in post13:40
*** maiteb has quit IRC13:40
StevenKcase ZUUL_REFNAME in stable/juno|stable/kilo) exit 0 ;; esac ?13:41
clarkband it will fail on liberty for projects that dont have liberty versions in zanata13:41
clarkbthats not sufficient due to ^13:41
*** olaph has joined #openstack-infra13:41
clarkbwe could probably ask zanata first for the list of versions and bail early if version dne13:42
clarkbbut I am not familiar with its api13:42
StevenKThat's doable13:42
*** amitgandhinz has joined #openstack-infra13:42
*** mrmartin has quit IRC13:43
frickleranyone willing and able to give https://review.openstack.org/190526 the final push before it collects too much dust? ;) has a couple of +1s and +2s for some time now13:43
StevenKclarkb: I can write a script for that tomorrow very easily -- exit 1 if the version doesn't exist, so if ! <script> ; exit 0 ; fi13:43
clarkbStevenK and for distasteful varnames we literally do that substitution because of zanata13:45
clarkbotherwise we wpuld just use refname evwrywhere so I dont understand what is distasteful13:45
StevenKclarkb: $VERSION just seems nicer to my eyes, but it's not a -113:46
*** mpaolino has joined #openstack-infra13:46
*** dramalho has quit IRC13:47
fungiokay, sorry... here and catching up with highlights in scrollback now. i'll attempt to address them in chronological order13:48
*** AJaeger has joined #openstack-infra13:50
*** wenlock has joined #openstack-infra13:50
*** e0ne has joined #openstack-infra13:51
*** alivigni has joined #openstack-infra13:51
AJaegerStevenK, clarkb : I suggest you take over clarkb's change and update it as you suggest. clarkb ,ok?13:51
AJaegerclarkb: I always forget about the post job - thanks13:51
clarkbno, I can look into it13:51
*** BharatK has quit IRC13:52
StevenKclarkb, AJaeger: I have the barebones of a script written, I will finish it and test it tomorrow13:52
*** wenlock has quit IRC13:52
clarkbI think you may be able to just zanata-cli --dry-run put-version13:52
*** wenlock has joined #openstack-infra13:53
clarkbor get-version? its not well documented and I dont have the tool.in front of me13:53
*** wenlock_ has joined #openstack-infra13:53
fungittx: dhellmann: i've reviewed and approved 226659 for the temporary liberty release management acl additions13:54
StevenKI don't either, my pretend proposal slave is off and it's 235413:54
dhellmannfungi: ty13:55
*** stevemar has joined #openstack-infra13:55
fungidhellmann: mordred: with the infra council reorg, all the openstack-infra project core subgroups are under the control of the infra-ptl group because they serve as formal delegations within infra. i'm happy to make whatever member additions you deem necessary to that group, just let me know who you want in it13:56
ttxfungi: thx!13:56
dhellmannfungi: ok, please add dims_ to the release-tools-core group13:56
fungidhellmann: i've added dims_ to the release-tools-core group now13:57
ttxfungi: we'll need https://review.openstack.org/#/c/226658 too, the acl change depends on it13:57
dhellmannfungi: thanks!13:57
ttxfungi: I separated them so that it's easier to revert13:57
clarkbmriedem shouldnt scheduler filters be easy to unittest?13:59
clarkbmriedem provide input host data, run filter, check output14:00
mriedemclarkb: i'm sure it's unit tested14:00
mriedemit's definitely not integration tested14:00
fungittx: ahh, oops, i missed there was a parent change, thanks. reviewing now14:01
mriedemin the case of TrustedFilter you'd have to completely mock out the backend external service14:01
*** ParsectiX has quit IRC14:01
*** jsavak has quit IRC14:02
AJaegerclarkb: /tmp/zanata-cli-3.7.4/bin/zanata-cli list-remote --project-version TEST is one way to test...14:02
openstackgerritMerged openstack-infra/project-config: Last change made all job runs end with success.  https://review.openstack.org/22670614:03
*** jerrygb has quit IRC14:03
*** afaranha has quit IRC14:03
AJaegerclarkb: that looks like the cheapest call...14:03
clarkbAJaeger thanks will look into using that to succeed early if version dne14:03
*** hashar_ has joined #openstack-infra14:04
openstackgerritSergey Reshetnyak proposed openstack-infra/project-config: Fix saharaclient gate  https://review.openstack.org/22676214:04
AJaegerclarkb: thanks.14:05
StevenKThat may involve shifting setup_project first so the zanata.xml exists14:05
*** amitgandhinz has quit IRC14:05
StevenKBut, something about bed.14:05
*** amitgandhinz has joined #openstack-infra14:06
*** hashar has quit IRC14:06
AJaegerStevenK: yes, that needs to be called before.14:06
AJaegerAnd that makes it ugly the way we handle manuals currently, we might need to refactor the manual part.14:07
*** jerrygb has joined #openstack-infra14:07
openstackgerritMerged openstack-infra/project-config: Standard release/stable ACLs for new managed projects  https://review.openstack.org/22665814:08
clarkbits not too bad, we can just exit success late14:08
clarkbthe script may take a few extra seconds but shouldnt be bad14:08
clarkbeg before the push14:08
AJaegeryeah, let's get it in working and optimize later if needed...14:09
openstackgerritMerged openstack-infra/project-config: Pre-release stable/liberty ACLs  https://review.openstack.org/22665914:09
openstackgerritBen Nemec proposed openstack/diskimage-builder: Update rhel7 element readme  https://review.openstack.org/22235114:09
yolandafungi, clarkb, i created a change to move to infra-root https://review.openstack.org/#/c/226643/14:10
openstackgerritmatthew wagoner proposed openstack-infra/gitdm: Update group membership for mordred  https://review.openstack.org/22680814:11
TheJuliaAnyone with magical gerrit powers, change 225636 landed yesterday to changing the release group for bifrost to bifrost-release.  Any chance someone can add me to the bifrost-release group?14:12
*** mtanino has joined #openstack-infra14:13
funginibalizer: yolanda: i've -1'd your infra root additions, requesting that you update the commit messages acknowledging http://docs.openstack.org/infra/system-config/sysadmin.html#ssh-access for the record14:14
yolandaok14:14
*** fawadkhaliq has quit IRC14:15
*** zns has quit IRC14:16
openstackgerrityolanda.robla proposed openstack-infra/system-config: Add yolanda to infra root  https://review.openstack.org/22664314:16
fungiTheJulia: for the sake of continuity, i've added devananda as the initial member of bifrost-release, so you should ask him to make whatever updates you need now14:17
TheJuliafungi: Merci14:17
*** AJaeger has quit IRC14:18
openstackgerritMoises Trovó proposed openstack-infra/puppet-log_processor: Create auto forwardable parameters  https://review.openstack.org/22236914:19
openstackgerritMoises Trovó proposed openstack-infra/puppet-log_processor: Make the subunit-files config section optional  https://review.openstack.org/19966614:19
yolandafungi, clarkb , as i'm doing upstream/downstream work, do you think it's worth generating a new key for upstream infra?14:22
*** Sree has joined #openstack-infra14:23
fungiyolanda: use your best judgement, but i do use a separate key specifically for openstack work14:23
yolandamakes sense14:23
yolandaso let me generate one and amend the change14:23
fungii also have some shell aliases i use so that i can explicitly separate any remote ssh/scp operations for openstack servers from other connections, by using different command names that pass the corresponding identity option to ssh. convenient for me but might be overkill for some14:24
fungithat way if i type ssh review.openstack.org it won't work, but ossh review.openstack.org will14:25
clarkbI have recently been trying to better consolidate my keys, makes for simpler rotations. So I have work, phone, else14:25
*** burgerk has quit IRC14:26
fungii also overload those o* aliases to set the search domain to openstack.org so i can just type ossh review14:26
*** eharney has joined #openstack-infra14:26
yolandamakes sense in terms of isolation, and to prevent accidents14:26
*** asselin_ has joined #openstack-infra14:27
*** peristeri has quit IRC14:27
fungii've found it convenient since i spend a lot of time hopping in and out of shells on the servers to troubleshoot some obscure problem, look at sensitive logs, et cetera14:27
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/22681614:28
*** zz_dimtruck is now known as dimtruck14:28
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Also use EPEL mirror for overcloud image builds  https://review.openstack.org/22681814:28
*** tonytan4ever has joined #openstack-infra14:28
yolandais there some case where you need ssh key forwarding? it's normal downstream , for git, for example, but in upstream everything is opened14:29
openstackgerrityolanda.robla proposed openstack-infra/system-config: Add yolanda to infra root  https://review.openstack.org/22664314:30
yolandaok, new key added14:30
clarkbnot typically no.14:30
yolandadoh, i amended commit change on the ui, so i lost it, just a sec :(14:30
openstackgerrityolanda.robla proposed openstack-infra/system-config: Add yolanda to infra root  https://review.openstack.org/22664314:31
yolandaok done14:31
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Also use EPEL mirror for overcloud image builds  https://review.openstack.org/22681814:32
*** sergmelikyan has quit IRC14:33
*** sergmelikyan has joined #openstack-infra14:33
*** adduarte has quit IRC14:34
*** duartea has joined #openstack-infra14:34
*** dprince has quit IRC14:35
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Simplify .gitignore  https://review.openstack.org/22486414:37
*** ildikov has joined #openstack-infra14:37
*** cburroughs has joined #openstack-infra14:38
*** geoffarnold has joined #openstack-infra14:38
pabelangerfungi: thanks for the tip the other day about git rebase -i with edit.  Works perfectly! ^14:38
*** sergmelikyan has quit IRC14:38
fungipabelanger: it is a swiss army knife of awesome14:38
pabelangerfungi: indeed14:39
*** hodos has joined #openstack-infra14:39
*** kiran-r has quit IRC14:39
fungionce you get used to using rebase -i you sort of gain an innate understanding of the underlying representation for commit histories in git14:39
*** MarkAtwood has joined #openstack-infra14:40
pabelangerYa, I thought I had some basic understanding, but learned something new. Will have to break out ProGit again and re-read the chapter14:40
*** salv-orlando has joined #openstack-infra14:40
*** stevemar has quit IRC14:40
*** zns has joined #openstack-infra14:41
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: [WIP] Add validate command  https://review.openstack.org/22655414:42
*** r-daneel has joined #openstack-infra14:43
*** aarefiev has quit IRC14:43
*** MarkAtwood has quit IRC14:44
*** salv-orlando has quit IRC14:45
*** stevemar has joined #openstack-infra14:46
*** aarefiev has joined #openstack-infra14:49
*** kiranr has joined #openstack-infra14:50
EmilienMnibalizer, crinkle: I try to do that in our modules https://review.openstack.org/#/c/226830/ - you might be interested for infra modules too14:50
*** dramalho has joined #openstack-infra14:51
*** smarcet has quit IRC14:53
openstackgerritMichael Krotscheck proposed openstack-infra/project-config: Updated npm-run macro to support npm 1.x  https://review.openstack.org/22659614:55
*** claudiub has quit IRC14:56
*** Sree has quit IRC14:56
*** kiran-r has joined #openstack-infra14:56
*** Sree has joined #openstack-infra14:56
*** lawrancejing has quit IRC14:57
*** scheuran has quit IRC14:58
*** kiran-r has quit IRC14:58
*** Daisy has joined #openstack-infra14:58
*** iraw_ has joined #openstack-infra15:01
*** Sree has quit IRC15:01
*** pc_m is now known as pc_m_AWAY15:02
*** Daisy has quit IRC15:02
*** iraw_ has quit IRC15:02
*** cburroughs has quit IRC15:04
*** Daisy has joined #openstack-infra15:04
*** Piet has quit IRC15:06
thiagopfungi: Hi! Can you take a look on our patch to create the release group on python-oneviewclient? https://review.openstack.org/#/c/225917/15:06
*** cburroughs has joined #openstack-infra15:06
thiagopfungi: s/can/would you mind/15:06
*** arxcruz has quit IRC15:07
*** pblaho has quit IRC15:07
timrcRunning into an interesting phenomenon with zuul windows.  We manage a pool of cloud nodes via nodepool and a pool of bare metal nodes via jenkins (e.g. they're all long lived).  Some changes run a battery of tests that will require a mix of these two node forms.  If gate resets occur because of a test failure on a bare metal node it'll decrease the window.  If the gate is loaded with these changes, we can basically find ourselves in a situation15:07
timrcwhere nodepool is sitting there idle even though it could be running the tests for these changes which require its node types.15:07
*** pblaho has joined #openstack-infra15:07
*** arxcruz has joined #openstack-infra15:07
*** Daisy has quit IRC15:09
*** ZZelle has quit IRC15:09
*** Daisy has joined #openstack-infra15:10
*** ZZelle has joined #openstack-infra15:10
*** hashar has joined #openstack-infra15:10
fungitimrc: it sounds like you may simply want to disable windowing if your nodes are not entirely elastic (or perhaps increase the window floor to a suitable high value)15:10
*** fedexo has joined #openstack-infra15:10
*** claudiub has joined #openstack-infra15:10
*** Daisy has quit IRC15:11
*** Daisy has joined #openstack-infra15:11
*** cburroughs has quit IRC15:11
fungitimrc: we implemented that windowing behavior to mitigate hysteresis conditions where a gate reset would dump and rebuild 100% of our node quota in one shot under periods of high load15:11
*** burgerk has joined #openstack-infra15:11
timrcIt seems like those valuables should be tunable from the cli?15:12
fungiand which was preventing any lower-priority queues from being serviced15:12
fungitimrc: i believe you should be able to adjust them on the fly in the config15:12
fungitimrc: http://docs.openstack.org/infra/zuul/zuul.html#pipelines has the details15:13
timrcYeah I suppose that's the safest an easiest approach... just a change to the config from puppet and then revert it when things return to normal.15:13
*** hashar_ has quit IRC15:13
*** yamahata has joined #openstack-infra15:13
*** vmbrasseur has left #openstack-infra15:13
yolandafungi, these window values should be applied just when zuul reloads the config? no zuul reboot needed?15:14
fungiyolanda: i believe we've adjusted them on the fly in the past without a restart15:14
fungithough it's possible they wouldn't immediately become apparent until a pipeline is recalculated due to addition or removal of a changeish15:15
fungiwe've done it so infrequently i don't recall15:15
*** vmb_work_AWAY is now known as vmb15:16
*** dramalho has quit IRC15:16
clarkbyes zuul layout should always be live loadable15:16
clarkbnegative value disables or is it 0 should be documented15:17
*** amotoki has quit IRC15:17
yolandawe did some change to shrink the zuul window in the past, but it wasn't reflected at the moment, as fungi said15:17
clarkbits reflected after the next window resize15:18
clarkbit wont stop running jobs to shrink it for example since that cost is already sunk15:18
fungiheh... http://teespring.com/99bugs?pr=10off99bug15:18
*** sabeen has joined #openstack-infra15:19
timrcclarkb, Makes sense.15:20
fungii've actually seen it recalculate and shrink the window past changes with running jobs, though as clarkb says the jobs do keep running and report normally15:20
*** amotoki has joined #openstack-infra15:20
*** vmb is now known as vmbrasseur15:20
*** dolpher has joined #openstack-infra15:21
openstackgerritJu Lim proposed openstack-infra/irc-meetings: Adding a meeting for OpenStack-UX WG with new day and time  https://review.openstack.org/22021115:21
fungiso the changes show a grey dot because of being outside the window, but have non-pending job states15:21
*** sabeen2 has joined #openstack-infra15:21
*** ajo has quit IRC15:21
*** woodster_ has joined #openstack-infra15:21
*** salv-orlando has joined #openstack-infra15:22
*** salv-orlando has quit IRC15:22
timrcWould maybe be nice to be able to promote changes to the bottom of a window... we can already promote to the top, which is great, but that seems like an easy marker to use to promote something so it runs sooner than later.15:23
*** flepied has quit IRC15:23
*** salv-orlando has joined #openstack-infra15:23
fungiinteresting idea... increase priority of the change but not enough to waste currently running jobs15:23
*** arxcruz has quit IRC15:24
*** tsekiyama has joined #openstack-infra15:24
*** mrmartin has joined #openstack-infra15:24
*** doug-fish has quit IRC15:24
*** sabeen has quit IRC15:24
fungiin our case it seems like a bit of a premature optimization though. we don't promote changes very often, and when we do we almost always want them to be the next thing to merge and consider any previously running jobs as an acceptable loss15:25
clarkb(because they will likely fail without the promoted change )15:26
*** otter768 has joined #openstack-infra15:26
*** tonytan4ever has quit IRC15:26
*** jhesketh has quit IRC15:26
*** sridhar_ram has joined #openstack-infra15:27
*** vlaza1 has joined #openstack-infra15:27
timrcfungi, Right and that's generally be how we use promotion too.15:27
timrcSometimes I accept bribes, too.15:27
fungihttps://i.imgflip.com/rhktm.jpg15:27
*** jhesketh has joined #openstack-infra15:27
*** step6829 has joined #openstack-infra15:28
yolandafungi, clarkb, and is that normal for you to have long gate queues, with several projects chained together? or do you prefer to isolate jobs, to avoid these queues?15:28
fungiyolanda: both15:28
*** tonytan4ever has joined #openstack-infra15:28
fungiit is normal for us to have long queues when things are busy, and we have a lot of interdependent projects sharing one particularly large queue, but we try to keep that as minimized as we reasonably can15:29
timrcYes we have change queues with jobs that take hours to run.  It's pretty awesome for deadlines.15:29
jheskethMorning15:29
timrcEspecially when one fails and causes a gate reset :)15:29
yolandaevery project is just chained together with a whole long queue :)15:29
*** claudiub has quit IRC15:30
fungiyep, that can get really problematic, which is why we struggle to keep it under control15:30
*** bpokorny has joined #openstack-infra15:30
*** vlaza has quit IRC15:31
*** otter768 has quit IRC15:31
clarkbjhesketh did you see my note about how new coverage release exposed a flaw in our html pass through logic for os-loganalyze?15:31
clarkbit has several blank lines before the html tag15:31
jheskethclarkb: oh I missed that15:32
fungineat15:32
jheskethclarkb: was the note in scrollback or on a patch/elsewhere?15:32
fungii missed that too15:32
yolandafungi, clarkb, also a problem that we are having , that i guess upstream doesn't have quite often , is branches. calculations for gate dependencies are not based on branches15:32
fungiyolanda: yeah, that was an intentional design decision because we want to test upgrades between branches15:33
timrcYeah....15:33
clarkbjhesketh scrollback15:33
yolandaso if several branches add a set of tests, and another branch has another, it's just chaining unrelated changes together, making the queue longer even if possible15:33
clarkbjhesketh I am wondering if we just need a rule to passthrough untouched15:33
clarkbjhesketh or maybe we fix hrml detection or both. I caught it late yesterday so havent really debugged15:34
*** Piet has joined #openstack-infra15:34
clarkbyolanda ya as fungi states thats required for upgrade testing with our branch model15:34
fungiyolanda: timrc: it may be possible with some minimal work to make zuul branch dependencies configurable on a per-pipeline basis, but i haven't looked closely at the code to get a good feeling for what would be involved to make it happen15:34
timrcWe could maybe have a gate pipeline per customer because really, in our case, branches = customers.15:35
*** puranamr has joined #openstack-infra15:35
timrc(internal customers, people building products, etc)15:36
*** matrohon has quit IRC15:36
clarkbtimrc: yes I know, despite my efforts :P15:36
timrcIt'd be awesome if we just all worked on the same branches and had an integrated product portfolio but that's wayyyy above my paygrade.15:36
clarkbor used forks properly15:36
jeblairtimrc: http://specs.openstack.org/openstack-infra/infra-specs/specs/zuulv3.html#tenants15:36
clarkb(because thats really what you have)15:37
clarkbjeblair: I just approved the shorten timeout on nodepool dsvm change because modreds shade stack timed out all the jobs15:37
clarkbincluding py27 and coverage15:37
jeblairclarkb: ++  (and that's a neat trick)15:37
*** vlaza1 has left #openstack-infra15:38
*** Sukhdev has joined #openstack-infra15:38
*** tonytan4ever has quit IRC15:38
jeblairi'm guessing it needs some low-altitude work15:38
clarkbjeblair: ya not sure how he managed that, the unittests should have timeouts that work15:38
timrcjeblair, Yes that seems like a perfectly reasonable way to manage the insanity :)15:38
jheskethanteaya: replied to https://review.openstack.org/#/c/214207/15:39
yolandajeblair, how is status of zuul v3? can we help somehow, with some tasks that don't need much time and dedication?15:39
jheskethclarkb: passthrough might work15:39
*** hdd has joined #openstack-infra15:40
*** thingee has quit IRC15:40
jeblairyolanda: hasn't started yet; need to land jhesketh's zuul changes first, and then do some planning.15:40
yolandai cannot compromise now with some time consuming dev task, but maybe we could take some small things15:40
yolandacool15:40
openstackgerritMerged openstack/requirements: update designateclient to 1.5.0  https://review.openstack.org/22646515:40
jheskethjeblair: I've began looking at the required nodepool changes, but every time I sit down to do it I get pulled into something else. (so no real progress)15:41
jheskethyolanda: what would be useful is more eyes on https://review.openstack.org/#/q/status:open+project:openstack-infra/zuul+branch:master+topic:connection_tests,n,z15:41
openstackgerritMerged openstack-infra/project-config: Set nodepool dsvm timeout to 1h  https://review.openstack.org/22610515:41
yolandajhesketh, sure15:41
*** amuller__ is now known as amuller15:42
*** ajo has joined #openstack-infra15:43
timrcclarkb, fungi, jeblair Thanks for your insights as always *forages around for food now*15:43
anteayajhesketh: thank you15:46
*** dolpher has quit IRC15:46
*** thingee has joined #openstack-infra15:46
anteayammedvede: thank you15:46
*** e0ne has quit IRC15:47
*** puranamr has quit IRC15:47
*** ajo has quit IRC15:47
openstackgerritJoshua Hesketh proposed openstack-infra/os-loganalyze: Skip whitespace for html view  https://review.openstack.org/22685815:48
jheskethclarkb: ^15:48
*** e0ne has joined #openstack-infra15:48
clarkbjhesketh I also looked at testing the jenkins timwout in nodepool yesterday and got atumped because we already rely on jenkins api raising an exception in the tests to invalidate that target. think I need to refactor nodepool a bit before this is testable15:48
clarkbjhesketh that os-loganaylse change will be lossy if its not html15:49
jheskethclarkb: yeah I considered that... but I also don't know where you'd care about blank lines at the top of your logs15:50
clarkbya it may not matter15:50
*** duartea has quit IRC15:50
*** puranamr has joined #openstack-infra15:50
jheskethclarkb: I'm not sure I have state for your nodepool comment...15:50
*** nadya has quit IRC15:51
*** bharathm has joined #openstack-infra15:51
clarkbjhesketh https://review.openstack.org/#/c/218949/15:51
jheskethah right15:52
jheskeththanks15:52
*** ivar-lazzaro has joined #openstack-infra15:52
*** ivar-lazzaro has quit IRC15:52
*** dramalho has joined #openstack-infra15:52
*** ivar-lazzaro has joined #openstack-infra15:53
*** ajo has joined #openstack-infra15:53
*** sabeen2 has quit IRC15:53
jheskethclarkb: is the timeout exception different?15:53
rbradformordred, are you aware coverage 4.0 is breaking html rendering at l.o.o (e.g. 4.0 -- http://logs.openstack.org/14/208114/4/check/nodepool-coverage/77f9baa/cover, v  3.7.1 http://logs.openstack.org/85/855e6f0485053a7e9dcaae76106adfb61e6d2a4d/post/neutron-coverage/fbef8a7/cover/)15:54
jheskethrbradfor: yes, we're aware :-)15:55
*** Swami has joined #openstack-infra15:55
rbradforjhesketh, thanks!15:55
*** bexelbie has quit IRC15:55
*** bltavares has joined #openstack-infra15:55
*** shardy_ has joined #openstack-infra15:55
*** bexelbie has joined #openstack-infra15:56
*** esker has joined #openstack-infra15:56
*** sdake has joined #openstack-infra15:57
*** shardy has quit IRC15:57
*** bexelbie has quit IRC15:59
*** ayoung has joined #openstack-infra16:00
*** trown is now known as trown|lunch16:00
*** sabeen has joined #openstack-infra16:00
clarkbjhesketh yes its the difference between failed tcp connection and fail to recieve bytes on open connection16:01
*** shardy_ has quit IRC16:01
clarkbjhesketh but nodepooldoesnt distinguish so I need to rework how to test that, likely with a fake/mock16:01
*** shardy has joined #openstack-infra16:02
jheskethright, I see16:02
clarkbits odd that coverage adds two unnecessary bytes to each file16:02
jheskethhmm.. could be complicated to mock it out and keep the right part to test16:02
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Allow creating externally accessible networks  https://review.openstack.org/22686516:02
jheskethclarkb: does seem like a small bug16:03
jeblair"nova image-list" for the openstackjenkins tenant in ovh hangs.... it works for openstackci16:03
jeblairother nova commands work16:03
jeblairthe openstackjenkins tenant has one of our custom images in it16:03
jheskethclarkb: perhaps we point the jenkins api at a non-responsive tcp connection that we set up in the test?16:03
*** dprince has joined #openstack-infra16:04
clarkbjhesketh ya that was another thought I had, open a socket that will only accept the connection16:04
jeblairoh!16:04
clarkbbut you cant distinguish that fail from the other fail16:04
jeblairit's not haning, it's really slow because there are thousands of images in it16:04
*** sdake has quit IRC16:04
jheskethclarkb: you can't?16:05
clarkbjhesketh nope they are all handled in one place16:05
clarkbin nodepool16:05
*** jlanoux has quit IRC16:06
*** esker has quit IRC16:06
* jeblair works on deleting thousands of images16:06
fungiyikes16:06
*** sdake_ has joined #openstack-infra16:06
jheskethclarkb: would mocking that out and checking that the right kind of exception is raised on timeout (as opposed to when the timeout isn't set) be adequate?16:07
jeblair8621 is the count16:07
*** ashleighfarnham has joined #openstack-infra16:07
clarkbjhesketh if we mock it we will know what exception is raised and can check the target is offline so I think that would work16:08
*** jsavak has joined #openstack-infra16:08
jheskethyep16:08
clarkbbut considering we have no testing of jenkins here I am wondering if fix small production issue has just turned into test nodepools jenkins16:09
openstackgerritRafael Folco proposed openstack-infra/project-config: Add gerritbot to #openstack-third-party-ci channel  https://review.openstack.org/22686616:09
clarkbits not a bad thing to do but etime16:10
*** AJaeger has joined #openstack-infra16:10
*** sdake has joined #openstack-infra16:11
anteayais someone able to check gerrit and check the size of the apache logs?16:11
jeblair/dev/xvda1                40G   34G  4.1G  90% /16:11
jeblair5.3G/var/log/apache2/16:12
jeblairanteaya: ^16:12
thiagopHello AJaeger. I removed the branch permission as you said in https://review.openstack.org/#/c/225917/16:12
*** resker has joined #openstack-infra16:12
thiagopAJaeger: please, take a look when you have a slot. Thanks.16:12
jheskethclarkb: sure, I'm happy to be pragmatic here.. if it's too much work, lets not block on what is a reasonably simple patch... however I would have thought it was just one method to mock and a fake socket to set up?16:12
anteayajeblair: thanks, I was hoping it would be less16:13
anteayalike a > 1G16:13
jeblairanteaya: are we switching from weekly to daily?16:13
*** mrmartin has quit IRC16:13
clarkbjhesketh just one method to mock, no socket needed16:13
anteayaI'll look at the patch again16:13
*** jsavak has quit IRC16:13
clarkbjhesketh so this case is simple but really what we need is a fake16:13
asselingreghaynes, has you seens this dib issue recently? http://paste.openstack.org/show/473781/16:13
clarkbthen we can test this and the other jenkins things16:14
anteayajeblair: daily: https://review.openstack.org/#/c/201312/21/manifests/init.pp16:14
jeblairanteaya: but from what?16:14
clarkbthe socket would be opened by the fake16:14
*** devvesa has quit IRC16:14
*** sdake_ has quit IRC16:14
*** doug-fish has joined #openstack-infra16:14
clarkbanyways will try the mock approach16:15
AJaegerthiagop: will do16:15
jeblairanteaya: it _looks_ like it used to be weekly; if so, it will take ~30 weeks to age out existing logs.16:15
thiagopAJaeger: o/16:15
jeblairanteaya: er, ~30 days.16:15
jheskethclarkb: okay :-)16:15
jeblairanteaya: however, we could go ahead and manually delete the log files that are > 4 weeks old now.16:16
anteayajeblair: ah okay16:16
*** resker has quit IRC16:16
anteayacould we?16:16
anteayaand yes I think it used to be weekly, I had weekly in my first patchset: https://review.openstack.org/#/c/201312/1/manifests/init.pp16:16
zaromorning anteaya16:17
anteayamorning zaro16:17
anteayazaro: how goes the testing to check out the gerrit upgrade fitness?16:17
*** amit213 has quit IRC16:17
*** MarkAtwood has joined #openstack-infra16:17
anteayazaro: do we have the hope of a path?16:17
*** amit213 has joined #openstack-infra16:17
*** rossella_s has quit IRC16:19
*** rossella_s has joined #openstack-infra16:19
jeblair1.8G.16:21
anteayajeblair: yay!16:22
jeblair/dev/xvda1                40G   30G  7.5G  81% /16:22
anteayamuch better16:22
anteayathank you16:22
jeblairanteaya: thank you.  we should probably check that in a day or two and make sure it's working right16:22
anteayayup, I will add it to my list of things to ask someone to check for me16:22
anteayaso on the note of gerrit size16:23
anteayawhat do we do if we run out of space16:23
jeblairanteaya: add a cinder volume and move something to it16:23
anteayaand the apache logs are already tidied up16:23
anteayaawesome16:23
anteayashall I start on a spec for that?16:23
anteayaor do we need one?16:23
anteayaor is that already our workflow16:24
jeblairanteaya: i hope it's not necessary... gerrit is already on its own volume: /dev/mapper/main-gerrit   99G   28G   72G  28% /home/gerrit216:24
anteayaand it is just news to me16:24
anteayaah okay16:24
anteayaI didn't see that on cacti16:24
anteayaperhaps I was looking in the wrong spot16:24
jeblairnope it's missing16:24
*** mrmartin has joined #openstack-infra16:25
fungiheading out to lunch, bbiab16:25
openstackgerritMerged openstack-infra/project-config: Retire the overcloud-f21-nonha job  https://review.openstack.org/22145716:25
anteayacan it be added? can I add it?16:25
anteayafungi: enjoy lunch16:25
jeblairanteaya: i'll have to add it; not sure why the script didn't do it automatically16:25
anteayavery good thank s16:25
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add db api method to get test_run dicts for runs by key value  https://review.openstack.org/22687016:26
jeblairanteaya: should be there now.  /opt too.16:27
zaroanteaya: this is the fix that will allow us to upgrade: https://git.eclipse.org/r/#/c/56015/16:27
* anteaya refreshes16:27
*** hashar has quit IRC16:28
*** dzamboni has joined #openstack-infra16:28
zarospearce is core on Gerrit and he not thrilled with that fix.16:29
*** gyee has joined #openstack-infra16:29
zarowas going to see if i get any other reviews before replying.16:29
*** jordanP has quit IRC16:29
*** Sukhdev has quit IRC16:29
*** kiran-r has joined #openstack-infra16:31
clarkbya imo gerrit should share those unthreadsafe things16:31
anteayajeblair: I must be looking in the wrong place, I can't seem to see a 99G server associated with review.openstack.org nor /opt16:31
jeblairanteaya: next largest space use on review.o.o is database backups 30 days, 20G total.16:31
*** Sukhdev has joined #openstack-infra16:31
clarkbbyt apparently spearce doesnt like that either16:31
jeblairanteaya: http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=916:31
anteayajeblair: but I do see gerrit is heavy cpu right now: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=25&rra_id=all16:32
jeblairanteaya: 2nd and 3rd graphs on that page16:32
clarkbanteaya I think gerrit may be in leaked memory territory again16:32
clarkbGCing all the time16:32
anteayajeblair: thank you16:32
jeblairanteaya: give it 5 minutes to actally get a reading16:32
anteayaclarkb: ah16:32
clarkbneed to check melody16:32
anteayajeblair: ah okay16:32
*** armax has joined #openstack-infra16:32
anteayaclarkb: thanks16:32
*** dramalho_ has joined #openstack-infra16:33
*** glauco__ has joined #openstack-infra16:33
jeblairclarkb: do you feel like we've put off the inevitable "cron restart of java app" about as long as we can? :/16:33
*** bltavare_ has joined #openstack-infra16:34
anteayazaro: ah okay, thanks for the update16:34
*** ccarrara_ has joined #openstack-infra16:34
clarkbjeblair well I started writing the one for jenkins :)16:34
clarkband confirmed its gcing a lot16:34
anteayazaro: does spearce have any better ideas about how to address the issue?16:34
clarkbwe can try bumping memory, maybe we just need more and there is a plateau16:34
*** alexsyip has joined #openstack-infra16:35
*** dtantsur is now known as dtantsur|afk16:35
anteayazaro: sounds like he feels there is another issue that needs to be uncovered, but is there anyone available to dig into the bigger issue?16:36
*** glauco has quit IRC16:36
*** dramalho has quit IRC16:36
*** ccarrara has quit IRC16:36
*** bltavares has quit IRC16:37
anteayajeblair: thank you now I see the graphs16:37
*** tjones has joined #openstack-infra16:37
zaroanteaya: yeah, i think the issue is that Gerrit is Sharing the WindowCursor object which it shouldn't be.  I think he's suggesting to rewrite that object or rewrite how Gerrit uses it.  I'm not sure what that involves.16:41
openstackgerritPaul Morie proposed openstack-infra/jenkins-job-builder: Add control over more settings of github pull request builder plugin  https://review.openstack.org/22269016:41
zaroit also seems like he might be ok with that change and is just looking for confirmation from other reviewers that it's not hiding some bigger problem.16:42
*** ivar-lazzaro has quit IRC16:43
*** Sukhdev has quit IRC16:43
*** Hal has quit IRC16:44
*** flepied has joined #openstack-infra16:44
*** Sukhdev has joined #openstack-infra16:46
openstackgerritPaul Morie proposed openstack-infra/jenkins-job-builder: Add control over more settings of github pull request builder plugin  https://review.openstack.org/22269016:46
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Add caching support  https://review.openstack.org/22600216:46
openstackgerritRafael Folco proposed openstack-infra/project-config: Add gerritbot/accessbot to #openstack-third-party-ci channel  https://review.openstack.org/22686616:46
*** Sukhdev has quit IRC16:47
*** puranamr has quit IRC16:47
*** derekh has quit IRC16:49
anteayazaro: okay thanks for sharing your thoughts on that16:50
anteayaif the WindowCursor object needs to be rewritten do you know of any gerrit developers who would be able to look into that?16:50
*** salv-orlando has quit IRC16:51
*** salv-orlando has joined #openstack-infra16:52
EmilienMhow can I add a package to dsvm centos7 image? we need redhat-lsb and lsb-release16:52
*** Sukhdev has joined #openstack-infra16:53
mordredEmilienM: you can just install it - BUT - lsb-release should be installed on the images already16:53
clarkbEmilienM your job should install them if they are required probably via puppet if puppet needs them but that may chicken and egg16:53
EmilienMnot on redhat systems it seems16:53
mordredEmilienM: there is a smaller package - lsb-core or osmething like that16:53
EmilienMclarkb: ok! thx16:53
*** unicell has joined #openstack-infra16:54
EmilienMmordred: ok will check, thx16:54
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Add caching support  https://review.openstack.org/22600216:54
*** Sukhdev has quit IRC16:54
zaroanteaya: Sasa, he's on the review list for that change.  he's a gerrit core and has tried to solve this problem previously, without sucess :(16:54
mordredEmilienM: in system-config/install-puppet.sh16:54
mordredEmilienM: yum install -y redhat-lsb-core git puppet16:54
*** tonytan4ever has joined #openstack-infra16:55
zarohe's on the review list.  might be a good idea to contact him personally though.16:55
mordredEmilienM: we do redhat-lsb-core instead of redhat-lsb because redhat-lsb pulls in X windows and stuff16:55
EmilienMmordred: yeah but we don't use that script16:55
EmilienMok16:55
EmilienMnice I'll copy/paste that line16:55
*** Daisy has quit IRC16:55
mordred:)16:55
mordredEmilienM: that script should have been run on every node since we prep them using puppet - but maybe we clean up after ourselves16:56
*** Daisy has joined #openstack-infra16:56
*** amuller is now known as amuller_afk16:56
openstackgerritRamy Asselin proposed openstack-infra/puppet-openstackci: Create a single-node 3rd party ci system  https://review.openstack.org/20033016:56
*** tonytan_brb has joined #openstack-infra16:56
*** mpaolino has quit IRC16:57
openstackgerritSpencer Krum proposed openstack-infra/system-config: Add nibalizer to infra-root  https://review.openstack.org/22652616:58
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet: make sure lsbrelease package is installed  https://review.openstack.org/22688216:58
EmilienMmordred, clarkb ^16:59
*** armax has quit IRC16:59
*** salv-orl_ has joined #openstack-infra16:59
*** tonytan4ever has quit IRC16:59
openstackgerritSpencer Krum proposed openstack-infra/system-config: Add yolanda to infra root  https://review.openstack.org/22664317:00
*** kiran-r has quit IRC17:00
*** Daisy has quit IRC17:00
nibalizerfungi: updated the commit message and rebased yolanda's17:00
*** tonytan_brb has quit IRC17:01
nibalizerfungi: can you share your bash aliases or functions that you use to separate things?17:01
*** salv-orlando has quit IRC17:01
*** abitha has joined #openstack-infra17:01
openstackgerritBruno Tavares proposed openstack-infra/puppet-lodgeit: Add acceptance tests for puppet-lodgeit.  https://review.openstack.org/22527917:01
*** fhubik is now known as fhubik_brb17:01
*** salv-orlando has joined #openstack-infra17:02
*** abitha has quit IRC17:02
*** bpokorny_ has joined #openstack-infra17:02
*** bpokorny has quit IRC17:03
*** trown|lunch is now known as trown17:04
anteayazaro: :(17:04
*** salv-orl_ has quit IRC17:04
anteayazaro: yes, perhaps a personal conversation might help17:04
zaroi have initiated.17:05
anteayazaro: you are awesome17:05
* anteaya showers zaro with angels of peace and fixing of the java17:05
anteayaI'm out for an errand, back in a while17:06
zarocccccceihvtjkvkkcrrgiclunjnnebdtlcretjeuncef17:07
*** ihrachys has quit IRC17:07
zarowhoo, that was wierd17:07
*** pc_m_AWAY is now known as pc_m17:08
*** cloudtrainme has joined #openstack-infra17:08
*** achanda has joined #openstack-infra17:10
anteayawas that safe travels?17:10
anteayain which case thank you17:10
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Add validate command  https://review.openstack.org/22655417:11
*** kiranr has quit IRC17:12
*** mrmartin has quit IRC17:13
dstufftzaro: looks like a yubikey ;)17:14
*** ociuhandu has quit IRC17:15
*** esker has joined #openstack-infra17:15
*** e0ne has quit IRC17:16
EmilienMif anyone could review https://review.openstack.org/#/c/226882/ - that would help our unit tests ci to pass, thanks17:17
*** xnox has quit IRC17:17
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Add validate command  https://review.openstack.org/22655417:18
bltavare_I love how yubikey adds an enter on the end and it always end up showing up on conversations17:18
bltavare_haha17:18
*** bltavare_ is now known as bltavares17:18
*** bharathm has quit IRC17:18
pabelangerEmilienM: commented17:19
zarodstufft: ahh yeah, accidentally brushed over it.17:20
zaroanteaya: thought it might be one of the angels sending a msg17:20
EmilienMpabelanger: replied17:23
AJaegerEmilienM: is it really redhat-lsb-core for Red Hat, Fedora and CentOS?17:24
*** fedexo has quit IRC17:24
EmilienMAJaeger: I used the suggestion from mordred, infra use this pkg in system-config/install-puppet.sh17:25
EmilienMand yes, it seems the same package name17:26
*** matbu has quit IRC17:26
*** cloudtrainme has quit IRC17:26
*** mrmartin has joined #openstack-infra17:26
pabelangerameade: AJaeger: I am actually surprised we don't bootstrap package by default17:27
pabelangerseems, somewhat, important17:27
*** cloudtrainme has joined #openstack-infra17:27
bltavareshello puppet masters, is there a way to extract a package version to alter a template accordingly?17:27
*** otter768 has joined #openstack-infra17:27
bltavaresit would help us with this comment https://review.openstack.org/#/c/226041/4/files/redis.conf17:27
AJaegerEmilienM: seems indeed to be available17:28
*** mrmartin has quit IRC17:28
*** zns has quit IRC17:28
EmilienMAJaeger: I wanted to use redhat-lsb first, but mordred suggested: "redhat-lsb-core instead of redhat-lsb because redhat-lsb pulls in X windows and stuff"17:29
*** ybathia has joined #openstack-infra17:29
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add db api method to get time series of runs by key value metadata  https://review.openstack.org/22386017:29
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add migration to fix wrong column name in test_metadata  https://review.openstack.org/22636317:29
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add db api methods to get keys from metadata tables  https://review.openstack.org/22616217:29
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Test get_runs_by_status_grouped_by_run_metadata API function  https://review.openstack.org/22526017:29
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add db api method to get test_run dicts for runs by key value  https://review.openstack.org/22687017:29
*** MarkAtwood has quit IRC17:29
AJaegerEmilienM: I was wondering about the "redhat" part of the package name ;)17:29
*** yamahata has quit IRC17:29
*** amuller_afk is now known as amuller17:30
*** cpallares has left #openstack-infra17:31
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Improve performance of get_runs_by_status_grouped_by_run_metadata  https://review.openstack.org/22433117:31
*** otter768 has quit IRC17:31
*** ociuhandu has joined #openstack-infra17:32
jeblairmordred, Shrews: it looks like if you ask shade to delete an image, it will perform an image listing first, is that correct?17:33
*** cloudtrainme has quit IRC17:33
jeblairmordred, Shrews: (i'm making that assumption by reading code, not executing, so am not 100% sure)17:34
openstackgerritClark Boylan proposed openstack-infra/project-config: Translate stable/liberty on horizon, DOA, and Nova  https://review.openstack.org/22595417:35
openstackgerritClark Boylan proposed openstack-infra/project-config: Make translation pushes to gerrit branch aware  https://review.openstack.org/22595317:35
openstackgerritClark Boylan proposed openstack-infra/project-config: Push version specific .pots to Zanata  https://review.openstack.org/22595217:35
clarkbAJaeger: ^ I think that should do it, is that what you had in mind?17:35
jeblairclarkb: we have a project called 'doa'?17:35
clarkbjeblair: django_openstack_auth, it didn't fit in the title :)17:35
jeblairwhat an unfortunate name17:35
clarkbjeblair: I think it is common for shade to list before many operations so would not be surprised if that is the case17:36
clarkbjeblair: it is doing that in order to do better error checking, but in cases like this not so great17:36
AJaegerclarkb: that's what I had in mind, thanks!17:36
*** xnox has joined #openstack-infra17:36
jeblairya, when your list takes several minutes... :(17:36
clarkbAJaeger: I did test that the command you suggested works with the correct return codes as well17:37
clarkbAJaeger: thanks for the suggestion it was a good one17:37
*** pelix has quit IRC17:38
AJaegerclarkb: great17:38
clarkbAJaeger: I didn't put it in the common functions file because this isn't needed for proposal and upstream hopefully thats ok17:39
clarkblooks like you +2'd thanks17:39
clarkbAJaeger: btw all the proposal jobs that were queued have finished17:40
AJaegerclarkb: yes, +2 for everything. Feel free to self-approve the two changes that now have a +2 by both pleia2 and myself, I wanted to give the chance to merge them one by one...17:40
clarkbAJaeger: yes I Think merging one by one is good too17:41
AJaegerclarkb: and seemed to have worked just fine, so no regressions...17:41
clarkbAJaeger: ya the ones I checked looked good17:41
AJaegerso, whom do you want to ping for https://review.openstack.org/225952? Or wait for pleia2 to return tomorrow?17:41
*** esker has quit IRC17:43
mordredjeblair: shade is currently assuming that caching will work. however, I have an idea for a way to avoid that (it's implemented for one operation and just needs to be applied across the board)17:43
openstackgerritIsaias proposed openstack-infra/git-review: Add pem key parameter  https://review.openstack.org/22689417:44
clarkbAJaeger: we can probably rope in jhesketh mordred jeblair anteaya sdague fungi et al17:44
AJaeger;)17:44
mordredjeblair: I'm in a meeting just now - but in an hour or two I'll show you a small patch and see whatyou think17:45
openstackgerritIsaias proposed openstack-infra/git-review: Add pem key parameter (WIP)  https://review.openstack.org/22689417:45
*** mrmartin has joined #openstack-infra17:45
*** markus_z has quit IRC17:45
*** mriedem has quit IRC17:46
jeblairmordred: oh, the dogpile cache?  is that enabled by default?  an automatic ephemeral in-process dogpile cache would probably be okay for this use-case.17:47
jeblairmordred: no rush though, i've got a novaclient script going now; it's just while i was writing it i thought "i wonder if shade would help here"17:47
sdagueclarkb: what's up?17:48
mordredjeblair: we do not have it enabled at the moment - but that's one of the things I want to test with nodepool and then look at enabling17:48
jeblairmordred: ack17:48
mordredjeblair: it would always help with it :)17:48
clarkbsdague: looking to get https://review.openstack.org/#/c/225952/3 reviewed to support translations of liberty branch with zanata17:48
mordredjeblair: I never touch novaclient anymore17:48
clarkbsdague: that way the translators can continue to translate after rc117:48
clarkb(and not need to do a bunch of manual work)17:48
*** mrmartin has quit IRC17:48
AJaegerIs there any easy way to figure out how many changes merged for Liberty in total?17:49
*** bharathm has joined #openstack-infra17:49
*** mriedem has joined #openstack-infra17:49
*** esker has joined #openstack-infra17:50
clarkbAJaeger: http://activity.openstack.org/dash/browser/scm.html17:50
clarkbAJaeger: also I think stackalytics tracks that17:50
jeblairclarkb: "setup_manuals $project $version" will succeed regardless of whether the zanata version exists, right?17:51
jeblairclarkb: i ask because the script is -e17:51
clarkbjeblair: yes17:51
sdagueclarkb: so that's a bashism I didn't quite know17:51
clarkbAJaeger: specifically http://activity.openstack.org/dash/browser/scm.html?release=liberty from the drop down at the top17:52
jeblairsdague: the regex sub?17:52
krotscheckI'd like to do a concentrated push to get npm publishing working, since that's been lingering since...urr.... july or so? What does the docket for the next few weeks look like for the infra cores with regards to helping approve those things?17:52
openstackgerritKevin L. Mitchell proposed stackforge/python-jenkins: Allow setting the next build number  https://review.openstack.org/22427517:52
sdaguejeblair: yeh17:53
AJaegerclarkb: thanks. Those two are completely different, just compare commits for mriedem (68 in activity vs 290 on stackalytics).17:53
*** HeOS has quit IRC17:53
clarkbAJaeger: counting is hard17:54
reedAJaeger, the two are not comparable17:54
reedAJaeger, what counts are trends, not the individual numbers17:54
sdagueclarkb: +A, did some local poking to convince myself of things :)17:54
*** yamahata has joined #openstack-infra17:54
*** kiran-r has joined #openstack-infra17:54
*** bharathm has quit IRC17:54
clarkbsdague: thank ou17:54
*** mriedem1 has joined #openstack-infra17:54
*** mriedem has quit IRC17:54
AJaegerreed, what's the difference between code developers and code submitters on http://activity.openstack.org/dash/browser/?release=liberty ?17:55
reedinteresting, a new bot popped up17:55
*** thingee has quit IRC17:56
reedAJaeger, should be roughly the same, one is counting authors on git, another is counting the same on gerrit17:56
*** e0ne has joined #openstack-infra17:56
*** ybathia has quit IRC17:56
*** pvaneck has joined #openstack-infra17:56
reedAJaeger, we can ask for details on #bitergia, too17:56
AJaeger1556 vs 2057 does not look roughly ;)17:56
clarkbwow we do just under a million lines changed every 30 days17:56
*** bharathm has joined #openstack-infra17:57
openstackgerritJulia Kreger proposed openstack-infra/project-config: Allow bifrost-release group to create branches  https://review.openstack.org/22689817:57
AJaegerreed: thanks for the pointer.17:57
clarkb(according to that page)17:57
* AJaeger just needs a few numbers to impress ;)17:57
reedAJaeger, yeha, that doesn't look right17:57
reedAJaeger, if the numbers are to 'impress' just pick a source and stick to it17:57
reedthe numbers don't count much17:57
reedBTW, I suspect activity.o.o is missing repositories compared to stackalytics17:58
*** krtaylor has quit IRC17:58
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Add validate command  https://review.openstack.org/22655417:58
reedAJaeger, last time I checked, stackalytics counts submissions to the specs repos as code, while activity doesn't count the spec repos at all17:58
reedjust as an example17:59
AJaegerreed: what fun ;)17:59
reedAJaeger, yeah :) that's why I used to spend time on quarterly reports17:59
*** zz_gondoi is now known as gondoi17:59
openstackgerritMerged openstack-infra/project-config: Push version specific .pots to Zanata  https://review.openstack.org/22595217:59
AJaegerreed: quite some time I fear ;(17:59
reedAJaeger, well... not that much in the end18:00
reedI stuck to one source :)18:00
*** ybathia has joined #openstack-infra18:00
*** thingee has joined #openstack-infra18:00
krotscheckSeeking: Additional core willing to assist fixing the release slave -> https://review.openstack.org/#/c/226040/ (requires a manual step)18:00
*** hemna is now known as hemnafk18:01
funginibalizer: i add entries like this to my ~/.bash_aliases http://paste.openstack.org/show/473790/18:01
*** nadya has joined #openstack-infra18:01
reedAJaeger, code submitters are people who pushed code to gerrit, not necessarily merged... it's weird that that number has diverged so much from authors18:02
AJaegerreed, thanks18:02
jeblairkrotscheck: what's the manual step?18:02
fungikrotscheck: i'm willing to perform the local manual un-break-it step if we can just get another +2 on that. i've already unbroken it several times to test our theories18:02
AJaegerthat's indeed a significant difference18:02
reedi remember the two numbers being much closer18:02
*** zns has joined #openstack-infra18:02
fungijeblair: manually reinstall npm packages18:02
krotscheckjeblair: Blow away the broken install of npm, so it can be rerun18:02
*** esker has quit IRC18:03
pabelangerJust a heads up, making some good process on grafyaml. Won't mind the help with code reviews: https://review.openstack.org/#/q/status:open+project:openstack-infra/grafyaml,n,z18:03
fungiactually `rm /usr/local/bin/npm` may be sufficient18:03
reedAJaeger, it could be a bug or the amount of code in pending review state or abandoned has increased significantly18:03
pabelangerhoping to have our first dashboard going in the next week or so18:03
*** olaph has quit IRC18:04
jeblairfungi, krotscheck: looking, though nibalizer has a +1 so we should be good.18:04
reedAJaeger, I don't know if the quarterly report will be produced at the end of September again, last one is from June18:04
krotscheckjeblair: Danke18:04
fungijeblair: oh, right! i forgot to translate his +1 to a +218:04
reedAJaeger, http://git.openstack.org/cgit/openstack-infra/activity-board/tree/reports/2015-q2/pdf18:04
krotscheckAfter npm publishing, I wonder if I can write a job that publishes a thing as an xstatic package.18:04
krotscheckBecause otherwise horizon won't use it.18:05
fungireed: i _thinkl_ we had one last quarterly on the contract, but i can't remember if that was actually the june one18:05
* krotscheck may be slightly allergic to xstatic18:05
jeblairfungi, krotscheck: lgtm18:05
krotscheckjeblair: Thanks!18:05
*** lhcheng has joined #openstack-infra18:05
fungijeblair: thanks. krotscheck: once that lands, i'll do the byhand dance for it18:05
*** doug-fis_ has joined #openstack-infra18:05
*** Hal has joined #openstack-infra18:06
AJaegerreed, I'm set now, thanks!18:06
*** e0ne has quit IRC18:06
reedcheers AJaeger, fungi18:06
krotscheckfungi: Much obliged, will keep an eye on it myself as well.18:06
*** abitha has joined #openstack-infra18:06
openstackgerritSergey Reshetnyak proposed openstack-infra/project-config: Fix saharaclient gate  https://review.openstack.org/22676218:06
*** doug-fi__ has joined #openstack-infra18:06
*** hashar has joined #openstack-infra18:07
krotscheckAlso, jeblair, that npm v1.x issue we ran into yesterday has a patch up at https://review.openstack.org/#/c/226596/18:07
krotscheck(It finally passed)18:07
*** doug-f___ has joined #openstack-infra18:08
*** doug-fish has quit IRC18:08
*** lhcheng has left #openstack-infra18:08
*** doug-fish has joined #openstack-infra18:09
*** olaph has joined #openstack-infra18:09
*** doug-fis_ has quit IRC18:10
*** mriedem1 has quit IRC18:10
*** doug-fis_ has joined #openstack-infra18:11
*** doug-fi__ has quit IRC18:11
openstackgerritMerged openstack-infra/system-config: Staged upgrade for npm  https://review.openstack.org/22604018:11
*** krtaylor has joined #openstack-infra18:11
*** spzala has joined #openstack-infra18:12
*** doug-f___ has quit IRC18:13
*** e0ne has joined #openstack-infra18:13
krotscheckfungi: ^^ woot?18:13
*** annegentle has joined #openstack-infra18:13
*** mriedem has joined #openstack-infra18:13
*** hrubi has quit IRC18:14
*** doug-fish has quit IRC18:14
fungikrotscheck: yep, w00t. there is no ansible run underway so i'll do the thing real quick and it should get updated on the upcoming pulse18:15
krotscheckWait, ansible?18:15
openstackgerritSpencer Krum proposed openstack-infra/system-config: Fix spelling mistake in docs  https://review.openstack.org/22691618:15
nibalizerkrotscheck: ansible runs puppet18:15
*** bpokorny_ has quit IRC18:16
fungikrotscheck: we use ansible on puppetmaster.openstack.org to orchestrate our sequence of puppet agent runs on individual servers18:16
*** bpokorny has joined #openstack-infra18:16
krotscheckWhoa, that's new.18:16
openstackgerritEric Harney proposed openstack-infra/project-config: Add dsvm-full-lio to os-brick jobs  https://review.openstack.org/22325818:16
fungithe script that does that pulls the system-config repo when it starts, so changes to that don't take effect until the subsequent run, even if they merge before puppet agent has fired on affected servers18:17
*** nadya has quit IRC18:17
fungikrotscheck: new in the past year at least, but it's been this way a while (months)18:17
*** Zhongjun has quit IRC18:17
*** hashar has quit IRC18:17
krotscheckfungi: I may bave been busy with Cross-Project things :)18:18
fungihaven't we all18:18
clarkbjenkins05 is thread leaking. anyone want to ACK https://review.openstack.org/#/c/222394/ though not necessarily approve it and I can use it against jenkins05?18:19
clarkbI think technically I need a python-jenkins release too so will liekly run out of a venv anyways18:19
bltavaresnibalizer: I'm not sure how to handle this comment regarding package version checks https://review.openstack.org/#/c/226041/4/files/redis.conf Do you have an idea?18:19
clarkbbltavares: I would just delete logstash::redis entirely18:20
clarkbits unused18:20
clarkband I think there are useable redis modules from puppet community now18:20
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add migration to fix wrong column name in test_metadata  https://review.openstack.org/22636318:20
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add db api methods to get keys from metadata tables  https://review.openstack.org/22616218:20
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add db api method to get test_run dicts for runs by key value  https://review.openstack.org/22687018:20
bltavaresclarkb: is there an easy way to search the modules to see if there is any other project using logstash::redis?18:21
krotscheckfungi: puppet just ran, could you doublecheck the version for me? :)18:21
clarkbbltavares: in our code base yes, but not globally18:21
clarkbbltavares: just git clone all our puppet modules and grep -R18:21
*** hashar has joined #openstack-infra18:22
bltavaresclarkb: I was afraid you would say that haha18:22
clarkbbltavares: there is also the hound service18:22
bltavaresclarkb: what is that? I'm new arond18:22
bltavaresaround*18:22
clarkbI haven't used it yet but others say it is handy for this http://hound.openstack.org18:22
clarkbit indexes our git repos for easy searching in your web browser18:22
mordredhound is awesome18:22
clarkbbltavares: http://hound.openstack.org/?q=logstash%3A%3Aredis&i=nope&files=&repos=18:23
*** olaph has quit IRC18:23
fungiclarkb: lgtm, i say give it a shot18:23
bltavaresclarkb: nice!18:24
bltavaresclarkb: I will comment on that. thank you18:24
jesusaurusclarkb: bltavares: we don't know if anyone out in the wild is relying on logstash::redis, but worst case they either pin their version of the module or stop using redis18:24
clarkband they should really stop using redis >_>18:25
jesusaurus++18:25
* krotscheck idly does a hound search for 'password', takes notes...18:25
fungikrotscheck: http://paste.openstack.org/show/473791/18:25
clarkbbltavares: if you want to be nice about it leave a comment/docs that its deprecated and should not be used18:25
clarkbbltavares: and don't worr about testing it or maintaining it, thats just wasted effort at this point18:25
jeblairdown to 6380 images, and 64 seconds to list them18:26
*** achanda has quit IRC18:26
clarkbjeblair: progress!, have you been able to determine wh so many images were created?18:26
fungikrotscheck: though also i had previously tried the proposed workaround there so it was probably already upgraded. i should try reinstalling npm from the distro package and make sure it updates correctly again on the next pass too18:26
krotscheckfungi: That.... is not what I expected.18:26
bltavaresclarkb: sounds like a plan18:27
krotscheckThe /etc/npmrc file should have put version 3.3.3 in /usr/local/bin, no?18:27
krotscheckSo yeah, maybe18:27
bltavaresclarkb: I do want to be nice haha (:18:27
jeblairclarkb: i suspect it's because of the nodepool bugs we corrected last week.  it would not surprise me at all if the error recovery was unable to function due to the logic errors.18:27
*** dims__ has joined #openstack-infra18:28
fungikrotscheck: i've reset its state to this now http://paste.openstack.org/show/473792/18:28
clarkbjeblair: gotcha18:28
Shrewsjeblair: correct18:28
krotscheckThat looks good. Here's hoping :)18:28
Shrewsjeblair: re: image list then delete. it's because we can delete by name OR id, so we need to match names. it's a pattern i'm regretting18:29
EmilienMif anyone from core could approve https://review.openstack.org/#/c/226882/ - thanks18:30
*** achanda has joined #openstack-infra18:30
jeblairShrews: mordred said he's going to push a discussion patch for changing the pattern soon18:30
Shrewsjeblair: ah, missed that18:30
*** dramalho_ has quit IRC18:31
jeblairthere's been a lot of yakking in the interim.  :)18:31
*** dims_ has quit IRC18:31
clarkbEmilienM: now is when I look and double check mordred on saying we already install that stuff18:32
clarkbEmilienM: we install redhat-lsb-core, that isn't sufficient for your needs?18:33
*** kiran-r has quit IRC18:33
*** gondoi is now known as zz_gondoi18:33
*** MarkAtwood has joined #openstack-infra18:34
openstackgerritBruno Tavares proposed openstack-infra/puppet-logstash: Add acceptance tests for puppet-logstash.  https://review.openstack.org/22485818:34
*** Sukhdev has joined #openstack-infra18:34
fungiapparently my plea to not reply to the -dev ml requesting pycharm licenses did little good18:34
clarkbfungi: I kinda want to join the pycharm train just to figure out what it is about18:35
clarkbbut anytime I use !vim I run away crying18:35
fungiit's like a charm bracelet for your pythons18:35
krotscheckfungi: New run.18:35
mordredShrews: I have an idea18:35
*** amotoki has quit IRC18:35
mordredShrews: of how to improve the pattern without breaking18:35
clarkbEmilienM: oh wait thats exactly what you install so now I am confused18:35
EmilienMclarkb: our CI does not use the script18:36
openstackgerritDoug Hellmann proposed openstack/requirements: Bump django_openstack_auth to 2.0.0  https://review.openstack.org/22525518:36
fungikrotscheck: we're back to 3.3.3 for /usr/bin/npm so i have a feeling the custom npmrc isn't doing what we want18:36
EmilienMclarkb: the script is used by system-config18:36
trownhow does one recheck for gate failure? https://review.openstack.org/#/c/210436/18:36
krotscheckfungi: ARGH18:36
trownI tried reverify, but I think that might not be correct.18:36
* krotscheck goes back to figure out what broke.18:36
clarkbEmilienM: no but your CI runs on our Vs18:37
clarkbEmilienM: which all install redhat-lsb-core https://git.openstack.org/cgit/openstack-infra/system-config/tree/install_puppet.sh#n7118:37
krotscheckfungi: I really don't get it. I've got a puppet module running against a trusty vm that does all that, and here it works fine.18:37
clarkbEmilienM: so the only way this makes sense is if you want to run the tests on VMs other than the ones we build and if that is the case ou should't be updating the jenkins job like that as it won't stick to other VMs18:37
openstackgerritDoug Hellmann proposed openstack/requirements: Bump django_openstack_auth to 2.0.0  https://review.openstack.org/22525518:37
openstackgerritPaul Belanger proposed openstack-infra/project-config: [WIP] Add grafana dashboard for status.o.o/zuul  https://review.openstack.org/22483418:39
fungikrotscheck: /etc/npmrc looks like it got correctly updated... is it possible the prefix setting has to be done differently for npm v2?18:40
EmilienMclarkb: I'm not sure our jobs run install_puppet.sh18:40
EmilienMclarkb: I might have missed something18:40
krotscheckfungi: Dunno. Maybe there's a mystery setting somewhere that came with the distro npm.18:40
*** shardy is now known as shardy_afk18:40
clarkbEmilienM: they don't need to, all of our image builds run install_puppet.sh18:40
krotscheckfungi: I'll keep digging18:40
fungikrotscheck: the distro-provided mystery settings tell it to use /usr/local too18:41
EmilienMclarkb: mhh I'm investigating : http://logs.openstack.org/30/226830/5/check/gate-puppet-nova-puppet-unit-4.0-dsvm-centos7/cc1856b/console.html#_2015-09-23_16_38_09_68618:41
*** ivar-lazzaro has joined #openstack-infra18:41
*** ivar-lazzaro has quit IRC18:41
AJaegertrown: reverify will put the change back in the check queue, so it should be there. Looking at status.openstack.org/zuul I see that Zuul is busy currently (Queue lengths: 649 events, 187 results), once it's idle again, it should appear18:41
*** ivar-lazzaro has joined #openstack-infra18:42
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Allow creating externally accessible networks  https://review.openstack.org/22686518:42
AJaegertrown: reverify is just an alias for recheck, we're deprecating reverify18:42
fungiwell, it's been effectively deprecated (as in not mentioned in our documentation) for a long time18:43
trownAJaeger: thanks18:43
*** HeOS has joined #openstack-infra18:43
*** esker has joined #openstack-infra18:44
fungikrotscheck: fwiw, `npm get prefix` says /usr/local'18:44
AJaegertrown: so, next time use "recheck"18:44
*** sabeen has quit IRC18:44
PietThe OpenStack UX project team would like to invite you to participate in a survey to help drive product direction for the Neutron project.  The survey should take no more than fifteen minutes to complete.18:44
fungikrotscheck: er, without the trailing ' (that was just fat fingers on my part)18:44
krotscheckfungi: What does npm -g prefix say?18:44
PietWe are specifically looking for folks with the following roles; Architect, Cloud Operator, System Administrator, Network Architect / Engineer / Administrator, Developer, or IT Manager / Director.  In addition, they should be familiar with either Nova Networks and/or Neutron.18:44
trownAJaeger: ack18:44
PietYou will also be entered in a raffle for one of two $100 US Amazon gift cards at the end of the survey.   As always, the results from the survey will be shared with the OpenStack community.18:44
AJaegertrown: your change is now in the check queue...18:44
Piethttps://www.surveymonkey.com/r/osnetworking18:44
fungikrotscheck: same as npm get prefix18:44
EmilienMclarkb: you're probably right, the package is here on our beaker jobs http://logs.openstack.org/30/226830/6/check/gate-puppet-nova-puppet-beaker-rspec-dsvm-centos7/d409e0a/logs/rpm-qa.txt.gz18:44
* krotscheck grumbles18:45
krotscheckUrm... Piet: Wrong channel?18:45
krotscheckOh!18:45
* krotscheck misunderstood.18:45
krotscheckIgnore me.18:45
Pietkrotscheck:  No worries18:46
PietYou had me worried because I'm a bit light headed today18:46
fungikrotscheck: if i manually run `sudo /usr/local/bin/npm install npm -g --upgrade` it successfully upgrades /usr/local/bin/npm rather than /usr/bin/npm18:47
clarkbwow only 2 questions if you dont know the size of your cloud18:47
clarkbcrinkle how many nodes do we have?18:47
clarkbcrinkle and speaking of when can we add it to nodepool :P18:47
krotscheckfungi: I just noticed that the IF statement on assert@2 doesn't seem to be picking up18:47
krotscheckfungi: Hrm...18:48
*** sabeen has joined #openstack-infra18:48
krotscheckfungi: Trailing ` in https://review.openstack.org/#/c/226040/1/modules/openstack_project/manifests/release_slave.pp18:48
crinkleclarkb: heh18:49
*** e0ne has quit IRC18:49
crinkleclarkb: there's one-node minicloud right now :)18:49
krotscheckNo that's not it18:49
clarkbcrinkle good enough :P18:49
*** dramalho has joined #openstack-infra18:51
fungiclarkb: finally!!!!! http://packages.ubuntu.com/trusty-updates/python3.418:52
clarkbyup18:52
krotscheckfungi: Urm.18:53
EmilienMclarkb: you were right, I found an issue in puppetlabs-apt - I abandon the patch - thx again18:53
clarkbEmilienM np18:53
krotscheckfungi: Looks like it installed npm in /usr/local/bin/bin18:53
* krotscheck facepalms18:53
krotscheckI am _so_ sorry about this18:53
EmilienMclarkb: in fact, I fail because of https://github.com/puppetlabs/puppetlabs-apt/blob/1.8.x/manifests/params.pp#L8-L3818:54
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: The apikey is now optional  https://review.openstack.org/22479618:55
EmilienMcrinkle: do you remember what was blocking us to bum frop 1.8 to 2.x (apt module) ?18:56
crinkleEmilienM: I thought we already moved?18:56
pabelangerwe did18:57
*** weshay has quit IRC18:57
nibalizerwe moved18:57
EmilienMlol18:57
nibalizerit was fast and easy thanks to paul18:57
nibalizerApt 2.x or bust!18:57
*** cburroughs has joined #openstack-infra18:57
fungikrotscheck: i don't see a /usr/local/bin/bin/npm on the server18:57
EmilienM1.8.x in our Puppetfile (integration repo)18:57
pabelangerold and busted, new and hotness18:57
EmilienMlet's move then18:57
krotscheckNow I'm _really_ confused18:57
* krotscheck is stepping through the puppet bits.18:57
pabelangerwell this is embarrassing, somehow grafyaml is missing the requirements for requests.18:58
pabelangerGuess I should add some test coverage there18:58
*** nadya has joined #openstack-infra18:59
*** bltavares has quit IRC18:59
*** bltavare_ has joined #openstack-infra19:00
*** thingee has quit IRC19:02
*** bltavar__ has joined #openstack-infra19:03
*** rockyg has joined #openstack-infra19:03
*** spzala has quit IRC19:03
jrollhiya infra. the ironic gate is busted because our nested VMs are hanging at boot... any image changes we might want to be aware of that could be related?19:04
* jroll digging devstack commits in the meantime19:05
clarkbjroll the qemu fake virt VMs?19:05
jrollclarkb: ya19:06
*** bltavare_ has quit IRC19:06
jrollI'm also suspicious of https://github.com/openstack-dev/devstack/commit/0612b485d3646e40ea0f70dfaadd7705a2b10c7119:06
yolandaclarkb, fungi, for the jenkins tool, i'm ok to add that feature on next changes. We don't have the split between nodepool and static managed slaves on our jenkins19:06
clarkbwe boot tons of VMs for tempest19:06
sdaguejroll: that passed gate-tempest-dsvm-ironic-pxe_ssh19:07
clarkbyolanda I just worry that we are taking simple tool and trying to make it a catch all19:07
jrollsdague: touche, thanks for pointing that out19:07
sdaguewhich I guess isn't the agent job19:08
sdaguewhich is failing now19:08
clarkbyolanda but if all you need is a regex that should be fine19:08
sdaguejroll: you want to propose a revert and see what happens, if you think it's the issue19:08
yolandaclarkb, yes, that should be fine19:08
sdagueI did notice the same kind of fail here - https://review.openstack.org/#/c/226831/19:08
yolandait's a really useful tool and i'd like to be able to use upstream, as it's a task that we do manually19:08
*** Piet has quit IRC19:08
sdaguejroll: http://tinyurl.com/ngh2hr3 shows it going to 100% fail recently19:09
jrollsdague: the change seems fine, I'm just always suspicious of devstack commits with 'ironic' in the title for some reason19:09
sdagueheh19:09
jrollsdague: right, trying to track down the cause19:09
clarkbI will do jenkins05 with it after babies and lunch19:09
sdagueyeh, it's tough though, because it looks like it goes to a high fail rate a lot19:09
jrollwe've had a number of gate breakages recently for various reasons19:10
jrollsee gate history here if you like details https://etherpad.openstack.org/p/IronicWhiteBoard19:10
*** Hal has quit IRC19:10
jrollbut I don't think there are many components that could cause the VMs to hang at boot every time19:11
jrolland especially for two different ramdisks19:11
sdaguewhere is it hanging?19:11
jrollwe get zero boot output19:11
jrollnot a single [0.0000] blablabla19:12
sdagueyeh, that seems weird19:12
*** nadya has quit IRC19:12
jrollwhich happens occassionally at random, but never seen it like this19:12
sdagueright, I'm actually pillaging the console files directly in the worlddump19:12
jrollI wonder if a bad ramdisk build got published, actually19:12
sdagueand see nothing - http://logs.openstack.org/31/226831/1/check/gate-tempest-dsvm-ironic-agent_ssh/ac91302/logs/worlddump-2015-09-23-152648.txt.gz19:12
*** e0ne has joined #openstack-infra19:12
jrollthere's also ironic_bm_logs19:12
jrollwhich is how you can tell, if it's all gibberish, it hung19:13
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Allow more complex router creation  https://review.openstack.org/22695119:13
*** Hal has joined #openstack-infra19:13
jroll(ignore my bad ramdisk comment, that wouldn't affect pxe_ssh)19:14
*** ihrachys has joined #openstack-infra19:14
sdagueright, but the pxe_ssh was in august19:14
sdaguehttp://logs.openstack.org/31/226831/1/check/gate-tempest-dsvm-ironic-agent_ssh/ac91302/logs/worlddump-2015-09-23-152648.txt.gz19:14
jroll?19:14
jrolleverything is failing https://review.openstack.org/#/c/224079/19:14
sdaguepxe_ssh is in check19:14
jrollsure, but it's failing consistently :)19:14
*** thingee has joined #openstack-infra19:15
*** dangers_away is now known as dangers19:15
openstackgerritRafael Folco proposed openstack-infra/system-config: Docs: Adding accessbot info to the IRC services page  https://review.openstack.org/22695219:15
*** hdd has quit IRC19:16
*** dramalho has quit IRC19:16
sdaguejroll: so the event that triggered this is probably about 6 hours ago, because my graph is a 12 hour moving average19:17
jrollyep19:17
sdaguewhen do ramdisks publish?19:17
sdaguethat would also not match the devstack change in timeframe19:17
jrollwell, only IPA ramdisks are published, as a post job on each ipa merge19:18
sdagueok, so when was the last merge there?19:18
jrollit wouldn't make pxe_ssh jobs fail, though, if those were bad19:18
*** sridhar_ram has quit IRC19:18
jrolllast merge was about 4 hours ago there19:18
fungia few hours ago says http://tarballs.openstack.org/ironic-python-agent/coreos/19:18
jrollI'm also suspicious of https://github.com/openstack/neutron/commit/23e9734819a1a905e8b96c73f9ddbaf3dda4162119:18
*** cdent has quit IRC19:19
fungi"23-Sep-2015 16:29" is when that image was generated/uploaded19:19
jrolljust because it changes dhcp things and is roughly the same timeframe19:19
fungi(utc)19:19
jrollbut I have no clue how to parse q-dhcp logs :/19:19
sdaguebut, dhcp failure shouldn't impact this right?19:19
sdaguewould that prevent you from getting any console?19:20
jrolldhcp failure would certainly affect pxe booting19:20
sdagueright, but the agent tests?19:20
sdagueit's possible there are 2 fails that landed simulatenous19:20
jrollwell, the problem is the VMs are not booting19:20
jrollthey are pxe booted19:20
sdagueall of them?19:20
jrollcorrect.19:21
jrollevery pxe boot of a VM we do hangs19:21
jrollthis neutron change doesn't look like it should affect that at all19:22
*** tonytan4ever has joined #openstack-infra19:22
jrollbut is suspicious19:22
clarkbfungi: I am ready to run against jenkins05 now19:22
*** MarkAtwood has quit IRC19:22
*** esker has quit IRC19:22
clarkbeveryone ready for the next giant leap in running jenkins?19:22
greghaynesasselin: that error seems like a mirror fail to me?19:23
sdaguejroll: have you replicated this locally with devstack? because it seems like there are too many variables to just play guessing games here.19:23
lifelessAJaeger: https://review.openstack.org/#/c/226775/19:23
fungiclarkb: hopefully the last giant leap before we leap off it entirely19:23
hodosclarkb: when I create an instance (cirros) it gets correct IP from nova dhcp server19:23
lifelesszigo: mordred: no, its th difference between build-time and run-time minimums19:23
clarkbfungi: ok I am pulling the trigger, its running in a screen on jenkins0519:24
lifelesszigo: mordred: they've not been coordinated for the entire time I've been contributing, and I don't think it makes sense to do so now19:24
jrollsdague: yeah, that's my next step, just wanted to pop in here and see if there were any image updates that could be related19:24
* jroll stacks19:24
AJaegerlifeless: what do you want me to do with 226775? Remove my +2 for now?19:24
lifelessAJaeger: yeah19:24
sdaguejroll: the coreos one is about the right time frame to cause this19:24
jrollsdague: thanks for the help though, I appreciate it19:24
hodosclarkb: in temppest it gets for some reason IP from external19:24
lifelessAJaeger: and perhaps +2 on the requirements one19:24
sdaguejroll: yeh, no prob19:24
lifelessAJaeger: which IIRC infra gets +2 on19:24
*** dims__ has quit IRC19:24
jrollsdague: but pxe_ssh is also broken and doesn't use that. :)19:24
*** e0ne has quit IRC19:24
clarkbfungi: seems to be working so far, its in shutdown mode and process is waiting for jobs to stop running19:25
*** dims_ has joined #openstack-infra19:25
zigolifeless: mordred: This makes no sense to me on the distro level, because obviously, if one package is needed for build time, it's also going to be used as runtime. There's only one instance of them in a distribution.19:25
clarkbfungi: next step will be to have a one a day jenkins master restart19:25
clarkbfungi: or possibly a continuous restart19:25
clarkbfungi: so we always operate one jenkins master short19:25
fungiattached and watching19:26
AJaegerlifeless: I'm only project-core, so have no +2 on requirements19:26
clarkbfungi: gah it 500'd19:26
fungiclarkb: yay traceback!19:26
AJaegerlifeless: dhellmann has +2 on requirements ;)19:26
*** mriedem has quit IRC19:26
clarkbfungi: but the script is safe to restart19:26
*** sridhar_ram has joined #openstack-infra19:26
fungiyep19:26
fungistaleless19:26
lifelesszigo: the version you need in debian then is any version that satisfies the union of the two requirements19:26
*** bharathm has quit IRC19:26
lifelessdhellmann: btw I fixed the pypy thing on requirements, its just been waiting for reviewers19:27
zigolifeless: But does it make sense on the gate?19:27
lifelesszigo: yes, why wouldn't it ?19:27
dhellmannlifeless: where?19:27
clarkbfungi: however thats a new fail19:27
lifelessdhellmann: https://review.openstack.org/#/c/224924/19:27
fungiclarkb: it's running through the various ways an http request can fail i think19:27
*** ddieterly has quit IRC19:27
zigolifeless: Will the gate install stuff with pbr 1.8, and then run them with 1.6?19:27
clarkbfungi: oh bad password copy19:27
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Restructure cmd tests into multiple files  https://review.openstack.org/22696019:27
zigoAre we already testing with lower bounds?19:28
dhellmannlifeless: ack19:28
lifelesszigo: no, but thats orthogonal19:28
*** otter768 has joined #openstack-infra19:28
*** salv-orlando has quit IRC19:29
clarkbfungi: I think the bug here is that the node job listing is raecing nodepool deleting the nodes19:29
*** salv-orlando has joined #openstack-infra19:29
clarkbfungi: so I think we can catch 500s from list running jobs and treat that as a non quiet state19:29
*** dramalho has joined #openstack-infra19:29
fungioh, ick19:29
*** bltavares has joined #openstack-infra19:30
*** ddieterly has joined #openstack-infra19:30
clarkbfungi: do you see my file edits? something like that19:31
*** bltavar__ has quit IRC19:32
*** annegentle has quit IRC19:32
*** mriedem has joined #openstack-infra19:32
fungiclarkb: yeah, looks like it's worth a try19:32
*** annegentle has joined #openstack-infra19:32
*** cloudtrainme has joined #openstack-infra19:32
*** hemnafk is now known as hemna19:33
*** otter768 has quit IRC19:33
*** Hal has quit IRC19:34
AJaegerclarkb: your upstream translation change is still not active, shouldn't it be rolled out by now?19:35
clarkbfungi: ya its always failing on get node info19:36
*** derekh has joined #openstack-infra19:36
clarkbAJaeger: let me check puppet I think I may have disabled it on propsal slave yesterday too and not reenabled it19:36
clarkbAJaeger: :/ sorry about that too manmy things at once19:36
*** cloudtrainme has quit IRC19:37
*** kushal has quit IRC19:37
*** Sukhdev has quit IRC19:37
clarkbAJaeger: ya that was it, fixed19:38
clarkbAJaeger: any runs after now should have the updates19:38
AJaegerthanks, clarkb !19:38
*** achanda has quit IRC19:41
clarkbfungi: I wonder though if we will have the same problem with node deletes19:42
clarkbfungi: since after jobs are done running nodepool will attempt to delete the last node19:42
*** mriedem has quit IRC19:43
fungii am slightly worried about trying to delete slaves through the api when the api is not performing particularly well19:43
clarkbfungi: thats why we have to run it before the api actually falls over19:44
clarkbfungi: jenkins05 is at 1.5k threads which is manageable for it19:44
clarkbwhen you get in the 8k range it starts to fail a lot19:44
fungiahh, okay. that seems safeish19:44
*** mriedem has joined #openstack-infra19:44
clarkbbut I think for deleting nodes we just need to do the same idea, delete them until there are no more offline nodes19:44
clarkband it will converge even with nodepool competing19:45
clarkbI will get the script updated19:45
fungiright nodepool is tolerant of a node it wants deleted being gone even before it asks for deletion19:46
*** ihrachys has quit IRC19:47
anteayazaro: decyphering angel messages sometimes takes me days19:48
*** kgiusti has quit IRC19:48
*** Piet has joined #openstack-infra19:48
anteayaclarkb: AJaeger 225952 already merged, well done19:49
*** bltavares has quit IRC19:50
jrollsdague: so locally I get an ipxe failure referencing http://ipxe.org/err/040ee1 . testing revert of that neutron dhcp change, if that's not it I'm suspecting a new package providing a buggy pxe rom in kvm or whatever19:50
clarkbjroll: if you want I can hold a node for you to poke on directly19:52
*** matrohon has joined #openstack-infra19:52
clarkbjroll: let me know once the revert tests come back19:52
jrollclarkb: nah, it's cool, I've reproduced locally, thanks though :)19:52
jrollI don't think this is infra-specific19:52
clarkboh good19:52
*** yfried_ has joined #openstack-infra19:53
AJaegerclarkb: upstreaming translations is still green, so time to approve the next one;)19:53
clarkbAJaeger: did a job run on the new changes?19:53
clarkbAJaeger: I was still waiting for one to run19:53
AJaegerclarkb: several now - example:https://jenkins.openstack.org/job/api-site-upstream-translation-update/9/console19:54
*** mwagner_lap has quit IRC19:54
clarkbAJaeger: woot I will approve the next one then19:54
*** olaph has joined #openstack-infra19:55
clarkbAJaeger: and the last change should wait for those three projects to have stable/liberty branches which should be real soon now19:56
AJaegerclarkb: then better mark it WIP for now19:56
*** spzala has joined #openstack-infra19:56
AJaegertime to call it a day - bye for now!19:57
clarkbdhellmann: any idea when nova and horizon will get liberty branches?19:57
clarkbAJaeger: ya will WIP now19:57
*** gordc_ has joined #openstack-infra19:57
*** AJaeger has quit IRC19:58
*** gordc_ is now known as guestblahasdfafa19:58
*** guestblahasdfafa has quit IRC19:58
*** cburroughs has quit IRC19:58
EmilienMclarkb: even with latest rabbitmq module, I still see the lsbdistid error that says the package is missing on the node where tests are run19:59
*** esker has joined #openstack-infra19:59
EmilienMhttps://jenkins07.openstack.org/job/gate-puppet-nova-puppet-unit-3.4-dsvm-centos7/31/console19:59
*** hodos|2 has joined #openstack-infra20:00
clarkbEmilienM: is facter doing that?20:00
openstackgerritSergey Reshetnyak proposed openstack-infra/project-config: Fix saharaclient gate  https://review.openstack.org/22676220:00
EmilienMclarkb: I'm running debug with Rakefile to determine if lsb-release is installed20:00
EmilienMclarkb: yeah20:00
openstackgerritMerged openstack-infra/project-config: Make translation pushes to gerrit branch aware  https://review.openstack.org/22595320:00
*** salv-orlando has quit IRC20:01
*** esker has quit IRC20:02
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add migration to fix wrong column name in test_metadata  https://review.openstack.org/22636320:02
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add db api methods to get keys from metadata tables  https://review.openstack.org/22616220:02
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add db api method to get test_run dicts for runs by key value  https://review.openstack.org/22687020:02
*** shardy_afk is now known as shardy20:02
*** fawadkhaliq has joined #openstack-infra20:02
*** hodos has quit IRC20:02
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Exit 1 if wrong number of nodes are deployed  https://review.openstack.org/22697020:02
*** dramalho has quit IRC20:03
jrollsdague: clarkb: it was that neutron patch. pew pew https://review.openstack.org/#/c/226969/20:03
*** hrubi has joined #openstack-infra20:03
clarkbEmilienM: I am currently relearning how facter works to understand what it does (its C++ now no longer ruby)20:04
EmilienMclarkb: yeah, should be faster :)20:04
mordredclarkb: yay20:04
*** matbu has joined #openstack-infra20:05
clarkbI mean20:05
openstackgerritMerged openstack/requirements: Update os-brick for new release 0.5.0  https://review.openstack.org/22651420:05
EmilienMclarkb: I'm running yum list in rakefile to make sure we have the package20:05
clarkbexec lsbrelease in C++ isn't really all that faster is it?20:05
*** fawadkhaliq has quit IRC20:05
clarkbits just harder to read and debug20:05
EmilienMclarkb: facter is faster in general I think20:05
EmilienMnot lsbrelease20:05
openstackgerritMerged openstack/requirements: Update python-novaclient for new release 2.30.0  https://review.openstack.org/22599320:06
*** dramalho has joined #openstack-infra20:07
openstackgerritJohn Trowbridge proposed openstack/diskimage-builder: ironic-agent element to output a .kernel file  https://review.openstack.org/21043620:08
clarkbI don't actually see where lsbrelease is execd so maybe it doesn't do that20:09
clarkbEmilienM: which makes me wonder if this is unrelated to the package20:09
clarkbbut still digging20:09
crinkleclarkb: EmilienM the facter on the nodes is still ruby http://logs.openstack.org/30/226830/6/check/gate-puppet-nova-puppet-beaker-rspec-dsvm-centos7/d409e0a/console.html#_2015-09-23_17_15_14_47920:09
crinklefacter 3.0 is c++20:10
clarkboh I thought we didn't pin facter, but we must20:10
* clarkb updates git branch20:10
crinkleI think facter 2.x is what comes with puppet 3.x, I don't think you need to pin20:10
*** stevemar has quit IRC20:11
*** stevemar has joined #openstack-infra20:11
clarkbcrinkle: we had to ping with puppet2.720:12
clarkband must've just kep the pin when we upgraded to 320:12
crinkleactually http://logs.openstack.org/30/226830/6/check/gate-puppet-nova-puppet-beaker-rspec-dsvm-centos7/d409e0a/console.html#_2015-09-23_17_15_51_423 is where beaker is installing it, so however beaker installs puppet (which I think is just apt-get install puppet) it installs facter 2.420:12
nibalizerI think the c facter is exposed as a package called 'cfacter' so you have to opt-in to get it20:13
*** angdraug has joined #openstack-infra20:13
nibalizeryou can have cfacter and facter together on the same system, then puppet.conf tells it which one to us20:13
nibalizere20:13
nibalizeror probably routes.yaml but still configuration in /etc/puppet20:13
*** stevemar has quit IRC20:13
*** salv-orlando has joined #openstack-infra20:14
*** bltavares has joined #openstack-infra20:14
crinkleEmilienM: beaker runs lsb_release so I don't think the problem is the lsbrelease package http://logs.openstack.org/30/226830/6/check/gate-puppet-nova-puppet-beaker-rspec-dsvm-centos7/d409e0a/console.html#_2015-09-23_17_22_26_01120:14
*** mrmartin has joined #openstack-infra20:15
EmilienMcrinkle: that's what I was wondering but I also thought beaker could have taken care of the package20:15
*** derekh has quit IRC20:16
crinkleEmilienM: oh I'm looking at the wrong logs, it's not running it in http://logs.openstack.org/30/226830/5/check/gate-puppet-nova-puppet-unit-4.0-dsvm-centos7/cc1856b/console.html20:16
crinklewhich is a unit test, not a beaker test...20:17
clarkbhttp://paste.openstack.org/show/473800/20:17
anteayaPiet: did you mention your survey in the #openstack-neutron channel?20:17
clarkbthats from a devstack-centos7 node in hpcloud which is the same place that test failed20:17
clarkbanteaya: yes Piet did20:17
*** mrmartin has quit IRC20:17
PietYep20:18
anteayaPiet: clarkb great thank you20:18
anteayaI'm getting better at reading conversations back to front20:18
clarkbwow tripleo ironic tests take 2.5 hours20:18
*** MarkAtwood has joined #openstack-infra20:18
PietThanks for completing the survey!20:19
*** rossella_s has quit IRC20:19
* clarkb notices because waiting for jenkins05 to be safe to restart20:19
*** rossella_s has joined #openstack-infra20:19
nibalizerclarkb: ouch20:19
EmilienMclarkb: some ansible & co take the same time20:19
EmilienMclarkb: our integration testing takes 20 min and it installs glance, cinder, nova, neutron, ceilometer, horizon and run tempest at the end.20:20
anteayadidn't we ask folks to have tests run in about 60 minutes?20:20
anteayaor am I mis-remembering20:20
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Allow more complex router creation  https://review.openstack.org/22695120:20
EmilienManteaya: a lot of jobs are > 60m20:21
anteayayes well 2.5 hours is way more than 60m20:21
anteayabut part of my brain remembers some sort of conversation at some point discussing trying to get folks to have tests complete by a certain time20:22
*** sdake_ has joined #openstack-infra20:22
anteayathe fact that isn't happening doesn't convince my brain I was never present for that discussion20:22
*** alexsyip has quit IRC20:23
crinkleEmilienM: 226830 seems to be the only change failing that unit test, are you sure it's not something in that change that's causing the break?20:23
clarkbanteaya: we do, but thats mostly for the large integrated gate, if you sta out of that and runtime only affects you its less of a concern20:23
clarkbanteaya: but does make me impatient waiting for script to finsih20:23
anteayaah, okay20:23
* anteaya nods20:23
anteayathat explaination makes sense to me20:23
anteayais it 60m for the integrated gate jobs?20:24
EmilienMcrinkle: see the Depends-On20:24
anteayaor am I wide of the mark there?20:24
EmilienMcrinkle: also, I dropped .fixtures file20:24
EmilienMcrinkle: and it's demonstrating our unit tests do not work with recent rabbitmq module because of apt module bug20:24
EmilienMcrinkle: see the old version of rabbimq module in fixtures20:25
*** sdake has quit IRC20:25
anteayafungi: it was a valourous attempt re: the pycharm request train20:25
*** weshay_xchat has joined #openstack-infra20:26
EmilienManteaya: a lot of jobs take more than 1 hour, specially third party CI20:27
jeblairwoot.  i'm running a benchmark devstack run on ovh20:27
clarkbanteaya: yes thats the general rule of thumb for the integrated gate20:27
EmilienManteaya: I won't give names or examples, you can easily find it in gerrit20:27
anteayajeblair: yay20:27
clarkbjeblair: did floating IPs get fixed or are you doing it manually?20:27
jeblairclarkb: manually20:27
*** trown is now known as trown|mtg20:27
anteayaEmilienM: clarkb's point was that the time frame I remember is for the integrated gate20:28
jeblairclarkb: i think mordred has pushed up rough draft changes to nodepool for that.  i'll review while this is running20:28
mordredjeblair: yes. I did20:28
jeblairalso, all of the spurious images are deleted20:28
anteayaEmilienM: and of all the things I have to talk to third party operators for I will leave it to projects to discuss length of test runs with them20:28
anteayaclarkb: thank you20:28
clarkbmordred: are those the ones that all failed?20:28
mordredclarkb: yup20:29
*** weshay_xchat has quit IRC20:29
mordredI have not had appropriate network access to actually test it, debug and fix it yet20:29
anteayajeblair: did you ever find out why so many images were created? if you said so in backscroll I haven't gotten to it yet20:30
jeblairanteaya: i'm not going to look into it because it happened with logic errors in nodepool.  the same errors may or may not have caused us to keep images around.  it's not worth investigating unless code that we think is supposed to work causes it.20:31
anteayavery good20:31
jeblairall bets are off with the code we were running last week20:31
anteayaI will accept this position20:31
*** spzala has quit IRC20:32
sridhar_raminfra team - our brand new experimental gate job for tacker is failing due to ERROR_ON_CLONE issue .. https://review.openstack.org/#/c/226072/. Looking for some guidance here.20:32
jeblairsridhar_ram: add your project to $PROJECTS20:33
sridhar_ramI do have that line in the tacker.yaml jenkins job20:34
EmilienMcrinkle: lsb_release seems installed, see https://jenkins01.openstack.org/job/gate-puppet-nova-puppet-unit-3.3-dsvm-centos7/33/console and grep lsb_release20:34
clarkbEmilienM: yes it is installed. ...20:35
sridhar_ramjeblair: here at https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/tacker.yaml#L1920:35
jeblairmordred: the test errors for the first job look to be lack of fakes20:35
EmilienMclarkb: just trying to figure out what's wrong - the error message told me it was not. Just checking20:35
jeblairsridhar_ram: link to the error line?20:36
sridhar_ramjeblair: I see some projects, like Senlin, see ERROR_ON_CLONE=True (they figure gate is running) and skip installing the client20:36
* sridhar_ram looking up..20:36
jeblairsridhar_ram: do you have a client library that your devstack plugin installs too?  you may need to add it to $PROJECTS as well20:37
sridhar_ramjeblair: we currently use LIBS_FROM_GIT to pull in the client and horizon pieces in (we don't have these in pypi yet)20:37
*** hemna is now known as hemnafk20:37
jeblairsridhar_ram: yeah, you'll need to add any git repos that aren't already in $PROJECTS (horizon probably is, see devstack-gate source code).20:38
sridhar_ramjeblair: oh, btw, the answer is yet .. our devstack plugin do install it20:38
openstackgerritChristopher Aedo proposed openstack-infra/puppet-apps_site: Add SSL support for apps.openstack.org  https://review.openstack.org/22698420:39
sridhar_ramjeblair: I see, so something like this ..  export PROJECTS="stackforge/tacker stackforge/python-tackerclient stackforge/tacker-horizon $PROJECTS"20:39
jeblairsridhar_ram: yes, but you can do it on 3 lines so it doesn't wrap :)20:40
docaedofungi: regarding SSL for app catalog, I took a first pass at it: https://review.openstack.org/#/c/226984/20:40
*** dramalho has quit IRC20:40
sridhar_ramjeblair: sure :) just saw those multi line patterns in other files20:41
*** achanda has joined #openstack-infra20:42
docaedofungi: I marked it WIP for now as I am sure I'm missing something? Unless hiera will fill in the cert details? at any rate, feedback is appreciated as always, from you or anyone else who wants to take a look20:42
sridhar_ramI still don't understand on how this magic happens - adding to PROJECTS will avoid gate to skip cloning these repos and there by avoiding git_clone error ?20:43
*** Sukhdev has joined #openstack-infra20:43
*** step6829 has quit IRC20:43
*** tiswanso has quit IRC20:44
jeblairsridhar_ram: devstack-gate is responsible for setting up all of the openstack git repos involved in a change, but it needs to know which ones to set up in advance.  adding the repo to $PROJECTS tells it this.20:45
*** hemnafk is now known as hemna20:45
*** salv-orlando has quit IRC20:45
jeblairsridhar_ram: devstack helps us avoid errors by refusing to perform any clones itself in the gate.  if devstack-gate sets up the repo, then devstack does not need to clone it, so the error does not occur.20:45
fungidocaedo: the hiera variables will be passed in by a separate but related change to the global site manifest in the system-config repo20:46
*** achanda has quit IRC20:47
*** bswartz has quit IRC20:47
docaedofungi: like magic! thanks - let me know what else I should do at this point, I assume a "depends-on" update is necessary then, against that patch for system-config?20:48
sridhar_ramjeblair: gate not doing clones make sense. then, within our devstack plugin check for "if we are running under gate" and avoid doing a "install_client" which in turn calls git_clone ?20:48
jeblairsridhar_ram: never check to see if you are running in the gate20:48
jeblairsridhar_ram: that's what got volkswagen in trouble20:49
sridhar_ramjeblair: okay :)20:49
*** achanda has joined #openstack-infra20:49
fungidocaedo: the system-config change would depends-on your change to the puppet-apps_site repo20:49
anteayaha ha ha20:49
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: [WIP] Add test coverate for grafana.py  https://review.openstack.org/22698620:49
* sridhar_ram reading devstack-vm-gate-wrap.sh on the side ... 20:49
docaedofungi: ok20:49
jeblairsridhar_ram: adding the client to $PROJECTS is the only change you should need to fix this20:50
openstackgerritMerged openstack/requirements: Remove workaround for pypy  https://review.openstack.org/22492420:50
sridhar_ramjeblair: sure20:50
fungidocaedo: also it looks like some additional work could be done to that change to make it default to using the local snakeoil certificate on the server when no key material is passed in. otherwise you need some additional conditionals to prevent it from trying to load the https half of the vhost config20:51
sridhar_ramjeblair: btw, stand up as a OpenStack-EPA and call out Senlin project ;-)20:51
jeblairwow http://hound.openstack.org/?q=ERROR_ON_CLONE&i=nope&files=&repos=20:53
openstackgerritMerged openstack-infra/project-config: Fix saharaclient gate  https://review.openstack.org/22676220:54
docaedofungi: ok, do I need to worry about those existing? Or just set the default to those (like in gerrit/manifests/init.pp for instances) and hiera will override20:54
clarkbjeblair: my favorite is the sed one20:54
*** sigmavirus24_awa has quit IRC20:54
jeblairclarkb: i haven't gotten to it yet.  i'm reading/patching one at a time.20:55
*** d34dh0r53 has quit IRC20:55
clarkbjeblair: ++20:55
clarkbyou'll get there20:55
*** achanda has quit IRC20:55
*** d34dh0r53 has joined #openstack-infra20:55
*** eglute has quit IRC20:55
*** achanda has joined #openstack-infra20:55
*** eglute has joined #openstack-infra20:55
fungidocaedo: yeah, puppet-gerrit is a reasonable example of that20:56
jeblairfeel free to follow my work with "topic:volkswagen"20:56
sridhar_ramjeblair: scandal unearthed ... will I get the whistle-blower status ? ;-)20:56
docaedogreat thanks - adding those make it so my local test worked20:57
*** puranamr has joined #openstack-infra20:57
jeblairsridhar_ram: you'll get the notoriety the wvu researcher who discovered it has had for the last year :)20:57
openstackgerritChristopher Aedo proposed openstack-infra/puppet-apps_site: Add SSL support for apps.openstack.org  https://review.openstack.org/22698420:57
*** thiagop has quit IRC20:57
anteayahound doesn't seem to adjust paths for projects that have moved from stackforge to openstack20:57
*** sigmavirus24_awa has joined #openstack-infra20:57
anteayamagnetodb as an example20:58
clarkbjeblair: I am happ to see youi werent kidding about the topic20:58
fungidocaedo: yeah, the goal of having a snakeoil fallback is that it's easy to test (locally and also in our ci)20:58
fungiclarkb: it's the people's car20:58
jeblairclarkb: omgsed20:58
clarkbjeblair: :)20:58
fungiyeah, that magnetodb one is classic20:59
fungii think i know the best way to fix it too20:59
jeblairfungi: ooh, i want to write that patch!20:59
jeblairsed -e 's/ERROR_ON_CLONE=True/ERROR_ON_CLONE=False/' -i $DEVSTACK_GATE/devstack-vm-gate.sh20:59
rm_worklol20:59
rm_workjeblair: will that not actually BREAK the barbican gate tho?20:59
rm_work(removing it)20:59
jeblairrm_work: it shouldn't but i don't actually care.21:00
rm_worklol21:00
anteayay'know it was in fort collins just last week that we discussed what it would take to get the neutron third party ci program rolling again21:00
fungijeblair: mordred already beat you to proposing the fix https://review.openstack.org/22474321:00
jeblairrm_work: they may need to adjust their job configuration.21:00
anteayawe said someone to confirm test results were actual results21:00
docaedofungi: thanks for the help, I think the patch is OK as far as I can tell now, just let me know if I need to do anything else. Appreciate your help as always21:01
anteayaI don't know the extent to which we were believed21:01
anteayasome sweet folks still believe folks report accurate results with testing21:01
openstackgerritSridhar Ramaswamy proposed openstack-infra/project-config: Add dependent repos to tacker gate job  https://review.openstack.org/22699421:01
jeblairfungi, mordred: does anyone know why that change hasn't merged?21:01
fungidocaedo: you're welcome. there are certainly other reviewers whose puppetry i trust far better than mine, so i'll let them weigh in21:01
jeblairdidn't we discuss it at a meeting, and doesn't it meet the threshold for passing?21:02
anteayait was about voting for the lone developer who would be left in the cold21:02
anteayaadding them to extra-atcs before it gets merged, I do believe was the argument21:02
jeblairanteaya: mine is a procedural question; i thought 7 votes meant pass, but it's complicated.21:03
docaedofungi: works for me, looking forward to seeing if there's anything else I need to do21:03
clarkbrm_work: without that change you never actuall test the code you aim to be testing21:03
clarkbrm_work: which is fail21:03
fungijeblair: i think it was just pending some additional comment in the commit message acknowledging that recent commits won't count toward atc status (though the rolls have already been generated for the tc election so it's likely irrelevant anyway)21:03
anteayajeblair: ack on your procedural question, I too thought 7 yes meant merge21:03
*** thingee has quit IRC21:03
sridhar_ramjeblair: team: you probably saw this flash by - just pushed https://review.openstack.org/226994 to fix that up...21:04
jeblairfungi: yeah, i understand the concern, and i don't object to that.  however, i think perhaps if the tc, as a body, thought that was enough of a concern to delay approval of the passage, perhaps they should not have voted for it in such numbers that, as far as i can tell, meet the criteria for the motion having passed.21:04
sridhar_ramjeblair: thanks for your help!21:05
*** hemna is now known as hemnafk21:05
fungijeblair: agreed. i am certainly not opposed to it, merely pointed out a potential risk (which was then discussed and presumably mollified?)21:05
*** glauco__ has quit IRC21:05
anteayafungi: thank you, not often I have to look up a word21:06
anteayayay21:06
*** alivigni has quit IRC21:06
jeblairttx: any reason why https://review.openstack.org/#/c/224743/ hasn't merged after leaving the TC meeting with 7 yes votes?21:07
*** trown|mtg is now known as trown21:08
*** glauco has joined #openstack-infra21:08
rm_workclarkb: well, in the new gate job, it is only used to clone the version of python-barbicanclient from master21:08
*** dprince has quit IRC21:08
rm_workwhich i guess though is supposed to be done via LIBS_FROM_GIT?21:08
clarkbyes LIBS_FROM_GIT21:08
rm_workis adding it to that var enough to get it done?21:09
openstackgerritChristopher Aedo proposed openstack-infra/project-config: Add app-catalog-common repository  https://review.openstack.org/22699921:09
clarkbrm_work: you also need to add it to the PROJECTS list like sridhar_ram did21:09
*** trown is now known as trown|outttypeww21:10
*** thorst1 has quit IRC21:10
*** sridhar_ram1 has joined #openstack-infra21:11
*** salv-orlando has joined #openstack-infra21:11
clarkbgerrit is really really slow on that GCing21:11
*** weshay_xchat has joined #openstack-infra21:12
*** julim has quit IRC21:12
*** puranamr has quit IRC21:12
*** sridhar_ram has quit IRC21:12
anteayaclarkb: this seems to happen every two weeks?21:13
anteayais that the frequency of restarts?21:13
clarkbya I think thats roughly how long the leak takes21:13
*** bswartz has joined #openstack-infra21:13
anteayaawesome21:14
*** ok_delta has quit IRC21:14
doug-fis_how do translations get proposed in Horizon to proposed/Liberty instead of master once rc1 is reached? I'm looking through the scripts but can't quite sort it out21:17
*** ZZelle_ has joined #openstack-infra21:18
clarkbdoug-fish the changes are in progress, they should go to stable/liberty unless hrm21:19
clarkbWe may actually need proposed-liberty in zanata then rename to stable-liberty after the switch21:19
*** dangers is now known as dangers_away21:20
doug-fis_oh - so the general idea is that the branches in zanata will match the branches in Horizon?21:20
clarkbyes with a / to - translation because zanata doesnt allow /s in the names21:20
*** esker has joined #openstack-infra21:20
anteayataron: so right now hound is not able to change repo names that have been indexed and then have had their paths changed21:20
doug-fis_I was expecting some mapping of mis-matched branch names. Making them match sounds much cleaner!21:21
mmmporktaron: monty: i'm actually working on that21:21
mmmporkanteaya: ^^21:21
anteayataron: for example, stackforge/magnetodb moved to openstack/magnetodb21:21
clarkbya I dont want to maintain mappings21:21
doug-fis_clarkb: yeah that makes sense. Thanks!21:21
*** tjones has left #openstack-infra21:21
anteayammmpork: oh, have you a patch?21:21
mmmporkoh wait, i'm working on adding new ones when the config changes21:21
mmmporkmonty brought it up a couple weeks ago at the infra community meeting21:21
anteayaokay, have you a patch?21:21
taronwell, that'd cover half of it anyway21:21
dims_fungi: clarkb: if i remember right, oslo-messaging py34 fails with "Segmentation fault (core dumped)" because of a python version issue, Does this ring any bells?21:21
mmmporki'm working on a patch21:21
anteayataron: so I'm thinking the place this would happen is this file: http://git.openstack.org/cgit/openstack-infra/puppet-hound/tree/files/hound.init21:22
anteayataron: is that correct21:22
clarkbdims_ yes the upstream python package from ubuntu should be fixed now/soonish21:22
anteayammmpork: have you anything on gerrit I can look at?21:22
fungidims_: should finally be fixed as of a few hours ago21:22
mmmporkhound is done through github21:22
mmmporki can link you to my fork, it's still WIP21:22
dims_clarkb: ack, let me go find it21:22
fungidims_: newer python 3.4 just showed up in trusty-updates today21:22
clarkbdims_ problem was the garbage collector freed free memory due to a bad traversal over freed objects21:22
dims_fungi: ah!21:22
fungithough likely needs to wait for new images21:23
mmmporkanteaya: taron: https://github.com/missaugustina/hound/commit/ecbad901337b1d9080664534db2ebb440e5de7f521:23
fungiso we probably shouldn't try until tomorrow21:23
dims_very cool, thanks fungi clarkb21:23
anteayammmpork: you are patching etsy's upstream repo?21:23
mmmporkyes21:23
openstackgerritChristopher Aedo proposed openstack-infra/project-config: Add app-catalog-common repository  https://review.openstack.org/22699921:23
clarkbdims_ basically it did for object in list delete object now delete all the things that it referred to21:23
taronanteaya: I'm not fully sure how hound handles reindexing things, and the hound.o.o instance is still monty's original version21:23
clarkbwhich led to the double free21:23
mmmporktaron: hound doesn't reindex things21:23
dims_clarkb: thanks!21:23
mmmporkit just loads on startup21:23
anteayataron: oh21:23
anteayataron: so puppet-hound isn't live yet?21:23
taronanteaya: nope, I'm missing something to hook hound into system-config21:24
fungidims_: for the record, clarkb filed that as bug 136790721:24
openstackbug 1367907 in python3.4 (Ubuntu Trusty) "Segfault in gc with cyclic trash" [Undecided,In progress] https://launchpad.net/bugs/136790721:24
anteayataron: not much sense trying to evaluate the code there if it isn't21:24
anteayataron: well do share your thoughts so far, since moving to your puppet module would be great21:24
jeblairfungi, mordred: https://review.openstack.org/#/c/227005/121:24
anteayataron: so you are missing something to hook into system-config21:24
dims_fungi: clarkb: cool, added url to my oslo.messaging bug (1499082)21:25
anteayataron: have you gotten any guidance as to what that might be?21:25
taronanteaya: yep. I have a patch, but I need to double check my syntax and then if that's not it I'm missing whatever will make system-config pull in the hound module when it runs its tests21:25
anteayataron: where is your patch?21:25
anteayammmpork: yes I know hound doesn't reindex things, that isn't part of their usecase as far as I can tell21:25
anteayabut it is part of ours21:26
dhellmannclarkb: if nova and horizon don't already have branches, I would expect them asap. I think we're waiting for a requirements change for horizon and nova had one FFE to wrap up21:26
* taron really wishes launchpad would stop logging them out21:26
fungidims_: fwiw clarkb added oslo.messaging to the original bug and sileht marked it as invalid21:26
dims_haha21:26
clarkbdhellmann and is it stable or proposed first? I cant keep it straight21:26
dims_ack21:26
anteayataron: is gerrit logging you out and you have to keep signing into gerrit?21:26
mmmporkanteaya: you'll need to talk to mordred then, what we discussed is adding new repos, not changing existing ones21:26
dhellmannclarkb: stable/liberty with special acls until after the release21:26
anteayammmpork: I think what you are working on is not what I am asking about21:26
clarkbdhellmann perfect everything should justw work for translations then21:27
clarkbdhellmann ty21:27
taronanteaya: yeah, I found the change though, and just found a few new comments from pleia2 from yesterday which I haven't read yet. https://review.openstack.org/#/c/216549/21:27
dhellmannclarkb: np21:27
anteayataron: if you have one tab with review.o.o open and open another and sign into the second one, the first one will kick you out again21:27
mmmporkanteaya: maybe, depends on how you want to reload those repos21:27
anteayataron: gerrit fights with itself, best to open the first tab and then sign in and then you are signed in for all new tabs21:28
mmmporkanteaya: if you are dealing with a running hound process and don't want to reload everything, then my patch is precursor work to that since i'm creating an inotify listener to check for config file changes21:28
anteayammmpork: I am just asking taron what she has done21:28
taronanteaya: I only ever keep one open, but it times out quite a bit more than most web services I'm used to21:28
anteayaI have made no decison21:28
*** notnownikki has quit IRC21:28
*** spzala has joined #openstack-infra21:28
anteayataron: hmmmm, okay21:28
jlvillalAny reason a user would not have a 'username' in Gerrit?  e.g.: murali.sundar@gmail.com21:28
anteayataron: well for starters can we have more detail in the commit message?21:29
mmmporkanteaya: yes i understand that, and i'm mentioning the work i'm doing because it's relevant to what you were asking about :)21:29
tchaypojlvillal: What makes you think they don’t have a username?21:29
*** otter768 has joined #openstack-infra21:29
anteayajlvillal: if they haven't given themselves a username in gerrit21:29
taronanteaya: mmmpork: the idea with the puppet module is that the service will be refreshed when projects.yaml changes, since hound can still find the indexes for things it's already indexed only the changes will be indexed21:29
fungijlvillal: you don't get one automatically. you have to go to https://review.openstack.org/#/settings/ and add one21:29
*** regXboi has quit IRC21:29
taronanteaya: mmmpork: inotify would be smoother, but it seemed like a reasonable stopgap21:29
taronanteaya: absolutely21:30
jlvillalfungi: Oh, interesting. I thought it was automatic to get a username. Thanks.21:30
fungijlvillal: it's covered in the fourth parahraph of http://docs.openstack.org/infra/manual/developers.html#account-setup21:30
mmmporktaron: ok cool, i had no context on the thing when mordred had mentioned it :)21:30
fungiparagraph21:30
anteayataron: having a good keyword friendly title followed by a commit body with current status, rationale for the change, and goal of the patch helps reviewers21:30
jlvillalfungi: So would that imply the person has never logged into Gerrit?21:30
anteayataron: right sounds great21:31
anteayataron: so let's get us running your code21:31
fungijlvillal: it implies they've only logged into the webui but never used the ssh api nor any authenticated rest api methods21:31
* taron is writing that down, has been stuck in the land of "this commit message looks bad but I don't know what it's missing"21:31
clarkbfungi: hrm jenkins05 is done running tests and script isn't exiting21:31
clarkbfungi: it does appear to have deleted the offline nodes though21:31
fungijlvillal: so also, by extension, means they've never uploaded a change for review since that happens via the ssh api21:31
clarkboh my ssh connectiondied21:32
anteayataron: sure, I have thoughts on commit messages and am happy to share them with you21:32
clarkblet me reconnect21:32
jlvillalfungi: Thanks. Strange to have a core-reviewer for a project not have a username, But I can handle it :)21:32
*** achanda has quit IRC21:32
fungiclarkb: yeah, the script seems to have terminated according to the screen buffer21:32
anteayataron: so I see you are naming the server codesearch.openstack.org21:32
anteayataron: had that been discussed previously?21:32
clarkbfungi: yup it worked \o/21:32
taronanteaya: that's in accordance with the spec21:32
clarkbso will get a new patch up with robustified offline node deletions in a bit21:33
clarkbI am restarting jenkins on that master now21:33
*** bpokorny has quit IRC21:33
fungijlvillal: chances are that's someone with duplicate accounts and they've been uploading changes with the ssh username of an older account but logging into the gerrit webui and reviewing changes with a newer account. unfortunately if you change the e-mail address with which you log into launchpad for openid authentication, that creates a new account in gerrit21:33
taronanteaya: which, on rereading the spec, I have more documentation to do anyway21:33
anteayataron: ah okay, great21:33
anteayawonderful21:33
*** otter768 has quit IRC21:34
taronhound.o.o is mordred's original test, codesearch.o.o will be the more permanent version21:34
jlvillalfungi: Okay. Thanks for the information. Very helpful :)21:34
fungijlvillal: i'm checking now to see if that user looks like they may be a duplicate21:34
*** doug-fis_ has quit IRC21:35
jlvillalfungi: https://review.openstack.org/#/admin/groups/964,members  Here is where I saw them.21:35
anteayapleia2: since this is a patch to infra-specs do we need to have an agenda item for it and voting? https://review.openstack.org/#/c/225945/ fungi?21:35
*** matrohon has quit IRC21:36
*** achanda has joined #openstack-infra21:36
anteayataron: okay, was just getting used to hound, but if codesearch is what the spec says, follow the spec21:36
*** MarkAtwood has quit IRC21:37
taronanteaya: it might be worth discussing more, since I don't think you're the only one who's gotten them confused. in the meantime I'll leave codesearch in21:37
openstackgerritJames E. Blair proposed openstack-infra/project-config: Remove magnetodb configuration  https://review.openstack.org/22701621:37
jeblairanteaya: this is why we should not recommend people use services that are not in production by the infra team21:38
*** MarkAtwood has joined #openstack-infra21:38
jeblairfungi, mordred: see "topic: magnetodb"21:38
anteayajeblair: no argument here, I didn't realize we weren't running taron's module yet21:39
anteayaI am guiltly of sharing the url with others21:39
anteayataron: also in the spec indexing keeping up with renames is mentioned21:39
*** pc_m has quit IRC21:40
anteayataron: so it doesnt have to be you, since your internship is over, but at some point that feature would be great to have21:40
anteayataron: and happy to have your help :)21:40
*** hemnafk is now known as hemna21:40
jeblairclarkb: i just ran devstack-gate in the foreground and it seems to have stopped with sigttou21:41
jeblairclarkb: while installing python-yaml21:41
*** burgerk has quit IRC21:42
clarkbjeblair: thats the thing rcarrillocruz ran into that I don't think we ever got to the bottom of21:42
jeblairclarkb: have you seen that in your ansible work?21:42
clarkblet me dig up my patch that died21:42
taronanteaya: tis in my plans, as long as I don't get knocked over by class or something21:42
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Switched location of global npmrc  https://review.openstack.org/22701921:42
*** MarkAtwood has quit IRC21:42
anteayataron: yup that is fine, just share your status when you can21:42
clarkbjeblair: https://review.openstack.org/#/c/160480/21:42
fungianteaya: pleia2: shouldn't really need a meeting cycle just to vote on whether the spec is implemented. if there is some objection later that it's really not complete then it can be moved back21:42
krotscheckfungi: ^^ Try #123125443221:43
anteayataron: and thank you21:43
clarkbjeblair: its SIGTTIN there but I think same problem21:43
anteayafungi: okey dokey, thank you21:43
fungijlvillal: i don't see evidence that's a duplicate account. i have a feeling a lot of the searchlight team may still be coming up to speed since that's a new-ish effort21:45
jlvillalfungi: Thanks for looking into it. I just modified my script to ignore users without a username.21:45
*** dramalho has joined #openstack-infra21:46
jeblairclarkb: hrm, the sigttou problem i'm running into is in d-g itself, not devstack.21:47
jeblairclarkb: so i don't think that would fix it21:47
jeblairclarkb: oh21:47
jeblairclarkb: wait it's in the script called in your patch, so it may affect it.21:48
jeblairclarkb: i'm not sure i'm keen on the implications though...21:48
jeblairclarkb: i think we really want child processes to die21:49
jeblairclarkb: otherwise, we could have things going on while we're trying to clean up and move log files etc21:49
anteayajeblair: do you also want to remove mangetodb from system-config statusbot and eavesdrop?21:49
clarkbya and I never really groked why it doesn't seem to happen consistently21:49
anteayajeblair: or would you like me to?21:49
jeblairanteaya: that'd be swell; can you set topic to 'magnetodb'?21:49
anteayacan do21:49
anteayaI'll make it dependent on the project-config change21:50
*** mjb has quit IRC21:50
*** mjb has joined #openstack-infra21:50
*** shardy has quit IRC21:50
fungijeblair: doesn't 227016 need to a parent change switching those projects to noop jobs first so the retiring change can merge to them?21:50
jeblairfungi: probably so, or we could just force-merge it :)21:51
*** jaypipes has quit IRC21:52
fungii am also okay with that answer21:53
openstackgerritBruno Tavares proposed openstack-infra/puppet-httpd: Fix proxy and redirect configuration file names.  https://review.openstack.org/22533121:53
fungijust didn't know if you were attempting to dry-run your proposed retiring workflow21:53
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate: Set dpkg to noninteractive  https://review.openstack.org/22702421:53
jeblairclarkb: ^21:54
openstackgerritAnita Kuno proposed openstack-infra/system-config: Remove magnetodb from statusbot and eavesdrop  https://review.openstack.org/22702521:54
*** esker has quit IRC21:55
*** amitgandhinz has quit IRC21:55
openstackgerritMerged openstack-infra/subunit2sql: Add tests for get_tests_run_dicts_from_run_id() and fix issues  https://review.openstack.org/22662221:55
anteayataron: an example of a commit message: https://review.openstack.org/#/c/227025/21:55
anteayataron: you should have all the information about what to expect from the code from the commit message21:56
anteayataron: let me know if you think I am missing anything21:56
openstackgerritRafael Folco proposed openstack-infra/system-config: Docs: Adding accessbot info to the IRC services page  https://review.openstack.org/22695221:56
anteayajeblair fungi I think we are in a force merge situation with magnetodb anyway as all their tests fail21:57
anteayanot all just most I guess21:57
*** achanda has quit IRC21:57
fungianteaya: that's the reason for splitting the project-config change in the retiring workflow21:57
anteayaah okay21:57
fungiupdate the projects to run only noop jobs, merge the change which removes all their files, then remove all record of them in our configuration21:57
anteayaif you want a noop patch I can write it21:57
fungibut for this time we can just merge the failing changes directly21:58
anteayaokey dokey21:58
*** esker has joined #openstack-infra21:59
*** esker has quit IRC21:59
*** dramalho has quit IRC21:59
*** sdake_ has quit IRC21:59
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Allow more complex router updates  https://review.openstack.org/22702721:59
fungithe split change solution is a way to not require intervention by gerrit admins, but in this case the person who proposed the changes is a gerrit admin anyway and there are no former core reviewers for those around to approve them regardless22:00
*** achanda has joined #openstack-infra22:00
anteayaha ha ha22:00
anteayagood to know for future though22:01
*** spzala has quit IRC22:01
openstackgerritMerged openstack-infra/project-config: Remove magnetodb configuration  https://review.openstack.org/22701622:01
*** eharney has quit IRC22:01
*** spzala has joined #openstack-infra22:02
openstackgerritClark Boylan proposed openstack-infra/puppet-jenkins: Add utility script for safe master shutdown  https://review.openstack.org/22239422:02
*** rfolco has quit IRC22:02
clarkbjeblair: ah, did that fix it for you?22:02
*** dzamboni has quit IRC22:02
fungitime of night for me to transition to my second job... i have a new career in the booming furniture construction industry22:02
openstackgerritRamy Asselin proposed openstack-infra/puppet-openstackci: Create a single-node 3rd party ci system  https://review.openstack.org/20033022:03
*** flaper87 has quit IRC22:03
*** fhubik_brb has quit IRC22:04
*** alexpilotti has joined #openstack-infra22:04
*** esker has joined #openstack-infra22:04
*** weshay_xchat is now known as weshay22:04
clarkbI will retest 222394 against jenkins-dev but the job listing update did run against jenkins05 ok22:04
*** ianw has quit IRC22:05
*** bharathm has joined #openstack-infra22:05
anteayafungi: woooo do all your books have homes yet/22:06
anteaya?22:06
taronanteaya: noted, thanks!22:06
anteayataron: welcome, your internship happened right in my busy time, the next couple weeks are slower for me22:07
anteayataron: hit me up if you have questions22:07
*** ianw has joined #openstack-infra22:07
taronanteaya: will do22:07
*** flaper87 has joined #openstack-infra22:07
*** hashar has quit IRC22:09
*** amuller has quit IRC22:10
*** stevemar has joined #openstack-infra22:13
*** geoffarnold has quit IRC22:13
anteayajeblair: on this patch do you think you should keep the install_selinclient command? https://review.openstack.org/#/c/227002/1/devstack/plugin.sh22:14
anteayathe echo is still there but the command is gone22:14
*** annegent_ has joined #openstack-infra22:14
*** stevemar has quit IRC22:15
*** esker has quit IRC22:15
*** openstackgerrit has quit IRC22:16
*** otter768 has joined #openstack-infra22:16
*** openstackgerrit has joined #openstack-infra22:16
*** annegentle has quit IRC22:18
*** bharathm has quit IRC22:19
*** esker has joined #openstack-infra22:19
fungianteaya: outfitting the library will hopefully be done by the weekend22:20
*** salv-orlando has quit IRC22:20
*** asselin_ has quit IRC22:20
*** mestery has quit IRC22:21
*** mestery has joined #openstack-infra22:22
*** salv-orlando has joined #openstack-infra22:22
*** esker has quit IRC22:24
*** gordc has quit IRC22:26
*** mriedem is now known as mriedem_away22:27
anteayafungi: yay books22:27
*** sridhar_ram1 has quit IRC22:27
anteayado you average more than one bookshelf per room?22:28
jeblairclarkb: i don't know; i just ran apt-get install python-yaml first :/22:30
*** ddieterly has quit IRC22:30
*** otter768 has quit IRC22:31
morgananteaya: what form of average? and what if you average less than one bookshelf per room... but there is a super huge room-sized bookshelf?22:32
morgananteaya: inquiring minds must know!22:32
morganfungi: ^ only relevant cause... bookshelves22:32
*** sridhar_ram has joined #openstack-infra22:32
* taron is curious as well, favors the room-sized bookshelf approach22:34
jeblairanteaya: senlin fixed, thanks22:35
anteayamorgan: you ask very good questions22:35
anteayajeblair: welcome22:35
*** jamielennox is now known as jamielennox|away22:35
morgananteaya: so few people appreciate these difficult questions!22:35
anteayamorgan: hmmm, I haven't yet spent the time on this that it deserves22:35
jeblairi've had to install temporary less-than-room-sized bookshelves while i wait for an opportunity to make the room-sized ones.22:35
anteayamorgan: what could they be thinking22:36
anteayamorgan: these are questions that deserve tea22:36
* anteaya goes to boil the kettle22:36
morgananteaya: Earl Grey, Hot.22:36
anteayamorgan: coming up22:36
morgananteaya ^_^22:36
*** otter768 has joined #openstack-infra22:36
morganjeblair: that is a good reason to have less than room sized shelves22:36
jeblairroom-sized ones facilitate having a library ladder, which is pretty much my goal in life.22:37
jeblairi mean, hidden spiral staircase behind a bookshelf is a stretch goal -- i don't want to give the impression that i'm done at library ladder.22:38
fungii am in the same situation as jeblair. assembling cheap-ish prefab shelving until i have the free time to cover walls with custom built-ins22:40
*** dims__ has joined #openstack-infra22:43
*** w_ has joined #openstack-infra22:43
clarkbSaga is just about the onlt physical media I buy anymore22:43
taronthat's what my parents said, 20 or 30 years later and instead we still have the same prefab ones22:44
jeblairtaron: but they don't make em like they used to ;)22:44
*** alexpilotti has quit IRC22:44
taronthis is true22:44
anteayajeblair: ha ha ha22:44
taronI was remarking earlier today on how much longer our 30 year old ikea shelves and table have lasted than any other furniture we've owned22:45
* anteaya offer morgan lemon22:45
anteayaI also started a fire22:45
anteayaworks with the images of library ladder22:45
anteayaand spiral staircase22:45
*** dims_ has quit IRC22:46
*** sabeen has quit IRC22:46
*** olaph has quit IRC22:46
anteayastone fireplace behind a heavy screen22:46
anteayato catch the sparks22:46
morganbut..22:46
morgan80+ degrees F here :(22:46
anteayanot here22:46
anteaya15C inside my house22:47
nibalizertaron: rebase? nudge nudge https://review.openstack.org/#/c/216549/22:47
*** sridhar_ram has quit IRC22:48
taronnibalizer: yeah poking it now, before my laptop inevitably dies to the 155 packages I am currently updating and I have to whip out a liveusb to boot it and get at my changes again22:48
nibalizer#archlyfe ?22:48
taronmore like #timetostopusingarch22:49
*** annegent_ has quit IRC22:49
taronI only left it off for a week...22:49
openstackgerritSpencer Krum proposed openstack-infra/puppet-httpd: Create a httpd::mod defined type  https://review.openstack.org/21683522:51
*** ZZelle_ has quit IRC22:52
*** jerrygb has quit IRC22:55
*** sridhar_ram has joined #openstack-infra22:56
taronand vim's libraries ran out from under it before I could edit the commit message. can't wait to reload this thing...22:56
*** weshay has quit IRC22:56
anteayayou sound like you are having lots of fun with your os choice22:57
*** gildub has joined #openstack-infra22:58
*** geoffarnold has joined #openstack-infra22:59
*** dingyichen has joined #openstack-infra22:59
taronI live in an awkward space where ubuntu and the like are all more bloat than I would like, but I haven't had the time to set up config management for my laptop which would make maintaining it less of an issue22:59
*** geoffarn_ has joined #openstack-infra23:00
taronluckily I'm the kind of person who breaks their networking and then fixes it again for fun23:00
anteayawooooo23:00
anteayaperfect os set up for you then23:00
taronyup, just need to layer gitolite or something similar on top of my git server23:01
*** trown|outttypeww is now known as trown23:01
jeblairclarkb, mordred: i get to this line in tempest, and then lose connectivity to the host.  it's happened twice on two different hosts, so it's looking like a pattern23:02
jeblair{1} tempest.api.compute.admin.test_agents.AgentsAdminTestJSON.test_update_agent [0.055964s] ... ok23:02
*** asettle has joined #openstack-infra23:03
clarkbjeblair uh mtreinish may be more help?23:03
*** Sukhdev has quit IRC23:03
openstackgerritJohn Trowbridge proposed openstack/diskimage-builder: ironic-agent element to output a .kernel file  https://review.openstack.org/21043623:03
jeblairmtreinish: ^ :)23:03
*** geoffarnold has quit IRC23:03
*** olaph has joined #openstack-infra23:04
jeblairclarkb: i'm just sshing in as jenkins, so this should just be exercising the same mechanisms we usually use, right?23:04
jeblairmtreinish, clarkb: (and new ssh connection attempts return "no route to host")23:04
*** annegentle has joined #openstack-infra23:04
*** annegentle has quit IRC23:05
*** w_ has quit IRC23:06
anteayaclarkb: did you just send jeblair to -qa?23:07
anteayaha ha ha23:07
*** w_ has joined #openstack-infra23:07
jeblairi don't have to do this :)  and i certainly don't have to do it alone.23:08
clarkbjeblair ya should be the same23:08
clarkbwhat does networking look like?23:08
clarkbone interface?23:09
openstackgerritSpencer Krum proposed openstack-infra/puppet-httpd: Create a httpd::mod defined type  https://review.openstack.org/21683523:09
*** olaph has quit IRC23:09
jeblairclarkb: log into 149.202.174.8023:09
*** tonytan4ever has quit IRC23:09
jeblairit's a newly booted host; have not run devstack yet23:09
jeblairclarkb: yes, one if23:09
jeblairjust eth023:10
*** hemna is now known as hemnafk23:10
*** geoffarn_ is now known as geoffarnoldX23:10
*** xyang1 has quit IRC23:12
jeblairclarkb: maybe i'll see if i can get a console or something23:12
*** stevemar has joined #openstack-infra23:13
clarkbso that shouldn't interfere with any of the private or public ranges23:13
clarkb(I like how simple it is)23:13
clarkbI wonder if it is possible that tempest is doing something to rip neutron protections for the host VM23:13
clarkbconsole would be good23:13
*** geoffarnoldX is now known as geoffarn_23:13
clarkbok jenkins safe shutdown looked good on jenkins-dev23:14
jeblair[10643.748739] kvm [750]: vcpu0 disabled perfctr wrmsr: 0xc1 data 0xabcd23:14
jeblairaroo?23:14
clarkbjeblair: is it possible we get nested virt there and it is exploding?23:15
jeblair cat /sys/module/kvm_intel/parameters/nested23:16
clarkbwe have vmx23:16
jeblairN23:16
jeblairbut maybe devstack changes that?23:16
clarkbjeblair: so we may need to hard set qemu23:16
clarkbjeblair: let me figure out how to do that if you want to try23:17
clarkb(also really neat that we have vmx)23:17
jeblairclarkb: yeah, there is so little about this cloud that i don't like.23:17
clarkbjeblair: you need to set LIBVIRT_TYPE=qemu in devstack23:18
clarkbjeblair: so you can use the passthrough localrc data option in d-g to do that23:19
clarkbor just hard update d-g23:19
clarkbbut I wouldn't be surprised if we are tripping over something funny with that23:19
clarkb(and we can make it actually work another day_23:19
jeblairclarkb: i'll try the passthrough, as my current process involves bootstrapping from nothing23:19
*** bpokorny has joined #openstack-infra23:20
jeblairexport DEVSTACK_LOCAL_CONFIG="LIBVIRT_TYPE=qemu"23:23
jeblairlike so, yeah?23:23
clarkbjeblair: ya that looks correct to me23:24
*** geoffarn_ is now known as geoffarnoldX23:25
*** geoffarnoldX is now known as geoffarn_23:25
* jeblair boots up some more test instances23:26
openstackgerritEmma Barber proposed openstack-infra/system-config: Add codesearch.o.o node and module  https://review.openstack.org/21654923:28
*** otter768 has quit IRC23:29
anteayataron: nice expansion of the commit message23:30
taron:) going to try and practice better discipline with that on my own projects too to get in the habit23:30
nibalizertaron: are you already working with a rooter on this?23:31
nibalizerif not I'd like to volunteer23:31
taronnibalizer: nope, go for it23:31
nibalizerbringing up a new node to host a service sounds like it would hit a lot of the rootering things I should knoow23:31
taron(someday I'll be able to read rooter without thinking of plumbing)23:31
anteayataron: habits are good23:32
nibalizertaron: what about those two variables pleia2 was asking about in the class?23:32
anteayaI gave a talk on them23:32
*** geoffarn_ has quit IRC23:32
*** achanda has quit IRC23:33
taronnibalizer: I think I failed at replying to comments, as it looks like it only posted as a draft23:33
taronoriginal change indicates jeepyb, but if pleia2 doesn't recognize them I kind of wonder if they actually need to be there23:33
anteayataron: go back and add a comment to the patchset that has the red balloon23:34
anteayathat would be patchset 123:34
openstackgerritBruno Tavares proposed openstack-infra/puppet-httpd: Fix proxy and redirect configuration file names.  https://review.openstack.org/22533123:34
nibalizeroh like you set those and the jeepyb class picks them up?23:34
*** hodos|2 has quit IRC23:36
taronnibalizer: possibly, see comments in https://review.openstack.org/#/c/178488/23:36
nibalizerweiird23:37
taronanteaya: aha, I see how that works now. thanks23:37
anteayataron: welcome23:38
anteaya:)23:38
taronnibalizer: could strip it out entirely and see what happens, but I'm not overly eager to abuse our CI more after all the linting I made it do on the other changes23:38
anteayaso maybe add in the comment that mordred had in his original patch?23:38
nibalizertaron: I don't see those variables in the puppet-jeepyb module at all (via grep)23:38
anteayataron: you can't abuse the ci any worse than anyone else23:38
anteayanever let fear of running testss stand in your way of trying something23:39
nibalizerya I agree with anita23:39
anteayatry removing them23:39
anteayalet's see how it explodes23:39
taronmm, good point. I'm gonna rip them out then and we'll see what happens, if it fails then we can put them back in with original comment23:39
anteayaand we will see how it fails, hopefully23:40
anteayaso we all will learn something23:40
openstackgerritEmma Barber proposed openstack-infra/system-config: Add codesearch.o.o node and module  https://review.openstack.org/21654923:40
taronand off it goes23:40
anteayataron: bravely done23:41
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: [WIP] Add test coverate for grafana.py  https://review.openstack.org/22698623:41
* anteaya goes to check the fire23:41
pabelangerianw: if you have some cycles today, wouldn't mind some reviews for grafyaml.23:41
ianwpabelanger: ok, i'll subscribe to that repo too23:42
*** dimtruck is now known as zz_dimtruck23:42
*** yfried_ has quit IRC23:42
ianwpabelanger: i spending some time with dib and fedora-minimal builds ... it is not filling me with joy23:43
pabelangerianw: Cool. Also going to give dnf a trying in 1hour. Looks like it was released into updates-testing23:43
pabelangerianw: Ya, I was planning on looking at that tomorrow23:43
pabelangerseen mordred comments on the review23:43
pabelangerFWIW: I had been testing with the fedora element the whole time23:44
*** Swami has quit IRC23:44
ianwyeah, i'm wondering if replacing cloud-init is a better way forward ... we'll see23:47
jeblairclarkb: died again :/23:47
clarkbjeblair: darn, not sure then23:47
anteayataron: so some feedback, the comment Original change indicates jeepyb. isn't very helpful to folks who don't know where the original change is and how to find it (like me)23:48
jeblairclarkb: no kvm dmesg msgs though23:48
anteayataron: can you add another comment with a link to monty's change?23:48
anteayataron: https://review.openstack.org/#/c/178488/523:48
anteayataron: then your comment can be understood by any reviewer23:48
*** rockyg has quit IRC23:49
clarkbjeblair: which probalby means that qemu was used, but whatever kvm and qemu are doing possibly trip the same thing?23:49
jeblairclarkb: yeah.  i think i'll need to pick this up tomorrow23:50
taronanteaya: yup, will do23:50
*** sridhar_ram has quit IRC23:50
anteayabut new errors, yay23:50
anteayataron: thanks23:50
*** baoli_ has quit IRC23:51
clarkbjeblair: ok, I am not sure where  Iwould look for next especially since dmesg doesn't have the kvm errors. Maybe pick a single tempest test to run that boots a VM and at least confirm or deny that works23:51
clarkbjeblair: then get fancier and fancier with the tempest tests until we can isolate a specific behavior23:51
anteayapycon.ca schedule is up: https://2015.pycon.ca/en/schedule/23:52
*** jamielennox|away is now known as jamielennox23:52
jeblairclarkb: ++23:52
*** wenlock_ has quit IRC23:52
anteayautah_dave from saltstack will be there \o/23:53
anteayait will be great to see him again23:53
openstackgerritBruno Tavares proposed openstack-infra/puppet-httpd: Fix proxy and redirect configuration file names.  https://review.openstack.org/22533123:53
anteayaI'll take him to my favourite greasy spoon chinese food restaurant23:54
anteayataron: nicely linked23:55
anteayaand it exploded nicely23:56
anteayataron: can you find the error yet?23:56
*** alexsyip has joined #openstack-infra23:57
*** ybathia has quit IRC23:58
*** vmbrasseur is now known as vmb_off23:58
anteayataron: hmmm unfortunately we didn't get test results on patchset two to compare to patchset three results23:59
anteayaI didn't look for that first, sorry about that taron23:59
*** MarkAtwood has joined #openstack-infra23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!