Tuesday, 2015-03-03

*** david-lyle has quit IRC00:00
clarkbpleia2: do you still have the output from launch-node handy? it should print out the cmmands to run at the end. we can get it to reprint if we need to00:00
clarkbpleia2: the only thing to keep in mind is that it will print two sets one for the old ip and one for the new one00:00
clarkbpleia2: so you just have to figure out which is which (I tpically dig the current dns records to figure out which set is which)00:00
pleia2clarkb: I don't, but we have some docs at http://ci.openstack.org/sysadmin.html#backups which may be sufficient00:00
clarkbpleia2: I think there is a flag to launch node where it just prints out dns info, let me find that00:00
clarkbpleia2: its the dns.py script in launch/00:01
clarkbpleia2: so you do something like `python dns.py $fqdn`00:01
pleia2ah, yeah, actually this isn't helpful, as all this stuff was copied over in the rsync00:01
pleia2k00:02
*** zz_dimtruck is now known as dimtruck00:02
*** markvoelker has quit IRC00:03
jeblairclarkb, pleia2: also, i think those commands will just _add_ the A/AAAA records, so we need to delete the old ones, otherwise we will dns rr between them00:04
clarkbjeblair: oh right good point00:04
clarkband I tend to find myself deleting via the webui because figuring out the rax dns client is weird00:04
*** otter768 has joined #openstack-infra00:04
pleia2clarkb: so the root user on each system will want to accept the backups server key?00:05
jeblairme too00:05
clarkbpleia2: yup00:05
clarkbI can delete the old dns records if it helps00:05
*** yamamoto has joined #openstack-infra00:06
jeblairpleia2: see the last paragraph of http://ci.openstack.org/sysadmin.html#backups00:06
*** bhunter71 has quit IRC00:06
pleia2jeblair: ah yes, good00:07
*** tiswanso has quit IRC00:07
*** hdd has quit IRC00:08
anteayaclarkb Sukhdev sure00:08
*** ZZelle_ has quit IRC00:09
*** otter768 has quit IRC00:09
openstackgerritMerged openstack/requirements: Bump oslo.log for critical nova regression  https://review.openstack.org/16043500:09
clarkboh cool my thought on what oslo.log was doing was correct00:11
jogodtroyer: the list, search for x86_64-linux-gnu-gcc on http://logs.openstack.org/94/160494/1/check/check-tempest-dsvm-full/85e0294//logs/devstacklog.txt.gz#_2015-03-02_21_59_00_99600:14
*** bswartz has joined #openstack-infra00:14
jogodtroyer: list of things we are compiling00:14
pleia2ok, ssh keys accepted00:14
*** annegentle has quit IRC00:14
pleia2clarkb: want to delete first then I can run dns.py?00:14
jogonot sure if any specific one is very slow but that is 68 compiles00:14
clarkbpleia2: sure, just the rax host records right?00:14
*** chlong has quit IRC00:15
pleia2clarkb: yeah, no hp server yet00:15
pleia2clarkb: well, the hp server is completely gone, so I guess we could delete those00:15
clarkbpleia2: ok will delete both sets00:15
*** marun has joined #openstack-infra00:15
dtroyerjogo: and how many are there in a straight run?  Everything in that list is something that choked in a venv00:15
clarkblooks like its just A records to worry about00:15
dtroyerthis is the proce of not using system packages00:15
jogodtroyer: ohh so this could be venv related?00:16
jogodtroyer: are there fixes for those up?00:16
dtroyeryes.  this is ALL venv related, that's the whole reason we're building wheels00:17
*** unicell1 has quit IRC00:17
*** unicell has joined #openstack-infra00:17
openstackgerritMerged openstack-infra/infra-specs: Add nodepool-launcher spec  https://review.openstack.org/14081200:17
clarkbpleia2: done00:17
*** stevemar has joined #openstack-infra00:18
mordredSpamapS, greghaynes is there an "easy" dib cantrip for "I want to install this thing via pip from a git repo" ?00:18
jogodtroyer: right, but if there are some fixes outstanding for these things, maybe those will bring the stack.sh time back down00:18
*** unicell has quit IRC00:18
pleia2clarkb: thanks, running script now00:18
*** unicell1 has joined #openstack-infra00:18
dtroyerjogo: https://review.openstack.org/156883 is the first in the chain of wip venvs for services00:18
clarkbpleia2: remember to only run the half of the commands for the new node00:18
dtroyernothing is going to bring those times down (per-run) except building the wheels with nodepool00:19
clarkbor putting wheels in the mirror00:19
jogodtroyer: http://logs.openstack.org/84/156884/4/check/check-tempest-dsvm-postgres-full/16f789b/logs/devstacklog.txt.gz (from one of your patches) is still pretty slow00:20
dtroyerclarkb: that's above my pay grade00:20
clarkbdtroyer: :)00:20
dtroyerfwiw, just touch $DEST/.wheelhouse and stack.sh will skip the whole thing…00:21
pleia2clarkb: sourced the creds file and set the FQDN, then ran it, it didn't error... can you take a look at the dns records to see if it did the right thing?00:21
clarkbpleia2: sure00:21
marunanteaya: can do00:21
clarkbpleia2: you added an A record for the rax host?00:22
jogodtroyer: can you comment on https://review.openstack.org/#/c/160548/1 ?00:22
jogodtroyer: as I think mtreinish's patch should help speed things up. clarkb your thoughts too00:22
pleia2clarkb: I ran the dns script for ci-backup-rs-ord.openstack.org00:22
clarkboh btw rax reboots this week00:22
jogo20 minutes for devstack is too long IMHO00:22
*** bhunter71 has joined #openstack-infra00:22
clarkbpleia2: oh the dns script should only print out commands to run00:23
pleia2ah, dns script just gave me security warnings00:23
pleia2I'll have a look at it00:23
mordredSpamapS, greghaynes: nm00:25
clarkbpleia2: I think thats failing on the same nova catalog thing00:25
clarkbpleia2: which is good fun00:25
anteayamarun: thanks00:25
greghaynesmordred: weve solved that problem numerous ways00:26
greghaynesnot sure which one I like best00:26
greghaynesmordred: curious how youre doing it?00:26
*** dims has quit IRC00:27
clarkbmordred: I think we need to add your fix for launch node into dns.py ya?00:27
mordredgreghaynes: I decided to go for source-repositories00:27
clarkbalso maybe if we just update keysteonclient its fixed now?00:27
pleia2clarkb: http://paste.openstack.org/show/185646/00:27
* clarkb tries with a virtualenv00:27
mordredclarkb: yes. if you update keystoneclient it _should_ be fixed00:27
*** mtanino_ has joined #openstack-infra00:28
*** mtanino has quit IRC00:29
clarkbnope still not working00:29
pleia2welp, openstack is broken00:30
openstackgerritMaru Newby proposed openstack-infra/project-config: Add the neutron func job (nv) to devstack-gate  https://review.openstack.org/15967200:30
clarkbOH!00:30
clarkbbecause its ord not dfw00:30
marunanteaya: done00:30
pleia2oh bother, not that again00:30
pleia2setting the proper envar00:31
clarkbya that fixed it for me but I was also using my venv so possible that you also need new keystonecleint00:31
pleia2clarkb: thanks, much better00:31
jeblairpleia2: we all get to take a drink every time one of us forgets to do that!00:32
pleia2jeblair: haha00:32
*** e0ne is now known as e0ne_00:33
*** e0ne_ is now known as e0ne00:33
pleia2clarkb: ok, finally done, I even added the correct (new) server00:34
*** e0ne has quit IRC00:34
clarkbwoot00:34
anteayamarun: thanks00:34
anteayapleia2: yay00:35
*** marun has quit IRC00:35
pleia2(added both the A and AAAA)00:35
clarkbif jenkins04 holds up I will likely update the other servers towards the end of the week to ssh-slaves version 1.900:36
clarkbbut I will keep an eye on 04's thread list to see if it is leaking those remote computer threads00:36
jogoclarkb: so I would like to get to the bottom of why it takes devstack 20 minutes to boot.00:37
*** bknudson has joined #openstack-infra00:37
clarkbjogo: I think dtroyer explained it00:37
openstackgerritBen Swartzlander proposed openstack-infra/project-config: Set manila tempest job concurrency to 12  https://review.openstack.org/16057700:37
clarkbjogo: its the added cost of installing pacakages with pip that include long compiles00:37
StevenKpleia2: WRT to helping on Zanata, I'm happy to pivot back to staring at the Java client if the Python client isn't going to really help00:39
pleia2StevenK: so re: python client for zanata, I think we probably do want to invest time in working with redhat to maintain it (that seemed to be the consensus at the summit)00:39
pleia2StevenK: and I added you to the story to package it, so congratulations! ;)00:39
openstackgerritTimothy R. Chavez proposed openstack-infra/project-config: Print instance UUID to log  https://review.openstack.org/15625200:39
pleia2tasks++00:39
*** dangers is now known as dangers_away00:39
jogoclarkb: so how do we go forward? looking at his venv patches they don't speed things up00:40
pleia2StevenK: but maybe we should bring it up on list again so AJaeger can chime in (he's in europe, so it occurs to me that he'll never see you)00:40
jeblairclarkb, yolanda: I think I may have merged https://review.openstack.org/#/c/133249/ in error... does that seem to you that it might be the case?00:40
StevenKpleia2: Or in my evening00:41
clarkbjeblair: looking00:41
clarkbjeblair: nope you had askedaboutthat one right after you hit the go button and I was fine with it00:41
openstackgerritMonty Taylor proposed openstack-infra/project-config: Add config-drive element  https://review.openstack.org/15413200:41
clarkbjeblair: since the thing I mentioned in my review was addressed00:41
jeblairclarkb: oh, ok.00:42
mordredSpamapS: ^^ look at the systemd things that Ng did00:42
clarkbjogo: did we expect them to speed things up?00:42
clarkbjeblair: maybe leave a comment on the change about it?00:42
pleia2StevenK: I'm happy we got licensing fixed on the java client, even if that meant that it was not BSD or Apache, but LGPL (what?)00:42
mordredSpamapS: basically, the obviate the need for that other script00:42
pleia2"it's BSD here, and Apache here, which is it?" "LGPL" D:00:42
StevenKpleia2: I think trying to assemble something working from the maven artifacts is going to end in pain, so I need to find the github for the java client00:42
jeblairclarkb: okay, i have left a note for myself for the next time I see that.  :)00:42
openstackgerritJames E. Blair proposed openstack-infra/infra-specs: Retitle some specs for clarity  https://review.openstack.org/16058000:42
StevenKpleia2: The Python client is LGPL200:42
StevenKEr, LGPL2+00:43
SpamapSmordred: yeah that looks simpler than the upstart for the most part. :)00:43
mordredSpamapS: I'm thinking we coudl make the upstart stuff work basically the same00:43
StevenKpleia2: They ship a copy of the GPLv3 and the LGPLv2.1 license with the Python client, but the source files are LGPL2+. Argh!00:44
SpamapSmordred: yeah00:44
jogoclarkb: no, but we need to speed things up anyway00:44
pleia2StevenK: I think this is the source for the java one https://github.com/zanata/zanata-client (readme seems to think so)00:44
pleia2looks like someone is poking around the python client at least, last update 6 days ago https://github.com/zanata/zanata-python-client00:44
*** ghostpl_ has joined #openstack-infra00:44
mordredSpamapS: like, I _think_ should be able to make bin/process-config-drive go away00:44
SpamapSmordred: right, in upstart you'd just add it to fstab with noauto, and then in pre-start, 'mount /mnt/config'00:44
jogoclarkb: ahh cool looks like https://review.openstack.org/#/c/160548/ is a good start and a first step for something00:45
StevenKpleia2: Yeah, I went looking on github and that's when I found the Python client00:45
StevenKpleia2: Which I've mostly packaged00:45
jeblairpleia2, StevenK: catch me up here -- can we/will we use the python client?  i like it when our tooling uses python :)00:45
SpamapSmordred: it kind of looks like the upstart one doesn't even have the mounting bit?00:45
mordredSpamapS: the script doesn't change anything in networking if there is nothing to pull from config-drive00:45
clarkbjogo: yup reasonable to start there00:45
mordredSpamapS: it seems like as long as we can get it to run before the start network events fire00:46
mordredSpamapS: then we could even have the dhcp files sitting on the machine before hand00:46
mordredSpamapS: yeah?00:46
pleia2StevenK: oh good00:46
pleia2jeblair: the python client for zanata is only "kind of" maintained, not many folks in the redhat community were using it (they use the java one)00:46
SpamapSmordred: sadly no. if you have the dhcp interfaces sitting around, udev will ifup them and they'll dhcp as soon as possible.00:46
pleia2jeblair: AJaeger knows more about the state it's in, but I think we convinced redhat to give the python client some love while we were at summit since we want to use it00:47
SpamapSstart on net-device-added00:47
mordredSpamapS: ok. so we need to have the files be blank in all cases, and then just make sure that we write out dhcp files if there's nothing in config drive, yeah?00:47
* pleia2 likes when our tooling using python too00:47
SpamapSmordred: network-interface will see it, and ifup it, and now you're waiting on dhcp.00:47
jeblairpleia2: cool00:47
pleia2uses too00:48
*** markmcclain has quit IRC00:48
SpamapSmordred: right, thats why we added the dhcp-all-interfaces thing.00:48
*** markmcclain has joined #openstack-infra00:48
*** ghostpl_ has quit IRC00:49
SpamapSmordred: oh hm, you could maybe have the dhcp ones there, but in the group "dhcp" instead of "auto", and then have your config-drive-finder run 'ifup --allow=dhcp -a'00:49
*** tsg has joined #openstack-infra00:50
SpamapSmordred: I mean have your config-drive-finder run that if it can't find a config drive.00:50
SpamapSthat would produce an image that works in both cases.00:50
jogoclarkb: ohh the slow down is very recent00:50
jogohttp://status.openstack.org/elastic-recheck/index.html#131106600:50
jogodtroyer: ^00:50
jeblairjogo, mordred: pbr released today00:51
*** MaxV has quit IRC00:51
mordredI thought it did a speedup?00:51
mordredwe're seeing a slow-down in a different place?00:51
SpamapSmordred: bbl, have to run fetch chidren00:51
SpamapSchildren00:51
clarkbhrm 04 may still be leaking those threads00:51
jogojeblair:  that was a speedup for running rootwrap, can't speak for anything else00:51
jogomordred: what time was your release?00:52
ShrewsSpamapS: hoping you meant *your* children00:52
jogochecking timestamps in logstash.o.o00:52
Shrewsmordred: ugh. do i really want to review your shade keystone projects patch?00:52
mordredjogo: 18:32 UTC00:53
*** hdd has joined #openstack-infra00:53
mordredShrews: probably not00:53
mordredShrews: you can wait if you want - it needs to grow domain parameters00:53
Shrewsmordred: then i shall wait00:54
clarkbI take that back 04 does seem to be able to cleanup the forRemoting threads so mabye it isn't leaking them \o/ time will tell00:54
clarkbdstufft: so given the wheelhouse with findlinks, if say lxml updates their version on pypi will pip grab and build that or iwll it insist on using the wheelhouse version?00:55
StevenKpleia2: Some way to test the Python client functionaility would be awesome00:57
jogomordred: hmm seeing the failures before pbr00:57
mordredjogo: that time is when I announced it in IRC, fwiw00:59
mordredjogo: it could have released 10-15 minutes before that00:59
pleia2StevenK: yeah, care to start a thread on openstack-infra and cc: camunoz@redhat.com to chat about the state of the python client? I hope to have our own server up soon that we can do tests against our own stuff (but java app+plugins+puppet is tricky, slow going)01:00
clarkbfwiw 05 looks like it may be in similar trouble to what 04 had01:00
jogomordred: seeing it way before then, I think but logstash is really slow for some reason01:00
clarkbmelody claims close to 9k threads in the graph, trying to get exact number now01:00
jogomordred: looks like closer to 20-24 hours ago01:01
StevenKpleia2: Let me follow your link to the Java client rather than using the Maven artifacts, and if that gets me closer then we have two.01:01
pleia2StevenK: ok01:01
*** jaypipes has quit IRC01:03
pleia2ugh, still didn't get to asselin's netcat gerrit tester for firewalls and it's hour 10 of my day :\01:03
clarkbjogo: possible that one of those dependencies released and resulted in a much longer ocmpile?01:03
mordredjroll: I have a stupid question ...01:03
mordredactually01:03
mordredJayF: ^^ you too01:03
*** dannywil_ has quit IRC01:03
pleia2I'll see what I can get done in the morning, doing some evening now01:03
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Only query jenkins plugins if config provided  https://review.openstack.org/15882601:03
jogoclarkb: maybe, will have to resume this a bit later though01:03
clarkbpleia2: what do we need there just netcat -kl 29418 running in screen?01:03
mordredJayF, jroll: the nova patch to add static network config info to config-drive01:03
mordredwhat happens if a deployer is a dhcp deploy?01:04
mordreddoes the network info still show up in config-drive?01:04
jrollmordred: it just passes what neutron knows into the configdrive01:04
pleia2clarkb: I think so, but I figured we'd want it puppetized and all01:04
mordredjroll: so it does it always01:04
jrollmordred: the NetworkInfo object or whatever on the instance01:04
jrollmordred: I think so but unsure01:04
*** markvoelker has joined #openstack-infra01:04
clarkbmelody says 05 has almost hist 10k threads and is just above 9k now01:04
JayFJoshNang: ^ is actually the owner of that patch fwiw01:05
JayFdo you know JoshNang ?01:05
mordredk. so, at some point in the future when it hits nova and that patch hits a cloud that _Does_ have dhcp, we'll want to figure out how to differentiate01:05
mordredJayF: I don't think so?01:05
JoshNango/01:05
mordredJoshNang: ohai101:05
mordred!01:05
mordredJoshNang: neutron metadata into config-drive01:05
JayFhe sits across from me and jroll (aweeks is beside him)01:05
JayFwe're all one chunk of Ironic goodness in Rackspace :P01:06
mordredJoshNang: I'm curious as to what the world looks like when that patch hits a cloud that does run with dhcp01:06
JoshNangmordred: lemme pull up the review...it was quite awhile that i actually wrote this code :/01:06
*** otter768 has joined #openstack-infra01:06
clarkbI am putting 05 in shutdown mode now so that we stop relying on it while its in an unhappy place01:06
mordredJoshNang: will there be any way for a node to tell from the config-drive metadata that it should do static config or that it should do cloud dhcp01:06
mordredJoshNang: thansk!01:06
mordredJoshNang: (also, thank you for writing the patch)01:07
clarkband with that its the end of the day for me01:07
JoshNangmordred: np! :D01:07
JoshNangso, if its configured by dhcp, the network type should be ipv[4|6]_dhcp01:08
JoshNangwhere it normally would be ipv[4|6]01:08
anteayaclarkb: happy end of the day01:08
*** dimsum__ has joined #openstack-infra01:08
*** david-lyle has joined #openstack-infra01:09
mordredJoshNang: AWESOME! Thank you!!!!01:09
JoshNangmordred: :D01:09
anteayaI should do the same, next meeting in less than 7 hours01:09
mordredJoshNang: that makes everything so much easier than I was fearing01:10
JoshNangmordred: woooooo! now i've never tested that beyond unit testing...but i'm reasonably confident it should work01:10
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Support hacking module <= 0.10.1  https://review.openstack.org/16058701:10
greghaynesclarkb: just ran test locally and looks like pip does the right thing WRT checking upstream index as well as find-links01:11
mordredJoshNang: well ... I may send you a link to a thing in just sec to see if you think I'm overly crazy01:11
*** unicell1 has quit IRC01:12
JoshNangmordred: kk01:12
*** unicell has joined #openstack-infra01:12
*** markvoelker has quit IRC01:13
*** unicell has quit IRC01:13
*** unicell1 has joined #openstack-infra01:14
*** baoli has joined #openstack-infra01:16
*** patrickeast has joined #openstack-infra01:17
*** penguinRaider has quit IRC01:17
*** Sukhdev has quit IRC01:17
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Reorder imports to match hacking guidelines  https://review.openstack.org/13346501:17
*** annegentle has joined #openstack-infra01:17
*** patrickeast_ has joined #openstack-infra01:18
*** patri277 has joined #openstack-infra01:18
*** 32NABGDWG has joined #openstack-infra01:18
*** patrickeast__ has joined #openstack-infra01:18
*** penguinRaider has joined #openstack-infra01:18
*** tiswanso has joined #openstack-infra01:18
*** krtaylor has quit IRC01:20
clarkbjeblair: 160491 and its child should fix a couple zuul test races01:21
*** patrickeast has quit IRC01:22
*** tiswanso has quit IRC01:23
*** patrickeast has joined #openstack-infra01:24
*** ivar-laz_ has joined #openstack-infra01:28
*** patrickeast_ has quit IRC01:29
*** penguinRaider has quit IRC01:29
*** annegentle has quit IRC01:29
*** patri277 has quit IRC01:30
*** patrickeast__ has quit IRC01:30
*** 32NABGDWG has quit IRC01:31
*** ivar-lazzaro has quit IRC01:31
*** penguinRaider has joined #openstack-infra01:31
*** ivar-laz_ has quit IRC01:32
mordredclarkb, JayF, jroll, SpamapS: anybody think of any reason why I shouldn't just put this into our fstab?01:33
mordredecho "LABEL=config-2 /mnt/config iso9660 ro,auto,nofail 0 2" >> /etc/fstab01:33
jrollmordred: I don't see why not, but idk how computers work01:33
*** krtaylor has joined #openstack-infra01:33
mordredjroll: that's fair01:33
jrollno reason that label shouldn't be correct though01:33
* mordred is just thinking he was making this too hard ...01:34
JayFmordred: that works01:35
*** patrickeast_ has joined #openstack-infra01:35
*** patrickeast__ has joined #openstack-infra01:35
*** patri585 has joined #openstack-infra01:35
*** patri806 has joined #openstack-infra01:35
*** dimtruck is now known as zz_dimtruck01:38
*** achanda has quit IRC01:38
*** patri806 has quit IRC01:38
*** patrickeast_ has quit IRC01:39
*** patri585 has quit IRC01:39
*** patrickeast__ has quit IRC01:39
zxiirozaro: ping01:39
*** patrickeast_ has joined #openstack-infra01:40
zxiirozaro: I've been told I should get your opinion / comment on this patch regarding where to put some functions in JJB https://review.openstack.org/#/c/158989/01:40
*** patrickeast has quit IRC01:41
*** patrickeast has joined #openstack-infra01:41
*** bhunter71 has quit IRC01:41
*** patrickeast__ has joined #openstack-infra01:41
*** patri891 has joined #openstack-infra01:41
*** patrickeast___ has joined #openstack-infra01:42
*** ddieterly has joined #openstack-infra01:44
*** bdpayne has quit IRC01:45
*** annegentle has joined #openstack-infra01:45
*** asselin_ has joined #openstack-infra01:46
*** ddieterl_ has joined #openstack-infra01:47
*** ddieterly has quit IRC01:47
*** sarob has joined #openstack-infra01:50
*** penguinRaider has quit IRC01:50
openstackgerritIan Cordasco proposed openstack-infra/project-config: Fix os-ansible-deployment publishers one last time  https://review.openstack.org/16060001:51
*** penguinRaider has joined #openstack-infra01:51
*** zz_johnthetubagu has quit IRC01:52
*** adalba has quit IRC01:52
*** david-lyle has quit IRC01:52
*** vilobhmm2 has quit IRC01:53
*** david-lyle has joined #openstack-infra01:53
SpamapSmordred: can we tag more things with nofail01:54
SpamapSlike, projects01:54
mordredSpamapS: I've got an awesome patch coming up for you ...01:55
*** claudiub has quit IRC01:55
mordredSpamapS: you're going to LOVE it01:55
greghaynesos-nofail-deployment?01:56
SpamapSos-nofail-config01:56
SpamapSwe only do os-something-config01:56
greghaynesor maybe thats the name for the second infra cloud - nofail-cloud01:56
SpamapSjust nofail01:57
SpamapSbe as ambiguous as cloud01:57
*** Longgeek has joined #openstack-infra01:57
mordred:)01:57
openstackgerritJoshua Hesketh proposed openstack-infra/project-config: Fix os-ansible-deployment publishers one last time  https://review.openstack.org/16060001:58
mordredSpamapS, greghaynes: glory in this: https://gitorious.org/mordred-temp/process-config-drive/source/42ebd249c82aa2ce5e9ceae10b61f198abf385ba:01:59
mordredSpamapS: glory I tell you01:59
greghaynesoh wow, gitorious still exists01:59
jrollmordred: did you give up on github?01:59
mordredgreghaynes: yup. I recently realized that unless somebody else forces me to use github for somethign, there is no reason for me to use it willingly01:59
jrolls/give up/ragequit/01:59
mordredjroll: well, yeah. it's not free01:59
jrolloh01:59
jrollyeah.01:59
mordredjroll: and the foudners are GIANT ASSHATS01:59
jrollgitlab is pretty nice too, btw01:59
mordredso I don't really think I should support them02:00
mordredI know my abdication will mean little02:00
mordredbut still - they hate women02:00
mordredand free software02:00
*** carl_baldwin has quit IRC02:00
jrollgreat reasons02:00
mordredalso - usually only use it to toss up temp repos before I import them here anyway :)02:00
jrollwait did you just rewrite cloud-init/network_stuff.py02:00
mordredyes02:00
mordredwell, not JUST now02:01
jogomordred:  what  about gitlab?02:01
jogomordred: well gitorious has a much better name02:01
*** dmsimard_away is now known as dmsimard02:01
mordredjogo: there you go :)02:01
jrollheh02:01
sigmavirus24GitLab has a more familiar interface and a less complex organizational structure for repositories02:01
sigmavirus24then again, complex may be good02:01
jogomordred: I always thing of The Notorious B.I.G when I hear of gitorious02:01
* sigmavirus24 hasn't been following the discussion02:02
jrollif you're just using it for temp hosting, either works (then again, so does any server with ssh)02:02
sigmavirus24jroll: ++02:02
jrollbut gitlab has decent merge requests etc02:02
sigmavirus24jroll: yeah, I've grown to appreciate gerrit's flow though02:02
openstackgerritMonty Taylor proposed openstack-infra/project-config: Add config-drive element  https://review.openstack.org/15413202:02
jrollalthough, working on a gitlab project after using gerrit makes me rage02:02
jroll+102:02
mordredjroll: +10002:02
jogomtreinish: based on some rough testing, your patch https://review.openstack.org/#/c/160548/1 should save about 5 minutes per job02:02
*** asselin_ has quit IRC02:02
mordredjroll, SpamapS, greghaynes: if you combine the repo I just showed you with the updated elements in that patch02:03
mordredthen what you shoudl have is a base instance that always has config-drive if it exists02:03
mordredand a script that will either output static config or dhcp02:03
*** kmartin has quit IRC02:03
*** annegentle has quit IRC02:03
jrollneat02:03
jrolleven if it is DIB02:04
* jroll smirks02:04
mordred(one bug todo - but it's a theory that we will not hit until 8 months from now, so there is time002:04
mordredjroll: :)02:04
mordredjroll: you know, you could ditch your cloud-init fork and use process-config-drive02:04
mordredjroll: and have unpatched cloud-init run to handle user-data requests :)02:04
jrollmordred: we do other things with cloud-init, like user-data and ssh keys02:04
jrolloh, true02:04
mordredif you're in to that sort of things02:04
jrollhowever our images team would probably kill me02:05
mordredyah02:05
mordredit's not important02:05
jrolland it doesn't really give any benefit at the moment02:05
jroll(to us)02:05
mordredyou've got the pipeline to deal with the complexities of cloud-init full-on02:05
mordredwhereas it's a really big beast on our end and I'm pretty sure not worth wrangling, considering that script above shoudl do everything we've ever wanted out of ut02:05
mordredit02:05
jrollyou don't have an images team?02:05
jroll:P02:05
mordredjroll: you're looking at him02:05
jroll:)02:06
*** rmcall has joined #openstack-infra02:06
*** rwsu is now known as rwsu-afk02:06
mordredNg: ^^ when you wake up - the patch I just updated could use some love to make the upstart as good as the systemd files you made02:06
mordredNg: also - you can remove the mount from the systemd commands02:06
* mordred has some testing of the above to do - most of it is rage code02:06
*** amitgandhinz has joined #openstack-infra02:07
jrollI decided the other day that most software development is driven by rage02:07
mordredyup02:07
mordredand with that- I will go watch people shoot each other on boardwalk empire02:08
jrollheh, have a good one :)02:08
*** sigmavirus24 is now known as sigmavirus24_awa02:08
*** ayoung-lunx is now known as ayoung02:09
SpamapSmordred: did the latest patch work now that you mount config drive before 'starting networking' ?02:09
SpamapS(since networking starts after local-filesystems)02:10
* SpamapS goes to do dinner-family-stuff02:10
asselinpleia2, tomorrow's fine. I think we should start with what clarkb said. Once that works, then go on to puppetize. although honestly, not sure if it really needs to be puppetized02:14
*** tiswanso has joined #openstack-infra02:16
*** bhunter71 has joined #openstack-infra02:19
openstackgerritK Jonathan Harker proposed openstack-infra/jeepyb: Fix typo: opensack -> openstack  https://review.openstack.org/16060402:19
*** tiswanso has quit IRC02:19
*** tiswanso has joined #openstack-infra02:20
*** dmellado has quit IRC02:21
*** dmellado has joined #openstack-infra02:22
*** david-lyle has quit IRC02:23
*** fabo has quit IRC02:23
*** mtanino_ has quit IRC02:24
*** fabo has joined #openstack-infra02:24
*** fabo has joined #openstack-infra02:24
*** jerryz_ has joined #openstack-infra02:24
*** markvoelker has joined #openstack-infra02:26
*** annegentle has joined #openstack-infra02:30
*** amotoki has joined #openstack-infra02:32
*** mancdaz has quit IRC02:32
*** mancdaz has joined #openstack-infra02:34
openstackgerritYuiko Takada proposed openstack-infra/project-config: Add translation job for Ironic-discoverd  https://review.openstack.org/16061002:36
*** annegentle has quit IRC02:36
*** dmsimard is now known as dmsimard_away02:40
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/publications: Updating pie chart  https://review.openstack.org/16061202:40
openstackgerritMerged openstack-infra/infra-specs: Add spec for reusable OpenStack CI solution  https://review.openstack.org/13974502:41
*** mancdaz has quit IRC02:41
openstackgerritMerged openstack-infra/infra-manual: Document Cross-Repo Dependencies  https://review.openstack.org/15885502:43
*** hdd has quit IRC02:44
*** tsg has quit IRC02:47
*** amitgandhinz has quit IRC02:49
*** crc32 has joined #openstack-infra02:49
*** ivar-lazzaro has joined #openstack-infra02:49
*** koolhead17 has joined #openstack-infra03:01
*** Longgeek has quit IRC03:02
*** patrickeast___ has quit IRC03:06
*** patri891 has quit IRC03:06
*** patrickeast__ has quit IRC03:06
*** patrickeast_ has quit IRC03:06
*** patrickeast has quit IRC03:06
*** bdpayne has joined #openstack-infra03:07
*** camunoz has quit IRC03:08
*** ivar-lazzaro has quit IRC03:10
*** ivar-lazzaro has joined #openstack-infra03:10
*** baoli has quit IRC03:11
*** camunoz has joined #openstack-infra03:11
*** Longgeek has joined #openstack-infra03:15
*** unicell1 has quit IRC03:15
*** yamahata has quit IRC03:20
*** asettle is now known as asettle-lernch03:21
*** penguinRaider has quit IRC03:21
*** bdpayne has quit IRC03:21
openstackgerritSpencer Krum proposed openstack-infra/system-config: update puppet haproxy module to 1.1.0  https://review.openstack.org/16006203:22
*** baoli has joined #openstack-infra03:26
nibalizeri expect http://ci.openstack.org/os-loganalyze to work but it doesn't... can someone help?03:27
*** zz_dimtruck is now known as dimtruck03:30
*** nelsnelson has joined #openstack-infra03:33
clarkbhow is it not working?03:35
*** dmellado_ has joined #openstack-infra03:36
clarkbit runs as a wsgi app so apache logs may be useful03:36
*** dmellado has quit IRC03:37
*** dmellado_ is now known as dmellado03:37
clarkboh do you just mean that path I should open url first03:37
*** asettle-lernch is now known as asettle03:39
*** sputnik13 has quit IRC03:41
*** Ryan_Lane has quit IRC03:45
nibalizerclarkb: yea now looking, it doesn't look like os-loganalyze has a ton of docs, but just the readme03:45
nibalizerbut yes my question is 'thats where the docs should be published to, right?'03:45
*** unicell has joined #openstack-infra03:45
*** dimsum__ has quit IRC03:45
nibalizersince this works for example http://ci.openstack.org/jenkins-job-builder/03:45
clarkbI dont think it has a doc publishing job03:45
nibalizerkk03:46
nibalizershould i submit a change to make that happen or :shrug: ?03:46
clarkbis there content to publish?03:46
*** ddieterl_ has quit IRC03:48
*** ivar-lazzaro has quit IRC03:49
*** ayoung has quit IRC03:50
dstufftclarkb: pip will use the newest version it can find, regardless of format, within a version it prefers wheels03:56
*** ianychoi has joined #openstack-infra03:58
*** ujuc has joined #openstack-infra03:59
*** penguinRaider has joined #openstack-infra04:00
*** jpeeler has quit IRC04:01
bhunter71in the context of Lucene reindex, is the following line 'bad':04:01
*** patrickeast has joined #openstack-infra04:01
bhunter71Reindexed 0 changes in 0.5s (0.0/s)04:01
*** amotoki has quit IRC04:02
ianychoiHello. Could somebody help  register #openstack-ko channel (discussion in Korean) to make openstack-ko channel logs publicly accessible?04:03
*** hdd has joined #openstack-infra04:05
*** Longgeek has quit IRC04:06
*** yamamoto has quit IRC04:07
*** yamamoto has joined #openstack-infra04:08
*** thedodd has joined #openstack-infra04:08
*** harlowja_ is now known as harlowja_away04:13
*** penguinRaider has quit IRC04:13
*** jamespage has quit IRC04:14
*** gnuoy has quit IRC04:14
*** gnuoy has joined #openstack-infra04:14
*** jamespage has joined #openstack-infra04:14
*** Longgeek has joined #openstack-infra04:18
*** joset has joined #openstack-infra04:20
*** armax has joined #openstack-infra04:21
*** crc32 has quit IRC04:22
*** patrickeast has quit IRC04:23
*** tiswanso has quit IRC04:28
*** dimtruck is now known as zz_dimtruck04:29
openstackgerritJoshua Hesketh proposed openstack-infra/project-config: zuul-swift-upload support recursive globs  https://review.openstack.org/15851404:29
openstackgerritJoshua Hesketh proposed openstack-infra/project-config: Enable swift logs for python jobs  https://review.openstack.org/15652104:29
openstackgerritJoshua Hesketh proposed openstack-infra/project-config: Upload python test results to swift  https://review.openstack.org/15652204:29
openstackgerritBrian Hunter proposed openstack-infra/system-config: Add openstack-ko to eavesdrop  https://review.openstack.org/16063104:32
bhunter71mordred/clarkb:  Are there any probable causes for "Unpack error on project" in manage-projects/jeepyb?  I have this with 4 repositories - and if I clone the upstream, pull all branches, I see nothing in git fsck [ but do see lots of git fsck errors in gerrit's git repos ].  The log isn't very helpful04:33
*** hdd has quit IRC04:34
*** harlowja_at_home has joined #openstack-infra04:37
*** coolsvap_ is now known as coolsvap04:37
bhunter71^ 4 of 10 repositories have this, and I cannot see any correlation between their configuration and this problem04:37
*** armax has quit IRC04:45
*** dimsum__ has joined #openstack-infra04:46
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Update zuul-changes to use the enqueue command  https://review.openstack.org/16001504:46
*** nikil22 has joined #openstack-infra04:46
*** nelsnelson has quit IRC04:47
*** armax has joined #openstack-infra04:47
*** oomichi_ has joined #openstack-infra04:48
*** ddieterly has joined #openstack-infra04:48
*** dimsum__ has quit IRC04:51
*** ddieterly has quit IRC04:53
*** sandywalsh_ has quit IRC04:56
*** sandywalsh has joined #openstack-infra04:58
*** markvoelker has quit IRC04:59
*** markvoelker has joined #openstack-infra05:00
*** signed8bit has joined #openstack-infra05:00
*** armax has quit IRC05:00
openstackgerritMerged openstack-infra/zuul: Only format swift string parameters  https://review.openstack.org/15759205:01
*** hdd has joined #openstack-infra05:02
*** tsg has joined #openstack-infra05:02
*** joset has left #openstack-infra05:03
*** markvoelker has quit IRC05:04
*** david-lyle_afk has joined #openstack-infra05:06
*** baoli has quit IRC05:06
*** koolhead17 has quit IRC05:07
*** hdd has quit IRC05:08
*** hdd has joined #openstack-infra05:09
*** garyh has quit IRC05:09
*** abhishek_cb has joined #openstack-infra05:23
abhishek_cbhi all, i have setup my CI LogServer and when I am trying to access the logs I am getting the following05:24
abhishek_cbYou don't have permission to access /htmlify/69/153969/8/check/dsvm-tempest-full/99fbc7d/console.html on this server.05:24
abhishek_cbCan anyone help me to resolve this??05:24
*** SergK has quit IRC05:25
*** SergK has joined #openstack-infra05:28
*** trinaths has joined #openstack-infra05:29
*** markvoelker has joined #openstack-infra05:30
*** bhunter71 has quit IRC05:31
*** Ryan_Lane has joined #openstack-infra05:31
*** thedodd has quit IRC05:34
*** markvoelker has quit IRC05:35
*** thedodd has joined #openstack-infra05:37
*** mrmartin has joined #openstack-infra05:39
*** harlowja_at_home has quit IRC05:40
*** signed8bit has quit IRC05:42
*** signed8bit has joined #openstack-infra05:43
*** david-lyle_afk has quit IRC05:44
*** yfried has quit IRC05:49
*** ddieterly has joined #openstack-infra05:49
*** ddieterly has quit IRC05:55
*** Sukhdev has joined #openstack-infra05:56
*** otter768 has quit IRC05:56
*** unicell has quit IRC05:57
*** unicell1 has joined #openstack-infra05:57
*** deepakcs has joined #openstack-infra05:58
deepakcsclarkb, ping05:58
*** esker has joined #openstack-infra06:01
*** resker has quit IRC06:01
*** koolhead17 has joined #openstack-infra06:05
*** koolhead17 has joined #openstack-infra06:05
*** kiseok7 has joined #openstack-infra06:06
*** xyang1 has quit IRC06:06
*** ildikov has quit IRC06:07
*** BharatK has joined #openstack-infra06:09
*** achanda has joined #openstack-infra06:14
*** koolhead17 has quit IRC06:17
*** eharney has quit IRC06:19
*** eharney has joined #openstack-infra06:20
*** redrobot has quit IRC06:21
*** gyee has quit IRC06:22
abhishek_cbhi all, i have setup my CI LogServer and when I am trying to access the logs I am getting the following "You don't have permission to access /htmlify/69/153969/8/check/dsvm-tempest-full/99fbc7d/console.html on this server." Can anyone help me to resolve this??06:23
*** vilobhmm has joined #openstack-infra06:24
*** redrobot has joined #openstack-infra06:25
*** redrobot is now known as Guest3254406:25
*** hdd has quit IRC06:25
*** rlandy has joined #openstack-infra06:26
openstackgerritRandy Bertram proposed openstack/requirements: Update Magic Search version  https://review.openstack.org/16066106:27
*** signed8bit has quit IRC06:30
*** thedodd has quit IRC06:31
*** hrubi has quit IRC06:31
*** markvoelker has joined #openstack-infra06:31
*** abhishek_cb has quit IRC06:33
*** fungi has quit IRC06:34
*** russellb has quit IRC06:34
*** markvoelker has quit IRC06:36
*** Apsu has quit IRC06:38
*** ildikov has joined #openstack-infra06:40
openstackgerritBharat Kumar Kobagana proposed openstack-infra/project-config: Re-enabling the glusterfs job for Cinder  https://review.openstack.org/16066406:43
*** david-lyle_afk has joined #openstack-infra06:44
*** ivar-lazzaro has joined #openstack-infra06:47
*** jroll has quit IRC06:49
*** ddieterly has joined #openstack-infra06:50
*** imcsk8 has quit IRC06:52
*** imcsk8 has joined #openstack-infra06:52
*** yfried has joined #openstack-infra06:54
*** ddieterly has quit IRC06:55
*** reed has quit IRC06:58
*** rmcall has quit IRC06:58
*** yfried has quit IRC06:58
*** yfried has joined #openstack-infra06:59
*** Apsu has joined #openstack-infra06:59
*** jroll has joined #openstack-infra06:59
openstackgerritBharat Kumar Kobagana proposed openstack-infra/project-config: Re-enabling the glusterfs job for Cinder  https://review.openstack.org/16066406:59
*** ivar-lazzaro has quit IRC07:00
*** ivar-lazzaro has joined #openstack-infra07:01
*** mrda is now known as mrda-away07:04
*** HeOS has quit IRC07:05
*** koolhead17 has joined #openstack-infra07:06
*** dstufft has quit IRC07:08
*** apmelton has quit IRC07:09
*** nikil22 has quit IRC07:09
openstackgerritMerged openstack-infra/project-config: Fuel plugin for Group Based Policy  https://review.openstack.org/16012607:11
*** hrubi has joined #openstack-infra07:11
*** dstufft has joined #openstack-infra07:14
*** vilobhmm1 has joined #openstack-infra07:15
*** vilobhmm has quit IRC07:17
*** oomichi_ has quit IRC07:18
*** sergsh has joined #openstack-infra07:18
*** woodster_ has quit IRC07:20
*** yamahata has joined #openstack-infra07:21
*** openstackgerrit has quit IRC07:22
*** openstackgerrit has joined #openstack-infra07:22
*** sergsh has quit IRC07:23
*** sergsh has joined #openstack-infra07:23
*** sergsh has joined #openstack-infra07:23
*** yamamoto has quit IRC07:24
*** scheuran has joined #openstack-infra07:26
*** yfried is now known as yfried|afk07:27
*** mrunge has joined #openstack-infra07:27
*** yfried|afk is now known as yfried07:28
*** markvoelker has joined #openstack-infra07:32
AJaegerianychoi, you have to register it yourself - see http://ci.openstack.org/irc.html and then send a patch to the project-config repo to have our bots there07:33
StevenKAJaeger: O HAI. Is the Python client for Zanata a going concern, or should I be focusing my efforts onto packaging up the Java client?07:37
AJaegerHi StevenK,07:37
*** markvoelker has quit IRC07:37
AJaegerlast time I looked (before Paris), the python client was missing some features that we needed. If those have been implemented in the mean time, we can use it.07:38
AJaegerI didn't review again recently07:38
AJaegerSo, for now I fear we need the Java client unless you want to check whether the python client is good enough - or fix it if not.07:39
StevenKAJaeger: I have a package of the Python client already. It needs some polish, but it's pretty much done. I don't know how to check it is actually functional once it's installed, or what we need the client to do that it didn't when you last looked.07:41
AJaegerlet me search a bit...07:41
*** koolhead_ has joined #openstack-infra07:43
AJaegerStevenK, http://lists.openstack.org/pipermail/openstack-infra/2014-October/002014.html starts a thread07:43
AJaegerand this is the problem we hit: http://lists.openstack.org/pipermail/openstack-infra/2014-October/002022.html07:43
AJaegerSo, unless the path handling has been improved, we cannot use it.07:44
AJaegerLet me check the log from the python client...07:44
*** Sukhdev has quit IRC07:45
*** koolhead17 has quit IRC07:46
AJaegerStevenK, issue seems not ot have been addressed, so we need the java client or some coding ;(07:46
StevenKAJaeger: I will continue to slam my head against maven07:48
AJaegerThanks, StevenK ! Much appreciated07:48
ianychoiHello AJaeger, thank you for your comment. I have just executed a chanserv command to give access to openstackinfra, and please see the link: https://review.openstack.org/#/c/160631/ .07:48
StevenKAJaeger: I may require to be plied with beer if you'll be in Vancouver :-P07:49
AJaeger;) Unfortunately I cannot make Vancouver ;(07:49
ianychoiIs it enough, or would I need to find additional configurations related to project-config? (The link is related to system-config, not project-config.)07:50
AJaegerianychoi, I'm not sure - let me comment on it and see what the other reviewers say...07:50
ianychoiOkay, I see. Thanks :)07:51
*** ddieterly has joined #openstack-infra07:51
*** markus_z has joined #openstack-infra07:52
AJaegerianychoi, I double checked, and think we need a patch for project-config/accessbot/channels.yaml as well. But feel free to wait for some definite answers by others ;)07:53
*** ddieterly has quit IRC07:56
*** otter768 has joined #openstack-infra07:57
*** krtaylor has quit IRC07:58
ianychoiAJaeger,  #openstack-ko channel is for discussions in Korean, like #openstack-kr channel. I could not find 'openstack-fr' strings on channels.yaml, so in my opinion, without the modification of channels.yaml would be also okay. But, as you said, let's wait for comments from others : )07:58
*** eharney has quit IRC07:58
AJaegeropenstack-fr is in accessbot07:59
*** armax has joined #openstack-infra07:59
AJaegerand openstack-kr is not in the files at all...07:59
AJaegerLet's learn together how to do it properly ;)07:59
ianychoiYep! I also want to learn it and happily would like to take notes for future irc channel creators : )08:00
AJaegerianychoi, patches for http://ci.openstack.org/irc.html are welcome - the source is in system-config repo08:01
*** otter768 has quit IRC08:01
anteayaAJaeger: I'm sad you won't be in Vancouver08:02
anteaya:(08:02
ianychoiI got it : )08:03
AJaegeranteaya, I'm as well - but I planned already last August a long weekend with my wife and haven't figured out how to be at two places at once...08:04
anteayaAJaeger: yes it is hard to be in two places at once08:06
anteayabetter to just focus on being in one place, it yeilds better results08:06
*** jcoufal has joined #openstack-infra08:07
*** krtaylor has joined #openstack-infra08:08
*** eharney has joined #openstack-infra08:09
*** armax has quit IRC08:12
*** stevemar has quit IRC08:15
openstackgerritAkihiro Motoki proposed openstack-dev/pbr: Make setup.py --help-commands work without testrepository  https://review.openstack.org/12465208:15
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove stackforge-libra from gerritbot  https://review.openstack.org/16068308:17
*** penguinRaider has joined #openstack-infra08:18
*** matrohon has joined #openstack-infra08:19
*** mtanino has joined #openstack-infra08:21
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove billingstack from gerritbot  https://review.openstack.org/16068608:23
*** dimsum__ has joined #openstack-infra08:24
*** vilobhmm1 has quit IRC08:24
*** vilobhmm1 has joined #openstack-infra08:24
*** mtanino has quit IRC08:26
*** penguinRaider has quit IRC08:26
*** odyssey4me has quit IRC08:26
*** sigmavirus24_awa has quit IRC08:26
*** cloudnull has quit IRC08:26
*** e0ne has joined #openstack-infra08:26
*** dolphm has quit IRC08:27
*** d34dh0r53 has quit IRC08:27
*** koolhead_ has quit IRC08:27
*** f1ller has quit IRC08:27
*** dimsum__ has quit IRC08:29
*** vilobhmm1 has quit IRC08:30
*** d34dh0r53 has joined #openstack-infra08:30
*** dtantsur|afk is now known as dtantsur08:30
*** dolphm has joined #openstack-infra08:31
*** vilobhmm1 has joined #openstack-infra08:32
*** markvoelker has joined #openstack-infra08:33
*** e0ne has quit IRC08:34
*** claudiub has joined #openstack-infra08:35
*** rlandy has quit IRC08:35
*** MaxV has joined #openstack-infra08:36
*** mpavone has joined #openstack-infra08:38
*** markvoelker has quit IRC08:39
*** e0ne has joined #openstack-infra08:39
*** penguinRaider has joined #openstack-infra08:39
*** f1ller has joined #openstack-infra08:39
*** MaxV has quit IRC08:41
*** devvesa has joined #openstack-infra08:43
*** mancdaz has joined #openstack-infra08:44
openstackgerritMarton Kiss proposed openstack-infra/infra-specs: Added backup/recovery description to askbot migration spec  https://review.openstack.org/16069308:45
*** vilobhmm1 has quit IRC08:45
*** jistr has joined #openstack-infra08:46
*** rlandy has joined #openstack-infra08:50
*** MaxV has joined #openstack-infra08:50
*** mpaolino has joined #openstack-infra08:50
*** skolekonov has joined #openstack-infra08:50
*** ghostpl_ has joined #openstack-infra08:51
*** ddieterly has joined #openstack-infra08:52
*** Hal has joined #openstack-infra08:52
*** Hal is now known as Guest9794208:53
*** devvesa has quit IRC08:53
*** arxcruz has joined #openstack-infra08:53
*** devvesa has joined #openstack-infra08:53
*** achanda has quit IRC08:55
*** mpaolino has quit IRC08:55
*** mpaolino has joined #openstack-infra08:55
*** ddieterly has quit IRC08:56
*** e0ne is now known as e0ne_08:59
*** ivar-lazzaro has quit IRC09:00
*** ivar-lazzaro has joined #openstack-infra09:01
*** e0ne_ is now known as e0ne09:01
openstackgerritDavid Pursehouse proposed openstack-infra/jenkins-job-builder: Add support to customize trigger-builds block thresholds  https://review.openstack.org/15437909:01
*** lifeless has quit IRC09:05
*** mpaolino has quit IRC09:06
devvesaHello. I have a question related to a recent change merged in `project-config`09:06
*** lifeless has joined #openstack-infra09:06
*** mpaolino has joined #openstack-infra09:06
devvesaI've submitted this patch https://review.openstack.org/#/c/159867/09:06
*** andreykurilin_ has joined #openstack-infra09:06
*** e0ne is now known as e0ne_09:06
*** JoshNang has quit IRC09:07
devvesaand the gate fails because the ERROR_IN_CLONE variable is set to False in `devstack-vm-gate.sh` script09:07
devvesaset to True I mean09:07
devvesahttps://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate.sh#L13509:07
*** sputnik13 has joined #openstack-infra09:07
devvesato make the gate work, I need to clone the http://github.com/midonet/midonet project09:08
devvesais posible to clone a project that's not part of `stackforge`?09:09
*** e0ne_ is now known as e0ne09:09
devvesaIn my patch I've set the PROJECTS env var to 'stackforge/networking-midonet $PROJECT'.09:09
devvesado I need to add 'midonet/midonet' to PROJECTS too?09:10
AJaegerdevvesa, better come back in 4 hours and talk with sdague09:10
AJaegeradding to PROJECTS should work but adding an external project is quite unusual09:10
AJaegerIt won't work - PROJECTS only handles repos that are on git.openstack.org and midonet is not09:11
*** andreykurilin_ has quit IRC09:12
*** andreykurilin_ has joined #openstack-infra09:12
*** yamahata has quit IRC09:13
*** ivar-lazzaro has quit IRC09:14
*** e0ne has quit IRC09:15
*** yfried is now known as yfried|afk09:16
*** _shaps_ has joined #openstack-infra09:17
*** jedimike has joined #openstack-infra09:17
*** jyuso1 has quit IRC09:17
openstackgerritRadomir Dopieralski proposed openstack/requirements: Upgrade oslo.config to version 1.7  https://review.openstack.org/16029709:18
openstackgerritRadomir Dopieralski proposed openstack/requirements: Upgrade oslo.config to version 1.7  https://review.openstack.org/16029709:19
*** koolhead17 has joined #openstack-infra09:19
*** jyuso has joined #openstack-infra09:22
devvesaAJaeger: Thanks. I'll think in a workaround09:23
AJaegerdevvesa, discuss with sdague or clarkb later today (US timezone)09:24
devvesaMaybe we need to install midonet from packages instead of clone it09:24
AJaegerthat'S one way...09:25
devvesaAJaeger: I'll do :)09:25
*** Guest97942 has quit IRC09:25
*** andreykurilin_ has quit IRC09:26
*** andreykurilin_ has joined #openstack-infra09:27
*** HeOS has joined #openstack-infra09:28
*** yfried|afk is now known as yfried09:32
*** markvoelker has joined #openstack-infra09:35
*** dizquierdo has joined #openstack-infra09:37
*** mpaolino has quit IRC09:37
*** mpaolino has joined #openstack-infra09:38
*** che-arne has joined #openstack-infra09:38
*** claudiub has quit IRC09:38
*** markvoelker has quit IRC09:39
*** mpaolino has quit IRC09:40
*** nfedotov has joined #openstack-infra09:40
*** mpaolino has joined #openstack-infra09:40
*** claudiub has joined #openstack-infra09:45
*** mpaolino has quit IRC09:48
*** mpaolino has joined #openstack-infra09:48
*** Ala has joined #openstack-infra09:50
*** coolsvap is now known as coolsvap_09:52
*** ddieterly has joined #openstack-infra09:53
*** ZZelle has quit IRC09:53
*** ZZelle has joined #openstack-infra09:53
*** Hal has joined #openstack-infra09:54
*** Hal is now known as Guest6431309:54
GheRiveromorning all09:55
*** ddieterly has quit IRC09:57
*** otter768 has joined #openstack-infra09:58
*** Longgeek has quit IRC10:01
*** otter768 has quit IRC10:02
nfedotovHello All! Does somebody know what happened with https://bootstrap.pypa.io/get-pip.py ?10:03
*** afazekas has joined #openstack-infra10:05
*** ssam2 has joined #openstack-infra10:06
GheRiveronfedotov: no idea, but if needed, you can use the one from the github repo: https://github.com/pypa/pip/tree/develop/contrib10:09
*** penguinRaider has quit IRC10:10
HeOSHi to all! My question is about gerrit. Could you say how I can set wildcard in config of project? I have some branches in my project (1.1.1-updates, 2.2.2-updates, for example) and I want set up once permissions to these branches. I don't received answer on #gerrit channel. :(10:10
*** jyuso1 has joined #openstack-infra10:16
*** jyuso1 has joined #openstack-infra10:16
*** mpaolino has quit IRC10:16
*** mpaolino has joined #openstack-infra10:16
*** ihrachyshka has joined #openstack-infra10:20
*** penguinRaider has joined #openstack-infra10:21
*** _shaps_ has quit IRC10:26
*** dtantsur is now known as dtantsur|bbl10:28
*** mpaolino has quit IRC10:30
*** mpaolino has joined #openstack-infra10:30
*** amotoki has joined #openstack-infra10:34
openstackgerritMerged openstack-infra/jeepyb: Fix typo: opensack -> openstack  https://review.openstack.org/16060410:34
*** markvoelker has joined #openstack-infra10:35
*** jyuso1 has quit IRC10:36
*** yfried is now known as yfried|afk10:37
openstackgerritMerged openstack-infra/publications: Updating pie chart  https://review.openstack.org/16061210:40
*** markvoelker has quit IRC10:40
*** Longgeek has joined #openstack-infra10:41
*** e0ne has joined #openstack-infra10:43
*** trey has quit IRC10:43
*** Longgeek has quit IRC10:43
*** Longgeek has joined #openstack-infra10:44
*** matrohon has quit IRC10:44
*** yfried|afk is now known as yfried10:45
*** trey has joined #openstack-infra10:45
*** andreykurilin_ has quit IRC10:46
*** mpaolino has quit IRC10:47
*** mpaolino has joined #openstack-infra10:47
*** scheuran_ has joined #openstack-infra10:49
*** devvesa has quit IRC10:49
*** devvesa has joined #openstack-infra10:49
openstackgerritenikanorov proposed openstack/requirements: Bup oslo.db version to 1.5.0  https://review.openstack.org/16073110:51
*** devvesa has quit IRC10:51
*** scheuran has quit IRC10:52
*** devvesa has joined #openstack-infra10:52
*** mpaolino has quit IRC10:52
*** mpaolino has joined #openstack-infra10:53
openstackgerritMerged openstack/requirements: Add openstack/debtcollector to projects.txt  https://review.openstack.org/15756610:53
*** ddieterly has joined #openstack-infra10:53
nfedotovGheRivero: Thank you!10:57
*** mpaolino has quit IRC10:57
*** Guest64313 has quit IRC10:58
*** mpaolino has joined #openstack-infra10:58
*** ddieterly has quit IRC10:58
*** Hal has joined #openstack-infra10:59
*** BobBall_AWOL is now known as BobBall11:00
*** Hal is now known as Guest4720311:00
boris-42AJaeger: hi there11:00
openstackgerritenikanorov proposed openstack/requirements: Bump oslo.db version to 1.5.0  https://review.openstack.org/16073111:00
*** pelix has joined #openstack-infra11:03
*** e0ne is now known as e0ne_11:09
*** dimsum__ has joined #openstack-infra11:16
*** pc_m has joined #openstack-infra11:16
*** coolsvap_ is now known as coolsvap11:17
*** e0ne_ has quit IRC11:20
*** jp_at_hp has joined #openstack-infra11:21
*** e0ne has joined #openstack-infra11:21
openstackgerritMerged openstack-infra/storyboard: Email SMTP Client  https://review.openstack.org/14979211:22
openstackgerritMerged openstack-infra/storyboard: Email Working Directory Utility Method  https://review.openstack.org/15194711:22
sdaguedevvesa: it is *not* possible to clone another project. Anything that's not openstack code should be installed from a release.11:27
*** mpaolino has quit IRC11:30
*** mpaolino has joined #openstack-infra11:31
*** mpaolino has quit IRC11:33
*** mpaolino has joined #openstack-infra11:33
*** markvoelker has joined #openstack-infra11:36
*** dhritishikhar has joined #openstack-infra11:38
*** Guest47203 has quit IRC11:39
*** mpaolino has quit IRC11:40
*** mpaolino has joined #openstack-infra11:40
*** markvoelker has quit IRC11:41
*** ldnunes has joined #openstack-infra11:44
AJaegerHI boris-4211:46
mordrednfedotov: what do you mean?11:49
*** cdent has joined #openstack-infra11:49
boris-42AJaeger: so we have issues11:52
boris-42AJaeger: with your request11:52
boris-42AJaeger: there is no admin in that chat11:52
boris-42AJaeger: I mean "openstack-rally"11:52
boris-42AJaeger: so I can't follow your instruction to set openstack-gerritbot11:53
*** ihrachyshka has quit IRC11:53
AJaegerboris-42, the rally channel is not registered. Talk with jeblair later today whether he can help registering.11:53
*** e0ne is now known as e0ne_11:53
boris-42AJaeger: so the only way that I know is to kick everybody from chat11:54
*** ddieterly has joined #openstack-infra11:54
boris-42AJaeger: but it's was even 1.5 years ago hard11:54
AJaegerboris-42, we might need a freenode admin - I suggest you talk with jeblair whether he has some hints to do this properly.11:55
AJaegerBut he's asleep right now (US timezone)11:55
*** mase_x200 has joined #openstack-infra11:56
boris-42AJaeger: ok thanks11:57
*** yfried is now known as yfried|afk11:57
*** koolhead17 has quit IRC11:57
*** Longgeek has quit IRC11:58
*** dhritishikhar has joined #openstack-infra11:58
*** ddieterly has quit IRC11:58
*** otter768 has joined #openstack-infra11:59
*** deepakcs has quit IRC11:59
*** yfried|afk is now known as yfried12:00
*** e0ne_ is now known as e0ne12:01
*** otter768 has quit IRC12:03
*** BharatK has quit IRC12:03
*** EmilienM|afk is now known as EmilienM12:05
*** ihrachyshka has joined #openstack-infra12:05
*** russellb has joined #openstack-infra12:08
*** baoli has joined #openstack-infra12:10
*** yamamoto has joined #openstack-infra12:12
*** katyafervent is now known as katyafervent_awa12:16
mordredboris-42: we have some special powers12:17
*** katyafervent_awa is now known as katyafervent12:17
mordredboris-42: and by we, I mean jeblair, and by powers, I mean he can change reality with only his mind12:17
mordredAJaeger: I _think_ we got a registration with the freenode admins which allows jeblair to force-register things that have an openstack- prefix12:18
mordredbut I don't have the power nor have I seen it used in anger yet12:19
*** adalbas has joined #openstack-infra12:19
*** mpaolino has quit IRC12:19
AJaegermordred, I've heard about some magic that jeblair can do but didn't know exactly what ;)12:20
*** mpaolino has joined #openstack-infra12:20
*** ihrachyshka has quit IRC12:21
*** dtantsur|bbl is now known as dtantsur12:22
*** ihrachyshka has joined #openstack-infra12:22
boris-42mordred: uuu nice12:23
*** mpaolino has quit IRC12:23
Kiallboris-42: you could always ask everyone really really nicely to leave for a few hours ;)12:23
*** mpaolino has joined #openstack-infra12:23
boris-42Kiall: a lot of people is offline/vacation and so on12:24
boris-42mordred: endless super-infra-power12:24
*** rfolco has joined #openstack-infra12:25
*** yamamoto has quit IRC12:26
*** weshay has joined #openstack-infra12:30
openstackgerritMerged openstack-infra/jeepyb: Workflow documentation is now in infra-manual  https://review.openstack.org/13942412:35
*** aysyd has joined #openstack-infra12:35
*** spredzy is now known as spredzyafk12:36
*** jedimike has quit IRC12:36
*** jedimike has joined #openstack-infra12:37
*** markvoelker has joined #openstack-infra12:38
*** baoli has quit IRC12:42
*** markvoelker has quit IRC12:42
*** baoli has joined #openstack-infra12:43
*** Longgeek has joined #openstack-infra12:43
*** dimsum__ is now known as dims12:46
*** trinaths has quit IRC12:49
*** trinaths has joined #openstack-infra12:49
*** _nadya_ has joined #openstack-infra12:50
*** BharatK has joined #openstack-infra12:53
*** esker has quit IRC12:53
*** trinaths has quit IRC12:53
*** ddieterly has joined #openstack-infra12:55
*** mpavone has quit IRC12:55
*** kgiusti has joined #openstack-infra12:56
*** ddieterly has quit IRC12:59
*** pblaho has quit IRC13:00
*** yamamoto has joined #openstack-infra13:02
*** koolhead17 has joined #openstack-infra13:02
openstackgerritJulien Danjou proposed openstack-dev/hacking: Add a check for staticmethod  https://review.openstack.org/15195213:02
*** arxcruz has quit IRC13:02
*** Hal has joined #openstack-infra13:03
*** Hal is now known as Guest1174213:04
*** arxcruz has joined #openstack-infra13:04
*** markvoelker has joined #openstack-infra13:04
*** yamamoto_ has joined #openstack-infra13:06
*** Bsony has joined #openstack-infra13:06
*** mpaolino has quit IRC13:06
*** jroll has quit IRC13:07
*** jroll has joined #openstack-infra13:07
*** mpaolino has joined #openstack-infra13:07
*** mpavone has joined #openstack-infra13:07
*** yamamoto has quit IRC13:09
*** tnovacik has joined #openstack-infra13:09
*** dims has quit IRC13:14
*** dims has joined #openstack-infra13:15
*** spredzyafk is now known as spredzy13:15
*** mugsie_ has joined #openstack-infra13:17
*** mfink_ has joined #openstack-infra13:17
*** mwagner_lap has quit IRC13:19
*** sarob has quit IRC13:20
*** sarob has joined #openstack-infra13:21
*** doude has joined #openstack-infra13:21
jedimikemordred, jeblair, hi! I've been analysing the nodepool performance in gozer, getting some interesting figures that say nodepool's task dispatching performs badly when the task queue gets over a certain point. Is the openstack-infra mailing list the best place to discuss?13:22
*** Bsony has quit IRC13:22
*** Bsony has joined #openstack-infra13:23
BobBallAnyone seen issues with memcached failing to restart because a defunct process (with the right pid) still exists?  I'm getting it in our internal CI but am struggling to figure out why...13:25
*** sarob has quit IRC13:26
*** dprince has joined #openstack-infra13:26
*** _shaps_ has joined #openstack-infra13:26
*** mfink_ has quit IRC13:27
*** _shaps_ has quit IRC13:31
*** dhritishikhar has quit IRC13:36
*** arxcruz has quit IRC13:36
*** dkranz has quit IRC13:37
*** gordc has joined #openstack-infra13:37
*** woodster_ has joined #openstack-infra13:37
*** hdd has joined #openstack-infra13:38
*** ddieterly has joined #openstack-infra13:38
*** mpaolino has quit IRC13:44
*** mpaolino has joined #openstack-infra13:45
*** arxcruz has joined #openstack-infra13:49
*** tnovacik has quit IRC13:55
*** tnovacik has joined #openstack-infra13:56
*** radez_g0n3 is now known as radez13:57
*** mpaolino has quit IRC13:59
*** mpaolino has joined #openstack-infra13:59
*** otter768 has joined #openstack-infra13:59
*** grantbow has quit IRC14:00
*** yamamoto_ has quit IRC14:01
*** yamamoto has joined #openstack-infra14:02
*** yamamoto has quit IRC14:02
*** julim has joined #openstack-infra14:03
*** esker has joined #openstack-infra14:03
*** asettle has quit IRC14:03
*** changbl has quit IRC14:04
*** otter768 has quit IRC14:04
*** mase_x200 has quit IRC14:07
*** ddieterly has quit IRC14:08
*** mwagner_lap has joined #openstack-infra14:08
*** sarob has joined #openstack-infra14:09
*** adalbas has quit IRC14:12
*** hdd has quit IRC14:12
*** mugsie has quit IRC14:13
*** asettle has joined #openstack-infra14:15
*** ghostpl_ has quit IRC14:15
*** dmsimard_away is now known as dmsimard14:17
*** mattfarina has joined #openstack-infra14:18
*** dustins has joined #openstack-infra14:23
*** spzala has joined #openstack-infra14:25
*** yamamoto has joined #openstack-infra14:26
*** adalbas has joined #openstack-infra14:26
*** chlong has joined #openstack-infra14:27
*** mriedem_away is now known as mriedem14:28
*** dkliban_afk is now known as dkliban14:29
*** eharney has quit IRC14:30
*** david-lyle has joined #openstack-infra14:31
openstackgerritIan Cordasco proposed openstack-infra/project-config: Fix os-ansible-deployment publishers one last time  https://review.openstack.org/16060014:35
*** yamamoto has quit IRC14:36
*** ddieterly has joined #openstack-infra14:37
openstackgerritSean M. Collins proposed openstack-infra/devstack-gate: Set IP_VERSION in DevStack to run dual stack  https://review.openstack.org/14012814:37
*** sarob_ has joined #openstack-infra14:37
*** mpavone has quit IRC14:38
*** mpavone has joined #openstack-infra14:38
*** sarob has quit IRC14:39
*** zz_jgrimm is now known as jgrimm14:43
*** salv-orlando has joined #openstack-infra14:43
*** coolsvap is now known as coolsvap_14:43
*** dustins has quit IRC14:43
*** ayoung has joined #openstack-infra14:43
*** mpavone has quit IRC14:45
*** tiswanso has joined #openstack-infra14:49
jeblairjedimike: sure, there or here.  how many threads do you have running?14:49
jedimikejeblair, can't remember off hand, i'll put all the graphs in a post to the mailing list I think14:51
jeblairjedimike: take a look at http://specs.openstack.org/openstack-infra/infra-specs/specs/nodepool-launch-workers.html14:52
jeblairjedimike: the only performance problem we've seen is not caused by the task queue depth, but simply starvation due to the number of threads14:53
*** sigmavirus24 has joined #openstack-infra14:53
jedimikejeblair, we also see that the tasks aren't run in a sensible order. For example, we might get loads of Floating IP tasks run, when it would get nodes available more quickly if the tasks were grouped by node14:54
*** hdd has joined #openstack-infra14:54
jeblairjedimike: may or may not be what you're seeing; just another data point for you14:54
jedimikejeblair, we see there isn't a single task that takes more that 60s to complete, but some nodes are waiting 20 minutes to be deleted because of the order the tasks get run in14:55
jeblairjedimike: well, tasks are fifo14:55
openstackgerritgordon chung proposed openstack-infra/project-config: add experimental ceilometer elasticsearch db jobs  https://review.openstack.org/16082414:55
jeblairjedimike: you might see an individual node become ready faster, but overall, i don't think reordering tasks will get you anything if you're running at capacity14:55
jeblair(everything needs to be done eventually)14:55
*** amitgandhinz has joined #openstack-infra14:56
jedimikejeblair, but we're runing out of capacity because we're waiting 20 minutes for a node to be deleted :)14:56
*** mpavone has joined #openstack-infra14:57
jeblairjedimike: yes, but if i'm hearing you correctly, during those 20 minutes, you're waiting for something else to happen... it's a zero-sum game.  you can't reorder things to make it faster, the only way to make it faster is to, well, make it faster:14:57
jeblairjedimike: like ensuring that your rate limits are set appropriately14:58
*** dhritishikhar has joined #openstack-infra14:58
jeblairjedimike: making the cloud you're using faster, or doing fewer tasks14:58
*** zz_dimtruck is now known as dimtruck14:58
*** garyh has joined #openstack-infra14:59
jeblairjedimike: it's important to realize that all of the tasks are non-blocking14:59
jedimikejeblair, so you can delete a node from the cloud without first releasing it's floating ip?15:00
jeblairjedimike: they are individual nova api calls.... you said none takes more than 60s... that seems excessive.  an individual task should take very little time15:00
*** che-arne has quit IRC15:00
*** tonytan4ever has joined #openstack-infra15:01
jeblairjedimike: nodepool deletes the floating ip first, then the server15:01
*** rlandy has quit IRC15:01
*** dangers_away is now known as dangers15:01
jeblairjedimike: (actually, floating ip, keypair, then server)15:01
*** _nadya_ has quit IRC15:01
jedimikejeblair, that's my point. The second task is blocked by the first.15:01
*** wenlock has joined #openstack-infra15:01
jeblairjedimike: it's not, actually.  http://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/provider_manager.py#n57815:02
jedimikejeblair, so we have nodes sat around in delete state waiting for their second or third delete task for a long time, while nodepool is sending the first delete task to a load of other nodes, when it could be sending the last delete task to the node that's ready for it15:02
jeblairjedimike: if you examine that code, you'll see that it does not wait for the floating ip to be deleted.  it issues the call and continues without blocking.15:03
*** ZZelle_ has joined #openstack-infra15:03
jeblairjedimike: it does wait for the call to be _issued_, but it does not block on a state change within the cloud.15:03
jedimikejeblair, ah, i see, thanks. Then I need to just post this data to the mailing list and get conclusions from people who are more familiar with the internals :)15:03
*** eharney has joined #openstack-infra15:04
jeblairjedimike: what's the 'rate:' set for your provider(s)?15:05
zxiiroclarkb: would you mind reviewing my patch? it needs one more +2 and it's something we need soon https://review.openstack.org/#/c/155865/15:05
AJaegerjeblair, good morning. Is there a way to add openstackinfra access to the #openstack-rally channel? The channel is not registered and setup with gerritbot but not with accessbot. That'S the earlier discussion with boris-42.15:06
openstackgerritTomas F proposed openstack-infra/jenkins-job-builder: Add combine-queued-commit support  https://review.openstack.org/16082915:06
jeblairAJaeger, boris-42: i just finished setting it up.  should be good to go now.15:07
AJaegerjeblair, wow! Thanks!15:07
openstackgerritafazekas proposed openstack-infra/devstack-gate: Add an extra tempest worker by default  https://review.openstack.org/16083015:07
AJaeger /msg chanserv access #openstack-rallyl list15:07
AJaeger /msg chanserv access #openstack-rally list15:08
AJaegerjeblair, let me send a patch to add accessbot then...15:08
*** eharney has quit IRC15:09
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add #openstack-rally to accessbot  https://review.openstack.org/16083115:10
AJaegerjeblair, looks fine - I really have to learn to type /msg without a leading space ;(15:10
jedimikejeblair, we don't have a rate entry in nodepool.yaml... do you know what the default is? (btw, thanks for answering my uninformed ramblings! :) )15:11
* sigmavirus24 hopes https://review.openstack.org/#/c/160600/ is the last time os-ansible-deployment has to bug y'all15:11
*** nelsnelson has joined #openstack-infra15:12
*** thedodd has joined #openstack-infra15:12
*** nelsnelson has quit IRC15:12
jrollAJaeger: in my client, you use e.g. //msg15:12
*** sarob_ is now known as sarob15:13
jrollmight be the same for yours :)15:13
AJaegerjeblair, clarkb with my three patches from today for accessbot/gerritbot, the only channels in gerritbot that are not in accessbot are: milk-dev, openstack-mistral, puppet-openstack, and rubick15:13
AJaegerjroll, it'S really the extra space at beginning of line - and me beeing so dumb that I copy and paste the space in ;(15:13
jrollAJaeger: oh, I see, lol15:14
AJaegerI changed my "cheat sheet" now so that there's nomore a space15:14
*** rlandy has joined #openstack-infra15:15
*** dustins has joined #openstack-infra15:15
*** jerryz_ has quit IRC15:15
*** ghostpl_ has joined #openstack-infra15:16
*** tsg has quit IRC15:17
*** prad has joined #openstack-infra15:17
*** ghostpl_ has quit IRC15:17
*** ghostpl_ has joined #openstack-infra15:17
*** nelsnelson has joined #openstack-infra15:18
*** bhunter71 has joined #openstack-infra15:18
AJaegerboth rubick and milk are dead, so let's remove them as well...15:20
*** odyssey4me has joined #openstack-infra15:22
*** Guest57892 has joined #openstack-infra15:22
*** Guest57892 is now known as cloudnull15:22
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove rubick and milk-dev from gerritbot  https://review.openstack.org/16083815:23
*** eharney has joined #openstack-infra15:24
*** alexpilotti has joined #openstack-infra15:25
*** mpaolino has quit IRC15:28
AJaegerjeblair, clarkb, with my patch above, this leaves two active projects with channels that are not setup in accessbot: openstack-mistral and puppet-openstack.15:28
*** nelsnelson has quit IRC15:28
*** mpaolino has joined #openstack-infra15:28
AJaegerjeblair, do you want to add openstackinfra to them as well - or shall we wait whether the teams do it themselves or ask?15:28
jeblairAJaeger: let's wait for someone to engage us15:29
*** wuhg has quit IRC15:29
AJaegerok, jeblair. I asked them to setup access but so far no reaction - but indeed nothing urgent here..15:30
openstackgerritMatthew Treinish proposed openstack-infra/puppet-subunit2sql: Add backup before running db migrations  https://review.openstack.org/16051415:30
*** tiswanso has quit IRC15:30
openstackgerritgordon chung proposed openstack-infra/project-config: add experimental ceilometer elasticsearch db jobs  https://review.openstack.org/16082415:31
openstackgerrityolanda.robla proposed openstack-infra/storyboard: Add an index on accesstokens table for access_token column  https://review.openstack.org/15654315:31
*** tiswanso has joined #openstack-infra15:32
*** patrickeast has joined #openstack-infra15:32
*** sigmavirus24 has quit IRC15:33
*** sergsh has quit IRC15:33
*** dkranz has joined #openstack-infra15:34
*** sigmavirus24 has joined #openstack-infra15:35
openstackgerrityolanda.robla proposed openstack-infra/jeepyb: Enforce manage_projects to be run with specified user  https://review.openstack.org/15208515:39
openstackgerritAlistair Coles proposed openstack-infra/project-config: Fix swiftclient func tests to run using both auth versions  https://review.openstack.org/16084415:40
*** annegentle has joined #openstack-infra15:42
*** carl_baldwin has joined #openstack-infra15:42
*** mpaolino has quit IRC15:43
BharatKclarkb: ping15:43
*** sputnik13 has quit IRC15:43
BharatKclarkb: https://review.openstack.org/#/c/160664/15:43
*** apmelton has joined #openstack-infra15:43
*** arxcruz has quit IRC15:44
*** mpaolino has joined #openstack-infra15:44
BharatKclarkb: please review this patch to reenable glusterfs job for cinder15:44
*** claudiub has quit IRC15:45
BharatKAJaeger: please review this patch https://review.openstack.org/#/c/160664/15:46
*** jaypipes has joined #openstack-infra15:46
BharatKAJaeger: while will reenables the glusterfs job for Cinder15:46
*** claudiub has joined #openstack-infra15:46
*** patrickeast has quit IRC15:48
*** skolekonov has quit IRC15:49
*** yfried has quit IRC15:50
*** mpaolino has quit IRC15:50
*** ddieterly has quit IRC15:52
*** ddieterly has joined #openstack-infra15:52
*** trinaths has joined #openstack-infra15:52
*** stevemar has joined #openstack-infra15:53
*** trinaths1 has joined #openstack-infra15:54
openstackgerrityolanda.robla proposed openstack-infra/nodepool: Enforce nodepool user when running cmd commands  https://review.openstack.org/16033615:54
*** unicell has joined #openstack-infra15:54
*** unicell1 has quit IRC15:56
*** trinaths has quit IRC15:57
*** spzala has quit IRC15:58
*** _nadya_ has joined #openstack-infra15:59
*** tsg has joined #openstack-infra15:59
*** spzala has joined #openstack-infra15:59
*** erikwilson has joined #openstack-infra16:00
*** erikmwilson is now known as Guest5878516:00
*** erikwilson is now known as erikmwilson16:00
*** erikwilson has joined #openstack-infra16:00
*** mpavone has quit IRC16:00
*** otter768 has joined #openstack-infra16:00
*** crinkle has quit IRC16:01
*** crinkle has joined #openstack-infra16:01
*** dustins_ has joined #openstack-infra16:01
*** rmcall has joined #openstack-infra16:02
*** tsg_ has joined #openstack-infra16:02
*** ildikov has quit IRC16:02
*** ekarlso has quit IRC16:03
*** SpamapS has quit IRC16:03
*** SpamapS has joined #openstack-infra16:04
*** dustins has quit IRC16:04
*** tsg has quit IRC16:05
*** otter768 has quit IRC16:05
*** annegentle has quit IRC16:06
*** kmartin has joined #openstack-infra16:06
*** annegentle has joined #openstack-infra16:06
jeblairsdague: you were working on support for dashboard editing in jeepyb, right?16:07
*** ekarlso has joined #openstack-infra16:07
*** mrunge has quit IRC16:08
*** ldnunes has quit IRC16:08
sdaguesometime over the summer, I abandoned that patch as it was stalled and I lost context on it. It should be in gerrit somewhere16:08
*** ChuckC has joined #openstack-infra16:08
jeblairsdague: bummer, i was looking forward to it.16:09
openstackgerritMatthew Treinish proposed openstack-infra/puppet-subunit2sql: Add backup before running db migrations  https://review.openstack.org/16051416:09
sdaguehere is the review for reference - https://review.openstack.org/#/c/94260/16:11
*** cp16net has joined #openstack-infra16:13
*** ghostpl_ has quit IRC16:14
*** JoshNang has joined #openstack-infra16:14
pabelangerGreetings, do the infra-spec get served up HTML some place?16:14
*** cp16net has left #openstack-infra16:14
jeblairpabelanger: http://specs.openstack.org/openstack-infra/infra-specs/16:14
pabelangerjeblair, danke16:14
anteayaHeOS: so here is an example of an acl file using wildcards to define groupings upon which to set permissions: http://git.openstack.org/cgit/openstack-infra/project-config/tree/gerrit/acls/openstack/cinder.config16:14
anteayaHeOS: the access "refs/heads/<branch-name>/*" part is the definiiton of what files will get the permissions that follow16:15
*** amotoki has quit IRC16:16
*** carl_baldwin has quit IRC16:16
*** ildikov has joined #openstack-infra16:18
*** changbl has joined #openstack-infra16:19
*** rlandy has quit IRC16:20
*** ChuckC has quit IRC16:20
pabelangerPretty excited about the common openstack ci solution spec16:20
anteayapabelanger: cool, do you want to help with it?16:20
openstackgerrityolanda.robla proposed openstack-infra/nodepool: Enforce nodepool user when running cmd commands  https://review.openstack.org/16033616:21
anteayapabelanger: have you met asselin yet?16:21
pabelangeranteaya, Ya, I'll likely commit some resources to it.  Seems like a good cause16:21
anteayapabelanger: awesome we'd love to have your help16:21
anteayapabelanger: getting to know asselin is probably a good first stop as he is the driver for that spec16:22
*** ddieterly has quit IRC16:22
anteayahe is in pacific time so should be around shortly16:22
*** ddieterly has joined #openstack-infra16:22
pabelangerSure, sounds good.  I'm working on my 3rd time reproducing the environemt for people :)  So, anything to cut down on duplicate code is a good thing.16:23
*** dhritishikhar has quit IRC16:23
*** carl_baldwin has joined #openstack-infra16:24
anteayapabelanger: ha ha ha, yes I hear that16:24
*** nelsnelson has joined #openstack-infra16:26
*** nelsnelson has quit IRC16:27
*** enikanorov has quit IRC16:28
*** nelsnelson has joined #openstack-infra16:28
*** dizquierdo has quit IRC16:28
*** enikanorov has joined #openstack-infra16:28
*** dimtruck is now known as zz_dimtruck16:29
*** Svedrin has quit IRC16:29
*** alexpilotti has quit IRC16:31
openstackgerrityolanda.robla proposed openstack-infra/puppet-cgit: Add configurable Timeout settings on git vhost  https://review.openstack.org/16087116:31
*** unicell1 has joined #openstack-infra16:32
*** che-arne has joined #openstack-infra16:32
*** unicell has quit IRC16:32
*** ghostpl_ has joined #openstack-infra16:33
*** yamahata has joined #openstack-infra16:33
boris-42jeblair: thanks!16:34
boris-42AJaeger: thank you too!16:35
boris-42jeblair: AJaeger finally we have normal IRC channel and get add standard logging for it16:35
boris-42be able to add*16:35
*** Bsony has quit IRC16:36
*** ildikov has quit IRC16:37
*** david-lyle_afk has quit IRC16:37
*** david-lyle has quit IRC16:37
*** reed has joined #openstack-infra16:38
asselinpabelanger, hi16:38
*** MaxV has quit IRC16:39
pabelangerasselin, Greetings. Just mentioning I'm interested in your venture to make -infra config more generic for the 3rd party.16:40
pabelangerPlan to follow along and possible commit if possible16:40
asselinpabelanger, great! yeah, spec just got approved.16:40
krtaylor\o/16:40
pabelangerindeed, seen that16:41
pabelangerTrying to stand up a new environment this month, interested to see what is in the pipeline.16:41
asselinpabelanger, out of curiosity, what approach did you use for the environments you've set up already?16:41
pabelangerasettle, mostly extract the existing -infra bits into my own puppet repo.16:42
SpamapSo/16:42
pabelangerI've packaged some tools like JJB, zuul, and nodepool into debian packages to consume, vs pip16:42
*** dustins_ has quit IRC16:42
*** markvan has quit IRC16:42
pabelangerbut I'm not running the latest versions obviously16:43
pabelangerI tend to sync with upstream every so often16:43
*** zz_dimtruck is now known as dimtruck16:43
pabelangermostly when I want to pull in something cool / new feature16:43
pabelangerthen, deal with the upgrade of things at that point16:43
asselinpabelanger, cool. yes, I'll admit there are advantages to running more stable versions16:43
*** dustins has joined #openstack-infra16:44
pabelangerI'm hoping the openstackci project will do some sort of 6 month release schedule.  But, not sure how that will all work16:44
pabelangerYa, my environments are super small compared to -infra16:44
*** MarkAtwood has joined #openstack-infra16:45
pabelangerFor me, the bigger issue was to consume nodepool resources since most of the cost for cloud time was out of pocket16:45
pabelangerbut none the less, still see a ton of value in it16:45
*** MarkAtwood has quit IRC16:45
*** MarkAtwood has joined #openstack-infra16:45
asselinpabelanger, well, i think the current/initial plan is to stick with 'master'.16:46
pabelangerbut, once the environment was setup, I didn't do much maintenance on it, unless I needed new features.16:46
*** dustins has quit IRC16:46
pabelangerYup, I can see that16:46
*** cdent has quit IRC16:46
asselinpabelanger, another idea a reviewer added was to create an ci-appliance.16:47
SpamapSpabelanger: and therein lies the rift between fast and stable. If your needs are not changing rapidly, there is simply no point in running from trunk. :)16:47
openstackgerritenikanorov proposed openstack/requirements: Bump oslo.db version to 1.5.0  https://review.openstack.org/16073116:48
SpamapStrunk/master/tip/zomgcrazycrack16:48
*** HeOS has quit IRC16:48
*** tnovacik has quit IRC16:48
pabelangerasselin, Ya, I've been meaning to try softwarefactory from enovance, that looks to be the idea of that tool16:49
*** mtanino has joined #openstack-infra16:49
pabelangerSpamapS, Right. Will be curious to see if there is some sort of release cycle for the project16:49
openstackgerrityolanda.robla proposed openstack-infra/puppet-cgit: Add configurable setting for MaxClients  https://review.openstack.org/16088516:49
*** jistr has quit IRC16:50
*** thedodd has quit IRC16:51
*** Guest32544 is now known as redrobot16:51
*** tonytan4ever has quit IRC16:51
krtaylorpabelanger, we did a parallel environment with a known working snapshot of upstream for reporting against patches and a development environment with the latest from infra16:51
*** tonytan4ever has joined #openstack-infra16:52
*** annegent_ has joined #openstack-infra16:54
*** jcoufal has quit IRC16:54
pabelangerkrtaylor, How did you pick your snapshot?  Just random checkouts? I tried to pick tags for the software, and if a tag had not been cut is some time, I've requested something in the past.  EG: zuul16:54
sigmavirus24For the people who were discussing gitlab versus gitorious last night: https://about.gitlab.com/2015/03/03/gitlab-acquires-gitorious/16:54
openstackgerritDmitry Tantsur proposed openstack/requirements: Add python-openstackclient  https://review.openstack.org/16088716:54
*** devvesa has quit IRC16:54
*** tonytan4ever has quit IRC16:56
*** kmartin has quit IRC16:56
*** unicell1 has quit IRC16:57
*** scheuran_ has quit IRC16:57
*** annegentle has quit IRC16:58
*** gyee has joined #openstack-infra16:58
openstackgerritMatthew Treinish proposed openstack-infra/puppet-subunit2sql: Add backup before running db migrations  https://review.openstack.org/16051417:01
*** mpavone has joined #openstack-infra17:01
openstackgerritMerged openstack/requirements: Oslo.versionedobjects requirement  https://review.openstack.org/15938017:01
*** MaxV has joined #openstack-infra17:02
*** dtantsur is now known as dtantsur|afk17:02
*** andreykurilin_ has joined #openstack-infra17:03
openstackgerritDan Smith proposed openstack-infra/project-config: Enable dsvm testing on oslo.versionedobjects  https://review.openstack.org/16089317:03
openstackgerritJulia Kreger proposed openstack-infra/shade: Add ironic node deployment support  https://review.openstack.org/16089417:03
krtaylorpabelanger, we test a latest-and-greatest pull in our dev environment, if it works good, that becomes our snapshot, nothing fancy17:03
pabelanger /me nods17:04
*** david-lyle has joined #openstack-infra17:05
openstackgerritJulia Kreger proposed openstack-infra/shade: Add ironic node deployment support  https://review.openstack.org/16089417:05
*** hodos has joined #openstack-infra17:05
krtaylorpabelanger, you can read about our environment in the third-party-ci-wg meetings at:  http://eavesdrop.openstack.org/meetings/third_party/2015/third_party.2015-02-04-15.00.log.html17:06
openstackgerritDan Smith proposed openstack-infra/project-config: Enable dsvm testing on oslo.versionedobjects  https://review.openstack.org/16089317:06
pabelangerkrtaylor, interesting, will check it over17:08
*** kmartin has joined #openstack-infra17:09
*** Ala has quit IRC17:10
*** alexpilotti has joined #openstack-infra17:11
Ngmordred: aboot?17:12
*** andreykurilin_ has quit IRC17:12
*** Longgeek has quit IRC17:12
openstackgerrityolanda.robla proposed openstack-infra/puppet-cgit: Add configurable setting for MaxClients  https://review.openstack.org/16088517:12
*** andreykurilin_ has joined #openstack-infra17:13
*** ildikov has joined #openstack-infra17:13
Ngmordred: your last upload to 154132 seems to remove the bin/ and modify the install scripts to copy the tools from something in /tmp, but I'm not seeing how those things get into /tmp/ in the first place17:14
*** Bsony has joined #openstack-infra17:14
*** changbl has quit IRC17:14
*** chlong has quit IRC17:17
*** Longgeek has joined #openstack-infra17:18
*** Longgeek has quit IRC17:21
d34dh0r53Sorry to bother, but I was wondering I we could get a quick review on https://review.openstack.org/#/c/160600/3 by someone with +2?17:21
mordredNg: there should be a source-repositories ...17:22
mordredNg: oh - I didn't check it in ... sone sec17:22
Ng:)17:22
openstackgerritMonty Taylor proposed openstack-infra/project-config: Add config-drive element  https://review.openstack.org/15413217:23
mordredNg: ^^17:23
*** ChuckC has joined #openstack-infra17:23
openstackgerritMatthew Treinish proposed openstack-infra/puppet-subunit2sql: Add backup before running db migrations  https://review.openstack.org/16051417:24
*** ihrachyshka has quit IRC17:25
Ngmordred: ta17:25
anteayad34dh0r53: it's all yours, hopefully it works for you17:26
*** sputnik13 has joined #openstack-infra17:26
* d34dh0r53 bows to anteaya 17:26
*** jpeeler has joined #openstack-infra17:26
mordredNg: also - for rax ... after you have the image, tools/upload-rax.sh does the vhd conversion, upload and sets the right metadata17:27
anteayaplease don't do that17:27
mordredNg: oh, actually, not the metadata17:27
anteayajust let me know if it works17:27
sigmavirus24anteaya: thanks17:27
anteayasigmavirus24: thanks for your digging, I learned a lot17:27
sigmavirus24anteaya: given the amount of hair pulling that went into that change17:27
mordredNg: after it's uploaded (you need to do glance task-show on the task id to poll for it)17:27
sigmavirus24I think it'll work now17:27
anteayasigmavirus24: yeah no kidding17:27
mordredNg: tools/update-rax-metadata.sh does the metadata17:28
sigmavirus24anteaya: yeah we should also document DirSets better for people sending changes to project-config17:28
anteayawell you should find out soon17:28
anteayasigmavirus24: I'm all for that, are you willing to draft a patch?17:28
mordredNg: obviously, you can do those steps in another way - those scripts are mainly just there to show the steps needed17:28
sigmavirus24anteaya: specifically explaining that DirSets are what source translated to and DirSets only work from the current directory and contents inside it17:28
sigmavirus24anteaya: where's the right place for that documentation?17:28
Ngmordred: I love scripts that do typing for me :)17:28
mordredNg: I've got an ansible playbook too - but it currently depends on non-released stuff17:28
anteayasigmavirus24: we don't have a read me for project-config though we have kicked the idea around17:28
mordredNg: I made this last night: https://etherpad.openstack.org/p/config-drive-infra-dib17:29
sigmavirus24anteaya: I think as long as we can point people /somewhere/ it's better than having to relearn this every time ;)17:29
anteayasigmavirus24: I'm for that17:29
*** melwitt has joined #openstack-infra17:29
*** trinaths1 has quit IRC17:29
*** claudiub has quit IRC17:29
anteayaI'm wondering if we should just do a text readme or do a published structure like system-config17:30
anteayajeblair: any thoughts? ^^17:30
*** trinaths has joined #openstack-infra17:30
jeblairsigmavirus24, anteaya: http://ci.openstack.org/jenkins-job-builder/publishers.html#publishers.scp17:30
jeblairsigmavirus24, anteaya: you could improve that, perhaps.17:31
anteayaokay17:31
anteayasigmavirus24: does that look like a reasonable spot?17:31
*** tiswanso has quit IRC17:31
*** tiswanso has joined #openstack-infra17:32
sigmavirus24anteaya: it does17:32
*** e0ne has quit IRC17:32
sigmavirus24that's openstack-infra/jenkins-job-builder right?17:32
jeblairyep17:32
anteayasigmavirus24: thanks17:33
*** sarob has quit IRC17:33
*** unicell1 has joined #openstack-infra17:33
jeblairsigmavirus24, anteaya: and we can make sure project-config points people there17:34
sigmavirus24jeblair: in a README or comment or ?17:34
anteayawhat are you envisioning as a pointer?17:34
jeblairso this spot already points people there: http://docs.openstack.org/infra/manual/drivers.html#running-jobs-with-zuul17:34
SpamapSgertty users.. I'm curious. Do you all find yourself switching back and forth between gertty and review.o.o, or have you been able to fully migrate?17:35
jeblairsigmavirus24, anteaya: ah, project-config readme also points there17:35
SpamapSI find the lack of diff-of-diff to be a show-stopper for me, and also the fact that patches on long-lines don't wrap to be rather frustrating to deal with.17:35
jeblairSpamapS: diff-of-diff?17:35
SpamapSjeblair: yes, I want to see only what changed since the last patchset I reviewed.17:36
jeblairSpamapS: that's the same in gerrit and gertty...17:36
*** Svedrin has joined #openstack-infra17:36
anteayaah it does have a readme17:36
jeblairSpamapS: hit 'p' on the diff page and you can change the base commit for the diff17:36
SpamapSjeblair: no there's a reasonably o-k mode in gerrit.17:36
anteayawhich is pointers to other docs17:36
SpamapSjeblair: yeah, gerrit introduced a new thing recently which is that per-file I can do that.17:37
SpamapSjeblair: which ends up producing a more useful result, because it only shows me differences in the files that actually changed in this patch set.17:37
openstackgerritDoug Wiegley proposed openstack-infra/project-config: Since grenade relies on devstack, add it to devstack's check queue  https://review.openstack.org/16091417:37
jeblairSpamapS: walk me through this17:37
SpamapSjeblair: in review.o.o, click commit message on the latest change17:37
SpamapSjeblair: then all of the patchsets are enumerated on the top left, and choose the last one you reviewed.17:38
jeblairSpamapS: can you supply an example change so we have the same context?17:38
SpamapShttps://review.openstack.org/#/c/154132/17:38
jeblairSpamapS: old change screen or new?17:38
SpamapSI reviewed patch set 6 last17:38
SpamapSjeblair: on the left side, I click 6, and viola, changes that matter. :)17:39
openstackgerritMerged openstack-infra/project-config: Fix os-ansible-deployment publishers one last time  https://review.openstack.org/16060017:39
jeblairSpamapS: are you using the old change screen, or the new change screen?17:39
SpamapSAnd yes I meant to say viola, and not voila, because I just love mid-range strings.17:39
SpamapSjeblair: I don't know what that means? :-P17:39
jeblairSpamapS: open a file diff and send me the direct link17:40
SpamapSold screen17:40
SpamapSin preferences17:40
SpamapSright?17:40
jeblairSpamapS: yeah17:40
openstackgerritDoug Wiegley proposed openstack-infra/project-config: neutron-*aas pylint jobs moving into pep8 job  https://review.openstack.org/16091517:40
*** dannywilson has joined #openstack-infra17:40
jeblairSpamapS: okay, i'm at "in review.o.o, click commit message on the latest change".  what does that mean?17:41
SpamapSUntil this moment, I have never seen the "new screen" ;)17:41
jeblairSpamapS: okay don't look at it now, it's just going to confuse me17:41
SpamapSah but it is similar.17:41
* SpamapS switches back to maintain parallel velocity17:41
*** vilobhmm has joined #openstack-infra17:41
jeblairSpamapS: do you mean i should click the link that goes here: https://review.openstack.org/#/c/154132/10//COMMIT_MSG  ?17:42
SpamapSjeblair: thanks for walking through this with me. :)17:42
SpamapShttps://review.openstack.org/#/c/154132/10//COMMIT_MSG yes17:42
*** dhritishikhar has joined #openstack-infra17:42
jeblairSpamapS: then click "Patch Sets" at the top17:42
SpamapSthen I click https://review.openstack.org/#/c/154132/6..10//COMMIT_MSG17:43
SpamapSwhich has a link text of "6"17:43
*** ssam2 has quit IRC17:43
jeblairSpamapS: oh ok17:43
SpamapSPatch Set Base 1 2 3 4 5 6 7 8 9 10   <-- looks like that17:43
jeblairSpamapS: got it17:43
jeblairSpamapS: that's actually functionally equivalent to what i said17:43
SpamapSThis makes all of the files next links go to the same 6..10 but doesn't include files that weren't part of 10's patch set17:44
jeblairSpamapS: so "Patch Sets" -> "Old Version; radio button 6" is the same as "Patcch Set Base 6"17:44
SpamapSjeblair: ah ok so I won't get a million rebase-results if I change things?17:44
SpamapSgah terrible sentence17:44
SpamapSjeblair: ah ok so I won't get a million rebase-results if I use "p" in diff mode?17:44
jeblairSpamapS: i'm still just talking about gerrit -- i have come to the conclusion there are two UI paths to get the same result17:45
SpamapSI'm searching for a patch that demonstrates what I don't want.17:45
SpamapSjeblair: ah ok.17:45
*** rkukura has joined #openstack-infra17:45
jeblairSpamapS: so, still within gerrit, there is no way to "interdiff".  a content change combined with a rebase is a mess.17:45
jeblairSpamapS: doing what we're doing will show you differences between patchsets, but if a rebase is involved, the rebase will appear as differences as well17:46
SpamapSjeblair: absolutely. In any single file, I will get rebased changes.17:46
SpamapSjeblair: But what I like about the method I have, is that I will not get any files that did not change as a result of the new patch.17:46
SpamapSSo it's purely an optimization of the same bad-not-interdiff method. :)17:47
jeblairSpamapS: ah i see, so you are suggesting that while gertty has the same ability to diff between patchsets, it lacks a filter on the resulting file set that limits it to the files within the "new" side of the diff?17:47
*** dimtruck is now known as zz_dimtruck17:48
pc_mHi! Can I get a second core review of this project-config commit? https://review.openstack.org/#/c/158389/17:48
SpamapSjeblair: indeed, and discussing this outside my own head makes me realize this may just be a happy accident in the gerrit UI.17:49
*** yamahata has quit IRC17:49
anteayapc_m: I tried to review that at the end of my day last night, I coudn't make it through the commit message17:49
pc_manteaya: :)17:49
*** sarob has joined #openstack-infra17:49
anteayapc_m: what are you doing in this patch, adding a test?17:50
jeblairSpamapS: so, we could diff new_base -> new_commit, get a list of files, then diff other_base -> new_commit and filter the resulting diff to the files from step 117:50
jeblairSpamapS: i confess, i'm not sure if i feel that's "correct"17:50
pc_manteaya: Adding a new job. For the StrongSwan driver (which will become the new reference implementation), it requires a different devstack setup for functional tests.17:50
jeblairSpamapS: (of course, what's best is if rebase patchsets are kept separate from content-changing patchsets)17:51
anteayapc_m: I can understand the need in neutron to write a thesis in the commit message, but mostly I just need to know if you are adding a test or similar17:51
*** zz_dimtruck is now known as dimtruck17:51
SpamapSjeblair: Yeah, I don't think anything I have now comes close to "best"17:51
anteayaadding a new job, okay thanks17:51
BobBallWhat installs /etc/apache2/sites-enabled for zuul and jenkins?  I'm trying to run the two on the same host, but I've got two issues: jenkins adds a redirect from http to https (which is where jenkins is served from) and zuul was only configured on the IP address not the resolved hostname17:51
jeblairSpamapS: i've also thought that perhaps an interdiff could be automated in gertty; but i haven't quite figured out how that would work yet17:51
SpamapSjeblair: but filtering out files that did not change in either patch set is a time saver for me.17:51
*** _nadya_ has quit IRC17:52
SpamapSjeblair: does anybody have an interdiff solution btw? I've never gotten this far down the rebase road before.17:52
jeblairSpamapS: not that i'm aware of17:52
anteayapc_m: you are adding a new experimental job to your own repo17:52
pc_manteaya: Understood, but it is more than adding a test, and trying to indicate A) why it is needed, and B) what the impact is of this change (new dirs used), so that developers know what they need to do to add tests.17:52
anteayapc_m: even easier17:52
*** AJaeger_ has joined #openstack-infra17:52
pc_manteaya: yes and yes.17:52
anteayapc_m: for me, I need to hear I"m adding a new experimental job to my own repo17:53
anteayaand I can understand the need for the rest in comments17:53
jeblairSpamapS: i _think_ it would be okay to add that filtering to gertty17:53
pc_manteaya: OK, sort of thought that's what the subject said. I can reword, if needed.17:54
SpamapSjeblair: so perhaps this is just the drawback we have to deal with because we rebase.17:54
jeblairSpamapS: especially if we did the union of files changed in both old and new patchsets17:54
anteayapc_m: no need, now that I have context this helps me understand what I am looking at17:54
SpamapSjeblair: right, I think that union is at least going to be likely to catch relevant differences.17:54
jeblairSpamapS: yeah, avoiding rebasing (or limiting it to a patchset that makes no substantial changes) is the best17:54
jeblairSpamapS: want to file a story to add the file limiting?17:55
pc_manteaya: Super. I'll try to word better for subsequent commits (when make it non-experimental, and then when voting).17:55
SpamapSThere may be rebased stuff that changes the general assumptions the code was originally reviewed under, but one would hope the reviewer would take those into account by nature of being familiar with the project.17:55
jeblairya17:55
openstackgerritIan Cordasco proposed openstack-infra/jenkins-job-builder: Add detailed call out about the SCP plugin  https://review.openstack.org/16091917:55
SpamapSjeblair: I will do that now, yes. Thanks again for walking through it with me.17:55
sigmavirus24anteaya: jeblair ^ (https://review.openstack.org/#/c/160919/)17:56
SpamapSjeblair: this is slightly related to https://storyboard.openstack.org/#!/story/2000138 btw17:56
SpamapSbut not exactly the same thing17:56
anteayapc_m: fwiw telling me "This patch adds a new experimental job to our repo" is as low risk as it gets17:56
pc_manteaya: gotcha17:56
anteayain that the experimental pipeline is where mistakes are supposed to happen17:57
anteayaand adding a job to your own repo only needs your approval17:57
openstackgerritJames E. Blair proposed stackforge/gertty: Wrap long lines in side-by-side diffs  https://review.openstack.org/16092117:58
jeblairSpamapS: there's the fix to your other thing ^ :)17:58
*** markvan_ has quit IRC17:58
SpamapSjeblair: \o/17:58
*** markus_z has quit IRC17:58
pc_manteaya: Really?17:58
jeblairSpamapS: i expect a comprehensive and thorough review of that change!  ;)17:58
*** thingee has joined #openstack-infra17:59
pc_manteaya: That's good to know. Then does it require infra, when moved to the check queue non-voting?17:59
anteayasigmavirus24: nicely done, I just want to see how the docs build17:59
*** markvan has joined #openstack-infra17:59
sigmavirus24anteaya: understood17:59
anteayapc_m: oh yes, just shareing my perpective in terms how how much work to make something happen, experimental pipeline is low risk, non-voting check is higher and voting jobs (check and gate) are highest18:00
anteayapc_m: adding jobs to your own repo is low risk (you are only shooting yourself in the foot, usually) adding jobs to other repos needs more communication18:00
*** bdpayne has joined #openstack-infra18:00
pc_manteaya: great. I we need to be able to start testing out the StrongSwan functional tests being developed.18:01
anteayapc_m: this is the thought pattern I hold when I review18:01
SpamapSjeblair: https://storyboard.openstack.org/#!/story/200018618:01
anteayapc_m: cool18:01
pc_manteaya: I like the way you think :)18:01
*** otter768 has joined #openstack-infra18:01
*** shardy has quit IRC18:01
anteayapc_m: thanks, commit mesasges that tell me how to contextualize a new patch really help me18:01
jeblairsigmavirus24: i left a comment on that with a suggestion of a different location to put that18:02
pc_manteaya: Actually, I can't approve, as I don't have +2 +A in infra area...18:02
pc_manteaya: project-config repo...18:02
anteayaas in tell me what pipeline (experimental, non-voting or voting) and tell me how the repos relate to you (mine, someone else's, multiple someone else's)18:02
*** ghostpl_ has quit IRC18:03
sigmavirus24jeblair: I'll look, thanks18:03
mrmartinif we are in the middle of this +2 lottery, can I get a +2 here: https://review.openstack.org/#/c/159426/ ?18:03
mrmartin:)18:03
pc_manteaya: Oh, I get you... you mean, you only need my approval to give approval for experimental job...18:04
pc_mnot that I only need to approve.18:04
*** marcusvrn has quit IRC18:04
*** timcline has joined #openstack-infra18:04
mrmartinthnx.18:04
*** changbl has joined #openstack-infra18:04
*** tnovacik has joined #openstack-infra18:05
clarkbwow I get dinner in the crock pot and this channel goes crazy18:05
anteayapc_m: well if someone who wastn' you wanted to add a job to a vpnaas pipeline, I would want you to know about it18:06
*** otter768 has quit IRC18:06
anteayapc_m: and +1 the patch in review18:06
*** ihrachyshka has joined #openstack-infra18:06
*** marun has joined #openstack-infra18:06
openstackgerritIan Cordasco proposed openstack-infra/jenkins-job-builder: Add detailed call out about the SCP plugin  https://review.openstack.org/16091918:06
anteayaclarkb: what are you cooking?18:06
sigmavirus24jeblair: updated ;)18:06
*** jaypipes has quit IRC18:07
clarkbanteaya: chili18:07
pc_manteaya: gotcha18:08
anteayapc_m: cool, thanks for understanding18:09
anteayaclarkb: sounds good18:09
*** jaypipes has joined #openstack-infra18:10
*** Bsony has quit IRC18:10
*** Bsony has joined #openstack-infra18:10
pc_manteaya: Thanks for approving!18:11
anteayasure18:12
*** harlowja_away is now known as harlowja_18:12
openstackgerritMerged openstack-infra/project-config: Setup non-voting VPNaaS func test for StrongSwan  https://review.openstack.org/15838918:14
*** tsg_ has quit IRC18:14
clarkbI am checking up on jenkins masters now to see if 04 is doing better than its comrades18:15
anteayaclarkb: I'm keen to hear your findings18:15
*** alexpilotti_ has joined #openstack-infra18:16
*** ivar-lazzaro has joined #openstack-infra18:16
pleia2oh nice, debian and ubuntu ship with different versions of netcat (debian has netcat-traditional and ubuntu has netcat-openbsd), and they have different options18:16
clarkb04 is still very light on the remoting threads so thats good. 05 has not decreased its number of threads despite being in shutdown mode so I think this is a realy leak that doesn't slowly resolve itself18:16
pleia2I've been testing on debian \o/18:16
pleia2"why this not work on Ubuntu..."18:16
clarkbpleia2: I think nc -k -l 29418 is what you want on ubuntu18:16
*** alexpilotti has quit IRC18:16
*** alexpilotti_ is now known as alexpilotti18:16
*** erlon has joined #openstack-infra18:17
pleia2clarkb: we need the echo response as well, with -traditional there is a -c for a command (like an echo)18:17
clarkbpleia2: do we? I figured just establishing a tcp connection was sufficient18:17
pleia2clarkb: ah, well if that's all :)18:17
clarkbasselin: ^ do you need anything more than that?18:18
asselinclarkb, pleia2 that should be enough18:18
pleia2clarkb: so, should we do anything more official than just tossing this in a screen session?18:19
jeblairpleia2: i'm okay with screen18:20
*** yamahata has joined #openstack-infra18:20
clarkbpleia2: I don't think it needs anything more especially if asselin can do testing quicklyish18:20
*** crc32 has joined #openstack-infra18:20
openstackgerritMatthew Treinish proposed openstack-infra/project-config: Build wheel house during nodepool devstack caching  https://review.openstack.org/16054818:20
asselinyes, I can test.18:20
mtreinishjogo: ^^^18:20
clarkbok jenkins report. Only 05 is showing symptoms of the leak. 04 is happy but considering that 01-04,06,07 are all happy I don't want to call it fixed just yet18:20
asselinother cinder folks would like this too18:21
mtreinishjeblair: ^^^ That should address your comments18:21
clarkbanteaya: ^18:21
anteayacool, what do you want to do based on that info?18:21
*** yamahata has quit IRC18:21
asselinpleia2, clarkb so it would be good to keep it enabled until around when the ip switch is done18:22
*** andreykurilin_ has quit IRC18:22
*** yamahata has joined #openstack-infra18:22
*** _nadya_ has joined #openstack-infra18:22
*** andreykurilin_ has joined #openstack-infra18:23
*** achanda has joined #openstack-infra18:23
clarkbanteaya: we should probably let 04 sit longer before we bother upgrading the others especially if 05 is the only one currently in a bad state18:23
anteayafair enough18:23
clarkbanteaya: I am happy to run a jenkins down for a bit in order to gather infos18:23
clarkbjeblair: ^ unless you disagree18:23
anteayarun a jenkins down, what does that entail?18:23
pleia2I don't seem to have an account on new gerrit yet (not running puppet?)18:23
jeblairclarkb: agree18:24
clarkbanteaya: basically that master just sits in shutdown mode so no slaves and jobs are assigned to it18:24
openstackgerritMerged openstack-infra/puppet-drupal: Get cron key variable from conf parameter  https://review.openstack.org/15942618:24
openstackgerritMerged openstack-infra/puppet-httpd: Remove tests  https://review.openstack.org/15908618:24
zaroclarkb: regarding 160549, the wget location is correct.18:24
clarkbzaro: hrm I will have to look at it again. The path seemed to end with versions not project names18:24
clarkbpleia2: I can hop on and check18:24
anteayaclarkb: ah so if it is a leak the leak will increase in that state?18:24
*** BobBall is now known as BobBall_AWOL18:25
*** jedimike has quit IRC18:25
clarkbanteaya: it seems related to slave connections so probably not18:25
zarozxiiro: will take a look at your jjb change.18:25
clarkbanteaya: but thats another thing to keep an eye on, that node has 9175 threads last I saw18:25
anteayaclarkb: okay cool18:25
anteayawill be interesting to see what happens after it is down for a while18:26
jeblairmtreinish: weirdly, i think it's more complicated than that.  i don't know why it was made that way18:26
zaroclarkb: yeah, i initially thought it was incorrect as well. but the UI doesn't match the real url reference.  might be a sim link or something, but it is ../$version/$plugin_name.hpi18:26
jeblairmtreinish: left a comment18:26
cineramahi pleia2!18:26
clarkbzaro: good catch I think you are right18:26
clarkbzaro: thank you for double checking on that18:27
openstackgerritJoshua Harlow proposed openstack-infra/project-config: Add python26 jobs to debtcollector  https://review.openstack.org/16092818:27
*** rkukura has quit IRC18:27
*** radez is now known as radez_g0n318:27
pleia2cinerama: hey :)18:28
*** tsg has joined #openstack-infra18:28
mtreinishjeblair: hmm, would just manually setting the path to be: '/home/jenkins/cache/files' in the element be enough. (that looks like what it does for the images)18:28
mtreinisherr s/files/wheelhouse18:28
harlowja_qq, i'm seeing '+ die 622 'Cloning not allowed in this configuration'' in http://logs.openstack.org/21/155121/1/gate/gate-tempest-dsvm-neutron-src-debtcollector/9d1a3f7/logs/devstacklog.txt.gz but am not sure if thats fixed by https://review.openstack.org/#/c/157580/ ; if it is can we get that merged so that error goes away?18:28
cineramapleia2, so i have been looking at the zanata stuff. i made a little base vagrant box with the generic puppet bits on it to use18:28
pleia2cinerama: wonderful18:28
mtreinishharlowja_: you need to make sure debtcollector is in the projects list in d-g18:29
mtreinishoh, that's what that patch is18:29
harlowja_:)18:29
jeblairharlowja_: aprvd18:29
harlowja_thx18:29
cineramapleia2: i found i needed to add "include zanata" to site.pp in zanata - was wondering if i missed something and didn't actually need to do that or what18:29
zaroclarkb: would you be willing to push this thru?  i am doing a talk soon and want to provide a url to the slides.  https://review.openstack.org/#/c/158387/18:30
pleia2cinerama: hm, I think that would include itself, more likely perhaps you need it in the local.pp?18:30
cineramapleia2: oh, ok, because i was going off of what the etherpad lite one looks like18:30
*** _nadya_ has quit IRC18:31
pleia2ah, interesting18:31
pleia2sometimes puppet confounds me :s18:31
clarkbzaro: let me look once I get pleia2 a user on new gerrit18:32
openstackgerritMatthew Treinish proposed openstack-infra/project-config: Build wheel house during nodepool devstack caching  https://review.openstack.org/16054818:32
cineramaso i didn't get a magical zanata yet but i'm going to poke at it more. learning through pokin.18:33
mtreinishjeblair: ^^^ so at least for the image files with dib it just explicitly used the full path, so I mirrored that for the wheelhouse18:33
clarkbwow there is a fair number of changes to be made (mostly related to zaro's various gerrit puppet related changes)18:34
clarkbthey all look familiar though so I am going to run puppet there18:35
anteayaAJaeger: you just put +A on https://review.openstack.org/#/c/159672/ did you read that I wanted jeblair to see it before it merges?18:35
anteayasince it adds a job to devstack-gate18:35
*** che-arne has quit IRC18:36
clarkbhrm that didn't go so well18:36
*** rkukura has joined #openstack-infra18:36
clarkbError: Could not create group elizabeth: Execution of '/usr/sbin/groupadd -g 2015 elizabeth' returned 4: groupadd: GID '2015' already exists18:36
AJaeger_anteaya: I missed that - let me remove it again...18:37
*** markvan has quit IRC18:37
zaroclarkb: which server is that?18:37
clarkbzaro: the new review.o.o18:37
*** MaxV has quit IRC18:37
AJaeger_anteaya: fixed - thanks!18:37
*** Ryan_Lane has joined #openstack-infra18:37
anteayaAJaeger_: thanks for the review, I just want devstack-gate jobs to have jeblair's awareness, as he requested18:38
anteayaAJaeger_: thanks for fixing18:38
clarkbopenstackwatch is uid 201518:38
zaroclarkb: most of it was to get gerrit-zuul-jenkins communications work again.18:38
pleia2heh18:38
clarkbalso user corvus isn't added properly because gid 2001 is taken18:39
*** tsg has quit IRC18:39
zaroohh wait, this is only gerrit.  not sure why so many changes then.18:39
clarkbby gerrit18:39
clarkbzaro: just because puppet hasnt been running there18:39
clarkbso acl files and gerrit config and the gerrit lib tidying all needed to be done18:39
zaroclarkb: ok. that makes sense.18:40
pleia2clarkb: I changed my mind, I don't want an account there18:40
clarkbhuh how did gerrit2 end up with gid 2001 when its uid is 100118:40
pleia2;D18:40
clarkbpleia2: ha18:41
*** thingee has quit IRC18:41
clarkbshould I just surgery it?18:42
*** markvan has joined #openstack-infra18:43
*** dhritishikhar has quit IRC18:43
*** trinaths has quit IRC18:43
zaroclarkb: i'm guessing it's from an upgrade.18:43
zarolike from 'java -jar gerrit.war init' command18:44
openstackgerritDarragh Bailey proposed openstack-dev/pbr: Allow overwriting sphinx builder from command line  https://review.openstack.org/11747818:44
*** tnovacik has quit IRC18:44
clarkb/etc/login.defs was updated in this puppet run to make a gap between uid and gid 1000-299918:44
clarkbso anything that ran before it would possibly have been wrong. The confusing bit is how did gerrit2 get uid 1001 with gid 2001 those should've matched up given the old login.defs rules18:45
clarkbalso shouldn't we have killed openstackwatch by now?18:45
zarooops ignore me, thought you meant gerrit db18:45
clarkboh! I think this is a race in puppet18:46
marunclarkb: can we merge this? https://review.openstack.org/#/c/160194/18:46
clarkbmordred is gid 2000, if that group was created before gerrit2 uid and gid then gerrit2 gid would be 2001, then gerrit2 uid would be made at 1001 then mordred uid at 200018:47
clarkbdoes anyone know where fungi stashed the scripts to untangle these messes on the filesystems? I can surgery this now that the login.defs are in place18:48
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: If wheelhouse is pre-generated, move into correct location  https://review.openstack.org/16093318:48
anteayaclarkb: no idea18:48
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: If wheelhouse is pre-generated, copy into correct location  https://review.openstack.org/16093318:49
*** SumitNaiksatam has joined #openstack-infra18:50
*** tsg has joined #openstack-infra18:50
*** tsg_ has joined #openstack-infra18:52
*** tsg has quit IRC18:55
*** achanda has quit IRC18:57
*** Sukhdev has joined #openstack-infra18:57
*** achanda has joined #openstack-infra18:57
openstackgerritMatthew Treinish proposed openstack-infra/project-config: Build wheel house during nodepool devstack caching  https://review.openstack.org/16054818:58
mtreinishAJaeger_: ^^^ fixed your comments (and the pep8 failure)18:58
clarkbok I have mapped out new values that are valid18:59
zaropelix, zxiiro : commented on https://review.openstack.org/#/c/158989/18:59
clarkbjust need to apply them and chown all the the things18:59
AJaeger_mtreinish: great18:59
clarkbjeblair: pleia2 ^ fyi18:59
*** yamahata has quit IRC18:59
*** tiswanso has quit IRC18:59
openstackgerritMerged openstack-infra/infra-specs: Spec to refactor puppet code in openstack_project  https://review.openstack.org/13747118:59
*** yamahata has joined #openstack-infra18:59
jeblairclarkb: thanks19:00
clarkbworst case we can probably rebuild the node assuming that preserves the IP addrs19:00
zaropelix: had a question for you in https://review.openstack.org/#/c/158350/19:00
jeblairmeeting time in #openstack-meeting19:00
*** unicell1 has left #openstack-infra19:00
clarkbwow so soon will save user updates for after meeting19:00
*** ryanpetrello has quit IRC19:00
*** tiswanso_ has joined #openstack-infra19:01
*** mriedem has quit IRC19:02
pleia2thanks clarkb19:02
*** sputnik13 has quit IRC19:03
*** marcusvrn has joined #openstack-infra19:03
*** changbl has quit IRC19:03
harlowja_clarkb could u also maybe look @ https://review.openstack.org/#/c/160928/ and get that in; its already stated as having 2.6 (and its tests pass there locally on my 2.6 env) and it'd be nice to make sure that it continues to be supported until we can get rid of 2.6 everywhere19:03
harlowja_*better to be safe than sorry*19:03
openstackgerritMerged openstack-infra/project-config: Squash overlapping skip-ifs into a single section  https://review.openstack.org/16019419:04
*** BharatK has quit IRC19:06
openstackgerritMatthew Treinish proposed openstack-infra/puppet-subunit2sql: Add backup before running db migrations  https://review.openstack.org/16051419:07
*** andreykurilin_ has quit IRC19:08
*** mriedem has joined #openstack-infra19:09
*** pblaho has joined #openstack-infra19:09
*** Rockyg has joined #openstack-infra19:14
*** amitgandhinz has quit IRC19:16
*** tonytan4ever has joined #openstack-infra19:18
*** radez_g0n3 is now known as radez19:20
openstackgerritRamy Asselin proposed openstack-infra/infra-specs: Add Gerrit Topic to the spec template  https://review.openstack.org/16094619:20
*** dustins has joined #openstack-infra19:21
*** Bsony has quit IRC19:21
*** dustins has quit IRC19:22
*** yfried has joined #openstack-infra19:23
*** Bsony has joined #openstack-infra19:24
mrmartinpleia2: http://www.slideshare.net/MartonKiss1/openstack-vagrant-plugin-overview19:25
*** Bsony has quit IRC19:25
*** Bsony has joined #openstack-infra19:25
pleia2mrmartin: thanks19:25
*** dustins has joined #openstack-infra19:32
zxiirozaro: thanks for your insight!19:34
*** sdake_ has joined #openstack-infra19:34
openstackgerritDoug Wiegley proposed openstack-infra/project-config: Since grenade+neutron relies on devstack, add it to devstack's check queue  https://review.openstack.org/16091419:35
zxiirozaro: any chance you can help get this dependent patch merged in? https://review.openstack.org/#/c/155865/19:36
*** ivar-laz_ has joined #openstack-infra19:36
*** dtantsur|afk has quit IRC19:36
*** ivar-lazzaro has quit IRC19:39
zarozxiiro: is the config file provider plugin a core plugin?19:39
zaroif it's not then maybe the doc should tell user that installing that plugin is required?19:40
*** dteselkin_ is now known as dteselkin19:41
*** dtantsur has joined #openstack-infra19:41
mrmartinpleia2: the zanata-dev vagrant scripts: https://github.com/mkissam/vagrant-zanata-dev19:43
mrmartinyou need to upgrade the zanata module there to latest version19:43
pleia2mrmartin: interesting, do you set up a mysql database anywhere?19:44
zxiirozaro: no it's not a core plugin19:45
mrmartinpleia2: not yet, am I need? :)19:45
pleia2mrmartin: that may be why zanata isn't working for you!19:45
mrmartinpleia2: yes, but I just wanted to reach a point where war file deployes well19:45
pleia2I don't think it will, the standalone.xml requires a mysql database19:46
pleia2mrmartin: I'm using an infra-prepped machine (install_puppet.sh and install_modules.sh, see: http://ci.openstack.org/sysadmin.html#making-a-change-in-puppet) and then a local.pp like: http://paste.openstack.org/show/183210/19:46
pleia2s/local.pp/site.pp19:46
zxiirozaro: Good idea, anyway I can address that point in my cosolidation patch instead? I  really need this particular patch in soon and considering it's a port of a previous patch I can update the docs in both places with the consolidation patch19:47
mrmartinpleia2: yes it is better, I simply don't have time for that19:47
*** amitgandhinz has joined #openstack-infra19:48
pleia2mrmartin: yeah, so you could just manually set up a mysql database with the creds provided in the puppet manifest19:48
mrmartinyeap, it can be added to vagrant's site.pp19:48
mrmartinand requires the mysql module19:48
mrmartin6lines max.19:48
pleia2great19:49
mrmartinthis few lines you pasted makes sense, I'll try to merge it with vagrant19:49
*** cebruns has quit IRC19:49
*** MaxV has joined #openstack-infra19:49
*** ldnunes has joined #openstack-infra19:51
zarozxiiro: no, i prefer it the update in the right patch.  will help us search the git history.  update the doc and i'll push it thru.19:51
zxiirozaro: ok, I'll go back and update the same docs over in project_maven as well too since it's missing there as well.19:53
zxiirozaro: I'll try to get this updated today19:53
*** _shaps_ has joined #openstack-infra19:56
*** tim_o has joined #openstack-infra19:56
*** eharney has quit IRC19:57
*** MaxV has quit IRC19:58
*** MaxV has joined #openstack-infra20:00
*** MarkAtwood has quit IRC20:00
*** tnovacik has joined #openstack-infra20:01
*** otter768 has joined #openstack-infra20:02
pleia2now we all hide so not to be the target of jeblair's "alternate means"20:03
*** jp_at_hp has quit IRC20:03
tchaypoactually20:04
tchaypoI’m going to try to find someone for my own alternate means...20:04
*** tiswanso_ has quit IRC20:04
tchaypoThe two hp regions have bastion hosts we jump through to get access to things behind them20:04
tchaypoI’d like to get started making sure that infra-root people have access and can start getting the machines into shape20:05
*** ChuckC has quit IRC20:05
*** ivar-laz_ has quit IRC20:05
*** tiswanso_ has joined #openstack-infra20:06
pleia2oh, in case it wasn't obvious in the meeting, in person meetup with cinerama for zanata stuff tomorrow means I'll be away most of the day tomorrow (silicon valley is faaar away ;))20:06
*** matrohon has joined #openstack-infra20:06
*** ivar-lazzaro has joined #openstack-infra20:06
*** tsg_ has quit IRC20:06
*** otter768 has quit IRC20:07
*** _shaps_ has quit IRC20:07
*** MaxV has quit IRC20:10
tchayponot for cinerama20:10
*** MarkAtwood has joined #openstack-infra20:10
*** liusheng has quit IRC20:10
*** liusheng has joined #openstack-infra20:11
pleia2tchaypo: indeed!20:11
*** e0ne has joined #openstack-infra20:11
tchaypowhat should I do to get infra-root people access to the bastions?20:11
*** dizquierdo has joined #openstack-infra20:13
*** tsg_ has joined #openstack-infra20:13
*** MaxV has joined #openstack-infra20:13
tchaypoIif there aaresome published keys i could start by putting those on the boxes20:14
*** adalbas has quit IRC20:15
pleia2tchaypo: this has all users on our systems http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/users.pp20:16
*** HeOS has joined #openstack-infra20:16
openstackgerritAnita Kuno proposed openstack-infra/project-config: Rename stackforge/bindep -> openstack-infra/bindep  https://review.openstack.org/16096320:16
pleia2tchaypo: mordred, corvus, clarkb, fungi, slukjanov and elizabeth are root20:16
mtreinishpleia2: did you just break the 4th wall? :)20:18
AJaeger_anteaya: please add bindep to https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Upcoming_Project_Renames20:18
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Add ironic node deployment support  https://review.openstack.org/16089420:18
anteayaAJaeger_: done20:19
AJaeger_thanks, anteaya20:19
*** tsg_ has quit IRC20:19
anteayaI needed the patch number to do that20:19
pleia2mtreinish: hah :)20:19
anteayanp20:19
anteaya:20:19
anteaya)20:19
AJaeger_;)20:19
clarkbok jeblair has an account on new review.o.o. pleia2 is trickier because her account conflicts with the admin gid20:19
*** sdake_ has quit IRC20:19
anteayaway to cause havoc pleia220:19
pleia22015 is miiine20:20
pleia2:)20:20
openstackgerritMerged openstack-infra/devstack-gate: Add debtcollector to devstack-vm-gate-wrap.sh  https://review.openstack.org/15758020:20
clarkbbut it doesn't look like admin group is used in any file perms20:21
*** f1ller is now known as filler20:21
clarkbadmin should be a system group ya? not sure why it is in the user range20:22
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Add ironic node deployment support  https://review.openstack.org/16089420:22
pleia2I think admin is the backwards compatible group that is still around but we've since switched to sudo group20:22
clarkbpleia2: oh ok I will worry less about it then20:22
jeblairclarkb: check sudo config20:23
pleia2ah yeah, should do that in case we are still using it20:23
lifelessjeblair: anteaya: I'm entirely happy with bindep moving20:23
anteayalifeless: great thanks20:23
jeblairlifeless: great, i think anteaya is working on the changes now, so she should have something for you to +1 soon20:23
lifelessI said no to anteaya's asking me if I would put forward the move because I have enough things in the air right now20:24
anteayalifeless: can you add a comment as such to https://review.openstack.org/#/c/160963/20:24
clarkbyup group sudo is used in sudoers not admin20:24
lifelessand fungi was focused on prep for going on holiday20:24
tchaypois there a mailing list for contacting infra-root people?20:24
anteayatchaypo: #openstack-infra irc channel20:24
hogepodgeFor some reason this workflow+1 patch hasn't been merged.  https://review.openstack.org/#/c/139499/20:25
anteayaif there is a security concern just people individual email addresses20:25
tchaypooh look, I already found it :)20:25
clarkbpleia2: ok you should be set. can you try logging in and make sure sudo and all that works for you?20:25
tchaypoCurrently on the bastions we’ve been using a shared user account20:25
pleia2clarkb: elizabeth@review:~$20:26
tchaypoI could go ahead and set up all the users as per the manifest, but I think it’s simpler (for me at least, not for anyone else) to just add those keys to the shared account and then let infra-root people take over20:26
pleia2clarkb: sudo looks good, thanks20:26
tchaypodoes that sound like a sensible plan, or just like me being lazy?20:26
*** radez is now known as radez_g0n320:26
clarkbpleia2: awesome I think my work fixing the gid and uids is done20:26
pleia2clarkb: nice work, thanks20:26
anteayaclarkb: nice job20:26
clarkbwe may want to consider a reboot as well but I did check that any processes running with old ids were killed20:27
pleia2I just started up the screen session, so just lmk if we do reboot so I can bring it back ;)20:27
AJaeger_oh, the post queue has jobs that are 5+ hours old - http://status.openstack.org/zuul/ . And we're using all test nodes right now...20:27
*** gyee has quit IRC20:28
*** kmartin has quit IRC20:28
pleia2asselin: netcat is up and running on 104.130.159.134 port 29418 now20:28
clarkbpleia2: I think we can avoid a reboot for now, I did try to be careful :)20:28
*** e0ne is now known as e0ne_20:29
asselinpleia2, cool. will try now20:29
*** e0ne_ has quit IRC20:30
*** e0ne has joined #openstack-infra20:31
asselinpleia2, it works! http://paste.openstack.org/show/186799/20:31
*** mpavone has quit IRC20:31
anteayaasselin: well done20:31
pleia2asselin: wonderful, sorry that took so long to get going20:32
anteayais taht for all hp or just your use?20:32
asselinanteaya, I didn't do much. :)20:32
anteayawhat you did, you did well20:32
asselinanteaya, just my site. I will ping some others to test other sites20:32
anteayaasselin: ping away20:32
asselinpleia2, no problem at all. timing is good. I will let cinder folks know in tomorrow's meeting that it's up and ready for them20:32
anteayajeblair: I went with openstack-infra/bindep, lifeless is suggesting openstack-dev/bindep: https://review.openstack.org/#/c/160963/20:33
anteayajeblair: let me know what you want20:33
*** e0ne has quit IRC20:33
anteayapleia2: how long will the telnet be up for?20:33
*** mpavone has joined #openstack-infra20:33
anteayaI got that it won't be up from now until march 21st20:34
pleia2anteaya: as long as we want it20:34
pleia2"until someone tells me to turn it off"20:34
anteayaso it is okay to leave it up20:34
jeblairanteaya, lifeless: i would prefer -infra; we're actually trying to retire -dev (but moving devstack is daunting)20:34
clarkbok time for lunch back in a bit20:34
anteayaclarkb: happy food20:35
anteayachili if I recall20:35
clarkbanteaya: thats dinner20:35
anteayaah you organized person you20:35
*** mpavone has quit IRC20:35
asselinanteaya, pleia2 it should be fine to leave up until the the gerrit server needs the port20:35
anteayacool thanks20:35
*** patrickeast has joined #openstack-infra20:36
lifelessjeblair: ok sure; was just a note :)20:37
*** achanda has quit IRC20:38
*** e0ne has joined #openstack-infra20:39
*** timcline has quit IRC20:39
openstackgerritAnita Kuno proposed openstack-infra/project-config: Rename stackforge/bindep -> openstack-infra/bindep  https://review.openstack.org/16096320:41
*** MaxV has quit IRC20:41
nibalizerpleia2: if you end up refreshing the nc, might be a good idea to replace it with an echoing version20:42
pleia2nibalizer: we talked about that this morning and decided there was no need20:43
nibalizerthis is what it looks like from inside hp, http://paste.ubuntu.com/10519241/ kindof hard to interpret20:43
sigmavirus24anteaya: clarkb that worked along with a symlink of the log directory: https://review.openstack.org/#/c/160560/20:43
clarkbnibalizer that means you connected20:43
pleia2it connected, I don't think there is much to know beyond that20:44
clarkbright20:44
*** mrda-away is now known as mrda20:44
*** MaxV has joined #openstack-infra20:44
anteayasigmavirus24: help me understand why you are having to jump through such hoops for your logging20:44
anteayasigmavirus24: I kind of came into the middle of this, but I don't recall recently have another stackforge repo having to fight so hard to get their logs20:45
*** MaxV has quit IRC20:45
sigmavirus24anteaya: so all of the services are run in containers and we bindmount back to the host so the logs can be collected from the host. Why the project originally chose /openstack/log I don't know, but it isn't something we can change at this moment20:46
pleia2woooo my Nexus 6 has arrived \o/20:46
anteayawhy are the logs from the host important to you?20:46
anteayapleia2: wooooo20:46
sigmavirus24anteaya: assuming you read the docs that I wrote for the scp job, we then tried adding a publisher for /openstack/log/** but that didn't work. So we're adding a symlink for the directory so we can publish them20:46
*** achanda has joined #openstack-infra20:46
anteayayes I understand what you tried and failed to accomplish20:47
sigmavirus24anteaya: because we run tempest as part of the check-commit job and we were having issues where tempest couldn't import dependencies for things but the logs were the only source of truth20:47
anteayawhat I don't understand is why you tried it20:47
sigmavirus24We were able to reproduce it but only after we already worked a review through that tee'd the output of testr list-test20:47
sigmavirus24So to not have to go through those hoops again (and to get other info about the set-up) we decided it wouldn't hurt to start publishing the logs from the job20:48
jrollflaper87: did you ever figure out   gcc: error: /usr/lib/rpm/redhat/redhat-hardened-cc1: No such file or directory20:48
jrollflaper87: err, https://bugs.launchpad.net/openstack-gate/+bug/142458220:49
openstackLaunchpad bug 1424582 in OpenStack-Gate "Missing /usr/lib/rpm/redhat/redhat-hardened-cc1" [Undecided,New]20:49
flaper87jroll: nope :(20:50
*** pblaho has quit IRC20:50
jrollflaper87: boo :(20:50
anteayasigmavirus24: my only comfort is that the only people you are boxing into a corner with this is your own project20:50
sigmavirus24Well I appreciate your help with all of this, and your patience20:51
anteayasigmavirus24: but I am learning interesting things from you20:51
anteayasigmavirus24: thanks for sharing20:51
*** mrmartin has quit IRC20:51
*** MaxV has joined #openstack-infra20:52
*** che-arne has joined #openstack-infra20:53
openstackgerritJan Hruban proposed openstack-infra/jenkins-job-builder: Support additional features in Build Flow project  https://review.openstack.org/15808420:53
*** timcline has joined #openstack-infra20:54
*** e0ne has quit IRC20:55
*** tonytan4ever has quit IRC20:55
*** AJaeger_ has quit IRC20:57
*** Sukhdev has quit IRC20:57
*** dimtruck is now known as zz_dimtruck20:59
anteayasdague: so did you get a chance to read the spec yet?21:00
anteayadevananda: ah so supporting out of tree drivers is something I knew about since we discussed taht in perth21:00
devanandaanteaya: :)21:01
anteayadevananda: what I don't know is what takes place for testing21:01
devanandaah21:01
anteayasince neutron is decomposing them, maintaining a test framework is a large consideration for them21:01
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard: Add an index on accesstokens table for access_token column  https://review.openstack.org/15654321:01
anteayaand since cinder and nova are the two other projects I was thinking of21:01
devanandawe have only had one driver so far successfully run third=party CI21:01
openstackgerritThanh Ha proposed openstack-infra/jenkins-job-builder: Add support for Config File Provider to Maven Project module  https://review.openstack.org/15586521:01
*** _nadya_ has joined #openstack-infra21:01
devanandaand it hasn't been the most stable ...21:02
anteayathey also have in tree drivers and would be in the position of neutron should they choose to split them out21:02
anteayaright21:02
devanandathe ilo driver team is working on running CI, but it's not operaational yet21:02
anteayaso your situation is unique as far as I know21:02
devanandaothers promise it but haven't delivered -- and I haven't pushed too hard on that yet, though I may start21:02
anteayain that you prepared an interface for drivers in the first design21:02
devanandaright21:02
anteayarather than the other projects who ended up with them in tree21:02
*** sputnik13 has joined #openstack-infra21:03
anteayaand then are trying to figure out what to do next21:03
devanandaexactly21:03
devanandait was a design principle in ironic, but not in nova/cinder/neutron21:03
openstackgerritThanh Ha proposed openstack-infra/jenkins-job-builder: Consolidate CFP settings into a common function  https://review.openstack.org/15898921:03
*** jpeeler has quit IRC21:03
anteayaso since your drivers have never been in tree, you have no obligation to weigh in on how they are tested21:03
anteayaor if they are21:03
anteayawhere as the other projects have thoughts about that21:04
devanandawhere we are right now is interesting - this cycle has added a lot to the driver API, but afaik we havent broken any drivers21:04
anteayasince they are or were in tree21:04
*** ghostpl_ has joined #openstack-infra21:04
anteayacongratulations21:04
devanandaanteaya: oh - many of our hardware drivers are in tree21:04
anteayahow are they tested?21:05
*** pblaho has joined #openstack-infra21:05
devanandaunit tests, unfortunately that's it21:05
anteayainteresting21:05
devanandaas long as they implement the driver API, they should be fine21:06
*** radez_g0n3 is now known as radez21:06
anteayashould be and is are worlds apart sometimes21:06
devanandai mean, fine from the upstream standpoint -- we dont make a claim that it works with said hardware21:06
anteayaokay21:06
devanandathat's on the driver author.21:06
*** _nadya_ has quit IRC21:06
anteayaI need to not computer for a while21:06
anteayathanks for the chat and the education21:06
devanandaok - ciao!21:06
anteayasee ya21:07
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard: Email base plugin.  https://review.openstack.org/15194821:07
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard: Email Send Cron Worker  https://review.openstack.org/15141621:07
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard: Email Outbox  https://review.openstack.org/15141321:07
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard: Redirect Browsers from API to Client  https://review.openstack.org/15555121:07
*** zz_dimtruck is now known as dimtruck21:07
*** ghostpl_ has quit IRC21:08
openstackgerritThanh Ha proposed openstack-infra/jenkins-job-builder: Consolidate CFP settings into a common function  https://review.openstack.org/15898921:09
jrollmordred: WELP http://thenextweb.com/insider/2015/03/03/gitlab-acquires-rival-gitorious-will-shut-june-1/21:09
greghaynesis that a joke?21:11
*** Bsony has quit IRC21:12
greghayneshttps://about.gitlab.com/2015/03/03/gitlab-acquires-gitorious/21:13
mordredwow. well, that happened21:13
greghayneswow21:13
pleia2:(21:13
*** dizquierdo has quit IRC21:14
*** ldnunes has quit IRC21:14
*** pblaho has quit IRC21:16
*** sdake_ has joined #openstack-infra21:17
*** aysyd has quit IRC21:18
*** kgiusti has left #openstack-infra21:19
*** thedodd has joined #openstack-infra21:20
*** sdake_ has quit IRC21:25
*** patrickeast has quit IRC21:26
*** patrickeast_ has joined #openstack-infra21:26
*** ChuckC has joined #openstack-infra21:26
*** hodos has quit IRC21:28
clarkbhpcloud has a high error rate right now, going to look at it to make sure its not something we are doing21:29
clarkbthen hopefully code review time21:29
*** ihrachyshka has quit IRC21:33
*** kmartin has joined #openstack-infra21:34
clarkblooks like we may be hitting ssh timeouts to get on the nodes21:35
clarkbso high number of deletes and builds results21:35
*** remote_morgan_ has quit IRC21:36
marunjeblair: It looks like skip-if is now working on both check and gate pipelines.  Previously it was only affecting the check pipeline for some reason.  Did you fix something or is it 'magic'?21:36
*** jpeeler has joined #openstack-infra21:38
*** jpeeler has quit IRC21:38
*** jpeeler has joined #openstack-infra21:38
jeblairmarun: i don't think so?21:39
marunjeblair: 'magic' it is. I'll cross my fingers in the hopes that we don't see a regression.21:40
jeblairmarun: did the nova config change merge?  maybe that fixed it?21:40
marunjeblair: it did merge, yes.21:40
*** eharney has joined #openstack-infra21:40
marunjeblair: the nova skip-if seemed to override the neutron one completely, though.21:40
marunjeblair: since it appeared later in the config21:41
marunjeblair: I was previously seeing the check queue with a skip-if filtered set of jobs, but then the gate queue unfiltered.21:41
clarkbjhesketh: can you see my comment on 158514? not sure how worried about that case I should be21:41
*** stevemar has quit IRC21:41
clarkbhrm also seeing http 500 errors from hpcloud21:41
marunjeblair: question regarding the integrated change queue...21:42
marunjeblair: skip-if allows limiting the jobs to run on non-functional changes (tests, docs, etc)21:42
*** tonytan4ever has joined #openstack-infra21:42
marunjeblair: but non-functional changes are still queued with functional changes21:43
marunjeblair: e.g. http://status.openstack.org/zuul/21:43
marunjeblair: where neutron change 153532,3 is behind a bunch of functional changes21:43
marunjeblair: and if one of them fails, it would have to be retested, despite no relying on any of the changes ahead of it21:43
*** eharney has quit IRC21:43
marunjeblair: maybe this implies establishing a criteria, separate from skip-if, to determine whether a change belongs in the integrated queue?21:44
*** EmilienM has quit IRC21:44
*** EmilienM has joined #openstack-infra21:44
*** gyee has joined #openstack-infra21:44
marunjeblair: just a thought, clearly not a priority.21:44
*** sdake_ has joined #openstack-infra21:47
*** koolhead17 has quit IRC21:47
*** dkliban is now known as dkliban_afk21:49
*** dprince has quit IRC21:49
zxiirozaro: thanks so much! This unblocks me from some things I need to do.21:50
*** BobBall_AWOL is now known as BobBall21:51
*** mpavone has joined #openstack-infra21:51
jheskethMorning21:51
openstackgerritMerged openstack-infra/jenkins-job-builder: Add support for Config File Provider to Maven Project module  https://review.openstack.org/15586521:52
clarkbjhesketh: good morning, please see comment on 158514 and see if I am over worried21:52
*** trey has quit IRC21:52
*** mtanino has quit IRC21:53
*** julim has quit IRC21:54
*** mpavone has quit IRC21:54
*** eharney has joined #openstack-infra21:54
*** trey has joined #openstack-infra21:54
greghaynesjhesketh: Hey, im poking at making a github trigger and I was pointed at your great source/trigger refactoring patch stack21:55
*** patrickeast has joined #openstack-infra21:55
*** patrickeast__ has joined #openstack-infra21:55
*** patri654 has joined #openstack-infra21:55
BobBallSo I've set up zuul.openstack.xenproject.org as a virtualhost shared with jenkins (had to change the vhost to be zuul.openstack.xenproject.org:80 instead of *:80) but now it can't get status.json.  It used to work when it was just the IP address so I'm not sure what else I need to change to get it working with a name?21:55
*** patri633 has joined #openstack-infra21:55
greghaynesjhesketh: Trying to wrap my head around what youre going for there, once I do I think I should base the github changes off your stack?21:56
*** jgrimm is now known as zz_jgrimm21:57
jheskethclarkb: yeah good point re globs. I'll turn that into a set shortly.21:57
jheskethgreghaynes: yeah that'd make it much easier for me and maybe even easier for you21:57
*** pelix has quit IRC21:58
greghaynesAwesome. I also left you some review comments on the bottom of the patch stack21:59
*** mattfarina has quit IRC21:59
*** mtanino has joined #openstack-infra21:59
*** tonytan4ever has quit IRC22:00
BobBalloh... silly me... my zuul process had died.  I just realised there was nothing listening on 8001.  Sorry.22:01
*** erlon has quit IRC22:01
*** achanda has quit IRC22:01
*** ivar-laz_ has joined #openstack-infra22:01
clarkbjeblair: I have comments on 140043, but nothing worth a -1 so I +2'd not sure if you want ot look at them anyways? also I need to check hiera before approving anything22:02
*** ivar-laz_ has quit IRC22:02
openstackgerritBob Ball proposed openstack-infra/puppet-zuul: Ensure zuul can co-exist with other sites.  https://review.openstack.org/16099722:03
*** andreykurilin_ has joined #openstack-infra22:03
*** ivar-laz_ has joined #openstack-infra22:03
*** otter768 has joined #openstack-infra22:03
*** zz_jgrimm is now known as jgrimm22:03
*** doude has quit IRC22:03
mroddenqq: how does -infra manage DNS entries... didn't see anything on the wiki or ci.openstack.org22:04
*** ivar-lazzaro has quit IRC22:04
clarkbmrodden: we use rackspace hosted dns22:04
mroddenfor all of it?22:04
mordredyup22:05
mroddenkk cool22:05
mroddenthanks22:05
clarkbjeblair: any reason for not approving the stack that starts at 158176?22:05
clarkbI will approve it if you are ok with me doing so, that will get us moving on the ansible fixes22:06
*** mwagner_lap has quit IRC22:06
*** achanda has joined #openstack-infra22:07
clarkbmordred: ^ can you think of any reason to not get that stack in?22:07
*** otter768 has quit IRC22:08
jeblairmarun: hi; was on phone... (that's becomming o common refrain :)22:10
marunjeblair: no worries ;)22:10
jeblairmarun: i think the changes should still stay in the same queue because of the git commit ordering22:11
marunjeblair: I guess the answer is that the integrated gate can't really be partially undone22:11
jeblairmarun: it's true that they aren't going to affect any shared jobs (because there are none), but they could affect the state of the git tree (including merge conflicts etc), which then might affect other changes (which may share jobs)22:12
jeblairmarun: i think so.  i think partial separation would be highly complex22:12
openstackgerritMerged openstack-infra/infra-specs: Retitle some specs for clarity  https://review.openstack.org/16058022:12
clarkbalso FYI everyone I believe our rax reboots will happen overnight today22:12
ttxjeblair: about stackforge... I think *most* projects there should move to openstack/. Just not *all* of them because (1) some of them miss a critical checkbox (like say, have an elected leadership) and (2) some of them don't want to submit to TC oversight22:12
clarkbso things may be really funny in the morning22:12
*** gyee has quit IRC22:13
*** devlaps has joined #openstack-infra22:13
jeblairmarun: on the plus side, however, those changes should still eventually make it through, and are highly likely to land since, after all, they are running fewer jobs22:13
ttxjeblair: couldn't articulate that in-meeting22:13
mordredclarkb: I was going to babysit when it went in22:13
*** devlaps has quit IRC22:13
clarkbmordred: oh, so I should wait then?22:13
marunjeblair: right.  if a failing job like grenade is failing functional changes, then the non-functional changes will eventually bubble up22:13
mordredclarkb: nah - I'm just AFK22:14
mordredand it affects our ops systems22:14
jeblairmarun: yep22:14
clarkbmordred: if it breaks we should expect puppet to stop running on nodes right?22:14
mordredyah22:14
sdaguemarun: so I think the thing you might actually want is reordering of jobs on a reset22:14
mordredit shouldn't kill anything22:14
clarkbmordred: I think I can babysit that if you are ok with me going ahead with this22:14
mordredtotally22:14
marunsdague: ah, so that non-functional jobs get priority?22:14
clarkbmordred: cool will approve now then22:15
*** tonytan4ever has joined #openstack-infra22:15
jeblairmarun: also, changes afterwords can take advantage of them (eg, new unit tests) immediately just by being enqueued afterwords, and changes in check can now take advantage of them with Depends-On22:15
marun(overloading 'functional' like mad here, but hopefully the meaning is clear)22:15
sdagueor bubble sorting by # of jobs22:15
marunsdague: that would seem like pretty easy to implement at least22:16
sdaguebecause changes with fewer jobs probably have less chance of causing resets22:16
jeblairi'd like to avoid that22:16
marunjeblair: why?22:16
*** tonytan4ever has quit IRC22:17
marunjeblair: +1 to changes taking advantage of test changes/additions, that's a nice thing to get basically for free22:17
clarkbmordred: looks like I need to approve the first one, let it apply then approve the second too22:17
clarkbso I will only approve the first change at this point22:18
jeblairit actually seems fairy complex to me, and i think it has a limited benefit -- the change should land eventually, i'm not sure what landing faster gets us, especially since we can start to build on it before it lands22:18
sdagueI guess with Depends-On it's less meaningful22:18
*** tiswanso_ has quit IRC22:18
*** MaxV has quit IRC22:18
jeblairttx: that seems reasonable.  i'd like to see where we can get in terms of most projects moving over, because it feels to me like that's why most of them are here, and then figure out what we do with what's left :)22:19
*** Bsony has joined #openstack-infra22:19
marunjeblair: I guess I'm missing the part about it being complicated.22:19
marunjeblair: and landing things quicker from a development perspective has real value.22:19
marunjeblair: in CI-land, eventually may be enough, but I think there is a real cost in terms of developer productivity in slowing down the merge rate.22:19
jeblairmarun: with Depends-On you can start using required changes before they land22:20
marunjeblair: 'start using' is in terms of gerrit22:20
marunjeblair: sure22:20
clarkbmoving the changes shouldn't affect the merge rate22:20
sdagueI think the time where queue reordering has value is in landing broadly impacting bugs, like the er bugs22:21
marunsdague: +122:21
marunclarkb: I'm not sure how that follows.22:21
sdaguebecause it will save a bunch of check jobs from being invalid22:21
jeblairsdague: i agree, which is why we do have a policy of moving those22:21
pleia2clarkb: so I thought my dns change went fine yesterday (nothing in output led me to believe otherwise), but can you confirm in the dns panel that ci-backup-rs-ord.openstack.org was created?22:21
marunclarkb: blocking non-functional changes behind functional changes that are blocked on some gate problem absolutely slows things down22:21
clarkbmarun: because we already reorder the tree completely on a single failure22:21
*** dkranz has quit IRC22:22
clarkbmarun: so pipeline throughput should be pretty constant regradless of order22:22
marunclarkb: what's the criteria for reordering?22:22
sdaguejeblair: yep, it would be cool, and I think we talked about it in .de, to do that automatically at reset points22:22
clarkbmarun: failed job22:22
sdagueso it wouldn't require manual intervention22:22
marunclarkb: so if we have 5 jobs that are all going to fail on the same thing, and something behind that fixes it?22:22
clarkbmarun: you are not talking about changes that fix any jobs22:22
marunclarkb: uh22:23
clarkbunless I am missing something the suggestion is to put changes that don't do the integration tests at the front of the queue22:23
clarkbthat shouldn't fix any integration tests by virtue of them not being part of integration testing22:23
*** Bsony has quit IRC22:23
ttxjeblair: most of the candidates definitely live there and those checked 90% of the boxes.22:23
jeblairmarun: our policy is to promote changes that fix bugs that are affecting many or all gate jobs22:23
jeblairmarun: this has been true for some time22:23
jeblairsdague: and yes, would love it to be more automated :)22:24
ttxjeblair: although interestingly nobody asked yet22:24
marunjeblair: I think ordering things in the manner suggested has the potential to automatically fix some failures.22:24
jeblairttx: yeah, i think last week we said that we wanted to start slow :)22:24
ttxslow yes, not standing still !22:24
marunjeblair: certainly, functional tests have the potential to be racey, and if the queue order was in least-jobs-first on reset, then a fix would automatically bubble up22:25
marunjeblair: as per sdague's suggestion22:25
jeblairmarun: a fix to an integration test race should run all the jobs though, right?22:26
marunjeblair: I'm not talking about a fix to an integration test race.  that would still require manual intervention22:26
marunjeblair: I'm talking about a project-specific functional test failure22:26
*** e0ne has joined #openstack-infra22:26
sdaguemarun: but in those cases, you just tell folks to rebase on your change22:26
marunjeblair: we had one a few weeks ago in neutron when we tried to rejigger eventlet monkeypatching22:26
sdagueand then they get running locally again quickly22:27
marunsdague: hmmm22:28
greghaynesjhesketh: Hey, im curious what kinds of ABC issues you hit on https://review.openstack.org/#/c/119530/22:28
dougwigis this gate slowness just last minute rush?  or is something up?  :)22:28
clarkbdougwig: hpcloud is unhappy22:28
sdagueoh hai 50% of nodes in building unhappy I see22:29
marunsdague: that would fix things locally, yes. Wouldn't we have to run a lot of unnecessary jobs until everyone had rebased, though?22:29
openstackgerritMerged openstack-infra/puppet-ansible: Put the library file into the role  https://review.openstack.org/15817622:29
clarkbdougwig: results in a lot of discarded nodes there, you can sort of see that in the node graph, lots of builing and deleting22:29
marunsdague: and pushed their changes to gerrit?22:29
dougwigclarkb: gotcha, thanks.22:29
sdaguemarun: realistically, I'd be surprised if you could communicate to all the contributors and get them to push patches rebasing on it before your code was merged anyway.22:30
jheskethgreghaynes: hmm, it was quite a while ago now22:30
greghaynes:(22:30
jheskethgreghaynes: I think it wasn't quite the right fit, but I can look at it again if you'd like22:31
greghayneswell, it is really a text book ABC setup22:31
jheskethit's also quite possible I stuffed up22:31
sdaguethe automation for the gate bugs to auto bubble would be cool if you wanted to get that rolling though22:31
greghaynesin that patch specifically you dont need to use any of the abc magic because the methods are not actually abstract, but in the source base class this is22:31
*** sarob has quit IRC22:31
greghayneser, in the source base class it would be useful22:31
marunsdague: wouldn't that imply a probably rebase failure as opposed to running a bunch of jobs doomed to fail?22:31
marunsdague: ok :)22:31
greghaynesjhesketh: id also be happy to poke at it if youd like :)22:32
*** dustins has quit IRC22:32
clarkbdougwig: it didn't appear to be actionable form our end fwiw, lots of timeouts and http 500 errors22:32
openstackgerritMerged openstack-infra/project-config: Remove stackforge-libra from gerritbot  https://review.openstack.org/16068322:32
sdaguemarun: and, honestly, the fixing the gate bug autobubble would probably give you nearly the same throughput gains as getting your test patches promoted, because it would fast path fixes that caused the resets in the first place22:33
dougwigclarkb: just bad timing that all of neutron's job's broke yesterday.  :)22:33
sdagueand less resets == more velocity22:33
dougwig /job's/jobs/22:33
*** rkukura has quit IRC22:33
openstackgerritJoshua Hesketh proposed openstack-infra/project-config: zuul-swift-upload support recursive globs  https://review.openstack.org/15851422:33
openstackgerritJoshua Hesketh proposed openstack-infra/project-config: Enable swift logs for python jobs  https://review.openstack.org/15652122:33
openstackgerritJoshua Hesketh proposed openstack-infra/project-config: Upload python test results to swift  https://review.openstack.org/15652222:33
jheskethgreghaynes: sure, that'd be awesome :-)22:33
*** gyee has joined #openstack-infra22:33
jheskethclarkb: fixed up 158514 ^22:33
*** rkukura has joined #openstack-infra22:34
marunsdague: I figure it would only get more useful as we rely more on project-specific testing.22:34
*** pc_m has quit IRC22:34
clarkbjhesketh: why sort on the lower() results?22:35
*** rmcall has quit IRC22:36
jheskethclarkb: case-insenstivie sorting, otherwise we'd have A C Z, c d z22:36
*** sdake_ has quit IRC22:37
clarkbgotcha22:37
jheskethmatter of preference, although I'm not sure what apache sorts on22:37
*** Rockyg has quit IRC22:39
*** esker has quit IRC22:39
openstackgerritMerged openstack-infra/project-config: Remove billingstack from gerritbot  https://review.openstack.org/16068622:42
openstackgerritDoug Hellmann proposed openstack-infra/project-config: Add openstack/developer-reference repository  https://review.openstack.org/16101522:42
*** timcline has quit IRC22:42
clarkbok ansible roles are in place and update now, next run through in a few minute should tell us if things are working22:43
*** stevemar has joined #openstack-infra22:44
*** rkukura has quit IRC22:44
*** ayoung has quit IRC22:45
*** ryanpetrello has joined #openstack-infra22:45
jeblairclarkb: i agree with your comments on the askbot change; i think we probably have some things to add to hiera before spinning it up.22:45
jeblairclarkb: would be good to get confirmation from mrmartin whether he wants precise or trusty22:46
clarkbjeblair: ok22:46
*** patri633 has quit IRC22:46
*** patrickeast__ has quit IRC22:47
*** patri654 has quit IRC22:47
*** patrickeast has quit IRC22:47
*** patrickeast_ is now known as patrickeast22:47
HeOSanteaya, thanks for answer, I'll check it tomorrow. :)22:48
*** mjturek1 has quit IRC22:49
*** annegent_ has quit IRC22:49
*** mriedem has quit IRC22:51
*** openstackgerrit has quit IRC22:51
*** openstackgerrit has joined #openstack-infra22:52
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard: Added python-dateutil  https://review.openstack.org/16101722:53
*** mwagner_lap has joined #openstack-infra22:53
pleia2StevenK: over here :)22:54
*** andreykurilin_ has quit IRC22:55
openstackgerritSpencer Krum proposed openstack-infra/puppet-httpd: rename to openstackinfra  https://review.openstack.org/16101822:55
openstackgerritBrian Hunter proposed openstack-infra/project-config: channel configuration for #openstack-ko  https://review.openstack.org/16102022:56
clarkbmordred: it looks like the deletion of /etc/ansible/library failed because you need the recurse flag, I am just going to ignore that for the moment so I can see if next run is happy22:58
clarkbmordred: I can push an update for that if you want or we can remove the dir manually22:58
openstackgerritSpencer Krum proposed openstack-infra/project-config: Allow puppet-httpd to be publised to the forge  https://review.openstack.org/16102222:59
nibalizerjeblair: 161018 and 161022 are I think what we need to publish httpd22:59
nibalizeras well as manually creating the module through the webui22:59
*** erikmwilson is now known as Guest2816423:01
*** erikmwilson has joined #openstack-infra23:01
*** erikmwilson has quit IRC23:01
*** erikwilson is now known as erikmwilson23:01
*** Guest28164 has quit IRC23:01
*** erikwilson has joined #openstack-infra23:02
*** erikmwilson has quit IRC23:02
*** erikwilson is now known as erikmwilson23:02
*** erikwilson has joined #openstack-infra23:02
*** jpeeler has quit IRC23:02
*** ivar-laz_ has quit IRC23:02
jeblairnibalizer: cool, +223:03
*** ivar-lazzaro has joined #openstack-infra23:03
*** rkukura has joined #openstack-infra23:03
*** ivar-lazzaro has quit IRC23:04
clarkbI am thinking we need better ansible logging23:04
clarkbI can't figure out if ansible/puppet were happy with the failed recurse dir deletion or not23:04
jeblairmordred: the puppet forge username/password does not work for me23:04
jeblairnibalizer: ^ :(23:04
*** ryanpetrello has quit IRC23:05
*** ivar-lazzaro has joined #openstack-infra23:05
anteayaHeOS: okay23:05
clarkbmanual pupept run indicates that puppet does not fail in this instance23:05
clarkbthat is amazing btw23:06
clarkbNotice: /Stage[main]/Ansible/File[/etc/ansible/library]: Not removing directory; use 'force' to override23:06
anteayaHeOS: submit some sort of change to gerrit and let the review process guide you, just have a clear explanation of what you want the patch to do in the commit message23:06
*** ryanpetrello has joined #openstack-infra23:07
nibalizerjeblair: :( are you using the values from hiera?23:08
jeblairyeah23:08
*** dangers is now known as dangers_away23:10
openstackgerritClark Boylan proposed openstack-infra/puppet-ansible: Remove embedded ansible role  https://review.openstack.org/15817723:10
openstackgerritClark Boylan proposed openstack-infra/puppet-ansible: Force /etc/ansible/library deletion  https://review.openstack.org/16102723:10
clarkbjeblair: mordred ^ that forces the dir removal and that should go in before 158177 so that it gets removed before we cleanup that puppet resource23:11
*** yamamoto has joined #openstack-infra23:11
*** sarob has joined #openstack-infra23:12
jeblairclarkb: aprvd23:12
clarkbty23:12
anteayajeblair and ttx (though he is probably asleep now) if we are going to have substantially more than 20 projects participating in the ptl election process we will have to look at our nomination and election workflow23:14
anteayadoing 20 projects nominations via the email list and wikipage worked for taht many projects but will be too hard to keep straight for more than 2023:15
anteayaplus if we end up running more than 6 actual polls at one time, tristan and I23:15
anteayakeep in mind that we go over the election roll manually after the generated lists have been provided to us23:16
*** dimtruck is now known as zz_dimtruck23:16
anteayaand I'll just throw this out there, I want to talk about how to approach presenting the answers to questions in a self-mixing order this time23:16
anteayafor the tc election23:16
clarkbI still think an opt in voter process would be nice, not sure that that conflicts with bylaws or not23:16
*** ryanpetrello has quit IRC23:16
anteayaas I think that information has some benefit but the current approach (me continually editing the wikipage for 3 days) is no sustainable23:17
anteayait does conflict23:17
anteayaand yes, it would be nice23:17
anteayaso much easier to generate the rolls23:17
jeblairanteaya: those are all good points :)23:17
heyonglihi, anteaya23:17
anteayajeblair: thought I'd just add them to the backscroll23:18
jeblairclarkb: i think that's what signing up as an individual member should mean (since it is not required to submit code)23:18
anteayalookf for a meeting agenda item soon that brings those up for the meeting23:18
anteayaheyongli: hello there23:18
anteayaheyongli: nice to see you, how have you been?23:18
*** tnovacik has quit IRC23:18
heyonglianteaya, just say hello to you, good Spring festival, -:023:18
*** rkukura has quit IRC23:19
*** matrohon has quit IRC23:19
anteayaheyongli: good spring festival to you as well23:19
*** alexpilotti has quit IRC23:19
anteayajeblair: I have no argument23:19
anteayathe problem is the charter23:19
anteayaboth the openstack bylaws and the tc charter23:20
anteayaanything to make this easier to run an election, I'm all for it23:20
anteayaas long as the election follows the rules23:20
jeblairanteaya: i don't think those are a problem -- they are written for ATCs23:20
jeblairanteaya: an ATC is a contributor who is also a member23:20
anteayaI'm open to having an evaluation of the bylaws and charter and having a good chat about them23:21
jeblairanteaya: we currently require a contributor to _be_ a member, but that is not actually reuired by the bylaws23:21
anteayaright23:21
anteayaI'm open to that interpretation23:21
anteayaconvince the tc23:21
jeblairanteaya: er, the foundation's lawyer has that interpretation23:21
jeblairanteaya: i don't think i need to convince anyone23:22
jeblairwe just need to stop requiring individual membership for contribution23:22
jeblairthat bit of code is in the foundation membership system, which i can not fix23:22
clarkbI wonder if that is part of the public www repo23:22
anteayaI'm in service to the tc23:22
anteayaif the tc says do it this way, okay23:23
anteayabut I do have to recognize how I have done it in the past23:23
anteayaso not disagreeing, just would like some support for that position23:24
jeblairanteaya: the charter is already written this way.  nothing needs to change.  ATCs will still be the electorate23:24
*** amitgandhinz has quit IRC23:24
anteayaand glad to have yours23:24
anteayasure23:24
anteayaI would like to hear ttx's thoughts on your reading23:24
jeblairanteaya: there may be fewer ATCs once contributors actually have the choice as to whether or not they become an individual member23:25
anteayaoh wouldn't that be lovely23:25
anteayayou paint a utopia23:25
*** sgordon has joined #openstack-infra23:25
*** patrickeast_ has joined #openstack-infra23:25
jeblair(i don't expect there to be greatly fewer, but the choice is important)23:26
anteayaI'm all for choice23:26
anteayaand any fewer would be a bit of light in a dark tunnel23:26
jeblairanteaya: http://governance.openstack.org/reference/charter.html#voters-for-tc-seats-atc23:26
jeblairanteaya: http://governance.openstack.org/reference/charter.html#voters-for-ptl-seats-apc23:27
jeblairboth of those are already written as "subsets of individual members"23:27
* clarkb is digging around in php project and feeling very lost23:28
*** patrickeast has quit IRC23:28
*** patrickeast_ is now known as patrickeast23:28
*** hichihara has joined #openstack-infra23:28
anteayayes I confirm "subsets of individual members"23:28
anteayain both ptl and tc sections23:29
*** stevemar has quit IRC23:29
*** e0ne has quit IRC23:30
anteayajeblair: so what would you like to see happen23:30
anteayahow do you envision the electorate is comprised?23:31
*** chlong has joined #openstack-infra23:31
jeblairanteaya: currently you have to sign the cla to contribute, and to sign the cla you have to be a member.23:31
*** mmedvede_ has joined #openstack-infra23:32
anteayaso far I follow you23:32
jeblairanteaya: the second is confirmed as not necessary by the foundation counsel, so we merely need to stop doing that23:32
jeblairanteaya: so then to contribute, you sign the cla.  to vote, you become a member23:32
jeblairanteaya: then the electorate is the set of members who have contributed (as specified by the charter)23:32
openstackgerritMerged openstack-infra/puppet-ansible: Force /etc/ansible/library deletion  https://review.openstack.org/16102723:33
jeblairanteaya: since you asked, i also want to see the cla replaced with the dco23:33
anteayahow is that different from what takes place now23:33
jeblairanteaya: people might choose not to become members, yet contribute anyway23:33
anteayayes I think I was familiar with your position on the cla and dco but thanks for confirming23:33
openstackgerritMiguel Grinberg proposed stackforge/gertty: Add change list options to configuration  https://review.openstack.org/16103223:34
anteayaone problem is that we don't know who the folks are who wish to contribute and not become members23:34
jeblairi am hoping that the board will take that on this year, since last year they expressed concern about quorum.  i think those issues have been addressed, for the moment at least.23:34
*** e0ne has joined #openstack-infra23:34
SpamapSjeblair: just got a pretty weird traceback from gertty..23:34
SpamapShttp://paste.openstack.org/show/186950/23:34
SpamapSjeblair: debugging now23:35
anteayaplus, I do belive we addressed that as an issue last round of elections by finding something in the bylaws that equated contributing with membership23:35
anteayaI actually was thinking of bringing that up again to see if there was an expiry associated with that23:35
jeblairanteaya: they are users in gerrit who have not become members.  we don't have much of a reason to track them though, if they do not become members.23:35
anteayasince it fit our situation last time as the foundation was letting folks delete memberships23:35
SpamapSwas while looking at I6c5a962260741dcf6f89da9a33b96372a719b7b023:35
jeblairanteaya: i'm not sure what you're referenging wrt to "finding something in the bylaws that equated contributing with membership"23:36
*** prad has quit IRC23:36
anteayalet me find it, it was from last round23:36
*** yamamoto has quit IRC23:36
*** ddieterly has quit IRC23:36
*** sigmavirus24 is now known as sigmavirus24_awa23:36
ianwdstufft:  "DEPRECATION: Uninstalling a distutils installed project (six) has been deprecated and will be removed in a future version. This is due to the fact that uninstalling a distutils project will only partially uninstall the project." <- does this mean uninstall is broken now?23:37
jeblairSpamapS: what size is your terminal?23:37
dstufftianw: that means uninstall has always been broken if the project was originally installed with distutils23:37
dstufftbecause distutils doesn't record what files were installed23:37
openstackgerritgordon chung proposed openstack-infra/project-config: add experimental ceilometer elasticsearch db jobs  https://review.openstack.org/16082423:38
dstufftso all we could ever really do is remove the metadata that says the thing was installed23:38
waynrclarkb, zaro, are either of you going to the jenkins user conference? i am considering submitting a talk about JJB and the way we used it at puppetlabs (based on a similar presentation i gave for our engineering department today)...thought i'd check to see if either of you had similar plans or know of someone else with similar plans (also, it's not clear to me if I even should be presenting about JJB23:38
dstufftbut leave behind the actual files23:38
waynrat conferences, not being a core developer)23:38
*** Ryan_Lane has quit IRC23:38
ianwdstufft: hmm, i wonder if we just didn't notice before.  keystone has started installing cryptography, which requires six > 1.9 ... but yeah it's leaving the packaged versions (from python-six pkg) there23:38
SpamapSjeblair: um, "really big" ? Gnome terminal isn't telling me. :-P23:38
ianwbut removing python-six package takes out cloud-init23:38
dstufftianw: yea, people just didn't notice because pip would happily then overwrite the left over files23:39
SpamapSjeblair: 132x4323:39
anteayajeblair: http://lists.openstack.org/pipermail/openstack-tc/2014-September/000820.html23:39
SpamapSjeblair: can't reproduce thus far.23:39
*** ryanpetrello has joined #openstack-infra23:39
dstufftianw: fwiw we're unlikely to actually remove that anytime soon, it'll probably stick around longer hten normal23:40
dstufftbut I like the warning anyways becuase it tells people something isn't quite right23:40
anteayajeblair: this was in response to people having the ability to resign their foundation membership but infra not having access to the updated database of foundation membership23:40
dstufftianw: if this is on a Debian deritive, Jessie makes this better by modifying pip so it won't touch python-six, it'll just install six into /usr/local23:40
dstufftI want to get that into all distros, but $TIME23:41
anteayajeblair: my read of it is that an accepted contribution counts as membership for 365 days23:41
ianwdstufft: no, centos.  but it might actually be something else going on here "Skipping six, due to already being wheel."23:41
*** erikmwilson has quit IRC23:41
*** erikwilson is now known as erikmwilson23:41
anteayawhich is the window for electorate eligibilyt23:41
*** ryanpetrello has quit IRC23:41
clarkbok next puppet run at 23:45UTC should remove the ansible library dir then I can merge the next change in the list23:41
anteayaso people who don't choose to have a membership will still be counted as members of the electorate according to this definition23:42
anteayasince merging a commit confers membership status23:42
dstufftianw: future versions of Fedora (so I assume RHEL and CentOS at some point) will use pip (and thus setuptools) to do installs of python stuff inside of rpms23:42
dstufftdoesn't help today ofc :(23:42
clarkbalso looks like our puppet runs take just over 15 mnutes so our current 15 minute cycle is really a 30 minute cycle23:44
*** tiswanso has joined #openstack-infra23:44
clarkbwe can probably tighten up the loop a bit by running in a 20 minute cycl23:44
*** ryanpetrello has joined #openstack-infra23:45
jeblairanteaya: i find the wording of that to be very confusing.  i am not certain i agree with radcliffe's interpretation.23:46
anteayajeblair: I'm fine with you disagreeing with radcliffe's interpretation23:47
jeblairanteaya: i do not see how someone who resigned individual membership (or later, one who chooses never to become one) could be considered an individual member for the purposes of the election23:47
*** e0ne has quit IRC23:47
ianwdstufft: ok, i think something else is going on.  pip is saying it installed six-1.9.0, but it didn't ... http://logs.openstack.org/79/153079/19/check/check-tempest-dsvm-centos7/ec74a80/logs/devstacklog.txt.gz#_2015-02-27_16_48_58_71223:47
anteayajeblair: I do not argue with you23:47
jeblairSpamapS: i can reproduce at 191x9823:48
jeblairanteaya: it will be interesting to see what happens :)23:48
anteayabut I have two hats here, my hat as a person (make it opt in) and my hat as an official (it has to comply with the rules as written and interpreted)23:48
anteayaagreed23:48
anteayaI'm all for having a discussion about it23:48
*** Ryan_Lane has joined #openstack-infra23:48
anteayabut my role is to do as the tc directs23:48
*** tiswanso has quit IRC23:49
*** achanda has quit IRC23:49
anteayaand if the tc directs me to do something which is easier for me, yahooo!!23:49
*** Sukhdev has joined #openstack-infra23:49
anteayabut wishing doesn't make it so23:49
jeblairanteaya: i believe mark radcliffe might have provided two conflicting interpretations of different parts of the bylaws23:49
*** annegentle has joined #openstack-infra23:49
asselinjeblair, would you like to clarkb's nodepool chang? we should get this and needed by patches merged https://review.openstack.org/#/c/151749/523:50
anteayaI have no objection that your observation has merit23:50
*** jgrimm is now known as zz_jgrimm23:50
jeblairanteaya: i believe if we boil them down, he has said that "membership is not required for contribution" and "contribution automatically grants membership".23:50
jeblairanteaya: i suppose those may not be technically conflicting.  they certainly seem discordant.23:51
anteayahe may very well have done so23:51
anteayadiscordant there is a good word23:51
clarkbpleia2: looks like git-fe01 and 02 have similargroup issues and you aren't getting a user there as a result23:51
SpamapSjeblair: ahh ok, I think it's possible it is just an urwid bug.23:51
anteayaso having the tc arrive at an interpretation would help me a lot here23:51
*** dmsimard is now known as dmsimard_away23:51
jeblairSpamapS: though i have done some terrible things to urwid; i hope i am not responsible23:52
clarkbpleia2: I will have to correct those in the near future as well23:52
*** nelsnelson has quit IRC23:52
clarkbthis makes me wonder if the login.defs file isn't being appliedearly enough to fix these issues23:52
*** mfink_ has joined #openstack-infra23:52
jeblairclarkb: are we using requires?  do we need to do phases?23:53
clarkb(I want to get this ansible stuff flipped over first though since I am in the process of doing that)23:53
SpamapSjeblair: urwid probably had it coming.23:53
clarkbjeblair: I need to refresh my memory on it23:53
*** ryanpetrello has quit IRC23:53
clarkbjeblair: I think I see why this happens. login.defs is applied before all virtual users but not before any normal users23:54
clarkbjeblair: so normal users eg gerrit2 can get in first23:54
jeblairasselin: i lack the brainpower to review that now, i have marked it for tomorrow23:55
asselinjeblair, thanks23:55
clarkbnibalizer: if I do User { require => SomeResource } is that global to all manifests?23:55
clarkbnibalizer: or is it manifest/class specific? scoping in puppet always has me questioning things23:55
clarkbcrinkle: ^ you too?23:55
SpamapSmordred: gitorious?23:56
SpamapSmordred: for process-config-drive??23:56
*** achanda has joined #openstack-infra23:56
*** gordc has quit IRC23:57
clarkbjeblair: https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/users.pp#n11 I think we need to do that for User and Group too23:57
clarkbbut I need to hunt down what the scoping is on that23:58
crinkleclarkb: it's not global but it will leak in weird ways23:58
crinklelet me find a reference23:58
clarkbhrm maybe its easiest to do in an earlier run phase? I know people hate those things though23:59
clarkbcrinkle: thank you23:59
*** MarkAtwood has quit IRC23:59
jeblairclarkb: if that's a workable solution, this seems like an actually good use of the feature23:59
*** yamamoto has joined #openstack-infra23:59
*** ryanpetrello has joined #openstack-infra23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!