Thursday, 2014-04-24

jeblairmikal: mordred surmised the actual units are 1000s of 512k blocks.  which may be crazy or perfectly sane depending on how you think about storage.00:00
*** sacharya has quit IRC00:00
mikalthis is more johnthetubaguy's thing than mine, but I'll happy to poke somene if that would help00:00
clarkbjeblair: ++ to keepings lots of dumps00:01
clarkbjeblair: just throwing the idea out there that we can reduce it if we need to00:01
jeblairmikal, johnthetubaguy: i just checked iad,ord,dfw and our performance1-8 nodes all have 40G root partitions00:02
jeblairmikal, johnthetubaguy: it seems it's just the new performance2-30 node i just spun up in dfw that has 20G /00:03
*** gokrokve has quit IRC00:03
jeblairclarkb: checking the rax web page, which has units, we are supposed to have a 40G /00:04
jeblairi think this might be a good thing to work out before monday; 20 vs 40G / will make a big difference for us00:04
clarkb++00:04
jeblairmikal, johnthetubaguy: how about i open a support ticket?00:05
*** nati_ueno has quit IRC00:05
jeblairmikal: (for context, this is on the new gerrit server we're moving to on monday)00:06
*** UtahDave has joined #openstack-infra00:06
clarkbjeblair: let me know if you need help debugging anything00:06
jeblairhuh, i think the device/partition are 40G, but the filesystem is not00:08
jeblairthis is from a pvhvm image; i wonder if that has something to do with it00:08
jeblairclarkb: shall i "resize2fs /" ?00:09
clarkboh00:09
clarkbwell we aren't using the node so nothing terrible should happen :)00:09
mikaljeblair: a support ticket sounds like a good idea00:09
clarkbwhy not, then hopefully this will be corrected on future nodes that we boot00:09
mikaljeblair: but I will fanatically try to help as much as you want00:09
mikaljeblair: bearing in mind I have no access to those systems00:09
jeblairThe filesystem on /dev/xvda1 is now 10484164 blocks long.00:10
jeblairpoof it's 40G now00:10
clarkbmagic00:11
*** tjones has left #openstack-infra00:12
*** marcoemorais has quit IRC00:13
jeblairokay, ticket 140424-00007-3 filed00:14
jeblairsince the resize worked and we have 40G now, I think we can proceed and just file that away for the next time we spin up servers (we may want to add that to install_puppet_and_destroy_your_disks.sh)00:15
*** marcoemorais has joined #openstack-infra00:15
davidlenwellway off topic .. but why doesn't http://paste.openstack.org/ have a remove paste button ?00:15
mordreddavidlenwell: what would that do?00:16
mordredjeblair: WEIRD00:17
clarkbits unauthenticated, not sure you can do destructive actions00:17
davidlenwella coworker posted something with a production password and ip in it and he's all crap .. where is the delete button00:18
davidlenwellI advised him to change the password00:18
jeblairclarkb, mordred: i'm thinking maybe we shouldn't have /var/lib/apt on our cinder volume... (based on the idea that we should put only the application data we want to keep around when we, say, replace the server on the cinder volume)00:19
clarkbgood point00:19
jeblairso that's pretty much /home/gerrit2/review_site /var/lib/jeepyb and /var/lib/git00:19
jeblairwe could try to move all 3 of those to something like /srv00:20
clarkbjeblair: or go the symlink route00:20
clarkbI am not a huge fan of symlinks for that but it is simple00:20
*** sweston has quit IRC00:21
jeblairi bet moving /var/lib/{jeepyb,git} to /srv will be easy.  and i bet review_site wouldn't be too hard.00:21
clarkbya shouldn't be terrible on the new host00:21
JayFBind mounts can be an interesting path for that sort of thing. Behaves more like actual filesystems, and codified in /etc/fstab they'll be up every boot00:21
clarkbthough harder on the existing one if we want to keep them in sync to monday00:21
JayFI actually prefer it to symlinks for things like "move dir X to place Y" when properly changing pointers isn't possible00:22
jeblairJayF: yeah, i like that idea.  that might be a good migration strategy too00:22
clarkbwfm00:22
clarkbmy only concern with it is again cfg managemtn00:22
clarkbit doesn't play nice with fstab00:22
jeblairbind mount them to /srv, then later move them to actually use /srv00:22
JayFonly thing that a bind mount doesn't work on00:23
JayFis if you have things calling rename()00:23
JayFbut that doesn't always work for symlinks either00:23
davidlenwellIt would be less of an issue if the past ids were uuids instead of sequence numbers, so it;s impossible to guess or iterate over the pastes00:23
* JayF had trouble with this setting up an HA chef server, it assumed same root dir == same physical partition and used rename() in that case00:23
davidlenwelli.e. http://paste.openstack.org/show/76862/00:23
clarkbdavidlenwell: feel free to patch lodgeit or implement a deployment of the thing notmyname showed00:24
davidlenwellwhich brings up the issue of how much of the paste database is this kind of spam00:24
clarkbdavidlenwell: but, I don't think we can do unauthenticated deletions00:24
clarkband everyone hates the idea of authenticated pate00:24
davidlenwellclarkb: I do as well00:24
davidlenwelllike I said .. delete wouldn't be an issue if the id's weren't sequential numbers00:25
clarkbit would be though00:25
clarkbanyone could delete any publicly known uuid00:25
jeblairyou could do session cookies so you can at least delete the thing you just pasted00:25
clarkbthey aren't secret just because they are uuids00:25
davidlenwellyeah ..  thats not fun00:25
davidlenwelljeblair: yeah .. thats a great idea00:25
*** UtahDave has quit IRC00:25
jeblairokay, tomorrow i'll do cinder and look into moving those things to /srv in puppet or bind mounting them00:26
clarkbjeblair: sounds good00:26
*** praneshp has quit IRC00:26
clarkbdavidlenwell: fwiw I don't want to run paste.o.o anymore but am in the minority :)00:26
davidlenwellclarkb: running a paste server is a pain in the ass00:27
*** fungi has quit IRC00:30
*** gokrokve has joined #openstack-infra00:30
*** melwitt has quit IRC00:31
*** amcrn has joined #openstack-infra00:34
*** gokrokve has quit IRC00:34
*** nati_ueno has joined #openstack-infra00:36
*** fungi has joined #openstack-infra00:36
*** zhiyan_ is now known as zhiyan00:37
*** nati_ueno has quit IRC00:40
*** hogepodge has quit IRC00:41
*** mwagner_lap has joined #openstack-infra00:42
*** talluri has joined #openstack-infra00:43
*** talluri has quit IRC00:47
*** mfer has joined #openstack-infra00:48
*** UtahDave has joined #openstack-infra00:48
openstackgerritSteve Kowalik proposed a change to openstack-infra/devstack-gate: Add os-cloud-config into PROJECTS  https://review.openstack.org/8997800:51
*** zhiyan has quit IRC00:58
*** kiall has quit IRC00:58
*** proffalken has quit IRC00:58
*** Shrews has quit IRC00:58
*** UtahDave has quit IRC00:59
*** asselin2 has joined #openstack-infra00:59
*** gokrokve has joined #openstack-infra00:59
*** Shrews has joined #openstack-infra01:00
*** zhiyan has joined #openstack-infra01:00
*** fungi has quit IRC01:00
*** proffalken has joined #openstack-infra01:00
*** harlowja has joined #openstack-infra01:00
*** rlandy has quit IRC01:01
*** fungi has joined #openstack-infra01:01
*** kiall has joined #openstack-infra01:02
*** marcoemorais has quit IRC01:02
*** annegentle has quit IRC01:02
*** khyati_ has quit IRC01:03
*** marcoemorais has joined #openstack-infra01:03
*** gokrokve has quit IRC01:04
*** nati_ueno has joined #openstack-infra01:10
clarkbjhesketh: https://review.openstack.org/#/c/76057/ has actual testing now01:11
clarkbjhesketh: feedback would be great01:11
jheskethawesome01:12
jheskethclarkb: I'll take a look but need to read from scratch as it left my mind01:12
*** mfer has quit IRC01:12
clarkbyeah I had to refill caches my self01:12
clarkbjhesketh: the tests are still a bit rudimentary but do exercise the polling01:13
*** yaguang has joined #openstack-infra01:13
jheskethgreat01:13
openstackgerritMonty Taylor proposed a change to openstack-infra/nodepool: Build images using diskimage-builder  https://review.openstack.org/4648201:13
openstackgerritMonty Taylor proposed a change to openstack-infra/config: WIP: Use ansible instead of direct ssh calls  https://review.openstack.org/8782101:15
*** lakshmi has quit IRC01:18
*** yamahata_ has joined #openstack-infra01:20
*** yamahata has joined #openstack-infra01:20
*** mburned is now known as mburned_out01:22
*** changbl has joined #openstack-infra01:22
*** homeless has quit IRC01:24
*** marcoemorais has quit IRC01:25
*** oomichi has joined #openstack-infra01:26
*** nati_ueno has quit IRC01:28
*** sweston has joined #openstack-infra01:32
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add support for disk-image-builder in nodepool  https://review.openstack.org/8847901:32
mordredclarkb: ^^ just used cache_devstack.py directly01:33
clarkbalso does that change cover pvhwm stuff?01:33
clarkbextra drivers?01:33
*** wchrisj has quit IRC01:33
clarkbmy xen is bad01:34
mordredoh - I didn't touch the xen scripts yet01:34
clarkbwe need it for slaves on rax01:34
clarkbnot testing xen01:34
mordredgotcha01:34
mordredI thought lifeless said we didn't need to do anything special - just needed to not strip out normal drives from the normal kernel01:35
mordredlifeless: ?01:35
*** saschpe has quit IRC01:35
lifelessmordred: dib? include the baremetal element probably is all.01:36
*** nosnos has joined #openstack-infra01:36
*** changbl has quit IRC01:36
mordredlifeless: but these are images to be loaded into clouds? shoudl we still inlude the bare metal element?01:37
*** saschpe has joined #openstack-infra01:37
openstackgerritA change was merged to openstack/requirements: Zake 0.0.15 released  https://review.openstack.org/8692801:39
*** yjiang has joined #openstack-infra01:39
*** talluri has joined #openstack-infra01:44
*** Ryan_Lane1 has quit IRC01:47
*** talluri has quit IRC01:48
*** changbl has joined #openstack-infra01:49
mesterysdague: Looks like your "bc" fix had issues, can you reverify this one? It failed on a cinder volume bug: https://review.openstack.org/#/c/89920/01:58
clarkbmestery: you can reverify it01:58
mesteryclarkb: Ah, yes. Doing it now, thanks!01:58
*** arosen2 has joined #openstack-infra01:59
clarkbthanks01:59
*** thomasem has joined #openstack-infra01:59
mesteryclarkb: I've seen that issue trip up a few neutron patches today, waiting for it to land before rechecking/verfiying some of those.01:59
*** gokrokve has joined #openstack-infra01:59
*** mburned_out is now known as mburned01:59
*** arosen1 has quit IRC02:00
*** gokrokve has quit IRC02:00
mordredclarkb, jeblair: I'm testing the dib patch now - the part where we have the cache repos script actually just create a dib source-repositories file and let the dib machinery put the source repos in place for us while keeping local caches of the thigns on the dev workstation is pretty sweet02:01
mordredlifeless: ^^ thanks02:01
*** gokrokve has joined #openstack-infra02:01
clarkbmordred: speed up the builds?02:01
mordredyah02:01
clarkbmordred: dib is going to cut out so many cpu hours02:01
clarkbit will be great02:02
*** weshay has quit IRC02:02
mordredclarkb: ultimately, we want to take cache_devstack and re-write it into a few parts I think02:02
clarkbmordred: oh also does your dib stuff cover the local dns resolver and the grub changes?02:02
clarkbI didn't see them but havne't looked too hard yet02:02
mordredclarkb: grub changes yes - dns no02:02
mordredthanks for reminding me - I had put that on my stack and forgot to pop it02:02
mordredclarkb: if we split cache_devstack into two - we can have the part which scans for images to cache create a source-repositories- file like the cache_repos does and let the dib caching machinery do its thing02:03
*** thomasem has quit IRC02:03
mordredwhich means that the build host will only download most of those images once and then it'll just keep them02:03
mordredthen, we let the other part run in-image and do the package pre-warming02:04
mordredit's a bit too many moving pieces for this step02:04
clarkbthat sounds good02:04
clarkbwill the dib caching download new cirros if say they update the image upstream though?02:04
clarkbor is it only checking the local file is present?02:05
mordredyup02:05
mordredin fact, I want to steal their url caching script for places where we do the same - because it does all of the thing we want it to do02:05
*** gokrokve has quit IRC02:05
mordredclarkb: # Save the nameservers configured by our provider.02:05
*** coolsvap has quit IRC02:05
mordredthis does not seem to do what the comment says02:06
clarkbyeah its wrong now because we gave up on provider resolvers02:06
mordredso really we could put the unbound setup into puppet now yeah?02:06
*** sweston has quit IRC02:08
*** sacharya1 has quit IRC02:08
clarkbmaybe? I think the static nodes use the provider DNS02:08
clarkbprovider DNS is only a problem when grabbing lots of IPs02:09
*** yaguang has quit IRC02:09
clarkbbecause they don't remove their blacklists afte rnodes are deleted02:09
mordredwell, I mean, we have "openstack_project::single_use_slave"02:09
*** coolsvap has joined #openstack-infra02:10
mordredclarkb: (I'm going to do it in dib for now - just pointing it out for whatever)02:10
*** sweston has joined #openstack-infra02:13
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add support for disk-image-builder in nodepool  https://review.openstack.org/8847902:17
*** sweston has quit IRC02:20
*** signed8bit has quit IRC02:21
*** signed8bit has joined #openstack-infra02:22
mordrednibalizer: when you are around ...02:23
*** zehicle_at_dell has joined #openstack-infra02:24
*** changbl has quit IRC02:26
*** nati_ueno has joined #openstack-infra02:26
jheskethclarkb: the zuul stuff looks good... what do you think about making the poll timeout configurable?02:31
clarkbjhesketh: I figured this would come up :) I can certainly do that and make that one test shorter02:32
clarkbjhesketh: do you think 60 seconds is a good default?02:32
jheskethheh02:32
jheskethI don't have any data on how gerrit replication works02:32
jheskethie, how slow it potentially is02:32
jheskethwe should also consider making the poll interval configurable too02:33
clarkbyeah02:33
jheskethwhat if a mirror only syncs every 30min, would it be terrible to poll every 5min and just have zuul hold the jobs in the queue for half an hour02:33
clarkbI think I will go with the current values as defaults and make it configurable02:33
clarkbjhesketh: well gerrit does pushes whenver things change to do replication02:34
clarkbso we shouldn't see delays that large02:34
jheskethyeah, I'm just thinking outloud about supporting somebody who wants to do really slow replication02:34
clarkbbut with really large objects and distances between gerrit and replicas we may see things take more than 60 minutes02:34
jheskethbut I think that's silly02:35
clarkbso making it configurable would be good02:35
clarkber 60 seconds02:35
jheskethit certainly can't hurt to add it, but zuul is becoming increasingly complex02:35
clarkbvictim of its own success02:35
jheskethclarkb: so as for having a mixin.. you decided against it?02:39
clarkbjhesketh: yeah, I needed to modify the tests anyways to do the replication02:40
clarkbjhesketh: so I am borrowing now more than copy pasta02:40
jheskethyep02:40
jheskethI'm fine with that02:40
lifelessjhesketh: o/ we should put some prose together for pyconau02:40
jheskethI don't think it's a terrible duplication, they are testing different things but they happen to be similar for weight02:40
clarkbjhesketh: yup02:40
jheskethlifeless, +102:40
jheskethlifeless: did you see my email to Chris yesterday?02:41
lifelessI think so02:41
lifelessI was up till 3am, so not entirely sure about anything that happened yesterday02:41
jheskethheh02:41
*** amcrn has quit IRC02:41
jheskethlifeless: so I figure as the first step(s) to gain some more information around miniconfs to know what we should be doing02:41
lifelessoh right02:42
lifelessyes02:42
lifelessI asked chrisjrn a little in #pyconau02:42
lifelessearlier today02:42
*** amotoki has quit IRC02:43
jheskethah cool, will read02:44
*** talluri has joined #openstack-infra02:45
jheskethlifeless: just sent a reminder to openstack-dev re main conf CFP's02:45
jheskethdidn't mention the miniconf as I want people to propose to the main conference first and we'll do an announce re miniconf later02:45
*** NobodyCam has quit IRC02:46
*** morganfainberg is now known as morganfainberg_Z02:47
*** alexpilotti has quit IRC02:49
*** talluri has quit IRC02:49
nibalizermordred: hi02:52
nibalizergreghaynes: and I did a pair-review of 88479 so my thoughts are all up there02:53
*** yamahata has quit IRC02:57
greghayneswoo pair reviewing02:57
lifelessreviewing pears.02:58
lifelessmmmm02:58
mordrednibalizer: I put up a patch earlier which kinda is the same as one of your patches except it's different02:58
mordrednibalizer: which makes me think we should, you know, merge them02:58
nibalizermmmm yes02:58
mordrednibalizer: https://review.openstack.org/#/c/88477/02:58
mordrednibalizer: although - perhaps I should skip the puppet3 parts of mine and leave that to yours02:59
mordredand just make mine the "What shoudl you do if you find ourself on trusty" patch02:59
*** gokrokve has joined #openstack-infra02:59
nibalizermordred: yea either way more complexity goes into install_puppet.sh02:59
nibalizerand yea merging my changes and your changes might be a bit hairy03:00
nibalizeri think we should just land your changes and i'll rebase against it03:00
nibalizerits not that big a deal and when I see the final state of what lands to ifcase trusty I can build on that with the puppet3 logic03:00
nibalizerbut yea there will be a combination of ... oh wait03:00
tchaypodstufft: I've just had the (in hindsight not very) startling realisation that in order to test what happens if the --index-url uses file:///, I'm going to have to write an index.html03:00
*** praneshp has joined #openstack-infra03:01
nibalizerwait no03:01
dstuffttchaypo: ok03:01
dstuffttchaypo: just use a py.test tmpdir to do it in03:01
nibalizeryea there are 4 possibilities: precise and puppet2.7, precise and puppet3, trusty and 2.7, trusty and 303:01
dstufftor I think there might be some tests/data03:01
nibalizerso it will get gnarly but noprobs03:01
mordrednibalizer: trusty and 2.7 does not seem to be a possibliity03:02
tchaypodstufft: it probably needs 3 entries in it, so I was thinking of just hand-coding and dropping it into tests/data/packages03:02
*** dkranz has joined #openstack-infra03:02
nibalizermordred: dangit are there technical limitations?03:02
tchaypodstufft: unless there's a nice tool that can generate it on the fly.. but then I'd need to add tests for that as well03:03
dstuffttchaypo: dropping it in works for me03:03
mordrednibalizer: there are no repos with puppet 2 for trusty03:03
nibalizergah!03:04
nibalizerwell if we need to there is always gem install03:04
nibalizerbut lets hope we dont need that03:04
mordrednah. I think we're going to work the puppet 3 upgrade with thigns still on precise03:05
mordredthen do the trusty upgrade03:05
nibalizerif I pull in update_slave from your patch into mine?03:05
mordredexcept - we WILL do a little puppet3 probably on the single use slaves since they do puppet apply and it all mostly works03:05
*** rfolco has quit IRC03:07
*** sandywalsh has quit IRC03:08
*** harlowja is now known as harlowja_away03:09
*** dkranz has quit IRC03:09
*** sandywalsh has joined #openstack-infra03:10
*** Ryan_Lane has joined #openstack-infra03:12
*** asselin2 has quit IRC03:16
nibalizermordred: so if i bring update_slave into my puppet3master change do you think we could land it?03:16
*** yaguang has joined #openstack-infra03:17
mordredmayhap?03:17
nibalizerokay ill do that03:18
*** prad has quit IRC03:19
*** UtahDave has joined #openstack-infra03:29
*** changbl has joined #openstack-infra03:30
*** HenryG has quit IRC03:36
mordredclarkb: wait. why wouldn't we manage the cinder volume mounting in puppet03:38
clarkbmordred: because it is too late by that point03:39
clarkbmordred: it needs to happen prior to or during boot03:39
clarkbalso uuids make it a pita with puppet03:39
mordredinstead of trying to figure out how to deal with seuqncing03:39
mordredwe HAVE puppet that is tied to specific hosts -03:39
mordredwe could do some mounting things with onlyoif and whatnot03:40
clarkbyou could but that doesn't fix the races03:40
mordredclarkb: not for /var/log03:40
clarkbso its mostly useless03:40
mordredfor other places03:40
clarkbmordred: and not for elasticsearch03:40
mordredliek, /home/gerrit203:40
clarkbgerrit is an exception not rule03:40
mordredsince /home/gerrit2 is a thing that puppet creates03:40
clarkbbecause we isntall gerrit ourselves not from pacakges03:40
mordredso, what you're saying is that the problem is packages and config management :)03:41
mordredssince they each overlap each other's problem domain03:41
clarkbpartially03:41
mordredso they fight03:41
clarkbbut the underlying problem is that my infrastructure as a service doesn't know how to communicate to each other so that I can boot a cohesive piece of infrastructure03:42
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add support for disk-image-builder in nodepool  https://review.openstack.org/8847903:42
mordredclarkb: well yeah03:42
mordredI'm just still brainstorming on making it work03:42
mordredbut I think that it all comes back to AFS03:42
clarkb:)03:42
clarkbI think sdague's idea is not completely terrible03:42
clarkbas we start to use DIB more we could bake the stuff into our images03:42
mordred++03:43
mordredI think that's a GREAT idea03:44
clarkbitdoesn't fix the make me a volume and partition format it03:44
clarkbbut it does fix the first boot race03:44
*** sweston has joined #openstack-infra03:47
mordredclarkb: AFS fixes the other thing03:48
mordredand I know I'm annoying about tht03:48
mordredbut seriously - I think it actually does03:48
*** mfer has joined #openstack-infra03:50
*** UtahDave has quit IRC03:52
*** unicell has joined #openstack-infra03:54
*** nati_ueno has quit IRC03:55
*** mfer has quit IRC03:55
*** sweston has quit IRC04:01
*** yfried has quit IRC04:01
*** sweston has joined #openstack-infra04:03
*** coolsvap has quit IRC04:05
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add support for disk-image-builder in nodepool  https://review.openstack.org/8847904:06
*** amcrn has joined #openstack-infra04:06
*** coolsvap has joined #openstack-infra04:07
*** gokrokve has quit IRC04:08
*** Longgeek has joined #openstack-infra04:10
*** yamahata has joined #openstack-infra04:17
*** harlowja_away is now known as harlowja04:18
*** marcoemorais has joined #openstack-infra04:20
YorikSarjeblair: Still around?04:20
*** UtahDave has joined #openstack-infra04:20
clarkbYorikSar: I think he AFK'd a while back. whats up?04:20
YorikSarclarkb: I'm just whaitng when there will be a good moment to upgrade Zuul.04:22
clarkbYorikSar: I think the priority this week is prep for gerrit upgrade. I wouldn't expect zuul upgrade to happen before then04:22
YorikSarclarkb: Ah... Ok.04:22
YorikSarclarkb: I guess we'll have to wait 40-50s for each UI update this week then.04:23
clarkbYorikSar: ya, its possible that gerrit will get done soon and zuul can happen but we are working to make sure gerrit upgrade happens on monday04:24
*** yfried has joined #openstack-infra04:24
YorikSarclarkb: btw, what about those stuck patchsets in check queue?04:24
clarkbYorikSar: there was a gearman blip last night apparently. If you push a new patchset it will move them along04:25
YorikSarclarkb: On Monday? Already? Yay! :) I'll be able to write some bot that will convert PEP8 output to Gerrit inline comments :)04:25
clarkbyup on monday04:26
YorikSarclarkb: REST API will be acessible to everyone?04:26
*** talluri has joined #openstack-infra04:28
clarkbI think so04:29
*** yfried has quit IRC04:29
*** talluri has quit IRC04:32
*** yamahata has quit IRC04:48
*** yamahata has joined #openstack-infra04:49
mordredYorikSar: dude. if you write a bot that converts pep8 output to gerrit inline comments, I will hand you a giant ham04:49
YorikSarmordred: Hey, Monty :) Which part of the world are you in this time of year?04:50
YorikSarmordred: Hmmm... Ham sounds good before breakfast :)04:51
*** nati_ueno has joined #openstack-infra04:52
YorikSarmordred: It's actually not that hard to do. All you need is PEP8 logs (we have them) and API to publish inline comments (it's there in newer versions of Gerrit)04:53
*** talluri has joined #openstack-infra04:53
clarkbyou probably want to do that as part of the job itself04:53
clarkbbut definitely doable04:55
*** afazekas is now known as _afazekas_away04:56
*** chandan_kumar has joined #openstack-infra05:00
*** signed8bit has quit IRC05:04
*** gokrokve has joined #openstack-infra05:07
*** rwsu has quit IRC05:07
*** nati_ueno has quit IRC05:07
*** nosnos has quit IRC05:08
YorikSarclarkb: I don't think that should be in jobs... Jenkins nodes shouldn't access Gerrit directly.05:09
YorikSarclarkb: But it might be part of Zuul, for example.05:09
clarkbI don't think that belongs in zuul05:10
clarkb:)05:10
*** yfried has joined #openstack-infra05:10
YorikSarclarkb: Yeah... So maybe a separate bot is a good fit :)05:10
*** gokrokve has quit IRC05:11
*** marcoemorais has quit IRC05:16
YorikSarclarkb: I've jusr read through jeblair's message on ML. Why is WIP label kept transient?05:21
*** e0ne has joined #openstack-infra05:22
*** rwsu has joined #openstack-infra05:23
clarkbYorikSar: I suppose you could propose we keep the -1 vote like we keep a code review -205:25
clarkbYorikSar: but I think it may be to keep the old behavior05:25
*** UtahDave has quit IRC05:25
*** e0ne has quit IRC05:26
YorikSarclarkb: I wonder if anyone's happy about it.05:29
YorikSarclarkb: Ok, I'll write it to ML then.05:29
*** nati_ueno has joined #openstack-infra05:33
*** amotoki has joined #openstack-infra05:33
*** nosnos has joined #openstack-infra05:35
Alex_Gaynorjeblair, clarkb, mordred: FYI https://github.com/pypa/pip/pull/1743 is the pip fix for the wacko pypy+setuptools issue we hit05:49
*** renlt has joined #openstack-infra05:52
*** nati_ueno has quit IRC05:58
clarkbI love that a method called clobber appaers to be constructive05:59
clarkbAlex_Gaynor: thanks for the heads up. I assume that means we can make pypy go again when we have new pip?05:59
clarkbassuming this PR merges05:59
Alex_Gaynorclarkb: yeah, I'll definitely follow up once that's out :-)06:00
clarkbmordred: jeblair SergeyLukjanov so sdague's d-g bc removal is being erally stubborn in the gate06:01
clarkbI am tempted to force it through but not right before I go to bed06:01
clarkbbut something to consider for morning06:02
*** jcoufal has joined #openstack-infra06:02
*** nati_ueno has joined #openstack-infra06:05
*** Longgeek has quit IRC06:05
*** gyee has quit IRC06:05
*** Longgeek has joined #openstack-infra06:06
yjiangHi,Is there any core member could help?I want to apply a 3rd part test account.My apply email have sent for 2 weeks and no response at all.06:06
*** Longgeek has quit IRC06:06
clarkbyjiang: sorry about that we have been very busy with a variety of things and shorthanded06:06
clarkbthird party test accounts have been a low priority the last few weeks06:07
*** Longgeek has joined #openstack-infra06:07
*** gokrokve has joined #openstack-infra06:07
yjiangclarkb: OK.thx.If I want to renew some part of the apply information,Should I sent another email?06:11
clarkbyjiang: is the information changing?06:11
yjiangclarkb: Yes.06:11
clarkbif so yes, just respond to your original email06:11
*** gokrokve has quit IRC06:12
clarkbalso please avoid needing to change the info once the requiest is complete06:12
*** Longgeek_ has joined #openstack-infra06:12
yjiangclarkb: OK,thx a lot.06:12
*** pcrews has quit IRC06:13
*** ildikov has quit IRC06:15
*** Longgeek has quit IRC06:16
*** jlibosva has joined #openstack-infra06:18
*** zehicle_at_dell has quit IRC06:23
*** harlowja is now known as harlowja_away06:30
renlthi infra team, I want add a new project in stackforge, I already read the process http://ci.openstack.org/stackforge.html, now I'll commit my initial project config, my question is do I need create a Launchpad bug for this commit? Thanks in advance.06:30
clarkbrenlt: no you don't but please make sure your gerrit topic is 'new-project'06:31
clarkbrenlt: you can do that by doing `git review -t new-project` when you push your change06:31
*** afazekas has joined #openstack-infra06:32
*** flaper87|afk is now known as flaper8706:38
renltclarkb: 'new-project' literally, not 'my-project-name' right?06:39
clarkbcorrect06:40
clarkbwe use that topic to filter all the new projects in gerrit06:40
clarkbmakes it easier to batch them up06:40
renltclarkb: many thanks!06:40
rcarrillocruzmorning06:51
*** _nadya_ has joined #openstack-infra06:52
SergeyLukjanov<day_time> folks!06:56
*** sweston is now known as sweston|away06:57
*** sweston|away is now known as sweston06:57
*** sandywalsh has quit IRC07:03
openstackgerritA change was merged to openstack-infra/config: Handle additional reqs push failure as non failing  https://review.openstack.org/8992407:04
*** sandywalsh has joined #openstack-infra07:04
*** amcrn has quit IRC07:04
*** lukego has joined #openstack-infra07:08
*** gokrokve has joined #openstack-infra07:08
*** ihrachyshka has joined #openstack-infra07:09
*** UtahDave has joined #openstack-infra07:10
*** e0ne has joined #openstack-infra07:11
*** marcoemorais has joined #openstack-infra07:12
*** gokrokve has quit IRC07:12
*** e0ne has quit IRC07:16
*** e0ne has joined #openstack-infra07:17
*** _nadya_ has quit IRC07:18
*** ihrachyshka has quit IRC07:19
*** ihrachyshka has joined #openstack-infra07:20
*** praneshp has quit IRC07:20
*** _nadya_ has joined #openstack-infra07:21
*** reed has joined #openstack-infra07:24
*** olaph has quit IRC07:28
*** rediskin has joined #openstack-infra07:33
openstackgerritLe Tian Ren proposed a change to openstack-infra/config: Create powervc-driver project under Stackforge  https://review.openstack.org/9001707:37
*** arosen2 has quit IRC07:41
*** hashar has joined #openstack-infra07:47
*** andreaf has joined #openstack-infra07:50
openstackgerritLe Tian Ren proposed a change to openstack-infra/config: Create powervc-driver project under Stackforge  https://review.openstack.org/9001707:51
*** rcarrill` has joined #openstack-infra07:53
*** rcarrillocruz has quit IRC07:56
*** ildikov has joined #openstack-infra07:56
*** sandywalsh_ has joined #openstack-infra08:04
*** matrohon has joined #openstack-infra08:06
*** andreaf has quit IRC08:06
*** sandywalsh has quit IRC08:06
*** gokrokve has joined #openstack-infra08:09
*** pblaho has joined #openstack-infra08:11
*** jamielennox is now known as jamielennox|away08:12
johnthetubaguyjeblair: for when you are up, did you get the performance node issues sorted? If you used PVHVM based images (probably a good idea) the base disk doesn't get auto sized upto 40 GB right now (I have a patch pending in gerrit to fix that, if you need it)08:12
*** mrmartin_ has joined #openstack-infra08:13
*** gokrokve has quit IRC08:13
mrmartin_re08:14
mrmartin_SergeyLukjanov are you here?08:14
*** e0ne has quit IRC08:15
*** ildikov_ has joined #openstack-infra08:16
*** jpich has joined #openstack-infra08:17
*** e0ne has joined #openstack-infra08:17
*** nosnos has quit IRC08:18
*** derekh has joined #openstack-infra08:18
*** dizquierdo has joined #openstack-infra08:19
*** ildikov has quit IRC08:20
SergeyLukjanovmrmartin_, yup08:22
*** julienvey has joined #openstack-infra08:22
mrmartin_SergeyLukjanov: can you check the zuul?08:22
SergeyLukjanovmrmartin_, what's the problem?08:23
*** darraghb has joined #openstack-infra08:24
mrmartin_https://review.openstack.org/#/c/9001808:27
mrmartin_I cannot see this job in zuul status page.08:28
mrmartin_and some of the jobs there running more then 20 hours08:29
mrmartin_can you check that?08:29
*** _nadya_ has quit IRC08:30
SergeyLukjanovmrmartin_, there were some problems with gear, but it works ok now afaik08:32
SergeyLukjanovmrmartin_, re your patch, it already have +1 from jenkins08:33
mrmartin_SergeyLukjanov, ok great, thank you08:33
mrmartin_if you have a little time today, may I ask a review for this two patches: https://review.openstack.org/#/c/88323/ https://review.openstack.org/#/c/88219/08:34
*** UtahDave has quit IRC08:34
mrmartin_both of them sitting there since a week08:34
*** gmoro has quit IRC08:35
mrmartin_we need to clone you somehow, I want to see more infra-team members in the EU timezone08:35
mrmartin_:)08:35
*** jooools has joined #openstack-infra08:37
*** andreaf has joined #openstack-infra08:40
*** markmc has joined #openstack-infra08:42
davidlenwellhey SergeyLukjanov.. what do you think about being able to see images commited from review pages?   i.e. https://review.openstack.org/#/c/88587/08:45
*** medieval1 has quit IRC08:45
SergeyLukjanovmrmartin_, please, don't clone me :)08:45
*** medieval1 has joined #openstack-infra08:45
SergeyLukjanovdavidlenwell, hey08:46
davidlenwellhi08:46
*** nati_ueno has quit IRC08:46
davidlenwellthought I'd talk about it with a core member of infra before maybe filing it as a bug then maybe coding it08:46
openstackgerritA change was merged to openstack-infra/storyboard: Creator field added to a Task model  https://review.openstack.org/8762608:46
*** gmoro has joined #openstack-infra08:47
SergeyLukjanovdavidlenwell, it sounds good, but it's really "nice to have" prio level08:47
*** reed has quit IRC08:47
SergeyLukjanovdavidlenwell, probably we could search for some existing gerrit plugins08:47
davidlenwellsure .. but its also kinda low hanging08:47
*** reed has joined #openstack-infra08:47
davidlenwellkinda what I was thinking .. since I don't really know how gerrit builds that page .. I probably don't wanna know08:48
*** e0ne_ has joined #openstack-infra08:48
*** dkehn has quit IRC08:49
SergeyLukjanovdavidlenwell, after short googling it seems like it's already implemented and we just should enable it08:50
SergeyLukjanovdavidlenwell, https://gerrit-review.googlesource.com/Documentation/config-gerrit.html#mimetype08:50
davidlenwellneat08:50
davidlenwellis that file in config?08:50
SergeyLukjanovdavidlenwell, yup, I'll take a look on current config file and send CR to discuss it with other infra folks08:51
*** e0ne has quit IRC08:51
davidlenwellone place I can start to help is on any interface stuff...08:52
SergeyLukjanovdavidlenwell, there was a CR to embed zuul results into the change request page in gerrit08:53
davidlenwellI like that idea08:54
*** rediskin has left #openstack-infra08:54
davidlenwelllike I said I don't currently know how that page builds .. but we use forked gerrit right?08:54
SergeyLukjanovdavidlenwell, yup, it's forked, you can fid sources in openstack-infra/gerrit08:55
SergeyLukjanovreview.o.o will be upgraded to the latest 2.8.X next week08:55
*** dkehn has joined #openstack-infra08:56
davidlenwellcool08:56
*** ihrachyshka has quit IRC08:58
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Display images in reviews  https://review.openstack.org/9003008:59
SergeyLukjanovdavidlenwell, ^^08:59
davidlenwellnice .. thanks.. thats bad ass ..08:59
davidlenwellI was totally looking for where to put that .. you beat me to it ..08:59
SergeyLukjanovdavidlenwell, oops, sorry09:01
davidlenwellno worries ...09:01
*** Longgeek_ has quit IRC09:01
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Introducing the event timeline  https://review.openstack.org/8795909:01
davidlenwellits still awesome to be able to bring it up in irc then BAM .. patch .. kick ass09:02
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Fix indention in gerrit.config.erb  https://review.openstack.org/9003109:03
*** marcoemorais has quit IRC09:06
openstackgerritA change was merged to openstack-infra/devstack-gate: change time calculation to not require bc  https://review.openstack.org/8992009:06
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Update a sample projects file  https://review.openstack.org/9003209:07
*** _nadya_ has joined #openstack-infra09:08
*** ominakov has joined #openstack-infra09:09
*** renlt has quit IRC09:09
*** _nadya_ has quit IRC09:09
*** Longgeek has joined #openstack-infra09:09
*** ociuhandu has quit IRC09:10
*** gokrokve has joined #openstack-infra09:10
*** asselin2 has joined #openstack-infra09:12
*** maxbit has joined #openstack-infra09:12
*** gokrokve has quit IRC09:14
*** sweston has quit IRC09:16
*** asselin2 has quit IRC09:16
*** hashar has quit IRC09:19
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Extract experimental-tripleo jobs to template  https://review.openstack.org/8402609:20
*** oomichi has quit IRC09:20
*** miarmak has quit IRC09:23
*** ociuhandu has joined #openstack-infra09:24
*** miarmak has joined #openstack-infra09:27
*** zhiyan is now known as zhiyan_09:32
*** marcoemorais has joined #openstack-infra09:33
*** marcoemorais1 has joined #openstack-infra09:35
*** marcoemorais has quit IRC09:38
*** marcoemorais1 has quit IRC09:39
*** hashar has joined #openstack-infra09:52
reeddoes anyone here know where the skin of wiki.openstack.org lives?09:53
*** rcarrillocruz has joined #openstack-infra09:54
*** rcarrill` has quit IRC09:56
*** zhiyan_ is now known as zhiyan09:58
*** xchu_ has joined #openstack-infra10:01
openstackgerritA change was merged to openstack-infra/config: Add example of comment formatting  https://review.openstack.org/8593010:02
*** yjiang has quit IRC10:04
*** ihrachyshka has joined #openstack-infra10:06
*** xchu_ has quit IRC10:06
openstackgerritSean Dague proposed a change to openstack-infra/devstack-gate: Revert "Revert "update grenade branches""  https://review.openstack.org/9004310:07
*** dims has quit IRC10:08
*** zhiyan is now known as zhiyan_10:08
*** ihrachyshka has quit IRC10:09
*** ihrachyshka has joined #openstack-infra10:10
*** hashar has quit IRC10:10
*** gokrokve has joined #openstack-infra10:11
*** Longgeek has quit IRC10:12
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Added test for migrations  https://review.openstack.org/9004710:12
davidlenwellSergeyLukjanov: any idea why this failed pep8? https://review.openstack.org/#/c/90024/  the logs aren't making sense to me.10:13
SergeyLukjanovdavidlenwell, from logs:10:14
SergeyLukjanov./nova/virt/libvirt/utils.py:230:80: E501 line too long (81 > 79 characters)10:14
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Update a sample projects file  https://review.openstack.org/9003210:14
*** gokrokve has quit IRC10:15
*** nosnos has joined #openstack-infra10:15
*** dims has joined #openstack-infra10:19
*** Longgeek has joined #openstack-infra10:20
*** e0ne_ has quit IRC10:20
*** mburned is now known as mburned_out10:23
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Added test for migrations  https://review.openstack.org/9004710:25
*** ihrachyshka has quit IRC10:30
*** marcoemorais has joined #openstack-infra10:36
openstackgerritBob Ball proposed a change to openstack-infra/nodepool: Check for stale PID lock when starting  https://review.openstack.org/9005210:39
*** marcoemorais has quit IRC10:40
*** jcoufal has quit IRC10:41
*** waterkinfe has joined #openstack-infra10:45
*** waterkinfe has quit IRC10:46
*** waterkinfe has joined #openstack-infra10:47
*** darraghb has quit IRC10:48
*** darraghb has joined #openstack-infra10:48
*** waterkinfe has quit IRC10:52
*** waterkinfe has joined #openstack-infra10:52
openstackgerritBob Ball proposed a change to openstack-infra/nodepool: Check for stale PID lock when starting  https://review.openstack.org/9005210:53
*** mburned_out is now known as mburned10:58
openstackgerritSean Dague proposed a change to openstack-infra/config: index n-sched in grenade runs  https://review.openstack.org/9005411:00
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: adjust the cgroup bug to use n-cpu  https://review.openstack.org/9005711:03
*** Clabbe has quit IRC11:03
*** Clabbe has joined #openstack-infra11:04
*** e0ne has joined #openstack-infra11:05
*** lukego has quit IRC11:09
*** e0ne has quit IRC11:10
*** gokrokve has joined #openstack-infra11:11
*** e0ne has joined #openstack-infra11:12
*** gokrokve has quit IRC11:16
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Introducing the event timeline  https://review.openstack.org/8795911:19
openstackgerritA change was merged to openstack-infra/elastic-recheck: adjust the cgroup bug to use n-cpu  https://review.openstack.org/9005711:34
*** jgallard has joined #openstack-infra11:36
*** marcoemorais has joined #openstack-infra11:37
*** Clabbe has quit IRC11:39
*** ihrachyshka has joined #openstack-infra11:40
*** Clabbe has joined #openstack-infra11:41
*** marcoemorais has quit IRC11:41
*** adalbas has joined #openstack-infra11:42
openstackgerritA change was merged to openstack-infra/devstack-gate: Add os-cloud-config into PROJECTS  https://review.openstack.org/8997811:44
*** chandan_kumar has quit IRC11:45
mattymoSergeyLukjanov, why is the launchpad+gerrit bug broken? :(11:47
SergeyLukjanovmattymo, terrorists probably11:49
SergeyLukjanovmattymo, is it not working for all events or for specific CR/bug/bp?11:51
*** Longgeek_ has joined #openstack-infra11:52
mattymothere is a specific one here: https://review.openstack.org/8983211:53
*** Longgeek has quit IRC11:53
*** HenryG has joined #openstack-infra11:55
*** Longgeek_ has quit IRC11:57
*** ildikov has joined #openstack-infra11:59
*** rfolco has joined #openstack-infra12:02
SergeyLukjanovmattymo, comment was posted to the issue12:02
*** pdmars has joined #openstack-infra12:02
*** ildikov_ has quit IRC12:02
SergeyLukjanovmattymo, and comment was added to https://blueprints.launchpad.net/fuel/+spec/pack-all-eggs-and-gems12:03
SergeyLukjanovso, I don't see the issue12:03
mattymooh ok12:03
mattymocarry on :)12:03
*** Longgeek has joined #openstack-infra12:04
*** Longgeek_ has joined #openstack-infra12:04
*** doug-fish has left #openstack-infra12:04
*** hashar has joined #openstack-infra12:07
*** Longgeek has quit IRC12:08
*** salv-orlando has joined #openstack-infra12:09
*** lazy_prince has joined #openstack-infra12:09
lazy_princeHi all.. I see that couple of tasks are still stuck over 20hrs.. is there any problem with Zuul..?12:12
*** gokrokve has joined #openstack-infra12:12
*** AJaeger has quit IRC12:12
*** gokrokve has quit IRC12:17
hasharlazy_prince: I have no clue but potentially you could retrigger the openstack-infra/config check change https://review.openstack.org/8238412:20
hasharby commenting "recheck no bug"12:20
hasharthat might reenqueue it12:20
hasharand thus discard the stuck change12:20
hasharfor the two tripleo changes I have no idea. The same trick might work as well or the job might depends on tripleo instances or something12:20
*** prad has joined #openstack-infra12:22
*** mbacchi has joined #openstack-infra12:24
lazy_princeWell.. I could see that other tasks are getting executed.. but there are couple of them that are queued but not yet executed. I will retrigger the checks again to see if it helps.12:24
lazy_princeI checked and seems like someone already added recheck no bug and it is still in the queue..12:25
*** AJaeger has joined #openstack-infra12:31
*** rlandy has joined #openstack-infra12:31
*** prad has quit IRC12:31
*** marcoemorais has joined #openstack-infra12:37
*** dizquierdo has quit IRC12:39
SergeyLukjanovlazy_prince, if recheck no bug doesn't help, try to push new patch set12:39
sdaguelazy_prince: you have to push a new patch set12:41
sdaguethere was a zuul issue yesterday where it lost track of some changes12:41
*** nosnos has quit IRC12:42
*** marcoemorais has quit IRC12:42
*** waterkinfe has quit IRC12:45
openstackgerritDavid Caro proposed a change to openstack-infra/jenkins-job-builder: Added parallelization options  https://review.openstack.org/7551412:46
sdagueoh, damn, we passed 90k12:47
sdaguehttps://review.openstack.org/#/c/9000012:48
*** lukego has joined #openstack-infra12:50
*** ildikov has quit IRC12:50
*** ildikov has joined #openstack-infra12:51
*** mark0n has joined #openstack-infra12:52
*** weshay has joined #openstack-infra12:52
SergeyLukjanovsdague, yeah, 100k is coming12:56
*** ildikov has quit IRC12:56
*** liam__ has joined #openstack-infra12:57
sdague43 days since 80k12:57
sdagueIIRC that's about the same window as 70k -> 80k12:58
*** NobodyCam has joined #openstack-infra12:58
sdagueso ~ June 6th12:58
sdague+/- a couple of days12:58
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard-webclient: TimeLine events support  https://review.openstack.org/8840512:59
*** skolekonov has quit IRC13:00
*** alexpilotti has joined #openstack-infra13:01
*** zehicle_at_dell has joined #openstack-infra13:02
*** signed8bit has joined #openstack-infra13:02
lazy_princesdague: SergeyLukjanov: Thanks. I will push a new change soon. but what will happen to the check thats running right now..13:05
lazy_princewill it get cancelled once new change is pushed..?13:06
SergeyLukjanovlazy_prince, I'll be canceled because of new patch set13:06
lazy_princeokay..13:06
*** ildikov has joined #openstack-infra13:06
mark0nJenkins Job Builder: It seems like "python setup.py install" does not install pbr automatically - the README doesn't mention this dependency but when I run JJB it fails with "pkg_resources.DistributionNotFound: pbr>=0.5.21,<1.0". When I run "easyinstall pbr" I think if the installer cannot install this automatically this additional step should be documented.13:07
*** Clabbe has quit IRC13:08
*** yfried has quit IRC13:09
*** gokrokve has joined #openstack-infra13:13
*** coolsvap is now known as coolsvap|afk13:13
*** jhesketh has quit IRC13:13
openstackgerritDavid Caro proposed a change to openstack-infra/jenkins-job-builder: Added recursive option  https://review.openstack.org/8510613:13
*** coolsvap|afk is now known as coolsvap13:13
*** bknudson has quit IRC13:14
phschwartzmorning infra13:14
*** dprince has joined #openstack-infra13:15
*** signed8b_ has joined #openstack-infra13:15
*** AJaeger has quit IRC13:16
*** mriedem has joined #openstack-infra13:17
*** AJaeger has joined #openstack-infra13:17
*** gokrokve has quit IRC13:17
*** signed8bit has quit IRC13:18
*** markmcclain has joined #openstack-infra13:19
*** julim has joined #openstack-infra13:20
*** markmcclain has quit IRC13:20
anteayamorning phschwartz13:22
*** yaguang has quit IRC13:25
*** jhesketh has joined #openstack-infra13:25
*** Clabbe has joined #openstack-infra13:30
*** changbl has quit IRC13:31
*** dkranz has joined #openstack-infra13:32
*** smarcet has joined #openstack-infra13:35
*** lazy_prince has quit IRC13:35
*** zehicle_at_dell has quit IRC13:36
anteayamark0n: I agree, would you like to document it?13:37
anteayahttp://git.openstack.org/cgit/openstack-infra/jenkins-job-builder/tree/README.rst13:38
*** marcoemorais has joined #openstack-infra13:38
*** marun has joined #openstack-infra13:39
anteayareed I do not know where the skin of wiki.o.o lives13:41
*** bknudson has joined #openstack-infra13:41
reedanteaya, thanks... Ryan_Lane should know13:41
*** yolanda has joined #openstack-infra13:42
*** marcoemorais has quit IRC13:42
*** doug-fish has joined #openstack-infra13:43
*** _nadya_ has joined #openstack-infra13:45
*** _nadya_ has quit IRC13:45
*** _nadya_ has joined #openstack-infra13:45
*** jaypipes has joined #openstack-infra13:46
*** devoid has joined #openstack-infra13:46
*** zns has joined #openstack-infra13:48
*** zns has quit IRC13:48
*** zns has joined #openstack-infra13:48
anteayareed: yes, he probably will13:48
*** zns has quit IRC13:51
*** thomasem has joined #openstack-infra13:51
*** zns has joined #openstack-infra13:54
*** markwash has joined #openstack-infra13:55
*** zhiyan_ is now known as zhiyan13:55
*** coolsvap is now known as coolsvap|afk13:57
*** unicell has quit IRC13:58
*** che-arne has joined #openstack-infra13:58
openstackgerritMarc Abramowitz proposed a change to openstack-infra/jenkins-job-builder: Refactor the `matches` function  https://review.openstack.org/8867814:01
*** gokrokve has joined #openstack-infra14:01
*** zns has quit IRC14:03
*** homeless has joined #openstack-infra14:03
*** zz_gondoi is now known as gondoi14:03
*** zns has joined #openstack-infra14:07
*** prad has joined #openstack-infra14:14
*** thedodd has joined #openstack-infra14:15
*** wchrisj has joined #openstack-infra14:16
*** wchrisj has left #openstack-infra14:16
openstackgerritMartin Konrad proposed a change to openstack-infra/jenkins-job-builder: Document installation of PBR library  https://review.openstack.org/9009214:17
mark0nanteaya: done14:18
openstackgerritJoão Vale proposed a change to openstack-infra/jenkins-job-builder: Allow using template variables in "defaults" field.  https://review.openstack.org/8533614:19
anteayamark0n: thank you14:23
*** atiwari has joined #openstack-infra14:24
*** rcarrill` has joined #openstack-infra14:25
openstackgerritVladislav Kuzmin proposed a change to openstack-infra/nodepool: Add layer for work with KVM/QEMU hosts  https://review.openstack.org/8855414:26
*** devoid has quit IRC14:26
*** rcarrillocruz has quit IRC14:27
*** signed8b_ is now known as signed8bit14:27
*** markmcclain has joined #openstack-infra14:28
*** UtahDave has joined #openstack-infra14:28
*** mwagner_lap has quit IRC14:30
openstackgerritVictor Sergeyev proposed a change to openstack-infra/config: Import oslo.db repository  https://review.openstack.org/7895514:31
*** adalbas has quit IRC14:32
*** UtahDave has quit IRC14:36
*** marcoemorais has joined #openstack-infra14:39
derekhhi, would anybody mind taking a look at https://review.openstack.org/#/c/86842/  I think I've rebased it correctly this time14:39
*** UtahDave has joined #openstack-infra14:40
*** marcoemorais has quit IRC14:43
*** adalbas has joined #openstack-infra14:44
SergeyLukjanovderekh, hey, it already have 2 x +2, so, it's waiting for someone to babysitting14:45
openstackgerritafazekas proposed a change to openstack-infra/elastic-recheck: Cirros boot failed  https://review.openstack.org/9010014:45
derekhSergeyLukjanov:  ahh ok, it just got the second one there, thanks14:46
anteayaokay so I am clicking around on review-dev and currently when I try to open any patch via the GUI I am told I don't have access: https://review-dev.openstack.org/#/q/status:open,n,z14:47
anteayaI am trying to distill the goodness sweston has offered in this etherpad: https://etherpad.openstack.org/p/ai9irqk3FC14:48
jeblairoops; i'll check and see if the apache config was messed up again14:49
*** hashar has quit IRC14:49
pleia2good morning14:49
*** pmathews has joined #openstack-infra14:49
jeblairpleia2: good morning14:50
anteayajeblair: thanks and good morning14:51
anteayapleia2: and good morning to you too14:51
*** pcrews has joined #openstack-infra14:51
Longgeek_I want to cry.14:53
jeblairah this is the problem: https://review.openstack.org/#/c/6089314:53
Longgeek_https://bugs.launchpad.net/openstack-ci/+bug/130696714:53
jeblairit's based on a WIP change14:53
uvirtbotLaunchpad bug 1306967 in openstack-ci "thstack-ci service account" [Undecided,New]14:53
pleia2Longgeek_: usually fungi is the one who handles those and he's on vacation, hopefully someone else will get to it soon, sorry for the delay14:54
*** mrmartin_ has quit IRC14:54
*** aglarendil|nb has joined #openstack-infra14:54
anteayapleia2 Longgeek_ clarkb is aware and it is on his list14:54
pleia2anteaya: thanks :)14:54
anteayaLonggeek_: I will attract your attention to my comments14:55
anteayaI have a concern about the name that will appear in the comments14:55
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Gerrit-2.8: Allow encoded path separators in URLs  https://review.openstack.org/6089314:55
pleia2anteaya: well it's the company name..14:55
pleia2seems a bit hard to get around that14:55
anteayawhen I see thstack it looks too much like thestack, which I wonder if others will think is our system14:55
pleia2and fwiw, I don't make that connection14:56
anteayaI just want to ensure new devs aren't confused about what set of tests they reference14:56
Longgeek_thestack is openstack system?14:56
anteayait is possible it is just me14:56
anteayaLonggeek_: it doesn't take much to confuse new developers14:57
anteayaand they don't tend to ask questions14:57
anteayathey just operate on incorrect information and get frustrated14:57
anteayathen the post blogs about their frustration14:57
AJaeger;(14:57
anteayaexactly14:57
anteayaperhaps it is just me14:57
Longgeek_"ThStack" is our company name, and we design 'Th' as the prefix to connect 'Stack' to show we based on OpenStack. It's really different between 'Th' and 'The', we want to express "Think" not "The", it's used to show our brief about cloud and OpenStack contribution, unfortunately we can't apply 'thinkstack.com' as our domain name, so 'th' is a good choice. thanks14:58
*** mfer has joined #openstack-infra14:58
Longgeek_I believe you can see our email address14:58
anteayaI'm not finding fault with your company name14:58
anteayaor why you chose it14:58
anteayajust trying to think like a new developer14:59
AJaegeranteaya, you have a good point. The question is how to avoid this confusion.15:00
*** markwash has quit IRC15:00
anteayaright15:00
anteayawhich includes many options15:00
AJaegerLonggeek_, www.thstack.com does not exist as webpage15:00
anteayaone of which is renaming our system from Jenkins to something taht is more obvious to new developers15:00
*** pmathews has quit IRC15:00
AJaeger"OpenStack official CI" ;)15:01
anteayaor just OpenStack15:01
anteayabut yes, something along those lines15:01
anteayaSteve I think was an option at one point15:01
anteaya:D15:01
Longgeek_Our site has not yet developed, still in the design phase. The company was founded less than a month.15:01
anteayaLonggeek_: I am not finding fault with your company or any of your naming choices15:02
*** pmathews has joined #openstack-infra15:02
anteayasince we have so many 3rd party testing accounts, we need to help developers sort though the comments15:02
*** sweston has joined #openstack-infra15:02
Longgeek_How to solve that problem?15:02
jeblairanteaya: theirs is no more confusing than any of the other 40 account names15:03
*** dims has quit IRC15:03
*** wenlock has joined #openstack-infra15:03
anteayajeblair: okay, I seem to be the only one15:03
anteayawhich is great, it is easy to solve my problem15:03
anteayaLonggeek_: yes, it is a new problem since we have so many accounts now15:04
*** chandan_kumar has joined #openstack-infra15:04
anteayait will come up at the summit, I am sure15:04
jeblairit's scheduled15:04
anteayayay15:04
anteayathank you jeblair15:04
Longgeek_I do not want to wait until the end of the summit, right?15:05
*** dims has joined #openstack-infra15:05
krtayloryes, glad it is scheduled, saw that!15:05
jeblairLonggeek_: no, someone will make the account soon15:06
krtaylorI'll add descriptive naming to the etherpad I'm keeping15:06
fifieldtfyi launchpad looks like it's having problems15:07
* fifieldt just saw a launchpad an error he'd never seen before!15:07
Longgeek_ok, thank you15:08
*** rediskin has joined #openstack-infra15:10
*** ihrachyshka has quit IRC15:10
anteayafifieldt: thanks, comcast subscribers were having lp issues the other day15:10
anteayafifieldt: you aren't using comcast are you?15:10
fifieldterm15:11
fifieldtI don't think comcast coverage reaches this far west :)15:11
pleia2fifieldt: I'm having trouble with other bits of the canonical-run infrastructure as well, all seems slow today15:11
fifieldtyeah, I saw a maint page with their IRC channel name on it15:11
fifieldtwhich was odd :)15:11
pleia2yeah, I saw that yesterday while trying to file a bug15:12
*** pmathews has quit IRC15:12
*** pmathews has joined #openstack-infra15:12
fifieldtanteaya, my provider is "中華電信“15:12
AJaegerfifieldt, how do I pronounce that one? ;(15:13
anteayafifieldt: so not comcast15:13
fifieldt Zhōnghuá Diànxìn :)15:13
fifieldtaka ChungHwa Telecom15:13
fifieldtanyway, just wanted to report in :)15:14
krtaylorls15:14
anteayasweston: I am selecting picking from your work on this etherpad: https://etherpad.openstack.org/p/ai9irqk3FC15:14
anteayafifieldt: thank you15:14
openstackgerritA change was merged to openstack-infra/config: Gerrit-2.8: Allow encoded path separators in URLs  https://review.openstack.org/6089315:15
*** zns has quit IRC15:15
*** coolsvap|afk is now known as coolsvap15:15
*** aglarendil|nb has left #openstack-infra15:16
swestonanteaya: in a meeting at the moment, may I get back to you?15:16
*** david-lyle has joined #openstack-infra15:16
*** chandan_kumar has quit IRC15:16
anteayasweston: of course15:17
*** mrodden has joined #openstack-infra15:17
openstackgerritMarc Abramowitz proposed a change to stackforge/python-jenkins: Add tests, make it work on Python 3  https://review.openstack.org/9011415:18
mordredmorning all15:19
*** afazekas has quit IRC15:21
ttxmorn15:21
rediskinjeblair fungi sdague mordred im really looking forward to +A this tiny patch @_@ https://review.openstack.org/#/c/89562/15:21
anteayamorning mordred15:22
rediskinto finally can see fancy html charts15:22
*** msabramo has joined #openstack-infra15:23
*** rcarrill` is now known as rcarrillocruz15:25
* anteaya assumes jeblair is still figuring out apache config for review-dev, since she can't yet see the patch review view15:25
*** markmc has quit IRC15:25
jeblairanteaya: i linked to the patch earlier that fixes it.  it's in the process of merging.15:25
devanandais there a guideline for what kinds of external libs should be in requirements, compared to optional / third-party things that shouldn't be, and how to test those?15:25
devanandag'morning, mordred15:25
anteayajeblair: ah okay, I misunderstood, thank you15:25
msabramojeblair: Jenkins jobs for python-jenkins will go live tomorrow (Friday)?15:26
devanandaanteaya: my neutron question to you yesterday is: does it support other dhcp providers (besides dnsmasq)?15:26
msabramojeblair: I was able to submit a review (https://review.openstack.org/90114) but it fired off a "noop"15:26
anteayajeblair: you removed the wip dependency?15:26
jeblairmsabramo: no, creating projects was the only thing we were doing weekly; changes to jobs will happen as people approve changes15:27
*** mburned is now known as mburned_out15:27
jeblairmsabramo: there might be a bit of a delay with that because we are short-staffed and those of us that are here are largely focusing on the gerrit upgrade15:27
msabramojeblair: Ah okday15:27
msabramookay15:27
anteayadevananda: ah that would be a neutron code question, which I am embarrassed to say I never figured out15:28
anteayadevananda: so I do not know the answer to that question15:28
anteaya:(15:28
devanandaanteaya: ah, np. i thought there might be some community knowledge there too.15:29
anteayaright, reasonable assumption15:29
anteayaI'm empty15:29
*** maxbit has quit IRC15:30
jeblairmordred, clarkb: so i'm wondering if we shouldn't actually put the jeepyb cache and local git mirror in /opt, since they are both recreatable?  (i mean, actually var is a great place for them, aside from the disk space problem)15:32
jeblairmordred, clarkb: and /opt seems to be our "place to put things that take up a lot of space but we don't care about preserving"15:33
jeblairsince it's where we typically mount the ephemeral disks15:33
mordredjeblair: sounds great to me15:34
*** mburned_out is now known as mburned15:34
mordredit also has the benefit of being locally attached and therefor probably quicker15:34
*** Longgeek_ has quit IRC15:34
mordredso for the apache git mirror, you know, no backend iscsi hop15:34
*** devoid has joined #openstack-infra15:35
anteayaso puppetdb report times? browser default time? http://puppetdb.openstack.org/report/review-dev.openstack.org/8715afee9349ca94963f4666e336456d58904c7015:35
jeblairmordred: are you sure ephemeral disks are local?15:35
jeblairanteaya: i believe so; i think i opened an issue about that15:35
mordredjeblair: I _believe_ so - I believe that's why they are considered 'ephemeral'15:35
anteayajeblair: k, thanks15:35
mordredjeblair: but I'm frequently wrong15:36
jeblairmordred: yeah, though the system disk is presumably local and is not15:36
jeblairbut then again, maybe neither of them are15:36
*** changbl has joined #openstack-infra15:36
mordredjogo, sdague ^^ ?15:36
jeblairi think someone at rax would be the right person to answer that :)15:37
sdaguethey should be local, unless your cloud provider did something crazy with nova15:37
*** mwagner_lap has joined #openstack-infra15:38
anteayajeblair: I don't see a bug about it: http://bit.ly/1iiFD6G15:38
*** msabramo has quit IRC15:38
mordredBWAHAHAHAHAHAAHHAAH15:38
jeblairi'm not at all sure why nova should care _where_ the disks backing the storage it uses are :)15:38
anteayaI can file unless I missed it15:38
mordredI spent an hour trying to figure out why a script in my dib elements wasn't being run15:38
*** yfried has joined #openstack-infra15:38
mordredit's quite simply because I did not actually reference the element anywhere15:38
jeblairanteaya: it's not our bug, it's puppetboard's15:38
anteayaah15:38
mordredit had nothign to do with naming or sequencing or me misunderstanding the system15:39
*** rediskin has left #openstack-infra15:39
*** adarazs has quit IRC15:40
anteayajeblair: found it: https://github.com/nedap/puppetboard/issues/6315:40
*** adarazs has joined #openstack-infra15:41
anteayayay, I can see patches in review-dev again15:41
*** mrmartin has joined #openstack-infra15:41
anteayahow do I override "server certificate verification failed" to clone from review-dev? http://paste.openstack.org/show/76962/15:44
*** msabramo has joined #openstack-infra15:45
*** ominakov has quit IRC15:49
mordredanteaya: there is a git setting ...15:50
mordredanteaya: although you can also just clone with ssh15:50
anteayamordred: yes, trying to remember where I put the clone over ssh command15:51
anteayaI will find it15:51
*** markmcclain has quit IRC15:53
*** MarkAtwood has joined #openstack-infra15:54
anteayahow long after I add a new ssh public key to review-dev before it sees it?15:55
mordredshould be immediate15:55
*** ihrachyshka has joined #openstack-infra15:56
*** pmathews1 has joined #openstack-infra15:56
anteayaor do I not have access to stream-events, ls-projects or show-queue?15:56
anteayaI remember I don't have access to stream-events now15:56
anteayaas a registered user15:56
anteayaare the others verboten to registered users as well?15:57
*** zns has joined #openstack-infra15:57
*** pmathews has quit IRC15:57
*** melwitt has joined #openstack-infra15:58
*** jlibosva has quit IRC15:58
mordrednot sure ...15:59
anteayak15:59
anteayait might just be me15:59
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Make gerrit git replica and jeepyb paths configurable  https://review.openstack.org/9012816:00
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Move local git replica on review to /opt  https://review.openstack.org/9012916:00
jeblairi believe we need to grant access to stream-events16:00
jeblairanteaya: try now16:01
jeblairmordred, clarkb: would you please review https://review.openstack.org/90128 ?  (and https://review.openstack.org/90129 though less important)16:02
*** dangers_away has quit IRC16:02
*** gothicmindfood has joined #openstack-infra16:02
*** ihrachyshka has quit IRC16:02
*** dims has quit IRC16:03
mordredjeblair: on it16:03
*** dangers_away has joined #openstack-infra16:03
*** ihrachyshka has joined #openstack-infra16:03
*** jlibosva has joined #openstack-infra16:04
*** sweston has quit IRC16:05
*** dims has joined #openstack-infra16:06
*** krtaylor has quit IRC16:08
anteayaanita@anita-hp:~$ ssh -p 29418 anteaya@review-dev.openstack.org gerrit stream-events16:09
anteayaPermission denied (publickey).16:09
anteaya:(16:09
jeblairanteaya: that's more likely to be related to having the right public key configured than gerrit permissions16:09
jeblairanteaya: does "ls-projects" work?16:09
anteayaI did cat .ssh/id_rsa.pub and copied the output from my terminal and pasted16:10
*** tru_tru has quit IRC16:10
anteayalike I have done before16:10
anteayals-projects and show-queue give me the same response16:10
anteayapermission denied (publickey)16:10
*** tru_tru has joined #openstack-infra16:10
anteayaI will repaste my publickey16:10
anteayanope16:11
anteayano change16:11
*** hashar has joined #openstack-infra16:12
*** homeless has quit IRC16:12
jeblairanteaya: check your username16:12
anteayaah16:12
anteayathat be it16:12
anteayad'oh16:12
*** imcsk8 has quit IRC16:13
anteayausername, I am still akuno to review-dev16:13
*** jaypipes has quit IRC16:13
*** imcsk8 has joined #openstack-infra16:13
*** homeless has joined #openstack-infra16:14
*** _afazekas_away is now known as afazekas16:14
*** marcoemorais has joined #openstack-infra16:17
*** dims has quit IRC16:17
*** dims has joined #openstack-infra16:17
*** zns has quit IRC16:18
*** pmathews1 has quit IRC16:18
*** pblaho has quit IRC16:19
jeblairI've pasted the ssh host key warning that people will get into the etherpad at https://etherpad.openstack.org/p/ai9irqk3FC16:19
*** pmathews has joined #openstack-infra16:19
jeblairalong with the command that people should use in order to resolve the error16:20
clarkb++ to /opt for jeepyb and mirror16:21
clarkbI'm reviewing puppet change now16:21
openstackgerritA change was merged to openstack/requirements: Add PyECLib as a requirement  https://review.openstack.org/7606816:24
*** chandan_kumar has joined #openstack-infra16:25
*** jgallard has quit IRC16:25
anteayajeblair: great thanks16:26
*** gyee has joined #openstack-infra16:26
*** lakshmi has joined #openstack-infra16:27
zaromonring16:28
*** talluri has quit IRC16:31
clarkbdevananda requirements should contain compatibly licensed packages that are actively supported with support for python 2 and 316:31
zarofooy, i can't rax slave.  thinking about turning off gerrit tests16:31
*** mburned is now known as mburned_out16:31
clarkbnot everything meets that criteria because a lot of stuff was grandfathered in. but additions will hopefully be able to do that16:32
devanandaclarkb: "actively supported" -- how does that apply to vendor published libraries?16:32
jeblairclarkb, devananda: https://wiki.openstack.org/wiki/Requirements16:32
*** zns has joined #openstack-infra16:32
*** gokrokve_ has joined #openstack-infra16:32
anteayamorning zaro16:32
*** zehicle_at_dell has joined #openstack-infra16:33
mordredjeblair: +2 - you wanna land it?16:33
devanandajeblair: heh, nice. python-seamicroclient is the reason i'm asking, but i'm sure it'll come up for other libs16:33
anteayajeblair: I blended in the instructions for the ssh host key change16:33
jeblairmordred: thx done16:33
anteayaedits welcome16:33
* anteaya goes to eat some lunch16:33
clarkbdevananda well are they licensed compatibly? if so they should be open source. you can see what their dev is like16:34
clarkblooks like apache2 hosted on github16:35
*** mburned_out is now known as mburned16:35
devanandaclarkb: yes16:35
zaroanybody willing to review https://review.openstack.org/#/c/88026 ?  would like to get that in and tested before gerrit upgrade.16:35
clarkbwith no issues or pull requests but last commit is from 4 days ago16:36
devanandaclarkb: is "apache2 and on github" enough to be added to global req's, and tested in ironic's gate? that seems iffy to me16:36
*** gokrokve has quit IRC16:36
clarkbno see my other criteria :)16:37
*** liam__ has joined #openstack-infra16:37
*** Ryan_Lane has quit IRC16:37
clarkbbut its certainly a step in the right direction16:37
devanandaclarkb: put another way - gate runs unit and functional tests, but we can't run functional tests of a third-party driver that requires special hardware16:38
*** liam__ has quit IRC16:38
openstackgerritA change was merged to openstack-infra/config: Make gerrit git replica and jeepyb paths configurable  https://review.openstack.org/9012816:39
clarkbright Iam not sure where the gate got involved16:39
devanandaclarkb: if the library isn't in global-req's, we can't run those unit tests in the gate. if it is, we can.16:40
clarkbopenstack/requirements is a list of dependencies. it helps keep all projects in syncon common depsand makes it easier to know what needs packaging16:40
devanandaclarkb: but fast-forward to when ironic graduates, now all projects are gated on eg. python-seamicroclient.16:40
clarkbsure but you cant run those tests regardless16:40
clarkbso its not worth worrying about from a gate perspective16:41
devanandawhy can't we run those unit tests?16:43
*** jlibosva has quit IRC16:43
clarkbno no you said functional tests with special hardware16:43
devanandaright16:43
devanandai mean, we can run the unit tests IFF that lib is in global requiremetns. but should we do that, considering that we /cant/ run the functional tests16:43
clarkbI think those unittests belong in python seamicroclient16:44
clarkbironic doesnt unittest external libs16:44
devanandaclarkb: i maen, run ironic's unit tests for the driver that uses said external lib16:45
*** zns has quit IRC16:45
mordredright. you need the lib to be in global reqs if ironic needs the lib for ironic's unittests16:45
devanandaclarkb: http://git.openstack.org/cgit/openstack/ironic/tree/ironic/drivers/modules/seamicro.py16:45
*** zns has joined #openstack-infra16:46
clarkbwhat do you need the lib for if you dont have hardware?16:46
*** marun_ has joined #openstack-infra16:46
clarkbI think we are using "unittest" very liberally here16:46
*** marun has quit IRC16:47
*** marun_ is now known as marun16:47
devanandaclarkb: ah16:47
clarkbany test that needs aspecial lib to talk to special hardware is a functional test16:48
devanandaclarkb: the driver could be unit tested without the lib by mocking it, yes16:49
clarkbright16:49
devanandaclarkb: so i think my question is answered -- third-party drivers that can't be functionally tested in the gate should not have their external dependencies added to requirements, and unit tests just need to mock them16:50
*** hashar has quit IRC16:50
devanandathanks16:50
*** dkliban is now known as dkliban_afk16:50
*** harlowja_away is now known as harlowja16:51
*** _nadya_ has quit IRC16:52
*** lakshmi has quit IRC16:52
*** LarsN has joined #openstack-infra16:53
*** shardy is now known as shardy_afk16:57
*** jpich has quit IRC16:58
*** jpeeler has quit IRC16:58
*** jpeeler has joined #openstack-infra16:59
*** jpeeler has quit IRC16:59
*** jpeeler has joined #openstack-infra16:59
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Gerrit: Ensure /opt/lib exists if used  https://review.openstack.org/9014716:59
jeblairclarkb, mordred: ^ minor tested fix to previous patch16:59
clarkbjeblair: can you just do if not defined File[$replicate_path] then file { $replicate_path: ensure => directory }17:00
*** zns has quit IRC17:01
*** signed8bit has quit IRC17:01
jeblairclarkb: hrm, i was responding to this error:17:01
*** sweston has joined #openstack-infra17:01
jeblairerr: /Stage[main]/Openstack_project::Gerrit/File[/opt/lib/git]/ensure: change from absent to directory failed: Cannot create /opt/lib/git; parent directory /opt/lib does not exist17:01
*** e0ne has quit IRC17:01
clarkboh I see, this is a problem with the root of the path17:01
clarkband puppet doesn't mkdir -p17:02
clarkbthat change is a bit hacky but I can't come up with anything better right now +217:02
mordred+@17:02
mordred+217:02
clarkbI approved since mordred got the first +217:03
jeblairclarkb: i'd love to see the correct and elegant way to do that in puppet17:03
*** zhiyan is now known as zhiyan_17:03
*** darraghb has quit IRC17:04
clarkbme too. I'm guessing it involves a git repo class that sorts out the recursive path stuff for you17:04
*** thedodd has quit IRC17:04
jeblairit's also a little weird because we ensure that local_git_dir is created in openstack_project::gerrit17:04
mordredexec { 'make dir': command => "mkdir -p $path", creates => $path }17:05
jeblairi'm not sure why the idea of local replication is split across those two modules17:05
*** signed8bit has joined #openstack-infra17:05
*** signed8bit has quit IRC17:05
mordredjeblair: ++ should probably be consolidated17:05
jeblairmordred: so you think that exec should replace the existing File['/opt/lib/git']?17:05
*** thedodd has joined #openstack-infra17:06
*** signed8bit has joined #openstack-infra17:06
*** sweston has quit IRC17:06
jeblairmordred: but then you'd have to "requires => Exec['make dir']", yeah?17:06
*** SumitNaiksatam has quit IRC17:06
mordredyeah17:07
mordredit's not really good17:07
mordredwe could make a Path type that does that - but then we're going way over the top17:07
clarkbhttp://www.puppetcookbook.com/posts/creating-a-directory-tree.html17:07
clarkbapparently you pass an array of dirs17:07
jeblairclarkb: i don't think that actually solves the problem17:08
*** coolsvap is now known as coolsvap|afk17:08
jeblairclarkb: our target directory is a variable17:08
clarkbjeblair: right so anytime your target dir changes your array variable needs updating17:08
jeblairwe can't set it to be an array and then go and use it in templates17:08
*** gokrokve_ has quit IRC17:08
clarkbthis doesn't work well with the templates17:08
clarkbya17:08
jeblairperhaps what we should actually do is not give the value a default17:09
jeblairand have the api for the gerrit module be "the caller ensures the directory is created"17:09
clarkbwfm17:09
mordred++17:10
mordredand also, we should bitch that puppet doesn't have a mkdir -p17:11
* jeblair glares at puppet17:11
*** msabramo1 has joined #openstack-infra17:12
*** morganfainberg_Z is now known as morganfainberg17:12
clarkbNobodyCam: have you been able to confirm that ironic is happy on the tripleo ci images now?17:13
*** msabramo has quit IRC17:13
NobodyCamclarkb: ironic is not happy.. the the changes are in the nodes now... Ty17:13
*** derekh has quit IRC17:15
openstackgerritKhai Do proposed a change to openstack-infra/config: temporary disable gerrit tests  https://review.openstack.org/9015417:16
zarojeblair: ^ need your help to get the gerrit patches in.17:17
*** Ajaeger1 has joined #openstack-infra17:17
*** ildikov has quit IRC17:18
*** chandan_kumar has quit IRC17:19
*** chandan_kumar has joined #openstack-infra17:19
*** doug-fish1 has joined #openstack-infra17:20
devanandaclarkb, jeblair: should "can be functionally tested upstream" be added to the requirements guidelines?17:20
anteayaclarkb: when you have a chance, how do we access the important changes custom dashboard you created? https://etherpad.openstack.org/p/ai9irqk3FC17:20
clarkbdevananda: I am not entirely sure it is that black and white in all cases17:20
clarkbdevananda: thinking of test libs themselves and so on17:20
*** SumitNaiksatam has joined #openstack-infra17:20
devanandaclarkb: i'm looking at some other requirements entries like hp3parclient17:21
*** zns has joined #openstack-infra17:21
*** doug-fish has quit IRC17:21
devanandaif none of the tests in the gate exercise a requirement, how do we know it actually works, and if we can't know that, why is it required?17:22
clarkbdevananda: fwiw I was trying to decouple gating from requirements :) I don't think we gate on it but I can see the lib being in requirements anyways17:22
openstackgerritMarton Kiss proposed a change to openstack-infra/config: Create groups-static-pages project  https://review.openstack.org/8973417:22
jeblairzaro: wfm17:22
clarkbdevananda: the requirements repo itself should document why it is required17:22
jeblairclarkb, mordred: can you review/aprv https://review.openstack.org/90154  for zaro?17:23
anteayaclarkb: thank you17:23
clarkbjeblair: sure17:23
*** maxbit has joined #openstack-infra17:23
clarkbjeblair: zaro done17:24
devanandaclarkb: eg, http://git.openstack.org/cgit/openstack/requirements/commit/?id=669056d88937a8c629020ee1b89602843cb6f0c417:24
clarkbdevananda: yes. I have been pushing pretty hard when I review requirements that people properly document stuff in the commits themselves17:25
clarkbdevananda: it is really important for figuring out if a thing should be removed or if an alternative might be better17:25
*** Ryan_Lane has joined #openstack-infra17:25
*** talluri has joined #openstack-infra17:25
devanandaclarkb: i dont feel that i have a good understanding of when vendor libraries for vendor drivers should be added to requirements or not17:25
mordredWOOT17:26
mordredfinally got puppet running in the dib17:26
clarkbdevananda: I think we need to reframe why requirements exists for you17:26
devanandaclarkb: there are at least three for ironic that I expect to have to address during Juno: seamicro, ilo, and pyghmi17:26
mordred(foudn why it wasnt' working before- I now expect a 95% functional thing in maybe 2-3 ish more hours)17:26
devanandaand others which are being discussed but for which there's no code yet17:26
clarkbdevananda: it isn't related to gating (well it actually is but only for sanity not as a goal)17:26
clarkbit exists so that projects will use acommon set of tools17:27
devanandaright17:27
clarkbon a common set of versions17:27
devanandathat makes all kinds of sense for common requirements :)17:27
clarkbso that we stop having incompatible deps across openstack (which was a huge problem prior to the reqs repo)17:27
devanandait doesn't seem to make sense for external libs only needed by one project17:27
clarkbbut also so that we can avoid having 4 libs that do the same thing17:27
devanandaeg, ironic or cinder needing specific bindings for specific hardware17:27
*** thedodd has quit IRC17:28
clarkbdevananda: where it does begin to make sense is when you consider the distros17:28
clarkbthey can refer to requirements as the source of truth for all the things you might want to package for openstack17:28
mordredright. and for the most part, those are considered depllioy time reqs and aren't listed in requirements.txt17:28
devanandamordred: right. and at least for ironic, it's not the default17:28
mordredbecause a person installing ironic and using ipmi probably doesn't also need to install the seamicro lib17:28
devanandaexactly17:28
mordred++17:28
clarkbthats fine17:28
clarkbthat doesn't mean you exclude it from the requirements file though17:29
clarkbbecause you do that then ubuntu doesn't package pyghmi for you17:29
clarkband now all the people deploying ironic have to figure that out17:29
clarkb*all the people using pyghmi17:29
zarocan anyone tell me why the name-filter: 'Performance' is only applied to rax VMs?17:29
devanandapyghmi may be a bit of a special case -- i'd like it to replace ipmitool17:29
devanandaclarkb: but the same argument applies to python-seamicroclient17:29
clarkbzaro: because rax has performance flavors and regular flavors17:30
openstackgerritRoger Luethi proposed a change to openstack-infra/git-review: Obey --version outside of git tree  https://review.openstack.org/9016017:30
devanandaand hp3parclient17:30
clarkbzaro: but none of the other clouds do17:30
clarkbdevananda: yup, I think they go in the requirements file17:30
devanandaclarkb: but there are a host of other deploy time requirements tha tdeplpoyers need to figure out17:30
zaroso what's the difference between prformance vs regular?17:30
devanandaclarkb: like tftpd17:30
clarkbI don't think you gate on seamicro though17:30
clarkbzaro: it depends on the particular flavor but in general you get more cpu cycles and less diskj17:30
devanandaclarkb: then the entry in requirements is meaningless IMO because it's never tested17:31
*** gyee has quit IRC17:31
clarkbdevananda: no go back to what I was saying before17:31
clarkbforget the gate completely17:31
devanandaclarkb: i get the packaging impact17:31
clarkbthis is a packaging thing17:31
devanandaclarkb: but why tell packages to package a thing that we have no idea whether it works?17:31
devanandas/taht/when/17:31
clarkbbecause if ironic hides their use of seamicro from everyone a year from now cinder will use a different seamicro lib17:31
clarkbdevananda: that is where third party testing comes in17:32
clarkbbut also ^17:32
mordreds/seamicro/wsgi/17:32
*** mrodden has quit IRC17:32
devanandamordred: wsgi we can test upstream17:32
clarkbyou don't want cinder and ironic and neutron to all end up in a place with vendor libs that they were in with all the other libs17:32
devanandamordred: seamicro we can't17:32
mordredand you have the problem ina nutshell17:32
openstackgerritA change was merged to openstack-infra/config: Gerrit: Ensure /opt/lib exists if used  https://review.openstack.org/9014717:32
clarkband you know what happens in this case? oslo.vmware17:33
mordredanybody seen this before:17:33
mordrederr: /Stage[main]/Openstack_project::Template/Service[rsyslog]: Could not evaluate: undefined method `[]' for nil:NilClass17:33
*** Ryan_Lane1 has joined #openstack-infra17:33
devanandaclarkb: fair 'nuf. /me updates requirements to indicate that it's there for packaging and not for testing17:34
mordredclarkb, jeblair ^^ I just saw that go by in running puppet for the slave dib - I wonder if it's happening all the time but we don't notice?17:34
devanandaclarkb: and that ironic doesn't actually import it :)17:34
clarkbI really don't want anymore oslo.$vendor libs17:34
clarkbdevananda: right note that it is an optional dependency for ironic to talk to seamicro nodes17:34
clarkband that seamicro nodes work fine with pyghmi or whatever17:34
clarkbhowever ^ raises a more interesting qusetion to me17:35
clarkbshould we completely avoid vendor specific libs in the first place and stick to standard tooling?17:35
jeblairmordred: you could check the nodepool image build logs17:35
mordredjeblair: k17:36
clarkbmordred: I don't think so, if puppet errors it should fail the image build17:36
mordredclarkb: that err did not cause puppet to return error17:36
clarkbeg the metadata things we see in hpcloud17:36
clarkbmordred: oh17:36
*** mrodden has joined #openstack-infra17:36
mordredbeacuse, you know, sometimes puppet does that for $reasons17:36
openstackgerritA change was merged to openstack-infra/config: temporary disable gerrit tests  https://review.openstack.org/9015417:36
*** thedodd has joined #openstack-infra17:37
devanandaclarkb: "should we completely avoid vendor specific libs" -- unless you're asking if opensatck should refrain from ever utilizing vendor-specific APIs, I'm not sure what you mean17:37
mordredclarkb: I think the no-vendor-libs approach would not ultimately be helpful in the goal of building an open cloud17:37
mordredclarkb: if you think of openstack as a datacenter os17:37
*** zehicle_at_dell has quit IRC17:37
*** Ryan_Lane1 has quit IRC17:38
clarkbmordred: maybe I should rephrase17:38
clarkbmordred: don't lock into specific libs when there are alternatives that work for all the things17:38
mordredthen sometimes you have hardware that you need to interact with via some drivers - but YOU want to just use openstack to manipulate it17:38
mordredclarkb: well sure, I think we do tend to prefer alternatives that work for all of the things17:38
clarkbif python seamicro does something that ironic can't do with ipmi it poses two problems. First the testing one. Second now you have no feature parity17:38
mordredbut hardware vendors kinda suck a lot - so the existence of such things is less common17:39
*** dkliban_afk is now known as dkliban17:39
mordredclarkb: what if python-seamicro lets you control hardware devices that don't have an IPMI interface17:39
mordredbut your ironic interace to that hardware is now the same?17:39
*** UtahDave has quit IRC17:39
mordredin essence, WE are becoming the thing that is the common thing that works with all of the things17:40
clarkbmordred: while I would like that to be the case history has shown we are completely incapable of doing that17:40
mordredclarkb: well, we can keep trying :)17:40
clarkbas soon as you use $other thing feature parity is thrown out the window17:40
devanandaclarkb: there are not alternatives that work for all things17:40
clarkbI have a summit session to hopeflly point a spotlight on this problem and get peopel to consider it seriously17:40
*** gokrokve has joined #openstack-infra17:40
devanandaclarkb: specifically, anything beyond IPMI 2.0 is not standardized _at_all_ -- but is really helpful and nearly everyone implements it17:40
devanandaclarkb: eg, mount virtual media17:41
*** mrodden1 has joined #openstack-infra17:41
clarkbbut I am skeptical that adding more non feature consist bits is a good thing17:41
mordred^^ ++17:41
devanandaclarkb: every hardware mgmt interface has it but it's not part of IPMI17:41
*** mrodden has quit IRC17:41
devanandaclarkb: and it's a planned component of secure boot, if ironic ever gets around to that17:41
clarkbdevananda: right so I am not speaknig as an expert17:41
clarkbmerely poitning out the myriad of issues we have in this space17:41
clarkbbceause no one does the thing mordred wants them to do17:41
devanandaclarkb: heh. well, i'm trying17:41
mordredyup. I will stick up for devananda here, because I know he's trying to have ironic do the right thing17:42
devanandamy goal with ironic is to drive the vendors towards feature parity for things which the common libraries DONT implement today17:42
mordred++17:42
devanandaso seamicro, ilo, etc -- they implement some of the same functions but their HW APIs are different17:43
clarkbya definitely not singling out ironic here17:43
*** _nadya_ has joined #openstack-infra17:43
clarkbor seamicro or 3par17:43
devanandabecause HW vendors dont like to agree17:43
devanandabut all their customers want the same things17:43
*** maxbit has quit IRC17:44
clarkband you'll note that I said add it to requirements :)17:44
devanandayep17:44
jeblairclarkb, mordred: does manage-projects run as root or gerrit2?17:44
clarkbI just find this massive feature matrix that we build for ourselves to be more interesting on a whole than should $individual lib be included17:45
clarkbjeblair: its run by puppet so root17:45
mordredjeblair: should runas gerrit217:45
*** krtaylor has joined #openstack-infra17:45
clarkbthe puppet exec could change uers but puppet makes that difficultish17:45
mordredoh.17:45
mordredhrm17:45
devanandaclarkb: im starting to feel your pain. there are some feature matrixes in ironic that are cropping up with the new agent17:45
clarkbanything relying on user env stuff will need to be very explicit17:45
clarkbeg where ssh keys are located and so on17:46
jeblairzaro: have you run manage-projects on review-dev recently?17:46
jeblairparamiko.BadHostKeyException: Host key for server localhost does not match!17:46
jeblairi get that error17:46
clarkbdefinitely doable though and ++ to having gerrit2 do it17:46
jeblairmordred: ^ ?17:46
mordredjeblair: zaro was having that problem on review-dev17:46
jeblairit was not a philosophical question.  :)17:46
mordredI know17:46
mordredoh. jeez.17:47
mordred17:46:22         jeblair | zaro: have you run manage-projects on review-dev recently?17:47
mordredthat's how much I suck17:47
*** lakshmi has joined #openstack-infra17:47
zarojeblair, mordred : i tried that yesterday but got an mismatched key error17:47
*** zns has quit IRC17:48
jeblairzaro: have you tested it against 2.8?17:48
zarowas going to try and update the project owner key and redo17:48
anteayaI am starting to become pleased with the information for developers regarding the Gerrit 2.8 upgrade found here: https://etherpad.openstack.org/p/ai9irqk3FC17:48
zarojeblair: i ran on review-dev.o.o17:48
anteayalooking for feedback17:48
zarojeblair: which is 2.817:48
anteayait is clear?17:48
jeblairzaro: yes, but did you run it and did it _work_?17:49
jeblairi'm wondering if someone did update the project owner key but didn't do it completely or correctly17:49
jeblair(for heartbleed)17:49
*** mburned is now known as mburned_out17:49
zarojeblair: no, failed with mismatched keys.  clarkb said i needed to update gerrit project creator key17:49
clarkbI thought it was because the key in gerrit's DB wasn't updated17:49
jeblairclarkb: yes, that makes sense17:50
clarkbbut the key on disk was. But I didn't actually check. that was just a hunch17:50
jeblairi will fix it17:50
*** nati_ueno has joined #openstack-infra17:52
*** mark0n has quit IRC17:52
*** mburned_out is now known as mburned17:53
jeblairi think it's probably actually ~/.ssh/known_hosts17:53
jeblairwe will need to do that on review on monday17:54
jeblair ssh-keygen -f "/root/.ssh/known_hosts" -R [localhost]:2941817:56
jeblairfixed that17:56
jeblairBadCredentialsException: 401 {u'documentation_url': u'https://developer.github.com/v3', u'message': u'Bad credentials'}17:56
jeblairnowe we have that17:56
clarkboh mordred swapped out github creds and must not have updated review-dev?17:57
clarkbreview-dev has its own token under the same account iirc17:57
*** zns has joined #openstack-infra17:57
clarkbso it is segregated but will need to be updated independent of review.o.o which is working best I can tell17:57
clarkboh wait no17:57
clarkbmange-projects doesn't use the tokens because tehy couldn't create projects. They can now, we should fix manage projects17:57
clarkbmordred: ^ do you know what is going on there?17:58
* clarkb needs to AFK to transplant from home to elsewhere17:58
*** thedodd has quit IRC17:59
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Favicon Whitelabel  https://review.openstack.org/9016717:59
jeblairerm, the password for that account in the password file is wrong18:00
*** thedodd has joined #openstack-infra18:01
jeblairmordred: ^18:01
*** sweston has joined #openstack-infra18:01
mordredjeblair: I remember updating that :(18:02
*** andreaf has quit IRC18:02
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Removed logo images  https://review.openstack.org/9016918:02
*** jcoufal has joined #openstack-infra18:03
*** e0ne has joined #openstack-infra18:03
jeblairmordred: the pw in the file matches hiera which you did update18:04
jeblairmordred: it's possible github still has the old password; will try that18:04
*** talluri has quit IRC18:04
jeblairmordred: yep, that was it.  you made a new pw but didn't actually change it on github18:05
*** talluri has joined #openstack-infra18:05
jeblairfixing that now18:05
mordredjeblair: wow. sorry about that18:05
jeblairyay git :)18:05
*** sweston has quit IRC18:05
jeblairdone18:06
jeblairand now manage-projects on review-dev runs18:06
*** nati_ueno has quit IRC18:06
anteayayay18:06
mordredw00t!18:07
jeblair(i don't know if it can create projects or change acls or anything though)18:07
*** ihrachyshka has quit IRC18:07
*** talluri has quit IRC18:07
anteayabut it runs18:08
*** MarkAtwood has quit IRC18:08
*** talluri has joined #openstack-infra18:08
*** amcrn has joined #openstack-infra18:09
zarojeblair: thanks for fixing.  did it pass the entire puppet run?  will you start the agent on review-dev?18:10
*** _nadya_ has quit IRC18:11
devanandaclarkb: if you can spare a moment, I'd like your input as to whether https://review.openstack.org/90174 is a sane way to do what we just talked about18:12
jeblairzaro: done18:12
*** praneshp has joined #openstack-infra18:12
*** che-arne has quit IRC18:13
*** nati_ueno has joined #openstack-infra18:13
jeblairi'm approving the replica move to /opt on production; i just rsynced the existing contents over18:13
jeblairwhen it lands, i will restart gerrit and then trigger replication to catch it up18:14
*** msabramo1 has quit IRC18:14
*** nati_ueno has quit IRC18:14
*** zns has quit IRC18:14
sdagueAlex_Gaynor: so what's the story with the pypy issue?18:15
Alex_Gaynorsdague: there's a PR for pip, dstufft could opine on when it's likely to land / be in a release18:15
sdaguethat seems to have been abandoned to the point where it feels like it's time to just delete the jobs, as they have been running non voting for a long time18:16
sdagueAlex_Gaynor: that's not going to help us though, right? because we're pinned on an earlier pip.18:16
dstufftLikely it'll land when Marcus feels it's ready and merges it, the PR is only a few days old.18:16
openstackgerritA change was merged to openstack-infra/config: Move local git replica on review to /opt  https://review.openstack.org/9012918:17
sdaguedstufft: but we're using pip 1.4.1, so that means that doesn't solve it for infra, right?18:17
openstackgerritDevananda van der Veen proposed a change to openstack/requirements: Add notes about packaging of external libraries  https://review.openstack.org/9017618:18
dstufftNot generally, but probably I can be convinced to fiddle some release bits if someone makes a PR against 1.4.X once Marcus's PR lands18:18
*** jcoufal has quit IRC18:19
Alex_Gaynorsdague: I haven't heard anything from the debian maintainer who did the patching, unfortunately :/18:19
sdagueAlex_Gaynor: well, it doesn't seem like it's doing us any good to keep running these jobs non voting that don't work18:20
jlkclarkb: in j-j-b, I've got a job-group, where i want to have a list in one attribute, which would create a job for every item in that list, using a specific job template. Is there a way to have multiple attributes as lists in a job-group? to create some sort of union or cartesian product?18:20
*** e0ne has quit IRC18:21
*** darraghb has joined #openstack-infra18:22
*** e0ne has joined #openstack-infra18:22
*** nati_ueno has joined #openstack-infra18:22
jlkclarkb: ah, I do it in - project18:24
dstufftsdague: you could install PyPy from tarball or turn off wheels for PyPy too18:24
*** darraghb has quit IRC18:25
*** rcarrill` has joined #openstack-infra18:25
Alex_Gaynordstufft: --no-use-wheel would fix it I suppose?18:26
Alex_Gaynoror, PIP_NO_USE_WHEEL=1 ?18:26
dstufftyea18:27
dstufftwell18:27
dstufftit's pip 1.418:27
dstufftoh wait18:27
*** msabramo has joined #openstack-infra18:27
dstufftdid 1.4 have wheels on by default I forget18:27
*** rcarrillocruz has quit IRC18:27
Alex_Gaynorare we specifically enabling wheels somewhere?18:27
dstufftI think that was 1.518:27
Alex_Gaynorno, it had them opt-in18:27
dstufftso wheels must be getting explicitly enabled somewhere18:28
zaroanteaya: gerrit upgrade doc looks good, gave a few suggestions but not much.  thanks18:28
dstufftat least as far as we know the bug only happens in the wheel install path18:28
anteayazaro: thanks for the suggestions18:28
*** blamar_ has joined #openstack-infra18:29
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Fixed padding on refresh icon.  https://review.openstack.org/9018218:29
*** blamar_ is now known as blamar18:29
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Gerrit: fix cron syntax errors  https://review.openstack.org/9018418:30
jeblairmordred, clarkb: ^ tested brown bag fix18:30
anteayazaro: do we have a link to the gerrit search docs for 2.8.4 that you would like to use?18:30
*** darraghb has joined #openstack-infra18:30
jeblairmordred, clarkb: that produces:  7 4 * * 0 find /opt/lib/git -type d -name "*.git" -print -exec git --git-dir="{}" repack -afd \;18:31
*** derekh has joined #openstack-infra18:31
mordredjeblair: +218:31
zaroanteaya: it's on the site  documentation->searching18:32
jeblairi'm restarting gerrit now to pick up the replication config change18:32
*** praneshp_ has joined #openstack-infra18:33
*** markvoelker has joined #openstack-infra18:33
anteayazaro: _that's_ what that documention button doea18:34
anteayadoes18:34
anteayaI had no idea, thank you18:34
*** darraghb has quit IRC18:34
*** markwash has joined #openstack-infra18:35
*** igor__ has joined #openstack-infra18:35
*** UtahDave has joined #openstack-infra18:35
*** praneshp has quit IRC18:35
*** praneshp_ is now known as praneshp18:35
jeblairi triggered a global replication push18:36
*** zns has joined #openstack-infra18:37
*** thedodd has quit IRC18:37
*** wenlock has quit IRC18:38
jeblaircloning from /p/... seems to work18:39
*** _nadya_ has joined #openstack-infra18:39
openstackgerritMarc Abramowitz proposed a change to stackforge/python-jenkins: Add .gitignore  https://review.openstack.org/9018818:39
*** thedodd has joined #openstack-infra18:40
jeblairi think i'm finally ready to make a cinder volume.  :)18:40
devoidis there a guide for donating VMs to the testing pool?18:40
*** jooools has quit IRC18:41
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Added loading UI for current user name  https://review.openstack.org/9018918:41
jeblairdevoid: nothing published, but send email to <jeblair@openstack.org> and i can work with you on it18:41
*** wenlock has joined #openstack-infra18:42
devoidjeblair: will do18:43
jeblairi'll make a 40G ssd volume for /home/gerrit2 (it's currently 5.5G)18:45
jeblairafter lunch18:45
*** doddstack has joined #openstack-infra18:46
*** _nadya_ has quit IRC18:46
*** hashar has joined #openstack-infra18:49
*** thedodd has quit IRC18:49
*** nati_ueno has quit IRC18:49
clarkbsounds good18:51
sdaguedstufft / Alex_Gaynor: so my concern is that I turned that job completely non voting on March 18th18:51
sdague6 weeks later, no resolution.18:51
sdagueand no one seems to be owning solving it18:51
*** chandan_kumar has quit IRC18:52
*** ominakov has joined #openstack-infra18:53
*** lukego has quit IRC18:53
*** zns has quit IRC18:54
*** zns has joined #openstack-infra18:55
*** zehicle_at_dell has joined #openstack-infra18:55
*** talluri has quit IRC18:57
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add support for disk-image-builder in nodepool  https://review.openstack.org/8847918:58
* mordred afks18:58
*** jaypipes has joined #openstack-infra18:58
*** ildikov has joined #openstack-infra18:59
mtreinishttx: if you're still around, is there anything I have to do to give the qa track a topic and color on sched.org?19:00
*** BadCub has joined #openstack-infra19:02
zaroanteaya: did you see the 1st abandoned change on the list on review-dev?19:02
anteayaahhhhh19:02
zaroanteaya: no X in W column.19:02
sdaguemtreinish: you got white because you happen to be in that part of the color rotation19:02
sdagueit will change the next time something alphabetically < q pushes a schedule19:03
anteayazaro: was looking at this: https://review-dev.openstack.org/#/q/status:abandoned,n,z19:03
zaroanteaya: yeah, that's what i'm referring to19:03
anteayazaro: then was in conversation, haven't figured out the pattern around how abandoned patches show up19:03
mtreinishsdague: oh ok, but there isn't a topic listed either which is why I thought I might be missing something19:03
mtreinishon the key in the upper right of the page19:04
sdagueoh, there might be an issue19:04
zaroanteaya: abandone is unrelated to wip.  you have have abadoned changes in their work in progress or ready for review state19:04
zarotheir/either19:04
anteayahmmmm19:05
anteayamaybe I will just leave that sentence out then19:05
*** lukego has joined #openstack-infra19:06
*** liam__ has joined #openstack-infra19:06
*** liam__ has quit IRC19:06
zaroanteaya: abandoned and wip are states.  being in one doesn't necessarily mean you are in another.19:06
anteayazaro: I removed that sentence19:06
anteayathe big direction was clarifying work in progress which I think I have done19:06
*** Ajaeger1 has quit IRC19:07
*** hartsocks has joined #openstack-infra19:07
anteayazaro: how are states different from workflow?19:07
*** markmcclain has joined #openstack-infra19:07
anteayaor should I have that conversation after the upgrade?19:07
*** exz has quit IRC19:07
*** StevenK has quit IRC19:07
*** StevenK has joined #openstack-infra19:07
*** simonmcc_ has quit IRC19:08
*** simonmcc_ has joined #openstack-infra19:08
zaroanteaya: i think that's semantics.  workflow contains states and items can be in multiple states at the same time. like a change can be in wip and abandoned state at the same time.19:09
*** Adri2000 has quit IRC19:10
*** Adri2000 has joined #openstack-infra19:10
*** serverascode has quit IRC19:11
*** cyoyo has quit IRC19:11
*** dims has quit IRC19:11
anteayazaro: let's have the semantics conversation over dinner19:11
anteayaif the etherpad is good for now, that is my main concern19:12
*** blamar has quit IRC19:12
openstackgerritSalvatore Orlando proposed a change to openstack-infra/config: Make neutron full job voting (neutron gate only)  https://review.openstack.org/8828919:12
zaroanteaya: looking forward to it. etherpad wfm19:12
*** exz has joined #openstack-infra19:13
*** cyeoh has joined #openstack-infra19:13
*** serverascode has joined #openstack-infra19:13
anteayazaro: great thanks19:13
*** chandan_kumar has joined #openstack-infra19:15
*** prad has quit IRC19:16
*** prad has joined #openstack-infra19:17
*** MarkAtwood has joined #openstack-infra19:17
*** _nadya_ has joined #openstack-infra19:17
*** marcoemorais has quit IRC19:17
jogomordred: wanna do some hacking reviews so I cannot do any more giant rebases: https://review.openstack.org/#/q/status:open+project:openstack-dev/hacking+branch:master+topic:rev,n,z19:22
*** chandan_kumar has quit IRC19:23
*** david-lyle_ has joined #openstack-infra19:26
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Re-add query for bug 1251784  https://review.openstack.org/9020019:26
uvirtbotLaunchpad bug 1251784 in tripleo "nova+neutron scheduling error: Connection to neutron failed: Maximum attempts reached" [Critical,Fix released] https://launchpad.net/bugs/125178419:26
*** ihrachyshka has joined #openstack-infra19:27
mtreinishsdague: well it looks like it fixed itself now19:28
sdagueoh, maybe on delay19:28
*** saschpe has quit IRC19:29
*** mdenny has quit IRC19:29
*** wenlock has quit IRC19:29
*** mdenny has joined #openstack-infra19:30
*** KurtMartin has joined #openstack-infra19:30
*** wenlock has joined #openstack-infra19:30
*** nati_ueno has joined #openstack-infra19:30
*** kmartin has quit IRC19:33
*** vhoward has joined #openstack-infra19:33
*** dims has joined #openstack-infra19:33
anteayacyeoh: yayyyayayayayay19:34
*** marcoemorais has joined #openstack-infra19:36
*** saschpe has joined #openstack-infra19:38
*** vhoward has left #openstack-infra19:39
*** sdague has quit IRC19:41
*** arosen has joined #openstack-infra19:41
*** sdague has joined #openstack-infra19:42
*** coolsvap|afk has quit IRC19:44
openstackgerritA change was merged to openstack-infra/config: Gerrit: fix cron syntax errors  https://review.openstack.org/9018419:44
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Add check-grenade-dsvm-neutron-icehouse to bug 1307344 query  https://review.openstack.org/9020719:45
uvirtbotLaunchpad bug 1307344 in neutron "neutron migrations are not idempotent or invariant to enabled services" [Critical,In progress] https://launchpad.net/bugs/130734419:45
clarkbI restarted firefox and lost all my tabs :(19:46
clarkbmay as well update and reboot now19:46
*** ihrachyshka has quit IRC19:47
*** hashar has quit IRC19:47
*** ihrachyshka has joined #openstack-infra19:47
*** MarkAtwood has quit IRC19:49
clarkbdevananda: yup something like that is what I would do19:51
cody-somervilleclarkb: I hate when that happens to me :(19:51
*** dprince has quit IRC19:51
clarkbdevananda: its a similar problem to what neutron faces for linux only things19:51
clarkbdevananda: they need to be mocked if people want to run unittests on windows or OS X19:52
clarkbcody-somerville: I had to double check I have the save my tabs option selected (and I do)19:54
clarkbnot sure what happened but I restarted it because it was unhappy so might be related19:54
*** _nadya_ has quit IRC19:54
sdagueclarkb: using the built in tab restore, or tabmixplus?19:56
sdagueI found I could never trust built in tab saving in firefox19:56
*** david-lyle_ has quit IRC19:56
clarkbsdague: built in tab restore19:57
*** julim has quit IRC19:58
*** ociuhandu has quit IRC19:58
*** melwitt has quit IRC20:00
openstackgerritA change was merged to openstack-dev/hacking: Make test_doctest use entry points  https://review.openstack.org/8669220:02
*** melwitt has joined #openstack-infra20:02
sorenclarkb: That only works when Firefox crashes, doesn't it? If you restart it gracefully, the tabs are gone IME.20:02
openstackgerritA change was merged to openstack-dev/hacking: Move comment checks into their own module  https://review.openstack.org/8669320:03
openstackgerritA change was merged to openstack-dev/hacking: Move except checks into their own module  https://review.openstack.org/8669420:03
boris-42clarkb hi20:03
*** mburned is now known as mburned_out20:04
*** zehicle_at_dell has quit IRC20:05
openstackgerritA change was merged to openstack-dev/hacking: Only compile regex for hacking_except_format once  https://review.openstack.org/8669520:05
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: Users can be filtered with LIKE clauses  https://review.openstack.org/9021720:06
*** harlowja is now known as harlowja_away20:06
*** marcoemorais has quit IRC20:06
clarkbsoren: there is an option under preferences to save tabs always20:07
*** mburned_out is now known as mburned20:07
clarkbboris-42: hi20:07
openstackgerritKhai Do proposed a change to openstack-infra/config: use buck from master branch  https://review.openstack.org/9021920:08
openstackgerritA change was merged to openstack-infra/elastic-recheck: Re-add query for bug 1251784  https://review.openstack.org/9020020:08
uvirtbotLaunchpad bug 1251784 in tripleo "nova+neutron scheduling error: Connection to neutron failed: Maximum attempts reached" [Critical,Fix released] https://launchpad.net/bugs/125178420:08
openstackgerritA change was merged to openstack-dev/hacking: Speed up license checks  https://review.openstack.org/8672620:08
sorenclarkb: Does that somehow protect you when you have another window open (some popup or whatever) and then you close your main window with all the tabs?20:09
sorenclarkb: I've done that more times than I care to think about.20:09
*** marcoemorais has joined #openstack-infra20:09
clarkbsoren: I'm not sure. I am a one window user20:09
*** HenryG has quit IRC20:11
sorenclarkb: I find that sometimes various web sites "helpfully" open a help window or something in another window (rather than in another tab).. Then I leave it alone, forget all about it, and close my main browser window and find it sitting there, taunting me.20:11
openstackgerritA change was merged to openstack-infra/elastic-recheck: Cirros boot failed  https://review.openstack.org/9010020:12
openstackgerritA change was merged to openstack-dev/hacking: Move python 2->3 checks into their own module  https://review.openstack.org/8844020:13
openstackgerritA change was merged to openstack-dev/hacking: Compile python 2-> regular expressions  https://review.openstack.org/8844120:14
*** mrmartin has quit IRC20:15
*** sweston has joined #openstack-infra20:15
devanandaclarkb: ack, thanks20:18
openstackgerritMatthew Treinish proposed a change to openstack-infra/config: Move tempest master-havana job to experimental  https://review.openstack.org/9022520:19
openstackgerritSean Dague proposed a change to openstack-infra/config: move tempest-master-*-havana to experimental  https://review.openstack.org/9022620:19
mtreinishsdague: ^^^ I win this time...20:19
mtreinish:)20:19
* zaro takes a walk. bbib20:19
sdagueheh20:19
sdagueyou should say something :)20:19
sdaguemtreinish: your patch isn't right though :)20:19
*** _sweston_ has joined #openstack-infra20:20
*** sweston has quit IRC20:20
mtreinishoh, I didn't realize we ran it on devstack too20:20
openstackgerritA change was merged to openstack-dev/hacking: Move import checks into their own file  https://review.openstack.org/8945420:20
openstackgerritA change was merged to openstack-dev/hacking: Move docstring checks into their own file  https://review.openstack.org/8971320:20
mtreinishsdague: I'll just abandon mine, just so I can contribute to your stat padding for samsung20:21
*** ociuhandu has joined #openstack-infra20:23
boris-42clarkb could you pls take a look at that patch with publishing plots20:23
boris-42clarkb we really would like to finish this part of job20:23
boris-42clarkb pls pls pls =)20:23
boris-42clarkb it's quite simple patch -> https://review.openstack.org/#/c/89562/20:23
*** SumitNaiksatam has quit IRC20:24
*** Ryan_Lane1 has joined #openstack-infra20:27
*** bknudson has quit IRC20:28
*** Ryan_Lane1 has quit IRC20:31
*** weshay has quit IRC20:34
*** changbl has quit IRC20:36
*** bknudson has joined #openstack-infra20:37
*** derekh has quit IRC20:39
*** marun has quit IRC20:40
*** changbl has joined #openstack-infra20:41
openstackgerritClark Boylan proposed a change to openstack-infra/zuul: Handle NullChange "merges" gracefully.  https://review.openstack.org/8521720:42
openstackgerritClark Boylan proposed a change to openstack-infra/zuul: Add a remote url override location  https://review.openstack.org/7605720:42
clarkbsdague: did we end up not needing https://review.openstack.org/#/c/84828/1 for branchless tempest?20:45
clarkbI am going to create longgeeks service acocunt now Bug 130696720:47
uvirtbotLaunchpad bug 1306967 in openstack-ci "thstack-ci service account" [Undecided,New] https://launchpad.net/bugs/130696720:47
*** zehicle_at_dell has joined #openstack-infra20:47
anteayaclarkb: yay, he will be very happy20:47
*** changbl has quit IRC20:50
*** che-arne has joined #openstack-infra20:50
_sweston_anteaya: ok, finally out of meetings for now.  I looked over the etherpad, can you tell me what else you need?20:50
*** jaypipes has quit IRC20:52
anteaya_sweston_: I think we are good20:52
anteayathanks so much for putting together the seed docs20:52
anteayaI'm really grateful20:52
*** ominakov has quit IRC20:52
anteayawhat is your availablity for testing the gerrit upgrade instructions?20:53
*** prad has quit IRC20:53
_sweston_anteaya: I am grateful for your help as well, thank you :-)20:53
anteayaanytime20:53
anteayaI enjoy working with you20:53
clarkbits done20:54
clarkbanteaya: ^20:54
*** changbl has joined #openstack-infra20:54
*** SumitNaiksatam has joined #openstack-infra20:54
_sweston_:-) what do we need to test the upgrade?  do we want to start with a base 2.4.8 ?20:54
clarkb_sweston_: I think jeblairs plan is to migrate to 2.4.8 not to upgrade directly to it20:55
*** _nadya_ has joined #openstack-infra20:55
clarkb_sweston_: there is a new machine jeblair is working on to do that20:55
clarkbwhich should allow us to check it before we go live and minimize the actual downtime20:55
_sweston_clarkb: what are we migrating from?20:55
clarkb2.4.420:56
clarkber sorry I totally flipped those numbers before20:56
jeblairclarkb: 2.4.8 != 2.8.420:56
clarkbya20:56
clarkbmy eyes were convinced they were the same though20:56
anteayaclarkb: yay20:57
_sweston_hehe, ok so help me understand what I need on my base box then20:58
anteayajeblair: is there anything _sweston_ and I can work on to help at this point?20:58
_sweston_i.e. where are we starting and where are we going?20:58
clarkb_sweston_: 2.4.4 is what we currently have. you can see the version on the bottom right of https://review.openstack.org/20:58
clarkb_sweston_: that way is available at http://tarballs.openstack.org/ci/20:59
clarkbs/way/war/20:59
anteaya_sweston_: https://etherpad.openstack.org/p/gerrit_upgrade_script and https://etherpad.openstack.org/p/remaining-gerrit-upgrade-changes20:59
*** mwagner_lap has quit IRC20:59
_sweston_clarkb: anteaya:  ok, so I can bring up a box with 2.4.4 and then test the upgrade path from there?21:00
clarkb_sweston_: ya, but we should check with jeblair if that is useful21:00
* anteaya nods21:01
clarkb_sweston_: I think the current plan is not an actual in place upgrade which makes migration and roll back really easy21:01
*** harlowja_away is now known as harlowja21:01
*** Ryan_Lane has quit IRC21:01
anteayawe just point revew.o.o at our server of choice21:02
*** pdmars has quit IRC21:02
_sweston_ok21:02
* _sweston_ is waiting to proceed21:03
*** Ryan_Lane has joined #openstack-infra21:04
*** rfolco has quit IRC21:05
* _sweston_ and reading etherpads21:05
*** marcoemorais has quit IRC21:05
openstackgerritClark Boylan proposed a change to openstack-infra/devstack-gate: update grenade branches  https://review.openstack.org/9023121:06
clarkbsdague: dtroyer jogo I think ^ is ready now as the grenade change merged21:06
clarkbsdague: dtroyer jogo we actually test d-g on the partial grenade test now so it should self gate properly21:06
jeblairclarkb: i expect the process is that we stop puppet on review, merge the upgrade changes, stop gerrit on review, change dns, run puppet on new-review, do whatever upgrade steps need to be done, repeat as necessary, start gerrit on new-review21:07
clarkbjeblair: sounds good21:08
*** maxbit has joined #openstack-infra21:09
*** marcoemorais has joined #openstack-infra21:09
jeblairso we'll perform the 2.4->2.8 upgrade steps on new-review on recently made copies of all the data during the downtime21:09
jeblairold-review will remain in the pre-upgrade state in case a rollback is needed21:09
anteayajeblair: what can _sweston_ and I do to help?21:11
anteayaI think the dev docs are done21:11
anteayahttps://etherpad.openstack.org/p/ai9irqk3FC21:11
openstackgerritA change was merged to openstack-infra/config: Publish rally plots  https://review.openstack.org/8956221:12
*** smarcet has quit IRC21:12
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Move cinder docs into sysadmin section  https://review.openstack.org/9023221:13
jogoclarkb: woot21:13
jlkclarkb: do you have any flow project types in jenkins job builder?21:14
jeblairanteaya: i think they should have more prose.  i will try to work on them when i'm finished with the server.21:14
clarkbjlk: not really. We rely on zuul for scheduling not jenkins21:15
jlkgotcha. I21:16
clarkbjlk: it is possible to do though. I think hashar put at least on example in jjb21:16
*** dizquierdo has joined #openstack-infra21:16
clarkbjlk: https://git.openstack.org/cgit/openstack-infra/jenkins-job-builder/tree/samples/pipeline.yaml something like that maybe?21:16
jlkclarkb: is there any language to do list joins or anything like that?  I'm looking at the example build flow, and I want the list of parallel jobs to be generated somehow21:16
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Move cinder docs into sysadmin section  https://review.openstack.org/9023221:16
clarkbjlk: not really. I think there is a change up to do more than just string types in variables21:17
anteayajeblair: okay21:18
jlkok.21:18
* clarkb looks for it21:18
*** hashar has joined #openstack-infra21:18
jlkI'm finding myself wanting to use jinja tempting inside the yaml :)21:18
anteayajeblair: hmmmm, I too with think about more prose, though you probably have something composed in your head21:18
*** maxbit_ has joined #openstack-infra21:19
jeblairanteaya: not really; if you want to write, go for it.  basically, i want something that 2000 developers can spend about 2 minutes reading and know how to deal with the new gerrit.21:19
clarkbjlk: there have been times where I want JJB to use jinja natively21:19
clarkbbut there is some concern of having the salt problem21:20
jlkwhat's the salt problem?21:20
jeblairanteaya: also, they will not be motivated to read it.21:20
anteayajeblair: I'll try again21:20
clarkbjlk: a turing complete language in your config files is insane :)21:20
jlkfair.21:20
jeblairclarkb: no it's not it's awesome21:20
greghaynesWhat, you dont just want to rewrite salt in jinja?21:20
clarkbjeblair: :P21:20
*** dangers_away has quit IRC21:20
*** e0ne has quit IRC21:21
jeblairclarkb: however, the jinja problem is no one knows how to use templates right, so doing something like "gate-{name}-docs" is really hard.  and that's the problem we wanted to solve.  :)21:21
clarkbright you would have to do for name in namevars: gate-{name}-docs and so on21:22
clarkbI am sure there is a way to make it less terrible21:22
*** markmcclain has quit IRC21:23
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add flag for unbound's resolv.conf  https://review.openstack.org/9023421:23
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add support for disk-image-builder in nodepool  https://review.openstack.org/8847921:23
mordredjeblair, clarkb: ^^ the first patch would be helpful to me21:23
clarkbmordred: you really didn't like my idea of the local resolver on your build host?21:24
*** dangers_away has joined #openstack-infra21:24
mordredclarkb: it doesn't help21:24
*** yamahata has quit IRC21:24
clarkbwhy not?21:24
mordredclarkb: the install.d scripts run in the node via qemu21:24
clarkbmordred: only as a mount though21:25
*** dangers_away is now known as dangers21:25
clarkbso your udp and tcp services on the host should be available right?21:25
mordrednope21:25
clarkbwhy don't they start services in the image then?21:25
mordredgethostbyname() is going to see /etc/resolv.conf on the image host21:25
clarkbmordred: which will say 127.0.0.121:26
mordredbecause they're making images, and running services introduces entropy issues21:26
mordredoh - hrm.21:26
clarkb127.0.0.1:53 on the host can have a resolver21:26
jeblairclarkb: where does it come from?21:26
mordredlemme try - I follow what you're saying now21:26
clarkbjeblair: in the case of nodepool from nodepool puppet21:26
clarkbjeblair: for mordred's dib build dib would probably have to ninja that in21:27
jeblairclarkb: mordred's dib is for nodepool puppet; i'm not sure how they are different21:27
clarkbjeblair: because you can run nodepool dib without openstack puppet21:27
mordredif running a caching nameserver on the build hosts fixes the problem21:27
mordredthen it'll fix the problem21:27
mordredin both places21:28
mordredbut it will mean that anyone who wants to build these images will be required to  have a local nameserver21:28
jeblairclarkb: yeah, let's not concern ourselves with that for the moment though since we won't be running nodepool dib without openstack puppet21:28
mordredso really - the puppet patch above keeps things simple21:28
*** _sweston_ is now known as sweston21:28
clarkbjeblair: right I don't think this is a problem for us21:29
clarkbit is a problem for mordred testing on his laptop though21:29
mordredfor people - in that they should really be able to do git clone openstack-infra/config ; pip install diskimage-builder ; tools/build-image and it shold just work21:29
*** Ryan_Lane1 has joined #openstack-infra21:29
mordredand if it's a problem for me testing on my laptop, it'sa  barrier for other people too21:29
jeblairclarkb: i don't understand how they are different.  mordred's laptop == nodepool.o.o21:29
zarosweston: how far along are you with upgrade?21:29
clarkbjeblair: it doesn't because mordred's laptop isn't managed by openstack puppet21:29
clarkbjeblair: openstack puppet installs a local resolver21:29
openstackgerritRuslan Kamaldinov proposed a change to openstack-infra/config: Extract Murano python jobs in a template  https://review.openstack.org/8797421:30
clarkbjeblair: having a local resolver already exist fixes mordreds problem21:30
jeblairclarkb: i was given to understand that dib runs inside of a qemu vm21:30
clarkbjeblair: it does not21:30
clarkbit runs on a qemu nbd mount or similar21:30
anteayamy latest attempt at developer info for the Gerrit upgrade: https://etherpad.openstack.org/p/TO1UOA0H3x21:30
clarkbit is more like a chroot than a VM21:30
mordredsorry - I was wrong - it's a qemu nbd mount21:30
jeblairwell that's completely different21:31
openstackgerritRuslan Kamaldinov proposed a change to openstack-infra/config: Extract Murano python jobs in a template  https://review.openstack.org/8797421:31
mordredyeah. my bad from the earlier conversation21:31
jeblairand i'm actually surprised mordred's laptop doesn't have a local resolver21:31
jeblairnetworkmanagery things in ubuntu just do that these days21:31
mordredjeblair: nameserver 127.0.1.121:31
jeblairha21:32
jeblairso close21:32
clarkboh hey mine does have a local resolver21:32
clarkb127.0.0.1 and 127.0.1.1 are basically the same thing though21:32
clarkbsince the kernel will forward packets if there isn't a specific match21:32
jeblairmy workstation has nameserver 127.0.0.121:32
jeblairit's precise though, maybe they changed.21:32
swestonzaro: I'd like to test out the process, but I still don't know if this will be helpful to anyone21:32
*** signed8bit has quit IRC21:33
*** zns has quit IRC21:33
*** dangers is now known as dangers_away21:33
*** dangers_away has quit IRC21:33
*** signed8bit has joined #openstack-infra21:33
jeblairsweston: any issues you can find before the downtime on monday would be very helpful21:33
*** nati_ueno has quit IRC21:33
*** Ryan_Lane1 has quit IRC21:34
clarkbhuh in this case I don't get 127.0.1.1 via 127.0.0.121:34
clarkbis that a sockopt?21:34
clarkbor is it just that you don't need an explicit interface for it to work?21:34
*** dangers_away has joined #openstack-infra21:35
swestonjeblair: zaro:  so why don't I start with 2.4 and then go through the steps here: https://etherpad.openstack.org/p/gerrit_upgrade_script21:35
clarkbwoo non standard fun behavior that is useful21:35
jeblairerm, we don't have noatime set on static.o.o21:37
mordredclarkb, jeblair: so, since local resolvers on laptops seem to be very weird on current ubuntu ... do we think I shoudl keep beating against that? or just do the puppet patch?21:38
zarosweston: sound like a good plan, although i would make one change.  on the db upgrade part i would use the db from review.o.o21:38
* anteaya goes for a walk21:39
swestonzaro: review.o.o is ?21:39
zarosweston: review.openstack.org (gerrit 2.4.4)21:39
jeblairzaro: except we don't just hand out the db from review.o.o; it has a lot of private info (eg, email addresses).21:40
*** hashar has quit IRC21:40
swestonzaro: jeblair: that was my thought as well.  Can we figure out a way to protect that data then?21:41
swestonfor example, do an export and scrub the addresses?21:41
*** markmcclain has joined #openstack-infra21:42
jeblairsweston: i don't believe so in the time we have remaining.  however, i believe either zaro or mordred has run the mysql steps on a copy of the production data, so we at least have verified that part should be okay.21:42
*** bknudson has quit IRC21:42
swestonzaro: jeblair:  ok, that's fine -- but I won't be able to get any extra data for you on timing without the database21:43
zaroi have which i can do again to double check.21:44
zaroit's been a while.21:44
*** changbl has quit IRC21:44
jeblairsweston: i know.  it's unfortunate but i think that's just where we are now.21:45
*** zns has joined #openstack-infra21:45
*** thomasem has quit IRC21:46
dhellmannhi, all!21:46
swestonjeblair: ok, just trying to manage any expectations, and want to be clear about what I can do :-)21:46
jeblairthe cinder volume at /home/gerrit2 is set up now21:47
clarkbdhellmann: hello there21:47
*** thomasem has joined #openstack-infra21:47
jeblairsweston: yeah, i think the value at this point is in finding procedural errors21:48
*** thomasem has quit IRC21:48
* dhellmann heard clarkb taking oslo's name in vain earlier21:48
*** mriedem has quit IRC21:48
clarkbdhellmann: sorry21:48
*** ominakov has joined #openstack-infra21:48
dhellmannclarkb: np, just kidding :-)21:48
clarkbbut if we can avoid any more oslo.vendor libs it was worth it21:48
swestonjeblair: I understand.21:48
dhellmannfwiw, I wasn't excited about oslo.vmware either, but they were going to share the code one way or the other, and this way we have have some input21:49
mordredoslo.vmware makes perfect sense21:49
dhellmannare git repo imports still being done by hand, or should we plan to schedule https://review.openstack.org/#/c/78955/ landing?21:49
mordreddhellmann: they're fixed21:49
boris-42clarkb thank you!21:49
* sweston is getting started on the upgrade script testing21:49
clarkbmordred: imo it belongs in a vmware lib not tied to openstack21:50
dhellmannyeah, in the end it includes code specific to vmware and openstack, and according to the devs not useful anywhere else, which exactly what we'd want in an oslo lib like that21:50
clarkbmordred: openstack can then consume that21:50
clarkbdhellmann: right the bug there is that openstack is special21:50
jeblairmordred: except i've disabled manage-projects on review.o.o for the upgrade21:50
jeblairso we're actually back to running manually if we do want to import21:50
mordredjeblair: good point21:51
mordredclarkb: I disagree21:51
mordredit shoudl be here21:51
mordredbecause we know how to collaborate21:51
jeblairalso, we would have seen that weeks ago if it had "new-project" as the topic21:51
dhellmannthe import can wait (that change isn't approved yet anyway) if you're doing an upgrade21:51
*** _nadya_ has quit IRC21:51
jeblairdhellmann: that's scheduled for monday21:51
dhellmannjeblair: "new-project"?21:51
dhellmannas the git topic?21:51
jeblairdhellmann: yep21:51
dhellmanner, gerrit topic?21:51
jeblairyep yep21:51
dhellmannis that a new thing?21:52
* dhellmann goes to update his growing list of instructions21:52
mordreddhellmann: been there for 2 years :)21:52
mordreddhellmann: git review -t new-project21:52
*** e0ne has joined #openstack-infra21:52
jeblairas of like 1 or 2 months ago; we sent an announcement and updated the infra instructions21:52
*** derekh has joined #openstack-infra21:52
mordredoh - I thought you were asking about gerrit topics at all - thus the snark21:52
dhellmannjeblair: ok, I must have missed those, I'll go look at the archives21:52
* mordred goes back into hole21:52
jeblairdhellmann: just out of curiousity (not implying any deficiency on your part) -- are you aware of the gerrit downtime and upgrade scheduled for monday?21:53
*** gondoi is now known as zz_gondoi21:53
dhellmannjeblair: I haven't been paying attention in this channel. Was it announced elsewhere?21:53
*** zz_gondoi is now known as gondoi21:53
jeblairdhellmann: twice to the openstack-dev list (so far; i anticipate one more, and then a post-upgrade announcement)21:54
dhellmannI don't see many unread messages in my dev mailbox, so I may have skipped over the announcement21:54
jeblairi'm starting to think we need an infra-announce list21:54
*** asselin_ has quit IRC21:54
*** mdenny has quit IRC21:54
dhellmannah, I see the email from zaro21:54
*** adalbas has quit IRC21:54
dhellmanna perfectly clear subject line, that I probably skipped over21:54
*** asselin_ has joined #openstack-infra21:55
*** mdenny has joined #openstack-infra21:55
dhellmannmaybe next time "DOWNTIME: gerrit upgrade $date" would be better?21:55
dhellmannor I could be more careful, too :-)21:55
jeblairdhellmann: well, it was missing "Subject: [everyone] [IMPORTANT] [please read] [nova] [cinder] [neutron] [openstack] ...." :)21:55
dhellmannmaybe instead of a separate list, just a separate topic?21:55
dhellmannheh21:55
*** dims has quit IRC21:56
dhellmanna topic would make it easy to filter those to my inbox where I wouldn't miss them, but so would a separate list21:56
dhellmannI don't know what other people's workflow looks like so I'm not sure which is better21:56
*** e0ne has quit IRC21:57
*** david-lyle has quit IRC21:57
jeblairanyway, i suspect we are going to surprise several people who aren't taking next week off.  oh well.21:58
clarkbeveryone doesn't skim all the messages anyways?21:59
clarkbI don't trust other people to filter for me :)21:59
dhellmannclarkb: only the subject lines, and obviously I missed some21:59
*** KurtMartin has quit IRC22:00
*** KurtMartin has joined #openstack-infra22:00
*** jgrimm has quit IRC22:02
mordredjeblair: when we set the irc topic , and then when gerrit stops working, I betch people will notice22:02
*** gondoi is now known as zz_gondoi22:03
jeblairmordred: yep.  maybe we'll have statusbot send a notice tomorrow22:04
jeblair(we can put the message and docs in a wiki page and have it broadcast a link)22:04
*** mfer has quit IRC22:06
*** marcoemorais has quit IRC22:06
*** amcrn has quit IRC22:08
*** marcoemorais has joined #openstack-infra22:08
*** dims has joined #openstack-infra22:08
*** yamahata has joined #openstack-infra22:09
*** dizquierdo_ has joined #openstack-infra22:11
*** marcoemorais has quit IRC22:12
*** adalbas has joined #openstack-infra22:12
*** marcoemorais has joined #openstack-infra22:14
*** e0ne has joined #openstack-infra22:16
*** _nadya_ has joined #openstack-infra22:17
*** e0ne_ has joined #openstack-infra22:18
*** e0ne has quit IRC22:21
*** e0ne_ has quit IRC22:22
*** dkranz has quit IRC22:24
*** zns has quit IRC22:24
*** doug-fish1 has left #openstack-infra22:26
*** ihrachyshka has quit IRC22:27
*** zns has joined #openstack-infra22:28
openstackgerritSean Dague proposed a change to openstack-infra/gitdm: adjusting affiliation  https://review.openstack.org/9024322:29
clarkbah man I won't be around for your first day?22:30
sdagueslacker :)22:31
jeblairsdague: congrats!  i like this way of announcing changes... if we -1 that change do you stay at samsung?  ;)22:31
JayFIs that yet another place to put in our info, along with stackalytics and reviewstats?22:31
sdagueheh, I hope not :)22:31
clarkbJayF: there are far too many22:31
*** dizquierdo_ has quit IRC22:31
sdaguereviewstats has affiliation?22:31
*** dizquierdo has quit IRC22:31
JayFit doesn't have affiliation, but iirc something had to update there when I joined? Maybe listing me as a core for ipa?22:32
boris-42clarkb http://logs.openstack.org/45/86945/19/check/check-rally-dsvm-rally/f53b058/rally-plot/ !!!22:33
boris-42clarkb it works~22:33
boris-42clarkb thank you=)22:33
clarkbcool22:33
*** doddstack has quit IRC22:34
sdagueI honestly completely forgot gitdm was publishing in channel, but announcing is good.22:34
*** dkliban is now known as dkliban_afk22:36
*** mriedem has joined #openstack-infra22:37
anteayasdague: did you want to add a line to http://git.openstack.org/cgit/openstack-infra/gitdm/tree/openstack-config/groups/hp as well?22:39
sdagueanteaya: honestly, IIRC, the groups files are trumped by the email-map22:39
sdaguethe gitdm layers of trumping is pretty byzantine22:40
pleia2sdague: woo, welcome-ish :)22:40
sdagueclarkb / jeblair / mordred: on the more useful commit front - https://review.openstack.org/#/c/90226/ - to help reduce some noise in the er fails, and stop burning nodes22:41
sdaguepleia2: thanks :)22:41
sdagueok, my wife just got home, time to go afk22:41
anteayaah I didn't know the trumping22:42
*** enikanorov_ has quit IRC22:42
*** zns has quit IRC22:43
*** bknudson has joined #openstack-infra22:44
*** derekh has quit IRC22:45
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add check-grenade-dsvm-neutron-icehouse to bug 1307344 query  https://review.openstack.org/9020722:46
uvirtbotLaunchpad bug 1307344 in neutron "neutron migrations are not idempotent or invariant to enabled services" [Critical,Fix committed] https://launchpad.net/bugs/130734422:46
anteayaso dhellmann can you do me a favour? can I get your feedback on: https://etherpad.openstack.org/p/TO1UOA0H3x22:48
anteayaif we were to send that out to 2000 devs, would it make sense?22:48
openstackgerritA change was merged to openstack-infra/config: move tempest-master-*-havana to experimental  https://review.openstack.org/9022622:48
*** msabramo has quit IRC22:48
*** signed8bit is now known as signed8bit_ZZZzz22:50
openstackgerritA change was merged to openstack-infra/reviewday: Add Sahara repos to reviewday  https://review.openstack.org/8821422:53
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add support for disk-image-builder in nodepool  https://review.openstack.org/8847922:55
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add flag for unbound's resolv.conf  https://review.openstack.org/9023422:55
*** jamielennox|away is now known as jamielennox22:56
*** mdenny has quit IRC22:56
*** etoews has joined #openstack-infra22:57
*** amcrn has joined #openstack-infra22:57
*** msabramo has joined #openstack-infra22:59
*** dkehn_ has joined #openstack-infra23:00
*** pfallenop has quit IRC23:01
*** pfallenop has joined #openstack-infra23:01
*** clarkb has quit IRC23:01
*** clarkb has joined #openstack-infra23:01
clarkbdid I miss anything?23:02
*** odyi has quit IRC23:02
clarkbmordred: jeblair: yjiang over in #openstack-qa had a nova pep8 job run out of disk on an hpcloud az2 bare precise node23:02
*** adalbas has quit IRC23:02
*** dkehn has quit IRC23:03
clarkbwe can't do anything with the ephemeral disks during image buildtime ...23:03
*** dkehn has joined #openstack-infra23:03
clarkbnot sure how else we can deal with this23:03
*** odyi has joined #openstack-infra23:03
clarkblooks like jobs have 3.5GB of disk in / though23:03
clarkbwhich should be plenty for pep823:03
*** dkehnx has quit IRC23:04
*** lifeless has quit IRC23:04
clarkbwoot https://review.openstack.org/#/c/90231/ passed23:04
*** lifeless has joined #openstack-infra23:05
anteayayay23:05
anteayadevstack-gate has a lot of tests23:05
*** markmcclain has quit IRC23:07
*** flaper87 is now known as flaper87|afk23:08
*** CaptTof__ has quit IRC23:08
*** atiwari has quit IRC23:09
*** CaptTofu has joined #openstack-infra23:09
*** msabramo has quit IRC23:11
*** msabramo has joined #openstack-infra23:11
*** melwitt has quit IRC23:11
*** pmathews has quit IRC23:12
*** CaptTofu has quit IRC23:14
*** mburned is now known as mburned_out23:14
*** lukego has quit IRC23:16
*** e0ne has joined #openstack-infra23:18
*** adalbas has joined #openstack-infra23:18
*** lukego has joined #openstack-infra23:21
clarkbmordred pbr should do versioning like this https://twitter.com/stahnma/status/459452329637326849/photo/123:22
*** e0ne has quit IRC23:22
mordredwow23:22
anteayaruby releasing23:25
anteayanever a strong point23:25
*** MarkAtwood has joined #openstack-infra23:26
*** gokrokve has quit IRC23:26
*** devoid has quit IRC23:28
*** CaptTofu has joined #openstack-infra23:29
arosenhrm is this a gerrit bug why there is no syntax hightlighting on this page? https://review.openstack.org/#/c/82831/13/nova/tests/virt/libvirt/test_libvirt.py23:31
*** Ryan_Lane1 has joined #openstack-infra23:31
*** mwagner_lap has joined #openstack-infra23:31
*** ominakov has quit IRC23:32
*** reed has quit IRC23:32
*** Ryan_Lane1 has quit IRC23:35
anteayaarosen: isn't that interesting, there is syntax highlighting in the other .py file in that patch23:35
arosenanteaya:  cha23:36
arosenAnd if you click on ... skipping <<HERERER 843> common lines ..23:36
arosenit just adds random +1 lines.23:36
anteayathat's wild23:37
anteayawell done, I have never seen that before23:37
anteayaI wouldn't even know how to describe that as a bug report23:37
*** oomichi has joined #openstack-infra23:38
anteayaarosen: since we are about to upgrade next week to gerrit 2.8.4, I don't think filing a bug is worth your time23:39
anteayabut it is interesting23:39
arosenyea wasn't planning on it. Just had never seen it before23:39
*** MarkAtwood has quit IRC23:39
anteayame either23:39
arosenfigured i'd point it out. Not worried about it thou23:39
anteayak23:40
sdagueclarkb: I have the revert revert version of that up actually23:40
sdagueclarkb: https://review.openstack.org/#/c/90043/23:40
*** ravikumar_hp has quit IRC23:41
clarkboh even better23:42
clarkbcan you abandon mine23:43
sdaguesure23:43
clarkbty23:43
*** e0ne has joined #openstack-infra23:43
sdagueactually, I don't seem to have a revert button23:43
sdaguesorry, the abandon button23:44
sdagueon https://review.openstack.org/#/c/90231/23:44
sdaguemaybe because you are the committer?23:44
clarkbhuh I thought core had it23:44
clarkbfeel free to -2 instead23:45
*** lukego has quit IRC23:45
sdagueguess not23:45
*** gokrokve has joined #openstack-infra23:46
*** e0ne has quit IRC23:47
*** masayukig has joined #openstack-infra23:52
mordredclarkb, jeblair: I wrote a script to process nodepool.log and produce a success/fail info - it's sitting in /var/log/nodepool right now and is called process.py23:52
*** UtahDave has quit IRC23:53
*** yamahata has quit IRC23:57
jogoheh sdague has two compeating patches23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!