Tuesday, 2016-02-16

greghaynesSpamapS: Is the thinking that drop database is inherently not a performant thing?00:00
SpamapSit's precisely how the mysql test suite itself does things.00:00
clarkbgreghaynes: the two considerations are 1) py26 cannot do setup/teardown class00:00
SpamapSgreghaynes: It is inherently serialized.00:00
clarkbgreghaynes: and 2) you would run it per process00:00
SpamapSand waits for files to be unlinked fully..00:00
clarkbSpamapS: we don't run mysql directly00:00
clarkbSpamapS: so we can do things that way but would require completely chaning how we test00:01
SpamapSclarkb: yeah, it was just a thought. So without that, yeah, you need to be dropping.00:01
SpamapSis there any reason any of the tables gets big?00:01
clarkband then changing every openstack project to match00:01
SpamapSthey should be tiny00:01
clarkbthey should be tiny00:01
SpamapSso then I don't see much reason for it to take a long time.00:01
clarkbgreghaynes: also if you do it that way you have to drop all the tables between tests anyways00:02
clarkbgreghaynes: not sure that really fixes the problem00:02
greghaynesclarkb: py26 shouldnt be an issue - I am not sure why youd need to do that00:02
clarkbgreghaynes: otherwise you lose test case isolation which will be even more fun to work around00:02
clarkbgreghaynes: we don't need it anymore but needed it until decemberish00:02
greghaynesclarkb: oh, right00:03
clarkbgreghaynes: its just a reason why things are the way thing sare00:03
SpamapSdropping all the tables is the same as dropping the db00:03
greghaynesclarkb: actually, I am thinking in class set up pick a random db prefix. in test setup create db under that prefix, dont delete in test cleanup, in class cleanup delete all databases starting with that prefix00:03
clarkbok then those are equivalent00:03
*** Kennan_Vacation is now known as Kennan00:03
SpamapSthough at least you'd have n statements to timeout instead of one. ;)00:03
greghaynesclarkb: its not a huge win but it would group deletes00:03
clarkbgreghaynes: which would also be subject to the timeout I think00:04
greghaynesclarkb: it would00:04
greghaynesclarkb: so it may not help00:04
*** dims has quit IRC00:04
*** piet has quit IRC00:05
SpamapSThe one thing I'd say is if you go ahead and drop all the tables one by one, at least you have more granularity on what is causing the problem if there is in fact a problem beyond "that is slow"00:05
greghaynesSpamapS: ++00:05
SpamapSand it's possible it fixes the problem because each table drop has its own timeout00:05
clarkbis mysql already logging that? I wonder if we can just grab the mysql log for that granularity00:05
clarkbSpamapS: no its the timeout in python not mysql00:05
SpamapSnot be default00:05
SpamapSnot by default rather00:06
SpamapSbut you can turn on logging00:06
SpamapSyou can even have it log to a table00:06
SpamapShttp://dev.mysql.com/doc/refman/5.5/en/log-destinations.html00:07
SpamapSThat would actually be _super_ useful in debugging anything SQL related00:07
clarkbwe had it enabled but then we wrote 1GB log files or something00:08
clarkbon devstack runs00:08
SpamapSyeah no surprise there00:09
clarkbok all jenkinses should be updated00:09
SpamapSstill, that's not a useless 1GB and probably xz's down to a at most 100MB ;)00:09
SpamapSsince it is likely to be a _lot_ of the same thing over and over.00:09
*** sflanigan has joined #openstack-infra00:10
*** sflanigan has joined #openstack-infra00:10
*** dims has joined #openstack-infra00:11
clarkbSpamapS: ya now run it 25k times per day :)00:11
openstackgerritColleen Murphy proposed openstack-infra/puppet-infracloud: Use SSL for rabbitmq traffic  https://review.openstack.org/27637500:11
openstackgerritColleen Murphy proposed openstack-infra/puppet-infracloud: Setup rabbit user/pass for keystone  https://review.openstack.org/27848200:11
*** thorst has joined #openstack-infra00:11
clarkbbut ya having a single periodic job that collected that info would likely be beneficial and not hurt the log disks too much00:11
*** gildub has joined #openstack-infra00:12
openstackgerritMerged openstack-infra/nodepool: Dont connect to gearman in cmd unless needed  https://review.openstack.org/27982900:13
*** thorst_ has joined #openstack-infra00:14
openstackgerritColleen Murphy proposed openstack-infra/puppet-infracloud: Use SSL for rabbitmq traffic  https://review.openstack.org/27637500:15
*** thorst has quit IRC00:17
clarkbnibalizer: mordred our time between puppet runs is pretty long now, upwards of an hour. Maybe we should increase the number of concurrent puppet applies?00:28
*** pradk has quit IRC00:30
nibalizermaybe00:30
nibalizerwe've added what 40 new hosts w/ infracloud?00:31
nibalizerand it runs those as a separate step00:31
nibalizerso its all git servers, all afs servers, all infracloud, everyone else00:31
clarkbya00:31
clarkband infracloud seems to update a lot rather than nop00:31
clarkbalso there are failures that we need to track down and puppetboard doesn't learn about them00:32
nibalizeryep00:32
nibalizerthe whole system needs attention and feeding to get it to a place thats better00:32
nibalizerare the errors just nodes that do not exist?00:32
clarkbsome of them are but others are real fails on real nodes I think00:32
clarkbI am only just now sort of looking00:32
nibalizerhttps://review.openstack.org/#/c/278769/00:33
Sam-I-Ammoo.00:33
nibalizeralso https://review.openstack.org/#/c/278841/ is a no brainer00:33
clarkbnibalizer: done, though that doens't explain why puppetboard doesn't learn about failures00:34
nibalizerwell depending on what you're seeing00:34
nibalizeryou may actually be seeing the puppetboard post is the only failure00:34
clarkbnibalizer: puppet ran into exec timeout on jenkins* an dreutrned 600:35
*** markvoelker has joined #openstack-infra00:35
clarkbnibalizer: that puppet run was not recordred in puppetboard00:35
*** rajinir has quit IRC00:35
nibalizeryea00:35
nibalizerim not sure whats going on there00:35
nibalizernone of the infracloud hosts appear in puppetboard00:35
clarkbhttp://puppetboard.openstack.org/node/jenkins02.openstack.org there is a gap between 10:23 and 1:23 pt where things actually failed00:35
fungiafter combing all 950 repos in gerrit, there were only 16 others with malformed groups files00:36
clarkbnibalizer: looks like the old pypi mirror hosts fail in ansible because they were deleted00:36
clarkbnibalizer: I think that is due to caching00:37
*** shashank_hegde has quit IRC00:37
clarkbfungi: ^ you ran into caching before right? what is the process there ? wait longer or ?00:37
nibalizerok00:37
nibalizerwe also have all those uuid-hosts still00:37
nibalizerdespite them not being real or useful00:37
*** salv-orl_ has quit IRC00:38
fungiclarkb: i thought the daily cache update was supposed to clear them out00:38
clarkbfungi: it doesn't appear to be working00:38
clarkbI don't even know what the daily cache update is00:38
clarkbso thats the extent of my knowledge00:38
funginibalizer: most of the uuids mentioned there are actually servers in dfw but for some reason half the time our ansible inventory on the puppetmaster is ending up with all hosts in dfw identified by instance uuid instead of instance name00:38
nibalizeryes00:39
fungiclarkb: supposedly it's that when we call ansible it's calling into shade for the openstack role, and shade caches its inventory (refreshing it by default only if it's >24 hours old)00:39
*** markvoelker has quit IRC00:39
clarkbnibalizer: oh! I see the problem Ithink we doubletap the compute hosts00:39
clarkbnibalizer: :)00:39
nibalizerclarkb: https://review.openstack.org/#/c/278855/00:40
clarkbnibalizer: it is definitely intermixing compute hosts and everything else00:40
nibalizercredit goes to crinkle for figuring that one out first00:40
*** gildub has quit IRC00:40
clarkbok that will likely fix things a bunch00:40
fungiclarkb: er, no wait, it's the ansible dynamic inventory script, sorry00:40
openstackgerritMerged openstack-infra/system-config: Disable nonfunctional infracloud hosts  https://review.openstack.org/27876900:41
*** denisra has quit IRC00:41
fungiclarkb: the /etc/ansible/hosts/openstack script on the puppetmaster uses shade00:41
*** denisra has joined #openstack-infra00:41
clarkbgotcha and shade is supposed to expire those things on a 24 hour timeout?00:42
fungiand that's how the cache is getting populated00:42
clarkbit definitely isn't if that is the case, pypi.*.openstack.org are all failing00:42
clarkbdue to connection errors00:42
fungiyeah, unless configured otherwise default is supposedly 24 hours00:42
clarkbI am going to restart nodepool now00:42
openstackgerritMerged openstack-infra/system-config: Delete json reports when we delete yaml reports  https://review.openstack.org/27884100:42
fungiclarkb: anyway, mordred would probably appreciate knowing that the inventory doesn't seem to be removing hosts deleted from nova00:42
fungipossible my understanding is incorrect and there's something else we're supposed to be doing instead00:43
clarkbnodepoold and builder have been restarted00:43
clarkbfungi: it would not surprise me if shade caching is busted00:44
clarkbthat code is complicated00:44
fungiwell, also the inventory script has some of its own logic around caches from the looks of it00:44
clarkbopenstackid.org is one of the failing hosts00:45
clarkbConnectFailure: Unable to establish connection to http://localhost:5000/v2.0/tokens00:45
clarkbuh00:45
clarkb2016-02-16 00:45:30,363 ERROR nodepool.NodeLauncher: ConnectFailure launching node id: 7975788 in provider: tripleo-test-cloud-rh1 error00:45
fungii approved a change earlier today to upgrade openstackid on production openstackid.org to the same release that's been running on openstackid-dev.o.o for a while00:45
clarkbnot sure yet if that is the cloud saying it can't connectto localohost or if nodepool can't connect to localhost00:46
clarkbseems like nodepool :(00:46
clarkbthat'll leran me to restart services at the end of the day00:46
mordredfungi, clarkb: when did you delete the hosts?00:47
mordredand when you did, did you delete the inventory cache?00:47
clarkbmordred: last week00:47
mordredah00:47
mordredthen they should not be in the inventory anymore00:47
clarkbmordred: als see above I think oscc/shade may be broken00:47
fungiclarkb: also, did not delete the inventory cache. was thinking it was supposed to update itself at least daily anyway?00:47
openstackgerritSpencer Krum proposed openstack-infra/ansible-puppet: Don't post data from uuid hosts  https://review.openstack.org/28045700:47
fungimordred: ^00:47
clarkbfungi: yes that is what I would expect00:47
nibalizerclarkb: ^^ that would likely fix it00:47
nibalizereven if not the right way00:48
mordredyes. it should update daily00:48
nibalizeralso that will fail lint based on line lenght00:48
nibalizerso i'd love some info on how to split that line up to be not so long00:48
funginibalizer: well, that keeps us from dirtying the puppetdb data, but of course doesn't solve the ineventory ending up all uuids in dfw sometimes00:48
*** nibz has joined #openstack-infra00:49
clarkbauth_url is set in our clouds.yaml00:49
clarkband it isn't localhost:500000:49
*** nibalizer is now known as nibz_irssi00:49
clarkbbluebox also sets it and I haven't seen any bluebox errors00:49
*** nibz is now known as nibalizer00:49
fungimordred: nibalizer: i still have a feeling it's something nova list for rax-dfw is doing weird sometimes to cause us to not end up with instance names00:49
nibalizerfungi:yep00:50
fungithough i have no proof--haven't caught it red handed00:50
nibalizerbut that is one example of making it a little bit better00:50
fungisure, i don't object00:50
openstackgerritMerged openstack-infra/system-config: Don't run infracloud puppet twice  https://review.openstack.org/27885500:51
clarkblocalhost:5000 don't show up in shade or oscc or nodepool00:52
*** nibz_irssi has quit IRC00:53
clarkbcan reproduce with openstack --os-cloud tripleo-test-cloud-rh1 catalog list00:53
clarkbso it isn't a nodepool bug00:54
clarkbmordred: ^ any ideas?00:54
mordredclarkb: it's 1am here - can you tl;dr me - I can't process the whole scrollback00:55
clarkbmordred: `openstack --os-cloud tripleo-test-cloud-rh1 catalog list` says Unable to establish connection to http://localhost:5000/v2.0/tokens00:55
greghaynesclarkb: did tripleo-test-cloud-rh1 show up somewhere in logs?00:55
clarkbmordred: nodepool is also failing on that00:56
*** yamamoto has joined #openstack-infra00:56
greghaynesWondering why you think that is the cloud causing the error00:56
clarkbgreghaynes: yes it is only hosts in that cloud failing00:56
greghaynesOk00:56
*** gildub has joined #openstack-infra00:56
mordredclarkb: from puppetmaster as root?00:57
greghaynesIts probably not too important to fix immediately, then - I doubt they will care too much if they miss one day of images00:57
clarkbmordred: on nodepool.o.o as nodepool00:57
clarkbgreghaynes: its all things so no testing can happen00:57
greghaynesoh :(00:57
clarkbon tripleo cloud00:57
greghaynesYea, I forgot that we boot up the worker nodes there00:58
openstackgerritThanh Ha proposed openstack-infra/zuul: Add quick-start guide  https://review.openstack.org/27187200:58
mordred      auth_url: 'https://ci-overcloud.rh1.tripleo.org:13000/v2.0'00:58
clarkbmordred: yup00:58
clarkbit is almost like that is a keystone auth default00:58
*** rfolco has quit IRC00:58
clarkbsince oscc and shade don't have localhost in their repos00:58
clarkbmordred: bluebox appears to work which similarly sets the auth_url00:59
*** thorst_ has quit IRC00:59
mordredclarkb: REQ: curl -g -i -X GET https://ci-overcloud.rh1.tripleo.org:13000/v2.0 -H "Accept: application/json" -H "User-Agent: python-openstackclient keystoneauth1/2.2.0 python-requests/2.9.1 CPython/2.7.6"01:00
mordredclarkb: is the first thing openstack is doing there01:00
fungicodesearch turns up waaaay too many false-positives due to that being used in install and api docs, keystone tests, documentation and sample configs, examples in python-openstackclient documentation and tests...01:00
*** thorst has joined #openstack-infra01:00
mordredthat's returning this:01:00
greghaynesmordred: that points to localhost01:00
mordredRESP BODY: {"version": {"status": "deprecated", "updated": "2014-04-17T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v2.0+json"}, {"base": "application/xml", "type": "application/vnd.openstack.identity-v2.0+xml"}], "id": "v2.0", "links": [{"href": "http://localhost:5000/v2.0/", "rel": "self"}, {"href":01:00
mordred"http://docs.openstack.org/api/openstack-identity-service/2.0/content/", "type": "text/html", "rel": "describedby"}, {"href": "http://docs.openstack.org/api/openstack-identity-service/2.0/identity-dev-guide-2.0.pdf", "type": "application/pdf", "rel": "describedby"}]}}01:00
greghaynesjinx01:00
mordredyah01:00
fungioh, ouch01:00
mordredso tripleo test cloud is broken01:00
clarkbwow01:00
fungiso very, very broken01:00
clarkbthat error message is really confusing in this context01:01
*** ZZelle_ has quit IRC01:01
fungiso busted keystone v2 entry in the catalog i guess?01:01
greghaynesYep01:01
clarkbwhich somehow overrides the auth url01:01
clarkbthat is a weird chicke nand eg01:02
fungithank you mario, but our princess is in another castle?01:02
clarkbno gearman connections to get listings \o/01:02
*** yamamoto has quit IRC01:03
*** [1]Thelo has joined #openstack-infra01:03
mordredthe auth url triggers version discover01:04
mordredthe auth url triggers version discovery01:04
clarkbhas someone joined #tripleo to let them know?01:04
clarkbI can do that if not01:04
*** dims has quit IRC01:04
mordredthe version discovery gets the list of urls that keystone is serving01:04
openstackgerritThanh Ha proposed openstack-infra/zuul: Add quick-start guide  https://review.openstack.org/27187201:04
clarkbmordred: that makes sense excet that I already have to know the version and location of keystone :/01:04
mordredyes01:04
mordredI'm not disagreeing with you01:04
clarkbso it is a weird chickenand egg where I must know the info ahead of time but we allow it to override and break me even if I know01:05
mordredgive me a sec -I'm poking at workarounds01:05
clarkbI can see both sides of an argument for why you would want this, but based on this issue I lean towards using the info as laready supplied bceause it is required info01:05
mordredmodern keystoneclient expects unversioned auth urls01:05
greghaynesclarkb: mordred I poked slagle in -tripleo01:05
mordredI'm going to see if I can tell it to not do discovery though01:05
clarkbother than that we look good on nodepool01:06
*** Thelo has quit IRC01:06
*** [1]Thelo is now known as Thelo01:06
*** mtanino has quit IRC01:06
mordredjamielennox: ^^ got a sec to look at scrollback?01:06
clarkband I will leave ansible inventory caching for another day01:06
mordredjamielennox: the tripleo test cloud has a broken setting for keystone version discovery01:06
mordredjamielennox: but we know the version01:07
jamielennoxhow far back?01:07
clarkbmordred: the other thing is failed puppet runs don't get puppetboarded01:07
mordredjamielennox: one or two screens01:07
mordredclarkb: k. we should fix that - I can work on it when it's not 1am where I am :)01:07
clarkbmordred: yup I don't expect you to work on it now01:07
clarkbmordred: just wanted to make you aware01:07
clarkbI also merged some cleanup changes for ansibling that crinkle and nibalizer pushed which should make debugging the remaining things easier tomorrow01:08
clarkb(less overall noise)01:08
mordredclarkb: cool01:08
nibalizerso should we disable the tripleo cloud?01:08
jamielennoxso the GET / on some cloud is reporting localhost as the URL?01:08
*** dims has joined #openstack-infra01:08
mordredjamielennox: tl;dr - how do we get python-openstackclient to _not_ do version discovery for keystone01:08
clarkbjamielennox: yes01:08
*** thorst has quit IRC01:08
mordredjamielennox: GET https://ci-overcloud.rh1.tripleo.org:13000/v2.001:08
jamielennoxosc had a fix for this i think but we didn't backport it because essentially the cloud is misconfigured01:09
mordredkk01:09
jamielennoxinstead of auth_type=password and the unveresioned url do auth_type=v2password and the /v2.0 url01:09
mordredso best bet is just get slagle to update the config there01:09
jamielennoxthat will skip version discovery01:09
clarkbexcept v2password is broken for other reasons01:09
* clarkb gets a drink01:09
jamielennoxor /v3 if possible01:09
jamielennoxclarkb: v2password is broken?01:09
greghaynesclarkb: this aged cachaca is pretty good01:10
clarkbjamielennox: the interface to that class is different than the interface to the generic password class01:10
mordredjamielennox: openstack --debug --os-auth-type=v2password --os-cloud=tripleo-test-cloud-rh1 server list01:10
mordredis what I'm doing01:10
mordredclarkb: it's ok - that's all fixed now01:10
mordredclarkb: specifying v2passwd is possible these days01:10
clarkbok01:10
*** bkero has joined #openstack-infra01:10
mordredjamielennox: that command above still does discovery01:10
jamielennoxclarkb: it is different becase the params to v2 and v3 auth are different01:10
mordredclarkb: oscc munges your parameters properly if you request v2password01:10
clarkbok01:11
jamielennoxmordred: oh, maybe it does for the CRUD stuff01:11
jamielennoxyou can use bypass-url or whatever for that bit01:11
jamielennoxbut i wouldn't think the server list part would do that01:12
openstackgerritThanh Ha proposed openstack-infra/zuul: Add additional zuul.conf information  https://review.openstack.org/27186801:12
clarkbanyways once the cloud is fixed nodepool should just start working with it again01:13
*** achanda has quit IRC01:13
clarkbso I don't hink we need to do anything special with them01:13
mordred++01:13
clarkband if it isn't fixed in a few days we can remove that cloud01:14
clarkband figure out what we do from there01:14
fungiyeah, seems unnecessary to jump through hoops so as to work around an obvious misconfiguration01:14
nibalizerclarkb: cool01:14
greghaynesclarkb: Why did this only show up after a nodepool restart?01:14
greghaynesclarkb: Is that the only time we do the endpoint discovery?01:14
openstackgerritTony Breeds proposed openstack-infra/project-config: Enable trove in devstack on stable/kilo  https://review.openstack.org/28046101:14
clarkbgreghaynes: because you only do this listing when you start01:14
fungii'm guessing some nodepool dependency updated since the prior restart01:14
clarkbgreghaynes: you don't ask for the catalog each time01:14
greghaynesclarkb: hrm, I guess on client creation01:14
nibalizerthere aren't any non tripleo tests that require nodes in the tripleo cloud right?01:15
clarkbgreghaynes: yup01:15
fungior else they changed their config since the last restart01:15
greghaynesfun01:15
clarkbnibalizer: nothing that should be voting01:15
greghaynesYea, so probably they redeployed with the catalog changing since out last restart01:15
greghaynesfungi: yep01:15
mordredwell - this isn't actually the catalog, fwiw01:15
mordredit's the keysotne config01:15
clarkbwhatever it is you only ask for it when creating a new client01:16
mordredthe config of what the self-url is01:16
fungiayup, before even being able to get the catalog01:16
nibalizerlooks like the only jobs using the tripleo-f22 nodes are the ironic openstack-releasenotes-jobs01:16
fungigot it01:16
nibalizerwhich I assume we only need when releasing?01:16
clarkbnibalizer: that doens't sound right, that job should run where the other release notes jobs run01:16
mordredI agree with that01:16
nibalizeri could be interpreting that wrong01:16
mordredjroll, devananda ^^ ?01:16
nibalizeroh i misparsed some yaml01:17
nibalizerits just a job called - '{trigger}-tripleo-ci-{jobname}'01:17
nibalizerand the node is tripleo-f2201:17
mordredgreghaynes, clarkb #public_endpoint = <None>01:17
*** achanda has joined #openstack-infra01:17
mordredthat's the setting in keystone.conf ^^01:17
clarkbmordred: that causes a localhost entry?01:17
mordredjamielennox: do I have that right?01:18
jamielennoxmordred, clarkb: how old is this install? for a couple of cycles now if you don't set public_endpoint it will default to the value from the request01:18
mordredjamielennox: might be a bit old01:18
clarkbexcept it was working last week01:18
jamielennoxif it's new to get that discovery entry they'd have to do public_endpoint = http://localhost:500001:18
greghaynesjamielennox: Unsure, it really is just when/what tripleo folks deployed01:18
mordredoh ... you know what01:18
jamielennoxwas working last week? what's changed?01:18
mordrednah. nevermind. I have no cule01:19
clarkbjamielennox: no idea, they run the cloud01:19
openstackgerritQiming Teng proposed openstack/requirements: Bump python-senlinclient version to 0.3.0  https://review.openstack.org/26359801:19
clarkbits fine, they will sort it out I am sure01:19
*** nelsnelson has joined #openstack-infra01:19
*** achanda has quit IRC01:20
*** david-lyle has joined #openstack-infra01:23
*** pvaneck has quit IRC01:24
openstackgerritBertrand Roussel proposed openstack-infra/jenkins-job-builder: Description Setter Plugin support as builder  https://review.openstack.org/28041601:25
*** tzn has joined #openstack-infra01:26
clarkbnibalizer: fyi we no longer mix the hosts but now we aren't running against the compute nodes from what I can see01:29
clarkband controller00 west is failing on some ssl thing01:29
*** kzaitsev_mb has quit IRC01:29
nibalizerclarkb: hrm let me view the log01:30
*** rlandy has quit IRC01:31
clarkbnibalizer: it is actually probably ok to mix them in with everything else as after the compute host01:32
clarkbbut a distinct log section may make debug simpler01:32
nibalizeryes01:33
nibalizerI think for speed reasons we'll want to put all the compute hosts in the everything blob01:33
*** weshay has quit IRC01:34
*** sam_wan has joined #openstack-infra01:34
*** ddieterly has quit IRC01:35
nibalizerclarkb: so the controller error is just that it can't post to puppetdb01:36
*** ddieterly has joined #openstack-infra01:36
nibalizeroh you know what01:36
*** yonglihe has joined #openstack-infra01:36
nibalizeris that the controller fails on posting to puppetdb so ansible probably aborts the play01:36
nibalizerbecause the second step in that playbook is to run the compute hosts01:36
clarkbah01:36
clarkbthat makes sense01:36
nibalizerwhich is kinda what we want tb01:36
nibalizertbh01:36
*** jaypipes has quit IRC01:36
*** eil397 has quit IRC01:39
*** ddieterly has quit IRC01:40
*** yamamoto has joined #openstack-infra01:48
*** bpokorny has joined #openstack-infra01:49
*** tiswanso has joined #openstack-infra01:51
*** tiswanso has quit IRC01:51
*** tiswanso has joined #openstack-infra01:52
*** edmondsw_ has quit IRC01:56
*** EricGonczer_ has joined #openstack-infra02:00
*** yamamoto has quit IRC02:00
*** tzn has quit IRC02:00
*** zz_dimtruck is now known as dimtruck02:00
*** zhurong has joined #openstack-infra02:01
lifelesstonyb: ok os02:01
* tonyb suspects lifeless is trying to explain complex thoughts in a way I'll understand :D02:05
lifelessfailing at multiplexing :)02:06
*** thorst has joined #openstack-infra02:07
tonyblifeless: :D02:07
lifelesstonyb: so, I'll poke around doing a release to help you out02:07
lifelessbut I think its entirely bogus02:07
tonybthorst: where is the powervm channel?02:07
tonyblifeless: firstly thanks.02:07
tonyblifeless: next, do you want to talk it through?  I agree that it's *somewhat* bogus but not entirely wrong.02:08
tonyblifeless: we can always talk it over at the bugsmash02:09
lifelessdoing a change of something just to declare something else has changed because a third thing doesn't handle the interaction well02:10
lifelesstonyb: -> bogus02:10
*** MarkAtwood has joined #openstack-infra02:11
*** EricGonczer_ has quit IRC02:11
*** thorst has quit IRC02:14
tonyblifeless: ok. I s'pose that's one way to describe it.02:17
*** ganso has quit IRC02:19
*** krtaylor has quit IRC02:20
*** zhurong has quit IRC02:22
*** rhallisey has quit IRC02:22
*** zhurong has joined #openstack-infra02:22
*** armax has joined #openstack-infra02:26
*** EricGonczer_ has joined #openstack-infra02:27
openstackgerritIan Wienand proposed openstack/diskimage-builder: Don't remove python3 & grubby in 99-remove-extra-packages  https://review.openstack.org/24954102:30
*** tphummel has quit IRC02:30
*** krtaylor has joined #openstack-infra02:31
jrollmordred: ping me tomorrow? not sure if you needed something and only here for a sec02:33
clarkbjroll: this reminds me where is that change you need?02:33
clarkbthe one that we held off on earlier? it can go in now02:34
jrollclarkb: oh, sec02:34
jrollclarkb: https://review.openstack.org/#/c/265311/ ty in advance02:34
*** markvoelker has joined #openstack-infra02:36
lifelesstonyb: how would you describe it?02:38
*** markvoelker has quit IRC02:40
openstackgerritIan Wienand proposed openstack/diskimage-builder: Don't remove python3 & grubby in 99-remove-extra-packages  https://review.openstack.org/24954102:40
openstackgerritIan Wienand proposed openstack/diskimage-builder: Update default to F23  https://review.openstack.org/24729602:42
*** shashank_hegde has joined #openstack-infra02:42
openstackgerritMerged openstack-infra/project-config: Allow ironic jobs to run with tempest plugin  https://review.openstack.org/26531102:44
*** _sarob has quit IRC02:46
*** 18VAAAIFD has joined #openstack-infra02:47
*** binbincong has quit IRC02:48
*** EricGonczer_ has quit IRC02:50
tonyblifeless: your desription is fine, but I think it lacks the nuance that "something" and "something else" have a circular relationship and "third thing" is setuptools02:51
*** tzn has joined #openstack-infra02:57
*** rossella_s has quit IRC02:57
*** rossella_s has joined #openstack-infra02:58
*** changzhi has joined #openstack-infra02:58
*** gildub has quit IRC02:59
*** binbincong has joined #openstack-infra03:01
*** shashank_hegde has quit IRC03:02
*** Thelo has quit IRC03:02
*** armax has quit IRC03:03
*** rguillebert has quit IRC03:07
*** fedexo has joined #openstack-infra03:08
*** shashank_hegde has joined #openstack-infra03:10
*** thorst has joined #openstack-infra03:12
*** gongysh has joined #openstack-infra03:14
*** shashank_hegde has quit IRC03:15
*** salv-orlando has joined #openstack-infra03:16
*** thorst has quit IRC03:18
*** shashank_hegde has joined #openstack-infra03:19
*** changzhi has quit IRC03:22
*** changzhi has joined #openstack-infra03:22
*** shashank_hegde has quit IRC03:25
*** gildub has joined #openstack-infra03:28
*** salv-orlando has quit IRC03:28
*** tzn has quit IRC03:30
*** shashank_hegde has joined #openstack-infra03:37
*** dims has quit IRC03:37
tonybjhesketh: can you look at: http://logs.openstack.org/96/274796/1/gate/gate-nova-python34/d298d96/console.html03:43
tonybjhesketh: specifically: http://logs.openstack.org/96/274796/1/gate/gate-nova-python34/d298d96/console.html#_2016-02-16_03_22_50_67003:44
tonybjhesketh: "Build timed out (after 40 minutes). Marking the build as failed." zuul-cloner to 40mins to clone the nova repo?03:44
jheskethtonyb: hmm okay03:44
*** esikachev has joined #openstack-infra03:45
tonybjhesketh: Just thought I'd flag it in case it's a early warning sign of $trouble03:45
jheskeththanks03:46
* jhesketh looks03:46
*** piet has joined #openstack-infra03:47
*** esikachev has quit IRC03:49
*** KanagarajM has joined #openstack-infra03:51
openstackgerritCraig Vyvial proposed openstack-infra/project-config: run trove experimental run scenario tests  https://review.openstack.org/27809503:53
*** piet has quit IRC03:53
*** amotoki has joined #openstack-infra03:56
*** amotoki has quit IRC03:56
jheskethtonyb: so I can't see which git mirror you were actually bounced to but they all look okay according to cacti and the replication appears to be running without issue..  it also seems that most other clones are working03:56
tonybjhesketh: Thanks for looking.03:57
*** daemontool has quit IRC04:02
*** david-lyle has quit IRC04:03
openstackgerritMerged openstack-infra/project-config: Remove restrict-memory  https://review.openstack.org/28036404:04
*** ccrouch has quit IRC04:09
*** gildub has quit IRC04:09
*** thorst has joined #openstack-infra04:16
jheskethtonyb: seems to be a few occurances over the last week http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22*ERROR%3Azuul.Repo%3AUnable*%5C%2204:17
*** sam_wan has quit IRC04:18
jheskethdoesn't appear to be due to any particular jenkins master or region (well all the regions are rax, but because of the low number of failures and limited nodes I'm not sure if that's a correlation)04:19
tonybjhesketh: okay, the frequency seems to be increasing04:19
tonyblook at 7 days worth of data04:20
openstackgerritBertrand Roussel proposed openstack-infra/jenkins-job-builder: Description Setter Plugin support as builder  https://review.openstack.org/28041604:20
*** smanjara has joined #openstack-infra04:21
jheskethtonyb: right, it looks that way but we may just not have enough data from earlier04:22
tonybjhesketh: okay.04:22
tonybjhesketh: I might and an eleastic-recheck rule for it04:23
*** dimtruck is now known as zz_dimtruck04:23
jheskethtonyb: good idea04:23
*** thorst has quit IRC04:24
openstackgerritMerged openstack-infra/project-config: Cleanup the early devstack clone script  https://review.openstack.org/26888804:25
*** sam_wan has joined #openstack-infra04:26
*** MarkAtwood has quit IRC04:26
*** sputnik13 has joined #openstack-infra04:27
*** tzn has joined #openstack-infra04:27
*** sabeen1 has quit IRC04:28
*** sputnik13 has quit IRC04:31
jheskethtonyb: there are some weird git average server times here http://grafana.openstack.org/dashboard/db/git-load-balancer (very last graph)04:32
jheskethbut it's across multiple backends and it's not clear what that might imply04:32
*** changzhi has quit IRC04:32
openstackgerritThanh Ha proposed openstack-infra/zuul: Add additional zuul.conf information  https://review.openstack.org/27186804:34
*** gildub has joined #openstack-infra04:34
*** smanjara has quit IRC04:35
*** markvoelker has joined #openstack-infra04:36
tonybjhesketh: Yeah there's a lot of data there, I'd need more context to pull in information out.04:36
jheskethprobably the most interesting thing is that there isn't obviously one node doing something different04:37
jheskethso either it's very subtle or across all the backends04:37
tonybjhesketh: I'm assuming that I can't tell which server I got directed to?04:37
jheskethsadly no04:37
jheskeththat'd make things too easy04:37
tonyb:)04:37
tonybYeah there are some strange peaks there but nothing clearly and massivly wrong.04:38
jheskethand where there are peaks it's different nodes04:38
jheskethsadly I'm out of ideas where to look from here sorry :-s04:39
jheskethtonyb: fwiw the recheck looks like it'll work04:40
jheskethor at least not fail for any git reasons04:40
*** markvoelker has quit IRC04:41
*** tiswanso has quit IRC04:44
*** achanda has joined #openstack-infra04:48
tonybjhesketh: Yeah, Thanks for lettign me distract you.04:52
*** fawadkhaliq has joined #openstack-infra04:52
*** oomichi has joined #openstack-infra04:55
jheskethno worries04:55
*** david-lyle has joined #openstack-infra04:55
*** tzn has quit IRC05:00
*** shashank_hegde has quit IRC05:10
*** fedexo has quit IRC05:18
*** thorst has joined #openstack-infra05:21
*** baoli_ has quit IRC05:26
*** tphummel has joined #openstack-infra05:28
*** oomichi has quit IRC05:29
*** thorst has quit IRC05:29
*** tphummel has quit IRC05:30
*** changzhi has joined #openstack-infra05:32
*** bpokorny has quit IRC05:40
*** kushal has joined #openstack-infra05:41
*** coolsvap|away is now known as coolsvap05:56
*** tzn has joined #openstack-infra05:57
clarkbtonyb: jhesketh was that job in ovh?06:01
clarkbI wonder if the network trouble is back06:01
tonybrax06:01
clarkbhuh06:01
tonybclarkb: 2nd thing I checked :)06:01
jheskethclarkb: yeah all rax by the looks06:04
*** piet has joined #openstack-infra06:06
*** Sukhdev has joined #openstack-infra06:07
*** sridhar_ram has joined #openstack-infra06:10
*** piet has quit IRC06:11
*** MarkAtwood has joined #openstack-infra06:15
*** MarkAtwood has quit IRC06:19
*** gildub has quit IRC06:20
*** jaosorior has joined #openstack-infra06:20
*** vgridnev has joined #openstack-infra06:20
*** vgridnev has quit IRC06:21
*** vgridnev has joined #openstack-infra06:22
*** vgridnev_ has joined #openstack-infra06:23
*** vgridnev has quit IRC06:26
*** thorst has joined #openstack-infra06:27
*** tzn has quit IRC06:30
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/27992606:33
*** smanjara has joined #openstack-infra06:33
*** thorst has quit IRC06:34
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/28051606:37
*** markvoelker has joined #openstack-infra06:37
openstackgerritOmer Anson proposed openstack/requirements: Add scapy and python-pytun  https://review.openstack.org/27789306:37
*** [HeOS] is now known as HeOS06:38
*** achanda has quit IRC06:39
*** david-lyle has quit IRC06:39
*** sridhar_ram has quit IRC06:40
*** david-lyle has joined #openstack-infra06:40
*** k4n0 has joined #openstack-infra06:42
*** markvoelker has quit IRC06:42
*** salv-orlando has joined #openstack-infra06:43
*** zzzeek has quit IRC06:44
*** k4n0 has quit IRC06:44
*** tzn has joined #openstack-infra06:45
*** tzn has quit IRC06:45
*** tzn has joined #openstack-infra06:46
*** salv-orlando has quit IRC06:46
*** _nadya_ has joined #openstack-infra06:53
*** tzn has quit IRC06:55
*** MarkAtwood has joined #openstack-infra06:57
*** rossella_s has quit IRC06:57
*** coolsvap is now known as coolsvap|away06:58
*** rossella_s has joined #openstack-infra06:58
openstackgerritAkihiro Motoki proposed openstack-infra/project-config: Enable translation jobs for sahara-dashboard  https://review.openstack.org/28052006:59
*** achanda has joined #openstack-infra06:59
*** e0ne has joined #openstack-infra07:02
*** Liuqing has joined #openstack-infra07:05
openstackgerritgreghaynes proposed openstack/diskimage-builder: Move hook generation in to python  https://review.openstack.org/27113907:06
*** wolverineav has quit IRC07:08
*** smanjara has quit IRC07:10
openstackgerritgreghaynes proposed openstack/diskimage-builder: Move hook generation in to python  https://review.openstack.org/27113907:10
*** abregman has joined #openstack-infra07:13
openstackgerritMerged openstack-infra/project-config: puppet-ceph: do not run integ jobs for scenario002  https://review.openstack.org/27807207:14
openstackgerritMerged openstack-infra/project-config: Change networking-ovn rally job to use devstackgaterc  https://review.openstack.org/27992707:14
openstackgerritMerged openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/28051607:17
*** nmagnezi has joined #openstack-infra07:19
openstackgerritMerged openstack-infra/project-config: Specify master branch for the devstack plugins periodic job  https://review.openstack.org/28042507:20
*** wolverineav has joined #openstack-infra07:21
*** smanjara has joined #openstack-infra07:24
*** scheuran has joined #openstack-infra07:25
*** kiranr_ has joined #openstack-infra07:32
*** thorst has joined #openstack-infra07:32
*** _nadya_ has quit IRC07:32
*** gongysh has quit IRC07:33
*** kiranr_ is now known as kiran-r07:33
*** gsagie has joined #openstack-infra07:34
*** gsagie has left #openstack-infra07:34
*** rcernin has joined #openstack-infra07:37
*** thorst has quit IRC07:38
*** sbadia has quit IRC07:42
openstackgerritgreghaynes proposed openstack/diskimage-builder: Move hook generation in to python  https://review.openstack.org/27113907:43
*** jbernard has quit IRC07:43
*** jbernard has joined #openstack-infra07:43
*** ekarlso has quit IRC07:44
*** ruhe has quit IRC07:44
*** ruhe has joined #openstack-infra07:45
*** Anticimex has quit IRC07:45
*** vponomaryov has quit IRC07:45
*** vponomaryov has joined #openstack-infra07:45
*** loquacities has quit IRC07:45
*** aarefiev has quit IRC07:45
*** jeblair has quit IRC07:45
*** aarefiev has joined #openstack-infra07:46
*** kragniz has quit IRC07:46
*** Sukhdev has quit IRC07:46
*** kragniz has joined #openstack-infra07:46
*** Anticimex has joined #openstack-infra07:46
*** jeblair has joined #openstack-infra07:46
*** sbadia has joined #openstack-infra07:47
*** kozhukal` has joined #openstack-infra07:47
*** loquacities has joined #openstack-infra07:48
*** piet has joined #openstack-infra07:49
*** kozhukal` is now known as kozhukalov07:49
*** tzn has joined #openstack-infra07:50
*** fawadkhaliq has quit IRC07:51
*** fawadkhaliq has joined #openstack-infra07:52
*** fawadkhaliq has quit IRC07:52
*** fawadkhaliq has joined #openstack-infra07:52
*** fawadkhaliq has quit IRC07:53
*** flepied has quit IRC07:53
*** fawadkhaliq has joined #openstack-infra07:53
*** piet has quit IRC07:54
yolandagood morning07:55
openstackgerritgreghaynes proposed openstack/diskimage-builder: Don't cache debootstrap rootfs by default  https://review.openstack.org/28053607:56
*** samuelBartel has joined #openstack-infra07:56
yolandagreghaynes, around?07:56
*** ekarlso has joined #openstack-infra07:57
*** piet has joined #openstack-infra07:59
*** sorantis has joined #openstack-infra08:00
AJaegergood morning, yolanda !08:00
yolandahow are things today?08:01
AJaegercould you review https://review.openstack.org/278588 and https://review.openstack.org/280290 , please?08:02
*** sorantis_ has joined #openstack-infra08:02
yolandasure08:02
AJaegeryolanda: everything fine so far ;) Hope we don't have bad surprises ;)08:02
openstackgerritMerged openstack-infra/puppet-infracloud: Setup rabbit user/pass for keystone  https://review.openstack.org/27848208:02
openstackgerritMerged openstack-infra/system-config: Send keystone_rabbit_password parameter  https://review.openstack.org/27848508:03
yolandayesterday was crazy08:03
AJaegeryolanda: yeah ;( clarkb had some fun later as well since we noticed that some of the constraint macros were broken ;(08:04
AJaegerand he needed to manually run jjb again...08:04
AJaegerand restart jenkins04...08:04
AJaegeryolanda: https://review.openstack.org/280369 would be nice as well08:04
*** sorantis has quit IRC08:04
yolandaAJaeger, why were they broken? some bug on the jobs? or a malfunction of jjb?08:04
*** sorantis_ has quit IRC08:05
*** sorantis has joined #openstack-infra08:06
openstackgerritMerged openstack-infra/project-config: Promote neutron-src-neutron-lib job to check/gate  https://review.openstack.org/28044308:06
openstackgerritMerged openstack-infra/project-config: Check for astra misspelling  https://review.openstack.org/27914308:07
AJaegeryolanda: I863de2c3d5847e9c1943bb25e28b86a68871693f - the checkout of constraints file was broken for requiremetns repo. See 280369 as well. WE had one if in there but needed the second as well - and this macro was used in far too many jobs...08:07
*** jed56 has joined #openstack-infra08:08
openstackgerritMerged openstack-infra/project-config: Enable gate-infra-ansible on check and gate pipelines  https://review.openstack.org/28019708:08
AJaegerSo, everything fine for all repos except requirements - but that fix touched all of them ;(08:08
yolandaoh, when there is a massive job reconfig, it's really a pain08:08
*** coolsvap|away is now known as coolsvap08:09
AJaegeryes.08:10
openstackgerritMerged openstack-infra/project-config: Revert "Support stable requirements"  https://review.openstack.org/27858808:10
AJaegerSo, yesterday we cut down number of total jobs from 8700 to 8001 - that might help a tiny bit...08:10
openstackgerritMerged openstack-infra/project-config: Remove check requirements from Kingbird  https://review.openstack.org/28029008:10
*** MarkAtwood has quit IRC08:11
openstackgerritMerged openstack-infra/project-config: Sync zuul-git-branch-prep-upper-constraints  https://review.openstack.org/28036908:11
*** ociuhandu has joined #openstack-infra08:11
openstackgerritMerged openstack-infra/infra-ansible: Pin ansible package to stable 2.0.0.2  https://review.openstack.org/28017308:12
openstackgerritMerged openstack-infra/infra-ansible: Refactor setup_env.sh to use virtualenvs  https://review.openstack.org/28017208:12
*** infra-red has joined #openstack-infra08:13
*** e0ne has quit IRC08:13
AJaegerOh,NOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO ;(08:13
*** sshnaidm has quit IRC08:14
AJaegerThis one is old: https://jenkins07.openstack.org/job/gate-nova-pep8/configure08:14
AJaegeryolando, could you manually run jjb on jenkins07 again, please?08:14
AJaegerclarkb, I thought you updated all jenkins. What happened with 07? ^08:15
*** shardy has joined #openstack-infra08:16
yolandaok i'll run again if you don't call me yolando any more :)08:16
*** smanjara has quit IRC08:16
* AJaeger apologices08:17
AJaegeryolanda: I'm sorry08:17
yolandaheh, you are not the first calling me like that :)08:17
yolandaso i had a similar problem yesterday on some jenkins. Ansible was saying ok, but jjb had not run08:18
yolandai wonder how it traps the errors08:18
AJaegeryolanda, it was really a typo.08:18
*** mikelk has joined #openstack-infra08:18
* AJaeger just checked jenkins 01-07 - only 07 had this job wrong08:18
yolandaok running on 0708:19
*** tzn has quit IRC08:19
*** tzn has joined #openstack-infra08:20
*** smanjara has joined #openstack-infra08:21
AJaegerthanks08:21
nibalizerAJaeger: yolanda good morning08:21
yolandahi nibalizer08:21
*** kushal has quit IRC08:21
*** ociuhandu has quit IRC08:21
AJaegermorning, nibalizer !08:22
*** zeih has joined #openstack-infra08:24
*** ihrachys has joined #openstack-infra08:25
*** vgridnev has joined #openstack-infra08:26
*** coolsvap is now known as coolsvap|away08:26
openstackgerritAndrey Pavlov proposed openstack-infra/puppet-refstack: use specific tag version of refstack for installation.  https://review.openstack.org/27951108:26
*** vgridnev has quit IRC08:27
yolandaAJaeger, in the case of neutron jobs, but related to non-neutron projects, like gate-tempest-dsvm-neutron-src-oslo.service , do we need +1 from neutron liaison?08:27
*** flepied has joined #openstack-infra08:28
*** matrohon has joined #openstack-infra08:28
*** mikelk has quit IRC08:28
zeihAJaeger: around?08:29
*** vgridnev has joined #openstack-infra08:29
*** salv-orlando has joined #openstack-infra08:30
yolandabtw, AJaeger, cache corruption again on jenkins0708:30
yolandawe'll need to launch a massive reconfig again :(08:30
AJaegeryolanda: I don't think so, it'S a job for a non-neutron repo...08:30
AJaegeryolanda: :(08:30
AJaegerBut you can run that only on jenkins07...08:31
AJaegerzeih: yes, what's up?08:31
yolandaAJaeger yes, i'll do only on jenkins0708:31
*** vgridnev has quit IRC08:31
zeihAJaeger: I have a question about https://review.openstack.org/#/c/278459/08:31
AJaegeryolanda: clarkb mentioned yesterday not approving changes while doing a manual jjb run.08:32
yolandaok let's not approve anything else until it's done08:32
*** salv-orlando has quit IRC08:32
AJaegeryolanda: you might want to wait utnil 280328 has merged *and* puppet has moved the new files to jenkins0708:33
*** oomichi has joined #openstack-infra08:33
zeihAJaeger: There is a question regarding the OpenStack Proposal Bot. His use in non-master branches.08:33
* AJaeger abstains from +A now as well...08:33
AJaegerzeih: let me check08:33
zeihAJaeger: thx08:33
*** vgridnev_ has quit IRC08:33
*** smanjara has quit IRC08:34
*** tzn has quit IRC08:34
AJaegerzeih: what's the problem exactly? Not getting it quickly08:34
*** vgridnev has joined #openstack-infra08:34
*** tzn has joined #openstack-infra08:34
*** tzn has quit IRC08:34
AJaegerah, see it. You hvae "hacking<0.9,>=0.8.0" in https://review.openstack.org/#/c/278487/1/test-requirements.txt and that causes the failure.08:35
zeihAJaeger: After we updated requirements in master branch and enabled the job in project config, we enabled the Bot in global requirements repo. Now we want to update the reqs in stable/liberty branch too08:36
AJaegerDo the following: Manually update 278487 and update the hacking line as well to newer version08:36
yolandaAJaeger, i am worried but these daily cache problems. Seems that jjb is running in top of another on consecutive puppet runs, because we are hitting these invalid cache problems quite often08:36
AJaegeryolanda: best talk with clarkb and fungi later today - yes, this is really strange...08:36
openstackgerritMerged openstack-infra/project-config: Exlude gate-tempest-dsvm-neutron-src-oslo.service from stable/liberty  https://review.openstack.org/28032808:37
*** oomichi has quit IRC08:37
zeihAJaeger: Is the Bot resposible for updating in stable branches as well?08:37
AJaegerzeih: yes, it is.08:37
AJaegerbut updates happen rarely on these.08:38
AJaegerYou're still in the bootstrapping phase ;)08:38
*** jlanoux has joined #openstack-infra08:38
zeihAJaeger: yes we are :)08:38
*** vgridnev has quit IRC08:38
*** thorst has joined #openstack-infra08:39
*** ihrachys has quit IRC08:39
zeihAJaeger: So do I need to do this manually or do we just have to wait?08:39
*** vgridnev_ has joined #openstack-infra08:39
*** mikelk has joined #openstack-infra08:39
AJaegerzeih: you have to do it manually, the bot is not updating the hacking line08:39
AJaegerso, amend that change with changing the hacking line and merge it...08:40
AJaegeryolanda: I don't know either why this suddenly pops up...08:40
yolandaAJaeger, if jjb runs fast with small changes it should be ok. But with these jobs reconfigs of the latest days it fails, so i'm thinking that this can be the reason, jjb still running for long, and puppet executing again08:42
*** jlanoux has quit IRC08:42
AJaegeryolanda: what about disabling puppet for the manual run?08:42
*** vgridnev_ has quit IRC08:42
*** vgridnev has joined #openstack-infra08:43
yolandaAJaeger i did it on jenkins0708:43
AJaeger;)08:44
*** jlanoux has joined #openstack-infra08:44
zeihAJaeger: so.. I have to update hacking>=0.10.2,<0.11 like https://github.com/openstack/requirements/blob/stable/liberty/global-requirements.txt#L331  ?08:44
yolandabut yes, doing that when running the plays seems a good idea08:44
AJaegerzeih: yes08:44
*** jordanP has joined #openstack-infra08:44
*** vgridnev has quit IRC08:44
zeihAJaeger: thx. will try08:44
*** thorst has quit IRC08:44
*** yaume has joined #openstack-infra08:45
*** smanjara has joined #openstack-infra08:46
openstackgerritDimitri Mazmanov proposed openstack-infra/project-config: Add check-requirements job  https://review.openstack.org/28055008:46
*** piet has quit IRC08:47
AJaegeryolanda: wow, the temporary removal was really short - only an hour or so ^08:49
*** wolverineav has quit IRC08:49
yolandaoh dear08:49
yolandaok let's wait for jjb to finish on jenkins07 and we'll review again08:49
AJaegeryolanda: no worries, that one has time - they were blocked since they had a broken requirements file and the check job tests both the original file and the new one - and failed on the original one, so they had not chance to get it fixed ;(08:50
*** hashar has joined #openstack-infra08:50
yolandaAJaeger yes, i can understand that these things happen, we've hit this quite often downstream08:51
yolandasometimes the only way to fix a problem is disabling the jobs, or if you have powers, force pushing08:51
AJaegeryep08:51
* AJaeger will be back later, thanks yolanda for keeping our CI running!08:51
yolandaAJaeger no problem, glad to help. I will be leaving in an hour as well, will be out for a pair of hours08:52
yolandaAJaeger, you seem to be always working, early in the morning until late at night...08:52
*** fhubik has joined #openstack-infra08:53
*** fhubik is now known as fhubik_brb08:53
*** max_lobur has quit IRC08:56
anteayafungi: thank you08:58
*** jlanoux has quit IRC08:59
*** wolverineav has joined #openstack-infra09:01
*** jlanoux has joined #openstack-infra09:02
*** fhubik_brb is now known as fhubik09:03
*** achanda has quit IRC09:03
*** ihrachys has joined #openstack-infra09:03
*** wolverineav has quit IRC09:04
*** zeih has quit IRC09:05
*** |-paul-| has joined #openstack-infra09:05
*** bexelbie has quit IRC09:06
*** bexelbie has joined #openstack-infra09:06
*** achanda has joined #openstack-infra09:06
*** ifarkas has joined #openstack-infra09:07
*** zeih has joined #openstack-infra09:08
*** salv-orlando has joined #openstack-infra09:08
*** kiran-r has quit IRC09:08
*** max_lobur has joined #openstack-infra09:09
*** kiran-r has joined #openstack-infra09:09
*** sshnaidm has joined #openstack-infra09:16
*** e0ne has joined #openstack-infra09:16
*** _nadya_ has joined #openstack-infra09:18
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/infra-ansible: Create other required openstack resources  https://review.openstack.org/28056109:19
*** d0ugal has quit IRC09:21
*** d0ugal has joined #openstack-infra09:21
*** yamahata has quit IRC09:22
openstackgerritStefan Andres proposed openstack-infra/shade: Fix lookup for network parameter in neutron_available_floating_ips This change attempts to fix the network parameter in neutron_available_floating_ips: * old behavior ignores network parameter and guesses external net * new behavior takes name or id and s  https://review.openstack.org/28017809:22
*** max_lobur has quit IRC09:24
*** lucas-dinner is now known as lucasagomes09:24
*** achanda has quit IRC09:28
*** zhurong has quit IRC09:28
*** wwwbukolaycom has joined #openstack-infra09:28
*** dtantsur|afk is now known as dtantsur09:30
*** max_lobur has joined #openstack-infra09:32
*** akscram has quit IRC09:33
*** akscram has joined #openstack-infra09:33
*** sfinucan has joined #openstack-infra09:34
*** Thelo has joined #openstack-infra09:35
*** wewe0901 has joined #openstack-infra09:36
*** tpsilva has joined #openstack-infra09:37
*** zeih has quit IRC09:38
*** electrofelix has joined #openstack-infra09:38
anteayafungi madorn I am able to vote +2, +A on the sandbox repo: https://review.openstack.org/#/c/279763/109:39
AJaegeranteaya: yippie!09:39
anteayayippie!09:39
*** ihrachys has quit IRC09:39
anteaya:)09:39
*** zeih has joined #openstack-infra09:39
anteayaops meetup is going well09:40
AJaegerglad to hear!09:40
AJaegerhow many are there?09:40
anteayathe european operators have a very different approach to how they use openstack09:40
AJaegerInteresting - can you explain the difference?09:40
anteaya80 in the room right now?09:40
anteayathey _want_ to work with other openstack providers collaboratively09:41
AJaegergreat!09:41
anteayait is part of their business model09:41
anteayait is a lovely atmosphere to be in09:41
*** Liuqing has quit IRC09:41
*** thorst has joined #openstack-infra09:42
AJaegerand productive I guess?09:42
anteayawell it is a different paradigm so they have challenges it meeting rquirements for tenders since the evaluators are using old mental models09:42
*** ociuhandu has joined #openstack-infra09:43
anteayabut the long term view is very practical and very beneficial for providers and customers09:43
*** kushal has joined #openstack-infra09:43
AJaegercool09:45
anteayaI agree09:45
anteayait is highly enjoyable room to e sitting in09:46
mordredanteaya: yay!09:46
anteaya*be09:46
anteayayay!09:46
anteayamordred: morning09:46
*** fawadkhaliq has quit IRC09:48
*** ihrachys has joined #openstack-infra09:48
*** fawadkhaliq has joined #openstack-infra09:48
*** thorst has quit IRC09:49
AJaegermorning, mordred !09:49
*** tzn has joined #openstack-infra09:49
*** ociuhandu has quit IRC09:50
*** fawadkhaliq has quit IRC09:50
*** fawadkhaliq has joined #openstack-infra09:50
*** tzn has quit IRC09:51
*** tzn has joined #openstack-infra09:51
mordredanteaya, AJaeger: morning!09:51
*** ociuhandu has joined #openstack-infra09:53
*** fawadkhaliq has quit IRC09:54
*** fawadkhaliq has joined #openstack-infra09:55
AJaegeryolanda: did jenkins07 manual jjb run finish already?09:56
yolandaAJaeger, still running09:57
openstackgerritJesse Keating proposed openstack-infra/project-config: Add giftwrap to OpenStack  https://review.openstack.org/28030509:58
yolandai'd expect at least one hour, it's on "gate-x*" jobs now09:58
AJaegeryolanda: I looked at the wrong job and that one is updated already, so moving in the right direction...09:59
*** ganso has joined #openstack-infra09:59
*** tzn has quit IRC09:59
AJaegeryolanda: gate-x is 5000 of 8000 - yeah, so indeed another hour10:00
yolandai'm leaving now, the jjb reconfig is running on a screen session, and i'll check when i come back so i can reenable puppet on jenkins0710:00
AJaegerthanks, yolanda10:00
*** tzn has joined #openstack-infra10:01
*** salv-orl_ has joined #openstack-infra10:02
*** wolverineav has joined #openstack-infra10:04
*** salv-orlando has quit IRC10:05
*** piet has joined #openstack-infra10:06
*** Liuqing has joined #openstack-infra10:06
*** jcoufal has joined #openstack-infra10:07
*** placko_ has joined #openstack-infra10:07
*** andymaier has joined #openstack-infra10:09
*** wolverineav has quit IRC10:09
*** vgridnev has joined #openstack-infra10:14
*** vgridnev has quit IRC10:14
*** vgridnev has joined #openstack-infra10:15
trashCan someone tell me what the exact pep8 error in http://logs.openstack.org/78/280178/4/check/gate-shade-pep8/e293a01/console.html shall be? I cannot find one10:19
*** rguillebert has joined #openstack-infra10:19
anteayatrash: how interesting, the log doesn't share what the error is, just that flake8 was the command that errored: http://logs.openstack.org/78/280178/4/check/gate-shade-pep8/e293a01/console.html#_2016-02-16_09_28_17_09710:21
*** fhubik is now known as fhubik_brb10:21
*** fhubik_brb is now known as fhubik10:21
anteayabut the error didn't get reported back to the log10:21
trashYeah, strange. flake8 doesn't report any errors locally.10:21
anteaya:(10:21
anteayamakes it difficult to fix the code so it passes10:22
*** yaume has quit IRC10:22
trashTotally :/10:23
*** andymaier has quit IRC10:23
*** yaume has joined #openstack-infra10:23
*** sorantis has quit IRC10:23
trashIt's guessing time I guess.10:24
anteayamordred: the shade pep8 test calls flake8 and flake8 doesn't report errors back up to be logged making it challenging for devs to have compliant patches, have you any recommendations?10:24
openstackgerritStefan Andres proposed openstack-infra/shade: Fix lookup for network parameter in neutron_available_floating_ips This change attempts to fix the network parameter in neutron_available_floating_ips: * old behavior ignores network parameter and guesses external net * new behavior takes name or id and s  https://review.openstack.org/28017810:24
*** yaume has quit IRC10:24
trashI am also wondering why the description isn't updated anymore when I push an updated code set10:24
anteayatrash: have you an example?10:25
trashThe link openstackgerrit just pasted10:25
*** yaume has joined #openstack-infra10:25
*** yaume has quit IRC10:25
trashIt misses the line below the last '*' => https://github.com/syseleven/shade/commit/4fea2bd790918fe191f7efa59131f42a3fcfa8c610:25
*** zeih has quit IRC10:26
*** vgridnev has quit IRC10:26
*** jlanoux has quit IRC10:26
*** jlanoux has joined #openstack-infra10:27
anteayatrash: oh you are stefan, 280178 is your patch10:28
trashanteaya: Yep10:28
trash(trying to add unit tests this afternoon)10:29
anteayaare you talking about the commit message?10:29
anteayatrash: have you read: http://docs.openstack.org/infra/manual/developers.html#updating-a-change10:30
*** sam_wan has quit IRC10:30
*** zeih has joined #openstack-infra10:30
trashI have 3 topics to this change :-) 1. the commit msg is not the one I put in git (see the original github one) 2. the last build did not show the actual flake8 error. Waiting on current build 3. (my task) I will write unit tests later today hopefully10:31
anteayawhat do you mean the original github one?10:31
AJaegertrash: github? I'm confused. Github is just a mirror....10:31
anteayaare you submitting patches to github?10:31
trashYes, original is the wrong word for it10:31
trashI've also pushed it to github so that I have a pip source to install this version from10:32
trash(besides the actual original openstack-infra one)10:32
trashSorry to have confused you.10:32
anteayaI think we need to use gerrit for reference for the patch: https://review.openstack.org/#/c/280178/510:32
anteayawe support patches submitted to gerrit10:32
trashAh, now it shows the correct commit msg.10:32
anteayawe have no support for patches submitted to github10:32
trashYes.10:32
mordredanteaya: uh. that's weird - have you seen anything lke that AJaeger ?10:33
trashI know, I know. We just misunderstood. That part is clear.10:33
anteayatrash: great10:33
mordredtrash: next time you update the patch, could you put a blank line in between the first and second lines of the commit message - otherwise things get confused and think the entire commit message is the subject :)10:33
mordredtrash: no rush or anything10:33
mordredtrash: I tried your patch locally with 'tox -epep8' and it ran fine10:33
*** jlanoux has quit IRC10:33
mordredso I'm not sure what the issue is in the CI job :(10:33
openstackgerritLucas Alvares Gomes proposed openstack/diskimage-builder: Install IPA in a virtual enviroment  https://review.openstack.org/23584310:34
anteayatrash: mordred's comment is the same as the one I left on your patch10:34
*** vgridnev has joined #openstack-infra10:34
trashmordred: Yeah, I did that initiall but then the update did not update, so I thought it had a problem with it :-)10:34
*** jlanoux has joined #openstack-infra10:34
*** zeih has quit IRC10:35
trashThe only "rush" is my company, this bug prevents ansible working for us with the offical ansible openstack module, so we want it upstream as soon as possible :-)10:35
mordredtrash: heh :)10:35
openstackgerritLucas Alvares Gomes proposed openstack/diskimage-builder: Install IPA in a virtual environment  https://review.openstack.org/23584310:35
AJaegermordred: no, haven't see that pep error10:35
mordredtrash: the patch looks good in general -I'm just waking up but will review in just a bit10:36
trashmordred: Thank you for your time10:36
Zaraanyone want to virtually attend tomorrow's storyboard meetup? there's no cake, but there could be ascii.10:36
AJaegertox -e pep8 works for me locally as well on the change10:36
AJaegerZara: no cake? That's sad :((10:36
ZaraAJaeger: there's cake in-person! I'm just not mailing it out. :P10:37
Zarait has icing; I'd be banned from using the postal service ever again.10:37
anteayacake!10:37
anteayacake with icing!10:38
anteayammmmm10:38
*** dosaboy has quit IRC10:38
* AJaeger is envious ;) and thinks you'll have a great storyboard meeting tomorrow!10:38
*** gongysh has joined #openstack-infra10:38
Zara:) thanks, hope so10:39
mordredtrash: oh - you're at syseleven. say hello to martin and kristian for me10:39
anteayaZara: you will be there, it already is a success in my mind :)10:40
Zaraaw, that's so nice of you! :')10:40
anteaya:)10:40
mordredtrash: I wonder if maybe the logic shouldn't be inverted10:41
*** dosaboy has joined #openstack-infra10:41
trashmordred: hehe, will do10:41
*** asettle has joined #openstack-infra10:41
mordredtrash: like, if you provide a network name, there is no need to have shade look for a network - perhaps put the networks = self.get_external_networks() in the else block?10:41
Zaraanteaya: same to you, btw.10:41
anteaya:)10:42
*** rfolco has joined #openstack-infra10:45
jlkHi folks, I could use a hand with something. I'm working on bringing a new project in, giftwrap, but I have to publish it to pypi as "python-giftwrap". I can't figure out what I need to change in my project-config PR to indicate that the pypi name doesn't exactly match the project name.10:45
trashmordred: Ah, good point. I can do that.10:46
jlkhttps://review.openstack.org/#/c/280305/ is the review for it.10:46
mordredjlk: it's ok - as long as setup.cfg is correct, the publication system will do the right thing10:46
AJaegerjlk: just mention it in the project-config review10:47
AJaegerAdd it to commit message10:47
*** thorst has joined #openstack-infra10:47
jlkokay.10:47
mordredjlk: you'll want to change https://github.com/blueboxgroup/giftwrap/blob/master/setup.cfg#L2 to name = python-giftwrap10:47
AJaegerAnd we trust that you set up your actual repo so that it does publish that way10:47
openstackgerritJesse Keating proposed openstack-infra/project-config: Add giftwrap to OpenStack  https://review.openstack.org/28030510:48
*** erlon has joined #openstack-infra10:48
jlkAJaeger: thanks. I'm poking at setup.cfg now10:49
mordredjlk: I sent you PR10:49
jlkLooks like I need to...10:50
jlkoh10:50
mordredjlk: but feel free to ignore it :)10:50
*** yaume has joined #openstack-infra10:50
*** ldnunes has joined #openstack-infra10:50
AJaegerjlk: Would be also great if the commit message would contain more information about what giftwrap is and how it fits into the OpenStack Ecosystem.10:50
jlkAJaeger: sure, let me do that too10:51
AJaegerjlk, I'll review at a later time in more details...10:51
*** dims has joined #openstack-infra10:51
openstackgerritMax Lobur proposed openstack-infra/project-config: Create openstack/ramdisk-func-test repository  https://review.openstack.org/27912010:52
anteayajlk: here is the patch for a project that got accepted by the tc: https://review.openstack.org/#/c/213183/10:54
anteayajlk: as an example of the commit message and discussion10:54
*** thorst has quit IRC10:54
jlkthanks, I'll amend a bit more.10:56
* anteaya nods10:56
*** rossella_s has quit IRC10:57
*** rossella_s has joined #openstack-infra10:58
AJaegerjlk, also I suggest you start first with becoming part of OpenSTack - meetings, discussions etc in the open and then apply. Right now nobody has ever heard of giftwrap... With your change in, you can start to change that and show that there's a team that works the OpenStack way10:58
openstackgerritStefan Andres proposed openstack-infra/shade: Fix lookup for network parameter in neutron_available_floating_ips  https://review.openstack.org/28017810:58
anteayatrash: nice commit title10:58
*** zeih has joined #openstack-infra10:59
trash:-)10:59
*** piet has quit IRC10:59
jlkAJaeger: yeah, it's known within the operator community, just not in the wider dev community10:59
AJaegerah...10:59
mordredtrash: looks great. Shrews and SpamapS will want a unit test - but I think the substance of your patch is solid11:00
*** notnownikki has joined #openstack-infra11:01
openstackgerritMax Lobur proposed openstack-infra/project-config: Create openstack/ramdisk-func-test repository  https://review.openstack.org/27912011:01
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/27992611:02
*** zeih has quit IRC11:03
trashmordred: Thanks. Yeah, I'll take a look at unit tests later. Unfortunately this part was not covered before, so it's more work for me11:04
trashanteaya: I found out why my commit msg was not updated in gerrit. The selection of the patch set was still set to 2/6, instead of the latest one in the UI ;-)11:05
mordredtrash: oh bother. we don't have any unittests in that stack? that's an ugly stack to ask you to put a new unit test on11:05
anteayatrash: yeah that fun feature trips up a lot of us :(11:05
trashmordred: You do, but not for those functions11:05
*** changzhi has quit IRC11:05
openstackgerritMerged openstack-infra/shade: Add test option to use Ansible source repo  https://review.openstack.org/27964611:06
*** aysyd has joined #openstack-infra11:06
trashhttps://github.com/openstack-infra/shade/blob/master/shade/tests/functional/test_network.py is the closest one I can find, I have even no idea what environment I need to actually run those tests. Is there any documentation on that? I cannot find anything in the repo itself.11:06
openstackgerritJesse Keating proposed openstack-infra/project-config: Add giftwrap to OpenStack  https://review.openstack.org/28030511:07
mordredtrash: it's done in a devstack plugin11:12
*** dims has quit IRC11:12
*** piet has joined #openstack-infra11:13
trashmordred: How is that usually used? I mean, while developing the test, I probably want to trigger it multiple times. I would not want to spam the gerrit with it11:13
BobBallWhere does zuul get the required node from?  I'm getting a NOT_REGISTERED however my projects.yaml has node: 'ds-xen' which is the same name as nodepool creates and the label showing in jenkins11:14
mordredtrash: test_add_auto_ip in shade/tests/unit/test_floating_ip_common.py might be an easier thing to start from11:14
*** fhubik has quit IRC11:14
mordredtrash: you can also run functional tests against an existing cloud - but I realize I do not have documentation for doing thtat11:15
mordredtrash: (I will add that to my todo list :) )11:15
*** ildikov_ has quit IRC11:15
trashmordred: This part is even more related, yep - I'll see what I can do with that11:15
mordredtrash: oh - or test_available_floating_ip_existing11:15
mordredin shade/tests/unit/test_floating_ip_neutron.py11:15
mordredis even closer11:16
*** vgridnev_ has joined #openstack-infra11:16
*** tzn has quit IRC11:16
*** vgridnev_ has quit IRC11:16
trashCool, thanks for looking it up.11:16
anteayaBobBall: what project and can you link to the patch wtih NOT_REGISTERED?11:16
*** esikachev has joined #openstack-infra11:17
*** asettle has quit IRC11:17
anteayaBobBall: I know yolanda was updating the jjb jobs manually on at least one jenkins, not sure if this is related or not11:17
openstackgerritLucas Alvares Gomes proposed openstack/diskimage-builder: Install IPA in a virtual environment  https://review.openstack.org/23584311:17
BobBall3rd party CI - https://review.openstack.org/#/c/279661/111:17
anteayaoh i see11:17
anteayaokay well our experience of not registered happens when the node the jenkins believes the test should run on and the node that zuul thinks the job should run on are mutually exclusive11:18
*** vgridnev has quit IRC11:19
anteayado you run a xml diff test on your yaml files to ensure they are resulting in the xml you are expecting?11:19
*** vgridnev has joined #openstack-infra11:19
BobBallYup; but where does zuul know about the node?  I have the right node (ds-xen) in nodepool and jenkins_jobs but there is no reference to the node in zuul's layout.yaml afaict11:20
*** hashar has quit IRC11:23
*** dims has joined #openstack-infra11:24
anteayathere isn't that is true11:24
anteayado you run anything like http://logs.openstack.org/60/280360/1/check/gate-project-config-compare-xml/b421787/console.html on your yaml files?11:24
*** zeih has joined #openstack-infra11:25
*** vgridnev has quit IRC11:25
anteayathis log tells us what assigned node the xml believes is correct: http://logs.openstack.org/60/280360/1/check/gate-project-config-compare-xml/b421787/console.html#_2016-02-15_19_02_28_28711:25
eantyshevBobBall: Are you talking of 3rd-party CI? We see this problem when somehow Jenkins doesn't see required nodes. do you see "ds-xen"  registered in your Jenkins?11:26
anteayaeantyshev: thank you11:26
BobBalleantyshev: yes11:26
BobBalleantyshev: to both11:26
*** jlanoux has quit IRC11:27
BobBallanteaya: And I've checked in jenkisn and the xml and the assignedNode is ds-xen in both cases.11:27
eantyshevDoes this node have the tags which are set in JJB?11:27
*** vgridnev has joined #openstack-infra11:27
*** sdague has joined #openstack-infra11:27
BobBallNot sure what you mean by that eantyshev11:27
*** jlanoux has joined #openstack-infra11:28
anteayaBobBall: great thank you11:28
*** achanda has joined #openstack-infra11:28
*** wznoinsk has joined #openstack-infra11:28
eantyshevBobBall: node tags are constrains you specify in you jobs11:28
wznoinskhi guys, I'm about to install downstream-ci/puppet as you call it11:29
anteayaso if the xml believes the assignedNode is ds-xen and ds-xen is registered in your Jenkins I'm at a loss as to what is causing the NOT_REGISTERED :(11:29
*** ociuhandu has quit IRC11:29
eantyshevanteaya, BobBall: AFAIU, node names are irrelevant, only tags matter11:29
*** zeih has quit IRC11:30
*** tzn has joined #openstack-infra11:30
eantyshevBobBall: tags = labels11:30
eantyshevsorry for misnaming them11:30
wznoinskcould you tell me that's the guide I should follow? : http://docs.openstack.org/infra/openstackci/third_party_ci.html11:30
*** zeih has joined #openstack-infra11:30
*** piet has quit IRC11:31
BobBalleantyshev: I don't see a "label" in any of the config files ?11:31
wznoinskor is there any more recent guide I should follow?11:31
BobBalleantyshev: http://paste.openstack.org/show/487088/ is a reduced config11:31
eantyshevBobBall: what labels are there for "ds-xen" you see in Jenkins?11:31
BobBalleantyshev: the job dsvm-tempest-xen has "label expression" ds-xen and "Label is serviced by 2 nodes" comment (showing it matches up with the nodes created by nodepool)11:32
eantyshevBobBall: "ds-xen" is a label, true11:33
eantyshevwznoinsk: I don't remember anything more actual11:34
*** achanda has quit IRC11:34
wznoinskeantyshev, thanks11:34
*** esikachev has quit IRC11:34
*** esikachev has joined #openstack-infra11:35
*** d0ugal has quit IRC11:36
eantyshevBobBall: "Label is serviced by 2 nodes" means "ds-xen"-named Jenkins node really has this label?11:36
BobBallyes eantyshev11:36
BobBallSlave ds-xen-rax-iad-772 (Dynamic single use ds-xen node) indeed has "Labels ds-xen"11:37
eantyshevBobBall: then AFAIU it should work, at least I have similar layout and it works11:38
*** dims has quit IRC11:38
*** dizquierdo has joined #openstack-infra11:39
*** gibi has quit IRC11:39
*** gibi has joined #openstack-infra11:39
*** asettle has joined #openstack-infra11:39
*** sdague has quit IRC11:39
BobBallyeah... I used to have a very similar setup working, but it got destroyed, and now I can't figure out the missing magic glue11:40
*** 18VAAAIFD has quit IRC11:40
*** Douhet has quit IRC11:41
eantyshevBobBall: have no thoughts, sorry :(11:43
*** sambetts has quit IRC11:43
*** sdague has joined #openstack-infra11:44
*** ildikov_ has joined #openstack-infra11:44
*** sambetts has joined #openstack-infra11:44
*** fawadkhaliq has quit IRC11:45
*** fawadkhaliq has joined #openstack-infra11:45
*** fawadkhaliq has quit IRC11:46
*** Qiming has joined #openstack-infra11:46
*** fawadkhaliq has joined #openstack-infra11:46
*** fawadkhaliq has quit IRC11:47
*** fawadkhaliq has joined #openstack-infra11:47
*** jlanoux has quit IRC11:47
*** fawadkhaliq has quit IRC11:47
*** fawadkhaliq has joined #openstack-infra11:48
*** thorst has joined #openstack-infra11:52
openstackgerritJesse Keating proposed openstack-infra/project-config: Add giftwrap to OpenStack  https://review.openstack.org/28030511:52
*** Daisy has joined #openstack-infra11:54
anteayareed: have you a link to the etherpad with all the other links to the etherpads for the ops meetup?11:55
anteayareed: I can't seem to find tom on irc11:55
*** abregman is now known as abregman|brb11:56
AJaegersdague: your constraints change plus a fix for it merged and nova should be able to use it now for more jobs.11:57
AJaegersdague: what should be done with other repos that are doing constraints already - or want to go there?11:57
*** ildikov_ has quit IRC11:59
*** jlanoux has joined #openstack-infra11:59
*** thorst has quit IRC11:59
*** infra-re_ has joined #openstack-infra12:00
*** d0ugal has joined #openstack-infra12:00
*** d0ugal has quit IRC12:00
*** d0ugal has joined #openstack-infra12:00
*** Douhet has joined #openstack-infra12:01
*** Daisy has quit IRC12:01
*** dprince has joined #openstack-infra12:01
*** Daisy has joined #openstack-infra12:02
*** infra-red has quit IRC12:03
*** ociuhandu has joined #openstack-infra12:04
*** kzaitsev_mb has joined #openstack-infra12:05
*** sdake has quit IRC12:06
anteayareed: found it: https://etherpad.openstack.org/p/MAN-ops-meetup12:06
*** fawadkhaliq has quit IRC12:06
*** fawadk has joined #openstack-infra12:06
*** sdake has joined #openstack-infra12:06
*** Qiming has quit IRC12:08
*** fawadk has quit IRC12:11
anteayathe amount of folks putting their name in the etherpad for the ops meetup is impressive12:12
*** Qiming has joined #openstack-infra12:12
anteayaI made an announcement the first day asking them to do so and telling them the benefits and they are adding their names \o/12:12
*** ericksonsantos has joined #openstack-infra12:13
*** smarcet has joined #openstack-infra12:17
*** Qiming has quit IRC12:17
*** jcoufal has quit IRC12:17
*** zeih has quit IRC12:18
*** Jeffrey4l has quit IRC12:18
*** pcaruana has joined #openstack-infra12:18
*** asettle has quit IRC12:20
*** Daisy has quit IRC12:22
*** Daisy has joined #openstack-infra12:23
jlkMy projects review is failing a test, http://logs.openstack.org/05/280305/8/check/gate-project-config-layout/d5f8445/console.html  and I think its "2016-02-16 12:12:22.078 | Job giftwrap-docs not defined"  but I'm not sure. I'm also not sure how to define that, or if I need to.12:23
AJaegerjlk, let me check and comment...12:26
*** Daisy has quit IRC12:27
sdaguejlk: I just commented on your governance change. I think you should just work on the project-config bits first and get the project off and running that way.12:28
*** [HeOS] has joined #openstack-infra12:28
jlksdague: I've just replied, but the docs I've been following told me to get the governance merged first, as did AJaeger in my project-config review.12:29
jlkI'm just trying to follow the directions...12:29
*** HeOS has quit IRC12:29
sdaguejlk: ok, which directions are these?12:29
*** yamamoto has joined #openstack-infra12:30
sdaguethere is also probably nuance missing in them12:30
jlkhttp://docs.openstack.org/infra/manual/creators.html#add-new-repository-to-the-governance-repository12:30
*** Jeffrey4l has joined #openstack-infra12:31
*** achanda has joined #openstack-infra12:31
sdagueAdding a new top level effort under the big tent is still kind of a big process. And based on the last 6 months, needs a contribution history in the open.12:32
*** tiswanso has joined #openstack-infra12:32
*** tiswanso has quit IRC12:33
jlkis github "in the open" enough?12:33
*** tiswanso has joined #openstack-infra12:34
sdagueno. In the open means "acts like openstack", so the review process, testing model, etc (in this context)12:34
jlkalright.12:34
sdaguesorry, still caffinating, so words aren't always as clear as they should be12:34
*** lucasagomes is now known as lucas-hungry12:35
jlkWhat's not clear to me is how I enter the "do things in the open" phase. I'm only marginally distracted here at ops meet up, but I'll do whatever we need to do, I just need to know how to do it.12:35
yolandahi AJaeger, i'm back. And jenkins07 is still building12:35
* jlk is grabbing lunch12:35
yolandait should be nearly finished,it's removing old jobs. It seems that yesterday it didn't finish properly12:36
AJaegerjlk, talk with mordred or anteaya ;)12:36
*** zeih has joined #openstack-infra12:36
AJaegeryolanda: is there an ansible timeout it run into as well? This is strange ;(12:36
sdaguejlk: my recommendation. Drop the governance change for now, get things imported into gerrit with project-config. Get the testing setup and working over there. Once that is all sorted and running, circle back around on goverance is that's your intent12:37
*** achanda has quit IRC12:37
sdaguealso, as I see mordred is proposing commits, he should also be able to advise, shephard here12:38
sdaguejlk: also, that explains why you are awake :)12:38
*** Daisy has joined #openstack-infra12:39
*** thiagop has joined #openstack-infra12:40
AJaegerI agree with sdague.12:41
*** andrey-mp has joined #openstack-infra12:41
jlkI can do that. Was there some part of the docs that would have guided me through this?12:41
jlkI kind of feel like I fell into a trap :)12:41
AJaegeranteaya, can you sit together with jlk and review the Creator's Guide page - and see whether there's anything to improve?12:42
*** Daisy has quit IRC12:43
*** rhallisey has joined #openstack-infra12:43
samueldmqhi12:45
samueldmqI don't know if it's the rigth channel to ask, but someone here might know12:45
samueldmqis there a schedule already set for Newton midcycle?12:45
*** abregman|brb is now known as abregman12:45
AJaegersamueldmq: which project?12:46
AJaegersamueldmq: I haven't seen any project discussion a Newton midcycle yet...12:46
samueldmqAJaeger: there is a general schedule projects follow right ? I am talking about that12:47
*** zeih has quit IRC12:48
*** baoli has joined #openstack-infra12:48
*** _sarob has joined #openstack-infra12:48
samueldmqAJaeger: something like https://wiki.openstack.org/wiki/Liberty_Release_Schedule12:49
*** weshay has joined #openstack-infra12:49
AJaegersamueldmq: but that page has nothing to do with midcycles12:49
AJaegersamueldmq: Sorry, I cannot help you.12:49
samueldmqAJaeger: oh I said midcycle12:50
samueldmqAJaeger: I meant Newton cycle, not midcycle12:50
samueldmqAJaeger: sorry12:50
*** thorst has joined #openstack-infra12:50
*** thorst_ has joined #openstack-infra12:51
openstackgerritKanagaraj Manickam proposed openstack-infra/project-config: Adds new project os-namos  https://review.openstack.org/28066212:51
*** gordc has joined #openstack-infra12:51
thorst_tonyb: Sorry - didn't see your q till now.  The PowerVM channel is #openstack-powervm12:52
AJaegersamueldmq: ask on #openstack-release12:52
*** ildikov has joined #openstack-infra12:52
*** baoli has quit IRC12:53
*** _sarob has quit IRC12:53
samueldmqAJaeger: perfect, that should be the right place, thanks!12:53
AJaegersdague: your nova change is broken, did you check the coverage and api changes?12:54
sdagueAJaeger: ? it passed12:54
sdagueoh, api-guide did not12:54
AJaegersdague: and you changed the coverage job that you did not test12:55
*** zeih has joined #openstack-infra12:55
sdagueright12:55
*** thorst has quit IRC12:55
*** weshay has quit IRC12:55
AJaegersdague: what should be done with other repos that are doing constraints already - or want to go there?12:55
*** dtardivel has joined #openstack-infra12:56
AJaegersdague: one example https://review.openstack.org/26198212:56
AJaegersdague: but there's also glance, neutron that are playing with constraints - or have gone there12:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Support GitHub PR webhooks  https://review.openstack.org/16311712:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Make the string representation of change transparent  https://review.openstack.org/23894812:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Lower the log level in tests  https://review.openstack.org/26336412:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Merge pull requests from github reporter  https://review.openstack.org/24325012:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Encapsulate determining the event purpose  https://review.openstack.org/24748712:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Fix job hierarchy bug.  https://review.openstack.org/19245712:56
openstackgerritJan Hruban proposed openstack-infra/zuul: support github pull reqeust labels  https://review.openstack.org/24742112:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Add 'push' and 'tag' github webhook events.  https://review.openstack.org/19120712:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Add 'pr-comment' github webhook event  https://review.openstack.org/23920312:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Support for dependent pipelines with github  https://review.openstack.org/24750012:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Configurable SSH access to GitHub  https://review.openstack.org/23913812:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Allow github trigger to match on branches/refs  https://review.openstack.org/25844812:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Allow using webapp from connections  https://review.openstack.org/21564212:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Allow list values in template parameters.  https://review.openstack.org/19120812:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Add basic Github Zuul Reporter.  https://review.openstack.org/19131212:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Support for github commit status  https://review.openstack.org/23930312:56
openstackgerritJan Hruban proposed openstack-infra/zuul: Better merge message for GitHub pull reqeusts  https://review.openstack.org/28066712:56
*** boris-42 has joined #openstack-infra12:56
*** rlandy has joined #openstack-infra12:57
sdagueAJaeger: honestly, I was not solving up for fixing the universe here12:57
*** weshay has joined #openstack-infra12:58
* AJaeger had hoped so ;)12:58
AJaegercould you at least write a short email, pointing to your nova change, to explain what projects can do?12:58
sdagueonce it works12:58
AJaeger;)12:59
sdagueor I'll nudge lifeless to, as this was really part of his larger constraints effort12:59
jlkAJaeger: your comment cut off. "To fix your problem,add"  and nothing else.12:59
jlkhttps://review.openstack.org/#/c/280305/8/jenkins/jobs/projects.yaml@170813:00
yolandaAJaeger, jenkins07 finished13:00
*** |-paul-| has quit IRC13:00
AJaegeryippie, yolanda !13:00
yolandai reenabled puppet on it13:00
AJaegerjlk: I forgot to delete that part of the sentence, ignore it. The fix is on the next file...13:01
AJaegerthanks, yolanda13:01
jlkokay13:01
yolandano problem13:01
AJaegersdague: yes, asking lifeless and Nakato (?) is another option13:02
*** edmondsw has joined #openstack-infra13:03
*** ihrachys has quit IRC13:04
*** julim has joined #openstack-infra13:05
*** vgridnev has quit IRC13:05
*** zhurong has joined #openstack-infra13:05
*** dizquierdo has quit IRC13:07
*** dkranz has joined #openstack-infra13:08
*** ihrachys has joined #openstack-infra13:08
*** vgridnev has joined #openstack-infra13:10
openstackgerrityolanda.robla proposed openstack/diskimage-builder: Add force-confdef in debian package install  https://review.openstack.org/28068213:10
openstackgerritStephen Gordon proposed openstack-infra/project-config: Skip magnum functional test jobs on docs changes  https://review.openstack.org/27789213:11
*** doug-fish has joined #openstack-infra13:14
*** ildikov has quit IRC13:18
*** ddieterly has joined #openstack-infra13:18
openstackgerritJan Hruban proposed openstack-infra/zuul: Better merge message for GitHub pull reqeusts  https://review.openstack.org/28066713:19
*** tiswanso has quit IRC13:19
*** tiswanso has joined #openstack-infra13:20
*** KanagarajM has quit IRC13:21
andrey-mpHello!13:22
andrey-mpCould anybody help us with https://review.openstack.org/#/c/279511/ ?13:22
*** [1]Thelo has joined #openstack-infra13:22
*** Thelo has quit IRC13:24
*** [1]Thelo is now known as Thelo13:24
andrey-mpwe want to separate Refstack releases from development13:25
*** zeih has quit IRC13:25
mordredandrey-mp: can I make a suggestion to achieve your goal differently?13:25
andrey-mpyeah13:26
smarcetfungi: morning, seems that openstackid production deployment is stuck since yesterday http://puppetboard.openstack.org/node/openstackid.org13:26
smarcetdont know why13:26
smarcetplease advice13:26
mordredandrey-mp: instead of putting version to deploy into the puppet - why not start making pypi releases from tags and set the puppet to install latest from pypi?13:26
mordredandrey-mp: that way you do not need to get an infra patch approved to bump a release13:26
mordredyou only have to make the tag on the refstack repo13:27
openstackgerritJesse Keating proposed openstack-infra/project-config: Add giftwrap to OpenStack  https://review.openstack.org/28030513:27
mordredbut you can still make multiple commits into the refstack repo without having them deploy immediately13:27
*** lucas-hungry is now known as lucasagomes13:27
andrey-mpmordred: sure, this is a better way. I think that we will do it. But I think that it will be not so fast...13:29
*** Aegil has joined #openstack-infra13:30
andrey-mpmordred: is it possible to add pypi jobs to refstack and after merge this patch infrastructure will build ppi package? or we will need one more tag?13:30
mordredcool. I'm fine with the patch you have right now - I mostly just think you'll get annoying having to get +2s every time you want to release - so figured I'd suggest a way for you to not need them13:30
*** vgridnev has quit IRC13:30
*** vgridnev has joined #openstack-infra13:31
mordredandrey-mp: infra will only upload new tags - but we could upload the current 1.0.0 tag by hand13:31
andrey-mpcool13:31
pabelangeryolanda: when you have free time, do you mind adding me to https://review.openstack.org/#/admin/groups/1284,members https://review.openstack.org/#/admin/groups/1285,members https://review.openstack.org/#/admin/groups/1291,members https://review.openstack.org/#/admin/groups/1292,members ?13:32
*** salv-orl_ has quit IRC13:32
*** baoli has joined #openstack-infra13:32
andrey-mpmordred: I think that we can start with this patch and after it we add pypi jobs to refstack. and after next release change puppet module to deploy from pypi13:33
yolandahi pabelanger sure13:34
*** ildikov has joined #openstack-infra13:34
mordredandrey-mp: cool13:34
*** doug-fish has quit IRC13:34
*** tiswanso has quit IRC13:35
*** thorst_ is now known as thorst13:35
andrey-mpmordred: thank you for help!13:36
*** salv-orlando has joined #openstack-infra13:36
*** zeih has joined #openstack-infra13:38
pabelangeryolanda: danke13:38
*** markvoelker has joined #openstack-infra13:39
*** piet has joined #openstack-infra13:39
*** jcoufal has joined #openstack-infra13:39
*** andrey-mp has left #openstack-infra13:40
yolandamordred, around? i'm running a test nodepool for infracloud, and i'm stuck at uploading the image to glance13:44
yolandai have the image on dib, then i executed a  nodepool image-upload infracloud ubuntu-trusty, but job seems to be stuck there, glance not even receiving any call to upload13:45
*** dims has joined #openstack-infra13:45
*** smanjara has quit IRC13:46
*** dims has quit IRC13:51
*** hichihara has joined #openstack-infra13:51
*** HeOS_ has joined #openstack-infra13:52
*** [HeOS] has quit IRC13:54
*** yaume_ has joined #openstack-infra13:54
*** yaume has quit IRC13:57
*** edleafe has joined #openstack-infra13:59
*** SAshish has joined #openstack-infra13:59
SAshishHi.. Anybody there?14:00
*** kgiusti has joined #openstack-infra14:00
*** zz_dimtruck is now known as dimtruck14:01
*** ddieterly has quit IRC14:01
openstackgerritAkihiro Motoki proposed openstack-infra/project-config: Translation job scripts support multiple python modules  https://review.openstack.org/28071114:02
*** ddieterly has joined #openstack-infra14:02
*** claudiub has joined #openstack-infra14:02
*** doug-fish has joined #openstack-infra14:02
*** piet has quit IRC14:02
*** zhurong has quit IRC14:02
*** moravec has joined #openstack-infra14:03
BobBallasselin_: Any chance you can help with a NOT_REGISTERED error that I can't figure out?14:03
*** changbl has quit IRC14:04
*** amitgandhinz has joined #openstack-infra14:04
*** ddieterly has quit IRC14:06
*** zhurong has joined #openstack-infra14:08
*** salv-orlando has quit IRC14:08
*** kiran-r has quit IRC14:08
*** yaume_ has quit IRC14:08
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/infra-ansible: Create and attach other required openstack resources  https://review.openstack.org/28056114:09
*** xyang1 has joined #openstack-infra14:09
*** alivigni has joined #openstack-infra14:09
*** yaume has joined #openstack-infra14:09
*** Guest76507 is now known as med_14:12
*** med_ has quit IRC14:12
*** med_ has joined #openstack-infra14:12
*** yaume has quit IRC14:13
*** zhurong has quit IRC14:14
*** yaume has joined #openstack-infra14:14
*** MCoLo__ has quit IRC14:14
*** MCoLo has joined #openstack-infra14:15
*** jcoufal has quit IRC14:15
openstackgerrityolanda.robla proposed openstack-infra/puppet-infracloud: Reduce mysql max-connections  https://review.openstack.org/28072014:15
*** jaosorior has quit IRC14:16
*** asettle has joined #openstack-infra14:17
*** jaosorior has joined #openstack-infra14:17
*** yaume has quit IRC14:20
*** yaume has joined #openstack-infra14:21
*** annegentle has joined #openstack-infra14:24
*** yaume has quit IRC14:25
*** yaume has joined #openstack-infra14:26
*** regXboi has joined #openstack-infra14:26
*** eharney has quit IRC14:26
SAshishErrors running git rebase -i remotes/gerrit/master error: could not apply 5062288... <my previous commit>  When you have resolved this problem, run "git rebase --continue". If you prefer to skip this patch, run "git rebase --skip" instead. To check out the original branch and stop rebasing, run "git rebase --abort". Could not apply 5062288.. <my previous commit>14:26
SAshishhi all14:26
SAshishcan anybody tell me14:27
SAshishhow to fix gthis..14:27
*** zeih has quit IRC14:27
SAshishI am struggling with this14:27
SAshishwhen I do git review it says this14:27
*** SAshish has quit IRC14:27
*** smarcet has quit IRC14:28
*** wshao has joined #openstack-infra14:28
*** wshao has quit IRC14:28
*** wshao has joined #openstack-infra14:28
*** zeih has joined #openstack-infra14:29
*** ccrouch has joined #openstack-infra14:29
*** yaume has quit IRC14:30
*** tiswanso has joined #openstack-infra14:30
*** yaume has joined #openstack-infra14:31
BobBallAwesome... Clearly SAshish didn't want an answer :)14:32
*** mriedem_away has quit IRC14:32
*** amitgandhinz has quit IRC14:32
anteayaI guess not14:32
*** amitgandhinz has joined #openstack-infra14:33
anteayahttp://gitimmersion.com/ was what I was going to suggest as a way to build some foundational git skills14:33
*** achanda has joined #openstack-infra14:35
*** zzzeek has joined #openstack-infra14:35
*** tiswanso has quit IRC14:35
*** yaume has quit IRC14:35
*** ildikov has quit IRC14:36
*** sabeen1 has joined #openstack-infra14:36
*** vgridnev has quit IRC14:37
*** hashar has joined #openstack-infra14:38
*** vgridnev has joined #openstack-infra14:38
*** sabeen3 has joined #openstack-infra14:39
*** achanda has quit IRC14:40
*** sabeen1 has quit IRC14:41
*** smarcet has joined #openstack-infra14:43
*** dimtruck is now known as zz_dimtruck14:44
*** HeOS has joined #openstack-infra14:45
*** vgridnev has quit IRC14:47
*** HeOS_ has quit IRC14:47
*** ildikov has joined #openstack-infra14:48
*** mdenny has quit IRC14:49
*** vgridnev has joined #openstack-infra14:49
*** piet has joined #openstack-infra14:50
*** vgridnev has quit IRC14:52
anteayaironic is using the conferencing system for their virtual sprint which just started14:52
anteayaso far so good I do believe14:53
*** ihrachys has quit IRC14:53
*** pradk has joined #openstack-infra14:53
BobBallasselin_: Sorry - my bad - ignore me.14:53
anteayaBobBall: did you figure out the issue?14:54
*** vgridnev has joined #openstack-infra14:54
*** aarefiev has quit IRC14:54
openstackgerritMerged openstack-infra/subunit2sql: Add optional run_metadata filter to get_test_runs_by_test_test_id  https://review.openstack.org/26995014:54
*** rbrndt_ has joined #openstack-infra14:55
BobBallI had reinstalled jenkins and forgotten to re-follow part of the instructions.14:55
*** mriedem has joined #openstack-infra14:55
*** aarefiev has joined #openstack-infra14:55
*** aarefiev has quit IRC14:55
*** nmagnezi has quit IRC14:55
*** aarefiev has joined #openstack-infra14:55
anteayaBobBall: okay, glad you figured it out14:55
*** thorst_ has joined #openstack-infra14:56
*** mtanino has joined #openstack-infra14:57
*** rossella_s has quit IRC14:57
*** coolsvap|away has quit IRC14:57
*** rossella_s has joined #openstack-infra14:58
*** haypo has left #openstack-infra14:59
openstackgerritMerged openstack-infra/project-config: Add giftwrap to OpenStack  https://review.openstack.org/28030514:59
*** thorst has quit IRC14:59
*** zeih has quit IRC15:00
*** piet has quit IRC15:01
*** coolsvap|away has joined #openstack-infra15:01
*** wshao has quit IRC15:01
*** sfinucan has quit IRC15:01
fungismarcet: it's hard to tell what happened to the deployment, because update-site output is so verbose it overruns rsyslog (imuxsock begins to drop messages from pid [...] due to rate-limiting) and so i can't see all of the output from it15:03
fungismarcet: i have a feeling it's failing somewhere in the update-site exec, but i'll need to run it by hand to find out what's going on15:04
*** tiswanso has joined #openstack-infra15:05
fungihopefully i can find a few minutes to try that during my next meeting15:05
fungier, i mean after my next meeting15:05
*** wolverineav has joined #openstack-infra15:10
*** gongysh has quit IRC15:11
*** slogan621 has joined #openstack-infra15:12
*** sigmavirus24_awa is now known as sigmavirus2415:13
*** wolverineav has quit IRC15:15
slogan621clarkb: https://review.openstack.org/#/c/275873 has two +2, what is next?15:16
*** mkoderer__ has quit IRC15:16
*** bhunter_ has joined #openstack-infra15:17
*** mkoderer__ has joined #openstack-infra15:17
mordredfungi: I'm in opposite-side-street land and likely may not be at today's meeting15:17
*** vgridnev_ has joined #openstack-infra15:17
*** zz_dimtruck is now known as dimtruck15:18
fungimordred: or attend from the pub!15:19
mordredfungi: well, I15:19
mordredfungi: I'm attending irc from a nice bar right now15:19
fungibully15:19
mordredfungi: so I _might_ be at the meeting - but I might not15:20
mordredfungi: and mostly just wanted to let you know priorities :)15:20
fungithis is the state of the world, yes. thanks for the heads up!15:20
*** vgridnev has quit IRC15:21
*** Liuqing has quit IRC15:21
*** piet has joined #openstack-infra15:22
*** Liuqing has joined #openstack-infra15:22
*** Liuqing has quit IRC15:22
AJaegermordred: we hear you that a British beer is more important ;)15:23
AJaegermordred: drink one on us ;)15:23
*** hichihara has quit IRC15:24
*** tongli has joined #openstack-infra15:25
*** piet has quit IRC15:25
*** _ody_ is now known as _ody15:26
*** sshnaidm has quit IRC15:26
AJaegerslogan621: you ask here to get added to the ACL group - an infra-root can do this for you. And then you can submit changes and add more core reviewers15:28
*** bpokorny has joined #openstack-infra15:29
*** bpokorny has quit IRC15:30
JayFIs there any way to see statistics on an infra Asterisk conference? i.e. number of people in a conference; sip usernames of people in, etc15:30
*** vgridnev_ has quit IRC15:32
*** eharney has joined #openstack-infra15:32
slogan621AJaeger: ok15:32
*** vgridnev has joined #openstack-infra15:32
*** EricGonczer_ has joined #openstack-infra15:33
slogan621AJaeger: I don't recall reading about ACL in the project creator's docs, is this something I need to understand or should I just ask? I was under the impression that once the project got 2 core reviews then it would just get created.15:33
*** fawadkhaliq has joined #openstack-infra15:34
*** fawadkhaliq has quit IRC15:34
*** dprince has quit IRC15:35
*** fawadkhaliq has joined #openstack-infra15:35
jlkohai. My project-config review merged, now I need to ask you to add me to some new groups15:36
*** smarcet has quit IRC15:36
jlkcan I be added to "giftwrap-release" and "giftwrap-core" ?15:36
*** yamahata has joined #openstack-infra15:36
jlkor show me how to request this through a review?15:37
pabelangerfungi: do you happen to know if any projects that are open to testing bindep jobs? I mean, I can continue on nova or pick some other random project, but figured I'd ask first15:37
pabelangerjlk: usually asking here or -infra ML works15:38
*** dizquierdo has joined #openstack-infra15:38
pabelangersince it is a manual process15:38
jlkalright15:38
jlkSo I'd like to have myself added to those two groups, and I'd like to add Craig Tracey to giftwrap-core15:39
*** jlanoux has quit IRC15:39
pabelangerjlk: I actually looked at giftwrap over the weekend. Curious if you've looked a delorean before?15:39
*** sshnaidm has joined #openstack-infra15:39
jlkbriefly, but it's been a while15:39
*** ajmiller has joined #openstack-infra15:39
pabelangerIf I understand, they look to do the same idea15:40
pabelangerI am sure there are some differences15:40
AJaegerslogan621: the patch merged and your project is created.15:40
*** salv-orl_ has joined #openstack-infra15:40
*** salv-orl_ has quit IRC15:40
jlkyeah, giftwrap doesn't do the yum part, but it can make RPMs. And Docker.15:40
slogan621AJaeger: oh :-)15:41
*** salv-orlando has joined #openstack-infra15:41
*** asettle has quit IRC15:41
AJaegerslogan621: http://docs.openstack.org/infra/manual/creators.html#wait-here and you moved on to http://docs.openstack.org/infra/manual/creators.html#update-the-gerrit-group-members15:41
AJaegerhttp://git.openstack.org/cgit/openstack/broadview-lib15:42
AJaegerslogan621: your change says " Merged"15:42
*** smarcet has joined #openstack-infra15:42
slogan621sweet. And I see something on github.15:42
slogan621thanks!15:42
AJaegerjlk: you get added and then can add anybody else...15:43
jlkAJaeger: perfect.15:43
AJaegerjlk, slogan621: Both of you need to wait for a gerrit admin to do it - pabelanger and myself can't help further15:43
fungipabelanger: i've already uploaded a change to create experimental bindep jobs on 14 more projects. lemme see if that merged yet15:44
*** sfinucan has joined #openstack-infra15:44
fungipabelanger: added about half a dozen different bindep-using job equivalents from the python-jobs group too15:44
fungipabelanger: 278798 but looks like it hasn't merged yet because nobody has approved its parent change 27879315:45
pabelangerfungi: okay, but if I understand bindep.  Each project should create a other-requirements.txt file too?15:45
AJaegerfungi: hasn't merged...15:45
*** jcoufal has joined #openstack-infra15:45
fungipabelanger: it's optional. if they don't then the jobs run with the bindep fallback list from project-config15:45
fungiwhich should closely emulate a bare-trusty or whatever worker15:46
pabelangerfungi: great15:46
fungipabelanger: the only reason i had one proposed in a do-not-merge change to nova is so that i could make sure the machinery properly used project-specific other-requirements.txt files when present15:47
pabelangerfungi: sure. Do you have an use case in mind when a project would use other-requirements.txt?15:47
fungipabelanger: when they want to start using bindep the way it's intended (to indicate what distro-supplied packages are necessary for installing or testing their project)15:48
jlkpabelanger: One thing I'm not sure I'm seeing in delorean, the ability to specify pre/post extras to install into the venv, which is kind of important sometimes.15:48
clarkbyolanda ajaeger I dont think puppet runs are running over each other, but we could add a lockfile if that is the case15:48
clarkb07 was fine when I left it yesterday15:48
*** nmagnezi has joined #openstack-infra15:49
fungipabelanger: it also allows them to avoid installing packages that we would otherwise install by default during the course of a job15:49
AJaegerclarkb: the corrupted caches really surprised us...15:49
AJaegerclarkb: but 07 did not have the latest gate-nova-pep8, it missed the change for the if.15:49
clarkbAJaeger: I am fairly sure I updated it, maybe there is a bug in jjb?15:50
AJaegerclarkb: I have no idea what broke, but this was much more painfull than I remember15:50
AJaegerclarkb: regarding update: Might also have been old sources?15:50
clarkbAJaeger: ya maybe I ran it before puppet could update it15:51
pabelangerjlk: Ya, I could be wrong, but I believe the main thing delorean does, is expects all dependencies to be packaged.  So, if something needs to be installed into the venv, then it should also likely be a package.15:51
AJaegerclarkb: best ask yolanda whether she has any more insights15:51
pabelangerjlk: but, don't quote me on that, still a new user of it.  RDO is really driving it15:51
jeblair17:35 < yolanda> as this can cause potential problems, such as jenkins trying to run jobs on projects that don't exist, or the one i hit with image builds, i think is important to reenable15:51
jeblair17:35 < pabelanger> AJaeger: Yup, I just think puppet-gerrit was over looked, since we stop it for renames.  The emergency fix jeblair was working on, that's the first time I seen us run out of inodes.  What  should likely happen, just thoughts after the fact, create / update the emergency server maintenance docs, and always add host to ansible emergency list.  Then you 100% know nothing with15:51
jeblair canwge while you are working15:51
pabelangerfungi: okay, that's what I figured15:52
jlkpabelanger: well, I'm not sure that delorean does anything with a virtualenv15:53
pabelangerJayF: There is, we could pipe the data into grafana.o.o via statsd. Haven't done the work yet.15:53
* AJaeger will be back later...15:53
pabelangerJayF: maybe a friday afternoon hack15:53
jlka python virtualenv.  That's the main thing that giftwrap does, all the python bits are installed (via pip) into a virtualenv, and that virtualenv tree is what's wrapped into a package.15:53
JayFpabelanger: I meant more realtime :)15:53
JayFpabelanger: but no is an okay answer :)15:53
*** infra-re_ has quit IRC15:53
pabelangerJayF: yes it call be realtime15:53
pabelangerJayF: simple way would be to use starpy to connect to AMI, then dump info to statsd15:54
JayFpabelanger: it's fine; I was asking more from the perspective of someone trying to find out info about a mid-cycle that's asking right now :P15:54
pabelangerjlk: Right, and I think the main thing for delorean is to packaging everything and remove the dependency on pip15:55
pabelangerJayF: well, I could manually do it.15:55
pabelangerJayF: what do you want / need to know15:55
fungiJayF: any performance issues on the bridge?15:55
JayFfungi: not afaict15:55
fungiawesome15:55
JayFpabelanger: it's not a big deal :) just wanted to make sure there wasn't some sweet dashboard somewhere we were missing out on (we were all speculating at the time how many people were on the call)15:56
*** kozhukal` has joined #openstack-infra15:56
*** changbl has joined #openstack-infra15:56
jlkpabelanger: definitely different use cases15:57
pabelangerwell, aside from the fact somebody is trying to brute force the asterisk server. Looks to be 33 people on the server ATM15:57
*** kozhukalov has quit IRC15:57
pabelangerguess we should install fail2ban15:58
jeblairpabelanger: they're trying to brute force passwords; they won't get far.15:58
pabelangerJayF: nope, but going to hack on it now :)15:59
JayF:)15:59
jeblairwhat's the call?15:59
*** kzaitsev_mb has quit IRC15:59
pabelangerjeblair: indeed, since we allow anonymous users to connect15:59
JayFjeblair: Ironic virtual mid-cycle meetup. https://etherpad.openstack.org/p/ironic-mitaka-midcycle15:59
jlkoh hey, is jeblair elevated enough to add my user to gerrit?15:59
jeblairjlk: whatcha need?16:00
jlkjeblair: myself added to giftwrap-release and giftwrap-core16:00
jeblairjlk: done!16:00
*** ddecapit has joined #openstack-infra16:01
*** baoli has quit IRC16:01
*** ddecapit is now known as DuaneDeC716:02
jlksweet16:02
*** salv-orl_ has joined #openstack-infra16:02
*** esikachev has quit IRC16:03
*** baoli has joined #openstack-infra16:03
*** dkranz has quit IRC16:03
*** dkranz has joined #openstack-infra16:04
slogan621AJaeger: so, the gerrit-group members would be the developers listed here: https://launchpad.net/~broadview-drivers/+members#active?16:04
mugsiea/win 5316:04
*** salv-orlando has quit IRC16:05
jlkjeblair: thanks. Now how do I manage adding other people to -core ?16:05
jeblairjlk: with the menu at the top: People -> List Groups -> Filter: giftwrap -> click on the group16:06
jlkjeblair: top of gerrit?16:07
*** EricGonczer_ has quit IRC16:07
jeblairjlk: yep16:08
jeblairjlk: should ultimately get you to this page: https://review.openstack.org/#/admin/groups/1293,members16:08
fungipabelanger: if the concern is over people trying to brute-force ssh passwords on the pbx server, it can just be ignored. we have password logins entirely disabled in ssh16:08
slogan621AJaeger: it appears you need just one, if so, please add volodymyr.samotiy@axilera.com (sorry if I am going about this in the wrong way).16:09
pabelangerfungi: no, this was via SIP.16:09
pabelangerfungi: eg: trying to register an extension, so they can try to make long distance calls16:10
Clintyeah, fail2ban is good for that16:10
pabelangeryup16:10
fungipabelanger: oh, fun!16:10
* fungi misses the days of hackable telephony networks16:10
pabelangerya, not concerned16:11
jlkjeblair: neat, thanks!16:11
pabelangerpretty sure we don't even have outbound setup16:11
*** DuaneDeC7 has quit IRC16:12
slogan621how can I view who is in the ACL list for my project?16:12
*** rbrndt_ has quit IRC16:13
fungislogan621: follow the directions jeblair just gave jlk above16:13
fungibut of course type in your project name instead of giftwrap16:13
*** kozhukal` has quit IRC16:13
openstackgerritMatthew Treinish proposed openstack-infra/shade: Add a method to download an image from glance  https://review.openstack.org/27881616:14
mtreinishSpamapS: ^^^ that should address your concerns16:14
*** rbrndt_ has joined #openstack-infra16:15
fungislogan621: i suppose http://docs.openstack.org/infra/manual/creators.html#update-the-gerrit-group-members would be a good place to add a couple sentences about that. doing now16:16
slogan621ah16:16
*** EricGonczer_ has joined #openstack-infra16:16
slogan621jeblair: are you available to add me to broadview-lib-core and broadview-lib-release?16:17
slogan621fungi: yep, sounds like a great idea16:17
* slogan621 sees the fog clear a bit 16:17
*** pcaruana has quit IRC16:18
jeblairslogan621: done!16:18
slogan621oh, oops :-) wrong user, I'm actually syd.logan@broadcom.com - I suppose I can authenticate as the other user and add myself now, right?16:20
*** EricGonczer_ has quit IRC16:20
openstackgerritJesse Keating proposed openstack-infra/project-config: Announce giftwrap gerret into our channel.  https://review.openstack.org/28079716:23
openstackgerritVincent Françoise proposed openstack-infra/project-config: Watcher multinode Tempest job fixup  https://review.openstack.org/27792316:24
*** sshnaidm has quit IRC16:25
jeblairslogan621: i switched them16:25
fungismarcet: wow, no wonder this overran rsyslog's rate-limiter. about 8k lines into the update output, i have a node.js exception in bower-config16:26
jeblairslogan621: your bcom aaccount is added now16:26
fungismarcet: paste coming in a moment16:26
*** jpr has joined #openstack-infra16:26
slogan621jeblair: awesome. I'll now add the other project members myself16:27
fungismarcet: http://paste.openstack.org/show/487139/16:27
*** jlanoux has joined #openstack-infra16:28
*** _nadya_ has quit IRC16:28
fungismarcet: if you want the full deploy.sh log, i'll have to copy it somewhere for you to retrieve. it's many times too long to be able to post to paste.openstack.org16:28
fungismarcet: separately, it may be better to redirect or silence most of the output from that script16:29
fungiso that what ends up in syslog is useful16:29
*** tiswanso has quit IRC16:31
*** sdague has quit IRC16:31
*** esikachev has joined #openstack-infra16:32
*** Swami has joined #openstack-infra16:32
*** tiswanso has joined #openstack-infra16:32
*** smarcet has quit IRC16:33
*** boris-42 has quit IRC16:34
*** sputnik13 has joined #openstack-infra16:34
*** sdague has joined #openstack-infra16:34
*** sabeen3 has quit IRC16:35
*** jcoufal has quit IRC16:35
*** slogan621 has quit IRC16:35
pabelangerSo, I was thinking about this last night, if I wanted to use DIBs in the gate, loaded into devstack, I sure I could.  But is there any projects doing this today?  I mean, could a periodic job be created to create a DIB, which is stored on static.o.o to then be used by a job?16:37
*** sputnik13 has quit IRC16:37
greghaynespabelanger: the issue is that you would be qemu booting16:37
greghaynespabelanger: so the perf is extremely slow16:37
greghaynespabelanger: but, nodepool func testing does this16:37
*** rcernin has quit IRC16:37
pabelangergreghaynes: Right, I would expect some perf issues16:38
openstackgerritPierre Mathieu proposed openstack-infra/project-config: Creation of a dedicated repo for API and media storage client  https://review.openstack.org/25534916:38
*** achanda has joined #openstack-infra16:38
pabelangeranother option would be 3rd party CI for baremetal provisioning16:38
*** armax has joined #openstack-infra16:38
*** placko_ has quit IRC16:41
*** placko_ has joined #openstack-infra16:41
clarkbpabelanger: yes the nodepool dsvm tests do this today16:42
openstackgerritJeremy Stanley proposed openstack-infra/puppet-openstackid: Put /usr/local/bin first in paths  https://review.openstack.org/28081016:42
clarkbthey build one image, upload it to devstack, then boot a VM off of that image16:42
fungismarcet: ^16:42
*** sridhar_ram has joined #openstack-infra16:42
pabelangerclarkb: but each patchset is creating an image right?16:43
*** annegent_ has joined #openstack-infra16:43
*** placko_ has quit IRC16:43
*** achanda has quit IRC16:44
*** EricGonczer_ has joined #openstack-infra16:44
clarkbpabelanger: yes16:44
fungiinfra-puppet-core reviewers, https://review.openstack.org/280810 addresses a deployment issue on openstackid.org (incorrect path order in a couple of execs)16:45
*** baoli has quit IRC16:45
pabelangerclarkb: So, if I wanted the image build to happen outside of the patchset, maybe a periodic job. Could that dib be hosted on some infra FS to be used later?  Trying to see if it is worth the time and energy to just build the DIB each time or externalize it16:46
*** baoli has joined #openstack-infra16:46
pabelangerhaving AFS mirrors help with build times now16:46
*** annegentle has quit IRC16:46
*** ajmiller has quit IRC16:47
*** annegent_ has quit IRC16:48
greghaynespabelanger: whats the purpose?16:48
greghaynespabelanger: or goal16:48
*** smarcet has joined #openstack-infra16:48
electrofelixAnyone here able to help out with a summit talk going astray? Who should I be talking to about finding out what happened and how to get it fixed?16:49
*** esikachev has quit IRC16:49
*** vgridnev has quit IRC16:49
*** zeih has joined #openstack-infra16:49
smarcetfungi: ok thx for the info and support :)16:50
jeblairpabelanger: yes, periodic jobs can upload artifacts to tarballs.o.o that can then be fetched later.  it would be better if we put that into afs so it can be fetched locally.16:50
*** tzn has quit IRC16:50
pabelangergreghaynes: mostly for some ansible testing. Our devstack DIBs work fine, but there are some trivial things installed that I wanted to remove.  Right now considering adding a pre_tasks to just purge them, but also thought about a using a ubuntu-minimal dib with just SSH keys.16:50
openstackgerritCraig Vyvial proposed openstack-infra/project-config: run trove experimental run scenario tests  https://review.openstack.org/27809516:51
*** tphummel has joined #openstack-infra16:51
pabelangergreghaynes: nothing super important, just brainstorming16:51
pabelangerjeblair: Right, AFS would like be better.16:51
pabelangereither way, just something I am thinking about16:51
*** HeOS has quit IRC16:52
*** DuaneDeC7 has joined #openstack-infra16:52
*** HeOS has joined #openstack-infra16:52
fungipabelanger: ironic-python-agent does this, i believe16:52
pabelangerfungi: cool, will check it out16:52
fungipabelanger: they build updated test images in the post pipeline iirc, and stash them on tarballs.o.o16:53
fungiand then use them in subsequent jobs16:53
*** eharney has quit IRC16:53
*** vincentfrancoise has joined #openstack-infra16:53
*** mikelk has quit IRC16:53
fungipabelanger: they build https://tarballs.openstack.org/ironic-python-agent/coreos/16:54
fungipabelanger: i think at least one other project does something similar, though i don't recall which at the moment16:54
pabelangerRight, I figured other projects were doing it, just couldn't remember which ones.  Will google around16:56
*** matrohon has quit IRC16:57
*** kzaitsev_mb has joined #openstack-infra16:58
pleia2good morning16:59
*** madhu_ak has joined #openstack-infra17:00
*** sabeen has joined #openstack-infra17:01
openstackgerritJeremy Stanley proposed openstack-infra/infra-manual: Add URL for Gerrit group self-management  https://review.openstack.org/28082317:02
*** asselin has quit IRC17:03
*** sabeen3 has joined #openstack-infra17:04
*** e0ne has quit IRC17:04
*** dprince has joined #openstack-infra17:04
fungisomething's going down in rax-ord... lots of nodes piling up in delete state there17:05
*** madhu_ak has quit IRC17:05
fungioh, in rax-dfw too actually, just not rax-iad (yet anyway)17:05
*** sabeen has quit IRC17:05
*** gyee has joined #openstack-infra17:05
fungialso, any word from the tripleo crowd on whether or not they're going to fix their keystone config?17:06
*** apoorvad has joined #openstack-infra17:07
*** apoorvad has quit IRC17:08
openstackgerritJordan Pittier proposed openstack-infra/elastic-recheck: Add query for Heat booting a VM on a network w/o subnet  https://review.openstack.org/28082417:08
mgagneclarkb: found the cause of my issue with change stuck in gate pipeline in Zuul status interface17:09
*** eharney has joined #openstack-infra17:09
*** vincentfrancoise has quit IRC17:09
*** rcernin has joined #openstack-infra17:09
mgagneclarkb: it was a bad Gerrit URL in the config. URL didn't return 404 but "00000020ERR Git repository not found" in the body.17:09
*** shashank_hegde has joined #openstack-infra17:10
*** apoorvad has joined #openstack-infra17:10
*** asselin has joined #openstack-infra17:10
*** annegentle has joined #openstack-infra17:10
*** d0ugal has quit IRC17:11
openstackgerritJames E. Blair proposed openstack-infra/infra-manual: Fix typos and clarify project retirement  https://review.openstack.org/28082617:11
*** wolverineav has joined #openstack-infra17:12
greghaynesclarkb: Looks like tripleo fixed their cloud https://ci-overcloud.rh1.tripleo.org:13000/v2.017:12
greghaynesclarkb: so nodepool needs a restat17:12
clarkbgreghaynes: oh right because we only grab the listing on new client17:12
greghaynesrestart17:12
greghaynesyep17:12
openstackgerritMerged openstack-infra/infra-manual: Add section on retiring a project  https://review.openstack.org/21063817:13
*** scheuran has quit IRC17:13
*** samuelBartel has quit IRC17:13
cody-somervilleanteaya: Is the snow falling as fast for you as it is here? I think we're going to get 40cm here today.17:13
*** gordc has quit IRC17:14
*** roxanaghe has joined #openstack-infra17:15
*** wolverineav has quit IRC17:16
jeblairgreghaynes: can you look at https://review.openstack.org/226114 ?17:16
* greghaynes looks17:17
jeblairwho's running solum these days?17:18
greghaynesjeblair: so part of that is identical to https://review.openstack.org/#/c/273703/10/nodepool/nodepool.py17:18
*** hashar has quit IRC17:18
clarkbjamielennox: for when you wake, is there a concrete answer to "can we prevent keystoneauth/keystoneclient from logging passwords and tokens?" looks like not logging at debug level may be sufficient? can you confirm? also how new of a keystoneauth/client is required for that to be the case17:19
*** EricGonczer_ has quit IRC17:19
jeblairgreghaynes: i'm not seeing it...17:19
greghaynesjeblair: the cleanupOneImage deleting images in state DELETE17:19
fungijeblair: devkulkarni, so says http://governance.openstack.org/reference/projects/solum.html (possibly in #solum according to that)17:20
greghaynesjeblair: oh, cleanupOneImage vs cleanupOneDibImage17:20
*** sshnaidm has joined #openstack-infra17:20
greghaynesjeblair: nvm17:20
clarkbjeblair: looks like http://git.openstack.org/cgit/openstack/election/plain//candidates/mitaka/Solum/Devdatta_Kulkarni.txt is ptl of solum17:20
jeblairthey have let the ERROR_ON_CLONE volkswagen patch sit for 5 months17:21
jordanPI noticed that we have a lot of old queries in https://github.com/openstack-infra/elastic-recheck/tree/master/queries Do we have a script to check if old queries are still relevant ?17:22
fungijeblair: we were eventually going to remove any jobs relying on that, right?17:22
clarkbjordanP: the results page tells you if a query matches or not17:22
jeblairfungi: yeah, i'm about to propose that17:22
clarkbjordanP: they get faded out at the end of the list17:22
greghaynesjeblair: lgtm17:22
jordanPclarkb, great, thanks17:23
jordanPdid you know we can have a direct URL to a logstash query like : http://logstash.openstack.org/#/dashboard/script/logstash.js?query=message:%22requires%20a%20subnet%20in%20order%20to%20boot%20instances%20on%2217:23
*** EricGonczer_ has joined #openstack-infra17:23
jordanPI spend 30min on that :p17:23
jordanP*spent17:23
clarkbya I hacked on the js to make that work (its not perfect)17:24
*** alkhodos has joined #openstack-infra17:24
jordanPohh that's you, okay :)17:24
greghaynesclarkb: we believe in your js skills17:24
*** shashank_hegde has quit IRC17:25
fungithat was a regression/feature loss in kibana right?17:25
clarkbkibana 3 by default writes stuff to the index which doesn't work for our read only api access17:25
clarkbfungi: yes, I had to have it accept hte parameters17:25
*** _nadya_ has joined #openstack-infra17:25
clarkbbut kibana is on v4 already (which I still hope to upgrade to if I can get logstash upgraded first)17:25
clarkbv4 goes bcak to the v2 way of things which should be better17:25
*** ybathia has joined #openstack-infra17:26
*** smanjara has joined #openstack-infra17:26
alkhodosHi everyone. Is there a way to configure tempest.conf values via local.conf ?17:27
jeblairclarkb, fungi: i'm going to force-merge https://review.openstack.org/227010 and https://review.openstack.org/22701117:27
fungialkhodos: sounds like a question for #openstack-qa17:27
jeblairfungi: should i remove you from bootstrappers while i'm here?17:27
alkhodosfungi: ah, ok, sorry17:27
fungijeblair: you can. i stopped last night in the middle of cleaning up the registered users groups breakage but can add myself back when i resume shortly17:28
*** sfinucan has quit IRC17:28
jeblairfungi: oh, i'll leave you then if you're about to resume17:28
BobBallasselin_: What's the correct line for the new gerrit_ssh_host_key?  Seems that single_node_ci_site.pp hasn't been updated since gerrit was moved?17:28
*** EricGonczer_ has quit IRC17:28
clarkbjeblair: ok17:28
asselinBobBall, well the default should work17:29
fungijeblair: yeah, i'll take myself out when i'm done. luckily we only had 17 projects impacted by that bug17:29
fungiso i should be done before meeting time17:29
BobBallasselin: I think it's wrong though?  still has review.openstack.org pointing to 23.253.232.87 but it's now at 104.130.159.13417:29
*** tqtran has joined #openstack-infra17:30
*** tiswanso has quit IRC17:30
BobBallasselin: I'm getting errors from zuul-merger saying host key verification failed17:30
*** annegentle has quit IRC17:30
jeblairhuh, i can't submit https://review.openstack.org/#/c/227011/17:30
jeblairinfra-root: has anyone force-sumbitted a change since the gerrit upgrade?17:31
fungijeblair: yep17:31
clarkbI have not17:31
*** DuaneDeC7 has quit IRC17:31
fungijeblair: you have to vote first, and then the submit button appears on the change screen after you commit your votes17:31
jeblairwhat am i missing on that change then...?17:31
fungiit's a behavior change17:31
jeblairfungi: i have voted but i don't see it17:31
BobBallasselin: http://paste.openstack.org/show/487147/17:31
jeblairfungi: the change is 'Ready to Submit'...17:32
*** tiswanso has joined #openstack-infra17:32
clarkbjeblair: https://review.openstack.org/#/c/273703/ does other related image clenaup if you have time to revie that when done merging magnetodb changes17:32
fungijeblair: yeah, usually it appeared for me where the cherry pick, abandon and follow-up buttons are17:32
jeblairfungi: do you see one there?17:33
fungii definitely do not17:33
jeblairneat.17:33
*** annegentle has joined #openstack-infra17:33
jeblairgertty got: 2016-02-16 09:30:49,235 Received: submit not permitted17:33
zaromorning17:33
BobBallasselin: Actually maybe this is because zuul-merger doesn't know that the private key is in /var/lib/zuul/ssh/id_rsa when doing git commands? (how does that happen?)17:33
fungijeblair: oh!17:33
fungijeblair: it's read-only already17:33
jeblairfungi: ha! thanks :)17:33
fungijeblair: you can't submit any changes on a project without making it active first (and possibly also giving it a semi-functional acl)17:34
jeblairfungi: just active is enough apparently17:34
*** dims has joined #openstack-infra17:34
BobBallasselin: if I copy /var/lib/zuul/ssh/id_rsa to ~zuul/.ssh/id_rsa then zuul-merger is happy and can clone repos?17:35
zarofungi: finally back from weekend trip.  do we still need to fix the gerrit groups issude?17:35
asselinBobBall, no...hold on17:35
*** ociuhandu has quit IRC17:35
openstackgerritCraig Vyvial proposed openstack-infra/project-config: run trove experimental run scenario tests  https://review.openstack.org/27809517:36
*** wolverineav has joined #openstack-infra17:36
fungizaro: i was able to confirm my suspicion that removing the group from the database did not fix the acls, but that individually updating the groups files in all affected repos does and can be done without taking gerrit back offline17:38
asselinBobBall, can you try this https://review.openstack.org/#/c/266041/2/contrib/single_node_ci_site.pp17:38
*** d0ugal has joined #openstack-infra17:38
fungizaro: the database update was really just cleanup. which groups the acls use is definitely determined by the groups files, and gerrit doesn't fall back to using the internal group with the same name if the uuid in the groups file refers to a nonexistent database entry17:39
clarkbfungi: and were you able to get jeepyb to update all the groups files for you? oh I bet it doesn't bceause they already hvae failues17:39
clarkbfailues? == values17:39
BobBallasselin: Tried that - it wasn't sufficient.  It does seems that zuul-merger can't get hold of id_rsa from /var/lib/zuul/ssh/id_rsa (hence copying the file to ~zuul/.ssh/id_rsa actually fixes the problem)17:39
fungiclarkb: since i had to work out the steps to test updating the groups files anyway, it's easier to just loop over the affected repos doing that17:40
*** Jeffrey4l has quit IRC17:40
asselinBobBall, I haven't seen that before... I though the path was set in the config file or the code17:40
BobBallasselin: It seems that zuul-merger doesn't need the host key to be in ~zuul/.ssh/known_hosts to function correctly17:40
fungii also wanted to check which repos were actually affected so we could figure out how widespread the issue was (answer is 17 repos, definitely looks like any which had their acls created/altered after the 2.11 upgrade)17:40
*** infra-red has joined #openstack-infra17:41
*** roxanaghe has quit IRC17:42
clarkbjust 17 that isn't too bad17:42
clarkbfungi: we are separately remove registered users from where it is unnecessary right?17:43
zarofungi, clarkb : ahh yeah, that's right.  I thought manage_projeects would replace the exiting one with 'glabl:Registered-Users' but I think i'm mistaken there.17:43
fungizaro: it might if we forced updates of those acls17:43
clarkb Ithink it sees that the uuid already exists and passes it over17:43
zaroyeah, can we force update?17:43
clarkbthe regex grabs the existing uuid and assumes it is correct17:44
zaroclarkb: yeah, i think that is correct17:44
fungizaro: i'm just editing them by hand. there's not that many17:44
clarkbwhich reduces the cost of checking against gerrit and is generally good enough :)17:44
zarofungi: coolio, sorry about that.17:45
*** sabeen3 has quit IRC17:45
fungizaro: no worries, got it figured out17:45
fungiglad it turned out to be fairly simple17:45
*** dprince has quit IRC17:45
*** esikachev has joined #openstack-infra17:46
*** sabeen1 has joined #openstack-infra17:46
BobBallasselin: it's listed in /etc/zuul/zuul.conf... seems that the ssh wrapper code isn't working in my environment for some reason... maybe...17:46
clarkbjeblair: would you be open to adding a test to https://review.openstack.org/#/c/226114/1 ? I think you can invoke the nodepool class, let it make an image, stop the nodepool object/thread, set image state to delete, start a new nodepool instance and wait for image to go away17:46
*** dprince has joined #openstack-infra17:46
*** ajmiller has joined #openstack-infra17:46
*** e0ne has joined #openstack-infra17:47
fungiokay, the affected groups files are all fixed now17:48
*** shardy has quit IRC17:48
*** mriedem is now known as mriedem_lunch17:49
jeblairclarkb: i am not opposed to that but do not expect to have time to do so this week.  or next.17:49
clarkbok I will add it as a followup change then17:50
*** _nadya_ has quit IRC17:50
*** sabeen3 has joined #openstack-infra17:51
zarofungi: thanks. i can do -2..+2 range on sandbox.17:52
*** sabeen1 has quit IRC17:53
BobBallDoes anyone know why GIT_SSH might work with zuul-merger's wrapper from the command line, but not when zuul-merger is running itself?17:53
clarkbBobBall: file permissions?17:54
BobBallI'd hope not... since zuul-merger created the wrapper file17:55
greghaynesmordred: Hey, do you know what the state of the nodepool + shade patches are? I am having a hard time figuring that out based on outstanding changes (theres a lot of them in various states)17:57
dprincehi, trying to figure out why TripleO jobs are queued. I just fixed an issue 2 hours ago where the keystone endpoint was getting set to locahost:5000. That should be resolved now. Any idea on why jobs are still queued?17:57
greghaynesmordred: I might have some time to bang my head against it now that builders arent OMG ON FIRE17:57
*** achanda has joined #openstack-infra17:59
greghayneshttps://review.openstack.org/#/c/226751/48 seems to be the new uberpatch?18:00
*** gangil has joined #openstack-infra18:01
*** gangil has quit IRC18:01
*** gangil has joined #openstack-infra18:01
greghaynesdprince: nodepool needs to be restarted18:02
fungidprince: we need a nodepoold restart so it rereads your keystone api response18:02
dprincefungi: ah, cool. Thanks for this. I was still wondering if there was something else on my side18:02
fungias far as it knows, your correctly-discovered keystone v2 endpoint url is hosted on its loopback18:02
dprincegreghaynes: thanks18:02
*** mayurig has joined #openstack-infra18:03
fungibut next time it starts and hits the initial api url again, it should get directed to the correctly configured one18:03
openstackgerritMerged openstack-infra/puppet-infracloud: Add class to deal with cacert on infra cloud  https://review.openstack.org/27836218:03
*** vgridnev has joined #openstack-infra18:04
dprincefungi: do we know when the next restart happens?18:04
fungidprince: it'll be manual18:04
clarkbI can get to it once I finish up these nodepool reviews and writing nodepool tests18:04
fungisomeone needs to take a few minutes to attempt a minimally-impacting restart of the daemon18:04
*** flepied has quit IRC18:04
fungithanks clarkb!18:04
clarkbthough if we have running image builds we will want the change I am reviewing :/18:04
clarkbso maybe let that merge first18:04
greghaynesclarkb: which change?18:05
clarkbgreghaynes: the one jeblair wrote to change status to delete on start if building18:05
fungiyeah, right now restarting nodepoold means any queued/in-flight image builds will be lost for the day18:05
clarkbI am writing tests for that now and if they pass I will approve18:05
greghaynesclarkb: Ah, that is just for snapshots, but they happen at the same time I suppose18:05
*** yamamoto has quit IRC18:05
*** smanjara has quit IRC18:05
clarkbgreghaynes: yup all related18:06
*** achanda has quit IRC18:06
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual: Add URL for Gerrit group self-management  https://review.openstack.org/28082318:06
greghaynesclarkb: If builds are running really we want https://review.openstack.org/#/c/273703/ too18:06
openstackgerritDoug Hellmann proposed openstack/requirements: update constraints to cliff 1.17.0  https://review.openstack.org/28085318:06
*** jcoufal has joined #openstack-infra18:06
clarkbgreghaynes: and uploads go in that table too18:06
clarkbgreghaynes: ya I asked jeblair to review that one18:06
*** annegentle has quit IRC18:06
*** haypo has joined #openstack-infra18:06
*** mriedem_lunch is now known as mriedem18:06
haypotonyb: would you mind to bless https://review.openstack.org/280854 liberty: release oslo.service 0.9.1 ?18:07
haypo#openstack-oslo: 19:02 < dhellmann> haypo : ping mriedem_lunch to review the release request18:07
jeblairclarkb, greghaynes: i am reviewing it now18:09
*** yamamoto has joined #openstack-infra18:10
openstackgerritMerged openstack/requirements: Bump yaql version to 1.1.0  https://review.openstack.org/27898318:10
*** annegentle has joined #openstack-infra18:11
*** bpokorny has joined #openstack-infra18:11
greghaynesclarkb: jeblair actually, https://review.openstack.org/#/c/273703/ is only useful if its merged before we shutdown. Still, good to get in regardless18:11
clarkbwoot have working test for the nodes get cleaned up on start, now to do images18:12
*** zeih has quit IRC18:13
fungiwoah! new wiki theme? when did that happen?18:13
jeblairgreghaynes, clarkb: see comment in https://review.openstack.org/27370318:13
fungino. nevermind. somehow it got stuck on the mobile view for me18:13
jeblairfungi: looks the same... ah18:13
*** sabeen3 has quit IRC18:15
openstackgerritMerged openstack-infra/infra-specs: Update unified mirror spec to support AFS  https://review.openstack.org/27367318:15
lifelesssdague: you want an email written?18:15
openstackgerritMerged openstack-infra/infra-specs: Update docs-publishing spec to catch up to reality  https://review.openstack.org/27648118:16
devanandaquestion related to virtual sprints and the SIP line -- is there a max # of participants? we're getting a report of line-busy18:16
*** jlanoux has quit IRC18:16
*** chaustin has joined #openstack-infra18:16
jeblairdevananda: not that we've encountered, and we tested to several hundred...18:17
jeblairpabelanger: ^18:17
chaustinHi Folks, I am attempting to dial into the Asterisk conferencing system and getting a busy tone.18:17
chaustinI'm using the number 512-808-575018:18
pabelangerdevananda: are you using PSTN?18:18
pabelangeror actually a SIP client18:18
*** davideagnello has joined #openstack-infra18:18
pabelangerwe don't actually do any Busy() over SIP18:18
sdaguelifeless: lets actually make sure the nova change works first18:19
*** dizquierdo has quit IRC18:19
*** wolverineav has quit IRC18:19
openstackgerritPaul Belanger proposed openstack-infra/gear: Remove shebang as the script is managed by an entry_point  https://review.openstack.org/18688918:19
*** bpokorny has quit IRC18:19
openstackgerritgreghaynes proposed openstack-infra/nodepool: Handle dib image deletion during periodic cleanup  https://review.openstack.org/27370318:20
*** bpokorny has joined #openstack-infra18:20
greghaynesjeblair: clarkb ^18:20
devanandapabelanger: phone #, not SIP client18:21
jeblairdevananda, pabelanger: our account balance with voip.ms is negative.  i will pay the phone bill.  :)18:21
devanandajeblair: lol :p18:22
pabelangerjeblair: devananda: Ya, that would do it18:22
clarkbjeblair: I can probably quickly do it if you want ot avoid doing it18:22
clarkbbut I have never done it before so no idea18:22
devanandamany of us are dialed in to the ph# now, but chaustin is getting busy signal18:22
clarkbwould be a new number too right?18:22
*** kzaitsev_mb has quit IRC18:23
*** achanda has joined #openstack-infra18:23
jeblairclarkb: i'm paying it so we can keep the number and hopefully get it working quickly18:24
clarkbthe new number was something I wanted to figure out18:24
clarkbwe could have two numbers until old one ran out of funds18:24
clarkbmaybe they allow transfers but my wiki reading hasn't shown anything18:24
jeblairit will probably be a few years until it runs out of funds now18:25
*** shashank_hegde has joined #openstack-infra18:25
*** rvasilets_ has joined #openstack-infra18:25
jeblairclarkb: so we may want to see if we can get the name/email addr on the existing account updated18:26
*** rvasilets_ has left #openstack-infra18:26
jeblairokay, it thinks we have a positive balance again18:26
pabelangerjeblair: clarkb: Ya, you won't lose the number. They give you ample warnings about a negative account.  Should take 10mins to come back online after account filled18:26
*** david-lyle has quit IRC18:27
clarkbpabelanger: talking about switching theaccount details. If we make a new account I haven't seen a way to transfre a number but maybe I wsn't reading the right docs18:27
jeblairpabelanger: yeah, this all ties in with the foundation's executive director quietly deleting my jeblair@openstack.org email alias in december.18:27
chaustinThank you folks!  I'm in.18:27
jeblairchaustin: great, sorry for the inconvenience.18:27
pabelangerjeblair: clarkb: you'll be able to port the number, there is some paper work for that18:28
jeblairpabelanger: that's where account balance notifications were being delivered.18:28
fungijeblair: jbryce was travelling when i caught up with him about the jeblair@o.o issue, and he indicated that he didn't intentionally delete it but may have removed it thinking it was inactive and overlooked any existing forward. it didn't sound like he was opposed to the idea of putting it back18:28
*** d0ugal has quit IRC18:28
chaustinjeblair: No worries, it was minor from my perspective.18:28
fungihe said something about having deleted e-mail accounts which had not been logged into for months that he thought were abandoned18:28
jeblairpabelanger, clarkb: as long as we're talking to voip.ms/filing paperwork, maybe we can see if we can get it set up as a proper role account18:29
*** d0ugal has joined #openstack-infra18:29
jeblairwe have $22.89 of runway to do that :)18:29
clarkbjeblair: ++ I think that would be ideal18:29
*** chaustin has left #openstack-infra18:29
clarkbI can rebug scott aout not using personal CC if we go that route too18:30
pabelangerjeblair: Ya, I found that very easy to work with.  Should be a simply support ticket to move things between accounts18:30
jeblairwe do pay like $0.01/min for incoming calls on this plan18:31
*** _nadya_ has joined #openstack-infra18:31
jeblairwhich is why the $2 we had in the account was suddenly no longer sufficient18:31
*** sridhar_ram is now known as sridhar_ram_afk18:31
openstackgerritPaul Belanger proposed openstack-infra/gear: Switch to six for configparser  https://review.openstack.org/28087618:31
AJaegerteam, rossella_s asked us in http://lists.openstack.org/pipermail/openstack-dev/2016-February/086392.html for an idea on how to setup a job. Has any of you some directions for her?18:33
*** _sarob has joined #openstack-infra18:33
*** e0ne has quit IRC18:33
dimsjeblair : i believe this is one from mtreinish is ready to merge https://review.openstack.org/#/c/279299/ (helps with the oslo master jobs on health check, has clarkb's +2 on it). please peek when you get a chance18:34
jeblairdims: ack18:34
*** kushal has quit IRC18:34
*** mriedem has quit IRC18:35
dimsthanks jeblair18:35
*** Madasi has joined #openstack-infra18:35
*** jcoufal has quit IRC18:35
*** edunham has left #openstack-infra18:35
*** david-lyle has joined #openstack-infra18:35
*** kzaitsev_mb has joined #openstack-infra18:36
openstackgerritOndÅ™ej Nový proposed openstack/requirements: Bump PyECLib global-requirement to >= 1.2.0  https://review.openstack.org/27894518:37
*** jordanP has quit IRC18:39
*** flepied has joined #openstack-infra18:39
*** qb_ has joined #openstack-infra18:41
clarkbhrm this code is racier than I thought18:41
*** wolverineav has joined #openstack-infra18:41
jeblairclarkb: if you need to kick it back to me, that's cool.18:41
*** EricGonczer_ has joined #openstack-infra18:42
*** wolverineav has quit IRC18:42
*** wolverineav has joined #openstack-infra18:42
clarkbI think I am very close, basically need to make periodic cleanup run with a config after starting the nodepool thread18:42
*** mriedem has joined #openstack-infra18:42
clarkbbecause periodic cleanup is what will clear out that image and make way for a new one via check for missing images18:42
clarkbcalling periodicCleanup() directly after pool.start() results in self.config NoneType has no attribute db18:43
*** EricGonczer_ has quit IRC18:43
clarkbI knoiw18:43
*** abregman has quit IRC18:43
clarkbbut thats hacky ( could make wait for images invoke a cleanup)18:44
*** ajmiller has quit IRC18:44
*** ajmiller_ has joined #openstack-infra18:44
*** mayurig has quit IRC18:44
jeblairoh, it's the tests18:45
clarkbI think so18:45
jeblairclarkb: add a wait for self.config.db method?18:45
*** roxanaghe has joined #openstack-infra18:48
*** hashar has joined #openstack-infra18:49
*** yamamoto has quit IRC18:49
*** nmagnezi has quit IRC18:50
clarkbya then wait for startup to update the db18:51
openstackgerritJames E. Blair proposed openstack-infra/system-config: Add storyboard exim router/transports  https://review.openstack.org/27033118:51
*** roxanaghe has quit IRC18:51
*** esikachev has quit IRC18:52
jeblairgreghaynes: onFailed will all dib_image.delete()18:52
jeblairgreghaynes: i'm typing more things into the review18:54
openstackgerritMerged openstack-infra/system-config: Remove wheel_mirror known hosts  https://review.openstack.org/27847318:55
clarkbAJaeger: that seems equivalent to http://status.openstack.org//reviews/18:55
clarkbAJaeger: maybe just suggest neutron use that?18:55
jeblairgreghaynes: okay, left more comments18:56
AJaegerclarkb: Not really, they look at critical bugs, then create a URL for that - and thus it changes daily18:57
clarkbAJaeger: that is whay the review day thing does18:57
*** rossella_s has quit IRC18:57
clarkbAJaeger: it runs periodically and updates the list based on bug information18:57
*** sridhar_ram_afk has quit IRC18:57
*** rossella_s has joined #openstack-infra18:58
AJaegerclarkb: Ok, I'll talk with her about it. Thanks for the hint18:58
*** notnownikki has quit IRC18:58
clarkbAJaeger: it is possible we want to add gerrit dashboard links to that tool, but all of the base infrastructure fo rthat exists18:59
clarkbAJaeger: repo is called reviewday iirc18:59
*** max_lobur has quit IRC18:59
pleia2meeting time :)19:00
*** tiswanso has quit IRC19:00
*** edleafe has left #openstack-infra19:00
*** esikachev has joined #openstack-infra19:00
AJaegerthanks, pleia219:00
*** tiswanso has joined #openstack-infra19:01
openstackgerritMerged openstack-infra/puppet-openstackid: Put /usr/local/bin first in paths  https://review.openstack.org/28081019:03
fungiyolanda: nibalizer: you seem to have dropped off #-meeting19:03
nibalizeroh noes19:04
nibalizerswitching irc clients: risky19:04
*** pvaneck has joined #openstack-infra19:04
*** kzaitsev_mb has quit IRC19:04
*** sabeen1 has joined #openstack-infra19:05
*** gibi has quit IRC19:06
*** infra-red has quit IRC19:07
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Make postgres job non-voting on Ironic  https://review.openstack.org/28088819:07
*** gibi has joined #openstack-infra19:07
*** sabeen2 has joined #openstack-infra19:07
*** gibi has quit IRC19:08
*** infra-red has joined #openstack-infra19:09
*** sabeen1 has quit IRC19:10
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Make postgres job non-voting on Ironic and switch it to IPA  https://review.openstack.org/28088819:11
*** mtanino__ has quit IRC19:12
*** gibi has joined #openstack-infra19:12
*** notnownikki has joined #openstack-infra19:12
*** ybathia has quit IRC19:13
*** daemontool has joined #openstack-infra19:14
*** vgridnev has quit IRC19:14
*** esikachev has quit IRC19:15
*** sputnik13 has joined #openstack-infra19:15
openstackgerritAliaksandr Buhayeu proposed openstack/python-jenkins: Adds method to retrieve all jobs from the specific view  https://review.openstack.org/27975019:16
AJaegerandreaf: could you review https://review.openstack.org/#/c/278091/ , please?19:16
*** daemontool_ has joined #openstack-infra19:16
*** dimtruck is now known as zz_dimtruck19:17
*** infra-re_ has joined #openstack-infra19:17
*** eharney has quit IRC19:17
*** esikachev has joined #openstack-infra19:18
openstackgerritErno Kuvaja proposed openstack/requirements: glance-store 0.11.0  https://review.openstack.org/28089119:18
*** daemontool has quit IRC19:19
*** gsagie_ has joined #openstack-infra19:19
*** infra-red has quit IRC19:21
*** zz_dimtruck is now known as dimtruck19:21
lifelesssdague: sure; I presume this is about constraints?19:26
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove unused periodic-pbr-installation-dsvm-upstream  https://review.openstack.org/28089419:27
*** ajmiller has joined #openstack-infra19:27
*** jtomasek_ has joined #openstack-infra19:28
AJaegerlifeless: this was about change I150640990fb900318878563544af91e0a6043882 - and how to move forward with constraints19:28
AJaegerlifeless: with that change in, we don't need a separate gate-{name}-pep8-constraints anymore19:29
*** SumitNaiksatam has joined #openstack-infra19:29
*** infra-red has joined #openstack-infra19:29
AJaegerlifeless: see also https://review.openstack.org/26709619:29
AJaegerlifeless: and to me the constraints move looks stale right now - with some projects having them non-voting but not making progress.19:30
*** ajmiller_ has quit IRC19:30
AJaegerlifeless: so, I'd like to see some guidance on how to move forward, please19:30
*** sridhar_ram has joined #openstack-infra19:30
*** infra-re_ has quit IRC19:32
*** EricGonczer_ has joined #openstack-infra19:33
*** ifarkas has quit IRC19:33
*** EricGonczer_ has quit IRC19:34
*** roxanaghe has joined #openstack-infra19:34
*** roxanaghe has quit IRC19:36
*** eharney has joined #openstack-infra19:37
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Fix name of ha-guide post job  https://review.openstack.org/28089919:38
*** max_lobur has joined #openstack-infra19:39
*** gsagie_ has quit IRC19:40
*** electrofelix has quit IRC19:42
*** roxanaghe has joined #openstack-infra19:42
openstackgerrityolanda.robla proposed openstack-infra/puppet-infracloud: Parameterize entries for neutron subnet  https://review.openstack.org/26690219:43
*** eil397 has joined #openstack-infra19:44
openstackgerrityolanda.robla proposed openstack-infra/puppet-infracloud: Remove dummy default password from keystone  https://review.openstack.org/28090319:45
*** Sukhdev has joined #openstack-infra19:47
annegentlefungi: if a spec is under consideration, which section to add it to?19:48
*** weshay has quit IRC19:48
annegentlelooking at doc/source/index.rst19:48
*** roxanaghe has left #openstack-infra19:49
*** weshay has joined #openstack-infra19:50
*** yamamoto has joined #openstack-infra19:50
AJaegerannegentle: add to "Approved Design Specifications"19:53
annegentleAJaeger: hehe but it's not approved so I got confused :)19:53
AJaegerbecause once it's approved, that's the right place19:53
AJaegerannegentle: having it approved is your goal ;)19:53
AJaegeryou propose a change so that it gets approved :)19:53
*** vgridnev has joined #openstack-infra19:54
*** EricGonczer_ has joined #openstack-infra19:54
openstackgerritAnne Gentle proposed openstack-infra/infra-specs: Adds specification for serving REST API info on developer.openstack.org  https://review.openstack.org/27648419:54
openstackgerritgreghaynes proposed openstack-infra/nodepool: Handle dib image deletion during periodic cleanup  https://review.openstack.org/27370319:54
annegentleAJaeger: :)19:54
greghaynesjeblair: clarkb ^19:54
*** yamamoto has quit IRC19:56
fungiannegentle: yeah, once the change adding it to approved merges, it will actually be approved, so ina mind-bending future-past sort of way it makes sense?19:56
annegentlefungi: sure does. Plus, positive thinking!19:57
clarkbjeblair: there is a bug in your change, do you want me to push a new patchset with the fix and test?19:57
*** infra-re_ has joined #openstack-infra19:57
clarkbs/in/with/ might be a better way to describe it19:57
jeblairclarkb: yes please, thanks19:58
*** infra-r__ has joined #openstack-infra19:59
*** infra-red has quit IRC20:00
*** rfolco has quit IRC20:01
fungipabelanger: clarkb: did the additional jobs at https://review.openstack.org/278793 make sense from the perspective of getting a broader idea of impact of the bindep addition to most of our bare worker job templates? have suggestions for others i should add? maybe some infra puppet jobs?20:01
*** vgridnev has quit IRC20:01
*** e0ne has joined #openstack-infra20:02
*** gnuoy_ has joined #openstack-infra20:02
fungii've also realized we probably need to either hurry up our transition off of bare-precise or get dib-based ubuntu-precise images working20:02
*** infra-re_ has quit IRC20:03
clarkbfungi: I havne't looked but mordred has a change to oscc that should make our uploads to rax work20:03
clarkbso that portion of the ubuntu-trusty work is making progress20:03
*** e0ne has quit IRC20:05
openstackgerritClark Boylan proposed openstack-infra/nodepool: Delete building images on startup  https://review.openstack.org/22611420:05
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test building node cleanup on startup  https://review.openstack.org/28090920:05
clarkbjeblair: ^ there we go20:05
jeblairclarkb: rebase :(20:06
pabelangerfungi: Ya, it helped a bit.20:06
clarkbjeblair: yup the old base was really old20:06
clarkband conflicted in the tests20:06
jeblairclarkb: could you do it as 2 patchsets please?20:07
*** gnuoy_ has quit IRC20:07
*** dtantsur is now known as dtantsur|afk20:07
jeblairclarkb: you say there's a problem with the first patchset, but i can't see what you did to fix it20:07
clarkbjeblair: do what as two patchsets?20:07
jeblairclarkb: the rebase and whatever change you made20:07
openstackgerritChuck Short proposed openstack/requirements: Add requests-unixsocket as a requirement  https://review.openstack.org/28091120:08
clarkbjeblair: ok...20:08
clarkbI am not sure thats a thing we have ever asked for before?20:08
jeblairclarkb: i ask for it all the time20:08
*** flepied1 has joined #openstack-infra20:08
*** jaosorior has quit IRC20:09
*** flepied has quit IRC20:10
jeblairclarkb: if someone updates a change with a new patchset, i want to be able to see the difference between them, but if there is a rebase *plus* a change, it is nearly impossible to do so.  the inter-patch-set-diff is thousands of lines long.20:10
pabelangerfungi: let me know what I should be working on to help escalate the bare-precise migration.  So far, I've just been monitoring bindep non-voting jobs and seem to be fine for project-config.  Same for nova20:10
greghaynesjeblair: that'll merge a bug in our git history20:10
clarkbgreghaynes: two patchsets not changes20:10
greghaynesAh20:11
openstackgerrityolanda.robla proposed openstack-infra/puppet-infracloud: Add element to bring up bridge on infra cloud  https://review.openstack.org/27629220:11
clarkbjeblair: I get that... but that is a problem with how we tell people to use gerrit20:11
pc_mDoes anyone know if we are supposed to be using otestr instead of testr now for test jobs?20:11
*** eil397 has quit IRC20:11
clarkbI don't know that any of our docs say do an intermediate patchset for the rebase20:11
*** sabeen2 has quit IRC20:11
jeblairclarkb: i don't know that we tell people to rebase and make changes at the same time.  in fact, we tell them to try not to rebase.  i wrote a tool to make that easier.20:11
clarkbin this case the rebase was required20:12
jeblairclarkb: i agree, we don't go out of our way to say "upload 2 patchsets if you need to do this" but maybe we should start20:12
clarkbdue to conflicts20:12
jeblairclarkb: i get it20:12
*** sambetts is now known as sambetts|afk20:12
openstackgerritClark Boylan proposed openstack-infra/nodepool: Delete building images on startup  https://review.openstack.org/22611420:13
clarkbthere is the rebase20:13
jeblairclarkb: but here's my mental state: "clarkb said there's something wrong with a patch i wrote.  i do not know what that thing is.  if i want to understand the change he made to fix that, i need to either look at 4000 lines of diff, or mentally interdiff, or ask clarkb to explain it"20:13
jeblairclarkb: it's not an ideal state for a reviewer (or author) to be in20:13
*** aysyd has quit IRC20:13
clarkbbelieve me I understand the issues. There are ways around them, most of them don't involve completely respinning patches20:14
jeblairclarkb: i'm open to alternative suggestions20:14
*** lucasagomes is now known as lucas-dinner20:14
fungipabelanger: yeah, i think in the interest of time i'm going to take the one +2 on 278793 (thanks AJaeger!) as an indication it's a good start, self-approve it and then as soon as that and its child change merge in a little while, upload some do-not-merge changes for the 15 projects using that project-template and do a check experimental on them20:14
jeblairclarkb: and i hope it's a checkout, rebase, and cherry-pick.  if you want, i can do it.20:15
clarkbjeblair: I am doing it, currently running into no changes rejection from gerrit20:15
*** sdake_ has joined #openstack-infra20:15
clarkbI think for the child change20:15
*** wolverin_ has joined #openstack-infra20:17
*** sdake has quit IRC20:17
clarkboh it is mad about the old patchset I see, one sec20:18
*** suhani has joined #openstack-infra20:18
*** ldnunes has quit IRC20:18
pabelangerfungi: sure, that works for me20:18
*** infra-red has joined #openstack-infra20:18
*** david-lyle has quit IRC20:18
openstackgerritClark Boylan proposed openstack-infra/nodepool: Delete building images on startup  https://review.openstack.org/22611420:19
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test building node cleanup on nodepool startup  https://review.openstack.org/28090920:19
clarkbthere we go20:19
clarkbI think20:19
fungiyeah, i think every time gerrit has ever rejected a change of mine for duplication reasons, it's actually been pebcak/id10t on my part20:20
*** smarcet has quit IRC20:20
clarkbwell it wasn't pebkac20:20
fungijust sometimes takes me a few minutes to figure out what it was i was actually doing wrong20:20
*** wolverineav has quit IRC20:20
clarkbgerrit doesn't allow what jeblair asked for unless you do some really forceful things20:20
*** infra-r__ has quit IRC20:20
*** wolverin_ has quit IRC20:21
clarkbcherry pick qualifies which I didn't use20:21
clarkbrebasing doesn't sufficiently change the patch diff which gerrit uses to see if things are differnet20:21
*** annegentle has quit IRC20:21
jeblairclarkb: (a rebase is a series of cherry-picks)20:21
*** esikachev has quit IRC20:21
clarkbjeblair: but cherry picks rewrite the commit timestamp20:21
clarkbrebase won't20:21
clarkbwhich I think is the difference here20:22
*** annegentle has joined #openstack-infra20:22
fungiclarkb: oh, even if the commit sha is different that's not enough to satiafy gerrit?20:22
suhanihi20:22
fungier, satisfy20:23
clarkbfungi: correct because it looks at a diff that doesn't include the sha20:23
clarkbor rather looks at a different sha that doesn't include the commit sha20:23
clarkbwhich is the sha of that diff20:23
clarkbsuhani: hello20:23
suhaniI have a question20:24
jeblairclarkb: a rebase will rewrite any commits it needs to....20:24
jeblairclarkb: ('pick' in interactive rebase means 'cherry-pick')20:24
clarkbjeblair: yup but in this case it was a fast forward because I hadn't included my changes20:24
suhaniI used my personal account for third party CI and has been disabled because of that20:24
*** claudiub has quit IRC20:24
fungiclarkb: i'm failing to understand how your rebase could result in a fast-forward from your previous patchset20:24
suhaniclarkb: I now know that we shouldn't use personal account for the same20:24
openstackgerritMerged openstack-infra/project-config: Add experimental bindep for the python-jobs group  https://review.openstack.org/27879320:24
clarkbjeblair: and then the end ps was identical to the earlier ps20:24
suhaniclarkb: is it possible to enable it again20:25
clarkbfungi: the first rebase, to just do the reabse was a fast forward, that worked fine20:25
clarkbfungi: the second rebase is identical to the preexisting patchset we don't want20:25
*** miqui has joined #openstack-infra20:25
clarkbbecause it was rebased20:25
*** mayurig has joined #openstack-infra20:25
clarkbthe diff sha is the same20:25
openstackgerritMerged openstack-infra/project-config: Extend experimental-bindep-jobs to 14 projects  https://review.openstack.org/27879820:25
clarkbbecause timestamps are preserved I think20:26
clarkbyup20:26
fungisuhani: it wasn't just that you used your account for a third-party ci system, but that you were leaving automated comments on all sorts of changes for different projects who hadn't asked you to do so and didn't have a public policy encouraging third-party testing comments20:26
fungisuhani: so the main reason we disabled the account was to get it to stop spamming20:27
suhanifungi: yes I now know that and won't be doing that again20:27
*** notnownikki has quit IRC20:27
*** dtardivel has quit IRC20:28
clarkbbasically you need some change in the commit message or the code diff, and rebase by default preserves the timestamp and author20:28
clarkbso that isn't sufficient in this case20:28
*** tiswanso has quit IRC20:28
pleia2suhani: we can re-enable your account then, but we will have to shut it off if we see more automated comments20:28
*** mdenny has joined #openstack-infra20:28
clarkbcherry pick will update the timestamp20:29
jeblairclarkb: your solution is a good one anyway.  :)20:29
clarkbya I just edited the commit message20:30
suhanipleia2: i agree20:30
suhanipleia2: and i assure that it won't be happening again20:31
fungisuhani: pleia2: i just did it and replied to the ml20:31
pleia2suhani: your account is now activated20:31
*** gnuoy_ has joined #openstack-infra20:31
pleia2fungi: oops20:31
*** gnuoy_ has quit IRC20:31
suhanithank you everyone20:31
fungidoubly-activated!20:31
*** sdake_ has quit IRC20:32
pleia2:)20:32
fungilike baking powder?20:32
fungino, wait, that's double-acting20:32
*** sdake has joined #openstack-infra20:32
jeblairclarkb: thank you for the update, i can see clearly the change now.20:32
*** asselin_ has quit IRC20:33
clarkbgreat. The test logs pointed out that we weren't flipping any image states which was odd and led me to that20:33
*** qb_ has quit IRC20:36
*** sabeen has joined #openstack-infra20:37
clarkbjeblair: as for alternatives `diff <(git show $ref) <(git show $other_ref)` works reasonably well20:38
fungithat's a useful one-liner. i didn't realize git could take two stdin redirections20:39
clarkbfungi: diff does not git20:39
*** wolverineav has joined #openstack-infra20:39
fungii meant diff, yeah20:39
*** |-paul-| has joined #openstack-infra20:40
*** kzaitsev_mb has joined #openstack-infra20:40
*** sabeen3 has joined #openstack-infra20:41
*** tiswanso has joined #openstack-infra20:41
openstackgerritPaul Michali proposed openstack-infra/project-config: Cleanup of constraint based jobs for neutron-vpnaas  https://review.openstack.org/28092220:41
*** sabeen has quit IRC20:42
*** rkukura has joined #openstack-infra20:42
fungithat's awesome. where has this been all my life!20:42
fungigoodbye tempfiles to perform sorted diffs20:43
*** wolverineav has quit IRC20:43
pleia2hehe20:43
*** wolverineav has joined #openstack-infra20:43
clarkbI can write a shell script to do it20:43
clarkband fetch the thingsfrom gerrit20:43
*** thorst_ is now known as thorst20:44
jeblairclarkb: that seems to work well in this case, though i know in the past i've tried it and it's produced some pretty unreadable stuff.  it does have the disadvantage of not making it particularly easy to review the result.20:44
tonybhaypo: I can look at it but I'm not in a position to bless it.20:45
AJaegersdague, lifeless : FYI, here's a first constraints change https://review.openstack.org/#/c/28092220:46
tonybthorst: Thanks20:46
haypotonyb: for https://review.openstack.org/280854 (oslo.service release in liberty), sorry, i don't know the status of oslo lib in liberty, except that it looks to be a mess :)20:47
haypotonyb: i saw that upper-constraints.txt of liberty uses an oslo.service version of mitaka...20:47
tonybhaypo: Oh wow, that seems like a bug.20:48
jeblairclarkb: have you found that process to be fairly reliable and comprehensible?20:48
clarkbjeblair: for me at least20:48
AJaegerfungi, ok to approve tonyb's change for removal of registered users? Or do you want to review it? https://review.openstack.org/#/c/28043920:48
clarkbjeblair: you just map the > side diff onto the base..newps diff20:48
clarkband comment there20:48
tonybhaypo: Oh are you thining about the *-src-$library jobs on liberty that pull $library from master?20:48
jeblairclarkb: aside from whether this technique is effective; do you think we should not ask reviewers to separate rebase and change patchsets?20:50
haypotonyb: i'm talking about https://github.com/openstack/requirements/blob/stable/liberty/upper-constraints.txt#L20120:50
jeblairclarkb: sorry, ask submitters20:50
haypomriedem knows maybe more about this issue ^^20:50
clarkbjeblair: I do not, in ~4 years of using gerrit I haven't felt that that was required20:51
jeblairclarkb: my thinking is that i'd really like change history to be easily viewable in gerrit, and i want things to be as easy as possible for reviewers20:51
clarkbsometimes it is difficult to read the diffs but there are easier ways of working through that then waiting on an asnyc process that may never happen20:51
jeblairclarkb: yeah, so i'm not actually suggesting that the process be that reviewers ask developers to go back and do things again, but rather that we ask developers to do this in the first place, when it's much simpler20:52
clarkbjeblair: the problem that is you will get lots of gratuitous rebase patchsets because it is easier to do the rebase before yo umake changes than after20:53
*** Sukhdev has quit IRC20:54
jeblairi know i try to do it when i submit changes; and i think other gerrit communities have adopted it explicitly as a best practice20:54
*** gyee has quit IRC20:54
clarkbideal situaton would just be to support the interdiff in gerrit20:54
clarkbor gertty20:54
jeblairclarkb: you only did the rebase after you tried to push the change, right?20:55
*** gordc has joined #openstack-infra20:55
jeblairclarkb: so that's still the same point in the process -- you have already written the change.  the question is, once git-review tells you you need to rebase, what do you do?20:55
mriedemhaypo: short story is that the bot was proposing updates to u-c in liberty and those were approved willy nilly20:55
mriedemhaypo: those haven't been unwound yet20:55
tonybhaypo: Ahh I see what you mean.20:55
mriedemsome of that was being talked about in https://etherpad.openstack.org/p/stable-liberty-constraints-sanity20:55
fungiAJaeger: tonyb: should be fine. it's also just cleanup now, the issue in the groups files has been corrected manually20:56
jeblairclarkb: i'm suggesting that one could, at that point, rebase the original patchset, push, cherry-pick the change, push20:56
* tonyb just volenteered to try and unwind some/all of that.20:56
tonybfungi: Thanks.20:56
clarkbjeblair: right the difference is in juggling old and new20:56
clarkbyou don't have to do that if you just explicitl deal with old first20:56
AJaegerfungi: approved...20:57
jeblairclarkb: you're saying people will want to pro-actively rebase to avoid the chance of having to do what i described?20:57
clarkbyes20:57
jeblairclarkb: that seems even more reviewer unfriendly20:58
clarkbyes20:58
jeblairi dunno20:58
jeblairi guess i'm trying to suggest that maybe we could try to do a little more work to make things easier for reviewers20:58
jeblairclarkb: but i guess you and i have had radically different experiences over the last 4 years20:58
*** jsavak has joined #openstack-infra20:58
jeblair(i've tried to do this when i submit changes, and i often do it on changes i'm reviewing to help both myself and other reviewers)20:59
openstackgerritMatthew Treinish proposed openstack-infra/system-config: Remove retry-get param from subunit file collection  https://review.openstack.org/28092420:59
*** suhani has quit IRC21:00
clarkbjeblair: mostly I see it as a tool problem not a rpocess problem21:00
clarkbwe already have a hrad enough time explaining to people how to update old patchsets21:00
jeblairclarkb: i agree; if interdiff were reliable, i'd use it in a heartbeat.  i have not figured out how to make it so.21:00
jeblairclarkb: interdiff <(git show 318e6e41bdc6c9d4d8eb77e475bd360fb0345687) <(git show 055c0064442bf4f7c08d6692a7ad86eb50182f90)21:01
jeblairclarkb: that showed the changes you made, but also, some rebase stuff leaked in there21:01
jeblairclarkb: diff <(git show 318e6e41bdc6c9d4d8eb77e475bd360fb0345687) <(git show 055c0064442bf4f7c08d6692a7ad86eb50182f90)21:01
jeblairclarkb: that shows exactly what we want to see21:02
*** sarob_ has joined #openstack-infra21:02
*** _sarob has quit IRC21:02
jeblairclarkb: but if you want to leave a review comment, it involves opening things up in multiple windows and trying to map between them21:03
clarkbya line numbers in the header for diff21:03
clarkbis hwy there is leakage21:03
*** _sarob has joined #openstack-infra21:03
clarkbthere is probably a flag to diff to avoid that21:03
*** sarob_ has quit IRC21:03
clarkbjeblair: that wouldn't be necessary if gerrit/gertty did it for you21:03
*** haypo has left #openstack-infra21:03
openstackgerritDan Prince proposed openstack-infra/project-config: Add puppet-zaqar to tripleo jobs  https://review.openstack.org/28092821:03
*** apoorvad has quit IRC21:04
* clarkb is reading git diff-tree manpage to see if the leakage can be cleaned up21:04
jeblairclarkb: yeah, i'd love to add it to gertty, but i haven't seen how without getting a working/reliable interdiff21:04
openstackgerritMerged openstack-infra/project-config: Remove Registered Users from seeting -1..1 in Code-Review  https://review.openstack.org/28043921:04
clarkbI mean even with that leakge it is really readable21:05
*** sarob_ has joined #openstack-infra21:06
jeblairclarkb: yeah, but it's not correct -- it's suggesting something changed in the update when it really came from the rebase21:06
*** sputnik13 has quit IRC21:06
clarkbbut only because git diff is smart and showing us a bunch of unnecessary context21:06
lifelessaaron bentley solved this comprehensively for bzr21:07
clarkbwhich should be toggleable (looking for that now)21:07
*** sputnik13 has joined #openstack-infra21:07
lifelessbut you need to track where the lines came from, and only show lines - added or removed - that originated in the patch side, not the mainline21:07
*** sdague has quit IRC21:07
lifelessI'm not aware of an implementation of that for git; be happy to find out I'm just ignorant :)21:08
*** sputnik13 has quit IRC21:08
clarkblifeless: isn't the inner diff doing that? gives you the lines from the patches21:08
*** _sarob has quit IRC21:09
openstackgerritColleen Murphy proposed openstack-infra/puppet-infracloud: Update SSL configuration  https://review.openstack.org/27928621:10
lifelessclarkb: well you need to mask out the line offset hunks for instance21:11
lifelessclarkb: because if e.g. master adds 5 lines, but the patches only change was the hunk offset, you shouldn't show that in a diff of the two versions of the patch21:11
*** kgiusti has left #openstack-infra21:11
lifelessclarkb: but if the patch was actually changed to apply to a matching context 15 lines down, you should show that21:11
*** wolverineav has quit IRC21:11
lifelesseven if the only change is the hunk offset21:12
*** asselin_ has joined #openstack-infra21:12
*** apoorvad has joined #openstack-infra21:12
tristanCttx: (and interested folks too): for the Newton PTL/TC election, here is the proposed timeline: https://review.openstack.org/#/c/278102/2/events.yaml21:12
*** jsavak has quit IRC21:14
*** bpokorny has quit IRC21:14
clarkbyup I thought there was a way to set the git diff format but it seems to insist on those (which make sense in the context of diff I suppose)21:14
*** sarob_ has quit IRC21:15
*** _sarob has joined #openstack-infra21:15
*** daemontool__ has joined #openstack-infra21:17
*** austin81 has joined #openstack-infra21:17
jeblairlifeless: git->bzr and then ask bzr for the result? :)21:17
lifelessjeblair: it would work :)21:17
lifelessjeblair: but, maybe a tad slow21:17
clarkbyou can format git diff output but not the diff itself looks like21:18
fungitristanC: so ideally ptls have at most 3 more tc meeting sessions/weeks to get extra-atcs entries added before voting begins (but probably only 2 if they also want those extra-atcs to get summit registration discount codes)21:18
*** fawadkhaliq has quit IRC21:18
*** daemontool_ has quit IRC21:20
jeblairclarkb: i wonder if this is perhaps becoming more of an issue because we were less likely in the past to make a new revision of a patch that has been sitting unreviewed for 5 months.21:20
*** alivigni has quit IRC21:20
tristanCfungi: alright, to avoid last time liberty-mitaka timeframe overlapping with elections, we defined the mitaka-newton timeframe to end right before candidacy submission, so atc roll should be extracted from contribution made between March 4, 2015 00:00 UTC and March 3, 2016 23:59 UTC21:20
jeblair(or partially reviewed)21:21
tristanCfungi: (if that works for you)21:21
fungitristanC: that sounds good. that's right after feature freeze too21:22
tristanChum, that's 3 week sharp from now, so that could be adjusted to right before actual election, so March 1021:22
fungitristanC: also fine, but we should get ttx to add the election tag to the governance repo on whatever date that is21:23
*** sdake_ has joined #openstack-infra21:24
fungitristanC: something like 24 hours before election starting is appreciated because that allows me to get you the rolls in advance21:24
*** dprince has quit IRC21:24
fungirather than delaying the start of the election while you wait for me to generate them21:24
*** sdake has quit IRC21:25
tristanCfungi: noted, so March 4 deadline seems the more convenient21:25
fungitristanC: yeah, sounds a little better21:27
*** baoli has quit IRC21:29
jeblairclarkb: i don't understand why interdiff is confused about the second and third hunks -- is it the line numbers?21:31
ianwgreghaynes: do you know off-hand if 1.11.0 dib release got last night's builds?  (i haven't done the timestamp analysis yet)21:31
greghaynesianw: very unlikely21:32
greghaynesianw: I did it a few hours ago and builds happen very late PST night IIRC21:32
ianwgreghaynes: ok, cool, just noticed the tag when i pulled21:32
clarkbjeblair: yes that code moved and the lin numbers changed, it is the thing lifeless was tlaking about21:32
clarkbjeblair: basically if we filter out line numbers for viewing but preserve them for commenting this should work21:33
clarkbbut does require more processing than git seems t provide out of the bix21:33
*** Sukhdev has joined #openstack-infra21:33
lifelessthat heuristic can be wrong too, but as a first approximation it would be pretty good21:34
*** bpokorny has joined #openstack-infra21:34
*** Sukhdev has quit IRC21:35
*** infra-red has quit IRC21:35
openstackgerritAustin Clark proposed openstack-infra/project-config: Create stackviz element and script in nodepool (WIP)  https://review.openstack.org/27931721:35
*** dims has quit IRC21:37
*** daemontool has joined #openstack-infra21:38
*** jtomasek_ has quit IRC21:39
*** daemontool__ has quit IRC21:42
openstackgerritIan Cordasco proposed openstack-dev/pbr: Include wsgi_scripts in generated wheels  https://review.openstack.org/28027021:43
*** weshay has quit IRC21:44
austin81ianw: Thanks for the comment on https://review.openstack.org/#/c/279317/ . Do you think it should be a separate element?21:44
sigmavirus24lifeless: added a test but I'm not sure if I need more than that. I didn't see any tests for the other internal functions in pbr.packaging so I didn't add any for the functions I made21:44
ianwaustin81: i feel like it's probably a separate thing enough to justify one.  greghaynes might have an opinion too21:45
jeblairclarkb: i don't see how to accomplish this by removing line numbers......21:46
*** wolverineav has joined #openstack-infra21:46
clarkbjeblair: you would filter those lines out of thediffs before interdiffing21:46
*** wolverineav has quit IRC21:46
jeblairclarkb: but i think interdiff parses those?21:46
clarkbits just diff21:46
clarkbso if those lines are different they show up21:46
*** wolverineav has joined #openstack-infra21:46
jeblairclarkb: oh you're saying diff21:46
clarkbgrep -v ^@@21:46
clarkborsometing21:46
openstackgerritMerged openstack/requirements: update docker-py to 1.6.0  https://review.openstack.org/27062521:47
jeblairclarkb: well we don't have to do anything with diff, except that diff of a diff doesn't output a diff that we can understand21:47
jeblairprogramatically...21:47
openstackgerritMerged openstack/requirements: Try to avoid future attempts to 'fix' usage of mock  https://review.openstack.org/27932921:47
greghaynesaustin81: Yea, I would recommend making another element21:47
jeblairclarkb: we just get this:21:47
jeblair< +            exp = exp.filter(node_table.c.state == state)21:47
jeblair> +            exp = exp.filter(snapshot_image_table.c.state == state)21:47
clarkbright thats prorammtically parseable21:48
clarkbmeans left side used the first line and right side used second line21:48
jeblairclarkb: yeah, but which lines in the patch are those?21:48
clarkbyou retain the line number information you just don't use it in calculating then interdiff which allows you to determine the line numbers for each of those21:48
clarkbjeblair: whatever the @@ line says it is21:48
*** |-paul-| has quit IRC21:49
jeblairclarkb: this s the relevant section of the diff output: http://paste.openstack.org/show/487182/21:49
austin81ianw, greghaynes: Ok great I'll get to work on that. Is there a way to tell packages.yaml to install nodejs-legacy on ubuntu and just nodejs on others?21:49
greghaynesaustin81: yes, check out http://docs.openstack.org/developer/diskimage-builder/elements/pkg-map/README.html21:50
*** dims has joined #openstack-infra21:50
openstackgerritMerged openstack-infra/project-config: Make postgres job non-voting on Ironic and switch it to IPA  https://review.openstack.org/28088821:50
*** gyee has joined #openstack-infra21:50
jeblairclarkb: but nothing there tells me how to get to that part of the inter-patchset-diff21:50
clarkbjeblair: what I am trying to say is that the interdiff (outer diff call) has to be smart21:50
clarkbjeblair: the diff utility is not smart like that21:51
clarkbbut it is doable21:51
jeblairclarkb: okay, i'm trying to understand how to implement "smart"21:51
clarkbjeblair: for each line in either inner diff annotate with meta data, line no, add minus etc21:51
clarkbjeblair: then diff them, show the differences with the preparsed metadata21:51
openstackgerritMerged openstack/requirements: Add watcher and python-watcherclient to projects.txt  https://review.openstack.org/27832121:52
jeblairclarkb: the inner diff is the patchset diff? eg, 'git show patchset1' and 'git show patchset2'?21:53
clarkbjeblair: yes21:53
jheskethMorning21:53
clarkbthat gives you the difference between that patchset and its parent21:53
jeblairclarkb: and you are suggesting annotating every line of that with metadata?21:54
clarkbjeblair: doesn't have to be every line but every line makes it easier to do the interdiff21:54
*** mriedem has quit IRC21:55
jeblairclarkb: https://etherpad.openstack.org/p/FAN6LW3B5c21:55
*** roxanaghe has joined #openstack-infra21:55
*** rhallisey has quit IRC21:55
*** _sarob has quit IRC21:56
*** roxanaghe has quit IRC21:56
jeblairclarkb: you're creating a data structure, and i'm creating a text file.....21:57
jeblairclarkb: when you said "annotate the lines before running a diff" i thuoght you meant run diff21:57
*** roxanaghe has joined #openstack-infra21:57
clarkbno21:57
clarkbthat is what I was saying21:57
clarkbdiff cannot do this21:58
clarkbbut that doens't mean somethingelse can't21:58
*** jtomasek has quit IRC21:58
jeblairclarkb: okay, a while back you said something about preprocessing things...21:58
jeblairclarkb: are you saying all we have to do is implement diff?21:58
*** tongli has quit IRC21:59
clarkbnot necessarily, you likely can use existing diffing tools if you maintain the metadata elsewhere and can map back to it21:59
jeblairclarkb: do you have an idea of how to do that?21:59
jeblairclarkb: because i'm really serious about implementing this, and it sounded like you have figured out a way, and i'm trying really hard to understand what that is.22:00
lifelessthere is python code to parse diffs around22:00
jeblairlifeless: i know, i use a lot of it in gertty22:00
*** annegent_ has joined #openstack-infra22:00
clarkbjeblair: one way would be to do like you were saying, create a new string representation, diff that, then do extra parsing around the results to decide if something should be present or not22:01
*** arxcruz has joined #openstack-infra22:01
clarkbbasically there has to be a way to carry the information forward22:01
jeblairclarkb: maybe we're focusing on the wrong thing22:01
jeblairbecause this conversation has turned toward parsing diffs, which is a pretty easy problem22:02
clarkbright so steps are parse first diffs to know what line numbers and such are before they get lost interdiffing. Then diff the diffs, map the parsed info onto the interdiff22:03
*** salv-orlando has joined #openstack-infra22:03
*** thorst has quit IRC22:03
jeblairokay, so when you diff the diff, how do you map the results of that back to the hunks you parsed in step 1?22:03
*** sridhar_ram1 has joined #openstack-infra22:03
jeblairfrom what i see, we've lost the identifying information22:03
clarkbthe way I would do it is by diffing the data structures and not the text22:03
*** thorst has joined #openstack-infra22:03
*** sridhar_ram has quit IRC22:04
clarkbnaive way of doing that is find difference between two sets, sort by line no, filename print22:04
clarkbprobably not very performant but should be correct22:04
*** annegentle has quit IRC22:05
*** daemontool has quit IRC22:05
*** salv-orl_ has quit IRC22:05
*** annegent_ has quit IRC22:05
lifelesssigmavirus24: the helper /should/ be unit tested please.22:06
*** ZZelle_ has joined #openstack-infra22:06
*** annegentle has joined #openstack-infra22:06
lifelesssigmavirus24: I'll look in a bit to assess the exterior coverage22:06
sigmavirus24lifeless: the generate_script helper?22:06
*** tpsilva has quit IRC22:06
greghaynesclarkb: Sorry to interrupt, but are you planning to restart nodepool still?22:07
lifelesssigmavirus24: please. pbr has a history of poor coverage and we've been lifting the bar incrementally22:07
clarkbjeblair: if this was C you could use pointers into the same list of strings22:07
clarkbgreghaynes: I wanted to get these fixes in but maybe that isn't happening22:07
*** thorst_ has joined #openstack-infra22:07
greghaynesclarkb: Yea, I think tripleo is :(22:07
*** jdurgin has quit IRC22:07
sigmavirus24lifeless: certainly. I know some people think things can be tested too much and I wasn't sure if that was pbr's philosophy22:07
*** thorst has quit IRC22:08
jeblairclarkb: still comparing a hunk at a time?22:08
clarkbjeblair: that would probably keep the code more manageable and possible let you to leave out some state like filename22:09
jeblairclarkb: i guess i'm wondering how do you decide which line record to compare another one too?22:10
clarkbyup you would do that by hunk22:10
*** _sarob has joined #openstack-infra22:10
*** thorst_ has quit IRC22:11
*** baoli has joined #openstack-infra22:12
lifelesssigmavirus24: I think they can be too; but we're not at that point :)22:12
*** baoli_ has joined #openstack-infra22:12
lifelesssigmavirus24: my threshould is about 10K unit tests for a mid-sized CLI program.22:12
clarkbjeblair: another approach more similar to what you had in mind the first time is the parse the outer diff to map back to inner diffs22:13
clarkbactually that might be ebtter in general22:13
clarkbso first diff the inner diffs, parse the inner diffs and remove any information whihc is not required (like commit shas and so on)22:14
clarkbthen diff the two diffs, use metdata data in interdiff to map lines in interdiff back to their respective diffs22:14
*** thiagop has quit IRC22:15
clarkbthat is likely more memory but easier to reason about?22:15
clarkbsince you need to keep all three "files" in memory22:16
*** sputnik13 has joined #openstack-infra22:16
jeblairclarkb: i don't see how to annotate the diffs in a way to do that though -- the metadata would be different for either side22:16
*** baoli has quit IRC22:16
clarkblet me try pasting an example22:16
jeblairclarkb: and if you knew two lines in each side were actually the same (and could therefore put in the same metadata), you'd be done already.  i'm struggling with a similar situation in the data-structure version of this -- how do you decide which 2 lines to compare at any point.22:17
jeblairclarkb: oh, i see what you pasted... lemme digest22:18
clarkbjeblair: you do have to maintain externa lstate as you go because the diff output is not sufficient, but if you do that I think it will work22:19
clarkb*because the interdiff output is not sufficient22:20
clarkbit essentially becomes file by file diffing with pointer arithmetic back to the original content22:21
openstackgerritAustin Clark proposed openstack-infra/project-config: Create stackviz element and script in nodepool (WIP)  https://review.openstack.org/27931722:23
austin81ianw, greghaynes: ^ think I got it22:23
sigmavirus24lifeless: good to know22:23
sigmavirus24lifeless: do you want me to test private methods too?22:24
*** onovy has quit IRC22:24
*** peterlisak has quit IRC22:24
*** sabeen3 has quit IRC22:24
*** thorst has joined #openstack-infra22:24
clarkbgrr my tests broke on a thing that I thouht I had tested22:25
* clarkb fixes then will restart nodepool22:25
*** tzn has joined #openstack-infra22:25
*** flepied1 is now known as flepied22:26
*** sabeen1 has joined #openstack-infra22:26
lifelesssigmavirus24: maybe? :)22:27
*** onovy has joined #openstack-infra22:28
*** dkranz has quit IRC22:28
*** sabeen3 has joined #openstack-infra22:28
*** thorst has quit IRC22:28
openstackgerritClark Boylan proposed openstack-infra/nodepool: Delete building images on startup  https://review.openstack.org/22611422:30
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test building node cleanup on nodepool startup  https://review.openstack.org/28090922:30
clarkbnow hopefully with working tests22:30
*** miqui has quit IRC22:30
*** tzn has quit IRC22:30
*** peterlisak has joined #openstack-infra22:30
*** sabeen1 has quit IRC22:30
*** annegentle has quit IRC22:31
*** annegentle has joined #openstack-infra22:31
*** qb_ has joined #openstack-infra22:31
*** tykeal has joined #openstack-infra22:32
clarkbwe have one building image in nodepool still, so either we get that first change merged then restart or we wait for build to finish22:33
clarkbgreghaynes: ^22:33
tykealI have a question about zuul and nodepool. I see nothing in the docs that inform when a given slave VM gets disposed of. Is it after a job is completed on the slave VM that was triggered by zuul? Do all slaves operate as single-use slaves then?22:34
openstackgerritMerged openstack-infra/nodepool: Deprecated tox -downloadcache option removed  https://review.openstack.org/25675522:34
clarkbtykeal: if you attach nodepool to jenkins via the zmq event plugin then any build finished events that nodepool can find a matching node for will result in that node being deleted22:35
*** annegentle has quit IRC22:35
tykealclarkb: even if that build wasn't initiated by zuul?22:36
clarkbyes22:36
openstackgerritTim Burke proposed openstack-dev/hacking: Run all flake8 checks  https://review.openstack.org/27650022:36
austin81ianw: In reference to https://review.openstack.org/#/c/279317/5/nodepool/elements/stackviz/install.d/99-prepare-stackviz was there a patch that fixed this issue? Seemed like it was included in all the other elements to get around some sort of lint bug?22:37
tykealhrmm... doesn't seem to be working for me then. I'm bringing up a nodepool system for the first time and have a test slave configured that properly connects to jenkins. If I build a simple job that executes on that slave it doesn't seem to delete it after completion22:37
*** rhallisey has joined #openstack-infra22:38
clarkbtykeal: do you have the zmq event plugin running against your jobs?22:38
tykealI've got it enabled globally. Does it need to be enabled per job?22:38
clarkbnodepool relies on that for the information22:38
clarkbglobally should be sufficient22:38
clarkbtykeal: can nodepool connect to it? eg no firewall in the way?22:38
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: Upperbound on pysaml2 to avoid pycryptodome  https://review.openstack.org/28096822:38
clarkbtykeal: telnet $jenkinshost $portinuse22:38
tykealhmm... let me verify that I actually have it enabled globally, I've already check firewall22:38
tonybWhen/how does gerrit decide to remove prior +2's?  I see one that survived a manual edit which doesn't seem right to me.22:39
tykealah... no it wasn't globally enabled. let me retry22:39
clarkbtonyb: it retains them on what it considers a trivial rebase22:39
clarkbtonyb: no commit message changes and the sha1 of the diff remains the same ignoring whitespace22:39
clarkbtonyb: the ignoring whitespace bit because git is C centric22:39
jeblairclarkb: okay, so that process would tell us which of the hunks in the patches are different, but we still need to actually run the interdiff command to generate a diff to get something to display22:40
tonybclarkb: Hmm okay, I added a whole new line but perhaps it's a special case as my my PS (4) matches PS2 which is the one that was +2'd PS3 was uplaoded by the propsals bot and l=missed a manually added line22:41
clarkbjeblair: yes you need a thing (call it interdiff) implemented somewhere that knows how to display the interdiff based on the 3 diffs22:41
jeblairclarkb: you know about the interdiff command, right?22:41
clarkbjeblair: no22:41
clarkbis hat already a thing?22:41
tonybclarkb: yeah.22:42
jeblairomg no wonder we've been talking around each other.  :)22:42
jeblair21:01 < jeblair> clarkb: interdiff <(git show 318e6e41bdc6c9d4d8eb77e475bd360fb0345687) <(git show 055c0064442bf4f7c08d6692a7ad86eb50182f90)22:42
clarkbjeblair: ya looking at that now22:43
tykealah, sweet. thanks clarkb that was the key.22:43
clarkbjeblair: now I am really confused on what is missing22:43
*** tiswanso has quit IRC22:43
clarkbjeblair: that seems to give you what I have been talking about? file, line no, context, etc22:43
*** gordc has quit IRC22:43
jeblair21:31 < jeblair> clarkb: i don't understand why interdiff is confused about the second and third hunks -- is it the line numbers?22:43
jeblairclarkb: when i said that (and you responded!) i literally meant i ran the interdiff command and the output is not what we want22:44
openstackgerritTim Buckley proposed openstack-infra/devstack-gate: Install and run StackViz during devstack-gate host cleanup. (WIP)  https://review.openstack.org/21220722:44
jeblairclarkb: this is the output: http://paste.openstack.org/show/487198/22:44
*** dingyichen has joined #openstack-infra22:44
clarkboh I thought you meant you ran an interdiff with diff which is what my example command was22:44
clarkbin any case I do not know why interdiff is doing that, oyu can completely work around it using what I have described22:45
jeblairclarkb: it had no third hunk22:45
*** EricGonczer_ has quit IRC22:45
jeblairclarkb: interdiff produces 4 hunks, the middle 2 of which are erroneous22:45
clarkbright that should all be fixable by not using interdiff22:46
jeblairoh, sorry... 6 and middle 422:46
clarkbwhich is what I have been trying to explain all along22:46
clarkbya its two pairs of hunks22:46
clarkbthat are inverses of each other on different lines22:46
clarkbwhich I think is a move22:46
jeblairclarkb: i've seriously been trying to understand your explanation22:47
*** j_king has quit IRC22:47
clarkbjeblair: use diff22:47
clarkbto get the interdiff22:47
*** dims has quit IRC22:47
clarkbthen you can map from that interdiff back to the original diffs and figure out the details youself22:47
clarkbdiff does not erroneously do this22:48
jeblairclarkb: "figure out the details yourself" ?22:48
*** daemontool has joined #openstack-infra22:48
clarkbjeblair: in gertty or gerrit do what I describe on the etherpad22:48
jeblairclarkb: right, so... as i was saying... you have mapped back to the original patchsets22:49
jeblairclarkb: but not to a diff between them22:49
clarkbjeblair: the diff between them is the 3rd diff22:49
clarkbjeblair: you display that third diff with line numbers determined by mapping back22:50
*** Nakato has quit IRC22:50
*** Nakato has joined #openstack-infra22:50
jeblairclarkb: and generate context lines ourselves too?22:50
clarkbyes22:50
clarkbbut then you can avoid interdiffs super correct behavior22:51
clarkbI am sure it is hsowing you code moves now22:51
*** regXboi has quit IRC22:52
clarkbwoo rax upload timed out :/22:52
*** changbl has quit IRC22:52
clarkbwe may still have trouble with uploads once the token stuff is working22:52
clarkbbut this means I can restart the service now22:52
clarkbjeblair: now that I understand whta you were saying you have two choices, do interdiffing yourself to avoid code moves like that or use interdiff and accept that as overhead for correctness22:53
jeblairclarkb: well, it's not correct -- it is not actually a change introduced by the patchset author.  so it would be a disservice to show it to the user.22:54
clarkbit is correct in that it is a difference between the two diffs but you are right it is unrelated to the current changes22:54
clarkbthis is what lifeless was talking abut earlier though22:54
clarkbyou can fudge around the lin number moves22:55
*** pradk has quit IRC22:55
clarkbI am restarting nodepool now22:55
jeblairif you can identify them22:55
*** rossella_s has quit IRC22:57
clarkbbluebox just had a bunch of launch status errors22:58
*** rossella_s has joined #openstack-infra22:58
jeblairclarkb: i don't think we have arrived at a solution that will reliably show the actual difference in patchsets.  we are either faced with showing extra hunks from moves from the rebase, or not showing potentially legitimate moves (like if you move the same code down 15 lines as lifeless says)22:59
clarkbI do not see tripleo cloud errors22:59
clarkbjeblair: we could hsow the moves and let the reviewer sort it out?22:59
clarkbthat seems the most conservative22:59
clarkbgerrit's trivial rebase ignores moves iirc which is the other end of the spectrum23:00
*** sigmavirus24 is now known as sigmavirus24_awa23:00
openstackgerritAustin Clark proposed openstack-infra/project-config: Create stackviz element and script in nodepool (WIP)  https://review.openstack.org/27931723:00
clarkbI think you could argue it either way23:01
fungiit only ignores moves if the context lines all also match, but patch has similar issues when you get into situations like that, as does git cherry-pick/rebase/merge23:01
*** wolverin_ has joined #openstack-infra23:02
jeblairand in this case, interdiff produced 4 nonsense hunks23:02
clarkbthey aren't nonsense23:02
mordredclarkb: "rax upload timed out" - is that with oscc patch? or without?23:03
clarkbthey show that modified code in the old version is still modified in the new version but at a different location23:03
lifelessall diff tools are essentially heuristics23:03
clarkbmordred: without23:03
*** wolverin_ has quit IRC23:03
clarkbmordred: builder wouldn't have been restrated recently enough to pick up any new oscc releases23:04
*** shashank_hegde has quit IRC23:04
mordredclarkb: hasn't released - I wasn't sure if you happened to be trying the patch23:04
*** wolverineav has quit IRC23:04
jeblairclarkb: well, what we actually, _actually_ need to display, is a subset of what we get from 'git diff ps1 ps2'23:04
clarkbmordred: nope this is just production, that is a different error than the auth fail though23:05
mordredclarkb: I think I'm waiting on feedback from you to merge it - but I can merge it before feedback if that makes more sense23:05
clarkbmordred: oh huh I had no idea23:05
mordredclarkb: well - i've been in and out :)23:05
openstackgerritMerged openstack-infra/irc-meetings: A meeting for discussing and coordinating routed networks  https://review.openstack.org/27811423:05
clarkbmordred: the feedback you were getting from swift peoples was good and I had nothing to add really23:05
openstackgerritMatthew Treinish proposed openstack-infra/shade: Add a method to download an image from glance  https://review.openstack.org/27881623:05
mordredclarkb: kk23:05
mtreinishmordred, SpamapS: ^^^ should pass tests now23:05
mordredShrews, notmorgan: when you have a sec: https://review.openstack.org/#/c/278797/23:06
clarkbmordred: if you want to test the trivial reproduction would be get_swift_client(), time.time = time.time + token_expiry + 1, upload object23:06
clarkbmordred: though that may work if the only token checking is server side hrm23:06
clarkbmordred: you could put a really long sleep in your test <_<23:06
mordredclarkb: ew gross23:06
clarkbjeblair: right the most interesting information isn't what common edited code was moved23:07
clarkbjeblair: however that information is still valuable23:07
clarkbpotentially23:07
pleia2mordred: happy england to you23:07
mordredpleia2: thanks!23:07
mordredpleia2: I'm certainly englanding23:07
pleia2:)23:07
mordredpleia2: so far today I have tube-d and gin-d23:07
notmorganmordred: ++ to englandling23:07
*** Sukhdev has joined #openstack-infra23:07
*** shashank_hegde has joined #openstack-infra23:07
mordredpleia2: I showed your opensourceinfra.org thing to robyn bergeron a little earlier today, btw23:08
clarkbjeblair: at least for this example my idea would work if you ignored file line diffs23:08
pleia2mordred: cool, it has a pretty layout now23:08
*** sdake_ has quit IRC23:09
*** apoorvad has quit IRC23:09
jeblairclarkb: so if we view the output of the interdiff program as our very conservative superset of what we should display -- how do we map that output back to an accurate diff between the two patchsets (with correct line numbers, etc)?23:09
clarkbjeblair: http://paste.openstack.org/show/487202/ is what the raw output looks like and you would just treat that as no delta23:09
mordredpleia2: yes - I noticed the difference23:09
clarkbjeblair: for your interdiff example you would show the move, data is removed over here and added over there. For the idea I have about ignoring it you just wouldn't show those line number only differences23:10
*** wolverineav has joined #openstack-infra23:11
clarkbjeblair: note that I still like using diff here so that you can produce the interdiff without working aorund the decisions interdiff has made for you, unless you wish to stick with the decisions it has made23:11
*** apoorvad has joined #openstack-infra23:12
notmorganmordred: wow, looking at the diff and... ugh.23:12
notmorganmordred: at least it's not unreadable.23:12
notmorganmordred: but... bleh on not havving session support (I've taken a couple stabs and it's a bit of work)23:13
jeblairclarkb: okay, but of all the diffs we've talked about, only 'git diff ps1..ps2' has the actual information needed to display a diff to the user (lines changed with old and new line numbers).23:13
jeblairclarkb: if you work back to the patchset diffs, you could probably reconstruct that23:13
clarkbI don't follow that23:14
clarkbeach of the initial diff has the information to display a diff doesn't it?23:14
*** wolverineav has quit IRC23:14
clarkbfor each side you get the offsets23:14
mordrednotmorgan: yah - I mean, I think the team there groks/desires adding session support23:14
notmorganmordred: they do.23:14
mordrednotmorgan: so it's not anything they're opposed to23:14
notmorganmordred: but it's a lot of unwinding requests-specific code and layering it into ksa session code23:15
notmorganmordred: subtle differences that aren't hard to do,just time consuming to hit every case where a ksa session != requests session perfectly23:15
mordredyup23:17
notmorganmordred: if ksa session were an adapter mounted to a requests session... this would be tons easier to do/support. but that isn't really "doable23:17
notmorgan"23:17
notmorganeither.23:17
*** rcernin has quit IRC23:18
mordrednotmorgan: what if we wrote an adapter which took a ksa session and mounted it to a requests session?23:18
mordrednotmorgan: that was not the new interface for things23:19
mordrednotmorgan: but was like LegacyJSONAdapter23:19
notmorganmordred: the ksa stuff does some things you can't do with request session iirc23:19
jeblairclarkb: yes, i think we're on the same page there -- using diff against the two patches, you can construct a synthetic diff of the lines that have changed.  you will need to map back to get the correct old/new line numbers.23:19
notmorganadapters23:19
mordrednotmorgan: in that it's a stepping stone from the old to the new23:19
mordrednotmorgan: oh, bother23:19
notmorganwe'd still need some wrapping of methods directly i think.23:19
notmorganwe could simplify it and make it a subclass probably23:19
*** flwang has quit IRC23:19
notmorganrather than a object that has a .session on it23:19
jeblairclarkb: this approach will not show you any extra information, but it may also not show you a relevant change if someone, say, moves where they added a function.23:20
clarkbjeblair: correct23:20
jeblairclarkb: if we say we want to be conservative and show potentially extra information in case a move is relevant, we can use interdiff23:20
clarkbjeblair: yup23:20
jeblairclarkb: but i don't see how to make sense of the 4 hunks i keep calling nonsense :)23:21
clarkbjeblair: you just display them23:21
clarkbon the old side you will have removals and on the new side you will have additions23:21
*** [1]Thelo has joined #openstack-infra23:22
*** wolverineav has joined #openstack-infra23:22
clarkbthat show code was at old location and now resides at new location23:22
jeblairclarkb: i must be reading the output wrong, because it looks like it says change A->B at 1423 and change B->A at 185823:23
openstackgerritColleen Murphy proposed openstack-infra/puppet-infracloud: Use SSL for rabbitmq traffic  https://review.openstack.org/27637523:24
*** Thelo has quit IRC23:24
*** [1]Thelo is now known as Thelo23:24
clarkbjeblair: it is showing you the code on A was at line 1858 and was removed from there and on the B side is added at 142323:25
clarkbwhich is a move23:25
jeblairclarkb: except that it's also saying the code from B was added to A line 185823:26
jeblairand vice versa23:26
jeblairclarkb: so i think if we just naively displayed it, it would not actually look like a move23:26
clarkbjeblair: no it is saying the code was already there23:26
clarkb(because it was your first patchset included that code)23:26
jeblairclarkb: if this were a side-by-side diff, it would look like this:23:27
clarkbby removing the lines from 1858 the implication is this code already existed at this location and does not now23:27
*** bdemers has joined #openstack-infra23:27
*** _ody_ has joined #openstack-infra23:27
jeblair1423 A        B23:27
jeblair1858 B        A23:27
*** tojuvone_ has joined #openstack-infra23:27
jeblairand that doesn't look like a move to me23:27
clarkbright because it is a nested diff23:28
clarkbbut that is what it is saying23:28
jeblairright, so how do we make sense of that?23:28
*** eil397 has joined #openstack-infra23:28
*** max_lobur1 has joined #openstack-infra23:29
*** xyang1_ has joined #openstack-infra23:29
*** ashtokolov_ has joined #openstack-infra23:29
clarkbby showing all of the info?23:29
*** mwhahaha_ has joined #openstack-infra23:30
*** wewe0901_ has joined #openstack-infra23:30
clarkbyou cannot write a single version of this file. With an interdiff you would have to review on the interdiff23:30
*** gyee_ has joined #openstack-infra23:30
*** maximov_ has joined #openstack-infra23:30
*** mgkwill_ has joined #openstack-infra23:30
*** DuncanT_ has joined #openstack-infra23:30
*** mkj_wk has quit IRC23:31
clarkbhrm ok I see the issue with where do you post a review comment23:31
*** markvan_ has joined #openstack-infra23:31
clarkbdepending on which of the two gets comments23:31
*** tpeoples_ has joined #openstack-infra23:31
jeblairclarkb: well, that's easy -- either the old side or the new23:31
clarkbright but determining which is which from interdiff ins't easy23:32
*** gibi_ has joined #openstack-infra23:32
*** mkj_wk has joined #openstack-infra23:32
*** Vivek_ has joined #openstack-infra23:32
*** nelsnels_ has joined #openstack-infra23:33
*** flwang has joined #openstack-infra23:33
*** kgalanov_ has joined #openstack-infra23:33
*** dham1_ has joined #openstack-infra23:33
notmorganShrews, mordred: ok this is complex enough i can't eyeball it so will score it as soon as i get through it [the .get_swift_client patchset]23:33
*** sylwesterB_ has joined #openstack-infra23:33
*** Ryan_Lane_ has joined #openstack-infra23:33
clarkbI think you could get this info from the diff diff23:33
clarkbmaybe23:33
clarkbyes because you know which is which there23:34
*** jpmaxman_ has joined #openstack-infra23:34
clarkbdue to the < and ?23:34
clarkber < and >23:34
*** sridhar_ram1 has quit IRC23:34
*** ruhe2 has joined #openstack-infra23:35
*** sweston_ has joined #openstack-infra23:35
*** dimtruck is now known as zz_dimtruck23:35
*** iremizov_ has joined #openstack-infra23:35
*** Ng_ has joined #openstack-infra23:35
*** cburgess has joined #openstack-infra23:35
*** EmilienM_ has joined #openstack-infra23:35
*** itsuugo_ has joined #openstack-infra23:35
*** fbo_ has joined #openstack-infra23:35
*** sridhar_ram has joined #openstack-infra23:35
jeblairclarkb: wait, this doesn't show up in the diff diff...23:36
clarkbjeblair: it does23:36
*** clayton_ has joined #openstack-infra23:36
clarkbjeblair: http://paste.openstack.org/show/487202/ is how it shows up23:36
clarkbbut from that you can tell which is which23:36
*** gnuoy` has joined #openstack-infra23:36
*** cgross- has joined #openstack-infra23:36
*** jamespag` has joined #openstack-infra23:36
*** qb_ has quit IRC23:37
*** gyee has quit IRC23:37
*** max_lobur has quit IRC23:37
*** gibi has quit IRC23:37
*** jpr has quit IRC23:37
*** bhunter_ has quit IRC23:37
*** xyang1 has quit IRC23:37
*** wewe0901 has quit IRC23:37
*** ekarlso has quit IRC23:37
*** ruhe has quit IRC23:37
*** nelsnelson has quit IRC23:37
*** nibalizer has quit IRC23:37
*** itsuugo has quit IRC23:37
*** markvan has quit IRC23:37
*** camunoz has quit IRC23:37
*** bdemers_ has quit IRC23:37
*** clayton has quit IRC23:37
*** Vivek has quit IRC23:37
*** sylwesterB has quit IRC23:37
*** ashtokolov has quit IRC23:37
*** Ng has quit IRC23:37
*** tpeoples has quit IRC23:37
*** mwhahaha has quit IRC23:37
*** mkwiek has quit IRC23:37
*** niska has quit IRC23:37
*** EmilienM has quit IRC23:37
*** fbo has quit IRC23:37
*** acabot has quit IRC23:37
*** AJaeger has quit IRC23:37
*** zxiiro has quit IRC23:37
*** iremizov has quit IRC23:37
*** Ryan_Lane has quit IRC23:37
*** _ody has quit IRC23:37
*** tojuvone has quit IRC23:37
*** bswartz has quit IRC23:37
*** cgross has quit IRC23:37
*** clif_h has quit IRC23:37
*** jpmaxman has quit IRC23:37
*** anthonyper has quit IRC23:37
*** cburgess_ has quit IRC23:37
*** jamespage has quit IRC23:37
*** gnuoy has quit IRC23:37
*** Hunner has quit IRC23:37
*** DuncanT has quit IRC23:37
*** dham1 has quit IRC23:37
*** kgalanov has quit IRC23:37
*** sweston has quit IRC23:37
*** ameade has quit IRC23:37
*** monester has quit IRC23:37
*** maximov has quit IRC23:37
*** verdurin has quit IRC23:37
*** vdrok has quit IRC23:37
*** mgkwill has quit IRC23:37
*** johnthetubaguy has quit IRC23:37
*** ruhe2 is now known as ruhe23:37
*** xyang1_ is now known as xyang123:37
*** clayton_ is now known as clayton23:37
*** EmilienM_ is now known as EmilienM23:37
openstackgerritColleen Murphy proposed openstack-infra/system-config: Use SSL for rabbitmq  https://review.openstack.org/27760523:37
*** wewe0901_ is now known as wewe090123:37
*** jamespag` has quit IRC23:37
*** jamespag` has joined #openstack-infra23:37
*** itsuugo_ is now known as itsuugo23:37
*** sylwesterB_ is now known as sylwesterB23:37
*** jpmaxman_ is now known as jpmaxman23:37
clarkbwhich clearly shows lhs is 1858 and rhs is 142323:37
*** EmilienM is now known as Guest2883623:37
*** iremizov_ is now known as iremizov23:37
clarkbso you would show the 1858 diff on the lhs and the 1423 diff on the rhs23:37
*** roxanaghe has quit IRC23:38
*** ashtokolov_ is now known as ashtokolov23:38
clarkbthen dpeending on where comments go post to the appropriate patchset and line number23:38
*** clif_h has joined #openstack-infra23:38
*** kgalanov_ is now known as kgalanov23:38
*** Hunner has joined #openstack-infra23:38
*** Hunner has quit IRC23:38
*** Hunner has joined #openstack-infra23:38
*** Ryan_Lane_ is now known as Ryan_Lane23:38
*** maximov_ is now known as maximov23:38
*** mwhahaha_ is now known as mwhahaha23:38
*** niska has joined #openstack-infra23:38
*** dham1_ is now known as dham123:38
openstackgerritColleen Murphy proposed openstack-infra/puppet-infracloud: Use SSL for rabbitmq traffic  https://review.openstack.org/27637523:38
*** wolverineav has quit IRC23:39
*** wolverineav has joined #openstack-infra23:39
*** mkwiek has joined #openstack-infra23:39
*** sweston_ is now known as sweston23:39
*** mgkwill_ is now known as mgkwill23:39
*** Ng_ is now known as Ng23:39
*** verdurin has joined #openstack-infra23:40
*** tpeoples_ is now known as tpeoples23:40
*** Guest28836 has quit IRC23:41
*** Guest28836 has joined #openstack-infra23:41
*** roxanaghe has joined #openstack-infra23:41
clarkbhttps://review.openstack.org/#/c/226114/5 passed python27 but failed on the coverage job due to the mysql drop db23:41
clarkbso I rechecked it23:41
*** Guest28836 is now known as EmilienM23:42
clarkbtime to see if increasing the timeout makes this go away (would imply mysql is just slow)23:42
*** zxiiro has joined #openstack-infra23:42
clarkband also reduce concurrency23:42
*** ameade has joined #openstack-infra23:43
*** camunoz has joined #openstack-infra23:43
*** acabot has joined #openstack-infra23:43
*** DuncanT_ is now known as DuncanT23:43
*** dims_ has joined #openstack-infra23:44
openstackgerritClark Boylan proposed openstack-infra/nodepool: Increase timeout to give mysql more time  https://review.openstack.org/28098823:44
*** bhunter_ has joined #openstack-infra23:44
jeblairclarkb: okay, so diff tells us to display the hunks at 1858 and 1423 -- what do we display?  our two original patchsets both have the same thing.  basically, they both add the line "image.state = nodedb.DELETE"23:44
*** monester has joined #openstack-infra23:44
openstackgerritMerged openstack/diskimage-builder: Fix tar listing in functional tests  https://review.openstack.org/27603723:45
jeblairclarkb: do we just ignore what's in the patchsets and simply fetch the contents of the lines in those ranges?23:45
mugsieand/win 2123:45
clarkbjeblair: you display both adds at different line numbers on either side23:45
clarkbjeblair: or you don't display them at all23:45
*** xyang1 has quit IRC23:46
*** jpr has joined #openstack-infra23:46
clarkbjeblair: I am not sure you display the actual file contents anywhere in an interdiff23:46
clarkbjeblair: you only show the diff23:46
jeblairclarkb: but that's not what a move looks like in a diff -- it looks like a removal on the old side and an add on the new23:46
clarkbjeblair: right but this is an interdiff23:46
clarkbwhich is different23:47
jeblairclarkb: no, the thing we need to display to the user is the difference between the two patchsets23:47
jeblairclarkb: so if something moved, it should be a removal on the old/left/red side and an addition on the new/right/green side23:47
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test if reducing concurrency makes mysql drops work  https://review.openstack.org/28098923:47
*** ekarlso has joined #openstack-infra23:47
*** AJaeger has joined #openstack-infra23:47
*** nibalizer has joined #openstack-infra23:47
*** johnthetubaguy has joined #openstack-infra23:47
*** anthonyper has joined #openstack-infra23:47
*** AJaeger has quit IRC23:47
*** AJaeger has joined #openstack-infra23:47
jeblairclarkb: i would not know what to make of a green line on the left side.  :)23:47
*** ekarlso has quit IRC23:48
clarkbjeblair: I think you show the diffs not a red green delta23:48
*** ekarlso has joined #openstack-infra23:48
clarkband you show the diffs where they differ23:48
*** AJaeger is now known as Guest2273623:48
jeblairclarkb: i thought this exercise was to try to make the non-rebase differences between patchsets visible to users in gerrit/gertty so that they could view and comment on them.23:49
clarkbit is23:49
clarkbbut you do that via showing them where the diffs are different23:49
clarkbyou aren't required to use the same exact ui that exists today23:49
clarkbsay I comment on a + line on the lhs, that comment would be made on the rhs of the normal git view at that number23:50
*** vdrok has joined #openstack-infra23:50
clarkbif you comment on a - line on the lhs, that comment would be made on the lhs of the normal git view at that line number23:50
clarkband similarly for the rhs of the interdiff23:50
jeblairclarkb: there is no reason this requires a ui difference.  the existing ui is perfectly adequate for showing a diff between two things and allowing comments.23:51
clarkbI think some of the problems in solving this are related to trying to treat a diff as the same as a diff between diffs23:51
jeblairthe only thing driving in that direction is the fact that git does not make factoring out a rebase easy.23:52
*** sdake has joined #openstack-infra23:53
clarkbhrm nodepool unittests don't print out slowtests, I suppose I can get that from subunit log23:55
clarkb(to confirm if increasing the timeout helped it pass or not)23:55
*** harlowja_at_home has joined #openstack-infra23:55
clarkboh thats coverage23:55
*** yuanying has quit IRC23:56
*** yuanying has joined #openstack-infra23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!