greghaynes | Yea, we need some indirectoin | 00:00 |
---|---|---|
jeblair | greghaynes: i'm guessing when this passes it's probably another thread happening to notice the disconnect first | 00:00 |
*** eil397 has quit IRC | 00:00 | |
clarkb | what if we don't subit the job and just change the db state | 00:00 |
clarkb | then rely on the periodic cleanup to fix it? | 00:00 |
*** Sukhdev has joined #openstack-infra | 00:01 | |
jeblair | seems safe and simple? | 00:01 |
greghaynes | jeblair: clarkb Something else I have been thinking is if the builders could notice the disconnect case and handle it by deleting the image | 00:01 |
greghaynes | which would work great combined with just deleting the db statae | 00:01 |
jeblair | greghaynes: they could probably do so by sending periodic work_status packets | 00:02 |
clarkb | does the server not send an ERROR when the client goes away? | 00:02 |
jeblair | greghaynes: if a sendWorkStatus fails, they'll notice | 00:02 |
clarkb | that is sort of how I would expect the server to pass that info a long | 00:02 |
greghaynes | jeblair: awesome | 00:03 |
*** Jeffrey4l has quit IRC | 00:03 | |
jeblair | clarkb: iirc, the protocol document does not specify notification to the worker on a client disconnect | 00:03 |
*** yamamoto_ has quit IRC | 00:03 | |
jeblair | clarkb: it might be worth checking gearmand to see what it does | 00:03 |
*** rm_work has quit IRC | 00:04 | |
*** Sukhdev has quit IRC | 00:04 | |
jeblair | it's weirdly asymmetrical like that | 00:04 |
*** Sukhdev has joined #openstack-infra | 00:04 | |
jeblair | (the protocol, that is) | 00:04 |
*** c-jm has quit IRC | 00:05 | |
*** Sukhdev has quit IRC | 00:08 | |
*** dimtruck is now known as zz_dimtruck | 00:09 | |
*** kzaitsev_mb has joined #openstack-infra | 00:09 | |
*** rm_work has joined #openstack-infra | 00:09 | |
*** rbrndt has quit IRC | 00:17 | |
*** armax has quit IRC | 00:17 | |
*** e0ne has quit IRC | 00:18 | |
*** shashank_hegde has joined #openstack-infra | 00:19 | |
*** Sukhdev has joined #openstack-infra | 00:19 | |
openstackgerrit | Merged openstack-infra/release-tools: use the name we derive from the project instead of the path https://review.openstack.org/278143 | 00:23 |
*** olaph has quit IRC | 00:26 | |
*** esker has quit IRC | 00:28 | |
*** flwang has quit IRC | 00:29 | |
*** annegentle_ has joined #openstack-infra | 00:29 | |
*** vilobhmm11 has joined #openstack-infra | 00:30 | |
vilobhmm11 | clarkb : jenkins not reporting anything for review seems like its stuck http://status.openstack.org/zuul/ | 00:30 |
vilobhmm11 | fungii, jeblair : ^^ | 00:31 |
clarkb | vilobhmm11: which change ? | 00:31 |
vilobhmm11 | https://review.openstack.org/245362 | 00:31 |
vilobhmm11 | clarkb : ^^ | 00:31 |
clarkb | if you click on the change yo ucan see that one job is still running | 00:31 |
vilobhmm11 | clarkb : any idea whats going wrong here or logs i can check to know what might be wrong here | 00:32 |
clarkb | that job has been running for 6 hours | 00:32 |
clarkb | https://jenkins04.openstack.org/job/gate-tempest-dsvm-neutron-src-tooz/98/console | 00:32 |
clarkb | looks like the job timeout failed to end the job | 00:32 |
clarkb | I can manually kill it | 00:32 |
vilobhmm11 | is that a bug ? | 00:32 |
vilobhmm11 | clarkb : sure thanks! | 00:32 |
clarkb | yes probably some jenkins issue with when/how the timeout occurs | 00:32 |
*** kgiusti has left #openstack-infra | 00:33 | |
*** kzaitsev_mb has quit IRC | 00:39 | |
*** annegentle_ has quit IRC | 00:41 | |
*** Apsu has quit IRC | 00:42 | |
*** Apsu has joined #openstack-infra | 00:42 | |
*** akshai has quit IRC | 00:43 | |
*** flwang has joined #openstack-infra | 00:43 | |
*** zz_dimtruck is now known as dimtruck | 00:44 | |
daemontool | anyone around to review https://review.openstack.org/#/c/278070/ ? it was already +[2A]ed | 00:44 |
*** eil397 has joined #openstack-infra | 00:45 | |
openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/release-tools: Use yes/no for pypi flag https://review.openstack.org/278167 | 00:46 |
*** achanda has joined #openstack-infra | 00:46 | |
zaro | clarkb: hey, wondering we use gerritlib when there's pygerrit? pygerrit seems better (or futher along at least). | 00:49 |
zaro | *why we use | 00:49 |
clarkb | zaro: because nothing else existed when we wrote gerritlib? | 00:50 |
zaro | clarkb: well now there is and it's better, what do you think we should do in this case? | 00:50 |
clarkb | nothing? | 00:50 |
daemontool | lol | 00:50 |
clarkb | I don't really think there is much value in porting everything | 00:50 |
clarkb | if we need some hard to implement feature smaybe | 00:51 |
zaro | clarkb: would it make sense to deprecate gerritlib and tell everyone to use pygerrit? | 00:51 |
clarkb | I don't think so | 00:51 |
*** thorst has joined #openstack-infra | 00:52 | |
clarkb | zaro: it would've been nice if sony had collaborated on making gerritlib better | 00:52 |
clarkb | but looks like it was an internal project for them for a long time before it got pypi'd | 00:52 |
clarkb | zaro: the problem with doing things like that is it just generates work when gerritlib is working fine | 00:53 |
anteaya | so just to give folks an opportunity to give me feedback on my actions prior to me taking them, I'm of a mind to post to the third-party-announce list asking intel-openstack-ci why there are posting sucess on a patch: https://review.openstack.org/#/c/278151/1 when the logs report the test actually failed: | 00:53 |
clarkb | and gerritlib existed first | 00:53 |
anteaya | http://intel-openstack-ci-logs.ovh/networking-odl-vhostuser-ci/refs/changes/51/278151/1/2016-02-09_23:56:52/console.html | 00:53 |
clarkb | so it is likely to have users | 00:53 |
anteaya | I'll make a cup of tea and take feedback | 00:53 |
anteaya | any opposition to my intended action? | 00:53 |
*** kzaitsev_mb has joined #openstack-infra | 00:54 | |
daemontool | I object on the cup of the, lol | 00:54 |
zaro | clarkb: imo it seems like more work to maintain 2 projects that do the same thing. | 00:54 |
*** thorst has quit IRC | 00:54 | |
clarkb | we only maintain one... | 00:54 |
clarkb | and it works | 00:55 |
clarkb | and it existed first | 00:55 |
*** thorst has joined #openstack-infra | 00:55 | |
clarkb | spending time to retrofit can only add bugs and waste time | 00:55 |
fungi | zaro: i suppose gerritlib could be turned into a compatibility shim/wrapper around pygerrit if someone wanted to write that? | 00:55 |
clarkb | if there is an additional benefit to switching then it may be worthwhile | 00:55 |
clarkb | I just don't want to switch because sony pushed their code after ours | 00:56 |
zaro | clarkb: so lets step back. i'm not advocating to retrofit. | 00:56 |
daemontool | clarkb, fungi at your convenience, can you please take a look at https://review.openstack.org/#/c/278070/ it was already approved, just an error in the regex | 00:56 |
*** SumitNaiksatam has quit IRC | 00:56 | |
* anteaya notes daemontool's opjection | 00:57 | |
clarkb | zaro: is there a feature we need that is missing from gerritlib that exists in pygerrit? | 00:57 |
clarkb | zaro: is there are bug that could be corrected? | 00:57 |
clarkb | I think we shouldn't switch unless we can make improvements lik etat | 00:57 |
*** tzn has quit IRC | 00:58 | |
*** jokke_ has quit IRC | 00:58 | |
*** jokke_ has joined #openstack-infra | 00:58 | |
zaro | clarkb: people may want to use python thru gerrit REST api. pygerrit already has that. | 00:59 |
clarkb | that doesn't require switching existing code to it | 00:59 |
*** achanda has quit IRC | 00:59 | |
zaro | clarkb: yeah agree. again i'm not advocating switching code. i don't want to do that either. | 01:00 |
*** thorst has quit IRC | 01:00 | |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Fail functests if refusing to run tests https://review.openstack.org/177002 | 01:00 |
zaro | i'm just wondering if there's a way to get people to join forces on 1 project instead of 2 | 01:00 |
clarkb | zaro: my suggestion 2 years ago would've been to focus on gerritlib :) but I guess that ship hsa long sailed | 01:00 |
*** markvoelker has joined #openstack-infra | 01:01 | |
zaro | clarkb: yeah, the only reason i think we should point ppl to pygerrit is that it's just better at this point. | 01:02 |
clarkb | probably the bes tthing would be to just advertise what features pygerrit does have and as people need those things they can naturally shift their efforts there | 01:02 |
*** armax has joined #openstack-infra | 01:02 | |
zaro | clarkb: exactly what i was thinking | 01:02 |
zaro | clarkb: has this been done before on openstack project? i'm sure it has | 01:03 |
clarkb | fwiw their ssh interface does not look better | 01:03 |
clarkb | it doesn't seem to do any output processing and you provide raw command and get raw results | 01:03 |
zaro | clarkb: it's more bare bones, but very simple | 01:03 |
clarkb | (at least the docs don't say if it handles paging and the weird metadata line of jason) | 01:04 |
fungi | so is popen('ssh mygerrit' % command) | 01:04 |
fungi | er, mailercode ;) | 01:04 |
*** sflanigan has quit IRC | 01:05 | |
anteaya | tea is made composing my email | 01:05 |
openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Use constraints based job to the gate of ofagent https://review.openstack.org/261982 | 01:05 |
*** gokrokve has joined #openstack-infra | 01:05 | |
clarkb | fungi: well it has native types for the json, you just have to compiose it all yourself and possibly cleanout the metadata and deal with paging | 01:05 |
clarkb | also for the events | 01:05 |
clarkb | so there are handy bits | 01:05 |
*** gildub has joined #openstack-infra | 01:06 | |
*** eil397 has quit IRC | 01:06 | |
clarkb | I am just grumping that our thing which existed first was ignored and now I am expected to switch | 01:06 |
*** annegentle_ has joined #openstack-infra | 01:06 | |
*** angdraug has quit IRC | 01:07 | |
*** sflanigan has joined #openstack-infra | 01:07 | |
*** sflanigan has joined #openstack-infra | 01:07 | |
zaro | clarkb: really, it's still being ignored. | 01:07 |
zaro | clarkb: except for my recent reviews :) | 01:08 |
clarkb | zaro: my point is that at any time sony et al could've worked upstream on the existing tool | 01:08 |
clarkb | they didn't now we have two things | 01:08 |
clarkb | thats fine, but we shouldn't be expecte dto replace gerritlib simply because pygerrit exists | 01:08 |
*** ybathia has quit IRC | 01:09 | |
clarkb | which is why my suggestion is to point out what pygerrit can do, and let tooling naturally transition if/when it needs those features | 01:09 |
zaro | clarkb: ok. i think add blurb to README about that then? | 01:10 |
*** weshay_xchat has quit IRC | 01:10 | |
anteaya | mtreinish: http://lists.openstack.org/pipermail/third-party-announce/2016-February/000282.html | 01:11 |
clarkb | or post to the mailing list | 01:11 |
anteaya | mtreinish: and thank you | 01:11 |
clarkb | zaro: I know gertty uses the rest api a bunch but I think it just uses requests | 01:12 |
mtreinish | anteaya: thanks for raising it in the proper place | 01:12 |
anteaya | I do try | 01:12 |
*** amitgandhinz has joined #openstack-infra | 01:13 | |
*** EricGonc_ has joined #openstack-infra | 01:13 | |
*** amitgandhinz has quit IRC | 01:13 | |
fungi | there's really not much you need on top of requests to handle the gerrit rest api anyway. paginating the changes method results is about the only complication i | 01:13 |
fungi | 've run into so far | 01:13 |
clarkb | zaro: and zuul was supposed to switch to gerritlib (gerritlib actually came out of zuul) but that never happend so there is historical "we failed to do this" | 01:13 |
mtreinish | anteaya: is that ci different from: https://wiki.openstack.org/wiki/ThirdPartySystems/Intel-Networking-CI | 01:13 |
mtreinish | it's got intel and networking in the name :) | 01:14 |
anteaya | mtreinish: yeah I think it is, the one that commented has odl in the title, that is a new account for me | 01:14 |
anteaya | also I know wznoinsk | 01:14 |
anteaya | I don't think something like this would get past him | 01:15 |
anteaya | he has been involved with his ci system for over a year | 01:15 |
anteaya | my sense is this is a separate account | 01:15 |
anteaya | but I could be wrong | 01:15 |
*** Swami has quit IRC | 01:16 | |
*** weshay_xchat has joined #openstack-infra | 01:16 | |
mtreinish | ok, I wasn't sure | 01:16 |
zaro | clarkb: hmm, well don't let that happen to python-jenkins :) | 01:16 |
anteaya | mtreinish: no it is a good queston | 01:17 |
*** gokrokve has quit IRC | 01:17 | |
*** EricGonczer_ has quit IRC | 01:17 | |
*** annegentle_ has quit IRC | 01:17 | |
anteaya | I only know because wznoinsk has shown up to many meetings and has been active in channel | 01:17 |
anteaya | he actually took out our gerrit about 6 months ago with an ssh connection keep alive script he wrote | 01:17 |
anteaya | so he has been fairly vigilent ever since | 01:17 |
anteaya | hence my belief he would have spotted this himself if this was his system | 01:18 |
anteaya | he didn't mean to take out our gerrit, and he helped us debug the issue | 01:19 |
anteaya | so he was helpful | 01:19 |
*** ccrouch has quit IRC | 01:20 | |
openstackgerrit | Merged openstack-infra/project-config: Set conditions for gate-{name}-docs on freezer* https://review.openstack.org/278070 | 01:21 |
clarkb | I don't know that I am core on python-jenkins | 01:21 |
zaro | clarkb: no, it's a nodepool change: https://review.openstack.org/#/c/259157/ | 01:22 |
zaro | fungi: do you think we can get some gerrit fixes in for this friday's maintenance? | 01:22 |
zaro | like this https://review.openstack.org/#/c/261110/ | 01:23 |
zaro | and this https://review.openstack.org/#/c/262611/ | 01:23 |
zaro | jhesketh: ^ answered your question on this one | 01:24 |
clarkb | zaro: has 259157 been tested? | 01:25 |
*** esker has joined #openstack-infra | 01:26 | |
dougwig | AJaeger: is it the inner or outer timeout that's no longer needed now? | 01:26 |
clarkb | it passes the tests we have but none of them talk to a real jenkins :/ | 01:27 |
*** dimtruck is now known as zz_dimtruck | 01:29 | |
*** mtanino has quit IRC | 01:29 | |
*** kzaitsev_mb has quit IRC | 01:30 | |
zaro | Clarkb: you mean by using nodepool? | 01:31 |
clarkb | ya point it at a jenkins | 01:32 |
*** thorst has joined #openstack-infra | 01:33 | |
*** thorst has quit IRC | 01:33 | |
zaro | Clarkb: then no I have not. I've only tested from using python Jenkins. I've never used nodepool so I'll have to figure that out first | 01:34 |
*** thorst has joined #openstack-infra | 01:34 | |
jhesketh | zaro: cool, replied :-) | 01:36 |
*** thorst has quit IRC | 01:39 | |
*** esker has quit IRC | 01:40 | |
*** esker has joined #openstack-infra | 01:41 | |
openstackgerrit | Merged openstack/requirements: Make osprofiler requirements >1.0.0 https://review.openstack.org/277583 | 01:45 |
*** esker has quit IRC | 01:45 | |
*** darrenc is now known as darrenc_afk | 01:47 | |
anteaya | dougwig: DEVSTACK_GATE_TIMEOUT is removed: http://git.openstack.org/cgit/openstack-infra/project-config/commit/?id=065a80d9c27b30dea253ed3554e09b1c8cb37e18 | 01:49 |
*** bswartz has quit IRC | 01:49 | |
anteaya | dougwig: I consider that the inner timeout | 01:49 |
*** tiswanso has joined #openstack-infra | 01:50 | |
*** tiswanso has quit IRC | 01:50 | |
*** piet has joined #openstack-infra | 01:50 | |
*** bswartz has joined #openstack-infra | 01:51 | |
*** tiswanso has joined #openstack-infra | 01:51 | |
*** gyee has quit IRC | 01:53 | |
*** shashank_hegde has quit IRC | 01:54 | |
*** vilobhmm11 has quit IRC | 01:56 | |
*** Sukhdev has quit IRC | 01:56 | |
*** vilobhmm11 has joined #openstack-infra | 01:56 | |
openstackgerrit | Merged openstack/requirements: Add neutron-lib to projects.txt https://review.openstack.org/273913 | 01:57 |
openstackgerrit | Merged openstack/requirements: Add pylxd library https://review.openstack.org/277789 | 01:57 |
openstackgerrit | Merged openstack/requirements: Add netmiko to requirements https://review.openstack.org/276200 | 01:57 |
openstackgerrit | Merged openstack/requirements: Add overtest to global-req https://review.openstack.org/274348 | 01:57 |
*** weshay_xchat has quit IRC | 01:58 | |
*** darrenc_afk is now known as darrenc | 01:59 | |
*** achanda has joined #openstack-infra | 02:00 | |
*** vilobhmm11 has quit IRC | 02:00 | |
*** Sukhdev has joined #openstack-infra | 02:00 | |
*** Sukhdev has quit IRC | 02:01 | |
*** vilobhmm11 has joined #openstack-infra | 02:01 | |
*** nelsnels_ has quit IRC | 02:02 | |
*** rossella_s has quit IRC | 02:03 | |
*** sridhar_ram1 has quit IRC | 02:03 | |
*** rossella_s has joined #openstack-infra | 02:03 | |
*** zz_dimtruck is now known as dimtruck | 02:04 | |
*** piet has quit IRC | 02:05 | |
openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Remove openstack-neutron-release from acceptable channels list https://review.openstack.org/278180 | 02:05 |
*** SumitNaiksatam has joined #openstack-infra | 02:09 | |
pleia2 | oh! this might be of interest here, since everyone always asks me if I know about other open source infras, I made a list, which now has a handy URL http://opensourceinfra.org/ :) | 02:10 |
pleia2 | (yes, I understand the irony of the source for the site being hosted on github) | 02:10 |
*** bpokorny has quit IRC | 02:10 | |
dougwig | anteaya: as do i. thank you. | 02:12 |
mordred | pleia2: nice! | 02:12 |
*** yamamoto has joined #openstack-infra | 02:12 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: tempest/experimental: run puppet scenarios on centos7 https://review.openstack.org/278080 | 02:14 |
openstackgerrit | Merged openstack-infra/release-tools: rename script for making stable branches https://review.openstack.org/277499 | 02:17 |
*** annegentle_ has joined #openstack-infra | 02:17 | |
*** armax has quit IRC | 02:18 | |
*** hdd has quit IRC | 02:19 | |
*** yamahata has quit IRC | 02:19 | |
*** nelsnelson has joined #openstack-infra | 02:21 | |
*** vilobhmm11 has quit IRC | 02:22 | |
*** annegentle_ has quit IRC | 02:25 | |
*** kzaitsev_mb has joined #openstack-infra | 02:27 | |
*** alex_xu has quit IRC | 02:28 | |
*** alex_xu has joined #openstack-infra | 02:30 | |
*** yamamoto has quit IRC | 02:31 | |
openstackgerrit | Merged openstack-dev/cookiecutter: Add gitignore files https://review.openstack.org/277679 | 02:32 |
tonyb | Are theer any guidelines on erpo names? I'm createing a devstack plugin currently called devstack-plugin-bleeding-edge | 02:33 |
tonyb | Would that be accepted or shoudl I look at renaming it? | 02:33 |
ianw | tonyb: bleeding-edge of what? | 02:42 |
ianw | i'm presuming libvirt | 02:42 |
tonyb | ianw: Well it only supports libvirt+wemu right now but it can be used for any packaged tool | 02:42 |
tonyb | ianw: Also on Ubuntu but once F23 is in the gate I'll use that and add virt-preview | 02:43 |
tonyb | s/wemu/qemu/ | 02:43 |
ianw | tonyb: i dunno, i'd call it something more descriptive; "bleeding-edge" pretty much describes everything to do with openstack ci | 02:44 |
ianw | mostly the bleeding bit | 02:44 |
*** dims_ has quit IRC | 02:45 | |
tonyb | ianw: Thanks. I'll try to think of a better name. | 02:47 |
*** alex_xu has quit IRC | 02:49 | |
tonyb | ianw: on an unrelated note the devstack-plugin-cookiecutter repo has somewhat bit rotted | 02:50 |
*** alex_xu has joined #openstack-infra | 02:52 | |
ianw | hmm, yeah not sure if anyone keeps on top of that | 02:53 |
*** mingyu has quit IRC | 02:54 | |
*** mingyu has joined #openstack-infra | 02:54 | |
*** darrenc is now known as darrenc_afk | 02:58 | |
*** kzaitsev_mb has quit IRC | 02:58 | |
*** bryan_att has quit IRC | 03:00 | |
*** links has joined #openstack-infra | 03:00 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Fix startup race with growroot/systemd https://review.openstack.org/278187 | 03:04 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Refactor growroot for debuggabilty https://review.openstack.org/278188 | 03:04 |
*** hdd has joined #openstack-infra | 03:05 | |
ianw | greghaynes / SpamapS : ^ on f23 disk-size issue ... 1st one is the fix i believe | 03:05 |
*** EricGonc_ has quit IRC | 03:07 | |
*** logan-- has joined #openstack-infra | 03:10 | |
*** darrenc_afk is now known as darrenc | 03:11 | |
prometheanfire | ianw: any response to https://review.openstack.org/#/c/276581/ ? | 03:12 |
*** vilobhmm11 has joined #openstack-infra | 03:14 | |
*** logan-- has quit IRC | 03:14 | |
*** vilobhmm111 has joined #openstack-infra | 03:17 | |
*** nadya has joined #openstack-infra | 03:18 | |
*** vilobhmm11 has quit IRC | 03:18 | |
*** nadya is now known as Guest2959 | 03:18 | |
*** ccrouch has joined #openstack-infra | 03:19 | |
*** Guest2959 has quit IRC | 03:22 | |
*** logan- has joined #openstack-infra | 03:23 | |
tonyb | ianw: I'll do a thing once I actually have my plugin accepted. | 03:23 |
*** ccrouch1 has joined #openstack-infra | 03:23 | |
*** ccrouch has quit IRC | 03:26 | |
*** dims has joined #openstack-infra | 03:27 | |
*** yamamoto has joined #openstack-infra | 03:29 | |
*** sc68cal has quit IRC | 03:30 | |
*** ccrouch1 has quit IRC | 03:30 | |
*** ccrouch has joined #openstack-infra | 03:31 | |
*** annegentle_ has joined #openstack-infra | 03:31 | |
*** woodster_ has joined #openstack-infra | 03:32 | |
*** tphummel has quit IRC | 03:32 | |
*** sridhar_ram has joined #openstack-infra | 03:33 | |
*** sridhar_ram has quit IRC | 03:34 | |
*** xyang1 has joined #openstack-infra | 03:34 | |
*** annegentle_ has quit IRC | 03:36 | |
*** dims has quit IRC | 03:37 | |
*** gokrokve has joined #openstack-infra | 03:37 | |
prometheanfire | ianw: so where would you say I doc it? | 03:39 |
*** apoorvad has quit IRC | 03:40 | |
ianw | prometheanfire: package-installs readme probably wouldn't be a bad start | 03:42 |
prometheanfire | ok, I'll update that and move the other postinstall.d to 95 | 03:43 |
*** gokrokve_ has joined #openstack-infra | 03:43 | |
*** gokrokve has quit IRC | 03:45 | |
*** vilobhmm111 has quit IRC | 03:45 | |
*** rguillebert has quit IRC | 03:47 | |
*** gokrokve has joined #openstack-infra | 03:48 | |
*** gokrokve_ has quit IRC | 03:48 | |
*** edmondsw has quit IRC | 03:49 | |
*** xyang1 has quit IRC | 03:50 | |
*** gokrokve has quit IRC | 03:53 | |
*** gokrokve has joined #openstack-infra | 03:53 | |
*** kzaitsev_mb has joined #openstack-infra | 03:55 | |
*** kzaitsev_mb has quit IRC | 04:00 | |
prometheanfire | ianw: updated | 04:01 |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Remove eclean-dist as it's not available by default https://review.openstack.org/276581 | 04:01 |
*** fawadkhaliq has joined #openstack-infra | 04:02 | |
*** jogo has quit IRC | 04:10 | |
*** jogo has joined #openstack-infra | 04:11 | |
*** jogo has joined #openstack-infra | 04:11 | |
*** markvoelker has quit IRC | 04:15 | |
*** markvoelker has joined #openstack-infra | 04:16 | |
*** vilobhmm11 has joined #openstack-infra | 04:17 | |
*** amotoki has joined #openstack-infra | 04:17 | |
*** amotoki has quit IRC | 04:17 | |
*** Daisy has joined #openstack-infra | 04:18 | |
*** tiswanso has quit IRC | 04:20 | |
*** Daisy has quit IRC | 04:23 | |
*** Daisy has joined #openstack-infra | 04:23 | |
*** shashank_hegde has joined #openstack-infra | 04:27 | |
*** dimtruck is now known as zz_dimtruck | 04:27 | |
*** Daisy has quit IRC | 04:28 | |
*** nelsnelson has quit IRC | 04:32 | |
*** dahoo has quit IRC | 04:33 | |
*** salv-orlando has joined #openstack-infra | 04:41 | |
*** chaitu has joined #openstack-infra | 04:41 | |
chaitu | Hi, even after image build is complete dib-image-list says that image is in building state,can someone please help me out with it. | 04:43 |
*** salv-orl_ has quit IRC | 04:43 | |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Install docker for tests https://review.openstack.org/278021 | 04:45 |
*** shashank_hegde has quit IRC | 04:47 | |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Fail functests if refusing to run tests https://review.openstack.org/177002 | 04:47 |
*** maishsk has quit IRC | 04:49 | |
*** Thelo has quit IRC | 04:55 | |
*** kzaitsev_mb has joined #openstack-infra | 04:57 | |
*** Thelo has joined #openstack-infra | 04:58 | |
*** moravec has quit IRC | 05:01 | |
*** kzaitsev_mb has quit IRC | 05:02 | |
*** gokrokve_ has joined #openstack-infra | 05:05 | |
*** gokrokve has quit IRC | 05:06 | |
*** rlandy has quit IRC | 05:07 | |
*** piet has joined #openstack-infra | 05:13 | |
*** maishsk has joined #openstack-infra | 05:16 | |
*** maishsk has quit IRC | 05:23 | |
prometheanfire | ianw: you really like slowing me down :( | 05:26 |
*** fawadkhaliq has quit IRC | 05:27 | |
*** vilobhmm11 has quit IRC | 05:30 | |
*** armax has joined #openstack-infra | 05:31 | |
openstackgerrit | Sachi King proposed openstack-dev/pbr: Don't attempt to test with 0.6c11 with Py3 https://review.openstack.org/273358 | 05:33 |
openstackgerrit | Sachi King proposed openstack-dev/pbr: Ensure we succeed at env_markers or bail gracefully https://review.openstack.org/278210 | 05:33 |
*** woodster_ has quit IRC | 05:36 | |
*** shashank_hegde has joined #openstack-infra | 05:37 | |
*** sflanigan has quit IRC | 05:40 | |
chaitu | Hi, even after image build is complete dib-image-list says that image is in building state,can someone please help me out with it. After starting nodepool service image got deleted | 05:41 |
*** gokrokve_ has quit IRC | 05:42 | |
*** mingyu has quit IRC | 05:42 | |
*** mingyu has joined #openstack-infra | 05:43 | |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Reorder the package-uninstall action https://review.openstack.org/278211 | 05:43 |
clarkb | chaitu: did the dib image build fail? | 05:43 |
clarkb | there have been several bugs in error handling that were recently fixed that could result in out of sync state between nodepool amd its image builder | 05:44 |
chaitu | no it didnt fail | 05:44 |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Remove eclean-dist as it's not available by default https://review.openstack.org/276581 | 05:44 |
prometheanfire | ianw: ok, separated it out, either can merge first, ordering doesn't matter | 05:45 |
chaitu | clarkb: It was in building state | 05:45 |
*** shashank_hegde has quit IRC | 05:45 | |
clarkb | chaitu: yes but did the actual dib process fail? you can check the logs | 05:45 |
*** gokrokve has joined #openstack-infra | 05:45 | |
*** sam_wan has joined #openstack-infra | 05:45 | |
chaitu | clarkb: i dont see any error in image.log or nodepool-builder.log | 05:46 |
clarkb | chaitu: and you do see the build completed according to the log? | 05:48 |
*** gokrokve has quit IRC | 05:48 | |
*** gokrokve_ has joined #openstack-infra | 05:48 | |
clarkb | if that is the case it is possibly a gearman client disconnect (which has also been patched in a couple ways) | 05:48 |
chaitu | yes, http://paste.openstack.org/show/486510/ | 05:49 |
chaitu | please look into builder-log | 05:49 |
zxiiro | I'm having some issues with nodepool failing with NoneType on private ip. My Rackspace network doesn't have a private IP as far as I can tell, does it really require one to work? http://pastebin.com/PFsGW4Ms | 05:49 |
*** sam_wan has quit IRC | 05:49 | |
clarkb | chaitu: can you check ps and see if that process is still running? | 05:50 |
clarkb | zxiiro: it is not required and at least one of our clouds dossnt have private IPs | 05:51 |
*** sam_wan has joined #openstack-infra | 05:51 | |
clarkb | zxiiro: in that case it should treat the public as privatr | 05:51 |
clarkb | but IP stuff is the most complicated unstandard impossible to infer thing about virtual machines right now | 05:51 |
chaitu | clarkb: Now it is building an new image.http://paste.openstack.org/show/486511/ | 05:52 |
zxiiro | clarkb: any ideas why it would blow up with the trace from my pastebin then? I'm trying the latest nodepool from pypi and in the paste I had to add this workaround for our network. https://github.com/zxiiro/nodepool/commit/7bc6b47df5464cf7b97e4b75a8eb6591ced71ce4 | 05:52 |
clarkb | zxiiro: it should log what it thinks the IPs are | 05:52 |
clarkb | oh from pypi | 05:52 |
clarkb | you might try newer (becausr again networking hard) | 05:53 |
zxiiro | ok let me try .... | 05:53 |
*** nadya has joined #openstack-infra | 05:53 | |
*** Sukhdev has joined #openstack-infra | 05:54 | |
*** nadya is now known as Guest91121 | 05:54 | |
clarkb | chaitu: image 5 is the one in progress according to both logs | 05:54 |
*** piet has quit IRC | 05:55 | |
clarkb | chaitu: something explicitly deleted image 4 | 05:55 |
ianw | promethanfire: did you read what i wrote about the documentation i'm looking for? it's not to explain the ordering, which we can take as understood. it's to explain why we have made the choice to have it at *95* and not 96, or 86, or 99 | 05:56 |
openstackgerrit | Omer Anson proposed openstack/requirements: Add scapy and python-pytun https://review.openstack.org/277893 | 05:57 |
clarkb | zxiiro: the underlying problem is there is no way for openstack to signal to the user which IP address shpuld be routable and whoch IP addresses are tenant private | 05:57 |
chaitu | clarkb: How could i cross check thae status of gearman plugin now??? | 05:57 |
clarkb | zxiiro: anf there is also no indicatiom of when a floating IP is needed. so nodepool tries its best | 05:57 |
clarkb | chaitu: ps says the image build is runnig | 05:58 |
*** daemontool_ has joined #openstack-infra | 05:58 | |
*** kzaitsev_mb has joined #openstack-infra | 05:58 | |
clarkb | you can tail your image logs, you can check that process, you can also connect to the gearman server via telnet and run the status command against it | 05:58 |
*** nelsnelson has joined #openstack-infra | 05:59 | |
chaitu | clarkb: Yeah but after build completes the image get deleted. | 05:59 |
clarkb | chaitu: many hours later according to the log | 05:59 |
*** daemontool has quit IRC | 06:02 | |
*** kzaitsev_mb has quit IRC | 06:03 | |
*** rossella_s has quit IRC | 06:03 | |
chaitu | yeah, This is fresh installation i didnt start my nodepool service for the first build and waited many hours to completed, After a while i started my nodepool service and the image got deleted. | 06:03 |
*** rossella_s has joined #openstack-infra | 06:03 | |
*** fawadkhaliq has joined #openstack-infra | 06:04 | |
chaitu | clarkb: Now it again started to build new image | 06:04 |
*** gokrokve_ has quit IRC | 06:06 | |
clarkb | chaitu anything in the nodepool debug log? | 06:06 |
clarkb | it shpuld tell you ehy it is deleting the image | 06:06 |
*** esker has joined #openstack-infra | 06:08 | |
zxiiro | clarkb: just tried with the latest code from master, still same failure: http://pastebin.com/BBwRNgpS | 06:13 |
chaitu | clarkb: it deleted in the process of periodic cleanup http://paste.openstack.org/show/486512/ please check the log | 06:15 |
*** gildub has quit IRC | 06:16 | |
zxiiro | the code's expecting a string to be returned but it's returning None because we don't have an IP address i guess | 06:17 |
clarkb | zxiiro: yes, do the logs indicate any IP is detected? | 06:17 |
clarkb | chaitu: that is normal if you have a newer image | 06:17 |
clarkb | it should keep the last 2 images | 06:18 |
*** hamzy has quit IRC | 06:18 | |
zxiiro | I think so because just before that log it successfully ssh's into the machine | 06:19 |
zxiiro | and runs scripts | 06:19 |
zxiiro | RESP BODY: {"servers": [{"status": "ACTIVE", "updated": "2016-02-10T06:08:02Z", "hostId": "", "addresses": {"opendaylight": [{"version": 4, "addr": "10.30.32.56"}]}, | 06:19 |
zxiiro | that's the json request i see just before that contains an ip too | 06:19 |
clarkb | thats what nova says but then nodepool has to figure out if that address is public or private | 06:19 |
clarkb | it should log explicitly the mapping it decides on iirc | 06:20 |
zxiiro | 2016-02-10 06:12:31,694 DEBUG nodepool.NodeLauncher: Node id: 14 is running, ipv4: 10.30.32.242, ipv6: None | 06:20 |
zxiiro | 2016-02-10 06:12:31,694 DEBUG nodepool.NodeLauncher: Node id: 14 testing ssh at ip: 10.30.32.242 | 06:20 |
zxiiro | hmm i don't see a mapping in the logs | 06:20 |
zxiiro | yeah that's the only log i see that has ips in it other than the flood of ssh debug logs that appear | 06:21 |
*** esker has quit IRC | 06:21 | |
clarkb | https://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/provider_manager.py#n68 | 06:22 |
clarkb | do I guess we must rely on that fixed spec on ovh | 06:23 |
*** sam_wan has quit IRC | 06:24 | |
zxiiro | what should it do if we don't have a private ip? just reuse the public ip? | 06:25 |
clarkb | I think if no private ip exists then we should either explicitly treat thr public as private or not try to use private at all | 06:25 |
zxiiro | we have to change our get_public_ip to use server.addresses.get('opendaylight', []) because we have a custom network name | 06:26 |
zxiiro | that change worked for us on older nodepool version | 06:26 |
clarkb | if your addresses had https://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/provider_manager.py#n78 it would work | 06:26 |
clarkb | which appears to be how it works for us today | 06:26 |
zxiiro | i guess something must have changed related to how nodepool handles missing private ip | 06:26 |
clarkb | you can specify the name in config now | 06:27 |
clarkb | no need to patch the service | 06:27 |
zxiiro | oh? how do i do that? | 06:27 |
zxiiro | i'll give that a try just in case | 06:27 |
clarkb | https://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/provider_manager.py#n61 id the code, only affects publoc, not private | 06:27 |
clarkb | http://docs.openstack.org/infra/nodepool/configuration.html#provider has docs on that | 06:28 |
*** annegentle_ has joined #openstack-infra | 06:29 | |
* clarkb really wishes that neutron would be explocit and consistent about this info | 06:29 | |
zxiiro | i'm guessing it's that networks: field. | 06:29 |
*** Guest91121 has quit IRC | 06:29 | |
* zxiiro goes to give it a try | 06:29 | |
clarkb | denote if IP is routable outside of the cloud or not | 06:30 |
*** ccrouch has quit IRC | 06:30 | |
zxiiro | clarkb: we're using the rackspace public cloud though, i'm worried that line that says provider.use_neutron means we need access to neutron which we don't have in the public cloud i don't think... | 06:31 |
* zxiiro we really need to move into the private cloud more quickly.... | 06:31 | |
*** hamzy has joined #openstack-infra | 06:31 | |
clarkb | what you describe isnt rackspace public cloud that I know | 06:31 |
clarkb | we use thus just fien with rax and there is no opendaylight and I want to say the if name == private is for rax | 06:32 |
*** esker has joined #openstack-infra | 06:32 | |
*** annegentle_ has quit IRC | 06:34 | |
*** ashleighfarnham has joined #openstack-infra | 06:34 | |
clarkb | but yes if we cant determine a private IP we should either A) ignore that properly or B) just use public | 06:35 |
zxiiro | ok when i add the networks setting i get NeutronClientException: 404 Not Found | 06:36 |
*** abregman has joined #openstack-infra | 06:36 | |
zxiiro | but i pip installed rackspace-neutronclient | 06:36 |
zxiiro | and just running "neutron" in the terminal works... | 06:36 |
clarkb | we use python-neutronclient | 06:37 |
clarkb | is rackspace-neutronclient really a thing? | 06:38 |
clarkb | :/ | 06:38 |
zxiiro | apparently... i assumed that was the one i wanted maybe not | 06:38 |
* zxiiro tries the other one | 06:38 | |
zxiiro | nope that didn't make a difference.... | 06:40 |
clarkb | I am not sure then, the setup you describe is very odd especialpy for what I expect from rackspace | 06:41 |
zxiiro | http://pastebin.com/Vuyqk1m3 | 06:41 |
zxiiro | that's the traceback | 06:41 |
zxiiro | i'm guessing i have the wrong "name" for my network | 06:41 |
zxiiro | i tried both the "id" as well as the "name" column that appears in rackspace, neither seem to work | 06:42 |
clarkb | well the 404 is on the list networks call | 06:42 |
clarkb | so it isnt able to list networks at all | 06:42 |
zxiiro | hmm | 06:43 |
zxiiro | oh well it's late | 06:43 |
zxiiro | i'm gonna go sleep | 06:43 |
zxiiro | clarkb: thanks for the help | 06:43 |
*** yumapath has joined #openstack-infra | 06:44 | |
yumapath | hi folks | 06:44 |
yumapath | am facing issues connecting to gerrit event stream through zuul | 06:45 |
yumapath | 2016-02-10 12:12:47,410 ERROR gerrit.GerritWatcher: Exception on ssh event stream: Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/zuul/connection/gerrit.py", line 173, in _run key_filename=self.keyfile) File "/usr/local/lib/python2.7/dist-packages/paramiko/client.py", line 292, in connect retry_on_signal(lambda: sock.connect(addr)) File "/usr/local/lib/python2.7/dist-packages/ | 06:45 |
yumapath | can anyone please help me with this | 06:45 |
clarkb | yumapath: can you usr a paste service and paste the entire traceback? | 06:46 |
yumapath | this command works though when run manually | 06:46 |
yumapath | ssh -vv -p 29418 yumapath@review.openstack.org | 06:46 |
yumapath | as zuul user | 06:46 |
yumapath | clarkb: am new to openstack , can you please tell me what is a paste service | 06:47 |
clarkb | it id a web service that you paste data into which then returns a url for that paste | 06:48 |
*** armax has quit IRC | 06:48 | |
yumapath | ok | 06:48 |
clarkb | thid way you dont have to do it line by line on irc | 06:48 |
yumapath | ok | 06:48 |
yumapath | let me just try something online | 06:48 |
yumapath | one sec | 06:48 |
clarkb | http://paste.openstack.org is the one we host but there are many options | 06:48 |
yumapath | ok | 06:48 |
yumapath | thanks | 06:48 |
yumapath | http://paste.openstack.org/show/486514/ | 06:49 |
yumapath | Please try this | 06:49 |
clarkb | network is unreachable | 06:50 |
*** gildub has joined #openstack-infra | 06:50 | |
clarkb | possibly a firewall probl | 06:50 |
clarkb | *problem | 06:50 |
yumapath | i tried this command | 06:50 |
yumapath | ssh -vv -p 29418 yumapath@review.openstack.org | 06:50 |
yumapath | manually with my gerrit username | 06:51 |
yumapath | it seems to work fine | 06:51 |
yumapath | as a zuul user | 06:51 |
clarkb | on the same machine running zuul? | 06:51 |
yumapath | yes | 06:51 |
yumapath | i have that allinone installation | 06:51 |
yumapath | using puppet modules | 06:51 |
yumapath | my server is behind a proxy | 06:51 |
yumapath | that is true | 06:51 |
yumapath | but since this command ssh -vv -p 29418 yumapath@review.openstack.org works | 06:51 |
yumapath | am lost as to what could be the issue | 06:52 |
clarkb | I would double check your zuul config then | 06:52 |
clarkb | it could be trying to connect yo the wrong location | 06:52 |
yumapath | oh i see | 06:52 |
yumapath | i have not changed anything in the zuul file | 06:52 |
yumapath | am just trying to check the noop connection | 06:52 |
yumapath | test | 06:52 |
yumapath | let me paste the contents | 06:52 |
clarkb | well check that it looks correct... | 06:52 |
clarkb | there should be a gerrit section with connection details I think | 06:53 |
yumapath | http://paste.openstack.org/show/486515/ | 06:54 |
clarkb | does telnet review.openstack.org 29418 establish a tcp connection? | 06:56 |
clarkb | I wonder if ssh is configured to proxy | 06:56 |
clarkb | and since zuul uses paramiko that wont just work | 06:56 |
yumapath | ssh is working | 06:56 |
yumapath | through proxy | 06:56 |
yumapath | ssh -vv -p 29418 yumapath@review.openstack.org | 06:56 |
yumapath | this command works | 06:57 |
clarkb | yes I know | 06:57 |
clarkb | but zuul does not use the ssh command, it uses the paramiko library | 06:57 |
clarkb | does a "raw" tcp connection work? | 06:57 |
clarkb | using nc or telnet? | 06:57 |
yumapath | i have not checked | 06:57 |
yumapath | one sec | 06:57 |
clarkb | if not then likely paramiko doesnt have the necessary proxy bits | 06:57 |
yumapath | ok | 06:57 |
*** ashleighfarnham has quit IRC | 06:59 | |
yumapath | zuul@cinder-jenkins:/etc/zuul$ telnet review.openstack.org Trying 104.130.159.134... Trying 2001:4800:7818:102:be76:4eff:fe05:9b12... telnet: Unable to connect to remote host: Network is unreachable zuul@cinder-jenkins:/etc/zuul$ | 06:59 |
*** kzaitsev_mb has joined #openstack-infra | 06:59 | |
yumapath | <clarkb>: raw telnet connection seems to fail | 06:59 |
clarkb | that us probably the issue then | 07:00 |
yumapath | then basically i should make telnet work behind a proxy | 07:00 |
yumapath | like i made ssh work behind a proxy | 07:00 |
clarkb | well you need paramiko to work yes | 07:01 |
yumapath | ok | 07:01 |
yumapath | let me try that out | 07:01 |
yumapath | thanks for your help | 07:01 |
yumapath | i was all along thinking it was using ssh for connecting | 07:01 |
yumapath | i was not aware that it was using telnet | 07:01 |
clarkb | it isnt using telnet | 07:01 |
nibalizer | no its using ssh | 07:01 |
clarkb | it uses paramiko | 07:01 |
nibalizer | telnet is just a basic tester for network connectivity | 07:02 |
nibalizer | paramiko is an ssh library for python | 07:02 |
yumapath | ok | 07:02 |
clarkb | but ssh is botha protocol and a command. in this case paramiko implemts the protocol but is separate from the command | 07:02 |
yumapath | ok | 07:02 |
nibalizer | yumapath: what is in your .ssh/config ? | 07:02 |
nibalizer | it looks like paramiko has proxycommand support http://docs.paramiko.org/en/1.16/api/proxy.html | 07:03 |
nibalizer | I doubt that is piped through to zuul though | 07:03 |
yumapath | ok | 07:03 |
ianw | http://nodepool.openstack.org/ <- so few images! | 07:03 |
*** kzaitsev_mb has quit IRC | 07:04 | |
yumapath | <nibalizer> & <clarkb> | 07:04 |
yumapath | i have the following in ssh config | 07:04 |
yumapath | http://paste.openstack.org/show/486516/ | 07:05 |
*** gokrokve has joined #openstack-infra | 07:06 | |
yumapath | <nibalizer> <clarkb> can you please check to see if the config for proxy | 07:06 |
yumapath | is enough | 07:06 |
yumapath | as you say am able to do ssh to review.openstack.org | 07:07 |
yumapath | so you mean to say that is not enough | 07:07 |
yumapath | a raw tcp connection should go through | 07:07 |
*** hdd has quit IRC | 07:08 | |
yumapath | my understand is, pramiko has its own implementation of the ssh protocol | 07:08 |
yumapath | and the proxy information which i have given is for the ssh command | 07:08 |
yumapath | and not for the protocol itself | 07:08 |
yumapath | am i right | 07:08 |
yumapath | ? | 07:08 |
clarkb | yes | 07:09 |
yumapath | ok got it | 07:09 |
yumapath | now i will have to figure out how to make tcp work behind a proxy | 07:09 |
yumapath | thanks so much clarkb and nibalizer | 07:09 |
yumapath | for pointing it out | 07:09 |
yumapath | let me try to fig out | 07:09 |
*** shashank_hegde has joined #openstack-infra | 07:10 | |
*** gokrokve has quit IRC | 07:14 | |
*** cgross- has joined #openstack-infra | 07:14 | |
*** rcernin has joined #openstack-infra | 07:14 | |
*** infra-red has joined #openstack-infra | 07:15 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/277702 | 07:15 |
*** infra-re_ has joined #openstack-infra | 07:16 | |
*** infra-red has quit IRC | 07:19 | |
*** cgross- is now known as lmiccini | 07:20 | |
yolanda | morning | 07:29 |
nibalizer | good morning | 07:29 |
*** ianw has quit IRC | 07:30 | |
*** ianw has joined #openstack-infra | 07:30 | |
*** Sukhdev has quit IRC | 07:31 | |
*** otherwiseguy has quit IRC | 07:34 | |
openstackgerrit | Merged openstack-infra/project-config: Notify #openstack-dev of governance changes https://review.openstack.org/277943 | 07:35 |
*** nmagnezi has joined #openstack-infra | 07:36 | |
openstackgerrit | Merged openstack-infra/project-config: Add python3-job and check-requirements for networking-fujitsu https://review.openstack.org/275462 | 07:37 |
openstackgerrit | Merged openstack-infra/project-config: Rename periodic networking jobs https://review.openstack.org/276367 | 07:37 |
openstackgerrit | Merged openstack-infra/project-config: gate-networking-midonet-v2-dsvm-rally-nv: Don't forget to enable rally https://review.openstack.org/276550 | 07:39 |
openstackgerrit | Merged openstack-infra/project-config: networking-nec: Enable python3 and check-requirement jobs https://review.openstack.org/276613 | 07:43 |
*** openstackgerrit has quit IRC | 07:47 | |
*** openstackgerrit has joined #openstack-infra | 07:47 | |
*** scheuran has joined #openstack-infra | 07:47 | |
openstackgerrit | Merged openstack-infra/project-config: puppet/integ/multinode: copy logs for localhost machine https://review.openstack.org/278008 | 07:48 |
openstackgerrit | Merged openstack-infra/project-config: Move bindep fallback job-template to infra file https://review.openstack.org/277980 | 07:50 |
*** jtomasek_ has joined #openstack-infra | 07:51 | |
openstackgerrit | Merged openstack-infra/glean: Stop confusing vim's tiny brain https://review.openstack.org/275984 | 07:51 |
*** rcernin has quit IRC | 07:52 | |
*** isaacb has joined #openstack-infra | 07:55 | |
*** andymaier has joined #openstack-infra | 07:55 | |
*** esker has quit IRC | 07:56 | |
*** e0ne has joined #openstack-infra | 07:58 | |
*** AJaeger has quit IRC | 07:59 | |
*** esker has joined #openstack-infra | 07:59 | |
openstackgerrit | Merged openstack-infra/project-config: Enables Congress to launch with dist_arch flag as True https://review.openstack.org/277787 | 07:59 |
*** tzn has joined #openstack-infra | 08:00 | |
*** kzaitsev_mb has joined #openstack-infra | 08:00 | |
openstackgerrit | Merged openstack-infra/project-config: Make TripleO puppet check jobs voting https://review.openstack.org/270165 | 08:00 |
*** abregman has quit IRC | 08:01 | |
*** kzaitsev_mb has quit IRC | 08:04 | |
*** abregman has joined #openstack-infra | 08:05 | |
*** sam_wan has joined #openstack-infra | 08:11 | |
*** achanda has quit IRC | 08:13 | |
*** rcernin has joined #openstack-infra | 08:15 | |
*** d0ugal has joined #openstack-infra | 08:17 | |
*** SumitNaiksatam has quit IRC | 08:19 | |
*** jistr|doc has joined #openstack-infra | 08:22 | |
*** vincentfrancoise has joined #openstack-infra | 08:23 | |
openstackgerrit | Alexander Charykov proposed openstack-infra/gerritlib: Add limit for bulk_query request https://review.openstack.org/277773 | 08:23 |
*** samuelBartel has joined #openstack-infra | 08:24 | |
*** nt has quit IRC | 08:28 | |
*** tzn has quit IRC | 08:29 | |
*** flepied has quit IRC | 08:30 | |
openstackgerrit | Merged openstack/diskimage-builder: Only match #!/bin/bash in scripts https://review.openstack.org/273879 | 08:35 |
*** matrohon has joined #openstack-infra | 08:35 | |
*** nadya has joined #openstack-infra | 08:35 | |
*** nadya is now known as Guest15890 | 08:36 | |
*** yaume has joined #openstack-infra | 08:37 | |
*** achanda has joined #openstack-infra | 08:37 | |
*** jlanoux has joined #openstack-infra | 08:38 | |
*** mikelk has joined #openstack-infra | 08:39 | |
*** e0ne has quit IRC | 08:39 | |
*** dingyichen has quit IRC | 08:40 | |
*** gokrokve has joined #openstack-infra | 08:40 | |
*** abregman has quit IRC | 08:40 | |
*** abregman has joined #openstack-infra | 08:41 | |
*** maishsk has joined #openstack-infra | 08:41 | |
*** ihrachys has joined #openstack-infra | 08:42 | |
*** abregman has quit IRC | 08:42 | |
*** abregman has joined #openstack-infra | 08:43 | |
*** salv-orlando has quit IRC | 08:44 | |
*** gokrokve has quit IRC | 08:44 | |
*** shashank_hegde has quit IRC | 08:46 | |
*** jaosorior has joined #openstack-infra | 08:48 | |
*** Hal has joined #openstack-infra | 08:51 | |
*** Hal is now known as Guest68220 | 08:52 | |
openstackgerrit | Moshe Levi proposed openstack/diskimage-builder: Adding InfiniBand Support https://review.openstack.org/274781 | 08:54 |
*** jlanoux has quit IRC | 08:54 | |
*** jlanoux has joined #openstack-infra | 08:55 | |
*** jpr has joined #openstack-infra | 08:57 | |
*** kzaitsev_mb has joined #openstack-infra | 09:01 | |
*** abregman has quit IRC | 09:01 | |
*** abregman has joined #openstack-infra | 09:02 | |
*** ifarkas has joined #openstack-infra | 09:02 | |
*** jcoufal has joined #openstack-infra | 09:03 | |
*** dtardivel has joined #openstack-infra | 09:04 | |
*** kzaitsev_mb has quit IRC | 09:05 | |
*** zeih_ has joined #openstack-infra | 09:09 | |
*** flepied has joined #openstack-infra | 09:10 | |
*** shardy has joined #openstack-infra | 09:11 | |
*** BobBall_AWOL has quit IRC | 09:18 | |
*** BobBall_AWOL has joined #openstack-infra | 09:18 | |
*** fawadkhaliq has quit IRC | 09:19 | |
*** lucas-dinner is now known as lucasagomes | 09:19 | |
*** fawadkhaliq has joined #openstack-infra | 09:19 | |
*** kzaitsev_mb has joined #openstack-infra | 09:20 | |
*** isaacb has quit IRC | 09:23 | |
*** dtantsur|afk is now known as dtantsur | 09:28 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove magnum bandit gate https://review.openstack.org/278271 | 09:34 |
openstackgerrit | Dmitry Tantsur proposed openstack/requirements: Bump futurist to 0.11.0 https://review.openstack.org/278272 | 09:34 |
*** flepied1 has joined #openstack-infra | 09:37 | |
*** yumapath has quit IRC | 09:40 | |
*** BobBall_AWOL is now known as BobBall | 09:40 | |
*** flepied has quit IRC | 09:40 | |
*** BobBall is now known as Guest8835 | 09:41 | |
*** gokrokve has joined #openstack-infra | 09:41 | |
*** Guest8835 is now known as Bobba | 09:41 | |
*** Bobba is now known as BobBall1 | 09:42 | |
*** electrofelix has joined #openstack-infra | 09:42 | |
*** annegentle_ has joined #openstack-infra | 09:45 | |
*** tzn has joined #openstack-infra | 09:45 | |
*** kzaitsev_mb has quit IRC | 09:46 | |
*** jistr|doc has quit IRC | 09:46 | |
*** ihrachys has quit IRC | 09:47 | |
*** zz_dimtruck is now known as dimtruck | 09:47 | |
*** gokrokve has quit IRC | 09:48 | |
*** [HeOS] is now known as HeOS | 09:48 | |
*** derekh has joined #openstack-infra | 09:50 | |
*** placko_ has joined #openstack-infra | 09:50 | |
*** annegentle_ has quit IRC | 09:50 | |
*** dtantsur is now known as dtantsur|brb | 09:51 | |
*** wznoinsk has quit IRC | 09:54 | |
*** mrmartin has joined #openstack-infra | 10:00 | |
*** achanda has quit IRC | 10:06 | |
*** maishsk has quit IRC | 10:07 | |
*** e0ne has joined #openstack-infra | 10:07 | |
*** maishsk has joined #openstack-infra | 10:07 | |
*** achanda has joined #openstack-infra | 10:08 | |
*** sam_wan has quit IRC | 10:10 | |
*** jaosorior has quit IRC | 10:21 | |
maishsk | Good afternoon all | 10:21 |
maishsk | How do I rebase a change? | 10:22 |
*** shardy has quit IRC | 10:25 | |
*** shardy has joined #openstack-infra | 10:25 | |
*** ihrachys has joined #openstack-infra | 10:29 | |
*** fawadkhaliq has quit IRC | 10:32 | |
*** fhubik has joined #openstack-infra | 10:35 | |
*** rguillebert has joined #openstack-infra | 10:37 | |
*** ihrachys has quit IRC | 10:41 | |
*** salv-orlando has joined #openstack-infra | 10:41 | |
*** dtantsur|brb is now known as dtantsur | 10:42 | |
nibalizer | maishsk: in many cases you can press the 'rebase change' button | 10:42 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Add support for periodic jobs https://review.openstack.org/271370 | 10:42 |
maishsk | nibalizer: I have tried that - but I am getting an error | 10:42 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Add support for command line job names https://review.openstack.org/235421 | 10:42 |
maishsk | Do I need to change parent revision? or fill in anything else? | 10:43 |
*** achanda has quit IRC | 10:45 | |
*** ldnunes has joined #openstack-infra | 10:46 | |
*** dims has joined #openstack-infra | 10:48 | |
nibalizer | you may need to use the command line | 10:48 |
nibalizer | https://help.github.com/articles/about-git-rebase/ | 10:48 |
openstackgerrit | Adelina Tuvenie proposed openstack/requirements: Change global requirements forcing cliff!=1.16.0 https://review.openstack.org/278299 | 10:48 |
nibalizer | that is github docs but mauch of it applies | 10:48 |
*** kzaitsev_mb has joined #openstack-infra | 10:49 | |
*** fawadkhaliq has joined #openstack-infra | 10:51 | |
*** aysyd has joined #openstack-infra | 10:52 | |
*** tpsilva has joined #openstack-infra | 10:53 | |
*** fawadkhaliq has quit IRC | 10:54 | |
*** fawadkhaliq has joined #openstack-infra | 10:55 | |
maishsk | nibalizer: thanks - but I still dont know how to rebase a specific change | 10:56 |
*** aysyd has quit IRC | 10:58 | |
*** aysyd has joined #openstack-infra | 10:59 | |
vincentfrancoise | Hi everyone. In https://review.openstack.org/#/c/275167/, I created a new "watcher-dashboard" project along with its "watcher-dashboard-core" group. The thing is that no one is currently in, so could a Gerrit admin to put me in? | 11:00 |
yolanda | hi vincentfrancoise, sure | 11:02 |
vincentfrancoise | yolanda: thanks a lot | 11:02 |
yolanda | done | 11:03 |
vincentfrancoise | thank you | 11:04 |
*** rfolco has joined #openstack-infra | 11:09 | |
*** samuelBartel has quit IRC | 11:15 | |
openstackgerrit | Sean Dague proposed openstack-infra/project-config: Revert "Set gate-grenade-dsvm-multinode to non-voting" https://review.openstack.org/277833 | 11:16 |
*** mrmartin has quit IRC | 11:20 | |
*** fawadkhaliq has quit IRC | 11:22 | |
*** fawadkhaliq has joined #openstack-infra | 11:23 | |
*** akscram has quit IRC | 11:25 | |
*** changbl has quit IRC | 11:25 | |
*** akscram has joined #openstack-infra | 11:25 | |
*** jaypipes has joined #openstack-infra | 11:27 | |
*** fhubik is now known as fhubik_brb | 11:34 | |
*** |-paul-| has joined #openstack-infra | 11:35 | |
*** ociuhandu has quit IRC | 11:35 | |
*** Daisy has joined #openstack-infra | 11:36 | |
*** sfinucan has joined #openstack-infra | 11:37 | |
openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added *-npm-publish-draft job https://review.openstack.org/277996 | 11:37 |
*** ildikov has quit IRC | 11:38 | |
*** sam_wan has joined #openstack-infra | 11:39 | |
*** AJaeger has joined #openstack-infra | 11:42 | |
openstackgerrit | David TARDIVEL proposed openstack/requirements: Add watcher and python-watcherclient to projects.txt https://review.openstack.org/278321 | 11:43 |
*** ihrachys has joined #openstack-infra | 11:43 | |
*** erlon has joined #openstack-infra | 11:43 | |
AJaeger | infra-root, the pip installation on the proposal slaves is broken. We get: "Download error on http://pypi.dfw.openstack.org/simple/pbr/: [Errno 113] No route to host -- Some packages may not be found!" | 11:43 |
AJaeger | examples: https://jenkins.openstack.org/job/propose-requirements-constraints-master/227/console and https://jenkins.openstack.org/job/designate-dashboard-propose-translation-update/142/console | 11:44 |
yolanda | hi AJaeger | 11:44 |
yolanda | i haven't been involved on that but i can try debug | 11:44 |
AJaeger | This worked a few days ago, failed already yesterday | 11:44 |
AJaeger | yolanda: IMHO not time critical but should be done today | 11:44 |
yolanda | going to check the server for obvious errors | 11:45 |
AJaeger | might be some side effect of mirror setup, mordred mentioned yesterday that the mirror looks like an old mirror. | 11:45 |
AJaeger | thanks, yolanda ! | 11:45 |
*** achanda has joined #openstack-infra | 11:45 | |
*** kzaitsev_mb has quit IRC | 11:47 | |
yolanda | weird, i cannot contact that externally from a browser, but responds to ping, ip resolves | 11:47 |
*** esikachev has joined #openstack-infra | 11:47 | |
yolanda | and wget internal from that machine works | 11:47 |
yolanda | doh, ipv6 problems again | 11:48 |
*** kmartin__ has quit IRC | 11:48 | |
AJaeger | argh ;( | 11:48 |
yolanda | Resolviendo pypi.dfw.openstack.org (pypi.dfw.openstack.org)... 23.253.237.8, 2001:4800:7817:104:d256:7a33:5187:7e1b | 11:48 |
yolanda | Conectando con pypi.dfw.openstack.org (pypi.dfw.openstack.org)[23.253.237.8]:80... falló: No existe ninguna ruta hasta el «host». | 11:48 |
yolanda | Conectando con pypi.dfw.openstack.org (pypi.dfw.openstack.org)[2001:4800:7817:104:d256:7a33:5187:7e1b]:80... falló: La red es inaccesible. | 11:48 |
yolanda | sorry for the spanish | 11:49 |
yolanda | so for ipv4, no route to host, for ipv6, not reachable network | 11:49 |
yolanda | going to check dns entries | 11:49 |
*** arthus has joined #openstack-infra | 11:50 | |
openstackgerrit | Fausto Marzi proposed openstack-infra/project-config: Set conditions for gate-freezer-devstack-dsvm on freezer https://review.openstack.org/278323 | 11:50 |
AJaeger | did we decommission that host as part of the new mirror setup? | 11:50 |
*** achanda has quit IRC | 11:50 | |
AJaeger | yolanda: https://review.openstack.org/#/c/273518/ | 11:51 |
AJaeger | could it be that we did not update the pip mirror configuration for the proposal slave? | 11:52 |
yolanda | ah didn't know that it landed yet | 11:52 |
yolanda | server is still up | 11:52 |
yolanda | so yes, jobs will need to use new slaves then. But it was dropped without the update of the jobs using that? | 11:53 |
*** xek has quit IRC | 11:53 | |
yolanda | AJaeger, i see iptables closed | 11:53 |
yolanda | so can you check if there are jobs still pending to update? if that's the case they need to be updated, or this change has to be reverted | 11:54 |
AJaeger | Might be something for mordred, jeblair, krotscheck_dcm, and fungi to look at later. | 11:55 |
AJaeger | I don't see an open review but might have missed something... | 11:56 |
*** links has quit IRC | 11:56 | |
yolanda | AJaeger, looking at project-config, i cannot find anything pointing to pypi.dfw | 11:56 |
yolanda | mm, in system-config, there is pydistutils configured to point to that! | 11:57 |
yolanda | [easy_install] | 11:57 |
yolanda | index_url = http://pypi.dfw.openstack.org/simple | 11:57 |
yolanda | allow_hosts = *.openstack.org | 11:57 |
yolanda | that looks as guilty! | 11:57 |
yolanda | AJaeger, what is the equivalent url now? you know? | 11:58 |
*** Daisy has quit IRC | 11:58 | |
*** claudiub has joined #openstack-infra | 11:58 | |
*** fhubik_brb is now known as fhubik | 11:58 | |
* AJaeger checks... | 11:58 | |
*** notnownikki has quit IRC | 11:59 | |
Zara | jeblair: btw, how are things going with https://review.openstack.org/#/c/270331/ ? | 11:59 |
*** fawadkhaliq has quit IRC | 11:59 | |
AJaeger | yolanda: http://mirror.dfw.rax.openstack.org/ | 11:59 |
yolanda | ok let's change it | 11:59 |
AJaeger | I think http://mirror.dfw.rax.openstack.org/pypi/ | 11:59 |
yolanda | ok that one works | 12:00 |
AJaeger | Better http://mirror.dfw.rax.openstack.org/pypi/simple/ | 12:00 |
*** daemontool_ has quit IRC | 12:00 | |
yolanda | well yes, that one | 12:01 |
AJaeger | note that file modules/openstack_project/templates/wheel_mirror/known_hosts.erb needs probably updating as well - it has all the old mirrors in it... | 12:01 |
openstackgerrit | Sean Dague proposed openstack-infra/project-config: move our API 2.0 compat jobs to experimental https://review.openstack.org/278325 | 12:01 |
yolanda | i'll double check it | 12:01 |
AJaeger | thanks, yolanda | 12:02 |
yolanda | that's already included in trusted hsots | 12:02 |
yolanda | hosts | 12:02 |
openstackgerrit | David TARDIVEL proposed openstack-infra/project-config: Add requirements check for watcher https://review.openstack.org/278326 | 12:02 |
AJaeger | Or we should remove the file completely? | 12:03 |
* AJaeger knows too little about the puppet setup, just knows the content is wrong... | 12:03 | |
yolanda | no, we better point that to a valid mirror | 12:04 |
sdague | AJaeger / yolanda https://review.openstack.org/278325 | 12:04 |
*** arxcruz has quit IRC | 12:04 | |
*** tzn has quit IRC | 12:04 | |
yolanda | AJaeger, sorry, a bit slow because i'm having rebase problems, i had some cruft in that repo | 12:04 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Split the deploy script into its own file https://review.openstack.org/275668 | 12:04 |
*** |-paul-| has quit IRC | 12:04 | |
AJaeger | sdague: I trade you a trivial review in exchange: https://review.openstack.org/278094 ;) | 12:05 |
*** ociuhandu has joined #openstack-infra | 12:05 | |
*** tzn has joined #openstack-infra | 12:05 | |
AJaeger | yolanda: no worries - I'm suggesting to let that change be properly reviewed and not ninja-approve it. | 12:06 |
*** olaph has joined #openstack-infra | 12:06 | |
*** annegentle_ has joined #openstack-infra | 12:06 | |
AJaeger | sdague: but this one is one I really would love some feedback on from you when you have time, please: https://review.openstack.org/#/c/278034/ | 12:07 |
sdague | AJaeger: that I need more brainpower for | 12:07 |
openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Update mirror to use in easy_install https://review.openstack.org/278328 | 12:08 |
yolanda | ok sent | 12:08 |
sdague | AJaeger: https://review.openstack.org/#/c/277833/ is rebased so zuul will vote on it | 12:08 |
sdague | if you could kick that in | 12:08 |
yolanda | sdague, approved | 12:08 |
AJaeger | sdague: done | 12:08 |
AJaeger | sdague: sure, take your time... | 12:09 |
yolanda | infra-root, can you review https://review.openstack.org/278328 ? we need to fix that, to point to valid mirrors, causing tests to fail | 12:09 |
AJaeger | thanks, yolanda | 12:09 |
yolanda | AJaeger, i remember having similar issues downstrema with that | 12:09 |
AJaeger | sdague: do you plan to continue with the constraints? AFAIR your latest change for project-config was reverted but I think that patch for just the gates - not the post - should be fine and move us forward. | 12:10 |
*** annegentle_ has quit IRC | 12:11 | |
*** notnownikki has joined #openstack-infra | 12:12 | |
*** kzaitsev_mb has joined #openstack-infra | 12:12 | |
AJaeger | sdague: btw. I did some more housekeeping of devstack-jobs, see https://review.openstack.org/#/q/status:open+topic:cleanup-devstack | 12:12 |
*** daemontool_ has joined #openstack-infra | 12:16 | |
openstackgerrit | Merged openstack-infra/project-config: Revert "Set gate-grenade-dsvm-multinode to non-voting" https://review.openstack.org/277833 | 12:16 |
*** ildikov has joined #openstack-infra | 12:16 | |
*** tzn has quit IRC | 12:18 | |
AJaeger | mordred, jeblair could you review system-config file ./modules/openstack_project/templates/wheel_mirror/known_hosts.erb, please? That looks very outdated | 12:19 |
*** yamamoto has quit IRC | 12:20 | |
openstackgerrit | Merged openstack-infra/project-config: move our API 2.0 compat jobs to experimental https://review.openstack.org/278325 | 12:20 |
*** gildub has quit IRC | 12:23 | |
*** arxcruz has joined #openstack-infra | 12:27 | |
sdague | AJaeger: I can respin that, it was my original patch, but I got -1ed for it | 12:27 |
openstackgerrit | Merged openstack/requirements: Remove version exclusions for selenium https://review.openstack.org/276288 | 12:28 |
*** edmondsw has joined #openstack-infra | 12:29 | |
AJaeger | sdague: my understanding of the -1 was that this was fixed with the PTI update. Best to talk with jeblair and others. | 12:30 |
* AJaeger likes to see a way forward with constraint testing, it's stale right now... | 12:30 | |
*** EricGonczer_ has joined #openstack-infra | 12:31 | |
yolanda | going to have lunch | 12:32 |
*** tzn has joined #openstack-infra | 12:32 | |
AJaeger | enjoy, yolanda ! | 12:32 |
yolanda | AJaeger, i'll need to step out in the afternoon. Can you ping some infra-root to review that change? | 12:33 |
sdague | AJaeger: no, https://review.openstack.org/#/c/267133/ | 12:34 |
sdague | but I can redo it as ps1 | 12:34 |
*** mingyu has quit IRC | 12:35 | |
*** EricGonczer_ has quit IRC | 12:36 | |
*** links has joined #openstack-infra | 12:36 | |
*** tzn has quit IRC | 12:36 | |
*** tzn has joined #openstack-infra | 12:36 | |
*** mingyu has joined #openstack-infra | 12:36 | |
openstackgerrit | Sean Dague proposed openstack-infra/project-config: always make upper-constraints available to python jobs https://review.openstack.org/278335 | 12:36 |
sdague | AJaeger: re proposed | 12:37 |
*** sam_wan has quit IRC | 12:37 | |
*** sam_wan has joined #openstack-infra | 12:37 | |
*** ildikov has quit IRC | 12:38 | |
openstackgerrit | Fausto Marzi proposed openstack-infra/project-config: Set conditions for gate-freezer-devstack-dsvm on freezer https://review.openstack.org/278323 | 12:38 |
AJaeger | yolanda: I'll try... | 12:38 |
*** krotscheck_dcm is now known as krotscheck | 12:38 | |
*** sam_wan has quit IRC | 12:38 | |
AJaeger | sdague: you cannot use zuul-cloner currenlty in the post pipeline - the coverage jobs runs in post, doesn't it? | 12:39 |
openstackgerrit | Sean Dague proposed openstack-infra/project-config: always make upper-constraints available to python jobs https://review.openstack.org/278335 | 12:40 |
sdague | AJaeger: probably, fixed | 12:40 |
*** thorst has joined #openstack-infra | 12:40 | |
AJaeger | sdague: please ping jeblair and fungi to review your change 278335 | 12:41 |
*** ildikov has joined #openstack-infra | 12:44 | |
*** Mmike has quit IRC | 12:44 | |
*** vgridnev has joined #openstack-infra | 12:45 | |
*** thorst has quit IRC | 12:45 | |
*** Mmike has joined #openstack-infra | 12:47 | |
*** Mmike has joined #openstack-infra | 12:47 | |
pigmej | yolanda: could you please look into https://review.openstack.org/#/c/267453/ it's nearly 2w since AJaeger Code Review +2... and about a month since patch was created | 12:47 |
*** annegentle_ has joined #openstack-infra | 12:48 | |
*** achanda has joined #openstack-infra | 12:48 | |
*** thorst_ has joined #openstack-infra | 12:49 | |
*** thorst_ has quit IRC | 12:49 | |
*** thorst_ has joined #openstack-infra | 12:50 | |
*** weshay_xchat has joined #openstack-infra | 12:52 | |
*** sam_wan has joined #openstack-infra | 12:52 | |
*** annegentle_ has quit IRC | 12:53 | |
*** achanda has quit IRC | 12:54 | |
*** mrmartin has joined #openstack-infra | 12:54 | |
*** sam_wan has quit IRC | 12:56 | |
*** lucasagomes is now known as lucas-hungry | 12:56 | |
*** sam_wan has joined #openstack-infra | 12:57 | |
*** tzn has quit IRC | 12:58 | |
*** dizquierdo has joined #openstack-infra | 12:58 | |
*** maishsk has quit IRC | 12:59 | |
*** sam_wan has quit IRC | 13:00 | |
*** vincentfrancoise has left #openstack-infra | 13:01 | |
*** sam_wan has joined #openstack-infra | 13:01 | |
*** rlandy has joined #openstack-infra | 13:02 | |
*** dimtruck is now known as zz_dimtruck | 13:03 | |
*** sdake has joined #openstack-infra | 13:04 | |
*** sam_wan has quit IRC | 13:04 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Revert "Revert "Enable voting for Puppet OpenStack Integration jobs"" https://review.openstack.org/278352 | 13:04 |
*** sam_wan has joined #openstack-infra | 13:06 | |
AJaeger | EmilienM: glad to see puppet gate back in business... | 13:06 |
EmilienM | AJaeger: until when? :) | 13:06 |
AJaeger | EmilienM: for ever I hope ;) | 13:06 |
EmilienM | AJaeger: the root cause was some issues in nova & gnocchi, that worked on devstack but not in package. Some sort of chicken & egg problem | 13:06 |
AJaeger | ;( | 13:06 |
*** tzn has joined #openstack-infra | 13:07 | |
*** tzn has quit IRC | 13:07 | |
*** jcoufal has quit IRC | 13:07 | |
*** tzn has joined #openstack-infra | 13:07 | |
tristanC | mordred: do you have a moment to talk about heat stack support in shade ? I've been using the proposed patch to demonstrate an os_stack ansible2 module... | 13:08 |
*** dprince has joined #openstack-infra | 13:09 | |
*** e0ne has quit IRC | 13:09 | |
*** vgridnev has quit IRC | 13:09 | |
*** annegentle_ has joined #openstack-infra | 13:09 | |
*** e0ne has joined #openstack-infra | 13:09 | |
tristanC | mordred: it's working fine and all, and before looking at heat stack-snapshot and resources listing, I'd like to check with you how/if you want to support heat with shade | 13:10 |
*** kgiusti has joined #openstack-infra | 13:11 | |
*** edmondsw has quit IRC | 13:11 | |
openstackgerrit | Dmitry Tantsur proposed openstack/requirements: Bump futurist to 0.11.0 https://review.openstack.org/278272 | 13:12 |
dtantsur | dims, ^^ | 13:12 |
dims | dtantsur : +2 | 13:12 |
*** olaph is now known as loaf | 13:13 | |
*** jed56 has quit IRC | 13:13 | |
*** annegentle_ has quit IRC | 13:13 | |
*** olaph has joined #openstack-infra | 13:14 | |
*** sam_wan has quit IRC | 13:15 | |
dims | AJaeger : i still don't see emails from the periodic jobs (-with-oslo-master) | 13:18 |
*** gordc has joined #openstack-infra | 13:19 | |
*** vgridnev has joined #openstack-infra | 13:19 | |
*** vgridnev has quit IRC | 13:21 | |
*** mase_x200 has joined #openstack-infra | 13:22 | |
AJaeger | dims: why emails? | 13:23 |
*** moravec has joined #openstack-infra | 13:24 | |
AJaeger | dims: we're not sending emails for periodic jobs anymore... | 13:24 |
*** e0ne has quit IRC | 13:24 | |
dims | AJaeger : ah. so those are just for stable-main jobs ("[Openstack-stable-maint] Stable check of openstack/tempest failed") | 13:24 |
AJaeger | dims, you have to check http://logs.openstack.org/periodic/ - or look at healthcheck | 13:24 |
AJaeger | dims: yes, only periodic-stable still sends emails | 13:25 |
*** EricGonczer_ has joined #openstack-infra | 13:25 | |
*** e0ne has joined #openstack-infra | 13:25 | |
*** sdake_ has joined #openstack-infra | 13:25 | |
AJaeger | dims: seems your jobs show not up here: http://status.openstack.org/openstack-health/#/g/build_queue/periodic?groupKey=build_queue&resolutionKey=hour&searchJob= - best talk with mtreinish on how to get them there.... | 13:27 |
*** baoli has joined #openstack-infra | 13:27 | |
*** vgridnev has joined #openstack-infra | 13:28 | |
dims | AJaeger : will do thanks | 13:28 |
*** baoli_ has joined #openstack-infra | 13:28 | |
*** yamamoto has joined #openstack-infra | 13:29 | |
mordred | tristanC: definitely want to support heat ... oh, I'm way behind in reviewing | 13:29 |
*** sdake has quit IRC | 13:29 | |
mordred | tristanC: let me go review some | 13:29 |
*** EricGonczer_ has quit IRC | 13:29 | |
openstackgerrit | Julien Danjou proposed openstack-dev/pbr: Add --sysconfdir option to install command https://review.openstack.org/274077 | 13:29 |
openstackgerrit | Julien Danjou proposed openstack-dev/pbr: tests: fix data_files testing https://review.openstack.org/278360 | 13:29 |
AJaeger | mordred: morning! Could you review 278328, please - that's the broken proposal slaves we briefly discussed yesterday. See scrollback for details | 13:30 |
Shrews | tristanC: your reviews are likely failing jenkins tests b/c they need a fix for the gate that was recently merged | 13:31 |
*** baoli has quit IRC | 13:32 | |
Shrews | tristanC: for shade, that is | 13:32 |
tristanC | mordred: for what it worth, here is the ansible implementation https://gist.github.com/TristanCacqueray/ef93d63a98addf4dae94 | 13:33 |
*** hdd has joined #openstack-infra | 13:33 | |
*** annegentle_ has joined #openstack-infra | 13:33 | |
*** amitgandhinz has joined #openstack-infra | 13:33 | |
tristanC | Shrews: yup I noticed those unrelated test failure, but I'm still in the blind if the code is the right approach in the first place | 13:34 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Source undercloud environment variable from a file https://review.openstack.org/275667 | 13:36 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Split the deploy script into its own file https://review.openstack.org/275668 | 13:37 |
Shrews | tristanC: mordred: i have concerns about shade supporting heat since we don't have any way to functionally test it. | 13:37 |
* gtmanfred would like the grant and revoke role stuff for keystone merged :) | 13:37 | |
openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Add class to deal with cacert on infra cloud https://review.openstack.org/278362 | 13:37 |
*** thorst_ has quit IRC | 13:38 | |
Shrews | gtmanfred: if mordred or SpamapS don't get around to adding a second +2 soon-ish, i may invoke super-ninja-merging powers | 13:38 |
Shrews | but we'll give them a bit longer :) | 13:38 |
tristanC | Shrews: that would be good to know, otherwise I could probably rewrite os_stack ansible module using native heatclient | 13:38 |
gtmanfred | awesome :) | 13:38 |
gtmanfred | kk | 13:38 |
*** xek has joined #openstack-infra | 13:38 | |
mordred | Shrews, tristanC looking at code right now | 13:39 |
*** thorst has joined #openstack-infra | 13:39 | |
mordred | Shrews: we should be able to enable heat in our devstacks, no? | 13:39 |
tristanC | mordred: that's appreciated, thank! | 13:39 |
*** Jeffrey4l has joined #openstack-infra | 13:39 | |
mordred | tristanC, Shrews: what's the deal with treating generators special in the first patch? is there something I'm missing? | 13:40 |
Shrews | mordred: i assume so. not knowing enough about heat, is functionally testing that in devstack viable? | 13:40 |
openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Enable cacert signing on infra cloud https://review.openstack.org/278368 | 13:40 |
Shrews | mordred: b/c some client api calls return a generator | 13:40 |
*** thorst has quit IRC | 13:40 | |
*** ihrachys_ has joined #openstack-infra | 13:40 | |
tristanC | mordred: otherwise stack list fail because the get() method is different for Stack object | 13:40 |
*** thorst has joined #openstack-infra | 13:40 | |
Shrews | mordred: you then have to have a way to iterate through the generator to munchify things | 13:41 |
*** jsavak has joined #openstack-infra | 13:41 | |
mordred | I mean - why do we need obj_gen_to_dict - obj_list_to_dict is the same code | 13:41 |
*** zz_dimtruck is now known as dimtruck | 13:41 | |
Shrews | oh, i haven't actually reviewed the new code... i should do that now i suppose | 13:41 |
*** sc68cal has joined #openstack-infra | 13:42 | |
mordred | Shrews: yes - I tihnk heat in devstack works well | 13:42 |
*** fawadkhaliq has joined #openstack-infra | 13:42 | |
*** ildikov has quit IRC | 13:43 | |
tristanC | Shrews: well you actually asked for obj_gen_to_dict... note that first patchset of https://review.openstack.org/#/c/276045/1 did this just for the stack_list method | 13:43 |
Shrews | then that is a thing we should do | 13:43 |
*** ihrachys has quit IRC | 13:43 | |
Shrews | tristanC: i probably did. been weeks since i looked at it | 13:43 |
* Shrews makes more coffee first | 13:44 | |
*** fhubik is now known as fhubik_brb | 13:45 | |
*** fhubik_brb is now known as fhubik | 13:46 | |
*** jed56 has joined #openstack-infra | 13:46 | |
*** amitgandhinz has quit IRC | 13:47 | |
*** amitgandhinz has joined #openstack-infra | 13:47 | |
*** sdake_ has quit IRC | 13:48 | |
*** gokrokve has joined #openstack-infra | 13:49 | |
*** mase_x200 has quit IRC | 13:49 | |
*** thorst has quit IRC | 13:52 | |
*** eharney has joined #openstack-infra | 13:52 | |
*** gokrokve has quit IRC | 13:53 | |
*** piet has joined #openstack-infra | 13:53 | |
*** lucas-hungry is now known as lucasagomes | 13:53 | |
*** rvasilets_ has joined #openstack-infra | 13:54 | |
*** mase_x200 has joined #openstack-infra | 13:56 | |
mordred | tristanC: stack looks generally good- other than my disagreement with Shrews over obj_list vs. obj_gen :) | 13:58 |
*** akshai has joined #openstack-infra | 13:59 | |
*** hamzy has quit IRC | 13:59 | |
*** hamzy has joined #openstack-infra | 14:00 | |
tristanC | mordred: sweet, then I can look into adding stack snapshot too! | 14:00 |
*** rhallisey has joined #openstack-infra | 14:00 | |
mordred | tristanC: why don't you go ahead and send a PR to ansible/ansible-modules-extra with your ansible module - and then note that it's going to need a new shade release | 14:01 |
*** dizquierdo has quit IRC | 14:01 | |
tristanC | mordred: well there's already 2 PR for an os_stack module in ansible, my version is just to validate shade interface | 14:03 |
tristanC | I could submit it if matbu doesn't update his PR | 14:04 |
mordred | ah - ok | 14:04 |
mordred | I suck then - I'll go dig those up | 14:04 |
*** mingyu has quit IRC | 14:05 | |
*** dimtruck is now known as zz_dimtruck | 14:06 | |
matbu | Hi Shrews mordred tristanC | 14:07 |
*** mingyu has joined #openstack-infra | 14:07 | |
*** weshay_xchat is now known as weshay | 14:07 | |
matbu | mordred: tristanC what parameter is missing to the os_heat_module ? | 14:08 |
matbu | mordred: tristanC I will update the PR regarding the needs | 14:08 |
*** nt has joined #openstack-infra | 14:08 | |
openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added *-npm-publish-draft job https://review.openstack.org/277996 | 14:08 |
krotscheck | AJaeger: Answered your question on ^^ | 14:08 |
*** piet has quit IRC | 14:09 | |
matbu | Shrews: mordred for the review here : https://review.openstack.org/#/c/254337/ gen_to_dict was required, because the heat client return a generator of heat stack object | 14:09 |
*** piet has joined #openstack-infra | 14:09 | |
*** Daisy has joined #openstack-infra | 14:10 | |
matbu | Shrews: mordred check my comment on patch set 11 | 14:10 |
*** isaacb has joined #openstack-infra | 14:10 | |
mordred | matbu: yes - but obj_list_to_dict is the same logic as obj_gen_to_dict because a generator in a for loop is the same as a list | 14:12 |
*** mtanino has joined #openstack-infra | 14:12 | |
mordred | so I tihnk the original error in 11 was not running obj_*_to_dict before doing the normalize | 14:12 |
mordred | now that the sequencing is correct, we do not need a second copy of the obj_list_to_dict function - we just need it to be called in the right place, which is now is | 14:13 |
mordred | or? | 14:13 |
matbu | yep | 14:14 |
*** dizquierdo has joined #openstack-infra | 14:14 | |
Shrews | mordred: matbu: yes, we don't need obj_gen_to_dict since it is identical to obj_list_to_dict, but we DO need to make sure that a generator is not passed to obj_to_dict() since that will make things go boom | 14:14 |
mordred | ++ | 14:14 |
*** Daisy has quit IRC | 14:14 | |
matbu | and keep the change for handle the generator case | 14:15 |
matbu | in wait() | 14:15 |
Shrews | which i *think* was my original point way back when, but i may not have expressed myself clearly | 14:15 |
*** julim has joined #openstack-infra | 14:15 | |
*** hashar has joined #openstack-infra | 14:15 | |
Shrews | yeah, the change in wait() needs to stay (except use obj_list_to_dict) | 14:15 |
openstackgerrit | Craig Vyvial proposed openstack-infra/project-config: run trove experimental run scenario tests https://review.openstack.org/278095 | 14:16 |
*** zz_dimtruck is now known as dimtruck | 14:16 | |
phschwartz | When nodepool is building an image with dib what is injecting /home/jenkins/.pydistutils.conf ? | 14:18 |
*** esikachev has quit IRC | 14:19 | |
*** sabeen has joined #openstack-infra | 14:19 | |
*** eharney has quit IRC | 14:21 | |
*** esikachev has joined #openstack-infra | 14:21 | |
*** mriedem has joined #openstack-infra | 14:22 | |
*** sabeen3 has joined #openstack-infra | 14:22 | |
*** jordanP has joined #openstack-infra | 14:22 | |
mordred | phschwartz: puppet | 14:23 |
phschwartz | mordred: I had that feeling, recent change? last 2 months? It use to be handled by the configure_mirror.sh script for nodepool | 14:23 |
*** sabeen has quit IRC | 14:24 | |
*** tiswanso has joined #openstack-infra | 14:24 | |
mordred | phschwartz: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/slave_common.pp#n46 | 14:24 |
mordred | phschwartz: when it is building an image, it's this ^^ | 14:24 |
mordred | phschwartz: configure_mirror is run on node creation time | 14:25 |
*** eharney has joined #openstack-infra | 14:25 | |
mordred | two different things | 14:25 |
Shrews | jeblair: fyi, getting this exception everytime i attempt to see the diff of a change in gertty (HEAD at fbb9969): http://paste.openstack.org/show/486564/ | 14:25 |
*** krtaylor has quit IRC | 14:25 | |
mordred | phschwartz: image build needs to have a mirror associated with the location the image is being built in (for us, always rackspace dfw) | 14:25 |
mordred | phschwartz: but when you spin up nodes, it needs to know the mirror for the location the node is running in | 14:26 |
mordred | phschwartz: it can likely be refactored/reorganized once we don't do snapshot images anymore | 14:26 |
*** _amrith_ is now known as amrith | 14:27 | |
mordred | but for now, some of the things happen in more than one place because history and because it's not worth refactoring until the snapshots go away | 14:27 |
*** annegentle_ has quit IRC | 14:27 | |
*** links has quit IRC | 14:27 | |
phschwartz | mordred: I have to figure a way around that as for our images that are being built we don't want to use a pypi mirror (and the pypi.dfw.o.o is not accessiable to us so it causes a pip break) | 14:28 |
*** hdd has quit IRC | 14:29 | |
mordred | phschwartz: well - pypi.dfw.o.o isn't accessible to anybody - https://review.openstack.org/#/c/278328/ is needed | 14:29 |
*** changbl has joined #openstack-infra | 14:29 | |
*** mase_x200 has quit IRC | 14:31 | |
mordred | phschwartz: but also, you shouldn't be using the puppet manifests in system-config anyway - that's the config for this instance of infra | 14:31 |
mordred | asselin: ^^ what's the story for this? | 14:31 |
phschwartz | mordred: I didn't use them, or at least tell it to. I am trying to track down what pulled it in | 14:32 |
*** ildikov has joined #openstack-infra | 14:32 | |
*** jcoufal has joined #openstack-infra | 14:33 | |
*** akshai has quit IRC | 14:34 | |
*** chaitu has quit IRC | 14:34 | |
*** slogan621 has quit IRC | 14:34 | |
mordred | nod | 14:36 |
*** xyang1 has joined #openstack-infra | 14:37 | |
anteaya | pleia2: nice list, isn't wikimedia part of that group as well? | 14:38 |
*** sdake has joined #openstack-infra | 14:38 | |
*** dimtruck is now known as zz_dimtruck | 14:38 | |
anteaya | tonyb: yeah anything with bleeding edge in the name is soon outdated, as what ever you are doing is bleeding edge for a limited period of time | 14:38 |
*** bryan_att has joined #openstack-infra | 14:39 | |
*** akshai has joined #openstack-infra | 14:39 | |
*** mrmartin has quit IRC | 14:39 | |
pabelanger | morning | 14:40 |
*** w_ has joined #openstack-infra | 14:40 | |
pabelanger | mordred: so, about to dive into the does for an official RPM mirror in centos / fedora. Any reason not to start with that software for our AFS mirrors? | 14:41 |
*** Swami has joined #openstack-infra | 14:41 | |
*** loaf has quit IRC | 14:43 | |
fungi | https://git-man-page-generator.lokaltog.net/ | 14:43 |
anteaya | maishsk: this may help if you are in channel again: http://anteaya.info/blog/2013/03/25/please-rebase-your-change-and-upload-a-new-patchset/ | 14:45 |
mordred | pabelanger: we should absolutely start with that on our AFS mirrors | 14:47 |
openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for tempest verify-config cliff bug 1543841 https://review.openstack.org/278409 | 14:48 |
openstack | bug 1543841 in devstack "Invocation error: tempest verify-config: error: unrecognized arguments: -uro ../../../../tmp/tmp.FR5OHabb3Y" [Undecided,In progress] https://launchpad.net/bugs/1543841 - Assigned to Matthew Treinish (treinish) | 14:48 |
mordred | pabelanger: I think you should be able to cargo-cult the ubuntu mirror code - just replace the reprepro calls with a call to rsync | 14:48 |
*** maishsk has joined #openstack-infra | 14:48 | |
mordred | pabelanger: and then once you've rsync'd, I'm not sure if there is a 'good' way to check a yum repo for consistency - but if there is, that would be a good thing to run where we're running reprepro check | 14:49 |
pabelanger | mordred: Ya, that's seems to be the tooling of choice for yum (rsync) | 14:49 |
mordred | pabelanger: finally - do yum repos purge old packages? | 14:49 |
*** daemontool_ has quit IRC | 14:49 | |
*** gokrokve has joined #openstack-infra | 14:50 | |
*** daemontool_ has joined #openstack-infra | 14:50 | |
*** abregman has quit IRC | 14:50 | |
pabelanger | mordred: Ya, I think repomanage has some logic built in for that | 14:50 |
*** jpeeler has joined #openstack-infra | 14:50 | |
mordred | pabelanger: k. so - one of the things we did with ubuntu is that we record the files to be purged when we do a mirror run | 14:50 |
mordred | pabelanger: but then we do not purge them until the following run | 14:50 |
openstackgerrit | Merged openstack-infra/system-config: Update mirror to use in easy_install https://review.openstack.org/278328 | 14:50 |
mordred | pabelanger: that way if someone has fetched an index, then we do a mirror release, then they try to fetch the file pointed to in the index - they do not get an error | 14:51 |
pabelanger | mordred: sure. I'll look into the review and see what is happening | 14:51 |
mordred | (unless they wait 2 hours between fetching an index and fetching the file) | 14:51 |
mordred | pabelanger: woot! | 14:51 |
mordred | pabelanger: I'm totally happy to help as much as you need - super excited to get centos/fedora mirrors going | 14:51 |
*** daemontool__ has joined #openstack-infra | 14:51 | |
openstackgerrit | Merged openstack-infra/release-tools: Use yes/no for pypi flag https://review.openstack.org/278167 | 14:52 |
pabelanger | mordred: Ya, I expect I'll be pinging you for reviews and questions | 14:52 |
pabelanger | or any other infra-root | 14:52 |
*** achanda has joined #openstack-infra | 14:52 | |
*** daemontool__ is now known as daemontool | 14:52 | |
openstackgerrit | Merged openstack-infra/system-config: Show toggle CI button for Gerrit URLs with patch set ranges https://review.openstack.org/261110 | 14:52 |
*** esker has quit IRC | 14:52 | |
*** Daisy has joined #openstack-infra | 14:53 | |
dolphm | are all gerrit usernames directly derived from launchpad IDs? | 14:53 |
dolphm | gerrit usernames / gerrit IDs | 14:53 |
*** alivigni has joined #openstack-infra | 14:53 | |
fungi | dolphm: they used to be, but lp stopped providing usernames via openid about a year ago so since then they're chosen at account creation time in gerrit | 14:54 |
*** [1]Thelo has joined #openstack-infra | 14:54 | |
fungi | dolphm: at this point the only linkage we have there is between gerrit accounts and login.launchpad.net openid urls | 14:55 |
dolphm | fungi: ah, that explains it | 14:55 |
*** daemontool_ has quit IRC | 14:55 | |
*** w_ has quit IRC | 14:55 | |
fungi | at least the only linkage we can reasonably trust | 14:55 |
anteaya | dolphm: on first sign in, the gerrit username is blank and has to be created | 14:55 |
*** annegentle_ has joined #openstack-infra | 14:55 | |
*** pradk has joined #openstack-infra | 14:55 | |
fungi | also, once chosen, gerrit does not allow you to change the username either | 14:56 |
dolphm | i assume the stackalytics data is the most reliable public data linking inconsistently named accounts? https://github.com/openstack/stackalytics/blob/master/etc/default_data.json | 14:56 |
*** hexhaxtron_ has joined #openstack-infra | 14:56 | |
*** gokrokve has quit IRC | 14:56 | |
*** Thelo has quit IRC | 14:56 | |
*** [1]Thelo is now known as Thelo | 14:56 | |
anteaya | dolphm: I wouldn't assume that | 14:56 |
fungi | dolphm: depends on what you mean by "data" | 14:56 |
*** w_ has joined #openstack-infra | 14:57 | |
anteaya | dolphm: you can query gerrit | 14:57 |
dolphm | lol | 14:57 |
fungi | to reach code contributors, i directly query gerrit's rest api | 14:57 |
*** achanda has quit IRC | 14:57 | |
fungi | though at the moment you can only see the preferred e-mail address of users in gerrit without being a gerrit admin (there's a patch upstream to fix that) | 14:57 |
dolphm | i'm looking to identify launchpad accounts (which i thought i could assume was 1:1) based on gerrit accounts (which i have) | 14:57 |
*** otherwiseguy has joined #openstack-infra | 14:58 | |
*** gokrokve has joined #openstack-infra | 14:58 | |
fungi | ahh, yes to actually identify lp accounts you'd need access to the openid urls tracked in gerrit's database, and i don't think it exposes those via the rest api | 14:58 |
dolphm | so, stackalytics for me then :P | 14:58 |
fungi | though if you had them, lp's api does provide an openid to lp account lookup method | 14:59 |
*** akshai has quit IRC | 14:59 | |
openstackgerrit | Sean M. Collins proposed openstack-infra/devstack-gate: [WIP] Switch to new Neutron devstack https://review.openstack.org/278415 | 14:59 |
*** maishsk has quit IRC | 14:59 | |
fungi | added at our request as well, because we use it in our bug update hooks to figure out how to reassign bugs in progress | 14:59 |
*** aovchinnikov has quit IRC | 14:59 | |
fungi | in theory this will become a much easier problem once we switch gerrit to identify users via openstackid.org | 15:00 |
*** akshai has joined #openstack-infra | 15:01 | |
openstackgerrit | Omer Anson proposed openstack/requirements: Add scapy and python-pytun https://review.openstack.org/277893 | 15:01 |
*** hexhaxtron_ has left #openstack-infra | 15:02 | |
*** fhubik is now known as fhubik_brb | 15:03 | |
*** annegentle_ has quit IRC | 15:03 | |
*** BobBall1 is now known as BobBall | 15:03 | |
mordred | dolphm: I agree - although the stackalytics data is not perfect, it's likely the best thing you have available to you | 15:03 |
openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Remove query for bug 1524418 https://review.openstack.org/278418 | 15:04 |
openstack | bug 1524418 in oslo.messaging "gate-grenade-dsvm-multinode fails with "AttributeError: 'LocalManager' object has no attribute 'l3driver'"" [Undecided,Fix released] https://launchpad.net/bugs/1524418 - Assigned to Mehdi Abaakouk (sileht) | 15:04 |
fungi | unless someone wanted to write a periodic etl process which created a gerrit->lp mapping we could publish | 15:05 |
dolphm | fungi: what about a way to go from OpenID to gerrit username? | 15:06 |
AJaeger | anteaya: https://review.openstack.org/#/c/277996/3/zuul/layout.yaml adds a voting job only to check queue. The reasons given satisfy me but I would ask krotscheck to update the commit message to add it there. Could you look at it as well, please? | 15:06 |
*** Daisy has quit IRC | 15:07 | |
*** deva_ has joined #openstack-infra | 15:08 | |
*** annegentle_ has joined #openstack-infra | 15:08 | |
*** esp has joined #openstack-infra | 15:09 | |
* anteaya looks | 15:09 | |
*** vgridnev has quit IRC | 15:09 | |
*** NobodyCa1 has joined #openstack-infra | 15:09 | |
*** ccrouch has joined #openstack-infra | 15:09 | |
*** mtanino has quit IRC | 15:09 | |
AJaeger | dougwig: could you review https://review.openstack.org/#/c/278051/ , please? | 15:09 |
*** otherwiseguy has quit IRC | 15:10 | |
*** vgridnev has joined #openstack-infra | 15:11 | |
asselin | mordred, phschwartz hi, what's up? | 15:11 |
*** nmagnezi has quit IRC | 15:11 | |
mordred | asselin: I thought phschwartz might need help in stopping to use system-config in his CI | 15:11 |
mordred | asselin: but he may have it now | 15:11 |
phschwartz | asselin: yeah, I am looking through it right now. I pulled in system-config somewhere for setting up the nodepool nodes | 15:12 |
openstackgerrit | Sean M. Collins proposed openstack-infra/devstack-gate: [WIP] Switch to new Neutron devstack https://review.openstack.org/278415 | 15:12 |
anteaya | AJaeger: I agree, having a draft available makes sense pre merge, thank you, the commit message is nice and clear | 15:12 |
*** esp has quit IRC | 15:13 | |
asselin | mordred, phschwartz ok I see...right now creating the images in in project-config which pulls in system-config | 15:13 |
AJaeger | anteaya: you approved without a second +2? | 15:13 |
jeblair | Shrews: yikes! what gertty version/git-sha, what change, and python2 or python3? | 15:13 |
Shrews | jeblair: sha in the comment | 15:13 |
phschwartz | asselin: that about wraps it up | 15:13 |
AJaeger | anteaya: let me quickly add my +2 ;) | 15:13 |
anteaya | AJaeger: I did so, sorry I thought your +2 was there | 15:14 |
Shrews | jeblair: 2.7.10 | 15:14 |
asselin | mordred, phschwartz we don't have a way yet to make images for devstack in common-ci w/o reusing infra's setup | 15:14 |
anteaya | AJaeger: my apologies | 15:14 |
*** zz_dimtruck is now known as dimtruck | 15:14 | |
phschwartz | asselin: which is why I think I did it that way. | 15:14 |
phschwartz | asselin: I might just add to my nodepool scripts an rm of the .pydistutils.cfg | 15:14 |
*** NobodyCa1 has quit IRC | 15:14 | |
Shrews | jeblair: apologies... using a venv... 3.4.3 | 15:14 |
*** deva_ has quit IRC | 15:14 | |
phschwartz | that will most likely solve it all | 15:14 |
AJaeger | anteaya: no worries, was just surprised... | 15:14 |
AJaeger | anteaya: now it's there | 15:14 |
anteaya | AJaeger: yes, good call, I don't do that | 15:14 |
anteaya | AJaeger: thanks for speaking up | 15:15 |
anteaya | thank you, sorry about that | 15:15 |
asselin | mordred, phschwartz so you end up needing patches like this too: https://review.openstack.org/#/c/217914/ | 15:15 |
Shrews | jeblair: so far, every gerrit change i've tried to get the diff causes it | 15:15 |
*** burgerk has joined #openstack-infra | 15:15 | |
openstackgerrit | Bryan Jones proposed openstack/requirements: Bump python-openstackclient version to 2.1.0 https://review.openstack.org/278428 | 15:16 |
phschwartz | asselin: yes, that seems to be what is needed. | 15:16 |
jeblair | Shrews: what's the gitpython version? | 15:16 |
Shrews | jeblair: 1.0.1 | 15:17 |
Shrews | jeblair: pip freeze output: http://paste.openstack.org/show/486574/ | 15:17 |
*** vgridnev has quit IRC | 15:17 | |
*** rbrndt_ has joined #openstack-infra | 15:18 | |
asselin | phschwartz, mordred so while we've separated the actual setup of the ci system by using common-ci, we still do some copy and paste-modify e.g. http://git.openstack.org/cgit/openstack-infra/project-config-example/tree/README.md#n3 | 15:18 |
*** gokrokve has quit IRC | 15:19 | |
*** sigmavirus24_awa is now known as sigmavirus24 | 15:19 | |
*** dkranz has joined #openstack-infra | 15:20 | |
*** maishsk has joined #openstack-infra | 15:20 | |
asselin | and here: http://git.openstack.org/cgit/openstack-infra/project-config-example/tree/README.md#n41 | 15:20 |
*** thorst_ has joined #openstack-infra | 15:21 | |
openstackgerrit | Ryan Rossiter proposed openstack-infra/release-tools: Add more emotion words https://review.openstack.org/278435 | 15:22 |
openstackgerrit | Kyle Mestery proposed openstack-infra/project-config: networking-ovn: Add an install job for networking-ovn + kuryr https://review.openstack.org/278101 | 15:22 |
fungi | dolphm: well, if we had some service publishing the mapping, it would be a two-way mapping. but ideally the gerrit rest api should be extended to expose methods for that | 15:22 |
*** woodster_ has joined #openstack-infra | 15:23 | |
*** thorst__ has joined #openstack-infra | 15:23 | |
*** jaosorior has joined #openstack-infra | 15:24 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Remove test workaround for extra_dhcp_opts https://review.openstack.org/278438 | 15:24 |
jeblair | Shrews: huh, so i kind of thought virtualenv-3.4 would make a python3.4 virtualenv | 15:25 |
jeblair | apparently i was mistaken about that | 15:25 |
phschwartz | asselin: mordred: maybe we should work to get that review merged. There are a bunch of +1's and +2's whats holding it from getting a +1 to workflow? | 15:25 |
jeblair | Shrews: so it's quite possible my 3.4 testing is not nearly as effective as i thought it was | 15:25 |
*** thorst_ has quit IRC | 15:25 | |
asselin | phschwartz, I can rebase it...it was waiting for some baby-sitting b/c it affects image builds. | 15:26 |
Shrews | jeblair: yes, it is 3.4.3. i was mistaken about the python version initially | 15:26 |
openstackgerrit | Brant Knudson proposed openstack-infra/project-config: Support stable requirements https://review.openstack.org/278056 | 15:26 |
*** w__ has joined #openstack-infra | 15:26 | |
openstackgerrit | Merged openstack-infra/project-config: Added *-npm-publish-draft job https://review.openstack.org/277996 | 15:26 |
*** thorst_ has joined #openstack-infra | 15:26 | |
jeblair | Shrews: do you know how i should make a 3.4 virtualenv? | 15:26 |
fungi | jeblair: i just do virtualenv -p python3.4 | 15:26 |
phschwartz | asselin: if you don't have time to do the rebase and baby sit, I can as I need this to fix our downstream | 15:26 |
jeblair | fungi: ah, ok i'll try that | 15:27 |
*** jsavak has quit IRC | 15:27 | |
fungi | -p PYTHON_EXE, --python=PYTHON_EXE | 15:27 |
*** thorst__ has quit IRC | 15:27 | |
jeblair | okay that works. wth is virtualenv-3.4 ? <mutter> | 15:27 |
*** w_ has quit IRC | 15:28 | |
fungi | no clue. haven't used that | 15:28 |
Shrews | jeblair: i think all i did was 'tox -evenv' and alias gertty to the one in that env | 15:28 |
jeblair | it's "fool's virtualenv" | 15:28 |
asselin | phschwartz, I worked around it by adding an element to fix the pip configuratino after puppet finishes | 15:28 |
fungi | hah | 15:28 |
fungi | Shrews: oh, good idea. using aliases probably makes more sense than my linkfarm in ~/bin | 15:29 |
Shrews | jeblair: perhaps i should rebuild that env? /me tries | 15:30 |
phschwartz | asselin: hmm, that is a good point. I can probably do it that way for now | 15:30 |
jeblair | Shrews: yep, i get that error in 3.4. so the short answer is, it should work in 2.7. and i'll go fix my 3.4 fixes better now that i'm actually running 3.4. | 15:30 |
Shrews | jeblair: nope. same thing | 15:30 |
*** regXboi has joined #openstack-infra | 15:30 | |
*** EricGonczer_ has joined #openstack-infra | 15:30 | |
Shrews | jeblair: ++ | 15:30 |
fungi | Shrews: what platform are you on that the default python is 3.4? | 15:31 |
*** thorst_ has quit IRC | 15:31 | |
*** jsavak has joined #openstack-infra | 15:31 | |
Shrews | fungi: wily, but the system default is still 2.7. not sure why tox uses 3.4 | 15:31 |
fungi | Shrews: that's weird | 15:32 |
*** EricGonc_ has joined #openstack-infra | 15:32 | |
fungi | Shrews: then again, my tox is actually ~/pyenvs/tox/bin/tox so its default python is the one i used to create its virtualenv | 15:32 |
*** rcernin has quit IRC | 15:33 | |
AJaeger | dims, dhellmann : Could you review https://review.openstack.org/#/c/278056 , please? It's another stable requirements fix | 15:33 |
fungi | in fact, my virtualenv is ~/pyenvs/virtualenv/bin/virtualenv | 15:33 |
*** vgridnev has joined #openstack-infra | 15:33 | |
fungi | i should start learning about pip --user or whatever it is | 15:34 |
*** thorst_ has joined #openstack-infra | 15:34 | |
*** e0ne has quit IRC | 15:34 | |
*** EricGonczer_ has quit IRC | 15:35 | |
*** e0ne has joined #openstack-infra | 15:35 | |
*** yamamoto has quit IRC | 15:35 | |
mordred | fungi: just run as root | 15:36 |
*** jaosorior has quit IRC | 15:36 | |
*** thorst_ has quit IRC | 15:38 | |
pabelanger | nibalizer: so, what our the changes of adding a testing hiera.yaml config file into system-config/tools? | 15:38 |
fungi | i have a root allergy | 15:38 |
*** krtaylor has joined #openstack-infra | 15:38 | |
pabelanger | for people how don't have access to the production one | 15:38 |
sdague | fungi: they make a cream for that | 15:38 |
*** mrmartin has joined #openstack-infra | 15:39 | |
fungi | i've been trying to treat it with more booze | 15:39 |
pabelanger | just removes an manual setup from a tester who want to spin up a node to write puppet code | 15:39 |
*** thorst_ has joined #openstack-infra | 15:39 | |
pabelanger | nibalizer: eg: udo puppet apply --modulepath=/etc/puppet/modules:modules manifests/site.pp --certname mirror.test.openstack.org --hiera_config tools/hiera.yaml | 15:39 |
pabelanger | nibalizer: otherwise you get: Error: Could not find data item elasticsearch_nodes in any Hiera data file and no default supplied at /home/ubuntu/system-config/manifests/site.pp:8 on node mirror.test.openstack.org | 15:39 |
*** mrmartin has quit IRC | 15:40 | |
*** infra-re_ has quit IRC | 15:42 | |
*** jaosorior has joined #openstack-infra | 15:42 | |
*** gokrokve has joined #openstack-infra | 15:43 | |
AJaeger | mordred, jeblair could you review system-config file ./modules/openstack_project/templates/wheel_mirror/known_hosts.erb, please? That looks very outdated. Can we just remove with new mirrors now? | 15:43 |
*** thorst_ has quit IRC | 15:44 | |
AJaeger | lifeless : Could you also review https://review.openstack.org/#/c/278056 , please? It's another stable requirements fix | 15:44 |
*** vgridnev has quit IRC | 15:45 | |
*** vgridnev has joined #openstack-infra | 15:45 | |
*** esikachev has quit IRC | 15:46 | |
*** piet has quit IRC | 15:46 | |
*** gokrokve has quit IRC | 15:47 | |
openstackgerrit | Mark Vanderwiel proposed openstack-infra/project-config: Adding integration test support for lbaas v2 dashboard https://review.openstack.org/275394 | 15:47 |
*** otherwiseguy has joined #openstack-infra | 15:48 | |
*** dizquierdo has quit IRC | 15:49 | |
openstackgerrit | Mark Vanderwiel proposed openstack-infra/project-config: Adding integration test support for app catalog horizon plugin https://review.openstack.org/276440 | 15:49 |
*** ihrachys_ is now known as ihrachys | 15:49 | |
*** Daisy has joined #openstack-infra | 15:50 | |
*** max_lobur has joined #openstack-infra | 15:52 | |
*** maishsk has quit IRC | 15:53 | |
*** yamamoto has joined #openstack-infra | 15:54 | |
*** Daisy has quit IRC | 15:55 | |
*** mtanino has joined #openstack-infra | 15:56 | |
*** piet has joined #openstack-infra | 15:56 | |
openstackgerrit | James E. Blair proposed openstack/gertty: Add support for conflicts-with https://review.openstack.org/276998 | 15:56 |
openstackgerrit | James E. Blair proposed openstack/gertty: Improve handling of abandoned related changes https://review.openstack.org/276997 | 15:56 |
openstackgerrit | James E. Blair proposed openstack/gertty: Make sorting commands use two two keys https://review.openstack.org/277476 | 15:56 |
openstackgerrit | James E. Blair proposed openstack/gertty: Fix return values in handleCommands in project_list https://review.openstack.org/277477 | 15:56 |
openstackgerrit | James E. Blair proposed openstack/gertty: Add support for last_seen https://review.openstack.org/277474 | 15:56 |
openstackgerrit | James E. Blair proposed openstack/gertty: Add support for customized dashboard sorting https://review.openstack.org/277475 | 15:56 |
openstackgerrit | James E. Blair proposed openstack/gertty: Add debug-sync option https://review.openstack.org/277473 | 15:56 |
openstackgerrit | James E. Blair proposed openstack/gertty: Fix unicode regression regressions https://review.openstack.org/278472 | 15:56 |
jeblair | Shrews: ^ 278472 should fix it | 15:57 |
*** Sukhdev has joined #openstack-infra | 15:57 | |
jeblair | Shrews: despite appearances, that's actually the bottom of that stack | 15:57 |
jeblair | Shrews: if you _also_ want to test out the new stuff i've been hacking on, feel free to go further up | 15:57 |
jeblair | Shrews: but it rebased them all on it so you don't have to | 15:57 |
yolanda | back... so AJaeger, modred, is the problem with easy_install fixed now? or we will need to rebuild images for it? | 15:58 |
mordred | yolanda: I am not sure if it landed before this morning's image builds or not | 15:58 |
AJaeger | yolanda: patch merged. I'm not sure whether we need to dosomething for the proposal slaves | 15:58 |
mordred | oh - proposal slaves | 15:58 |
mordred | no - those don't need images | 15:58 |
mordred | those are normal servers | 15:59 |
jeblair | Shrews: i have two test changes i use to test unicode issues -- they are https://review.openstack.org/275862 and https://review.openstack.org/119302 . 278472 appears to work with both on 2.7 and 3.4, as well as a random non-unicodeish change. | 15:59 |
yolanda | mordred, is that only configuration for proposal slaves? | 15:59 |
*** thorst_ has joined #openstack-infra | 15:59 | |
*** jpr has quit IRC | 15:59 | |
mordred | yolanda: we update pydistutils.cfg in configure-mirror.sh when we boot nodes, so nodes themselves should be fine | 15:59 |
yolanda | nice | 16:00 |
Shrews | jeblair: cool. will test it out | 16:00 |
openstackgerrit | James E. Blair proposed openstack-infra/system-config: Remove wheel_mirror known hosts https://review.openstack.org/278473 | 16:00 |
jeblair | AJaeger: ^ indeed, thanks. krotscheck, fungi, mordred: ^ | 16:00 |
*** rcernin has joined #openstack-infra | 16:01 | |
*** fhubik_brb is now known as fhubik | 16:01 | |
*** jsavak has quit IRC | 16:01 | |
*** jswarren_ has joined #openstack-infra | 16:01 | |
*** salv-orlando has quit IRC | 16:01 | |
Shrews | jeblair: those unicode test reviews you posted don't seem to be, um, relevant? | 16:01 |
jeblair | Shrews: they have utf8 encoded chars in them | 16:02 |
Shrews | oh | 16:02 |
jeblair | Shrews: though... possibly not in the diffs... maybe only in the author fields? | 16:02 |
jeblair | we may need to keep an eye out for actual diffs. | 16:03 |
*** tcammann has joined #openstack-infra | 16:04 | |
*** esp has joined #openstack-infra | 16:04 | |
*** samueldmq1 has joined #openstack-infra | 16:04 | |
*** gokrokve has joined #openstack-infra | 16:04 | |
*** NobodyCa1 has joined #openstack-infra | 16:05 | |
Shrews | jeblair: yay, it worky! thx | 16:05 |
*** kmartin has joined #openstack-infra | 16:05 | |
jeblair | Shrews: cool -- also, i found a change with a utf8 char in the diff itself, and it works in 27 and 34 ( https://review.openstack.org/133550 ) | 16:05 |
*** Jeffrey4l has quit IRC | 16:05 | |
*** deva_ has joined #openstack-infra | 16:06 | |
openstackgerrit | James E. Blair proposed openstack/gertty: Add another utf8 test change comment https://review.openstack.org/278480 | 16:06 |
*** lmiccini is now known as lmiccini|gone | 16:07 | |
Shrews | jeblair: the 133550 diff opens fine for me. no crash | 16:07 |
*** fhubik has quit IRC | 16:08 | |
*** jaosorior_ has joined #openstack-infra | 16:09 | |
*** hdd has joined #openstack-infra | 16:09 | |
*** tcammann has quit IRC | 16:09 | |
openstackgerrit | Carl Baldwin proposed openstack-infra/irc-meetings: A meeting for discussing and coordinating routed networks https://review.openstack.org/278114 | 16:09 |
*** esp has quit IRC | 16:11 | |
*** deva_ has quit IRC | 16:11 | |
*** NobodyCa1 has quit IRC | 16:11 | |
*** samueldmq1 has quit IRC | 16:11 | |
*** rajinir has joined #openstack-infra | 16:11 | |
openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Setup rabbit user/pass for keystone https://review.openstack.org/278482 | 16:11 |
*** esker has joined #openstack-infra | 16:12 | |
*** jsavak has joined #openstack-infra | 16:13 | |
openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Send keystone_rabbit_password parameter https://review.openstack.org/278485 | 16:15 |
daemontool | anyone available for +A https://review.openstack.org/#/c/278323/ ? thanks | 16:15 |
*** esker has quit IRC | 16:16 | |
*** arthus has quit IRC | 16:17 | |
*** esp has joined #openstack-infra | 16:17 | |
*** esker has joined #openstack-infra | 16:17 | |
*** tcammann has joined #openstack-infra | 16:18 | |
*** slogan621 has joined #openstack-infra | 16:18 | |
*** NobodyCa1 has joined #openstack-infra | 16:19 | |
anteaya | fungi clarkb jeblair is the only issue we have had in our tooling with 4-byte unicode etherpad? | 16:20 |
*** [HeOS] has joined #openstack-infra | 16:21 | |
anteaya | I ask because cinder is discussing supporting 4-byte unicode for naming their things | 16:21 |
openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for tempest verify-config cliff bug 1543841 https://review.openstack.org/278409 | 16:21 |
openstack | bug 1543841 in devstack "Invocation error: tempest verify-config: error: unrecognized arguments: -uro ../../../../tmp/tmp.FR5OHabb3Y" [Undecided,In progress] https://launchpad.net/bugs/1543841 - Assigned to Matthew Treinish (treinish) | 16:21 |
*** weshay has quit IRC | 16:21 | |
clarkb | anteaya: that issue shoudlve been corrected not long after the vancouver summit | 16:21 |
*** weshay_xchat has joined #openstack-infra | 16:21 | |
*** cbader has quit IRC | 16:22 | |
anteaya | clarkb: right with etherpad | 16:22 |
anteaya | I'm wondering if that has been an issue with any of our other tools | 16:22 |
slogan621 | Andreas: thanks again for the +2 | 16:22 |
anteaya | they are discussing at their meeting underway in -meeting | 16:22 |
*** Swami_ has joined #openstack-infra | 16:22 | |
*** annegentle_ has quit IRC | 16:22 | |
slogan621 | anteaya: can I get a review from you on https://review.openstack.org/#/c/275873/ please? | 16:23 |
*** weshay_xchat has quit IRC | 16:23 | |
anteaya | slogan621: I'm in a meeting, perhaps afterwards | 16:23 |
*** weshay has joined #openstack-infra | 16:23 | |
clarkb | anteaya: not that I have seen I think other tools generally check and are more cautious wheeeas etherpad blindly wrote to the db | 16:23 |
slogan621 | anteaya: thanks | 16:23 |
*** NobodyCa1 has quit IRC | 16:23 | |
*** otherwiseguy has quit IRC | 16:24 | |
anteaya | clarkb: thank you | 16:24 |
*** HeOS has quit IRC | 16:24 | |
*** tcammann has quit IRC | 16:24 | |
clarkb | daemontool: that change doesnt say why it is being made, only what it does (which is discoverable in the diff) | 16:24 |
*** rcernin has quit IRC | 16:24 | |
*** esp has quit IRC | 16:24 | |
openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: import release-test repository https://review.openstack.org/278495 | 16:24 |
openstackgerrit | Carl Baldwin proposed openstack-infra/irc-meetings: A meeting for discussing and coordinating routed networks https://review.openstack.org/278114 | 16:25 |
daemontool | clarkb, ok, I'm adding more info in the commit message, ty | 16:25 |
*** placko_ has quit IRC | 16:26 | |
daemontool | you already make the point yestarday about this | 16:26 |
daemontool | s/make/made/ | 16:26 |
*** otherwiseguy has joined #openstack-infra | 16:26 | |
pabelanger | mordred: so, just to confirm, we should only need os and updates repos for centos / fedora right? | 16:26 |
pabelanger | I don't think we need to mirror epel7 | 16:26 |
*** placko_ has joined #openstack-infra | 16:27 | |
clarkb | we use epel | 16:27 |
pabelanger | oh | 16:27 |
pabelanger | okay then | 16:27 |
*** Swami has quit IRC | 16:27 | |
clarkb | and the rdo repo | 16:27 |
*** harlowja_at_home has joined #openstack-infra | 16:27 | |
*** annegentle_ has joined #openstack-infra | 16:28 | |
fungi | yeah, the main repo for centos is pretty useless on its own | 16:29 |
fungi | epel is a necessity | 16:29 |
fungi | so many of the packages we need are in epel | 16:29 |
pabelanger | okay, will start with epel7 then | 16:30 |
clarkb | and rdp has half the packages to use oprmstack | 16:30 |
clarkb | ovs and friends | 16:30 |
openstackgerrit | Fausto Marzi proposed openstack-infra/project-config: Set conditions for gate-freezer-devstack-dsvm on freezer https://review.openstack.org/278323 | 16:30 |
mordred | pabelanger: what clarkb and fungi said | 16:30 |
mnaser | is there a way of providing the nodepool config with the os-client-config vendor profile? | 16:31 |
*** tiswanso has quit IRC | 16:31 | |
zeih_ | hey, someone around of requirements-core? I have a question regarding requirements handling in stable branches. Is it recommended/usefull to backport PS to stable/liberty and stable/kilo of global-requirements repo if I have this stable branches in the projekt repo as well? | 16:31 |
mordred | pabelanger: I think we likely only want 2 afs volumes - mirror.centos and mirror.fedora - and then mirror all of the repos for each we want as part of a run/release cycle for each | 16:31 |
*** placko_ has quit IRC | 16:31 | |
mnaser | i have a customer that's setting up nodepool for CI and they're getting "service catalog is empty" related errors, i suspect it's the incorrect region-name/service-type/service-name | 16:31 |
*** abregman has joined #openstack-infra | 16:31 | |
mnaser | but ideally i'd like them to be using the os-client-config profile to make sure stuff always works | 16:31 |
pabelanger | mordred: right | 16:31 |
*** placko_ has joined #openstack-infra | 16:31 | |
anteaya | thank you | 16:31 |
clarkb | mnaser: yes have a clouds.yaml and set the cloud name in your nodepool provider config | 16:32 |
mnaser | clarkb: so the cloud name under providers is actually the name of the profile in os-client-config ? | 16:32 |
clarkb | mnaser: yes | 16:32 |
*** placko_ has quit IRC | 16:32 | |
mnaser | well that might be a documentation bug then i guess :-P | 16:32 |
clarkb | becaude it used to be called "cloud" in os client config | 16:32 |
*** boris-42 has quit IRC | 16:33 | |
clarkb | mnaser: I just confirmed it isnt documented | 16:34 |
clarkb | mordred ^ | 16:34 |
mnaser | i wonder if this can explain them getting: "The Service Catalog is empty" | 16:34 |
*** tiswanso has joined #openstack-infra | 16:34 | |
*** tiswanso has quit IRC | 16:35 | |
*** rvasilets_ has quit IRC | 16:35 | |
*** slogan621 has quit IRC | 16:35 | |
*** tiswanso has joined #openstack-infra | 16:35 | |
mordred | they should not need to set service-type/service-name unless something is really weird | 16:36 |
*** vgridnev has quit IRC | 16:36 | |
*** Guest15890 has quit IRC | 16:36 | |
*** jsavak has quit IRC | 16:36 | |
mordred | but if they have a clouds.yaml file it should be pretty easy to test that it's correct using python-openstackclient | 16:36 |
*** jgriffith_away is now known as jgriffith | 16:37 | |
mnaser | i have their clouds yaml file here infront of me, they don't have it specified so its a bit confusing | 16:37 |
mnaser | oh. | 16:37 |
mnaser | auth-url with /v2.0/ | 16:37 |
mnaser | that could be it | 16:37 |
*** mingyu has quit IRC | 16:38 | |
*** infra-red has joined #openstack-infra | 16:39 | |
jeblair | they shouldn't need auth-url, right? | 16:39 |
jeblair | if the profile is specified | 16:40 |
mnaser | if they use os-client-config I guess they don't | 16:40 |
mnaser | but in this caes, they have their own name for the provider and the rest of the stuff is defined | 16:40 |
mnaser | holy crap | 16:40 |
mnaser | !! | 16:40 |
openstack | mnaser: Error: "!" is not a valid command. | 16:40 |
*** doug-fish has quit IRC | 16:40 | |
mnaser | i just noticed looking at their config... "tennant-id: " | 16:40 |
*** doug-fish has joined #openstack-infra | 16:41 | |
*** bpokorny has joined #openstack-infra | 16:41 | |
*** harlowja_at_home has quit IRC | 16:41 | |
mordred | :) | 16:41 |
*** mingyu has joined #openstack-infra | 16:41 | |
mordred | mnaser: can you pastebin their clouds.yaml removing the password from it and send it to me and I can doublecheck anything else for you | 16:42 |
*** mingyu has left #openstack-infra | 16:42 | |
*** jsavak has joined #openstack-infra | 16:42 | |
mordred | but also - I'm a bit unhappy about that error message | 16:42 |
mordred | if they have tennant-id in there there SHOULD have been an error about missing required parameters | 16:42 |
*** harlowja_at_home has joined #openstack-infra | 16:42 | |
*** jtomasek_ has quit IRC | 16:42 | |
mnaser | mordred: sent via pm with extra stuff removed | 16:44 |
*** jpr has joined #openstack-infra | 16:44 | |
*** maishsk has joined #openstack-infra | 16:45 | |
*** doug-fish has quit IRC | 16:45 | |
*** MarkAtwood has joined #openstack-infra | 16:46 | |
fungi | zeih_: i'm pretty sure the general stable branch policy for requirements is to make no additions and no increases of minimum or maximum versions, but adding or lowering maximum versions may be acceptable if it fixes an issue with a new release of some dependency | 16:48 |
*** jpr has quit IRC | 16:49 | |
zeih_ | fungi: yes, thats right. | 16:50 |
*** salv-orlando has joined #openstack-infra | 16:50 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add a calendar directive https://review.openstack.org/278508 | 16:50 |
*** apoorvad has joined #openstack-infra | 16:51 | |
*** jswarren_ has quit IRC | 16:51 | |
*** doug-fish has joined #openstack-infra | 16:51 | |
*** jlanoux has quit IRC | 16:51 | |
*** asselin has quit IRC | 16:52 | |
*** marcusvrn_ has joined #openstack-infra | 16:53 | |
*** mikelk has quit IRC | 16:53 | |
openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Add element to bring up bridge on infra cloud https://review.openstack.org/276292 | 16:53 |
*** achanda has joined #openstack-infra | 16:55 | |
*** gyee has joined #openstack-infra | 16:55 | |
*** sigmavirus24 is now known as sigmavirus24_awa | 16:55 | |
*** sigmavirus24_awa is now known as sigmavirus24 | 16:56 | |
*** asselin has joined #openstack-infra | 16:57 | |
*** doug-fish has quit IRC | 16:57 | |
*** jaosorior_ has quit IRC | 16:58 | |
jeblair | the travel support committee uses google docs. :( i've asked if there's some other way i can contribute. | 16:58 |
*** annegentle_ has quit IRC | 16:59 | |
*** asselin__ has joined #openstack-infra | 16:59 | |
*** achanda has quit IRC | 16:59 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add a calendar directive https://review.openstack.org/278508 | 17:00 |
*** jaosorior_ has joined #openstack-infra | 17:00 | |
*** flepied1 has quit IRC | 17:00 | |
*** thorst_ has quit IRC | 17:01 | |
*** asselin has quit IRC | 17:01 | |
EmilienM | mordred: do you have an example in infra where http://docs.ansible.com/ansible/os_auth_module.html is used? | 17:02 |
*** esikachev has joined #openstack-infra | 17:02 | |
*** jsavak has quit IRC | 17:02 | |
*** jsavak has joined #openstack-infra | 17:02 | |
anteaya | jeblair: :( | 17:05 |
*** jpr has joined #openstack-infra | 17:05 | |
mordred | EmilienM: nope- I mostly made that module to help debug things | 17:05 |
EmilienM | mordred: trying to use it, but I don't get how to use auth (and if I should use it) | 17:06 |
mordred | EmilienM: you should just always have a clouds.yaml and use that | 17:06 |
EmilienM | ok | 17:06 |
EmilienM | I missed that part | 17:07 |
*** sdake has quit IRC | 17:08 | |
*** e0ne has quit IRC | 17:08 | |
mordred | EmilienM: http://paste.openstack.org/show/486587 | 17:08 |
tristanC | speaking of, nodepool is still failing if image-api-use-tasks isn't defined in nodepool.yaml: https://review.openstack.org/#/c/272097/ | 17:08 |
mordred | EmilienM: there is a playbook that shows it | 17:09 |
mordred | tristanC: using or not using clouds.yaml ? | 17:09 |
EmilienM | mordred: thanks | 17:09 |
tristanC | mordred: well without clouds.yaml | 17:09 |
*** esikachev has quit IRC | 17:09 | |
*** armax has joined #openstack-infra | 17:09 | |
tristanC | mordred: is there a documentation about using clouds.yaml for nodepool ? | 17:10 |
*** shashank_hegde has joined #openstack-infra | 17:10 | |
*** thorst__ has joined #openstack-infra | 17:10 | |
clarkb | tristanC: no thsts what I was pointing out to mordred earlier | 17:10 |
clarkb | we never added docs for it | 17:10 |
mordred | gah | 17:10 |
mordred | I think I have it in one of the nodepool-shade patches | 17:11 |
yolanda | nibalizer, aroun? | 17:11 |
mordred | I should pull that out and resubmit it | 17:11 |
yolanda | around? | 17:11 |
yolanda | i need to talk with you about certs | 17:11 |
*** maishsk has quit IRC | 17:11 | |
mordred | https://review.openstack.org/#/c/226758/4/doc/source/configuration.rst | 17:12 |
tristanC | clarkb: thank! that's a bit confusing for now, and well, master version of nodepool won't work with shade-1.4.0 without that image-api-use-tasks setting | 17:12 |
mordred | tristanC, clarkb: ^^ | 17:12 |
tristanC | mordred: ha nice, makes more sense now :) | 17:12 |
*** daemontool has quit IRC | 17:13 | |
mordred | let me extract that and just send a patch with that | 17:13 |
*** jcoufal has quit IRC | 17:13 | |
tristanC | should I abandon https://review.openstack.org/#/c/272097/ then ? | 17:14 |
*** maishsk has joined #openstack-infra | 17:14 | |
clarkb | depends, is that a setting nodepool can read natively already? | 17:15 |
clarkb | if so then we should accept it | 17:15 |
*** vgridnev has joined #openstack-infra | 17:16 | |
*** amotoki has joined #openstack-infra | 17:16 | |
flaper87 | Is there a way (sorry for the dumb question) to group several patches from the same project (glance) so that they are run under 1 CI job (without merging them in a single patch and giving up authorship)? I'm interested in doing so for a group of patches that just fix typos and docstrings | 17:16 |
*** amotoki has quit IRC | 17:16 | |
AJaeger | flaper87: no, each will be tested separately | 17:16 |
*** [HeOS] has quit IRC | 17:16 | |
clarkb | you can stack them though | 17:17 |
flaper87 | AJaeger: that's the current behavior and I take, from your answer, there's no way to have them run under the same job. too bad :( | 17:17 |
*** annegentle_ has joined #openstack-infra | 17:17 | |
clarkb | children are tested with their parent | 17:17 |
flaper87 | clarkb: I'm all ears | 17:17 |
flaper87 | or eyes? | 17:17 |
jeblair | flaper87: if you did want to squash them, you could add "Co-Authored-By" headers | 17:17 |
*** scheuran has quit IRC | 17:17 | |
flaper87 | clarkb: NICE! | 17:17 |
zaro | morning | 17:18 |
anteaya | morning zaro | 17:18 |
*** arthus has joined #openstack-infra | 17:18 | |
flaper87 | jeblair: tbh, I believe these are just folks trying to get a free ticket to the summit. If I add Co-Author I'll have to request extra ATC and I don't want to spend time on that :P | 17:18 |
EmilienM | mordred: works perfectly :) thanks | 17:18 |
AJaeger | clarkb: but if you stack them, each is tested still separately, isn't it? | 17:18 |
jeblair | flaper87: summit stuff should respect co-authored-by | 17:18 |
flaper87 | but stacking them sounds like simple enough | 17:18 |
cody-somerville | 6 | 17:18 |
cody-somerville | oops. | 17:18 |
flaper87 | jeblair: Ok, *that* I didn't know | 17:19 |
clarkb | yes separate tests but the child test is for all of them together | 17:19 |
*** mrmartin has joined #openstack-infra | 17:19 | |
fungi | jeblair: what summit stuff respects co-authored-by? we talked about it but no support was ever implemented anywhere | 17:20 |
*** zeih_ has quit IRC | 17:20 | |
jeblair | flaper87: we should check with fungi that's the case, but it's certainly the intention | 17:20 |
openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Document clouds.yaml as the preferred configuration https://review.openstack.org/278529 | 17:20 |
*** jlanoux has joined #openstack-infra | 17:20 | |
*** jcoufal has joined #openstack-infra | 17:20 | |
mordred | tristanC, clarkb, jeblair: ^^ | 17:20 |
flaper87 | fungi: jeblair oh :( | 17:20 |
mordred | mnaser: you too - since we also discussed this this moring ^^ | 17:20 |
fungi | right now neither the old nor new script scrapes commit messages, it just looks at gerrit's "owner" field | 17:20 |
openstackgerrit | Fausto Marzi proposed openstack-infra/project-config: Set conditions for devstack-dsvm and python34 on freezer https://review.openstack.org/278323 | 17:20 |
flaper87 | mordred: what's clouds.yaml? /me ducks #trollmode | 17:20 |
jeblair | fungi: what's the old and new script? | 17:20 |
* mordred picks up flaper87 and tosses him into the pool | 17:21 | |
*** annegentle_ has quit IRC | 17:21 | |
mnaser | mordred: how annoyed do you get by typos in docs :-P | 17:21 |
fungi | jeblair: old: http://git.openstack.org/cgit/openstack-infra/system-config/tree/tools/atc/email_stats.py new: https://review.openstack.org/263971 | 17:21 |
fungi | all based on gerrit change "owner" (so it's not even necessarily the author or committer of the commit which eventually merged, just the committer of the first patchset) | 17:22 |
mordred | mnaser: well, I should probably fix them :) | 17:22 |
jeblair | fungi: did you write the new script that way by choice? | 17:23 |
flaper87 | jeblair: fungi: can this be added in the new script? :D :D :D | 17:23 |
fungi | jeblair: what "way?" | 17:23 |
mnaser | mordred: done, thanks | 17:23 |
*** jcoufal has quit IRC | 17:23 | |
jeblair | fungi: tied so strongly to owner | 17:23 |
jeblair | fungi: i mean, you called it 'owners.py' | 17:24 |
flaper87 | were there objections ? | 17:24 |
jeblair | fungi: have you made a choice that only owners should be considered? | 17:24 |
fungi | jeblair: i wrote it for feature parity with the old script | 17:24 |
fungi | i'm perfectly happy for us to calculate electorate in new and different ways than we have in the past as long as there's sufficient official buy-in | 17:25 |
jeblair | fungi: i believe we have always said that co-authored-by should be treated as equivalent as the author field | 17:25 |
jeblair | fungi: it's what our documentation says, and the fact that our invite script omitted that was an oversight | 17:26 |
mordred | btw: https://review.openstack.org/278533 os-client-config patch removing HP and RunAbove for anyone who cares | 17:26 |
jeblair | though i really do remember fixing that _somewhere_ | 17:26 |
*** burgerk_ has joined #openstack-infra | 17:26 | |
fungi | jeblair: the reason we still rely on owner is that (in theory) the user must have had a valid foundation individual membership to be able to agree to the icla, while co-authored-by has no such guarantee | 17:26 |
anteaya | ah actually I never considered co-authored by equavalent to owner for elections | 17:26 |
jeblair | fungi: we do not require that people sign the cla to be contributors | 17:27 |
anteaya | I know it was discussed in the tc but then the solution was to include names in extra-atcs | 17:27 |
*** ifarkas has quit IRC | 17:27 | |
anteaya | which was the reason for a very large patch to the extra-atcs file when it existed | 17:27 |
jeblair | fungi: even before the changes... it is permissible to submit something on someone's behalf under certain circumstances | 17:27 |
fungi | jeblair: yeah, that was i guess one of those "best effort" things to attempt to meet the bylaws requirement for electorate to be foundation members in good standing | 17:27 |
*** dtantsur is now known as dtantsur|afk | 17:28 | |
fungi | jeblair: there is, if i remember correctly, a script in the governance repo which scrapes co-authored-by for purposes of coming up with potential candidates for addition to the extra-atcs list (pending manual research of the foundation membership for each of them) | 17:28 |
*** jaosorior_ has quit IRC | 17:28 | |
mordred | that is my understanding as well | 17:29 |
anteaya | that was it | 17:29 |
jeblair | fungi: right, though membership isn't required for summit passes | 17:29 |
*** doug-fish has joined #openstack-infra | 17:29 | |
anteaya | yes and it resulted in a very large initial patch | 17:29 |
jeblair | but sommit passes have 'arbitrary' criteria | 17:29 |
*** burgerk has quit IRC | 17:29 | |
zaro | fungi: willing to include this change for friday's gerrit maintenance? https://review.openstack.org/#/c/165228/ | 17:29 |
anteaya | membership is required for addition in extra-atcs | 17:29 |
mordred | https://governance.openstack.org/reference/charter.html#voters-for-tc-seats-atc | 17:29 |
mordred | Active Technical Contributors (“ATC”), which are a subset of the Foundation Individual Members. | 17:30 |
jeblair | anteaya, mordred, right | 17:30 |
jeblair | we're talking about a couple different things at once :) | 17:30 |
fungi | jeblair: true. summit registration discount codes for contributors follow requirements decided arbitrarily by the conference organizers, but traditionally they've been baed on people able to vote in the tc election (in recent cycles limited to a more recent period of activity though) | 17:30 |
*** burgerk_ has quit IRC | 17:30 | |
mordred | my undersatnding is that the only folks who get automatic non-judgement-based passes are people who are ATCs, which implies foundation membership. additional people who do not meet that automatic criteria can also get passes, but those require extra-atcs judgement | 17:31 |
jeblair | so here's what i'm getting at -- we either need to recognize co-authored-by as == author (and base our stuff on author); or change our docs to say "do not use co-authored-by" rather than "use co-authored-by" | 17:31 |
mordred | which is why co-authored-by has been handled by the other script and a submission for extra-atcs | 17:31 |
*** matrohon has quit IRC | 17:31 | |
maishsk | Good evening | 17:31 |
jeblair | determining membership of co-authored-by is automatable | 17:32 |
mordred | jeblair: I believe that if we can automate determining membership of co-authored-by, then I agree with your assessment | 17:32 |
maishsk | Can someone please have a look as to why https://review.openstack.org/#/c/278164/4 is not being checked ? | 17:32 |
jeblair | mordred: i do not believe _i_ can automate it, but i believe the foundation can. :( | 17:32 |
fungi | yep, in theory we could get a lookup api in the foundation member system. i want to request it, but have a feeling it would need to be implemented in the openstackid-resources system which needs a server provisioned which needs openstackid running on a newer ubuntu release... yak shave. so i've avoided asking for that until i can free up time to do that other prerequisite work | 17:33 |
*** sdake has joined #openstack-infra | 17:33 | |
maishsk | I would appreciate the help and explanation - so that I can hopefully deal with this myself next time | 17:33 |
mtreinish | dims: which jobs are you looking for? | 17:33 |
fungi | which i keep promising i'll work on and then not finding the time to do | 17:33 |
jeblair | mordred: i could do, at most, a first pass that checks co-authored-by against change owners so that you would catch the ones that happen to have also submitted changes | 17:33 |
maishsk | I assume that I did something wrong there | 17:33 |
mordred | jeblair: yes. I think that would work well on our side | 17:33 |
*** krtaylor has quit IRC | 17:34 | |
jeblair | fungi: indeed | 17:34 |
fungi | that's a good point. compare to the list of all change owners (lookup from table by e-mail address) | 17:34 |
zaro | fungi: also i wasn't sure whether you were requesting me to do anything more than review the patches for project name change for this friday. was there something else? | 17:34 |
*** EricGonc_ has quit IRC | 17:34 | |
jeblair | fungi: will the summit invite use the extra-atc script? | 17:34 |
mordred | jeblair: however, I'm not sure what that would gain for this, since that person would already have the atc credit from being the owner of the different change | 17:34 |
fungi | jeblair: it uses the extra-atcs _file_ (or the extra-atcs data from the projects.yaml since it's moving/moved there) | 17:35 |
jeblair | mordred: it may not be a current change | 17:35 |
*** davideagnello has quit IRC | 17:35 | |
fungi | also querying by owner takes us back to probably needing to dump an entire list of contributors if we want to catch people who were active as authors or co-authored-by but not owners of a change which merged within the qualifying period | 17:36 |
*** davideagnello has joined #openstack-infra | 17:36 | |
*** piet has quit IRC | 17:36 | |
jeblair | fungi: so does that mean this round of summit invites will have co-authored-by via the extra-atc script? | 17:36 |
*** claudiub has quit IRC | 17:36 | |
fungi | which the rewritten script was explicitly avoiding in an attempt to make something which people can run without being a gerrit admin/root admin | 17:36 |
*** tiswanso has quit IRC | 17:36 | |
fungi | jeblair: again, not sure what you mean by "via the extra-atc script" | 17:37 |
fungi | it will have co-authored-by entries from the governance repo merged into the query results | 17:37 |
*** nadya has joined #openstack-infra | 17:37 | |
*** nadya is now known as Guest10720 | 17:37 | |
*** hashar has quit IRC | 17:38 | |
jeblair | 17:28 < fungi> jeblair: there is, if i remember correctly, a script in the governance repo which scrapes co-authored-by for purposes of coming up with potential candidates for addition to the extra-atcs list (pending manual research of the foundation membership for each of them) | 17:38 |
jeblair | fungi: that ^ | 17:38 |
fungi | it doesn't run the script from the governance repo to get them. ptls run that script and propose results they think are worthy of consideration as an extra atc based on co-authored-by credits in commits | 17:38 |
fungi | and then the tc votes on their inclusion | 17:38 |
jeblair | fungi: right, so does that happen in time for the summit invites? | 17:38 |
fungi | if proposed and approved in time for them, sure | 17:39 |
anteaya | fungi: that data has now moved to projects.yaml, yes | 17:39 |
*** boris-42 has joined #openstack-infra | 17:39 | |
fungi | that's been the process so far anyway (for several cycles now) | 17:39 |
*** Swami_ has quit IRC | 17:39 | |
jeblair | so i can say to flaper87 that as long as he runs that script in a timely manner, co-authored-by people in his repos will end up as atcs | 17:40 |
jeblair | ? | 17:40 |
fungi | yes | 17:40 |
jeblair | it's not perfect but it's something :) | 17:40 |
anteaya | he runs the script and creates a patch to governance yes | 17:40 |
fungi | get it proposed to the governance repo and approved prior to feature freeze week | 17:40 |
jeblair | whew. this was easy. | 17:40 |
fungi | we'll be sending a last batch of codes just after feature freeze | 17:40 |
*** fedexo has joined #openstack-infra | 17:40 | |
*** fedexo_ has joined #openstack-infra | 17:41 | |
*** claudiub has joined #openstack-infra | 17:41 | |
anteaya | while we are on the topic if you want to get in on the fun early jeblair and mordred here is an addition of a cinder extra atc: https://review.openstack.org/#/c/278464/ | 17:42 |
openstackgerrit | Bob Ball proposed openstack-infra/project-config-example: Email notifications should only be for silent checks. https://review.openstack.org/278541 | 17:42 |
*** jed56 has quit IRC | 17:43 | |
*** esikachev has joined #openstack-infra | 17:43 | |
*** infra-re_ has joined #openstack-infra | 17:44 | |
*** mrmartin has quit IRC | 17:44 | |
*** kzaitsev_mb has quit IRC | 17:45 | |
*** claudiub has quit IRC | 17:45 | |
*** krtaylor has joined #openstack-infra | 17:45 | |
*** rvasilets__ has joined #openstack-infra | 17:46 | |
*** claudiub has joined #openstack-infra | 17:46 | |
*** eharney has quit IRC | 17:47 | |
*** infra-red has quit IRC | 17:47 | |
*** tphummel has joined #openstack-infra | 17:48 | |
*** jtomasek has joined #openstack-infra | 17:48 | |
anteaya | I have to go uptown and get better mousetraps | 17:49 |
anteaya | I have learned what style just torture the mice, so I have that as a data point | 17:49 |
anteaya | back later | 17:49 |
openstackgerrit | Bob Ball proposed openstack-infra/project-config-example: Email notifications should only be for silent checks. https://review.openstack.org/278541 | 17:50 |
sdague | hey, infra folks, what's up with - https://jenkins07.openstack.org/job/gate-tempest-dsvm-full-ceph/7156/console ? | 17:50 |
sdague | it's oddly hung | 17:50 |
sdague | the whole gate is stalled behind it | 17:51 |
openstackgerrit | Bob Ball proposed openstack-infra/project-config-example: Update recheck syntax to avoid the global namespace https://review.openstack.org/278537 | 17:51 |
clarkb | sdague: the job timed out but jenkins hasn't been able to kill it | 17:52 |
*** rcernin has joined #openstack-infra | 17:52 | |
clarkb | I have seen a small number ~2 other cases of this in the lsat week but haven't been able to figure out why jenkins is not able to stop the job | 17:52 |
BobBall | asselin_: Regarding the project list in layout.yaml; do you know if the zuul 'behaviour' where we had to list all projects has been changed? I believe it was because depends-on changes expect the target project to be listed in zuul's config even if there are no jobs | 17:53 |
clarkb | we can likely work around it by having the internal timeout be more aggressive so the job ends itself | 17:53 |
AJaeger | clarkb: jeblair and myself changed the internal timeout handling the last few days, do you want to double check the changes? | 17:55 |
asselin__ | BobBall, yes I remember there were some patches merged to zuul to fix that | 17:55 |
BobBall | asselin__: Awesome - I won't propose an update to layout.yaml for that then :) | 17:55 |
sdague | clarkb: the job did end itself | 17:56 |
sdague | or tried | 17:56 |
sdague | 2016-02-10 14:25:32.840 | /home/jenkins/workspace/gate-tempest-dsvm-full-ceph/devstack-gate/functions.sh: line 1088: 19472 Killed timeout -s 9 ${REMAINING_TIME}m bash -c "source $WORKSPACE/devstack-gate/functions.sh && $cmd" | 17:56 |
clarkb | sdague: it was still world dumping when the jenkins timeout kicked in | 17:56 |
clarkb | 15 minutes later | 17:56 |
clarkb | ish | 17:56 |
sdague | ok, that command takes 2 seconds | 17:56 |
*** achanda has joined #openstack-infra | 17:57 | |
sdague | which means something is horribly wrong | 17:57 |
sdague | is there any way to get on the node to get syslog or a kernel console? | 17:57 |
clarkb | we can try | 17:58 |
fungi | Unable to download data from https://rubygem | 17:58 |
fungi | s.org/ - bad response Not Found 404 (https://rubygems.global.ssl.fastly.net/late | 17:58 |
fungi | st_specs.4.8.gz) | 17:58 |
fungi | grr, stray newlines | 17:58 |
pabelanger | AJaeger: no new info about the github replication issue? | 17:58 |
*** Swami has joined #openstack-infra | 17:58 | |
fungi | we should consider caching that or making the bundler jobs non-voting | 17:58 |
sdague | because I feel like ceph vs. kernel is going on here | 17:58 |
sdague | and it would be good to figure out | 17:58 |
AJaeger | pabelanger: I can't help with that at all since I don't have the needed access, please ask infra-root for help. | 17:59 |
*** dolphm has quit IRC | 17:59 | |
rvasilets__ | fungi: Hi, I really didn’t want to make such an offensive proposal. I choose wrong words to bring my thoughts. We didn’t want to say anything bad about infra and infra efforts. I am going to fix proposal soon, sorry! | 17:59 |
*** tiswanso has joined #openstack-infra | 18:00 | |
clarkb | sdague: ssh is failing me, I can try a nova console-log | 18:00 |
clarkb | it did manage to open a tcp connection but I am not getting a login | 18:01 |
sdague | clarkb: yeh, any bread crumbs we can get would be good | 18:01 |
*** armax has quit IRC | 18:01 | |
*** derekh has quit IRC | 18:01 | |
sdague | I really wonder if there was an oom killer event | 18:01 |
*** achanda has quit IRC | 18:01 | |
*** w__ has quit IRC | 18:02 | |
clarkb | sdague: [ 2160.896598] INFO: task kworker/u16:1:98 blocked for more than 120 seconds. | 18:02 |
clarkb | there are a few of those | 18:02 |
*** shashank_hegde has quit IRC | 18:02 | |
AJaeger | pabelanger: did you merge any changes already to the repos? | 18:02 |
*** rossella_s has quit IRC | 18:03 | |
pabelanger | AJaeger: I did, but nothing that can't be reimported | 18:03 |
*** mrmartin has joined #openstack-infra | 18:03 | |
*** dahoo has joined #openstack-infra | 18:03 | |
clarkb | sdague: magnum ran into similar on a different region (but same image) | 18:03 |
fungi | rvasilets__: i appreciate the apology. a lot of the benefits you pointed out in your description of rally-ci are in the process of being added to zuul v3, and we could certainly use some additional developers helping. see http://specs.openstack.org/openstack-infra/infra-specs/specs/zuulv3.html for a basic outline of what's changing | 18:03 |
AJaeger | pabelanger: So, that means additional syncs failed as well... | 18:03 |
clarkb | I wonder if that kernel is buggy | 18:03 |
*** rossella_s has joined #openstack-infra | 18:03 | |
sdague | same cloud ? | 18:03 |
*** ihrachys has quit IRC | 18:04 | |
clarkb | no | 18:04 |
pabelanger | AJaeger: right. I was hoping a new commit would force a replication, but didn't work | 18:04 |
clarkb | was ovh | 18:04 |
clarkb | this is bluebox | 18:04 |
AJaeger | fungi, clarkb: Can you help pabelanger, please? problem is: https://github.com/openstack/ansible-role-jenkins empty | 18:04 |
sdague | and we've forced off nested kvm, right? | 18:04 |
clarkb | sdague: yes in devstack gate we force qemu | 18:04 |
*** sridhar_ram has joined #openstack-infra | 18:04 | |
sdague | hmmm, ok | 18:04 |
*** esker has quit IRC | 18:04 | |
*** zeih_ has joined #openstack-infra | 18:05 | |
*** tiswanso has quit IRC | 18:05 | |
sdague | clarkb: well, can you dump everything off nova-console to a file somewhere to look at it later? | 18:05 |
rvasilets__ | fungi: Thank you for the link I will look at the link and zuul v3 more carefully | 18:05 |
*** tiswanso has joined #openstack-infra | 18:05 | |
sdague | and I guess can you hard kill the node and zuul will reset things? | 18:06 |
*** annegentle_ has joined #openstack-infra | 18:06 | |
sdague | because all work is currently stopped on this | 18:06 |
clarkb | sdague: it may reset things :) not sure I would count on it | 18:06 |
*** mrmartin has quit IRC | 18:06 | |
sdague | well, we should figure out what the recovery path is supposed to be here | 18:06 |
sdague | because our 2 different timeouts haven't managed to do it | 18:06 |
*** BobBall is now known as BobBall_AWOL | 18:07 | |
fungi | AJaeger: fixed. it was the usual github api call fail when trying to add permissions for gerrit to push. i just had to add gerrit to that repo manually in github and replication completed | 18:07 |
fungi | pabelanger: ^ | 18:07 |
clarkb | right because the machine is completely hosed. I bet jenkins is trying to tell its slave agent that the job should die so it can cleanup slave side | 18:07 |
clarkb | hence the fail to stop the job | 18:07 |
sdague | right | 18:07 |
sdague | but it's now something that's been seen more than once | 18:07 |
AJaeger | fungi, there's a second repo: https://github.com/openstack/ansible-role-jenkins-plugins | 18:07 |
AJaeger | fungi, thanks! | 18:07 |
AJaeger | pabelanger, fungi: first repo looks fine now! | 18:08 |
*** krtaylor has quit IRC | 18:08 | |
*** Sukhdev has quit IRC | 18:08 | |
*** ociuhandu_ has joined #openstack-infra | 18:08 | |
fungi | added there too | 18:09 |
pabelanger | great | 18:09 |
fungi | will take a moment for gerrit to realize and retry the push | 18:09 |
clarkb | sdague: http://paste.openstack.org/show/486599/ | 18:09 |
*** jaosorior has quit IRC | 18:09 | |
clarkb | and delete is in progress, we shall see if it gets rescheduled or not | 18:09 |
AJaeger | and has content now -thanks, fungi! | 18:09 |
fungi | np | 18:10 |
*** dkranz has quit IRC | 18:10 | |
*** ociuhandu has quit IRC | 18:11 | |
*** ociuhandu_ is now known as ociuhandu | 18:11 | |
clarkb | delete is slow... | 18:12 |
*** achanda has joined #openstack-infra | 18:12 | |
sdague | what is the swap setup here | 18:13 |
fungi | on ovh? | 18:14 |
*** w__ has joined #openstack-infra | 18:14 | |
clarkb | on ovh and bluebox I beliee it is the swap file | 18:14 |
clarkb | which is sparse | 18:14 |
clarkb | we could try a preallocated file | 18:15 |
*** achanda has quit IRC | 18:15 | |
*** yaume has quit IRC | 18:16 | |
clarkb | sdague: slave deleted | 18:16 |
*** thorst__ has quit IRC | 18:16 | |
*** max_lobur has quit IRC | 18:17 | |
clarkb | looks like job stayed queued and didn't flip to aborted or failed so job will be rerun | 18:17 |
sdague | clarkb: yeh, sparse swap file could definitely be an issue, because if it goes after a block it can't get because there isn't space left | 18:17 |
*** jlanoux has quit IRC | 18:17 | |
sdague | that would explain something like this | 18:17 |
*** mrmartin has joined #openstack-infra | 18:18 | |
craige | o/ | 18:19 |
fungi | basically memory exhaustion coupled with disk space exhaustion | 18:19 |
sdague | fungi: yeh | 18:19 |
*** yamamoto has quit IRC | 18:19 | |
sdague | because this kind of hard stop is indicative of blocking io | 18:20 |
pabelanger | mordred: is there a way I can mock k5start with my local afs setup? using the same openstack.org directories? | 18:20 |
fungi | the downside to preallocated means we're eating space on an already tight filesystem | 18:20 |
clarkb | really the ideal thing would be to not swap at all :/ | 18:20 |
*** krtaylor has joined #openstack-infra | 18:20 | |
sdague | fungi: right, but if you need the swap, you need it | 18:20 |
clarkb | (and not have a swap device) | 18:20 |
clarkb | most of our jobs get away with it just fine | 18:20 |
*** e0ne has joined #openstack-infra | 18:20 | |
fungi | i think we may have some jobs (grenade?) which can't function on 8gb less than the current size of the rootfs on ovh | 18:20 |
*** shashank_hegde has joined #openstack-infra | 18:20 | |
sdague | lying to the server and telling it it has swap it does not actually have means it makes decisions based on it | 18:21 |
mordred | pabelanger: uhm | 18:21 |
sdague | so we get there, then we wedge | 18:21 |
fungi | sdague: well, that's only a lie if the rootfs is almost full | 18:21 |
mordred | jeblair: did we make krotscheck a principal for him to hack on mirrors? | 18:21 |
clarkb | there is a small minority like magnum and I guess ceph that dig into swap | 18:21 |
pabelanger | mordred: aside from me standing up my own kerbose server and enrolling afs into it | 18:21 |
sdague | fungi: sure, but, we see it's sometimes a lie | 18:21 |
mordred | jeblair: I'm wondering if making pabelanger a principal that can write to a volume in our AFS is a good way to let him hack on the yum mirror | 18:21 |
*** rhallisey has quit IRC | 18:21 | |
*** electrofelix has quit IRC | 18:22 | |
sdague | and having it wedge the whole system until I come and tell you about it, doesn't feel very "continuous" :) | 18:22 |
fungi | right, and as clarkb points out we have jobs which oom because 8gb ram is insufficient. maybe those jobs should create a swapfile and we should just drop swap across all workers instead | 18:22 |
sdague | especially as it also prevents us from real post mortem | 18:22 |
*** cbader has joined #openstack-infra | 18:23 | |
fungi | unfortunately, the oom condition in at least some cases has a similar effect (machine becomes completely unreachable, drops from jenkins, zuul restarts job on new worker, loop ad infinitum) | 18:23 |
sdague | fungi: maybe they could, not sparsely allocating the swap seems like a thing which could be fixed today so we don't have non post mortemable jobs | 18:23 |
*** tzn has quit IRC | 18:23 | |
openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Show innodb status before dropping db https://review.openstack.org/278146 | 18:23 |
clarkb | ok that is actually locally tested against mysql and working | 18:24 |
clarkb | greghaynes: jeblair ^ I am probably goint to recheck that a few times and see if I can catch the error on the test slaves | 18:24 |
*** jbernard has joined #openstack-infra | 18:24 | |
greghaynes | clarkb: ++ | 18:24 |
*** zeih_ has quit IRC | 18:25 | |
*** dkranz has joined #openstack-infra | 18:25 | |
clarkb | sdague: I can make that change to d-g | 18:25 |
clarkb | since I basically already wrote it once | 18:25 |
sdague | clarkb: cool, thanks | 18:25 |
*** lucasagomes is now known as lucas-afk | 18:25 | |
*** tzn has joined #openstack-infra | 18:26 | |
sdague | clarkb: oh, interesting, zuul was smart enough to restart that test job | 18:26 |
fungi | yeah, node deletion has that effect | 18:26 |
*** infra-red has joined #openstack-infra | 18:26 | |
sdague | cool, that means if it passes, we get to land the 20 patches backed up behind it instead of restarting them all | 18:26 |
*** tzn has quit IRC | 18:26 | |
*** tzn has joined #openstack-infra | 18:27 | |
fungi | unfortunately, also any job which consistently tanks in such a way as to cause the worker to die in flames has a similar effect | 18:27 |
openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/277702 | 18:27 |
*** slogan621 has joined #openstack-infra | 18:27 | |
*** infra-re_ has quit IRC | 18:28 | |
*** mriedem has quit IRC | 18:28 | |
*** _tzn has joined #openstack-infra | 18:29 | |
*** jordanP has quit IRC | 18:29 | |
*** max_lobur has joined #openstack-infra | 18:29 | |
*** tzn has quit IRC | 18:29 | |
*** thorst_ has joined #openstack-infra | 18:30 | |
lifeless | AJaeger: sure | 18:31 |
openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: Preallocate swapfile https://review.openstack.org/278557 | 18:31 |
clarkb | sdague: fungi ^ | 18:31 |
clarkb | note we can also make the swapfile smaller if that helps, but 8G is what it was before and at least for magnum I think we need ~2G | 18:32 |
*** kdas_ has joined #openstack-infra | 18:32 | |
fungi | we probably want to recheck that a bunch to make sure we get grenade runs in ovh/bluebox | 18:32 |
clarkb | yup | 18:32 |
*** dkranz has quit IRC | 18:32 | |
clarkb | and internap | 18:32 |
fungi | also note there's a thread on the -dev ml about reducing the memory footprint of magnum's jobs | 18:32 |
fungi | so maybe they don't actually need swap soon? | 18:32 |
clarkb | they did reduce their VMs to 1GB flavor | 18:33 |
clarkb | which helps | 18:33 |
*** eharney has joined #openstack-infra | 18:33 | |
*** ccrouch has quit IRC | 18:33 | |
*** thorst_ has quit IRC | 18:34 | |
clarkb | tristanC: https://review.openstack.org/#/c/272097/3/nodepool/cmd/config_validator.py isn't a key that nodepool already knows about | 18:34 |
clarkb | tristanC: so that is a noop change? | 18:35 |
*** kushal has quit IRC | 18:35 | |
*** ashleighfarnham has joined #openstack-infra | 18:35 | |
jeblair | mordred, pabelanger: yeah, i'm down with creating a principal; we should either grant pabelanger perms in user/pabelanger, or, if we want to use the real paths, we should make sure to revoke those before production | 18:36 |
*** mriedem has joined #openstack-infra | 18:36 | |
jeblair | mostly just on principle | 18:36 |
jeblair | i did it with group membership elsewhere, so it's easy | 18:36 |
jeblair | mordred, pabelanger: oh -- note k5start is different with a user vs service principal | 18:37 |
clarkb | tristanC: ya I can't find any way for that parameter to make it from the nodepool config to shade | 18:37 |
jeblair | we have keytabs for service principals; if you use k5start without a keytab, you'll get prompted for a password | 18:37 |
jeblair | we could probably set up pabelanger's principal with a keytab | 18:38 |
jeblair | if that's important | 18:38 |
pabelanger | jeblair: mordred: Okay, I'm not sure the best approach. OpenAFS still pretty new to me. | 18:38 |
jeblair | if the password prompts are okay though, that would be easiest/best | 18:39 |
krotscheck | mordred: Sortof. I have principal rights on /mirror/npm, but I forgot the credentials | 18:39 |
AJaeger | team, I have a policy question for you regarding the PTI: We discussed a few weeks ago to add a linters job so that projects can use that instead of pep8 - and first projects already use that like keystone and bandit. But PTI mentions pep8, so should I update the PTI somehow? | 18:39 |
*** vilobhmm11 has joined #openstack-infra | 18:40 | |
pabelanger | jeblair: Ya, password work for now. until I puppetize everything | 18:40 |
jeblair | AJaeger: yes. keystone and bandit are out of policy. those changes should not have been approved. | 18:40 |
*** MarkAtwood has quit IRC | 18:40 | |
jeblair | AJaeger: i would go so far as to say they should be reverted | 18:40 |
*** sridhar_ram is now known as sridhar_ram_afk | 18:40 | |
*** vilobhmm11 has left #openstack-infra | 18:40 | |
jeblair | AJaeger: what problem was trying to be solved? | 18:41 |
AJaeger | jeblair: then I totally misunderstood the discussion we had a few weeks ago here ;( | 18:41 |
*** annegentle_ has quit IRC | 18:41 | |
clarkb | mordred: commnted on https://review.openstack.org/#/c/278529/1 | 18:42 |
* AJaeger tries to find logs from that discusion.. | 18:42 | |
jeblair | AJaeger: it's *very* important that projects follow that interface. the pep8 job does more than just run pep8. | 18:42 |
fungi | i think the two main goals from that were to combine multiple static analysis jobs for a slight additional efficiency, and also to get rid of the potential confusion around having a "pep8" tox environment that runs all sorts of things and not just pep8/flake8 | 18:43 |
*** mrmartin has quit IRC | 18:43 | |
jeblair | yeah, but by doing that without adjusting the pti means we're not testing tarball builds of keystone anymore | 18:43 |
AJaeger | jeblair: discussion starting here http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2015-12-21.log.html#t2015-12-21T19:10:29 | 18:43 |
fungi | but yeah, before moving to projects adhering to the pti the pti should have been amended/updated with that | 18:43 |
*** ashleighfarnham has quit IRC | 18:43 | |
*** jsavak has quit IRC | 18:44 | |
*** armax has joined #openstack-infra | 18:44 | |
AJaeger | jeblair: why not anymore tarball builds? | 18:44 |
jeblair | AJaeger: because that's done by run-pep8 | 18:44 |
*** sridhar_ram_afk has quit IRC | 18:44 | |
*** samueldmq has joined #openstack-infra | 18:45 | |
samueldmq | hi | 18:45 |
samueldmq | is there any kno issue with stackalytics.o.o ? | 18:45 |
samueldmq | last time it was updated was 28 Jan | 18:45 |
samueldmq | known* | 18:45 |
slogan621 | https://review.openstack.org/#/c/275873 - any approvers willing to take a look? Thanks! | 18:46 |
pabelanger | samueldmq: looks like it, I can see what is going on | 18:46 |
*** cbader_ has joined #openstack-infra | 18:46 | |
pabelanger | samueldmq: it currently isn't production, so might not be getting the love it needs | 18:46 |
jeblair | AJaeger: projects must adhere to the pti so that we can make changes like this globally. it's our *interface* to running tests for the projects. we can make the changes you're talking about, but we need to do it with care. for openstack projects we don't just run whatever people tell us to. we make some guarantees about what is run and how. | 18:46 |
samueldmq | pabelanger: :( | 18:47 |
jeblair | AJaeger: can you take care of reverting those? | 18:48 |
AJaeger | jeblair: ARgh, wished I had that advise before Christmas when we discussed it. | 18:48 |
samueldmq | pabelanger: I got it, there are other priorities | 18:48 |
pabelanger | samueldmq: looks like stackalytics-processor is hung | 18:48 |
AJaeger | jeblair: I can take care of cleaning up. | 18:48 |
AJaeger | jeblair: but before reverting, I'd like to discuss whether there's a clear path forward - or whether I should revert and bury it. | 18:48 |
pabelanger | samueldmq: well, we still need to get a migration plan in place to retire stackalytics.com. There are still some dependency on it | 18:49 |
jeblair | AJaeger: thanks. sorry i did not see that discussion then. i have a vague recollection of it happening, but my perception was that you wanted to test it out in project-config. | 18:49 |
*** dkranz has joined #openstack-infra | 18:49 | |
clarkb | so thats interesting, I just got google results for gerrit changes | 18:50 |
pabelanger | samueldmq: once we can schedule the migration, it shouldn't take too long | 18:50 |
clarkb | I wonder if indexing is part of our memory and 500ing woes | 18:50 |
samueldmq | pabelanger: is stackalytics.com maintained by openstack-infra , | 18:50 |
samueldmq | ? | 18:50 |
*** cbader has quit IRC | 18:50 | |
pabelanger | samueldmq: no, mirantis. | 18:50 |
tristanC | clarkb: well it get evaluated here http://git.openstack.org/cgit/openstack-infra/shade/tree/shade/openstackcloud.py#n127 | 18:50 |
*** yamamoto has joined #openstack-infra | 18:50 | |
*** eharney has quit IRC | 18:50 | |
pabelanger | samueldmq: that's one of the reason for stackalytics.o.o | 18:50 |
pabelanger | samueldmq: we just haven't made the switch yet | 18:50 |
*** baoli_ has quit IRC | 18:51 | |
pabelanger | samueldmq: http://lists.openstack.org/pipermail/openstack-infra/2016-January/003627.html | 18:51 |
AJaeger | fungi, jeblair: Do you see a way forward - or should I revert? | 18:51 |
tristanC | clarkb: and iirc, trying to use master of nodepool with shade-1.4.0 is not possible because shade throws KeyError when the setting is not there, and nodepool will not validate the configuration is the setting is there | 18:51 |
samueldmq | pabelanger: okay so the plan is to make stackaylytics.o.o more stable and ask miratis to remove their own? | 18:51 |
clarkb | tristanC: via cloud config, not via nodepool config | 18:51 |
* samueldmq 's looking | 18:51 | |
tristanC | clarkb: that is without any clouds.yaml | 18:51 |
jeblair | AJaeger: i think there is a path forward -- adjust the pti, propose the new environment to all of the projects, then adjust project-config. but the things we are doing for pep8 must still be done in the new linters job too | 18:51 |
clarkb | tristanC: so you can add that to the nodepool config but it won't be used | 18:52 |
jeblair | AJaeger: it will be a big, long, slow process. | 18:52 |
tristanC | clarkb: there may be something else, all I know is that this patch make nodepool work again for me (+ the new param in my nodepool.yaml) | 18:52 |
clarkb | tristanC: I just don't see how it can, all that is saying is if you validate the config allow this key | 18:53 |
fungi | AJaeger: right, i agree with what jeblair said. for official projects this needs to be a coordinated transition for which the next step is updating the defined standard | 18:53 |
clarkb | but nothing from what I can see ever passes that key from nodepool config to shade | 18:53 |
samueldmq | pabelanger: okay, thanks for the updates | 18:53 |
fungi | s/official/projects attempting conformance wit the pti/ | 18:53 |
pabelanger | samueldmq: yes, we have an infra-spec to do that. stackalytics.o.o is fully managed by puppet now, and under the control of -infra. However, some minor things like maintenance and upgrades that need to be resolved. My understanding is stackalytics.com does that manually | 18:53 |
jeblair | AJaeger: (you don't need to revert the change to have project-config use linters -- it's not subject to the pti) | 18:53 |
AJaeger | I see ;( So, possible - but so much work that it's not worth it, correct? | 18:53 |
samueldmq | pabelanger: nice, unfortunately I can't commit part of my time to help on that :( | 18:53 |
pleia2 | anteaya: just saw your earlier question re: wikimedia, they're an organization, not an open source project, maybe mediawiki (which IS the open source project) has an open infra, but I don't know and I don't know where I'd find it | 18:54 |
AJaeger | jeblair: reverting for project-config is the most trivial one - but thanks ;) | 18:54 |
tristanC | clarkb: I could look into that, but it seems like I should better switch to this new cloud.yaml configuration | 18:54 |
clarkb | tristanC: thats the way I would expect it to work :) | 18:54 |
jeblair | AJaeger: i don't know whether it's worth it or not. | 18:54 |
*** thorst_ has joined #openstack-infra | 18:54 | |
clarkb | tristanC: it is possible we dump the entire key space for provider config into shade as kwargs | 18:55 |
clarkb | let me check that | 18:55 |
fungi | AJaeger: it's not been worth it to anyone so far, to the point where effort has been invested to get it done, but that's not to say it's not worthwhile to someone | 18:55 |
fungi | er, double-negative | 18:55 |
fungi | it's possible it may be worthwhile enough to someone that they're willing to invest the effort to go through the (long and arduous) process to make it happen | 18:56 |
clarkb | _cloudKwargsFromProvider(provider) seems to filter out the list | 18:56 |
AJaeger | So, a slow migration is not really possible? Meaning offering it as an alternative? ;( | 18:56 |
fungi | AJaeger: i think the best argument for doing it is so that developers can know that by running `tox -e linters` they're guaranteed to get all the important static analysis checks performed rather than having to run a bunch of different commands and know which ones are important to a particular project and which aren't | 18:57 |
jeblair | AJaeger: i think it could be phased, but i think we would want to make the transition as quickly as possible for our own sanity. | 18:58 |
*** bpokorny_ has joined #openstack-infra | 18:59 | |
*** pvaneck has joined #openstack-infra | 18:59 | |
AJaeger | fungi: I'm currently frightened that continuing I will have a lot of work and therefore ask whether it can be done in a reasonable way - without becoming insane ;/ | 18:59 |
*** thorst_ has quit IRC | 18:59 | |
*** Guest10720 has quit IRC | 18:59 | |
*** bpokorny_ has quit IRC | 18:59 | |
fungi | AJaeger: a perfectly reasonable concern. certainly don't volunteer for things you don't think you'll have time to do | 18:59 |
AJaeger | ;) | 18:59 |
*** bpokorny_ has joined #openstack-infra | 19:00 | |
fungi | on the scale of important problems we need solved within openstack, that one is probably pretty far down the list | 19:00 |
*** achanda has joined #openstack-infra | 19:00 | |
tristanC | clarkb: http://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/config.py#n141 wouldn't that copy the whole object ? | 19:00 |
*** annegentle_ has joined #openstack-infra | 19:00 | |
*** mrmartin has joined #openstack-infra | 19:01 | |
*** annegentle_ has quit IRC | 19:01 | |
*** w_ has joined #openstack-infra | 19:01 | |
AJaeger | fungi: yeah, it might be easier to explain a few more times that bandit, bashate, and other linters should be in pep8 instead of pushing it through... | 19:01 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Add job tags https://review.openstack.org/277981 | 19:01 |
clarkb | tristanC: yes but that isn't what we pass to OpenStackCloud | 19:01 |
*** annegentle_ has joined #openstack-infra | 19:01 | |
clarkb | tristanC: we pas a cloud_kwargs thing that comes from _cloudKwargsFromProvider(provider) which filters out a specific set of args | 19:02 |
*** doug-fis_ has joined #openstack-infra | 19:02 | |
*** EricGonczer_ has joined #openstack-infra | 19:02 | |
*** bpokorny has quit IRC | 19:02 | |
fungi | AJaeger: well, also there is a good reason to have separate tox envs for those things while they're in the process of being phased in, since a project might want separate job results for bandit, or to be able to make bandit's results visible but non-voting while they're working on getting compliant without making their other linters non-voting | 19:03 |
*** eharney has joined #openstack-infra | 19:03 | |
tristanC | clarkb: oh ok, well nevermind. I'll try again without that patch to track how the config is processed. Thank for the review though! | 19:03 |
clarkb | I have to say, figuring out why swift uploads to rax still don't work really makes me dislike the number of layers between client and get a token | 19:03 |
*** w__ has quit IRC | 19:03 | |
openstackgerrit | Paul Belanger proposed openstack-infra/puppet-stackalytics: Setup logging for stackalytics-processor https://review.openstack.org/278567 | 19:04 |
clarkb | nodepool -> shade -> openstack client config -> keystone auth with some swift client mixed in | 19:04 |
fungi | AJaeger: though i still think that adding the new linter and at the same time adding skips/overrides fro everything it's failing on is a better approach, then you can peel back individual skips/overrides incrementally in later patches | 19:04 |
*** daemontool has joined #openstack-infra | 19:04 | |
*** zeih_ has joined #openstack-infra | 19:04 | |
*** doug-fi__ has joined #openstack-infra | 19:04 | |
pabelanger | samueldmq: that should help debug the failure with stackalytics.o.o ^ | 19:05 |
*** doug-fish has quit IRC | 19:05 | |
AJaeger | fungi: sure, non-voting bandit is valid... | 19:06 |
tristanC | clarkb: on that subject, note I'm able to run zuul without swift connection, providing a known temp_url_key and storage_url... the code is actually missing a condition as proposed here: https://review.openstack.org/#/c/270338/ | 19:06 |
*** doug-fis_ has quit IRC | 19:06 | |
jeblair | clarkb: wasn't notmorgan working on the keystoneauth/swift thing? | 19:06 |
*** EricGonc_ has joined #openstack-infra | 19:07 | |
samueldmq | pabelanger: what does Signed-off-by mean? | 19:07 |
samueldmq | pabelanger: firt time I see that | 19:07 |
*** sridhar_ram has joined #openstack-infra | 19:07 | |
pabelanger | samueldmq: nothing, just a habit of doing git -s | 19:08 |
clarkb | jeblair: he was going to add sessions to swiftclient | 19:08 |
fungi | samueldmq: http://docs.openstack.org/infra/manual/developers.html#using-signed-off-by | 19:08 |
mordred | pabelanger: there is a fellow in #ansible who has the sads because he wants to use the os_ modules in ansible 2.0 but that requires shade and he's on rhel7 and there are no rpms for shade and pip installing shade breaks other things he has installed via rpms | 19:08 |
clarkb | jeblair: I am trying to fix it given the current state of software | 19:08 |
pabelanger | samueldmq: one day well support gpg keys :) | 19:08 |
mordred | pabelanger: I told him I knew a person who did packging that I would ping about it | 19:08 |
*** thorst_ has joined #openstack-infra | 19:08 | |
*** jsavak has joined #openstack-infra | 19:08 | |
fungi | pabelanger: what do you mean by "one day"? | 19:08 |
clarkb | it looks like keystoneauth gives its plugins discretion on whether or not a new token should be issued | 19:08 |
*** zeih_ has quit IRC | 19:08 | |
clarkb | so we don't really have control to say "give me a new token really I mean it" despite remaking our client object | 19:08 |
fungi | pabelanger: you can already do git commit -S and push the result up for review, no problem | 19:08 |
*** doug-fi__ has quit IRC | 19:09 | |
pabelanger | mordred: indeed. I'm trying to get the required os-client-config for rawhide now. | 19:09 |
jeblair | clarkb: okay, is it worth checking in with notmorgan to find out if that is imminent? | 19:09 |
pabelanger | mordred: what that is done, I'll be backporting into epel7 | 19:09 |
clarkb | jeblair: it is worth checking in but I seriously doubt that swiftclient changes + oscc changes + shade changes will get in any time soon | 19:09 |
pabelanger | fungi: Wait, our workflow support signed commits? | 19:09 |
pabelanger | I didn't know that | 19:09 |
clarkb | mostly because swift will probably not like the change in deps | 19:09 |
pabelanger | maybe I am confusing it with tags | 19:09 |
*** xyang1 has quit IRC | 19:09 | |
fungi | pabelanger: anyway, the signed-off-by header has a completely different implication (acknowledgement of the dco) than signed git commits | 19:09 |
fungi | pabelanger: see the url i linked about it for samueldmq | 19:10 |
mordred | pabelanger: awesome! thanks | 19:10 |
notmyname | clarkb: those cranky swift devs. always getting in the way ;-) | 19:10 |
*** EricGonczer_ has quit IRC | 19:10 | |
clarkb | notmyname: I just set my expectations based on previous attempts at changing similar things in swiftclient | 19:10 |
notmyname | clarkb: in seriousness, though, we (swift devs) do want the keystone session support in swiftclient | 19:10 |
pabelanger | fungi: ya, reading now | 19:10 |
*** _tzn has quit IRC | 19:11 | |
AJaeger | jeblair, fungi: See we have 383 repos using pep8 right now ;( | 19:11 |
clarkb | notmyname: ok thats good to hear. Last time I pushed a change to swiftclient to do keystone things I got much fire and brimstone | 19:11 |
clarkb | because swiftclient very much prefers its basic auth or something | 19:11 |
samueldmq | pabelanger: fungi: thanks, good to know | 19:11 |
clarkb | thats what it was, I wanted it to install keystoneclient by default since you know openstack | 19:11 |
fungi | pabelanger: but `git commit -S` (capital S) does commit signing with an openpgp key and gerrit will accept the resulting signed commit just fine | 19:11 |
*** thorst_ has quit IRC | 19:12 | |
pabelanger | fungi: Nice. TIL. Going to give it a try | 19:12 |
fungi | though i don't think it supports any sort of validation of the signature, nor even displays it. you'd still need to retrieve the commit to check the signature if you were so inclined | 19:12 |
*** thorst_ has joined #openstack-infra | 19:12 | |
clarkb | but I guess if keystoneauth goes in like client where it isn't actually installed automagically maybe that won't be a problem | 19:12 |
*** dpaterson has joined #openstack-infra | 19:12 | |
*** w_ has quit IRC | 19:14 | |
*** w_ has joined #openstack-infra | 19:14 | |
*** w_ has quit IRC | 19:15 | |
clarkb | notmyname: jeblair the other concern is that we may not actually correct things with direct session support, since I basically hacked the whole get me a new token process into shade for iamge uplodas except it isn't working | 19:15 |
clarkb | oh wait I see why | 19:15 |
daemontool | anyone available to review https://review.openstack.org/#/c/278323/ | 19:16 |
clarkb | because there are actually many api calls that happen over time (potentially) from that one python function call | 19:16 |
clarkb | so hacky thing may still timeout, sessions should fix that particular thing | 19:16 |
AJaeger | would ansible also violate the PTI? They're using linters now but are they a python project under PTI? | 19:16 |
mordred | AJaeger: I'm not sure they are a python project, tbh | 19:17 |
*** rpioso has joined #openstack-infra | 19:17 | |
*** fedexo_ has quit IRC | 19:17 | |
*** fedexo has quit IRC | 19:17 | |
*** bpokorny_ has quit IRC | 19:17 | |
mordred | I think the language they write in is "ansible" - and ansible happens to be written in python - there are many things about their setup that don't make sense in the PTI | 19:17 |
*** bpokorny has joined #openstack-infra | 19:18 | |
mordred | but I do think that's getting into a grey-ish area | 19:18 |
*** jdurgin has joined #openstack-infra | 19:18 | |
mordred | clarkb: oh - it looks like I missed a fun dicsussion about seesions | 19:18 |
clarkb | mordred: well just wrapping my brain around why the hack in shade isn't reliable and I think I sorted it out | 19:19 |
mordred | notmyname: I added it to a few other client libs - I'd be happy to work you up a patch if it's a thing you're interested in receiving | 19:19 |
clarkb | it is because we only reup the token before doing all of the operations, those operations don't all happen at once and happen over time | 19:19 |
clarkb | sessions should reup for each one if done properly | 19:19 |
dpaterson | mordred, rpioso: I've been assist my associate rpioso with some difficulty he is having with pbr and packaging. | 19:19 |
mordred | clarkb: yah | 19:19 |
mordred | dpaterson: uhoh | 19:20 |
* mordred hides | 19:20 | |
dpaterson | :) | 19:20 |
rpioso | mordred: Nice to meet you. | 19:20 |
clarkb | mordred: so my shade hack helps but isn't complete | 19:20 |
dpaterson | rpioso: please describe the issue | 19:20 |
notmyname | mordred: thanks. the people to work with on the swift side are timburke and joeljwright | 19:20 |
mordred | notmyname: cool! I shall put it on my list and then poke them | 19:21 |
notmyname | mordred: both have expressed interest and willingness to see that done in swiftclient, but they don't know much about how to. that's the barrier right now, I think | 19:21 |
AJaeger | fungi, jeblair: So boils down to these two options: | 19:21 |
AJaeger | 1) Updating PTI, 2) fixing linters job to do the same as pep8, 3) adding linters to python-jobs with lots of skips/non-voting, 4) updating official repos to have linters target that does pep8 job on master (not on stable), 5) removing pep8 and skips/non-voting | 19:21 |
AJaeger | Plan B: 1) Revert changes for bandit, keystone 2) Remove linters job from python-jobs in jenkins . Leave ansible, system-config, project-config as is (using linters) | 19:22 |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Modify test workaround for extra_dhcp_opts https://review.openstack.org/278438 | 19:22 |
AJaeger | Correct? | 19:22 |
* nibalizer shakes the collection tin on https://review.openstack.org/#/c/234535/11 | 19:22 | |
mordred | notmyname: cool - I know a bunch about it - but am not in a position to have an interest in it being done in swiftclient | 19:22 |
mordred | notmyname: so it sounds like a good match :) | 19:22 |
clarkb | there should be lots of prior art too | 19:23 |
daemontool | clarkb, thanks, anyone can +A please https://review.openstack.org/#/c/278323/ | 19:23 |
rpioso | dpaterson, mordred: In the package I'm building, I would like to include a script (Py module with name equal to __main__ ) that is not inside of a Py package. I haven't been able to find doc on how to do that with pbr. Is it possible? | 19:24 |
SpamapS | mtreinish: hah, mysql 5.6 allows you to have bigger indexes now btw https://dev.mysql.com/doc/refman/5.6/en/innodb-parameters.html#sysvar_innodb_large_prefix | 19:24 |
mordred | rpioso: hrm. I believe so - one sec | 19:25 |
SpamapS | mtreinish: glad we got rid of all those big indexes before that arrived ;) | 19:25 |
lifeless | rpioso: should be the same as getting setuptools to do it | 19:25 |
lifeless | rpioso: I don't think we specifically break that in any way | 19:25 |
mtreinish | SpamapS: heh, nice :) | 19:25 |
AJaeger | jeblair, fungi : Can you confirm? Then I would choose plan B. | 19:26 |
lifeless | jd__: whats a project that uses etc files? nova doesn't have any | 19:26 |
openstackgerrit | Mikhail S Medvedev proposed openstack-infra/system-config: Add #openstack-third-party-ci to channel logging https://review.openstack.org/278574 | 19:26 |
mtreinish | SpamapS: heh, subunit2sql is running on 5.6.17 | 19:26 |
lifeless | ah, neutron | 19:26 |
mordred | lifeless: good - you're here - I haven't tried that in forever | 19:27 |
clarkb | jeblair: https://review.openstack.org/#/c/277941/ would be a good one to get into nodepool soon | 19:27 |
*** jpr has quit IRC | 19:27 | |
clarkb | mordred: also I commented on your nodepool docs change, if we can address those items I will happily fast approve | 19:28 |
*** abregman is now known as abregman|afk | 19:28 | |
lifeless | dstufft: oh wow | 19:28 |
lifeless | dstufft: pip wheel now outputs to . by default? | 19:28 |
fungi | AJaeger: yeah, i think those are basically our two options. if we do option "b" now, someone interested in option "a" later can always pick up the torch and work on implementation | 19:28 |
AJaeger | oh, kolla, kolla-mesos, ekko, steht, also use linters | 19:28 |
*** jsavak has quit IRC | 19:28 | |
mordred | clarkb: cloud in nodepool does not refer to a profile. it refers to a cloud | 19:29 |
dstufft | lifeless: hm does it? I remember talking aobut it but I don't remember what happened | 19:29 |
mordred | clarkb: a "profile" is a named vendor | 19:29 |
clarkb | mordred: I thought we explicitly renamed all that stuff because that was confusing | 19:29 |
mordred | clarkb: we did- just the opposite way of how you're thinking | 19:29 |
clarkb | ah | 19:29 |
lifeless | dstufft: can you remember the status of /etc handling in wheels ? | 19:29 |
clarkb | mordred: ok, then just pointing at oscc docs for "this is what the thing is and where it can live" and addressing the ipv6 thing | 19:30 |
mordred | clarkb: "rackspace" is a profile that the cloud "rax" has in our config | 19:30 |
mordred | clarkb: yes | 19:30 |
lifeless | dstufft: I'm just looking at https://review.openstack.org/#/c/274077/5 closely, and my recollection is that wheel doesn't support /etc as a thing | 19:30 |
*** electrofelix has joined #openstack-infra | 19:30 | |
clarkb | mordred: nodepool will actually internally set a nodes ip attribute in the db and elsewhere to the ipv6 addr with that flag set | 19:30 |
dstufft | lifeless: /etc no, it supports data_files which are installed relative to sys.prefix (which sadly, is different then how they are treated in setuptools....) | 19:30 |
mordred | clarkb: so - ipv6-preferred is also shade thing | 19:30 |
mordred | clarkb: but you are right, we are not using that yet | 19:30 |
clarkb | mordred: its also a nodepool thing | 19:30 |
mordred | clarkb: so I'll fix it | 19:31 |
dstufft | but the same to how it is treated in distutils | 19:31 |
mordred | clarkb: once we do shade-nodepool it will be an occ thing | 19:31 |
*** mrmartin has quit IRC | 19:31 | |
*** infra-re_ has joined #openstack-infra | 19:31 | |
mordred | because it controls what gets set into the interface_ip field of the server metadata which is where nodepool will pull the value to store in the db | 19:31 |
clarkb | mordred: nodepool will lilkely need to special case that but it can read the value from cloud config | 19:31 |
mordred | however, your review is correct as nodepool exists today | 19:31 |
mordred | clarkb: I see no reason why nodepool would need to special case tht | 19:32 |
clarkb | mordred: oh gotcha that is even ebtter on the shade - nodepool interaction | 19:32 |
mordred | phew | 19:32 |
mordred | I thought I'd missed something major :) | 19:32 |
clarkb | mordred: I was expecting shade to still return ipv4 and nodepool would have to sort between all the adrds | 19:32 |
clarkb | which is basically what it does today | 19:32 |
*** jsavak has joined #openstack-infra | 19:33 | |
*** rockyg has joined #openstack-infra | 19:33 | |
notmorgan | jeblair yes. Just slow going. If someone else picks it up, all good. | 19:33 |
lifeless | sdague: remind me; did nova go to a model of having no files needed in /etc by default ? | 19:34 |
sdague | lifeless: no | 19:34 |
*** hashar has joined #openstack-infra | 19:34 | |
mordred | clarkb: yah - turns out sorting through the addrs is hard | 19:34 |
clarkb | mordred: fwiw after talking to zxiiro last night I really really think the next item to solve in neutron API is the whole "public" vs "private" distinguishing | 19:34 |
jeblair | clarkb: +2 with comments | 19:35 |
mordred | clarkb: ++ | 19:35 |
mordred | clarkb: very much so | 19:35 |
*** infra-red has quit IRC | 19:35 | |
openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Document clouds.yaml as the preferred configuration https://review.openstack.org/278529 | 19:35 |
mordred | clarkb: ^^ updated | 19:35 |
clarkb | jeblair: thanks | 19:36 |
*** achanda has quit IRC | 19:36 | |
lifeless | sdague: hmm, I didn't see any etc files in nova's setup.cfg | 19:36 |
rpioso | lifeless: For a Py script named foo, I tried http://pastebin.com/Rx6aZNyw, but it didn't work. | 19:37 |
sdague | lifeless: you are assuming pip install nova is all you need for a running nona | 19:37 |
sdague | which is not true | 19:37 |
lifeless | sdague: I'm not assuming anything actually - I'm looking into what we're doing in projects in response to a pbr patch | 19:38 |
*** daemontool has quit IRC | 19:38 | |
lifeless | sdague: and thus asking you stuff :) | 19:38 |
sdague | lifeless: ok | 19:38 |
lifeless | sdague: the pbr patch adds a sysconf-dir option, which wheel doesn't support | 19:38 |
lifeless | sdague: and I'd like, if I end up saying 'no, we really can't do this', to be able to say 'this is what nova does, copy them' (if thats sensible) | 19:38 |
lifeless | sdague: so, what does nova do ? | 19:39 |
sdague | some number of months ago I was waved off the idea of making the servers installable | 19:39 |
sdague | require another installer: i.e. devstack, puppet, ansible, etc.... | 19:39 |
*** hdd has quit IRC | 19:39 | |
sdague | like all our server projects | 19:39 |
AJaeger | jeblair, fungi : I drafted an email before sending out patches: https://etherpad.openstack.org/p/C2CWVcO7dz - will that one work? | 19:39 |
clarkb | mordred: I was going to fast approve but two other reviewers were faster than me | 19:40 |
jd__ | lifeless: gnocchi at least | 19:40 |
jd__ | lifeless: and I get beaten by packages for not having a way to put them in the right directory | 19:40 |
jd__ | s/packages/packagers/ | 19:40 |
mordred | lifeless: I agree with sdague, btw | 19:41 |
AJaeger | jeblair, fungi, feel free to edit | 19:41 |
sdague | mordred: agree with what? Because I think it actually sucks that we can't do a real install from python | 19:41 |
mordred | sdague: well, it may suck, but it's the case as it is due to how wheels work | 19:41 |
mordred | sdague: oh - nevermind - I agree with your characterization | 19:42 |
sdague | mordred: right sure, it's the way things are. | 19:42 |
mordred | sdague: I misread a connecting word in your sentence | 19:42 |
sdague | it makes me sad | 19:42 |
sdague | because I'd really like to live in a universe where we could make pip install nova a thing | 19:42 |
*** doug-fish has joined #openstack-infra | 19:43 | |
clarkb | fungi: sdague https://jenkins07.openstack.org/job/gate-grenade-dsvm-multinode/2740/ is an ovh grenade run with preallocated swapfile | 19:44 |
mordred | so ... | 19:44 |
mordred | sdague: I have a suggestion for that - but it might be weird | 19:44 |
mordred | sdague: put your example /etc files into the nova package as pacakge data | 19:44 |
*** achanda has joined #openstack-infra | 19:45 | |
*** rajinir has quit IRC | 19:45 | |
mordred | sdague: then include a command that is "nova-init-config" that will write those files into /etc/nova | 19:45 |
clarkb | there are currently 50GB of disk avaiable on / | 19:45 |
mordred | sdague: the main problem is that pip doesn't have a way to track files specifically | 19:45 |
mordred | sdague: so if pip always installed the files, you'd get file clobbers on upgrade | 19:45 |
jeblair | mordred: i like that idea (the command should of course be careful not to overwrite them) | 19:45 |
sdague | mordred: right, it just all seems kind of wonky | 19:45 |
mordred | if you had config management lay down the files in the first place | 19:45 |
mordred | sdague: pip is and never will be an actual package manager - you need apt or yum for that | 19:46 |
lifeless | mordred: pep 491 will help | 19:46 |
sdague | there is also the issue of building packages from this | 19:46 |
lifeless | mordred: pip tracks the files | 19:46 |
mordred | sdague: but - a one-command "please write out things that a package manager would normally write out" - is _less_ wonky than ont being able to do it at all | 19:46 |
sdague | which means you need the ability to reroot it all | 19:46 |
lifeless | mordred: it toally does | 19:46 |
jeblair | mordred: we could do that for gertty too... | 19:46 |
nibalizer | mordred: haha so use an install wizard? | 19:46 |
sdague | sound like a good pbr extension, no? | 19:46 |
lifeless | sdague: possibly yes | 19:47 |
mordred | lifeless: sure - but it doesn't so much have apt/yum like facilities to say "hey, you changed this file I want to write, do you want me to overwrite?" | 19:47 |
sdague | I honestly don't want to invent a custom hack locally in nova | 19:47 |
openstackgerrit | Craig Vyvial proposed openstack-infra/project-config: run trove experimental run scenario tests https://review.openstack.org/278095 | 19:47 |
mordred | sdague: I also don't want you to do that | 19:47 |
mordred | sdague: I agree with lifeless - possibly yes | 19:47 |
*** krotscheck is now known as krotscheck_dcm | 19:47 | |
sdague | but if something showed up in pbr that allowed for such a thing, adding the pbr config to do it would be nice | 19:47 |
*** abregman|afk is now known as abregman | 19:47 | |
sdague | and I'd love to live in a world where that was a real thing you could do | 19:48 |
mordred | jeblair: I thnk the command should by default not overwrite them - but also have a --force flag | 19:48 |
*** Sukhdev_ has joined #openstack-infra | 19:48 | |
mordred | sdague: you and me both | 19:48 |
jeblair | mordred, lifeless: gertty has several alternate example config files; selection of which might be nice; but if that's too much, would probably just install the full reference one with all the options... | 19:48 |
slogan621 | what are these notifications from openstackgerrit bot triggered by, like the one above at 11:47 | 19:48 |
slogan621 | ? | 19:48 |
* slogan621 is a newbie | 19:48 | |
mordred | slogan621: openstackgerrit watches the gerrit event stream | 19:48 |
jeblair | slogan621: the one at 19:47 UTC was triggered by the gerrit event stream | 19:49 |
mordred | slogan621: https://review.openstack.org/Documentation/cmd-stream-events.html | 19:49 |
AJaeger | jeblair, fungi : should I send that email as is? | 19:49 |
slogan621 | thanks | 19:49 |
jeblair | AJaeger: wfm | 19:49 |
* slogan621 reads | 19:49 | |
fungi | AJaeger: sorry, looking now. i'm having about 10 different conversations at once | 19:50 |
*** electrofelix has quit IRC | 19:50 | |
AJaeger | sorry, fungi. Thanks, jeblair. | 19:50 |
fungi | AJaeger: corrected one minor typo: conversation->conversion | 19:51 |
*** matrohon has joined #openstack-infra | 19:51 | |
fungi | otherwise lgtm | 19:51 |
fungi | send at your leisure | 19:51 |
dmsimard | Does openstack-infra still have a puppetboard instance ? | 19:51 |
dmsimard | The link I found was puppetdb.openstack.org but that doesn't seem to work. | 19:52 |
fungi | dmsimard: surprisingly, at http://puppetboard.openstack.org/ | 19:52 |
AJaeger | thanks, fungi | 19:52 |
dmsimard | fungi: doesn't load for me :( | 19:52 |
fungi | dmsimard: ...for some definitions of "have" i guess. it was working yesterday | 19:52 |
*** notnownikki has quit IRC | 19:52 | |
mordred | it also does not work for me | 19:53 |
fungi | now it's taking a while and eventually throwing an internal server error | 19:53 |
mordred | fungi: maybe we need to restart java? | 19:53 |
dmsimard | fungi: yeah I actually *just* got the internal server error | 19:53 |
*** ociuhandu has quit IRC | 19:53 | |
fungi | last time i saw this, there was a corrupt report file which was causing it to fail to load | 19:53 |
rpioso | lifeless: Resending, ... For a Py script named foo, I tried http://pastebin.com/Rx6aZNyw, but it didn't work. | 19:54 |
*** ccrouch has joined #openstack-infra | 19:54 | |
*** mrmartin has joined #openstack-infra | 19:54 | |
rpioso | lifeless: Am I specifying it correctly? | 19:55 |
*** esikachev has quit IRC | 19:55 | |
*** doug-fish has quit IRC | 19:55 | |
fungi | dmsimard: mordred: cpu usage is spiking up pretty high briefly, but system load average is not bad, memory consumption and disk utilization look under control, et cetera | 19:56 |
fungi | according to cacti | 19:56 |
fungi | no indication of a recent oom in dmesg output, puppetdb log isn't filled with errors | 19:56 |
*** esikachev has joined #openstack-infra | 19:56 | |
dmsimard | wsgi/apache error logs ?& | 19:56 |
fungi | that's where i'm looking next | 19:56 |
fungi | working my way up the stack there | 19:57 |
*** jgriffith is now known as jgriffith_away | 19:57 | |
fungi | [Wed Feb 10 19:57:19 2016] [error] ERROR:pypuppetdb.api:Could not reach PuppetDB on localhost:8080 over HTTP. | 19:57 |
fungi | yeah, that's no good | 19:57 |
openstackgerrit | Merged openstack-infra/system-config: Add infracloud playbook https://review.openstack.org/234535 | 19:58 |
fungi | nothing listening on 8080/tcp locally | 19:58 |
*** eliqiao_ has quit IRC | 19:59 | |
openstackgerrit | Brant Knudson proposed openstack-infra/project-config: Revert "Support stable requirements" https://review.openstack.org/278588 | 19:59 |
*** nadya has joined #openstack-infra | 20:00 | |
*** nadya is now known as Guest6137 | 20:00 | |
*** rfolco has quit IRC | 20:01 | |
fungi | though that goes back periodically as far as we have logs | 20:01 |
fungi | which i think means puppetdb is "down" from time to time? | 20:01 |
*** arthus has quit IRC | 20:02 | |
*** doug-fish has joined #openstack-infra | 20:02 | |
*** eliqiao_ has joined #openstack-infra | 20:02 | |
crinkle | fungi: I don't think puppetdb was ever running on 8080 http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/puppetdb.pp#n24 | 20:02 |
fungi | weird, then i wonder why puppetboard is trying to reach that? | 20:03 |
crinkle | nibalizer: ^ ? | 20:03 |
fungi | oho! now i see it listed again | 20:04 |
fungi | and puppetboard is working again | 20:04 |
fungi | very strange | 20:04 |
*** Guest6137 has quit IRC | 20:04 | |
fungi | also odd is its socket implementation | 20:04 |
fungi | tcp6 0 0 127.0.0.1:8080 :::* LISTEN | 20:04 |
fungi | that seems... contradictory?\ | 20:04 |
fungi | shouldn't that be tcp 127.0.0.1:8080 and tcp6 ::1:8080? | 20:05 |
*** Sukhdev_ has quit IRC | 20:06 | |
clarkb | http://paste.openstack.org/show/486620/ caught a hung nodepool test on db delete | 20:06 |
clarkb | realize I should record the name of the schema we are dropping so will add that to my change | 20:06 |
clarkb | mordred: ^ that may be less indecipherable to you, but looks like posibly we are creating an index on a table and that has it hung up? | 20:07 |
lifeless | rpioso: that seems incomplete | 20:08 |
nibalizer | puppetboard listens locally on 8080 | 20:08 |
nibalizer | unauthenticated | 20:08 |
mordred | clarkb: that does seem like an index create | 20:08 |
lifeless | rpioso: basically though, you'll need to figure it out, because its really not a use case today | 20:08 |
nibalizer | er /spuppetboard/puppetdb/ | 20:08 |
mordred | SpamapS: ^^ that read to you? | 20:08 |
*** daemontool has joined #openstack-infra | 20:08 | |
nibalizer | so puppetboard contacts it on 8080 local | 20:08 |
lifeless | rpioso: doing it the same as everything else is trivial, and you can have tests that way, in the stock layout openstack uses | 20:08 |
nibalizer | unfortunately our puppetdb is sick | 20:08 |
lifeless | mordred: wheel RECORD files have hashes of everything installed | 20:09 |
nibalizer | related https://review.openstack.org/#/c/272850/ | 20:09 |
lifeless | mordred: pip can totally detect modified vs unmodified. Is there a UX around that today? no. | 20:09 |
daemontool | fungi, jeblair at your convenience please https://review.openstack.org/#/c/278323/ | 20:09 |
Sam-I-Am | dhellmann: ping | 20:09 |
*** jtomasek has quit IRC | 20:10 | |
lifeless | mordred: *should* there be? Even more fascinating question | 20:10 |
mordred | lifeless: right - sorry, I was mostly meaning that there is currently no UI that would make it seem to a user like pip did anything with that information | 20:10 |
mordred | and yes | 20:10 |
Sam-I-Am | dhellmann: having a docs publishing problem, maybe you can help? | 20:10 |
clarkb | mordred: I will be adding explicit recording of the schema being dropped whcih should allow us to more easily map onto the transaction log | 20:10 |
fungi | nibalizer: got it, so it's a process inside the jvm running out of memory, not system-level process under init | 20:10 |
rpioso | lifeless: I only provided what I consider to be the relevant section of setup.cfg. | 20:10 |
nibalizer | yes | 20:10 |
clarkb | testing it locally first | 20:10 |
nibalizer | I'm not sure what that word is | 20:10 |
nibalizer | maybe just javaOutOfMemoryException | 20:10 |
*** esikachev has quit IRC | 20:11 | |
jeblair | clarkb, mordred: why does it show up in 2 transactions? | 20:12 |
rpioso | lifeless: What do you mean by "its really not a use case today"? | 20:12 |
*** xyang1 has joined #openstack-infra | 20:12 | |
*** tmcpeak has joined #openstack-infra | 20:13 | |
lifeless | rpioso: installing a single .py file is something that so far no openstack project has needed to do | 20:13 |
tmcpeak | AJaeger: you around? | 20:13 |
*** andymaier has quit IRC | 20:13 | |
jeblair | clarkb, mordred: two transactions, referencing the same thread, one committing, one not started | 20:13 |
openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Show innodb status before dropping db https://review.openstack.org/278146 | 20:13 |
lifeless | rpioso: perhaps I'm misunderstanding what you're attempting | 20:13 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use pep8 for keystone projects https://review.openstack.org/278593 | 20:13 |
AJaeger | tmcpeak: yes | 20:13 |
tmcpeak | AJaeger: Are we back to the drawing board for "bandit" gates then? | 20:14 |
clarkb | jeblair: that is an excellent question | 20:14 |
tmcpeak | I guess we should do a separate template, etc | 20:14 |
clarkb | jeblair: two different sessions performing the same action? | 20:15 |
AJaeger | tmcpeak: no, we rename linters to pep8, and bandit stays in pep8 | 20:15 |
jeblair | clarkb: the same thread id makes me think no, but i know very little about this :) | 20:15 |
tmcpeak | AJaeger: ahh ok, got it | 20:15 |
jeblair | clarkb: what does that look like when it doesn't hang? | 20:15 |
clarkb | one sec will pull that out of my local testing | 20:15 |
rpioso | lifeless: No worries. I'm trying to install Py packages, along with a closely related script that uses them. | 20:15 |
*** ldnunes has quit IRC | 20:16 | |
*** achanda has quit IRC | 20:16 | |
*** sfinucan has quit IRC | 20:16 | |
jeblair | clarkb: (but yeah, if it were two sessions performing the same action, that might go a long way to explaining things) | 20:16 |
tmcpeak | AJaeger: did you make the change to call bandit in the non-linters target or should I? | 20:16 |
*** hdd has joined #openstack-infra | 20:16 | |
clarkb | jeblair: http://paste.openstack.org/show/486623/ | 20:16 |
AJaeger | tmcpeak: I just send a change for bandit itself | 20:16 |
clarkb | jeblair: that is the transaction portion from my local run | 20:16 |
lifeless | rpioso: define script | 20:17 |
clarkb | and it did not hang locally | 20:17 |
lifeless | rpioso: it may be that we're miscommunicating | 20:17 |
nibalizer | infra-root: the IC-west stuff landed | 20:17 |
lifeless | rpioso: or better yet, supply the whole setup.cfg | 20:17 |
AJaeger | tmcpeak: https://review.openstack.org/#/q/topic:pti-pep8-linters | 20:17 |
nibalizer | i'm monitoring | 20:17 |
tmcpeak | ok, if we're actually removing the target that calls linters from infra I assume Bandit would fail unless it gets changed over too? | 20:17 |
jeblair | clarkb: so only one thing there | 20:17 |
AJaeger | tmcpeak: so, first changing bandit project, then changing infra. I'll take care of that | 20:17 |
rpioso | lifeless: I would like the script to be readily available to users. | 20:17 |
tmcpeak | AJaeger: got it, thank you | 20:18 |
rpioso | lifeless: By script I mean a Py module with name equal to __main__. | 20:18 |
*** doug-fish has quit IRC | 20:18 | |
clarkb | one unlikely theory would be that our random db generation isn't really random enough | 20:18 |
clarkb | we add the pid though and since we only run a test at a time that should be fine if it is the case | 20:19 |
lifeless | rpioso: can you supply the whole setup.cfg? It would be a lot easier to reason about if I could actually see it | 20:19 |
clarkb | one at a time per pid | 20:19 |
rpioso | lifeless: That can be executed at the shell via "python script.py". | 20:19 |
anteaya | pleia2: would hashar know if mediawiki has an open infra | 20:19 |
hashar | anteaya: pleia2: hello! I might be able to answer :-) | 20:20 |
*** doug-fish has joined #openstack-infra | 20:20 | |
clarkb | jeblair: the query id and thread are the same for both but the transaction id differs | 20:20 |
anteaya | hashar: awesome | 20:20 |
pleia2 | hashar: I run a list of open source projects that run an open source infra, is mediawiki the project one of them? | 20:20 |
jeblair | clarkb: yep, doesn't make a lot of sense to me yet | 20:21 |
anteaya | http://opensourceinfra.org/ | 20:21 |
anteaya | hashar: ^^ | 20:21 |
tmcpeak | AJaeger: if projects run this way, then how can they run pep8 standalone? | 20:21 |
tmcpeak | will Bandit always be included with pep8? | 20:21 |
tmcpeak | separate runs seems useful in cases | 20:21 |
pleia2 | hashar: I know you *use* open source tooling, just wasn't sure if your configs and stuff are open source and people can contribute to them | 20:21 |
*** jgriffith_away is now known as jgriffith | 20:22 | |
tmcpeak | AJaeger: I'm not sure that gets us where we want to be | 20:22 |
AJaeger | tmcpeak: they can create separate environments for these. | 20:22 |
hashar | pleia2: anteaya: the whole Wikimedia infrastructure is based on open source software and almost its entire configuration is public and editable (as one can propose a change in Gerrit). That includes all DNS entries, puppet, server side conf for php etc | 20:22 |
clarkb | jeblair: the latest patchset will at least allow us to confirm if the db being deleted is the one being operated on | 20:22 |
tmcpeak | AJaeger: separate pep8 environment that isn't called pep8? | 20:22 |
clarkb | jeblair: hopeflly we can get it to trip over this issue quickly | 20:22 |
tmcpeak | AJaeger: approaching a different direction, why couldn't "linters" be the standard target | 20:23 |
*** achanda has joined #openstack-infra | 20:23 | |
AJaeger | pep8 already has in many projects other lint like jobs, so adding bandit there is no problem | 20:23 |
rpioso | lifeless: Thank you. The entire setup.cfg is at http://pastebin.com/58qsiY5n | 20:23 |
tmcpeak | AJaeger: do you know of an example off the top of your head I can check out? | 20:23 |
*** ociuhandu has joined #openstack-infra | 20:23 | |
lifeless | rpioso: so, on disk you have foo/__main__.py ? | 20:23 |
AJaeger | tmcpeak: read the scrollback here, e.g. on eavesdrop. To make it the standard, we would need to adopt all official projects - and that's far more than I can sign up for. | 20:23 |
tmcpeak | AJaeger: ok, I'll read it | 20:24 |
pleia2 | hashar: asking specifically about mediawiki the project, is there a link to where people can learn about it in order to contribute? | 20:24 |
*** harlowja_at_home has quit IRC | 20:25 | |
*** mrmartin has quit IRC | 20:25 | |
hashar | pleia2: for the CI system ? The landing page would be http://www.mediawiki.org/wiki/CI | 20:25 |
rpioso | lifeless: I have a project directory named foo. It contains README.rst, foo.py, requirements.txt, setup.cfg, and setup.py. | 20:25 |
lifeless | then your script is not named __main__ | 20:26 |
*** piet has joined #openstack-infra | 20:26 | |
lifeless | so your entry point should say foo.foo:main | 20:26 |
lifeless | assuming your entry function is called main | 20:26 |
rpioso | lifeless: foo.py contains main()... and if __name__ == "__main__": main() | 20:26 |
lifeless | rpioso: the __name__ stuff is entirely irrelevant for entry points | 20:27 |
*** kozhukalov_ has joined #openstack-infra | 20:27 | |
rpioso | lifeless: K. Just trying to be clear :-) | 20:27 |
lifeless | I appreciate that | 20:28 |
lifeless | one of the complexities here is that 'name' can refer to __name__, a variable set by python's import system, or the name on disk | 20:29 |
*** Swami has quit IRC | 20:29 | |
lifeless | and both of those have the special __main__ value | 20:29 |
rpioso | lifeless: I've tried foo.foo:main. That only seems to work if foo.py is in a Py package named foo. | 20:29 |
lifeless | with very different meanings | 20:29 |
*** matrohon has quit IRC | 20:29 | |
tmcpeak | AJaeger: I think I'd rather just create a Bandit template | 20:29 |
*** EricGonc_ has quit IRC | 20:29 | |
lifeless | rpioso: you said you had a package called foo | 20:29 |
lifeless | rpioso: packages = foo | 20:29 |
lifeless | rpioso: in your setup.cfg | 20:29 |
tmcpeak | I liked your idea of the linters target, but bundling Bandit into pep8 really doesn't feel clean to me, they're really totally different except they can both be described as a linter | 20:29 |
*** kozhukalov has quit IRC | 20:30 | |
*** infra-re_ has quit IRC | 20:30 | |
rpioso | lifeless: I do have a package named foo. However, I don't want foo.py to live in that package. | 20:30 |
fungi | tmcpeak: the name of the pep8 environment is already misleading because it doesn't directly invoke pep8 and only pep8 | 20:30 |
lifeless | rpioso: why not? | 20:30 |
tmcpeak | fungi: agreed | 20:31 |
fungi | tmcpeak: however, the _name_ pep8 is an arbitrary string encoded in our project testing interface standard in governance | 20:31 |
AJaeger | tmcpeak: linters and pep8 had the same purpose, the indented change was a pure rename. | 20:31 |
rpioso | lifeless: Cuz then relative imports don't work. | 20:31 |
AJaeger | tmcpeak: pep8 already calls for many projects bashate or doc8 | 20:31 |
lifeless | rpioso: so don't call it foo.py ? | 20:31 |
fungi | (or flake8 which also has pyflakes and hacking and potentially other plugins)_ | 20:31 |
AJaeger | tmcpeak: starting a new VM just for bandit is a lot of waste | 20:32 |
*** jsavak has quit IRC | 20:32 | |
*** e0ne has quit IRC | 20:32 | |
AJaeger | fungi, jeblair: Do you want to +2 https://review.openstack.org/278593 to get keystone "pep8ed" again? | 20:32 |
rpioso | lifeless: The name of the script doesn't affect the availability of relative imports. | 20:32 |
tmcpeak | AJaeger: I see your point, although really since the job is called pep8 and then lumping all of the pass fail for potentially serious security issues into the style checking part of the gate feels off | 20:32 |
rpioso | lifeless: I tried a different name. | 20:33 |
tmcpeak | fungi: ^ | 20:33 |
lifeless | rpioso: sure it does; its failing because a module foo inside a package foo shadows the name foo | 20:33 |
fungi | tmcpeak: well, if they fail the job will fail, right? and if they pass and everything else is also passing, the job will pass | 20:33 |
AJaeger | tmcpeak: I prefer linters as well but getting this through in the proper way is more than I can commit to. If anybody wants to take it on, I can assist | 20:33 |
*** jsavak has joined #openstack-infra | 20:33 | |
openstackgerrit | Sean Dague proposed openstack-infra/project-config: create openstack/service-registry https://review.openstack.org/278612 | 20:33 |
*** dims has quit IRC | 20:34 | |
*** fawadkhaliq has quit IRC | 20:34 | |
tmcpeak | fungi: ok so what's the realistic path for a project that wants to add the Bandit gate and still be able to get a separate style check? | 20:34 |
fungi | tmcpeak: basically it's a very large amount of work to change a cosmetic issue (renaming an arbitrary string from "pep8" to "linters") so while i agree it seems like something i wouldn't object to, someone would need to have time to invest in a proper phased implementation through governance and down to all repos following the pti | 20:35 |
tmcpeak | they add Bandit in pep8, now the thing that used to be called pep8 and actually runs pep8 is called some arbitrary other thing? | 20:35 |
rpioso | lifeless: Unfortunately, it didn't for me. | 20:35 |
*** dims has joined #openstack-infra | 20:35 | |
fungi | tmcpeak: the thing which runs pep8 runs all sorts of arbitrary other things already | 20:35 |
tmcpeak | fungi: well it's not entirely cosmetic, a project loses their ability to just run style checks by adding bandit unless they do something else special | 20:35 |
lifeless | rpioso: ok, well here's the situation - all the openstack projects put their CLI entry points inside the project package itself | 20:35 |
*** aysyd has quit IRC | 20:36 | |
lifeless | rpioso: and it works fine. I can probably diagnose whats not working for you, but I can't with the information asymmetry going on right now | 20:36 |
fungi | tmcpeak: i argued to call it "static-analyzers" rather than "pep8" or "linters" fwiw | 20:36 |
lifeless | rpioso: if you want to push up a tree to github or something where I can actually test it and figure out whats up with your relative imports, I'd be happy ro do that | 20:36 |
tmcpeak | fungi, AJaeger: ok cool, I see your points | 20:36 |
dims | clarkb : fungi : which version of tox do we use? | 20:37 |
tmcpeak | it is a ton of work for something mostly cosmetic | 20:37 |
lifeless | rpioso: short of that though - this stuff works :) | 20:37 |
*** yamahata has joined #openstack-infra | 20:37 | |
fungi | tmcpeak: but i'm also not especially invested in whether bandit jobs should be bundled into jobs that run all the other static analyzers or kept separate | 20:37 |
tmcpeak | so I should advise projects that add Bandit to add it in their pep8 section, and then maybe make a separate target that does Bandit and PEP8 separately if they want? | 20:37 |
rpioso | lifeless: Do the projects use relative imports? Silly question, perhaps. | 20:37 |
*** dtardivel has quit IRC | 20:38 | |
*** matrohon has joined #openstack-infra | 20:38 | |
lifeless | rpioso: depends on what you mean, since that term has had at least two definitions in python | 20:38 |
*** dkranz has quit IRC | 20:38 | |
fungi | tmcpeak: what are the reasons why a project which successfully complies with bandit (or has sufficient skips/overrides in place to work around the existing noncompliance) would want to not run bandit checks when they run other static analyzers? does it take a lot longer than the others, or have tons of extra requirements, or something? | 20:38 |
clarkb | dims: looks like latest (but with the image build lag time) | 20:39 |
dims | clarkb : ack thanks | 20:39 |
*** ccrouch has quit IRC | 20:39 | |
*** burgerk has joined #openstack-infra | 20:39 | |
*** angdraug has joined #openstack-infra | 20:39 | |
tmcpeak | fungi: no, neither of those hold true. I suppose having the idea of "linters" now called "pep8" really doesn't make a difference (except cosmetic) | 20:39 |
*** gokrokve has quit IRC | 20:40 | |
clarkb | dims: devstack may update it when it runs but for everything else they will use the system installed version included in the image | 20:40 |
openstackgerrit | Colleen Murphy proposed openstack/diskimage-builder: Fix dpkg element for Ubuntu Xenial https://review.openstack.org/278617 | 20:40 |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API https://review.openstack.org/221964 | 20:40 |
fungi | tmcpeak: from a standpoint of pragmatism, it makes one less thing developers have to remember to run locally, and one less job they need to remember to add in the ci | 20:40 |
AJaeger | tmcpeak: and I guess you want to encourage develoeprs to run bandit when they run pep8 as well... | 20:40 |
*** |-paul-| has joined #openstack-infra | 20:40 | |
dims | clarkb : so what ever "apt-get install python-tox" fetches? | 20:41 |
clarkb | dims: no it is pip install tox | 20:41 |
AJaeger | better to catch errors early ;) | 20:41 |
dims | clarkb : ah even better. thanks | 20:41 |
tmcpeak | fungi, AJaeger: yeah, I guess my only concern is it makes it feel like a slightly bigger step to adopt Bandit | 20:41 |
nibalizer | seems to have not lolsploded | 20:41 |
*** rockyg has quit IRC | 20:41 | |
fungi | tmcpeak: and hopefully people who _strongly_ object to the naming inaccuracy have time to correct it properly through a cross-project effort rather than taking the easy and less efficient way out | 20:41 |
rpioso | lifeless: By relative import, I mean what's described as "explicit relative imports" in section 6.4.2 of https://docs.python.org/2/tutorial/modules.html. | 20:42 |
tmcpeak | fungi: cool, yeah fair enough | 20:42 |
*** kzaitsev_mb has joined #openstack-infra | 20:42 | |
tmcpeak | AJaeger, fungi: I appreciate your effort on this | 20:42 |
fungi | tmcpeak: i appreciate the discussion! | 20:42 |
*** kozhukalov has joined #openstack-infra | 20:42 | |
*** HeOS has joined #openstack-infra | 20:43 | |
clarkb | keep in mind pep8 is self testing | 20:43 |
*** sdake has quit IRC | 20:43 | |
clarkb | so any project adding bandit to the pep8 target will be self tested and any issues can be corrected | 20:43 |
*** EricGonczer_ has joined #openstack-infra | 20:43 | |
clarkb | it actually makes adoption simpler in many cases than adding a new separate job then iterating on why it fials | 20:43 |
rpioso | lifeless: Thank you for your offer to look at some code. Much appreciated. | 20:44 |
fungi | tmcpeak: but basically "pep8" was no longer accurately named when most projects started calling flake8 from it years ago | 20:44 |
lifeless | rpioso: that should work fine | 20:44 |
tmcpeak | fungi: yeah, it's a fair point | 20:44 |
*** maishsk has quit IRC | 20:44 | |
*** jpeeler has quit IRC | 20:44 | |
tmcpeak | fungi: feels like just semantics so it should be fine | 20:44 |
*** alexpilotti_ has joined #openstack-infra | 20:44 | |
tmcpeak | fungi: we can revisit later if there are problems I'm not seeing now | 20:45 |
AJaeger | sure, thanks for understanding, tmcpeak | 20:45 |
*** kozhukalov_ has quit IRC | 20:45 | |
*** jgriffith is now known as jgriffith_away | 20:45 | |
tmcpeak | thanks for all the effort on it | 20:46 |
rpioso | lifeless: I'll try to put together a simple sample that illustrates what I've been seeing and publish it on github. | 20:46 |
*** tzn has joined #openstack-infra | 20:46 | |
*** maishsk has joined #openstack-infra | 20:46 | |
*** gildub has joined #openstack-infra | 20:46 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use pep8 instead of linters for kolla* https://review.openstack.org/278622 | 20:46 |
*** hdd has quit IRC | 20:47 | |
lifeless | rpioso: I'm happy looking at your current code for this, it doesn't need to be made super simple | 20:47 |
*** eil397 has joined #openstack-infra | 20:47 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API https://review.openstack.org/221964 | 20:47 |
*** EricGonczer_ has quit IRC | 20:48 | |
rpioso | lifeless: Simpler may simplify it for me, if you know what I mean :) I'll circle back with you when it's available. | 20:49 |
rpioso | lifeless: Thanks for being accommodating, tho. | 20:49 |
lifeless | np | 20:49 |
lifeless | gl | 20:49 |
*** tzn has quit IRC | 20:51 | |
*** tmcpeak has left #openstack-infra | 20:51 | |
*** tzn has joined #openstack-infra | 20:51 | |
*** zeih_ has joined #openstack-infra | 20:53 | |
*** e0ne has joined #openstack-infra | 20:53 | |
*** kozhukalov_ has joined #openstack-infra | 20:55 | |
*** rvasilets__ has quit IRC | 20:56 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use pep8 instead of linters for bandit https://review.openstack.org/278627 | 20:56 |
*** ccrouch has joined #openstack-infra | 20:56 | |
*** abregman is now known as abregman|afk | 20:56 | |
*** apoorvad has quit IRC | 20:59 | |
*** HeOS has quit IRC | 20:59 | |
daemontool | AJaeger, if that's allright, could you +A this review please https://review.openstack.org/#/c/278323/ | 21:00 |
*** kozhukal` has joined #openstack-infra | 21:01 | |
AJaeger | daemontool: done | 21:01 |
*** kozhukal` has quit IRC | 21:02 | |
*** abregman|afk is now known as abregman | 21:02 | |
openstackgerrit | Merged openstack/requirements: Change global requirements forcing cliff!=1.16.0 https://review.openstack.org/278299 | 21:02 |
openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: import release-test repository https://review.openstack.org/278495 | 21:03 |
*** zeih_ has quit IRC | 21:03 | |
*** jlk has quit IRC | 21:05 | |
*** jlk has joined #openstack-infra | 21:05 | |
*** jlk has quit IRC | 21:05 | |
*** yamahata has quit IRC | 21:06 | |
*** jlk has joined #openstack-infra | 21:06 | |
*** daemontool has quit IRC | 21:07 | |
*** ybathia has joined #openstack-infra | 21:07 | |
jamielennox | clarkb: yes, keystoneauth plugins get tokens as required - however there is an invalidate() method that can be used to drop auth | 21:07 |
*** mrmartin has joined #openstack-infra | 21:07 | |
*** mrmartin has quit IRC | 21:07 | |
jamielennox | clarkb: so not so much force it to get a new token, but you can invalidate() then get_token() and you'll practically always get a new one | 21:07 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use pep8 for doc projects https://review.openstack.org/278633 | 21:08 |
jamielennox | clarkb: but i'd be interested in why you really need a new one if you're using the same credentials | 21:08 |
*** dkranz has joined #openstack-infra | 21:09 | |
clarkb | jamielennox: ya the issue is swift uplaods for large files end up being many api calls over time, so even if I invalidate at the beginning one could fail later | 21:09 |
clarkb | jamielennox: because of ^ | 21:09 |
*** e0ne has quit IRC | 21:09 | |
AJaeger | jeblair, fungi, project-config cores: Could you review 278633 and 278593, please? The first keystone changes have been approved already but 278593 is a pre-requisite | 21:09 |
clarkb | sessions should handle that gor each sub request but my reup then call macto swift level call wont | 21:09 |
*** jlk has joined #openstack-infra | 21:10 | |
openstackgerrit | Merged openstack-infra/project-config: Set conditions for devstack-dsvm and python34 on freezer https://review.openstack.org/278323 | 21:10 |
*** jlk has quit IRC | 21:10 | |
*** jlk has joined #openstack-infra | 21:10 | |
*** baoli has joined #openstack-infra | 21:11 | |
*** sdake has joined #openstack-infra | 21:12 | |
jamielennox | clarkb: so is this issue that swiftclient doesn't support sessions? | 21:12 |
clarkb | that and shade/os client config dont pass the auth details to swiftclient so it can't renew the token itself | 21:13 |
stevemar | AJaeger: if i wanted to create a dsvm job that uses cliff from source should i use something like "gate-tempest-dsvm-largeops-src-cliff" ? | 21:14 |
*** jsavak has quit IRC | 21:15 | |
dhellmann | stevemar : yeah, I think that would do it | 21:15 |
AJaeger | Not sure about the largeops name, otherwise sounds fine | 21:15 |
clarkb | but I think that only worls with password auth which is why shade/oscc do it the eay yhey do | 21:15 |
slogan621 | jeblair, fungi: Could you please review and possible approve https://review.openstack.org/#/c/275873/ | 21:15 |
*** HeOS has joined #openstack-infra | 21:15 | |
dhellmann | stevemar : though largeops may be going away soon, so I hope whoever does that provides a replacement | 21:15 |
clarkb | support more auth methods | 21:15 |
slogan621 | s/possible/if possible/ | 21:15 |
*** daemontool has joined #openstack-infra | 21:15 | |
* slogan621 thanks you | 21:15 | |
fungi | dhellmann: seemed that largeops going away was pretty inevitable from the ml thread | 21:16 |
daemontool | AJaeger, thanks a M | 21:16 |
fungi | dhellmann: and that coming up with an alternative would be up to someone with time to implement one | 21:16 |
fungi | SpamapS seemed to think he might be interested in bringing in something useful for that space in the future | 21:16 |
dhellmann | fungi : we're using that job in a lot of places as a way to test libs from source, so just deleting those instead of replacing them with another job is going to drop our test coverage drastically | 21:16 |
dhellmann | fungi : well, not a lot. a few. | 21:17 |
fungi | oh, i see. so you just mean picking another existing job to run as the backward compat verification | 21:17 |
*** sdake has quit IRC | 21:17 | |
dhellmann | right | 21:17 |
dhellmann | oslo.db, oslo.log, oslo.messaging, and oslo.rootwrap use that right now | 21:18 |
fungi | that seems fairly trivial assuming the largeops job was chosen mostly arbitrarily | 21:18 |
*** kozhukalov has quit IRC | 21:18 | |
dhellmann | yeah, just something to keep an eye out for when someone actually goes to delete the job | 21:18 |
*** jsavak has joined #openstack-infra | 21:18 | |
dhellmann | gate-tempest-dsvm-neutron-src-{name} may be a reasonable substitute | 21:18 |
*** kozhukalov has joined #openstack-infra | 21:18 | |
AJaeger | let's tell sdague about the above ^, I guess he will do the cleanup | 21:18 |
openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: add a dsvm job for cliff https://review.openstack.org/278638 | 21:19 |
hashar | pleia2: thank you for the add on http://opensourceinfra.org/ . Not sure what the site will be about that looks nice :} | 21:19 |
stevemar | dhellmann: AJaeger ^ | 21:19 |
*** alexpilotti_ has quit IRC | 21:19 | |
clarkb | largeops is likely a good one for messaging and db | 21:19 |
clarkb | because it puts some strain on those components | 21:19 |
*** baoli has quit IRC | 21:19 | |
stevemar | clarkb: oh is that the only diff between largeps and non-largeops? | 21:20 |
dhellmann | stevemar you may want to just use gate-tempest-dsvm-neutron-src-{name} from the start | 21:20 |
stevemar | yeah | 21:20 |
*** baoli has joined #openstack-infra | 21:20 | |
clarkb | stevemar: largeops uses the nova fake virt driver amd boots a hundred or so VMs | 21:20 |
stevemar | eek | 21:20 |
clarkb | the other jobs use qemu and dont boot so many VMs | 21:20 |
clarkb | but exercise a broader scope of things | 21:21 |
openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: add a dsvm job for cliff https://review.openstack.org/278638 | 21:21 |
stevemar | clarkb: thanks for the explanation, i didn't know the diff between the two | 21:21 |
*** HeOS has quit IRC | 21:21 | |
openstackgerrit | Merged openstack-infra/system-config: Puppetdb keeps ooming, give it more ram https://review.openstack.org/272850 | 21:22 |
fungi | nibalizer: ^ | 21:22 |
*** rockyg has joined #openstack-infra | 21:23 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use pep8 instead of linters for ekko https://review.openstack.org/278641 | 21:24 |
*** tiswanso has quit IRC | 21:24 | |
*** apoorvad has joined #openstack-infra | 21:24 | |
clarkb | I wonder if largeops makes sense with a longer timeout running in the periodic pipeline and monitored by the health dashboard | 21:24 |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Create ansible-role-shade project https://review.openstack.org/278643 | 21:24 |
clarkb | that way its less about perfoance and more about can we boot a large number of VMs all at once | 21:25 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use pep8 instead of linters for steth https://review.openstack.org/278644 | 21:26 |
anteaya | hashar: yay! | 21:27 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use pep8 instead of linters for terracotta https://review.openstack.org/278645 | 21:28 |
*** gildub has quit IRC | 21:28 | |
*** alivigni has quit IRC | 21:28 | |
*** maishsk has quit IRC | 21:28 | |
*** gildub has joined #openstack-infra | 21:28 | |
AJaeger | team, what happened on https://review.openstack.org/#/c/278645/ | 21:29 |
*** maishsk has joined #openstack-infra | 21:29 | |
*** jgriffith_away is now known as jgriffith | 21:29 | |
AJaeger | suhani gupta send a merge failed message ^ | 21:29 |
AJaeger | ah, no -1 - strange.... | 21:30 |
clarkb | using personal account for CI? | 21:31 |
AJaeger | and then on project-config??? | 21:31 |
AJaeger | and also on terrakotta: https://review.openstack.org/#/c/278637 | 21:32 |
rbrndt_ | saw it on moans as well https://review.openstack.org/#/c/278104/ | 21:32 |
rbrndt_ | monasca | 21:33 |
samueldmq | hi, what/who is "suhani gupta" ? | 21:33 |
samueldmq | it just posted a comment in a keystone change as it was a CI bot | 21:33 |
samueldmq | so I am here to confirm | 21:33 |
anteaya | it is a ci https://review.openstack.org/#/q/reviewer:%22suhani+gupta+%253Csuhani%2540hedviginc.com%253E%22 | 21:33 |
AJaeger | samueldmq: that's what we're wondering as well... | 21:33 |
*** ZZelle_ has joined #openstack-infra | 21:33 | |
*** ZZelle_ has quit IRC | 21:33 | |
anteaya | I'll get the id and we will shut it down | 21:33 |
bknudson_ | why is suhani gupta telling me the merge failed? https://review.openstack.org/#/c/277494/ | 21:33 |
AJaeger | anteaya: thanks! | 21:33 |
*** ZZelle_ has joined #openstack-infra | 21:33 | |
samueldmq | anteaya: so a bot doing bad things :/ | 21:34 |
AJaeger | bknudson_: anteaya is shutting that CI down... | 21:34 |
bknudson_ | oh, thanks! | 21:34 |
AJaeger | It's not giving any -1s AFAIU but very confusing ;( | 21:34 |
pabelanger | samueldmq: looks more like 3rd party CI | 21:34 |
samueldmq | and it's posting merge failed in lots of changes :( | 21:35 |
AJaeger | jeblair, fungi : I think I cleaned up all projects regarding linters. Thanks a lot for discussing this through with me! | 21:35 |
pabelanger | samueldmq: Ya, if zuul-merger is not setup properly, it will do just that | 21:35 |
pabelanger | likely local permission issue | 21:35 |
openstackgerrit | Merged openstack-infra/system-config: Update common.js to include OpenStack-Health https://review.openstack.org/240379 | 21:35 |
Shrews | mordred: jeblair: SpamapS: if one or more of you can +2 this, we can unbreak shade gate... again: https://review.openstack.org/278438 | 21:35 |
anteaya | infra-root could someone disable and close connection on gerrit id 20395 please? http://paste.openstack.org/show/486629/ | 21:35 |
* AJaeger waves good night.. | 21:36 | |
pleia2 | anteaya: having a look now | 21:36 |
anteaya | this is a ci operating under a personal account: https://review.openstack.org/#/q/reviewer:%22suhani+gupta+%253Csuhani%2540hedviginc.com%253E%22 | 21:36 |
anteaya | pleia2: thank you | 21:36 |
anteaya | AJaeger: thank you, good night | 21:36 |
samueldmq | anteaya: pleia2: thanks for taking care of it | 21:37 |
pabelanger | I remember some talks in Vancouver about adding some soft of middleware to gerrit to throttle / better control ACLs for 3rd party. | 21:37 |
samueldmq | pabelanger: ^ | 21:37 |
anteaya | samueldmq: thanks for saying something | 21:37 |
samueldmq | good night all | 21:37 |
pleia2 | anteaya: disabled, but I don't know how to do the "close connection" bit | 21:37 |
*** adis has joined #openstack-infra | 21:37 | |
samueldmq | anteaya: glad to give feedback and keep things working :) | 21:37 |
adis | dali ima neko ovdje iz Bosne | 21:38 |
adis | za opusten razgovor | 21:38 |
adis | bilo ko, neka se javi | 21:38 |
adis | ??? | 21:38 |
anteaya | adis: Govorimo engleski u ovom kanalu. Ja ne znam niti suradnika koji govore hrvatski. | 21:38 |
*** pradk_ has joined #openstack-infra | 21:38 | |
*** rocky_g has joined #openstack-infra | 21:38 | |
adis | aham. ok | 21:39 |
anteaya | pleia2: https://review.openstack.org/Documentation/cmd-close-connection.html | 21:39 |
adis | english | 21:39 |
*** ybathia_ has joined #openstack-infra | 21:39 | |
anteaya | adis: english | 21:39 |
*** devananda has quit IRC | 21:39 | |
stevemar | anteaya: google translate for the win | 21:39 |
*** salv-orl_ has joined #openstack-infra | 21:39 | |
anteaya | stevemar: exactly | 21:39 |
* stevemar is mildly impressed | 21:39 | |
pabelanger | same | 21:39 |
adis | znaci, samo na engleskom jeziku | 21:39 |
pabelanger | that was fast | 21:40 |
anteaya | adis had already visted -dev so I had it all in copy/paste | 21:40 |
*** achanda_ has joined #openstack-infra | 21:40 | |
anteaya | adis: sorry I only speak english | 21:40 |
anteaya | adis: I used google translate to understand that you speak Croatian and were looking for others who do | 21:40 |
*** bknudson has joined #openstack-infra | 21:40 | |
*** dprince has quit IRC | 21:40 | |
*** cbader_2 has joined #openstack-infra | 21:40 | |
anteaya | adis: I don't know of any contributors who speak Croatian | 21:41 |
adis | the first time i use Mirc and I am not sure how this all works | 21:41 |
*** erlon_ has joined #openstack-infra | 21:41 | |
*** jordanP has joined #openstack-infra | 21:41 | |
*** kzaitsev_mb has quit IRC | 21:41 | |
anteaya | adis: okay great, well welcome | 21:41 |
adis | I'm sorry.. | 21:41 |
anteaya | adis: you are in a channel that helps developers create openstack | 21:41 |
*** charz_ has joined #openstack-infra | 21:41 | |
pleia2 | anteaya: hm, do you know the session_id? | 21:41 |
*** crinkle_ has joined #openstack-infra | 21:41 | |
anteaya | adis: don't be sorry, welcome to irc | 21:41 |
anteaya | pleia2: I don't, sorry | 21:42 |
*** christiana has quit IRC | 21:42 | |
anteaya | pleia2: and I don't know how to find out | 21:42 |
pleia2 | me neither | 21:42 |
adis | hvala, ups, thanks | 21:42 |
anteaya | adis: welcome, were you looking for openstack? | 21:42 |
anteaya | adis: or just any irc channel? | 21:42 |
*** nadya has joined #openstack-infra | 21:43 | |
*** bodepd_ has joined #openstack-infra | 21:43 | |
*** nadya is now known as Guest18407 | 21:43 | |
adis | However, asking the channel in the language of the Balkan peoples, Croatian, Bosnian, Serbian and so on. | 21:43 |
*** devananda has joined #openstack-infra | 21:43 | |
*** gibi_ has joined #openstack-infra | 21:43 | |
*** smcginni1 has joined #openstack-infra | 21:44 | |
*** Swami has joined #openstack-infra | 21:44 | |
*** wolsen has joined #openstack-infra | 21:44 | |
anteaya | here is a serbian user group: https://groups.openstack.org/groups/serbia | 21:45 |
*** markvan_ has joined #openstack-infra | 21:45 | |
*** devananda has quit IRC | 21:45 | |
*** andymaier has joined #openstack-infra | 21:45 | |
*** baoli has quit IRC | 21:45 | |
anteaya | I don't see one for Croatia or Bosnia | 21:45 |
*** _ody_ has joined #openstack-infra | 21:45 | |
anteaya | the slovian group looks active: https://groups.openstack.org/groups/slovenia | 21:46 |
anteaya | would slovania count? | 21:46 |
adis | no no Slovenian, I do not understand Slovenian language | 21:47 |
adis | ;) | 21:47 |
*** crinkle has quit IRC | 21:47 | |
*** HenryG_ has joined #openstack-infra | 21:47 | |
*** kzaitsev_mb has joined #openstack-infra | 21:47 | |
anteaya | oh okay | 21:47 |
*** crinkle_ is now known as crinkle | 21:47 | |
anteaya | I don't know it either | 21:47 |
anteaya | are you looking to contribute to openstack? | 21:47 |
*** HeOS has joined #openstack-infra | 21:47 | |
*** Guest18407 has quit IRC | 21:47 | |
adis | Nevertheless, thank you very much, very kind of you | 21:47 |
anteaya | welcome | 21:47 |
openstackgerrit | Merged openstack-infra/puppet-statusbot: Allow statusbot to take an array of auth nicks https://review.openstack.org/274252 | 21:47 |
anteaya | happy to help | 21:47 |
*** bknudson has quit IRC | 21:48 | |
*** cbader_2 has quit IRC | 21:48 | |
*** cbader has joined #openstack-infra | 21:48 | |
*** rockyg has quit IRC | 21:48 | |
*** ybathia has quit IRC | 21:48 | |
*** achanda has quit IRC | 21:48 | |
*** cbader_ has quit IRC | 21:48 | |
*** salv-orlando has quit IRC | 21:48 | |
*** pradk has quit IRC | 21:48 | |
*** nt has quit IRC | 21:48 | |
*** erlon has quit IRC | 21:48 | |
*** Apsu has quit IRC | 21:48 | |
*** gibi has quit IRC | 21:48 | |
*** jgriffith has quit IRC | 21:48 | |
*** fbo_ has quit IRC | 21:48 | |
*** pkoniszewski has quit IRC | 21:48 | |
*** ctlaugh has quit IRC | 21:48 | |
*** wolsen_ has quit IRC | 21:48 | |
*** smcginnis has quit IRC | 21:48 | |
*** wfoster has quit IRC | 21:48 | |
*** tlbr has quit IRC | 21:48 | |
*** Ryan_Lane_ has quit IRC | 21:48 | |
*** zxiiro has quit IRC | 21:48 | |
*** charz has quit IRC | 21:48 | |
*** bknudson_ has quit IRC | 21:48 | |
*** sbadia has quit IRC | 21:48 | |
*** zhenguo_ has quit IRC | 21:48 | |
*** mkwiek has quit IRC | 21:48 | |
*** betherly has quit IRC | 21:48 | |
*** iremizov has quit IRC | 21:48 | |
*** skath_ has quit IRC | 21:48 | |
*** igorbelikov has quit IRC | 21:48 | |
*** HenryG has quit IRC | 21:48 | |
*** dhellmann has quit IRC | 21:48 | |
*** ramishra has quit IRC | 21:48 | |
*** _ody has quit IRC | 21:48 | |
*** gmann has quit IRC | 21:48 | |
*** beisner has quit IRC | 21:48 | |
*** hockeynut has quit IRC | 21:48 | |
*** jesusaur has quit IRC | 21:48 | |
*** zz_zz_ja has quit IRC | 21:48 | |
*** acabot has quit IRC | 21:48 | |
*** bodepd has quit IRC | 21:48 | |
*** markvan has quit IRC | 21:48 | |
*** zeus has quit IRC | 21:48 | |
*** HenryG_ is now known as HenryG | 21:48 | |
*** ybathia_ is now known as ybathia | 21:48 | |
*** bknudson has joined #openstack-infra | 21:49 | |
pleia2 | anteaya: aha, there's a show-connections command, let's see where I get with that | 21:49 |
*** zeus has joined #openstack-infra | 21:49 | |
anteaya | ah go go show connections | 21:49 |
*** hockeynut has joined #openstack-infra | 21:49 | |
*** tlbr has joined #openstack-infra | 21:49 | |
anteaya | I think I knew about that and forgot to say it | 21:49 |
*** dhellmann has joined #openstack-infra | 21:49 | |
anteaya | sorry about that | 21:49 |
*** zz_ja has joined #openstack-infra | 21:49 | |
*** zeus is now known as Guest57497 | 21:49 | |
*** wfoster has joined #openstack-infra | 21:49 | |
jhesketh | Morning | 21:49 |
*** erlon_ is now known as erlon | 21:49 | |
*** |-paul-| has quit IRC | 21:49 | |
pleia2 | hm, this seems to be very slow, or something (not returning results yet) | 21:50 |
anteaya | morning jhesketh | 21:50 |
anteaya | pleia2: hmmmm | 21:50 |
anteaya | would zaro know? | 21:50 |
*** fbo has joined #openstack-infra | 21:50 | |
anteaya | zaro how would pleia2 find the connection to close via close connections | 21:50 |
*** beisner has joined #openstack-infra | 21:50 | |
*** Apsu has joined #openstack-infra | 21:50 | |
anteaya | the account is still posting | 21:50 |
*** pkoniszewski has joined #openstack-infra | 21:50 | |
openstackgerrit | Merged openstack/diskimage-builder: Fix growroot for Gentoo's openrc https://review.openstack.org/276578 | 21:50 |
pleia2 | aha, there it goes | 21:50 |
*** nt has joined #openstack-infra | 21:50 | |
pleia2 | just slow :) | 21:50 |
*** sbadia has joined #openstack-infra | 21:51 | |
anteaya | I think | 21:51 |
anteaya | ah patience | 21:51 |
fungi | pleia2: if you only want numeric ip addresses and usernames then add -n | 21:51 |
openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements https://review.openstack.org/278654 | 21:51 |
openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/pbr: Updated from global requirements https://review.openstack.org/278655 | 21:51 |
*** jgriffith has joined #openstack-infra | 21:51 | |
fungi | goes a lot faster since it doesn't need to do a bunch of reverse dns lookups | 21:51 |
pleia2 | anteaya: no connection from the user we disabled, so I think we're ok | 21:51 |
anteaya | awesome | 21:51 |
pleia2 | fungi: ah, I saw the -n but didn't use it, good to know re: speedy | 21:51 |
fungi | s/usernames/ids/ | 21:52 |
*** tiswanso has joined #openstack-infra | 21:52 | |
*** baoli has joined #openstack-infra | 21:52 | |
fungi | -n switches from ptr records to ip addresses and usernames to numeric user ids | 21:52 |
*** HenryG has quit IRC | 21:52 | |
pleia2 | yeah, and all I needed here was the numeric user id anyway | 21:52 |
fungi | iirc | 21:52 |
*** smcginni1 is now known as smcginnis | 21:52 | |
anteaya | most recent post is at <hour>:31 | 21:52 |
pleia2 | " If the -n option is used, this column shows the Account Id instead." | 21:52 |
pleia2 | so yeah | 21:52 |
pleia2 | next time, -n :) | 21:52 |
anteaya | pleia2: thanks for taking care of it | 21:53 |
stevemar | anteaya: we're getting a lot of comments from a "suhani gupta" account, it almost looks like a third party CI account | 21:53 |
anteaya | stevemar: we just disabled it | 21:53 |
stevemar | anteaya: oh nice, thanks | 21:53 |
*** kzaitsev_mb has quit IRC | 21:53 | |
anteaya | stevemar: and yes it is a third party ci using a personal account | 21:53 |
anteaya | stevemar: you shouldn't see any further posts, do speak up if you see something recent | 21:53 |
stevemar | anteaya: not sure why they need to comment on keystone jobs, we don't have any third party plugins | 21:53 |
*** Sukhdev has joined #openstack-infra | 21:53 | |
anteaya | they were all over the place: https://review.openstack.org/#/q/reviewer:%22suhani+gupta+%253Csuhani%2540hedviginc.com%253E%22 | 21:54 |
*** adis has left #openstack-infra | 21:54 | |
anteaya | keystone just got scooped up too | 21:54 |
*** acabot has joined #openstack-infra | 21:54 | |
*** ctlaugh has joined #openstack-infra | 21:55 | |
*** HenryG has joined #openstack-infra | 21:56 | |
*** jesusaur has joined #openstack-infra | 21:56 | |
*** ramishra has joined #openstack-infra | 21:56 | |
*** mkwiek has joined #openstack-infra | 21:56 | |
*** gmann has joined #openstack-infra | 21:56 | |
*** bpokorny has quit IRC | 21:56 | |
*** zxiiro has joined #openstack-infra | 21:57 | |
*** skath_ has joined #openstack-infra | 21:57 | |
*** igorbelikov has joined #openstack-infra | 21:57 | |
*** devananda has joined #openstack-infra | 21:57 | |
*** betherly has joined #openstack-infra | 21:57 | |
stevemar | ahh | 21:58 |
*** Ryan_Lane_ has joined #openstack-infra | 21:58 | |
*** vgridnev has quit IRC | 21:58 | |
anteaya | yeah, they have no idea what they are doing | 21:59 |
anteaya | they should be set up for ci-sandbox only at this point | 21:59 |
anteaya | and using a real CI account, not a personal account | 21:59 |
anteaya | but they aren't | 21:59 |
*** zhenguo_ has joined #openstack-infra | 22:00 | |
*** iremizov has joined #openstack-infra | 22:01 | |
*** rossella_s has quit IRC | 22:03 | |
*** rossella_s has joined #openstack-infra | 22:03 | |
*** kgiusti has left #openstack-infra | 22:04 | |
*** rcernin has quit IRC | 22:07 | |
*** amrith is now known as _amrith_ | 22:08 | |
*** abregman is now known as abregman|afk | 22:09 | |
*** thorst_ has quit IRC | 22:10 | |
*** thorst_ has joined #openstack-infra | 22:10 | |
*** daemontool has quit IRC | 22:13 | |
*** ccrouch has quit IRC | 22:14 | |
*** thorst_ has quit IRC | 22:14 | |
*** shardy has quit IRC | 22:14 | |
*** regXboi has quit IRC | 22:15 | |
*** ccrouch has joined #openstack-infra | 22:16 | |
*** julim has quit IRC | 22:16 | |
*** hashar_ has joined #openstack-infra | 22:17 | |
*** zxiiro_ has joined #openstack-infra | 22:17 | |
*** igorbelikov_ has joined #openstack-infra | 22:17 | |
*** boris-42_ has joined #openstack-infra | 22:17 | |
*** julim has joined #openstack-infra | 22:17 | |
*** julim has quit IRC | 22:17 | |
*** annegent_ has joined #openstack-infra | 22:18 | |
stevemar | anteaya: could you take a quick look at https://review.openstack.org/#/c/278638/ ? | 22:18 |
anteaya | just a quick one :) | 22:18 |
stevemar | it'll really help in diagnosing https://bugs.launchpad.net/python-cliff/+bug/1543841 - but we need it anyway :) | 22:18 |
openstack | Launchpad bug 1543841 in devstack "Invocation error: tempest verify-config: error: unrecognized arguments: -uro ../../../../tmp/tmp.FR5OHabb3Y" [Undecided,In progress] - Assigned to Matthew Treinish (treinish) | 22:18 |
*** mase_x200 has joined #openstack-infra | 22:18 | |
*** armax has quit IRC | 22:19 | |
*** YorikSar_ has joined #openstack-infra | 22:19 | |
*** bknudson_ has joined #openstack-infra | 22:19 | |
anteaya | stevemar: done | 22:19 |
anteaya | may it be all you hope it will be | 22:19 |
*** Ryan_Lane_ is now known as Ryan_Lane | 22:19 | |
*** bknudson_ has quit IRC | 22:19 | |
stevemar | anteaya: yee haw | 22:20 |
*** Ryan_Lane is now known as Guest76581 | 22:20 | |
*** bknudson_ has joined #openstack-infra | 22:20 | |
anteaya | :) | 22:20 |
*** sbadia_ has joined #openstack-infra | 22:20 | |
*** Guest76581 has quit IRC | 22:20 | |
*** Guest76581 has joined #openstack-infra | 22:20 | |
*** Guest76581 is now known as Ryan_Lane | 22:20 | |
openstackgerrit | Merged openstack-infra/shade: Modify test workaround for extra_dhcp_opts https://review.openstack.org/278438 | 22:21 |
*** woodster__ has joined #openstack-infra | 22:22 | |
tonyb | Did something change with the way we upload/store job logs in thast 24hours (or so). I'm no longer getting console.log from gate-irc-meetings-tox-ical jobs. Compare http://logs.openstack.org/14/278114/1/check/gate-irc-meetings-tox-ical/a74b71b/ to http://logs.openstack.org/14/278114/3/check/gate-irc-meetings-tox-ical/6e25e19/ | 22:22 |
*** ianw_ has joined #openstack-infra | 22:22 | |
*** chlong_ has joined #openstack-infra | 22:22 | |
*** aspiers_ has joined #openstack-infra | 22:22 | |
anteaya | jhesketh: ^^ any logging changes I know about? | 22:22 |
*** igorbelikov has quit IRC | 22:22 | |
*** zxiiro has quit IRC | 22:22 | |
*** boris-42 has quit IRC | 22:22 | |
*** acabot has quit IRC | 22:22 | |
*** dhellmann has quit IRC | 22:22 | |
*** sbadia has quit IRC | 22:22 | |
*** bknudson has quit IRC | 22:22 | |
*** ianw has quit IRC | 22:22 | |
*** YorikSar has quit IRC | 22:22 | |
*** chlong has quit IRC | 22:22 | |
*** hashar has quit IRC | 22:22 | |
*** claudiub has quit IRC | 22:22 | |
*** woodster_ has quit IRC | 22:22 | |
*** AJaeger has quit IRC | 22:22 | |
*** annegentle_ has quit IRC | 22:22 | |
*** aspiers has quit IRC | 22:22 | |
*** ianw_ is now known as ianw | 22:22 | |
*** tzn has quit IRC | 22:22 | |
*** igorbelikov_ is now known as igorbelikov | 22:22 | |
*** sbadia_ is now known as sbadia | 22:22 | |
anteaya | tonyb: I don't know of any mind you I was away in the middle of the day for a few hours | 22:23 |
*** dhellmann has joined #openstack-infra | 22:23 | |
anteaya | something may have happened during that time | 22:23 |
*** zxiiro_ is now known as zxiiro | 22:23 | |
*** AJaeger has joined #openstack-infra | 22:23 | |
ianw | does anyone know if it's possible to change the default view when you click on a project (e.g. https://review.openstack.org/#/projects/openstack-dev/devstack,dashboards/default) to *not* show merged changes? | 22:23 |
*** woodster__ is now known as woodster_ | 22:23 | |
*** boris-42_ is now known as boris-42 | 22:24 | |
jhesketh | anteaya, tonyb: not that I've done or know of sorry | 22:24 |
*** acabot has joined #openstack-infra | 22:24 | |
anteaya | jhesketh: thanks anyway | 22:25 |
tonyb | jhesketh: Okay I'll find the job on jenkins*.o.o and see if I can get more details. | 22:25 |
anteaya | tonyb: I can offer you sad face | 22:25 |
anteaya | :( | 22:25 |
anteaya | if that helps | 22:25 |
tonyb | anteaya: it does :) | 22:25 |
jhesketh | tonyb: yep good idea | 22:25 |
onovy | anyone for final +A pls? https://review.openstack.org/#/c/256668/ https://review.openstack.org/#/c/256755/ | 22:25 |
*** tiswanso has quit IRC | 22:25 | |
tonyb | jhesketh: I'm learning :) | 22:26 |
tonyb | jhesketh: dosn't stop be from being lazy but ... | 22:26 |
clarkb | tonyb it looks like you are copyong an index.html to the root | 22:26 |
tonyb | clarkb: we used to BUT there is explict stuff in the publisher to stop that and AFICT that's still there | 22:26 |
*** armax has joined #openstack-infra | 22:27 | |
clarkb | tonyb console log is there | 22:27 |
tonyb | clarkb: seek jenkins/jobs/infra.yaml | 22:27 |
clarkb | just masked by rogue index.html | 22:27 |
clarkb | you cam address it directly to see it | 22:27 |
tonyb | clarkb: yeah it helps if I use console.html NOT console.log :) | 22:28 |
openstackgerrit | Merged openstack-infra/project-config: Use pep8 for keystone projects https://review.openstack.org/278593 | 22:28 |
mordred | jamielennox: notmyname and I spoke earlier and he said that timburke and joeljwright were the folks on the swiftclient side we should work with on adding session support | 22:30 |
openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Disable nonfunctional infracloud hosts https://review.openstack.org/278769 | 22:30 |
*** matrohon has quit IRC | 22:30 | |
nibalizer | mordred: im interested to know your thoughts on that ^^ as well | 22:31 |
nibalizer | should we be commenting or moving to a disabled group | 22:31 |
jamielennox | mordred: is there support there for the idea? i have looked at swiftclient in the past and whilst it is an invasive change for all clients it will not be an easy conversion for swiftclient | 22:32 |
mordred | jamielennox: yes - there are people interested and supportive | 22:32 |
openstackgerrit | Brant Knudson proposed openstack/requirements: Add checks for setup.cfg existence in project dictionary https://review.openstack.org/278772 | 22:32 |
openstackgerrit | Brant Knudson proposed openstack/requirements: Add location to requirement.Requirement https://review.openstack.org/278773 | 22:32 |
openstackgerrit | Brant Knudson proposed openstack/requirements: Fix editing constraints files with urls in them. https://review.openstack.org/278774 | 22:32 |
openstackgerrit | Brant Knudson proposed openstack/requirements: Deal with underscores in names in edit-constraints https://review.openstack.org/278775 | 22:32 |
openstackgerrit | Brant Knudson proposed openstack/requirements: Expose extras information in requirements https://review.openstack.org/278776 | 22:32 |
*** jordanP has quit IRC | 22:33 | |
jamielennox | mordred: ok, i'll need to have another look at swiftclient and speak to them, hopefully it'll be easier with some of the team on board | 22:33 |
*** thorst_ has joined #openstack-infra | 22:34 | |
*** eharney has quit IRC | 22:35 | |
openstackgerrit | James E. Blair proposed openstack-infra/infra-specs: Add Nodepool Zookeeper spec https://review.openstack.org/278777 | 22:35 |
openstackgerrit | Mark Vanderwiel proposed openstack-infra/project-config: Adding integration test support for app catalog horizon plugin https://review.openstack.org/276440 | 22:35 |
*** kozhukal` has joined #openstack-infra | 22:35 | |
*** dimtruck is now known as zz_dimtruck | 22:36 | |
jeblair | clarkb, greghaynes, mordred: when you have some time, i'd love some feedback on https://review.openstack.org/278777 which i've been thinking about for a while, but especially after some of the hairy things we've run into with nodepool dib builders | 22:36 |
*** kozhukal` has quit IRC | 22:36 | |
*** kozhukalov_ has quit IRC | 22:37 | |
mordred | jeblair: I'm reading it right now | 22:37 |
*** kozhukalov has quit IRC | 22:37 | |
prometheanfire | ianw: that review is only cleaning up the cleanup function, it's not to fix the ordering of package-installs | 22:37 |
prometheanfire | and doesn't depend on it either, though it would be nice to have | 22:38 |
prometheanfire | it's a ncie to have | 22:38 |
*** thorst_ has quit IRC | 22:39 | |
nibalizer | jeblair: neat! | 22:39 |
jeblair | i see some typos in self-review i'm already fixing :) | 22:40 |
*** mattt has joined #openstack-infra | 22:40 | |
*** miqui has quit IRC | 22:41 | |
*** salv-orlando has joined #openstack-infra | 22:42 | |
mattt | hi infra team, has there just been a new release of the ubuntu-trusty-rax-iad and devstack-trusty-rax-iad image by chance? | 22:42 |
*** mase_x200 has quit IRC | 22:42 | |
openstackgerrit | James E. Blair proposed openstack-infra/infra-specs: Add Nodepool Zookeeper spec https://review.openstack.org/278777 | 22:42 |
jeblair | mattt: i'll check | 22:43 |
*** dpaterson has quit IRC | 22:44 | |
jeblair | mattt: it does not look like it -- http://paste.openstack.org/show/486635/ | 22:44 |
*** salv-orl_ has quit IRC | 22:44 | |
mnaser | would be cool if the openstack-infra projects hosted the docs of the latest release + master .. all docs refer to this patch already updated - https://github.com/openstack-infra/nodepool/commit/0ceb3d53b27bcd81ef577eb00d849c5dfe7dae6d -- but zero docs online show the 0.2.0 previous behaviour, as all docs are for master | 22:45 |
mnaser | just throwing a suggestion out there, unless I couldn't find them | 22:45 |
jeblair | mattt: (first field in "Age" is days) | 22:45 |
mnaser | for context, 0.2.0 is the latest release (on pypi) of nodepool | 22:45 |
*** zz_dimtruck is now known as dimtruck | 22:45 | |
*** jgriffith is now known as jgriffith_away | 22:46 | |
mattt | jeblair: ok cool, let me make sure the issue isn't on this end! | 22:47 |
dims | hmm. check queue is ~350 and gate is ~50...wondering if this is stuff backed up from yesterday or some other rush | 22:48 |
anteaya | jeblair: according to the paste, doesn't it say this id 355223 (devstack-trusty) is 7 hours old? | 22:48 |
openstackgerrit | Merged openstack/diskimage-builder: Mark ironic-discoverd-ramdisk as deprecated in favor of ironic-agent https://review.openstack.org/270267 | 22:48 |
jeblair | anteaya: it does. | 22:49 |
jeblair | anteaya: so is 355221. | 22:49 |
jeblair | but that wasn't asked about | 22:49 |
*** FallenPegasus has joined #openstack-infra | 22:49 | |
anteaya | yes | 22:49 |
anteaya | oh? | 22:49 |
*** achanda_ has quit IRC | 22:49 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Templatize experimental bindep jobs https://review.openstack.org/278784 | 22:49 |
jeblair | anteaya: i don't consider 7 hours old to be 'just'. | 22:50 |
mordred | mnaser: that is not a terrible idea | 22:50 |
anteaya | jeblair: oh okay | 22:50 |
*** baoli has quit IRC | 22:50 | |
tonyb | clarkb: okay I'm seeing "[PostBuildScript] Build is not success : do not execute script" which (I think) explains the clobbering of the index. | 22:50 |
jeblair | i guess that's a matter for the long now foundation though. | 22:50 |
mattt | anteaya jeblair : the reason i ask -- our openstack-ansible-security role started to fail due to a misconfiguration in /etc/apt/apt.d, we're only seeing it in iad i /think/ | 22:50 |
*** baoli has joined #openstack-infra | 22:51 | |
tonyb | clarkb: so that means I now need to ask how can a I make sure that my publisher job always runs? | 22:51 |
openstackgerrit | Merged openstack-infra/tripleo-ci: scp/ssh do not check for know host keys https://review.openstack.org/269660 | 22:51 |
anteaya | mattt: when did it start to fail? | 22:51 |
*** arthus has joined #openstack-infra | 22:51 | |
*** burgerk has quit IRC | 22:51 | |
jeblair | mattt: and do you have a link to a failure? | 22:51 |
mordred | oh! woot - btw - apt mirror is live | 22:51 |
clarkb | tonyb: there are some flags you can set, look at how the swift console log stuff does it | 22:51 |
anteaya | mordred: yay | 22:51 |
mordred | http://logs.openstack.org/03/254703/36/check/gate-tempest-dsvm-neutron-full/b6c9bf0/logs/devstacklog.txt.gz#_2016-02-10_20_40_12_324 | 22:52 |
fungi | mordred: i worry that you and mattt are talking about the same thing :/ | 22:52 |
jeblair | indeed | 22:52 |
mordred | fungi: well - that was from a successful run | 22:52 |
*** alex_xu has quit IRC | 22:52 | |
mordred | so at least _some_ nodes are running against apt mirror and succeeding | 22:52 |
mattt | jeblair: http://logs.openstack.org/91/278491/2/check/gate-openstack-ansible-dsvm-commit/707ae72/logs/ansible-logging/ansible.log, search for AllowUnauthenticated | 22:52 |
*** mriedem has quit IRC | 22:52 | |
mattt | jeblair: the role fails if AllowUnauthenticated is set to true in /etc/apt/apt.d | 22:53 |
mordred | (hahahaha) | 22:53 |
mordred | yup | 22:53 |
mordred | that would be this | 22:53 |
*** sigmavirus24 is now known as sigmavirus24_awa | 22:53 | |
*** dingyichen has joined #openstack-infra | 22:53 | |
fungi | indeed, seems like the role needs some adjusting for testing purposes | 22:53 |
mordred | yah - we do not sign the packages in the mirror - so we drop a file in there that disables signature checks | 22:53 |
anteaya | btw firefox prompts me to open mattt's link using gedit | 22:53 |
fungi | since you may want to test against a package mirror with unsigned indices | 22:53 |
jeblair | it's a security hardening role | 22:54 |
anteaya | rather than openin in the browser so I opened it in chrome | 22:54 |
fungi | (as we do) | 22:54 |
mattt | we can disable this rule, that's no problem | 22:54 |
mordred | is openstack-ansible using our mirror yet? | 22:54 |
mattt | i just wanted to make sure we knew why it needed to be done | 22:54 |
jeblair | mordred: i don't understand the question | 22:54 |
fungi | mattt: alternatively, you could unset that after packages are installed? | 22:54 |
mattt | mordred: i know odyssey4me has been doing a bunch of work using your pip mirrors etc, but didn't realise it had gone live | 22:55 |
mordred | I thought I rembmered openstack-ansible having local code to use per-cloud-region apt mirrors | 22:55 |
jeblair | mordred: ah now i understand | 22:55 |
mordred | if that is still the case | 22:55 |
*** alex_xu has joined #openstack-infra | 22:55 | |
fungi | lie wrap that role's test in code which forces the setting to true and then restores it to its prior value after the test | 22:55 |
tonyb | clarkb: Okay thanks. although I now think that isn;t the real probelm as bit patchsets failed but ps1 "did the right thing" and ps3 didn't | 22:55 |
fungi | s/lie/like | 22:56 |
mordred | then I recommend for the moment simply adding an rm of the file in /etc/apt/apt.conf.d/ | 22:56 |
anteaya | firefox 44.0 | 22:56 |
mattt | mordred: yeah that's what i'll do | 22:56 |
fungi | or mock out the apt configuration for testing purposes | 22:56 |
mordred | until such a time as openstack-ansible consumes our mirrors | 22:56 |
*** piet has quit IRC | 22:56 | |
*** dpaterson has joined #openstack-infra | 22:56 | |
mattt | thanks a lot guys! | 22:56 |
mattt | (and girls!) | 22:57 |
mordred | mattt: sure thing! | 22:57 |
fungi | mattt: because presumably what you want to know is that the control properly detects when that setting has been set incorrectly for production purposes, but you don't _actually_ need to test the security of our test servers to do that | 22:57 |
mordred | infra-root: everybody good with me sending out the mirror announce? | 22:58 |
mordred | they seem to be live and working :) | 22:58 |
nibalizer | wfm | 22:58 |
jhesketh | yep :-) | 22:58 |
fungi | mordred: it's working in multiple regions? | 22:58 |
*** eil397 has quit IRC | 22:58 | |
mordred | uh | 22:58 |
fungi | sounds like good timing to me then | 22:58 |
mordred | I know it's working in iad | 22:59 |
mordred | I can go troll for more build logs real quick | 22:59 |
*** doug-fish has quit IRC | 22:59 | |
anteaya | you need to exercise that troll | 22:59 |
fungi | logstash.o.o presumably makes that fast | 22:59 |
clarkb | jeblair I thi k greghaynes has been toying with the idea of running builders completely separate from nodepool then just use glance to find the current image | 22:59 |
mordred | fungi: yes. I confirm multiple regions | 23:00 |
clarkb | which should remove the need for any db beyond the api | 23:00 |
*** doug-fish has joined #openstack-infra | 23:00 | |
jeblair | clarkb: that would work for severing the daemon-worker relationship, but not for worker mutexing of builds. | 23:00 |
mordred | http://logs.openstack.org/03/254703/36/check/gate-tempest-dsvm-full/94f9198/logs/devstacklog.txt.gz#_2016-02-10_20_39_28_449 | 23:00 |
mordred | fungi: that's internap nyj01 | 23:01 |
fungi | right on | 23:01 |
greghaynes | clarkb: jeblair Yea, I think they are unrelated but funny timing | 23:01 |
anteaya | mordred: happy posting to the ml | 23:01 |
*** eil397 has joined #openstack-infra | 23:01 | |
mordred | also - I'm sure everyone in both new york and new jersey loves the 'nyj' acronym | 23:01 |
clarkb | jeblair correct you eould have to shard builds instead | 23:01 |
greghaynes | clarkb: jeblair I think both is ideal, actually | 23:01 |
openstackgerrit | Paul Belanger proposed openstack-infra/puppet-stackalytics: Setup logging for stackalytics-processor https://review.openstack.org/278567 | 23:01 |
fungi | mordred: they're the same place, right? ;) | 23:02 |
*** jgriffith_away is now known as jgriffith | 23:02 | |
* mordred waits for Clint to come diving through the air at fungi | 23:02 | |
anteaya | mordred: only because everyone on new york and new jersey agree on everything | 23:02 |
anteaya | s/on/in | 23:02 |
*** armax has quit IRC | 23:02 | |
jeblair | clarkb, greghaynes: yeah, if we don't want to support more than one thing being able to build ubuntu-trusty, then no db needed. | 23:02 |
fungi | mordred: i thought "new jersey" was just what you called teh part of new york where you dump your trash | 23:02 |
mordred | fungi: yup. but we choose to not refer to it as new york - it has all that trash | 23:03 |
fungi | very good point | 23:03 |
jeblair | clarkb, greghaynes: if we do want to support that, we need a db (zookeeper/mysql/...). but you're right, we don't need the launcher to have access to that if it uses metadata and glance | 23:03 |
greghaynes | jeblair: clarkb Even if we have a db because we want to scale out more easily then I like the separation of concerns from breaking builders out entirely | 23:03 |
clarkb | yup | 23:03 |
greghaynes | jeblair: yep | 23:03 |
clarkb | I actually like the idea of mkxing them together | 23:04 |
greghaynes | jeblair: also, I was just trying to brainstorm with someone over lunch today on how we could use zookeeper for this | 23:04 |
jeblair | clarkb, greghaynes: however, that would be a polling operation, so we'd have to do an image list periodically. sharing the zookeeper db could be more responsive. but it's not a huge gain/hit. | 23:04 |
jeblair | greghaynes: now you can brainstorm with me too. :) | 23:04 |
anteaya | jeblair: I'm going to advocate for zuul being restarted: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=392&rra_id=all | 23:04 |
clarkb | jeblair I want to say shade already does the poll | 23:05 |
anteaya | in response to dims post in backscroll | 23:05 |
greghaynes | jeblair: clarkb Yes, it would have to poll, but the polling can be very infrequent - if it takes 15min after an image upload for the image to begin being in use then its not a big deal | 23:05 |
clarkb | but I would have to reread its image boot path | 23:05 |
jeblair | clarkb: hopefully it's in the cache :) | 23:05 |
*** doug-fish has quit IRC | 23:05 | |
jeblair | clarkb: i think we'd launch by image id anyway | 23:05 |
greghaynes | Also, if we *really* dont want to poll, I wouldn't be opposed to having one rpc call between the two which is builders poking nodepoold to say "this image-id should be uploaded now to this provider" | 23:07 |
jeblair | greghaynes, clarkb: regardless of whether the nodepool daemon does a glance poll or checks zk -- we would still have achieved the goal of having independent dib building daemons that do not depend on the central daemon | 23:07 |
mmedvede | hi infra, it looks like no new nodes are being launched, correct? sorry if it is somewhere in backscroll, ctrl-f fails me | 23:07 |
greghaynes | jeblair: yep | 23:07 |
jeblair | greghaynes: well, the builder can do the upload itself | 23:07 |
greghaynes | jeblair: Yes, I mean after it completes an upload, just as a way to wake up nodepool to poll a specific image-id | 23:08 |
greghaynes | its an optimization and not really important | 23:08 |
*** doug-fis_ has joined #openstack-infra | 23:08 | |
jeblair | greghaynes: ah, so more "this image *was* uploaded to this provider" | 23:08 |
greghaynes | yep | 23:08 |
anteaya | mmedvede: jenkins01 and 06 are off on their own but it looks like other jenkins are online: http://grafana.openstack.org/dashboard/db/nodepool | 23:09 |
anteaya | mmedvede: what are you seeing? | 23:09 |
mmedvede | anteaya: just a bunch of scheduled builds are very old on http://status.openstack.org/zuul/. Was making sure that gate is fine before doing a recheck | 23:09 |
anteaya | a bunch of scheduled builds are very old, what does that mean? | 23:10 |
*** doug-fis_ has quit IRC | 23:10 | |
anteaya | does that mean the jobs are stuck? | 23:10 |
anteaya | or that the patches are waiting a long time for nodes? | 23:10 |
*** doug-fis_ has joined #openstack-infra | 23:11 | |
clarkb | jeblair: greghaynes my only comments would be dont require zk for a single builder to be useful for small installs and as a dib to glance utility and dont bother with etcd or consul | 23:11 |
mordred | clarkb: bluebox is unhappy with node launching again - didn't you do something last time? | 23:11 |
clarkb | mordred: cleaned up leaked fips | 23:11 |
mordred | yay | 23:11 |
mmedvede | anteaya: from zuul's perspective, it can not find a node to finish a check | 23:11 |
mordred | my favorite | 23:11 |
jeblair | clarkb: i agree re etcd and consul; | 23:11 |
anteaya | mmedvede: right the job is queued | 23:11 |
fungi | mmedvede: perhaps it would help if you provided a specific example | 23:11 |
jeblair | clarkb: i'm less excited about supporting nothing though | 23:11 |
mordred | zk seems super easy to install for small things | 23:12 |
clarkb | jeblair I am just thinking about the use case of on my laptop amd build + ulpaod | 23:12 |
mordred | I mean, it's no _harder_ to install than mysql on ubuntu | 23:12 |
jeblair | clarkb: zk still acts as a persistent data store, so we'd have to fill that with something | 23:12 |
*** denisra has quit IRC | 23:13 | |
clarkb | ya maybe its simpler to just build a separate utility on a shard run dib and use shade thing | 23:13 |
greghaynes | You could use no persistent store with the caveat that you can only have one builder responsible for a given image | 23:13 |
mordred | I mean | 23:13 |
mordred | seriously | 23:13 |
mordred | installing zk is super easy | 23:13 |
jeblair | clarkb: yeah, i feel like laptop build+upload is a different use case than general dib+upload daemon. | 23:13 |
mordred | I'm not sure why we'd work around it | 23:13 |
JayF | mordred++ | 23:13 |
mordred | it's a single apt-get command | 23:13 |
anteaya | I will agree that zuul is almost at max memory and could do with a restart, and 2 of 7 jenkins aren't playing well with others, but I think as far as I can see everything else is behaving as expected | 23:13 |
JayF | mordred: I want more ZK in my OpenStack ;) | 23:13 |
nibalizer | greghaynes: yes | 23:13 |
anteaya | we do have fewer test nodes than we used to, that plays a role | 23:14 |
greghaynes | Yep, I agree with the 'just use zk' thinking | 23:14 |
clarkb | mordred mostly becausr I dont want it on my laptop but I dont want dib actaully on my laptop either | 23:14 |
greghaynes | I need to actually read the spec in detail too, though | 23:14 |
mmedvede | fungi: anteaya: I think I am misinterpreting zuul's status, not used to see checks that are sitting for long (e.g. zuul.o.o has a few older than 8 hours) | 23:14 |
clarkb | the missing thing here is uploading to rax is litrrally impossible | 23:14 |
clarkb | but nodepool almost can do it | 23:14 |
clarkb | so I want that | 23:14 |
mmedvede | fungi: anteaya: would proceed with my recheck then, thanks | 23:14 |
mordred | clarkb: you can't shade uploads locally without nodepool? | 23:14 |
*** annegent_ has quit IRC | 23:14 | |
clarkb | and using glance in general is an exercisr in frustration | 23:14 |
clarkb | mordred it isnt fun to no | 23:15 |
anteaya | mmedvede: what do you expect a recheck to do | 23:15 |
mordred | clarkb: I usually just use os_image from ansible or make a 2 line python script | 23:15 |
*** yamahata has joined #openstack-infra | 23:15 | |
greghaynes | jeblair: mordred clarkb One of my motivations for breaking out builders entirely too is that I think that tool would be generall useful (lots of clouds need to keep a set of images up to date regularlyish) | 23:15 |
anteaya | mmedvede: all that does it take it out of where it is in the queue and put it farther back in the line | 23:15 |
jeblair | mordred: is one of them a #! line? | 23:15 |
*** daemontool has joined #openstack-infra | 23:15 | |
mordred | clarkb: perhaps I should write up a quick thin on using os_image? | 23:15 |
fungi | mmedvede: yes, we're running jobs at basically max capacity and there is a substantial backlog. also because the gate pipeline is prioritized, the check pipeline only gets what quota is not being used by gate pipeline jobs | 23:15 |
mmedvede | anteaya: my patch is not on the queue | 23:15 |
jeblair | greghaynes: yeah, and we can use it for our infra system images. | 23:15 |
clarkb | mordred ya maybe thats what I need to see | 23:15 |
mordred | jeblair: well, only if I write the python like it's perl :) | 23:15 |
mordred | clarkb: I'll make you one of those | 23:15 |
mmedvede | anteaya: one of checks failed with timeout though | 23:15 |
anteaya | mmedvede: ah okay | 23:15 |
greghaynes | jeblair: yep | 23:15 |
anteaya | mmedvede: which job failed? | 23:16 |
anteaya | mmedvede: can you share the log? | 23:16 |
clarkb | mordred yhr real problem with dhade for me currently is instantiating a cloud | 23:16 |
clarkb | getting auth is noy really easier today, you just dont havr to know cloud secrrts | 23:16 |
clarkb | but uts still ridiculously complicated | 23:16 |
*** erlon has quit IRC | 23:16 | |
mordred | clarkb: really? | 23:16 |
mmedvede | anteaya: sure, the log: http://logs.openstack.org/74/278574/1/check/gate-infra-puppet-apply-bare-precise/08bd048/console.html. But I think it just hit something random | 23:17 |
mordred | clarkb: import shade ; cloud = shade.openstack_cloud() | 23:17 |
clarkb | ya I just spent all morning debugging it | 23:17 |
clarkb | and ended up in 6 repos | 23:17 |
clarkb | for just get me a token | 23:17 |
mmedvede | fungi: good explanation, thank you | 23:17 |
mordred | clarkb: I would like to hear more about that - I usually find opening a python interpreter and importing shade to be the easiest way to interact with an openstack cloud | 23:18 |
clarkb | mordred the rax swift token fail thing | 23:18 |
mordred | oh. that's swift | 23:18 |
mordred | nothing else needs pre-created tokens - the way swiftclient works is very different | 23:19 |
anteaya | mmedvede: zuul cloner spent 30 minutes trying to update origin remote in puppet-logstash | 23:19 |
clarkb | nodepool -> shade -> oscc -> keystoneauth and swiftclient | 23:19 |
clarkb | mordred ya but its required for rax uploads :) | 23:19 |
clarkb | I can upload to everyone else just fine | 23:19 |
mordred | well, sure. | 23:19 |
*** dkranz has quit IRC | 23:19 | |
mordred | but the shade to do an image upload is still hella easy | 23:20 |
mordred | debugging it DOES involve needing to grok those 5 things | 23:20 |
mordred | because the rackspace image upload process is hella complex | 23:20 |
mordred | clarkb: did you find any new workarounds to make it betterer? | 23:20 |
mordred | clarkb: or was the result "suck" | 23:21 |
mmedvede | anteaya: ok, I thought the VM might have gone away or lost connectivity | 23:21 |
mordred | clarkb: also - I wonder if we lower the chunk size we're using | 23:21 |
mordred | clarkb: if that would be helpful | 23:21 |
clarkb | mordred no I think the two solutions would be only support passeord auth fot swift in shade and hand over the creds or get sessions in swiftclient | 23:21 |
clarkb | but shade/oscc do ejat they do to support other auth aiui | 23:21 |
clarkb | so thatd a tradeoff | 23:22 |
mordred | clarkb: oh- well - we could support password auth in swift | 23:22 |
mordred | clarkb: I'd support a change that passes in username/password if the password auth plugin is in use | 23:22 |
mordred | clarkb: and fallback to passing in a preauthtoken to swiftclient if non-password auth is the auth plugin | 23:22 |
clarkb | that may be worth trying | 23:22 |
clarkb | once home I can pull oscc back up and look at it | 23:23 |
*** christiana has joined #openstack-infra | 23:23 | |
clarkb | since it actually makes the clients | 23:23 |
*** jaypipes has quit IRC | 23:23 | |
mordred | clarkb: I'll look in a jiff - I'm pretty sure I konw where that goes and how it should work | 23:23 |
anteaya | mmedvede: no zuul cloner looks like it couldn't finish updating the repo within 30 minutes for some reason | 23:23 |
mmedvede | anteaya: right, if VM went away, postscript would not have ran | 23:24 |
clarkb | mordred I also need to figure out how to use osic and push oscc patch for it | 23:24 |
clarkb | currently just have a horizon ip address | 23:24 |
mordred | clarkb: that would be welcomed | 23:24 |
clarkb | should be fun | 23:24 |
mordred | clarkb: you should be able to get an openrc file from horizon | 23:24 |
clarkb | oh cool | 23:24 |
openstackgerrit | Tony Breeds proposed openstack-infra/project-config: Force the gate-irc-meetings-tox-ical postbuildscript to always run https://review.openstack.org/278790 | 23:24 |
anteaya | mmedvede: logstash hasn't seen a lot of that message: Build timed out (after 30 minutes). Marking the build as failed. | 23:25 |
tonyb | That that should fix my irc-meetings thing. | 23:25 |
clarkb | mordred and qcow2 vs raw is trial and error? | 23:25 |
mordred | clarkb: what I usually do is do a glance image-list | 23:26 |
mordred | clarkb: and look to see what format the images in the cloud are in | 23:26 |
*** baoli has quit IRC | 23:26 | |
mordred | clarkb: then record that into the vendor profile in oscc | 23:26 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Source undercloud environment variable from a file https://review.openstack.org/275667 | 23:26 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Split the deploy script into its own file https://review.openstack.org/275668 | 23:26 |
*** baoli has joined #openstack-infra | 23:27 | |
mordred | clarkb: openrc file should be in compute -> access & security -> api access | 23:27 |
anteaya | tonyb: this builder only runs on irc-meetings, which is good because unless I already understood what the issue was I couldn't get it from your commit message and comment, sorry :( | 23:27 |
mordred | clarkb: and there should be a link or button at the tpo of that to download the rc file | 23:27 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Add experimental bindep for the python-jobs group https://review.openstack.org/278793 | 23:27 |
anteaya | tonyb: I know you know what you are talking about | 23:27 |
clarkb | mordred so many hax | 23:27 |
anteaya | tonyb: let me see if I have a suggestion | 23:27 |
clarkb | clearly you have done thus before | 23:27 |
mordred | clarkb: :) | 23:27 |
mordred | clarkb: many. many. many times | 23:28 |
*** sc68cal has quit IRC | 23:28 | |
tonyb | anteaya: Okay Thanks. I thought the subject called that out but Happy for corrections. | 23:29 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Add experimental bindep for the python-jobs group https://review.openstack.org/278793 | 23:29 |
*** ZZelle_ has quit IRC | 23:29 | |
*** baoli has quit IRC | 23:29 | |
*** baoli has joined #openstack-infra | 23:30 | |
mordred | jamielennox: need some advice | 23:30 |
mordred | jamielennox: say I have a keystone session and an auth plugin | 23:30 |
mordred | jamielennox: ... wait- I overthought something. nevermind | 23:30 |
anteaya | tonyb: the obvious is often lost on me | 23:31 |
anteaya | tonyb: I'm the slow kid in the class | 23:31 |
*** achanda has joined #openstack-infra | 23:31 | |
anteaya | left some suggestions | 23:32 |
tonyb | anteaya: pish. | 23:32 |
anteaya | :) | 23:32 |
mmedvede | anteaya: thanks for the help. I looked through zuul cloner, but nothing obvious there. I do not think it is something reproducible, would see on recheck | 23:32 |
*** doug-fis_ has quit IRC | 23:33 | |
openstackgerrit | Merged openstack-infra/project-config: Revert "Revert "Enable voting for Puppet OpenStack Integration jobs"" https://review.openstack.org/278352 | 23:33 |
*** pahuang has quit IRC | 23:33 | |
anteaya | mmedvede: okey dokey, thanks for taking a look | 23:33 |
anteaya | mmedvede: let me know if you see the same error though with zuul cloner | 23:33 |
anteaya | sorry not error, timeout | 23:33 |
mmedvede | anteaya: would do | 23:34 |
anteaya | thank you | 23:34 |
anteaya | mmedvede: I'm going offline soon so leave your thoughts in channel if you have any to share | 23:34 |
openstackgerrit | Merged openstack-infra/project-config: add a dsvm job for cliff https://review.openstack.org/278638 | 23:34 |
*** edmondsw has joined #openstack-infra | 23:34 | |
openstackgerrit | Merged openstack/diskimage-builder: py26 is no longer supported by Infra's CI https://review.openstack.org/261656 | 23:36 |
*** andymaier has quit IRC | 23:38 | |
*** thorst_ has joined #openstack-infra | 23:38 | |
mordred | clarkb: https://review.openstack.org/278797 | 23:39 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Extend experimental-bindep-jobs to 14 projects https://review.openstack.org/278798 | 23:39 |
*** thorst_ has quit IRC | 23:39 | |
mordred | clarkb: there's rough draft of passing in user/pass to swiftclient | 23:39 |
*** thorst_ has joined #openstack-infra | 23:40 | |
mordred | clarkb: completely untested - I mostly just wanted to get thoughts into a patch for you | 23:40 |
*** sc68cal has joined #openstack-infra | 23:40 | |
*** gordc has quit IRC | 23:41 | |
clarkb | mordred: ya that seems right | 23:41 |
*** ccrouch has quit IRC | 23:41 | |
clarkb | assuming the auth name is a key in auth_args | 23:41 |
mnaser | hrm, does nodepool have a hard requirement on adding floating IPs to servers? | 23:42 |
mordred | mnaser: nope | 23:42 |
mordred | mnaser: not if the cloud does not need floating ips | 23:42 |
mnaser | it .. seems like it does? at least based on the 0.2.0 release | 23:42 |
mordred | mnaser: it has never had a hard require on floating ips | 23:42 |
mordred | mnaser: only one of our four clouds has floating ips | 23:42 |
clarkb | if it can't determine the public ip it iwll try to fip though | 23:42 |
mordred | yes | 23:43 |
mnaser | mordred: interesting, so it seems that it's attempting to create floating ips here | 23:43 |
mnaser | well, the idea is that the customer doesn't want internet accessiblity to these machines (NAT is okay, but no public access) | 23:43 |
mordred | AH | 23:43 |
mnaser | perhaps i misformulated my question | 23:43 |
jeblair | nodpool's fip logic is tuned for our clouds; shade will make that better. | 23:43 |
mordred | mnaser: yah - I have config controls to support the thing you're doing in shade | 23:44 |
jeblair | nodpool. heh. clearly i meant to type nodepoor. | 23:44 |
*** baoli has quit IRC | 23:44 | |
mnaser | nodepoor? :-P | 23:44 |
mnaser | so the customer has their own internal /23 network that they want to deploy VMs inside, and maintain all communication inside that private neutron /23 network | 23:44 |
mordred | mnaser: I'm not 100% sure that we can express that in current nodepool- but I'm working on a patch that should help | 23:44 |
jeblair | dvorak typos are even better than qwerty ones | 23:44 |
mordred | mnaser: yah - the trick there will basically be to tell nodepool and shade that the internal network is the one it should consider "public" | 23:45 |
clarkb | mordred: mnaser you can, you just have to set the network name iwth the public attribute for that /23 | 23:45 |
clarkb | if you do that it will happily use unroutable IPs as the public IPs | 23:45 |
mnaser | clarkb: that's the workaround i thought about, except 0.2.0 (latest pypi release doesn't have that) | 23:45 |
mordred | clarkb: oh right - we have that directly in nodepool.yaml | 23:45 |
mnaser | it'd be cool if we got a new release hint hint hint | 23:45 |
clarkb | mnaser: oh ya don't use 0.2.0 | 23:45 |
mordred | :) | 23:45 |
clarkb | mnaser: as soon as we have reliablish image builds a new release should happen | 23:46 |
clarkb | it is very close | 23:46 |
*** chlong_ has quit IRC | 23:46 | |
mnaser | so takeaways, dont use 0.2.0 (master?) and - label: public\n public: true | 23:46 |
anteaya | nodepour, nodestream, nodewaterfall | 23:46 |
*** pahuang has joined #openstack-infra | 23:46 | |
clarkb | mnaser: yes, we deploy master | 23:47 |
*** devananda has quit IRC | 23:47 | |
clarkb | releases are somewhat arbitrary but there is at least one outstanding known bug that I owuldn't want to release with | 23:47 |
mnaser | i figured that was the reason | 23:47 |
mnaser | i think going for master is the best solution in this case | 23:48 |
clarkb | mordred: question about oscc vendor data, when do you choose to add the authurl and when do you not add the authurl | 23:48 |
*** thorst_ has quit IRC | 23:49 | |
*** weshay has quit IRC | 23:49 | |
*** dimtruck is now known as zz_dimtruck | 23:49 | |
*** thorst_ has joined #openstack-infra | 23:49 | |
mnaser | clarkb: say someone was to ask "very close", more in a timeframe (i don't expect a commitment) | 23:51 |
mnaser | few weeks -> few months -> few years? :p | 23:51 |
mordred | clarkb: when there is an auth url to add, I add it | 23:51 |
jamielennox | AJaeger: hey, if you're around, for https://review.openstack.org/#/c/271128/ i literally just need to add to gate-tempest-dsvm-neutron-identity-v3-only-full-nv to the devstack-gate list? | 23:51 |
mordred | clarkb: so, like, osic is a single cloud that's has an auth url | 23:51 |
mordred | clarkb: so it would do it | 23:51 |
clarkb | mnaser: for a release? the two outstnading things have changes proposed | 23:51 |
mordred | clarkb: but adding a vendor profile for bluebox wouldn't make sense | 23:51 |
clarkb | mordred: gotcha | 23:52 |
mordred | clarkb: since there are more than one bluebox cloud | 23:52 |
jamielennox | AJaeger: it's passing tox on my machine, and i don't see a corresponding one for identity-v3-only that has been otherwise declared | 23:52 |
mnaser | clarkb: sounds good, thank you :) | 23:52 |
* mnaser is excited to see this customer spin up nodepool for their CI | 23:52 | |
clarkb | mordred: and the floating ip source as None is only required if there are no floating IPs or should I put the external network name there if I have it? | 23:52 |
mordred | clarkb: only required if there are no floating ips | 23:53 |
mnaser | once they got up to ~50 concurrent builds/machines, jenkins didnt start feeling oh-so-hot, so they're moving to nodepool | 23:53 |
mordred | clarkb: and external network name only needed if it's a cloud where shade can't figure it out | 23:53 |
*** jlk has quit IRC | 23:54 | |
mordred | mnaser: WOOT | 23:54 |
clarkb | mordred: what are the criteria for that? | 23:54 |
clarkb | I guess I can just try making a fip and see whta happens | 23:54 |
*** bpokorny has joined #openstack-infra | 23:55 | |
mordred | clarkb: yah - or - do cloud.create_server(*args, auto_ip=True, wait=True) and see if you wind up with a server with a floating ip | 23:55 |
mordred | clarkb: there are almost no clouds where shade can't figure it out | 23:56 |
mgagne | is there a way to create dependent jobs in Zuul? Job A needs to complete before job B starts for example (in same pipeline) | 23:56 |
*** jlk has joined #openstack-infra | 23:57 | |
*** jlk has quit IRC | 23:57 | |
*** jlk has joined #openstack-infra | 23:57 | |
*** thorst_ has quit IRC | 23:57 | |
clarkb | venv/bin/glance --insecure image-list --sort disk_format does not actually show you the disk format :) | 23:58 |
clarkb | mgagne: yes you make the parent a dict key and the children a list of jobs | 23:58 |
anteaya | mnaser: we try to keep the jobs per jenkins to about 100 | 23:58 |
anteaya | but yay for nodepool | 23:59 |
mgagne | clarkb: really? where can I find an example? (docs, existing layout.yaml, etc.) | 23:59 |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: create_service() should normalize return value https://review.openstack.org/274091 | 23:59 |
clarkb | image-show works | 23:59 |
clarkb | mgagne: in our layout.yaml look at the tarball and pypi release jobs | 23:59 |
anteaya | yay | 23:59 |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add docs tox target https://review.openstack.org/276870 | 23:59 |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Clarify Munch object usage in documentation https://review.openstack.org/276878 | 23:59 |
clarkb | mgagne: the relationship there is tarball must complete before the upload job runs | 23:59 |
mgagne | will check, thanks! | 23:59 |
mnaser | anteaya: i think they're looking to bring all their CI to one centralized nodepool, similar to what the foundation does :) | 23:59 |
clarkb | mordred: qcow2 which is default so that is easy | 23:59 |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add enabled flag to keystone service data https://review.openstack.org/274116 | 23:59 |
mnaser | anyways, i'm off to go home.. to finish up more work :-P | 23:59 |
mgagne | clarkb: you know what I want =) | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!