| *** marcoemorais has quit IRC | 00:00 | |
| *** marcoemorais has joined #openstack-infra | 00:00 | |
| lifeless | clarkb: hmm? it should be doing most of its work in ram | 00:00 |
|---|---|---|
| lifeless | clarkb: we just use one of the default openstack flavors | 00:00 |
| clarkb | lifeless: I end up with 4GB of stuff in /tmp and each image itself takes up a ton of data | 00:01 |
| clarkb | one image build is worth like 8GB of disk | 00:01 |
| lifeless | clarkb: there's something wrong there | 00:01 |
| clarkb | we can't tmpfs because we do/did things that broke in tmpfs | 00:01 |
| lifeless | clarkb: unless you're relaly low ram ? | 00:01 |
| lifeless | oh | 00:01 |
| lifeless | so transient use of disk space could be quite big then | 00:01 |
| lifeless | but it shouldn't be leaking stuff post build | 00:01 |
| clarkb | lifeless: it leaks whenyou run out of disk | 00:01 |
| clarkb | lifeless: whcih only makes the problem worse | 00:02 |
| clarkb | I think we might be able to go back to tmpfs'ing though. I will test that in the future (probably not on the nodepool node though because ENORAM) | 00:02 |
| *** sarob_away is now known as sarob | 00:03 | |
| *** unicell has joined #openstack-infra | 00:07 | |
| *** wenlock has joined #openstack-infra | 00:08 | |
| *** dimtruck is now known as zz_dimtruck | 00:09 | |
| openstackgerrit | A change was merged to openstack-infra/config: Set the nodepool user and key on dib images https://review.openstack.org/123603 | 00:11 |
| *** wenlock has quit IRC | 00:12 | |
| clarkb | ok I have confirmed that /etc/nodepool and /opt/nodepool-scripts are created by the changes I have made | 00:15 |
| clarkb | fungi: ^ any opposition to me self approving? you +2'd the first (it has two +2's) but not the second | 00:16 |
| *** salv-orlando has quit IRC | 00:16 | |
| fungi | back, looking | 00:19 |
| clarkb | jhesketh: http://logs.openstack.org/09/123609/1/check/gate-config-layout/e553dc3/ will probably interest you | 00:19 |
| *** jergerber has quit IRC | 00:19 | |
| clarkb | jhesketh: I am not sure why that happened but it did happen | 00:20 |
| *** dmsimard_away is now known as dmsimard | 00:20 | |
| jhesketh | clarkb: hmm, https://jenkins06.openstack.org/job/gate-config-layout/1505/consoleText works for me | 00:21 |
| *** mwagner_lap has quit IRC | 00:22 | |
| *** JayJ has joined #openstack-infra | 00:22 | |
| * jhesketh watches the recheck | 00:22 | |
| clarkb | jhesketh: ya Iwonder if it is a transient thing with jenkins derping and apache doesn't know how to handle it so it 502s | 00:22 |
| jhesketh | that'd be my guess | 00:23 |
| fungi | clarkb: yeah, go for it. i only +2'd an didn't approve because you were still testing that | 00:23 |
| clarkb | fungi: and the child change as well? | 00:24 |
| *** dims has quit IRC | 00:24 | |
| fungi | er, or i'm misreading you... which is the second change? | 00:24 |
| *** SumitNaiksatam has quit IRC | 00:24 | |
| *** nosnos has joined #openstack-infra | 00:24 | |
| *** dims has joined #openstack-infra | 00:24 | |
| clarkb | fungi: https://review.openstack.org/#/c/123611/ child of that first one | 00:25 |
| fungi | i think gertty isn't showing it on the other change. thanks | 00:25 |
| *** otherwiseguy has quit IRC | 00:26 | |
| *** JayJ has quit IRC | 00:27 | |
| fungi | approved | 00:27 |
| *** JayJ has joined #openstack-infra | 00:27 | |
| clarkb | ty | 00:27 |
| clarkb | I will approve the first | 00:28 |
| *** dims has quit IRC | 00:29 | |
| *** ChuckC_ has joined #openstack-infra | 00:29 | |
| *** emagana has quit IRC | 00:29 | |
| *** hemna has quit IRC | 00:30 | |
| *** hdd has joined #openstack-infra | 00:31 | |
| *** JayJ has quit IRC | 00:32 | |
| *** JayJ has joined #openstack-infra | 00:33 | |
| *** ChuckC has joined #openstack-infra | 00:33 | |
| *** ChuckC_ has quit IRC | 00:33 | |
| mikal | fungi: you around? | 00:35 |
| fungi | mikal: barely | 00:35 |
| mikal | fungi: got time for a quick question in a PM? | 00:35 |
| fungi | sure | 00:36 |
| *** JayJ has quit IRC | 00:37 | |
| ianw | lifeless: what is the release policy for d-i-b? (sorry if this is written down somewhere obvious ... i didn't see it) | 00:37 |
| *** JayJ has joined #openstack-infra | 00:38 | |
| lifeless | ianw: we release each week if there are unreleased changes in it | 00:39 |
| *** todd_dsm has joined #openstack-infra | 00:39 | |
| lifeless | ianw: more often if there is an urgent thing | 00:40 |
| *** gyee has quit IRC | 00:41 | |
| morganfainberg | anteaya, zuul tv is live and just as exciting as last time! :) | 00:42 |
| morganfainberg | (maybe more exciting) | 00:42 |
| *** JayJ has quit IRC | 00:42 | |
| ianw | lifeless: thanks | 00:42 |
| *** Margaretta_Gorcz has quit IRC | 00:42 | |
| *** JayJ has joined #openstack-infra | 00:43 | |
| * anteaya checks | 00:44 | |
| *** gokrokve_ has quit IRC | 00:44 | |
| anteaya | merge-check is a whole new adventure | 00:44 |
| morganfainberg | i know! | 00:45 |
| *** sarob is now known as sarob_away | 00:46 | |
| *** marcoemorais has quit IRC | 00:47 | |
| *** JayJ has quit IRC | 00:47 | |
| *** dmsimard is now known as dmsimard_away | 00:47 | |
| *** marcoemorais has joined #openstack-infra | 00:48 | |
| *** marcoemorais has quit IRC | 00:48 | |
| *** marcoemorais has joined #openstack-infra | 00:48 | |
| *** marcoemorais has quit IRC | 00:48 | |
| *** marcoemorais has joined #openstack-infra | 00:49 | |
| *** gokrokve has joined #openstack-infra | 00:49 | |
| *** JayJ_ has joined #openstack-infra | 00:49 | |
| *** bhuvan has quit IRC | 00:51 | |
| ianw | lifeless: while on d-i-b, without having to look at all 148 files or whatever it is, do you have any general issue with the approach as in the changelog in https://review.openstack.org/#/c/119023/ (https://review.openstack.org/#/c/119023/)? | 00:51 |
| *** cnesa15 has quit IRC | 00:52 | |
| clarkb | I have reenabled puppet on nodepool.o.o | 00:52 |
| lifeless | ianw: I have a concern, I've put it in the review | 00:53 |
| *** JayJ_ has quit IRC | 00:54 | |
| *** mfer has joined #openstack-infra | 00:54 | |
| *** Angie_Rath21 has joined #openstack-infra | 00:55 | |
| *** JayJ_ has joined #openstack-infra | 00:55 | |
| *** r-daneel_ has quit IRC | 00:56 | |
| *** mfer has quit IRC | 00:59 | |
| *** JayJ_ has quit IRC | 01:00 | |
| *** JayJ_ has joined #openstack-infra | 01:00 | |
| *** arnaud has joined #openstack-infra | 01:01 | |
| *** todd_dsm has quit IRC | 01:02 | |
| *** hdd has quit IRC | 01:02 | |
| *** Longgeek has joined #openstack-infra | 01:03 | |
| *** VijayTripathi has quit IRC | 01:05 | |
| *** JayJ_ has quit IRC | 01:05 | |
| *** mmaglana has quit IRC | 01:05 | |
| *** gokrokve has quit IRC | 01:07 | |
| *** mwagner_lap has joined #openstack-infra | 01:10 | |
| *** camunoz has quit IRC | 01:11 | |
| *** boden has joined #openstack-infra | 01:11 | |
| fungi | clarkb: thanks | 01:13 |
| *** lcheng has joined #openstack-infra | 01:13 | |
| *** shashankhegde has quit IRC | 01:13 | |
| *** hdd has joined #openstack-infra | 01:14 | |
| *** boden has quit IRC | 01:16 | |
| *** SumitNaiksatam has joined #openstack-infra | 01:16 | |
| *** changbl_ has joined #openstack-infra | 01:16 | |
| *** david-lyle has joined #openstack-infra | 01:17 | |
| david-lyle | ls | 01:18 |
| clarkb | . .. foo bar foobar test | 01:19 |
| *** JayJ_ has joined #openstack-infra | 01:19 | |
| david-lyle | slow, but accurate :) | 01:19 |
| *** todd_dsm has joined #openstack-infra | 01:20 | |
| *** yaguang has joined #openstack-infra | 01:22 | |
| *** emagana has joined #openstack-infra | 01:22 | |
| *** zz_dimtruck is now known as dimtruck | 01:25 | |
| *** signed8bit has joined #openstack-infra | 01:25 | |
| *** Angie_Rath21 has quit IRC | 01:25 | |
| *** JayJ_ has quit IRC | 01:25 | |
| *** praneshp has quit IRC | 01:26 | |
| *** JayJ_ has joined #openstack-infra | 01:26 | |
| *** camunoz has joined #openstack-infra | 01:27 | |
| *** VijayTripathi has joined #openstack-infra | 01:28 | |
| *** hdd has quit IRC | 01:29 | |
| *** zns has joined #openstack-infra | 01:30 | |
| *** JayJ_ has quit IRC | 01:31 | |
| *** JayJ_ has joined #openstack-infra | 01:31 | |
| *** ttx has quit IRC | 01:33 | |
| *** jyuso has joined #openstack-infra | 01:34 | |
| *** JayJ_ has quit IRC | 01:34 | |
| openstackgerrit | A change was merged to openstack-infra/config: Rename nodepool exta-data.d to extra-data.d https://review.openstack.org/123609 | 01:36 |
| *** JayJ_ has joined #openstack-infra | 01:38 | |
| *** ttx has joined #openstack-infra | 01:38 | |
| *** ttx has quit IRC | 01:38 | |
| *** ttx has joined #openstack-infra | 01:38 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add a nodepool dib script to create /etc/nodepool https://review.openstack.org/123611 | 01:39 |
| *** Aurore50 has joined #openstack-infra | 01:40 | |
| *** todd_dsm has quit IRC | 01:42 | |
| *** groknix has quit IRC | 01:43 | |
| *** KanagarajM has quit IRC | 01:43 | |
| *** baoli has joined #openstack-infra | 01:44 | |
| *** cristov_mac has joined #openstack-infra | 01:44 | |
| *** cristov_mac has quit IRC | 01:44 | |
| *** sarob_away is now known as sarob | 01:47 | |
| *** cristov_mac has joined #openstack-infra | 01:47 | |
| *** amotoki has joined #openstack-infra | 01:47 | |
| *** cristov_mac has quit IRC | 01:47 | |
| *** acfleury has quit IRC | 01:48 | |
| *** cristov_mac has joined #openstack-infra | 01:49 | |
| *** cristov_mac has quit IRC | 01:49 | |
| *** cristov_mac has joined #openstack-infra | 01:50 | |
| *** otherwiseguy has joined #openstack-infra | 01:52 | |
| *** hdd has joined #openstack-infra | 01:52 | |
| *** armax has quit IRC | 01:56 | |
| *** sarob is now known as sarob_away | 01:56 | |
| *** ildikov has joined #openstack-infra | 01:57 | |
| *** mmedvede has quit IRC | 01:59 | |
| *** zns has quit IRC | 01:59 | |
| *** ildikov_ has quit IRC | 02:00 | |
| *** ildikov has quit IRC | 02:01 | |
| *** todd_dsm has joined #openstack-infra | 02:01 | |
| *** dims has joined #openstack-infra | 02:02 | |
| *** todd_dsm has quit IRC | 02:02 | |
| *** marcoemorais has quit IRC | 02:02 | |
| *** patrickeast has quit IRC | 02:04 | |
| *** david-lyle has quit IRC | 02:05 | |
| *** david-lyle has joined #openstack-infra | 02:06 | |
| *** pcrews has quit IRC | 02:06 | |
| *** zz_jgrimm is now known as jgrimm | 02:08 | |
| *** gokrokve has joined #openstack-infra | 02:09 | |
| *** david-lyle has quit IRC | 02:10 | |
| *** todd_dsm has joined #openstack-infra | 02:11 | |
| *** lcheng has quit IRC | 02:12 | |
| *** Ryan_Lane has quit IRC | 02:12 | |
| *** camunoz has quit IRC | 02:13 | |
| *** baoli has quit IRC | 02:15 | |
| *** baoli has joined #openstack-infra | 02:15 | |
| openstackgerrit | Ian Wienand proposed a change to openstack-infra/config: Add centos7 image to nodepool d-i-b config https://review.openstack.org/123594 | 02:16 |
| openstackgerrit | Ian Wienand proposed a change to openstack-infra/config: Initial centos7 support for build-image.sh https://review.openstack.org/123343 | 02:16 |
| ryanpetrello | anybody know if this is something beyond just a fluke? | 02:16 |
| ryanpetrello | http://screens.objects.dreamhost.com/09-23-2014-22-16-36.png | 02:16 |
| ryanpetrello | test failing to upload to Connecting to static.openstack.org | 02:16 |
| *** emagana has quit IRC | 02:17 | |
| *** emagana has joined #openstack-infra | 02:18 | |
| *** otherwiseguy has quit IRC | 02:18 | |
| clarkb | ryanpetrello: possible network problem. can you link to the log? | 02:18 |
| *** otherwiseguy has joined #openstack-infra | 02:18 | |
| ryanpetrello | clarkb: https://jenkins03.openstack.org/job/gate-pecan-tox-scaffolds-26/4/console | 02:19 |
| *** lcheng has joined #openstack-infra | 02:19 | |
| clarkb | ya Ithink that must be another manifestation of the hpcloud to rax networking trouble | 02:20 |
| clarkb | actually no, scp is master to static.o.o | 02:20 |
| clarkb | so internal rax network trouble? http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=139&rra_id=all doesn't make it look like a persistent problem | 02:22 |
| *** emagana has quit IRC | 02:22 | |
| *** praneshp has joined #openstack-infra | 02:22 | |
| *** yamahata has joined #openstack-infra | 02:23 | |
| *** todd_dsm has quit IRC | 02:24 | |
| ryanpetrello | okay, I'll just try again | 02:24 |
| ryanpetrello | not a big deal | 02:24 |
| *** camunoz has joined #openstack-infra | 02:30 | |
| *** praneshp_ has joined #openstack-infra | 02:30 | |
| *** gokrokve has quit IRC | 02:31 | |
| *** gokrokve has joined #openstack-infra | 02:32 | |
| *** praneshp has quit IRC | 02:32 | |
| *** praneshp_ is now known as praneshp | 02:32 | |
| *** dims has quit IRC | 02:35 | |
| *** JadnG has quit IRC | 02:35 | |
| *** sdake_ has joined #openstack-infra | 02:35 | |
| *** dims has joined #openstack-infra | 02:35 | |
| *** gokrokve has quit IRC | 02:36 | |
| *** harlowja is now known as harlowja_away | 02:36 | |
| *** Aurore50 has quit IRC | 02:38 | |
| *** dims has quit IRC | 02:39 | |
| *** SumitNaiksatam has quit IRC | 02:41 | |
| clarkb | morganfainberg: WARNING keystoneclient.httpclient: Failed to retrieve management_url from token is a really interesting thing to log | 02:43 |
| *** rmcall has quit IRC | 02:43 | |
| *** sarob_away is now known as sarob | 02:47 | |
| *** JadnG has joined #openstack-infra | 02:47 | |
| *** Ryan_Lane has joined #openstack-infra | 02:50 | |
| *** Amie74 has joined #openstack-infra | 02:51 | |
| clarkb | it appears that we can build our dib image with tmpfs if we want to do that. though it does't make the process go any quicker and may require a bigger nodepool.o.o node | 02:54 |
| clarkb | lifeless: how big of a tmpfs does dib expect? | 02:54 |
| lifeless | clarkb: see the docs | 02:55 |
| openstackgerrit | A change was merged to openstack-infra/infra-manual: Changed width of the image at the top of the page https://review.openstack.org/108867 | 02:55 |
| clarkb | lifeless: :P | 02:55 |
| *** maxbit has quit IRC | 02:55 | |
| lifeless | I don't often play the RTFM card, but when I do, dos equis | 02:56 |
| *** maxbit has joined #openstack-infra | 02:56 | |
| morganfainberg | clarkb, oh joy | 02:56 |
| morganfainberg | clarkb, haha | 02:56 |
| clarkb | morganfainberg: I mean its a thing but I didn't expect a management url in the first place | 02:57 |
| clarkb | not sure why I am being warned | 02:57 |
| morganfainberg | clarkb, yeah super useful thing to warn about | 02:57 |
| *** sarob is now known as sarob_away | 02:57 | |
| morganfainberg | clarkb, maybe "HEY i thought i'd have a management url but it's missing... what do it do with this token?" might be better | 02:57 |
| morganfainberg | clarkb, actually i don't know why that would be logged. | 02:57 |
| clarkb | morganfainberg: or maybe if I am not trying to do anything managementy it should care? | 02:57 |
| morganfainberg | clarkb, i'd need to go look - but it seems weirdly out of context | 02:57 |
| clarkb | *shouldn't | 02:58 |
| *** flaviof is now known as flaviof_zzz | 02:58 | |
| morganfainberg | clarkb, perhaps it wont mater. | 02:58 |
| clarkb | oh comcast | 02:58 |
| clarkb | some of my packaets currently go through new york to hit google | 02:58 |
| clarkb | google is about 60 miles east of here | 02:59 |
| morganfainberg | clarkb, oh it's just that it can't find the endpoint in the token for identoty | 02:59 |
| *** armax has joined #openstack-infra | 02:59 | |
| clarkb | morganfainberg: right but why would it expect that | 02:59 |
| clarkb | you want 99.99% of your users to never get a managemtn url | 02:59 |
| *** JayJ_ has quit IRC | 02:59 | |
| morganfainberg | clarkb, oh this looks like a region thing... | 03:00 |
| clarkb | lifeless: ok I have rtfm'd. The docs imply that nodepool will only tmpfs if there is 4GB of ram free? | 03:00 |
| morganfainberg | clarkb, and it may not actually matter | 03:01 |
| *** homeless has quit IRC | 03:01 | |
| clarkb | lifeless: my grasp of english at this hour is poor. is that a correctreading? | 03:01 |
| clarkb | morganfainberg: my operations succeeded | 03:02 |
| clarkb | morganfainberg: but its spat out those warnings to the console which is silly imo | 03:02 |
| morganfainberg | clarkb, then it's because you don't have a catalog and the warning is the wrong log level | 03:02 |
| morganfainberg | clarkb, in short, totally silly :) | 03:02 |
| morganfainberg | clarkb, and we should fix that. | 03:02 |
| *** sdake_ has quit IRC | 03:05 | |
| *** jvrbanac has quit IRC | 03:05 | |
| clarkb | ianw: jeblair fungi mordred nodepool just set its first devstack-trusty-dib node to ready state \o/ | 03:06 |
| *** dimtruck has quit IRC | 03:06 | |
| clarkb | things that I have noted. `sudo nodepool image-build devstack-trusty-dib` makes the dib files in /opt/nodepool_dib owned by root. I have manually chown -R'd to nodepool:nodepool so that nodepool can delete them when the time comes | 03:06 |
| clarkb | not sure if there is a better way to solve that problem than to say we should use sudo -u nodepool | 03:07 |
| *** ttx has quit IRC | 03:07 | |
| *** jlk has quit IRC | 03:07 | |
| *** comstud has quit IRC | 03:07 | |
| *** wendar has quit IRC | 03:07 | |
| *** cyeoh has quit IRC | 03:07 | |
| *** vishy has quit IRC | 03:08 | |
| clarkb | if we set up workers to do it like we talked about I think it becomes a non issue, because the command whould just hand a job off to a worker whcih would do it with the correct perms | 03:08 |
| *** wendar has joined #openstack-infra | 03:08 | |
| *** otherwiseguy has quit IRC | 03:09 | |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: doc update: add references to yaml local include files https://review.openstack.org/111478 | 03:10 |
| clarkb | woo my packets between home and irc box are hitting almost 50% packet loss crossing L3 | 03:11 |
| clarkb | on the link between comcast and L3. This must be primetime netflix derpage | 03:11 |
| lifeless | clarkb: I believe so | 03:11 |
| clarkb | lifeless: ty | 03:12 |
| clarkb | in that case I think it is safe for us to at least attempt to tmpfs rather than disale it completely | 03:12 |
| *** otherwiseguy has joined #openstack-infra | 03:13 | |
| clarkb | lifeless: previously we are setting the immutable bit on a file but we gave up on that | 03:13 |
| clarkb | when we were doing that tmpfs said lolno because its tmpfs. but now that we are not doing that tmpfs should be fine | 03:13 |
| *** melwitt has quit IRC | 03:15 | |
| *** jgrimm is now known as zz_jgrimm | 03:16 | |
| *** ttx has joined #openstack-infra | 03:16 | |
| *** ttx has quit IRC | 03:16 | |
| *** ttx has joined #openstack-infra | 03:16 | |
| *** armax has quit IRC | 03:17 | |
| *** yaguang has quit IRC | 03:18 | |
| *** radez_g0n3 is now known as radez | 03:19 | |
| lifeless | mordred: ping | 03:19 |
| *** Longgeek_ has joined #openstack-infra | 03:20 | |
| *** rmcall has joined #openstack-infra | 03:21 | |
| *** Longgeek has quit IRC | 03:23 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 03:24 | |
| *** radez is now known as radez_g0n3 | 03:25 | |
| openstackgerrit | Chaoyi Huang proposed a change to openstack-infra/config: Remove Jenkins jobs of tricircle project https://review.openstack.org/123622 | 03:30 |
| *** koolhead17 has joined #openstack-infra | 03:31 | |
| *** daya_k has joined #openstack-infra | 03:32 | |
| *** mmaglana has joined #openstack-infra | 03:33 | |
| ianw | clarkb: yay! | 03:35 |
| *** miqui has joined #openstack-infra | 03:35 | |
| *** Amie74 has quit IRC | 03:39 | |
| *** Alford_Cummings has joined #openstack-infra | 03:40 | |
| *** mmaglana has quit IRC | 03:45 | |
| *** mmaglana has joined #openstack-infra | 03:45 | |
| *** stevemar has joined #openstack-infra | 03:46 | |
| *** arnaud has quit IRC | 03:48 | |
| *** mmaglana has quit IRC | 03:50 | |
| *** signed8bit_ZZZzz has quit IRC | 03:50 | |
| *** marcoemorais has joined #openstack-infra | 03:55 | |
| *** marcoemorais1 has joined #openstack-infra | 03:57 | |
| *** yaguang has joined #openstack-infra | 03:59 | |
| *** marcoemorais has quit IRC | 04:00 | |
| *** Ryan_Lane has quit IRC | 04:03 | |
| *** liusheng has quit IRC | 04:03 | |
| *** terryw has joined #openstack-infra | 04:03 | |
| *** liusheng has joined #openstack-infra | 04:03 | |
| *** otherwiseguy has quit IRC | 04:06 | |
| *** garyh has quit IRC | 04:09 | |
| *** jaypipes has joined #openstack-infra | 04:10 | |
| *** markmcclain has quit IRC | 04:11 | |
| *** jpich has quit IRC | 04:11 | |
| *** jpich has joined #openstack-infra | 04:12 | |
| *** Alford_Cummings has quit IRC | 04:18 | |
| *** reed has joined #openstack-infra | 04:21 | |
| *** comstud has joined #openstack-infra | 04:21 | |
| *** zz_dimtruck has joined #openstack-infra | 04:21 | |
| *** jvrbanac has joined #openstack-infra | 04:21 | |
| *** zz_dimtruck is now known as dimtruck | 04:21 | |
| *** vishy has joined #openstack-infra | 04:22 | |
| *** rushiagr_away is now known as rushiagr | 04:23 | |
| *** arnaud has joined #openstack-infra | 04:24 | |
| *** rmcall has quit IRC | 04:25 | |
| *** reed has quit IRC | 04:25 | |
| *** rmcall has joined #openstack-infra | 04:27 | |
| *** dimtruck has quit IRC | 04:34 | |
| *** vishy has quit IRC | 04:34 | |
| *** jvrbanac has quit IRC | 04:34 | |
| *** baoli has quit IRC | 04:35 | |
| *** comstud has quit IRC | 04:35 | |
| *** zz_dimtruck has joined #openstack-infra | 04:38 | |
| *** comstud has joined #openstack-infra | 04:38 | |
| *** jvrbanac has joined #openstack-infra | 04:38 | |
| *** zz_dimtruck is now known as dimtruck | 04:38 | |
| *** vishy has joined #openstack-infra | 04:39 | |
| *** harlowja_at_home has joined #openstack-infra | 04:40 | |
| *** garyh has joined #openstack-infra | 04:40 | |
| *** jvrbanac has quit IRC | 04:44 | |
| *** dimtruck has quit IRC | 04:44 | |
| *** vishy has quit IRC | 04:44 | |
| *** comstud has quit IRC | 04:45 | |
| *** hdd has quit IRC | 04:46 | |
| *** sarob_away is now known as sarob | 04:47 | |
| mordred | lifeless: pppppppooooooonnnnnngggggg | 04:53 |
| *** stevemar has quit IRC | 04:54 | |
| openstackgerrit | Adam Gandelman proposed a change to openstack-infra/devstack-gate: Bump BUILD_TIMEOUT for both Ironic drivers https://review.openstack.org/123629 | 04:54 |
| *** stevemar has joined #openstack-infra | 04:54 | |
| *** arnaud has quit IRC | 04:56 | |
| *** sarob is now known as sarob_away | 04:57 | |
| *** rmcall has quit IRC | 04:58 | |
| *** hdd has joined #openstack-infra | 04:59 | |
| *** gokrokve has joined #openstack-infra | 05:00 | |
| *** Longgeek_ has quit IRC | 05:02 | |
| *** e0ne has joined #openstack-infra | 05:04 | |
| *** e0ne has quit IRC | 05:07 | |
| *** KanagarajM has joined #openstack-infra | 05:10 | |
| *** e0ne has joined #openstack-infra | 05:11 | |
| *** boden has joined #openstack-infra | 05:14 | |
| lifeless | mordred: so hai | 05:15 |
| *** shashankhegde has joined #openstack-infra | 05:16 | |
| lifeless | mordred: um,I replied to your blog; it may be incoherent. I think I have won over namespaces, see my post to the -dev list (I'd like to unblock zzeeek!) | 05:16 |
| *** Longgeek has joined #openstack-infra | 05:17 | |
| *** jvrbanac has joined #openstack-infra | 05:17 | |
| *** zz_dimtruck has joined #openstack-infra | 05:18 | |
| *** comstud has joined #openstack-infra | 05:18 | |
| *** zz_dimtruck is now known as dimtruck | 05:18 | |
| *** vishy has joined #openstack-infra | 05:18 | |
| *** boden has quit IRC | 05:19 | |
| *** harlowja_at_home has quit IRC | 05:19 | |
| *** e0ne has quit IRC | 05:22 | |
| *** xyang0 has quit IRC | 05:26 | |
| *** e0ne has joined #openstack-infra | 05:26 | |
| *** e0ne has quit IRC | 05:27 | |
| *** changbl_ has quit IRC | 05:28 | |
| *** mrmartin has joined #openstack-infra | 05:30 | |
| *** stevemar has quit IRC | 05:31 | |
| *** afazekas has joined #openstack-infra | 05:35 | |
| *** lcheng has quit IRC | 05:46 | |
| *** sc68cal has quit IRC | 05:51 | |
| *** arnaud has joined #openstack-infra | 05:51 | |
| *** miqui has quit IRC | 05:52 | |
| *** Longgeek has quit IRC | 05:52 | |
| *** gokrokve_ has joined #openstack-infra | 05:58 | |
| *** shashankhegde has quit IRC | 05:59 | |
| *** gokrokve has quit IRC | 06:01 | |
| *** jcoufal has joined #openstack-infra | 06:01 | |
| *** gokrokve_ has quit IRC | 06:02 | |
| *** YorikSar has quit IRC | 06:06 | |
| *** HeOS has quit IRC | 06:08 | |
| *** YorikSar has joined #openstack-infra | 06:08 | |
| *** k4n0 has joined #openstack-infra | 06:09 | |
| openstackgerrit | Ian Wienand proposed a change to openstack-infra/nodepool: Add meta option for passing meta-data https://review.openstack.org/123639 | 06:13 |
| ianw | clarkb / modred : ^ first-cut at meta-data setting as discussed for RAX images ... hopefully that is somewhat similar to what you're thinking of :) | 06:14 |
| *** amcrn has quit IRC | 06:15 | |
| *** boden has joined #openstack-infra | 06:15 | |
| *** flaper87|afk is now known as flaper87 | 06:17 | |
| *** lcheng has joined #openstack-infra | 06:17 | |
| *** Longgeek has joined #openstack-infra | 06:18 | |
| *** ayoung has quit IRC | 06:19 | |
| *** boden has quit IRC | 06:19 | |
| *** sdake_ has joined #openstack-infra | 06:20 | |
| *** sdake_ has quit IRC | 06:21 | |
| *** sdake_ has joined #openstack-infra | 06:21 | |
| *** KanagarajM has quit IRC | 06:21 | |
| *** ppai has joined #openstack-infra | 06:23 | |
| *** yamahata has quit IRC | 06:27 | |
| *** yamahata has joined #openstack-infra | 06:27 | |
| *** gokrokve has joined #openstack-infra | 06:28 | |
| *** lcheng has quit IRC | 06:29 | |
| *** gokrokve has quit IRC | 06:29 | |
| *** gokrokve has joined #openstack-infra | 06:30 | |
| *** imcsk8 has quit IRC | 06:31 | |
| *** imcsk8 has joined #openstack-infra | 06:31 | |
| *** gokrokve has quit IRC | 06:35 | |
| *** berendt has joined #openstack-infra | 06:37 | |
| *** nadya has joined #openstack-infra | 06:37 | |
| *** nadya is now known as Guest16151 | 06:38 | |
| *** ayoung has joined #openstack-infra | 06:40 | |
| *** berendt has quit IRC | 06:43 | |
| *** jistr has joined #openstack-infra | 06:46 | |
| *** ildikov has joined #openstack-infra | 06:46 | |
| *** vigneshvar has joined #openstack-infra | 06:48 | |
| *** hdd has quit IRC | 06:52 | |
| *** unicell has quit IRC | 06:53 | |
| AJaeger | jhesketh, is there a special reason that you did not approve https://review.openstack.org/#/c/122946/ ? Would be great to get that one in withhttps://review.openstack.org/#/c/122076, please | 06:54 |
| jhesketh | AJaeger: I think I just wasn't going to hang around at the time to make sure it went thorugh | 06:55 |
| jhesketh | *through | 06:55 |
| jhesketh | AJaeger: if you're online, I'll approve it now so you can help debug if it goes wrong | 06:56 |
| *** Guest16151 has quit IRC | 06:56 | |
| AJaeger | jhesketh, I'm around... | 06:56 |
| *** arnaud has quit IRC | 06:56 | |
| AJaeger | could you review 122076 as well, please? 122946 depends on it... | 06:56 |
| *** ihrachyshka has joined #openstack-infra | 06:56 | |
| *** yfried is now known as yfried|afk | 06:57 | |
| *** ashaeron has joined #openstack-infra | 06:58 | |
| *** berendt has joined #openstack-infra | 06:58 | |
| *** mpaolino has joined #openstack-infra | 06:59 | |
| *** ihrachyshka has quit IRC | 06:59 | |
| *** sdake_ has quit IRC | 06:59 | |
| *** zns has joined #openstack-infra | 07:00 | |
| *** ihrachyshka has joined #openstack-infra | 07:01 | |
| *** ihrachyshka has quit IRC | 07:02 | |
| jhesketh | AJaeger: 122076 approved | 07:05 |
| AJaeger | jhesketh, thanks a lot! | 07:05 |
| *** arxcruz has joined #openstack-infra | 07:06 | |
| *** GheRivero_ has joined #openstack-infra | 07:11 | |
| *** GheRivero has quit IRC | 07:14 | |
| *** GheRivero_ is now known as GheRivero | 07:15 | |
| openstackgerrit | A change was merged to openstack-infra/config: Use python-jobs and publish docs for manila https://review.openstack.org/122076 | 07:15 |
| openstackgerrit | A change was merged to openstack-infra/config: Publish python-manilaclient on pypi https://review.openstack.org/122946 | 07:15 |
| AJaeger | jhesketh, Do you have time for one more reivew that would be nice but is not critical, please? https://review.openstack.org/#/c/121633/ | 07:19 |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/config: Use a job-template for the tripleo jobs https://review.openstack.org/123649 | 07:19 |
| openstackgerrit | David Pursehouse proposed a change to stackforge/gertty: Rename gerrit-gertty.yaml to googlesource-gertty.yaml https://review.openstack.org/123650 | 07:19 |
| *** denis_makogon has joined #openstack-infra | 07:20 | |
| *** VijayTripathi has quit IRC | 07:28 | |
| *** gokrokve has joined #openstack-infra | 07:31 | |
| *** Longgeek has quit IRC | 07:31 | |
| *** HeOS has joined #openstack-infra | 07:31 | |
| *** jp_at_hp has joined #openstack-infra | 07:35 | |
| *** gokrokve has quit IRC | 07:35 | |
| *** cnesa15 has joined #openstack-infra | 07:36 | |
| *** zns has quit IRC | 07:37 | |
| *** zns has joined #openstack-infra | 07:38 | |
| jhesketh | AJaeger: Approved :-) | 07:40 |
| *** amuller has joined #openstack-infra | 07:40 | |
| *** ihrachyshka has joined #openstack-infra | 07:41 | |
| *** MaxV has joined #openstack-infra | 07:48 | |
| openstackgerrit | A change was merged to openstack-infra/config: Update jobs for zaqar https://review.openstack.org/121633 | 07:50 |
| *** yfried|afk is now known as yfried | 07:51 | |
| *** Hal has joined #openstack-infra | 07:52 | |
| *** e0ne has joined #openstack-infra | 07:53 | |
| *** Hal is now known as Guest68510 | 07:53 | |
| *** boden has joined #openstack-infra | 07:56 | |
| *** Ryan_Lane has joined #openstack-infra | 07:56 | |
| *** Ryan_Lane has quit IRC | 07:56 | |
| *** zns has quit IRC | 07:56 | |
| *** jlibosva has joined #openstack-infra | 07:58 | |
| *** mancdaz has joined #openstack-infra | 07:59 | |
| *** zns has joined #openstack-infra | 08:00 | |
| *** yfried is now known as yfried|afk | 08:04 | |
| *** hashar has joined #openstack-infra | 08:04 | |
| *** pblaho has joined #openstack-infra | 08:07 | |
| *** nadya has joined #openstack-infra | 08:08 | |
| *** nadya is now known as Guest88992 | 08:08 | |
| *** hashar_ has joined #openstack-infra | 08:09 | |
| *** mrmartin has quit IRC | 08:09 | |
| *** e0ne has quit IRC | 08:10 | |
| *** hashar has quit IRC | 08:11 | |
| *** praneshp has quit IRC | 08:11 | |
| *** mwhudson has joined #openstack-infra | 08:12 | |
| *** Longgeek has joined #openstack-infra | 08:12 | |
| *** ttx has quit IRC | 08:16 | |
| *** mrmartin has joined #openstack-infra | 08:16 | |
| *** ttx has joined #openstack-infra | 08:17 | |
| *** ttx has quit IRC | 08:17 | |
| *** ttx has joined #openstack-infra | 08:17 | |
| *** lcheng has joined #openstack-infra | 08:25 | |
| *** gokrokve has joined #openstack-infra | 08:28 | |
| *** gokrokve has quit IRC | 08:33 | |
| *** mpaolino has quit IRC | 08:36 | |
| *** zz_johnthetubagu is now known as johnthetubaguy | 08:36 | |
| *** yfried|afk is now known as yfried | 08:38 | |
| *** cnesa has joined #openstack-infra | 08:39 | |
| *** marcoemorais1 has quit IRC | 08:41 | |
| *** bauzas has joined #openstack-infra | 08:42 | |
| bauzas | SergeyLukjanov: hi | 08:42 |
| bauzas | SergeyLukjanov: https://review.openstack.org/118651 is already having 2 +2s, could you please +W it ? Thanks ! | 08:43 |
| DinaBelova | bauzas, SergeyLukjanov is in the US right now, he's sleeping I guess :) | 08:44 |
| *** jistr has quit IRC | 08:45 | |
| *** lcheng has quit IRC | 08:46 | |
| bauzas | DinaBelova: oooooh :) | 08:46 |
| bauzas | DinaBelova: then no worries :) | 08:47 |
| DinaBelova | bauzas :) | 08:47 |
| bauzas | any infra-core could then bless this patch ? :) | 08:47 |
| *** andreaf_ is now known as andreaf | 08:47 | |
| *** yfried is now known as yfried|afk | 08:48 | |
| *** e0ne has joined #openstack-infra | 08:50 | |
| openstackgerrit | A change was merged to openstack/requirements: Bump websockify to >=0.6.0 which fixes bug causing zombie processes https://review.openstack.org/114757 | 08:52 |
| DinaBelova | bauzas, I suppose jhesketh may be somewhere around | 08:55 |
| bauzas | DinaBelova: ok, no worries, will wait for a few hours | 08:55 |
| jhesketh | bauzas: I'll take a look | 08:56 |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/config: Use a job-template for the tripleo jobs https://review.openstack.org/123649 | 08:57 |
| jhesketh | bauzas, DinaBelova: approved | 08:58 |
| DinaBelova | jhesketh, thank you sir! | 08:59 |
| *** YorikSar has quit IRC | 08:59 | |
| *** Longgeek has quit IRC | 09:00 | |
| *** YorikSar has joined #openstack-infra | 09:01 | |
| *** BobBall_Away is now known as BobBall | 09:03 | |
| *** jpich has quit IRC | 09:04 | |
| hashar_ | jhesketh: good sometime zone :] I got Zuul cloner enabled on Wikimedia production! | 09:06 |
| jhesketh | hashar_: woot :-) | 09:07 |
| hashar_ | jhesketh: monty/james told me they were going to switch Openstack jobs to it as well. So I guess it is probably safe enough for turbo hipster | 09:07 |
| *** ociuhandu has quit IRC | 09:08 | |
| *** jistr has joined #openstack-infra | 09:08 | |
| *** derekh has joined #openstack-infra | 09:09 | |
| bauzas | jhesketh: awesome, thanks | 09:09 |
| *** salv-orlando has joined #openstack-infra | 09:10 | |
| *** zns has quit IRC | 09:12 | |
| *** zns has joined #openstack-infra | 09:12 | |
| openstackgerrit | A change was merged to openstack-infra/config: Enable IRC channel logging for #openstack-fr https://review.openstack.org/118651 | 09:14 |
| *** andreykurilin_ has joined #openstack-infra | 09:16 | |
| *** loki184 has joined #openstack-infra | 09:20 | |
| *** openstack has joined #openstack-infra | 09:24 | |
| *** gokrokve has joined #openstack-infra | 09:28 | |
| *** gokrokve has quit IRC | 09:29 | |
| *** gokrokve has joined #openstack-infra | 09:30 | |
| *** toni_v has joined #openstack-infra | 09:32 | |
| toni_v | Hi | 09:32 |
| toni_v | I can not install devstack over icehouse Igot this error: ERROR: openstack Internal Server Error (HTTP 500) | 09:32 |
| *** gokrokve has quit IRC | 09:35 | |
| AJaeger | jhesketh, thanks! | 09:39 |
| *** miarmak has quit IRC | 09:39 | |
| *** zns has quit IRC | 09:39 | |
| *** dizquierdo has joined #openstack-infra | 09:39 | |
| *** Longgeek has joined #openstack-infra | 09:41 | |
| *** zns has joined #openstack-infra | 09:42 | |
| *** denis_makogon has quit IRC | 09:43 | |
| *** ihrachyshka has quit IRC | 09:46 | |
| *** ildikov has quit IRC | 09:48 | |
| *** Guest88992 is now known as _nadya_ | 09:50 | |
| *** rlandy has joined #openstack-infra | 09:51 | |
| *** esker has joined #openstack-infra | 09:52 | |
| *** e0ne has quit IRC | 09:54 | |
| *** hashar_ is now known as hashar | 09:57 | |
| *** unicell has joined #openstack-infra | 10:00 | |
| *** flaviof_zzz is now known as flaviof | 10:04 | |
| *** yfried|afk is now known as yfried | 10:07 | |
| *** esker has quit IRC | 10:08 | |
| *** e0ne has joined #openstack-infra | 10:08 | |
| *** pcm_ has joined #openstack-infra | 10:12 | |
| *** Guest68510 has quit IRC | 10:14 | |
| *** pcm_ has quit IRC | 10:15 | |
| *** pcm_ has joined #openstack-infra | 10:15 | |
| *** ociuhandu has joined #openstack-infra | 10:17 | |
| *** ildikov has joined #openstack-infra | 10:17 | |
| *** cnesa15 has quit IRC | 10:19 | |
| *** cbkyeoh has joined #openstack-infra | 10:20 | |
| *** ihrachyshka has joined #openstack-infra | 10:20 | |
| *** dizquierdo has quit IRC | 10:23 | |
| *** yfried is now known as yfried|afk | 10:23 | |
| *** yfried|afk is now known as yfried | 10:23 | |
| *** cbkyeoh is now known as cyeoh | 10:24 | |
| *** andreykurilin_ has quit IRC | 10:28 | |
| *** gokrokve has joined #openstack-infra | 10:28 | |
| *** gokrokve has quit IRC | 10:33 | |
| *** hashar has quit IRC | 10:36 | |
| *** dizquierdo has joined #openstack-infra | 10:37 | |
| *** sandywalsh has joined #openstack-infra | 10:39 | |
| *** rushiagr is now known as rushiagr_away | 10:40 | |
| *** zns has quit IRC | 10:40 | |
| *** rushiagr_away is now known as rushiagr | 10:43 | |
| *** cnesa has quit IRC | 10:45 | |
| *** dims has joined #openstack-infra | 10:48 | |
| *** dmsimard_away is now known as dmsimard | 11:00 | |
| openstackgerrit | A change was merged to openstack/requirements: Bump python-cinderclient version to 1.1.0. https://review.openstack.org/121624 | 11:00 |
| *** ildikov_ has joined #openstack-infra | 11:02 | |
| *** toni_v has quit IRC | 11:02 | |
| *** ppai has quit IRC | 11:04 | |
| *** ildikov has quit IRC | 11:04 | |
| *** esker has joined #openstack-infra | 11:04 | |
| *** esker has quit IRC | 11:04 | |
| *** mwagner_lap has quit IRC | 11:05 | |
| openstackgerrit | Paul Bourke proposed a change to openstack-infra/jeepyb: Allow expire_old_reviews to be used with suexec https://review.openstack.org/123693 | 11:08 |
| *** ociuhandu has quit IRC | 11:08 | |
| *** ociuhandu has joined #openstack-infra | 11:10 | |
| *** e0ne has quit IRC | 11:12 | |
| openstackgerrit | Paul Bourke proposed a change to openstack-infra/jeepyb: Allow expire_old_reviews to be used with suexec https://review.openstack.org/123693 | 11:13 |
| *** ppai has joined #openstack-infra | 11:18 | |
| *** yaguang has quit IRC | 11:19 | |
| *** koolhead17 has quit IRC | 11:24 | |
| dstufft | clarkb: fungi mordred If you upgrade bandersnatch to 1.6.1 you'll be ready when the next version of pip comes out, Christian merged my name normalization patch and released it | 11:28 |
| *** gokrokve has joined #openstack-infra | 11:28 | |
| *** ociuhandu has quit IRC | 11:28 | |
| *** yfried is now known as yfried|afk | 11:29 | |
| *** gokrokve has quit IRC | 11:33 | |
| *** marcusvrn has joined #openstack-infra | 11:33 | |
| *** yfried|afk is now known as yfried | 11:33 | |
| *** yamahata has quit IRC | 11:35 | |
| *** HeOS has quit IRC | 11:41 | |
| *** e0ne has joined #openstack-infra | 11:44 | |
| *** weshay has joined #openstack-infra | 11:46 | |
| *** dkliban_afk is now known as dkliban | 11:47 | |
| sdague | so something is pretty wrong with zuul at the moment, merge checks are backed up 45 minutes, which I thought was suposed to be super cheap | 11:48 |
| *** HeOS has joined #openstack-infra | 11:49 | |
| sdague | and we've got a ton of stuff waiting for nodes... but aren't using our nodes | 11:50 |
| *** mbacchi has joined #openstack-infra | 11:53 | |
| *** baoli has joined #openstack-infra | 11:55 | |
| *** dmakogon_ is now known as denis_makogon | 11:56 | |
| *** p5ntangle has quit IRC | 12:00 | |
| *** p5ntangle has joined #openstack-infra | 12:01 | |
| *** berendt has quit IRC | 12:02 | |
| *** loki184 has quit IRC | 12:04 | |
| *** dims has quit IRC | 12:05 | |
| *** dims has joined #openstack-infra | 12:05 | |
| *** p5ntangle has quit IRC | 12:06 | |
| *** HenryG_afk is now known as HenryG | 12:09 | |
| *** yfried is now known as yfried|afk | 12:10 | |
| *** mrmartin has quit IRC | 12:10 | |
| *** julim has joined #openstack-infra | 12:11 | |
| *** JayJ_ has joined #openstack-infra | 12:12 | |
| *** bswartz has quit IRC | 12:14 | |
| *** adalbas has joined #openstack-infra | 12:21 | |
| *** ppai has quit IRC | 12:21 | |
| *** signed8bit has joined #openstack-infra | 12:23 | |
| *** yfried|afk is now known as yfried | 12:23 | |
| openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack/requirements: Allow projects to use oslo.middleware https://review.openstack.org/123712 | 12:25 |
| *** aysyanne has joined #openstack-infra | 12:26 | |
| *** mrmartin has joined #openstack-infra | 12:28 | |
| *** gokrokve has joined #openstack-infra | 12:28 | |
| openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack/requirements: Bump requests to 2.2.0 https://review.openstack.org/123714 | 12:28 |
| *** doug-fish has joined #openstack-infra | 12:28 | |
| *** mmedvede has joined #openstack-infra | 12:29 | |
| *** maxbit_ has joined #openstack-infra | 12:31 | |
| *** hdd has joined #openstack-infra | 12:32 | |
| *** hashar has joined #openstack-infra | 12:32 | |
| *** gokrokve has quit IRC | 12:33 | |
| *** maxbit has quit IRC | 12:33 | |
| sdague | fungi: let me know when you get around, the gate is quite... odd | 12:33 |
| HenryG | Hi. In openstack-infra/config there is slave_db.pp to install mysql and pg backends with 'openstack_citest' user. I would like this to be done for the machines running the neutron-dsvm-functional job. I am not familiar with puppet and would appreciate some hints. | 12:34 |
| *** ppai has joined #openstack-infra | 12:35 | |
| HenryG | Not sure if that would cause issues for devstack on the node? | 12:35 |
| *** mwagner_lap has joined #openstack-infra | 12:36 | |
| *** ppai has quit IRC | 12:37 | |
| *** signed8bit has quit IRC | 12:38 | |
| *** hashar has quit IRC | 12:39 | |
| *** Guest68510 has joined #openstack-infra | 12:39 | |
| *** hashar has joined #openstack-infra | 12:42 | |
| openstackgerrit | Thomas Bechtold proposed a change to openstack-infra/config: install_puppet.sh: Initial openSUSE support https://review.openstack.org/123717 | 12:46 |
| *** eharney has joined #openstack-infra | 12:47 | |
| *** ociuhandu has joined #openstack-infra | 12:49 | |
| *** jyuso has quit IRC | 12:52 | |
| *** pblaho has quit IRC | 12:52 | |
| *** jgallard has joined #openstack-infra | 12:54 | |
| jroll | g'morning | 12:55 |
| *** ayoung has quit IRC | 12:57 | |
| *** mfer has joined #openstack-infra | 12:57 | |
| *** signed8bit has joined #openstack-infra | 12:58 | |
| *** flaviof is now known as flaviof_zzz | 12:59 | |
| *** viktors has joined #openstack-infra | 12:59 | |
| *** dkranz has joined #openstack-infra | 13:00 | |
| *** _nadya_ has quit IRC | 13:02 | |
| *** amuller has quit IRC | 13:06 | |
| *** _nadya_ has joined #openstack-infra | 13:07 | |
| *** bswartz has joined #openstack-infra | 13:07 | |
| *** changbl_ has joined #openstack-infra | 13:08 | |
| *** radez_g0n3 is now known as radez | 13:11 | |
| *** maxbit_ has quit IRC | 13:11 | |
| *** miqui has joined #openstack-infra | 13:11 | |
| *** mjturek has joined #openstack-infra | 13:17 | |
| *** hdd has quit IRC | 13:18 | |
| *** bauzas has left #openstack-infra | 13:18 | |
| *** dkranz has quit IRC | 13:18 | |
| fungi | sdague: thanks, looking | 13:18 |
| *** dane_leblanc has joined #openstack-infra | 13:19 | |
| *** mriedem has joined #openstack-infra | 13:21 | |
| fungi | sdague: so... the periods of jobs not using ready nodes are generally zuul dealing with the merge-check pipeline. there was some talk about making it lower priority than other pipelines (except maybe experimental and silent pipelines) but i don't think anybody' shad time to tweak that yet | 13:21 |
| *** hdd has joined #openstack-infra | 13:21 | |
| *** yfried is now known as yfried|afk | 13:21 | |
| *** hdd has quit IRC | 13:21 | |
| sdague | fungi: I thought it was super cheap? | 13:21 |
| *** yamahata has joined #openstack-infra | 13:21 | |
| *** xyang0 has joined #openstack-infra | 13:21 | |
| fungi | super-cheap-ish compared to using a node. calculating a nova merge is still a couple minutes i think | 13:22 |
| *** zns has joined #openstack-infra | 13:22 | |
| sdague | ok, so I saw those at 45 min backup this morning | 13:23 |
| fungi | though also i think we have a few nodes which got left in ready during nodepool restarts last night (picked up jobs in the moments when the daemon wasn't watching events) so i'm clearing those now | 13:23 |
| *** yamahata has quit IRC | 13:24 | |
| *** yamahata_ has joined #openstack-infra | 13:24 | |
| *** yfried|afk is now known as yfried | 13:24 | |
| fungi | hrm... we did merge a requirements change ~2 hours ago... so the spike there may have been when it proposed reqs updates | 13:26 |
| *** markmcclain has joined #openstack-infra | 13:26 | |
| *** _buzz has joined #openstack-infra | 13:27 | |
| *** nosnos has quit IRC | 13:27 | |
| *** nosnos has joined #openstack-infra | 13:27 | |
| *** _nadya_ has quit IRC | 13:28 | |
| *** gokrokve has joined #openstack-infra | 13:28 | |
| *** markmcclain1 has joined #openstack-infra | 13:28 | |
| *** _buzz_ has quit IRC | 13:29 | |
| *** che-arne has quit IRC | 13:30 | |
| *** bknudson has joined #openstack-infra | 13:30 | |
| *** markmcclain has quit IRC | 13:31 | |
| *** dprince has joined #openstack-infra | 13:31 | |
| *** nosnos has quit IRC | 13:32 | |
| *** gokrokve has quit IRC | 13:33 | |
| *** _nadya_ has joined #openstack-infra | 13:33 | |
| sdague | maybe it would be nice if we rate limitted those, so we do that once a week, and not as a post job | 13:33 |
| *** yfried is now known as yfried|afk | 13:34 | |
| *** dkranz has joined #openstack-infra | 13:34 | |
| *** skolekonov has quit IRC | 13:35 | |
| sdague | I feel like 10hr gate backup is really high for the state of the world right now, given that logstash is really delayed, it's hard to figure out what's causing it | 13:35 |
| sdague | for instance yesterday's rax outage only just showed up | 13:35 |
| fungi | well, if zuul did merge checks when its mergers weren't busy calculating merges for jobs in higher-priority pipelines, then it wouldn't lead to a lull like that... but also i don't think that's likely to be causing the gate to be running so far behind | 13:37 |
| fungi | and it's certainly not the cause of the logstash backlog | 13:38 |
| fungi | if anything it would be helping logstash catch up by causing us not to run jobs as quickly | 13:38 |
| fungi | keeping in mind that those lulls from bursts in merge-check are letting nodepool catch back up and also letting providers catch up on delete requests, the actual impact to throughput may be minimal | 13:39 |
| *** koolhead17 has joined #openstack-infra | 13:39 | |
| *** koolhead17 has joined #openstack-infra | 13:39 | |
| fungi | and i think clarkb has resolved at this point that the solution to the logstash backlog is either lower log volume or faster disk | 13:40 |
| *** homeless has joined #openstack-infra | 13:42 | |
| fungi | also, we seem to continue to accumulate disassociated floating ips in our hpcloud tenant, causing us to overrun our quota there. not sure if this morning's batch is in any way related to our nodepool restarts last night, but i'll keep an eye on it throughout the day after this cleanup pass | 13:43 |
| fungi | #status log removed 79 disassociated floating ips in hpcloud | 13:43 |
| openstackstatus | fungi: finished logging | 13:43 |
| *** juzuluag has joined #openstack-infra | 13:44 | |
| fungi | and bandersnatch has released a new version which may help with our occasional staleness from hanging at teardown | 13:45 |
| fungi | hopefully that doesn't break other things in the process | 13:45 |
| fungi | our puppet manifest just ensures "present" for that, so we could in theory upgrade it on pypi.ord.o.o since it serves the smallest volume of workers and then proceed with the others if that doesn't expose any issues | 13:49 |
| *** zz_gondoi is now known as gondoi | 13:53 | |
| *** lcheng has joined #openstack-infra | 13:54 | |
| *** flaviof_zzz is now known as flaviof | 13:54 | |
| *** _nadya_ has joined #openstack-infra | 13:56 | |
| *** dangers_away is now known as dangers | 13:56 | |
| pabelanger | fungi, yes, I don't keep any nodes ready. Mostly because of the costs associated with keeping them running 24/7 | 13:58 |
| *** Sincler has joined #openstack-infra | 13:58 | |
| openstackgerrit | Victor Sergeyev proposed a change to openstack/requirements: Add PyMySQL to global requirements https://review.openstack.org/123737 | 13:58 |
| *** r-daneel_ has joined #openstack-infra | 13:59 | |
| *** hdd has joined #openstack-infra | 13:59 | |
| fungi | viktors: ^ i'm very much in favor of that addition, but you may want to consider keeping it at wip status until after the reqs freeze is lifted | 14:00 |
| viktors | fungi: done | 14:01 |
| *** vhoward has joined #openstack-infra | 14:02 | |
| viktors | fungi: by the way, when K master will be open? | 14:02 |
| *** yamahata_ has quit IRC | 14:02 | |
| *** gokrokve has joined #openstack-infra | 14:03 | |
| *** yamahata_ has joined #openstack-infra | 14:03 | |
| *** gokrokve has quit IRC | 14:03 | |
| *** gokrokve has joined #openstack-infra | 14:03 | |
| *** gokrokve has quit IRC | 14:03 | |
| *** gokrokve has joined #openstack-infra | 14:04 | |
| *** yamahata_ has quit IRC | 14:04 | |
| fungi | viktors: once rc1 has been tagged for all integrated servers | 14:04 |
| fungi | viktors: i believe that's the point at which we branch off openstack/requirements for the upcoming release | 14:05 |
| *** yamahata_ has joined #openstack-infra | 14:05 | |
| viktors | fungi: ok, thanks. | 14:06 |
| *** mmedvede has quit IRC | 14:06 | |
| *** nelsnelson has joined #openstack-infra | 14:07 | |
| *** sabeen has quit IRC | 14:08 | |
| fungi | yikes... "CVE-2014-6271: remote code execution through bash" (code execution via envvars inherited over remote login sessions, e.g. ssh) | 14:09 |
| uvirtbot | fungi: ** RESERVED ** This candidate has been reserved by an organization or individual that will use it when announcing a new security problem. When the candidate has been publicized, the details for this candidate will be provided. (http://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2014-6271) | 14:09 |
| *** gondoi is now known as zz_gondoi | 14:10 | |
| *** maxbit has joined #openstack-infra | 14:10 | |
| *** mmedvede has joined #openstack-infra | 14:15 | |
| BobBall | sounds very nasty fungi | 14:16 |
| fungi | mostly nasty if you're filtering commands via .ssh/authorized_keys or in your sshd_config but not completely sanitizing the environment too | 14:18 |
| *** MindfulMonk has joined #openstack-infra | 14:18 | |
| *** sabeen1 has joined #openstack-infra | 14:18 | |
| *** hdd has quit IRC | 14:21 | |
| BobBall | Well surely it also allows people to 'piggy back' on someoens SSH session from a compromised box in order to compromise another box? | 14:21 |
| *** asettle has joined #openstack-infra | 14:21 | |
| *** daya_k has quit IRC | 14:21 | |
| fungi | sure, though there were already ways to do that | 14:21 |
| fungi | (tweak their path to call a trojaned ssh client/agent for example) | 14:22 |
| fungi | though yes, this could be an arguably slightly more trivial means to the same end | 14:23 |
| *** lcheng has quit IRC | 14:24 | |
| *** hdd has joined #openstack-infra | 14:24 | |
| fungi | either method is generally thwarted by never logging into a higher-security system from a lower-security system | 14:24 |
| sdague | fungi: https://review.openstack.org/#/c/123742/ - closes one of the top gate bugs by deleting the problematic test | 14:25 |
| sdague | so a promote might be in order | 14:25 |
| fungi | sdague: lgtm. i'll bring it forward | 14:26 |
| sdague | it looks like if we wait 5 minutes we might land 4 patches first | 14:26 |
| fungi | i plan to | 14:26 |
| *** arnaud__ has joined #openstack-infra | 14:27 | |
| *** zz_jgrimm is now known as jgrimm | 14:27 | |
| sdague | coolio | 14:27 |
| sdague | thank you sir | 14:27 |
| *** rlandy has quit IRC | 14:27 | |
| *** zz_gondoi is now known as gondoi | 14:27 | |
| nibalizer | clarkb: you were saying memory use on the puppetmaster under 3.7 is super high right? | 14:27 |
| fungi | nibalizer: leaking, it seemed | 14:28 |
| *** ociuhandu_ has joined #openstack-infra | 14:31 | |
| *** ociuhandu has quit IRC | 14:31 | |
| *** ociuhandu_ is now known as ociuhandu | 14:31 | |
| *** david-lyle has joined #openstack-infra | 14:31 | |
| *** david-lyle has quit IRC | 14:31 | |
| *** lcheng has joined #openstack-infra | 14:31 | |
| *** lcheng has quit IRC | 14:31 | |
| *** david-lyle has joined #openstack-infra | 14:32 | |
| fungi | nibalizer: right now, we have 5 ruby processes running as the puppet user consuming between 125 and 500 mib resident, with very little at all shared, and the server only has 2gib ram | 14:32 |
| fungi | and the numbers are slowly climbing | 14:32 |
| fungi | since upgrading all the systems to point at the new puppetmaster, we've had it run out of memory and need restarting twice | 14:33 |
| *** david-lyle has quit IRC | 14:33 | |
| *** david-lyle has joined #openstack-infra | 14:34 | |
| *** hashar_ has joined #openstack-infra | 14:34 | |
| *** david-lyle has quit IRC | 14:34 | |
| *** david-lyle has joined #openstack-infra | 14:35 | |
| *** mrmartin has quit IRC | 14:35 | |
| *** tty57 has joined #openstack-infra | 14:36 | |
| *** andreaf_ has joined #openstack-infra | 14:36 | |
| *** andreaf has quit IRC | 14:36 | |
| *** andreaf_ is now known as andreaf | 14:36 | |
| *** andreaf_ has joined #openstack-infra | 14:36 | |
| *** hashar has quit IRC | 14:37 | |
| nibalizer | okay | 14:39 |
| nibalizer | someone in #puppet is in about the same boat | 14:39 |
| *** jp_at_hp has quit IRC | 14:39 | |
| fungi | would tweaking apache's max requests per thread cause passenger to free up accumulated virtual memory? | 14:39 |
| *** gargola has joined #openstack-infra | 14:40 | |
| *** stevemar has joined #openstack-infra | 14:40 | |
| *** emagana has joined #openstack-infra | 14:41 | |
| jroll | fungi, nibalizer, I'm sure it's not on your radar yet but you might be interested in http://puppetlabs.com/blog/puppet-server-bringing-soa-to-a-puppet-master-near-you | 14:43 |
| *** yfried|afk is now known as yfried | 14:43 | |
| *** pballand has quit IRC | 14:43 | |
| *** andreaf has quit IRC | 14:43 | |
| *** lcheng has joined #openstack-infra | 14:45 | |
| nibalizer | jroll: yea, but we want to wait for it to be real software first | 14:46 |
| nibalizer | right now its 0.2.0 or something and they make no promises about the stability of the api | 14:46 |
| jroll | :P | 14:46 |
| jroll | touché | 14:46 |
| nibalizer | on the other hand | 14:46 |
| clarkb | meh I still contend the server isnt the issue. The issue is expecting one central thing to compile graphs for everyone when you have a botnet | 14:47 |
| *** pcrews has joined #openstack-infra | 14:47 | |
| *** jp_at_hp has joined #openstack-infra | 14:47 | |
| fungi | sdague: promoted that nova change to the front now that anything which wasn't at least an hour out has reported | 14:47 |
| *** jp_at_hp has quit IRC | 14:48 | |
| clarkb | fungi did you see I got the dib slave up last night? | 14:49 |
| fungi | clarkb: i did. i just deleted one from ready and am watching it build again | 14:49 |
| fungi | not the image, but just the node | 14:49 |
| *** mmaglana has joined #openstack-infra | 14:49 | |
| clarkb | would like to get https://review.openstack.org/#/c/123245/ in soon to run tests on those nodes | 14:50 |
| *** hemnass has quit IRC | 14:51 | |
| *** jp_at_hp has joined #openstack-infra | 14:51 | |
| mtreinish | clarkb: do you know if there is a better way to do?: https://review.openstack.org/#/c/123589/ | 14:51 |
| EmilienM | could I have a review on https://review.openstack.org/#/c/120285/ ? It has been a while, and I already have +2, +1 reviews. Thanks! | 14:51 |
| EmilienM | it's about "Introduce tripleo-puppet-elements into Stackforge" | 14:51 |
| fungi | also currently trying to figure out why puppetmaster.o.o never shows up in the cacti index and has no rrd files... the puppet log notes (/Stage[main]/Openstack_project::Cacti/Openstack_project::Cacti_device[puppetmaster.openstack.org]/Exec[cacti_create_puppetmaster.openstack.org]/returns) executed successfully | 14:51 |
| *** hashar_ has quit IRC | 14:52 | |
| *** yfried is now known as yfried|afk | 14:53 | |
| *** maxbit has quit IRC | 14:53 | |
| clarkb | mtreinish: I do not. maybe use two tox.ini files? | 14:53 |
| mtreinish | clarkb: heh, yeah that's what I was thinking too, but I think that would probably be more confusing | 14:54 |
| *** yfried|afk is now known as yfried | 14:54 | |
| *** emagana has quit IRC | 14:55 | |
| *** datsun180b has joined #openstack-infra | 14:55 | |
| nibalizer | fungi: so if im looking at this right... we don't cacti graph on puppetmaster.o.o ? | 14:55 |
| *** emagana has joined #openstack-infra | 14:55 | |
| fungi | nibalizer: we should, but for some reason it's not working. i'm digging into why | 14:55 |
| openstackgerrit | A change was merged to openstack-infra/release-tools: Skip tagging if tag exists https://review.openstack.org/122438 | 14:56 |
| *** hashar has joined #openstack-infra | 14:57 | |
| nibalizer | hrm yea, puppetmaster.o.o is in the big list of machines | 14:57 |
| *** andreaf has joined #openstack-infra | 14:57 | |
| *** groknix has joined #openstack-infra | 14:57 | |
| fungi | AHA! elementary my dear nibalizer... | 14:58 |
| fungi | "This host already exists in the database (puppetmaster.openstack.org) device-id: | 14:58 |
| fungi | (85)" | 14:58 |
| nibalizer | o.O | 14:58 |
| fungi | we used to have a puppetmaster.o.o in the beforetime, in the long, long ago | 14:58 |
| *** yfried has quit IRC | 14:59 | |
| fungi | the fun bit is that /usr/local/bin/create_graphs.sh puppetmaster.openstack.org exits 0 after erroring in this fashion, so puppet reports it as having succeeded | 14:59 |
| *** emagana has quit IRC | 14:59 | |
| nibalizer | ah cool | 14:59 |
| *** afazekas has quit IRC | 15:00 | |
| sdague | fungi: thanks | 15:01 |
| *** juzuluag has quit IRC | 15:02 | |
| *** juzuluag has joined #openstack-infra | 15:03 | |
| *** hashar_ has joined #openstack-infra | 15:03 | |
| *** signed8bit has quit IRC | 15:04 | |
| *** signed8bit has joined #openstack-infra | 15:04 | |
| *** hashar has quit IRC | 15:04 | |
| *** sabeen1 has quit IRC | 15:05 | |
| *** berendt has joined #openstack-infra | 15:06 | |
| *** juzuluag has quit IRC | 15:07 | |
| *** ZZelle has quit IRC | 15:08 | |
| *** ZZelle has joined #openstack-infra | 15:08 | |
| *** juzuluag has joined #openstack-infra | 15:09 | |
| nibalizer | fungi: so it doesn't look like plabs is tracking/aware of the memory leak issue | 15:13 |
| nibalizer | but someone else in #puppet has this problem on centos so its likely a real proble | 15:13 |
| nibalizer | would be awesome to have some graphs of the memory use | 15:14 |
| yolanda | clarkb, got something working for dib and debian, how are things with dib in trusty? they work fine? | 15:14 |
| *** che-arne has joined #openstack-infra | 15:15 | |
| clarkb | yolanda yes it is working now after a few more patches | 15:15 |
| yolanda | patches for nodepool or for config? | 15:15 |
| clarkb | needed to update the elements to match nodepools expectations | 15:15 |
| openstackgerrit | A change was merged to openstack-infra/subunit2sql: Add get_failing_from_run db api method https://review.openstack.org/117860 | 15:15 |
| clarkb | the config | 15:15 |
| yolanda | clarkb, ok, i'll take a look to update mine as well | 15:15 |
| *** james_li has joined #openstack-infra | 15:15 | |
| *** terryw has quit IRC | 15:16 | |
| clarkb | we had to create /etc/nodepool and we had a misnamed run parts dir | 15:16 |
| yolanda | btw, i filed the debootstrap install to debian element, but got the right answer, debootstrap is not needed in the element but in the host running dib, so if we want to build Debian images in nodepool we need debootstrap package | 15:16 |
| clarkb | I see | 15:17 |
| fungi | right, debootstrap runs from outside the chroot | 15:17 |
| fungi | it creates a chroot with a base debian packageset installed in it | 15:17 |
| fungi | and minimal necessary configuration in /etc (hostname, passwd/groups, et cetera) | 15:18 |
| yolanda | so if we need to build debian images we need it as a req | 15:18 |
| fungi | its operation is sort of a subset of dib's | 15:19 |
| fungi | also note that there is at least one debootstrap competitor, cdebootstrap (in typical fashion they tend to leapfrog one another so i can't remember which one is recommended these days) | 15:20 |
| yolanda | oh, didn't know about cdebootstrap | 15:20 |
| yolanda | always been using debootstrap package and i installed that into my setup as well | 15:20 |
| *** VijayTripathi has joined #openstack-infra | 15:20 | |
| *** jistr has quit IRC | 15:21 | |
| fungi | given that i spend a lot of time cross-building base filesystem images for embedded devices from other systems, i've tended to use both over time | 15:21 |
| *** dizquierdo has quit IRC | 15:21 | |
| *** IAX has quit IRC | 15:22 | |
| nibalizer | fungi: how many vcpus does the master have? | 15:22 |
| fungi | most recent upload of cdebootstrap into sid was a little under two months ago, so it's still under active development | 15:22 |
| fungi | nibalizer: 2 | 15:23 |
| yolanda | clarkb, fungi, are we interested in debian images for nodepool upstream? | 15:23 |
| nibalizer | fungi: so i think we just want more cpus and more rams, is that a problem? can we make it 4cpu and 4Gig? | 15:23 |
| yolanda | i saw some work for Centos but nothing for Debian atm, right¿ | 15:24 |
| fungi | nibalizer: it's doable, though "upgrading" means building another instance and copying a lot of stuff over to it. could be a useful exercise to see what gaps we still have in puppet master deployment automation, but it will not be a light undertaking | 15:24 |
| clarkb | yolanda: right now we havent been asked to test debian. so unless that changes probably not | 15:25 |
| nibalizer | oh :/ | 15:25 |
| clarkb | nibalizer we shouldnt need to... | 15:25 |
| clarkb | we have < 80 nodes | 15:25 |
| yolanda | clarkb,ok, so i'll keep that as a local change then | 15:25 |
| *** david-ly_ has joined #openstack-infra | 15:25 | |
| fungi | yolanda: the "project we" is not particularly interested because we don't have current demand for it. the "royal we" (me) is of course quite interested to see debian gain better representation | 15:26 |
| fungi | but i'm unfortunately lacking in time to help make that come about | 15:26 |
| *** jergerber has joined #openstack-infra | 15:26 | |
| jeblair | is the change just to install debbootstrap? that probably won't kill us... :) | 15:26 |
| yolanda | jeblair, for debian wheezy there weren't more issues | 15:27 |
| *** david-lyle has quit IRC | 15:27 | |
| *** ashaeron has quit IRC | 15:27 | |
| yolanda | i sent some patches in the past for debian as well | 15:27 |
| fungi | if that's the only effective cost to adding an experimental debian dib flavor in our nodepool, then seems worth the trivial effort | 15:27 |
| *** sabeen has joined #openstack-infra | 15:28 | |
| clarkb | ya I wouldnt be opposed to it | 15:28 |
| yolanda | fungi, i need to double check that i don't have any other custom things, maybe some puppet issues | 15:29 |
| fungi | out of curiosity, what tool makes the base ubuntu chroot for dib? is there some ubuntu equivalent to (c)debootstrap or is this a reinvented wheel in dib itself? | 15:29 |
| fungi | i mean, i've used debootstrap to create ubuntu chroots, so i know it does work | 15:29 |
| *** marun has joined #openstack-infra | 15:29 | |
| *** rushiagr is now known as rushiagr_away | 15:29 | |
| *** jgallard has quit IRC | 15:29 | |
| *** loki184 has joined #openstack-infra | 15:30 | |
| fungi | but if we don't have it installed on our nodepool server then presumably that's not what it's doing | 15:30 |
| clarkb | ubuntu publishes base images | 15:30 |
| clarkb | so you chroot into that | 15:30 |
| fungi | oh, dib starts from an official ubuntu cloud image? | 15:30 |
| clarkb | yes | 15:30 |
| fungi | we could presumably so the same with debian's then | 15:30 |
| *** mmaglana has quit IRC | 15:31 | |
| yolanda | we grab an ubuntu image, and the only extra install i see there is install linux-image-generic package | 15:31 |
| *** mmaglana has joined #openstack-infra | 15:31 | |
| yolanda | Readme of debian element says Use of this element will also require the tool 'debootstrap' to be available on your system. It should be available on Ubuntu, Debian, and Fedora. | 15:32 |
| fungi | rightscale has been hosting these on behalf of the debian cloud team... http://support.rightscale.com/Community/RightScale_OSS#Debian_GNU.2FLinux_MultiCloud_Images | 15:33 |
| *** dizquierdo has joined #openstack-infra | 15:34 | |
| *** maxbit has joined #openstack-infra | 15:34 | |
| fungi | though those are pretty ancient | 15:34 |
| *** james_li has quit IRC | 15:34 | |
| fungi | yeah, bootstrap or one of the cloud image build tools in debian are probably the best bet for a backend implementation for now it looks like | 15:35 |
| *** ociuhandu has quit IRC | 15:35 | |
| *** ihrachyshka has quit IRC | 15:36 | |
| *** mmaglana has quit IRC | 15:36 | |
| *** rushiagr_away is now known as rushiagr | 15:37 | |
| fungi | aiui there's a plan to start publishing images generated with the build-debian-cloud tool on the mirrors alongside cd images | 15:39 |
| tristanC | Hello folks, I wonder if this bash bug (http://seclists.org/oss-sec/2014/q3/651) is exploitable through gerrit... | 15:40 |
| *** Sukhdev has joined #openstack-infra | 15:40 | |
| fungi | tristanC: unlikely since you don't ssh into a shell when you connect to the gerrit "ssh" api | 15:41 |
| fungi | tristanC: it uses a java-based ssh service to provide the protocol implementation and feeds that directly into some custom command parser | 15:41 |
| clarkb | and I dont think there is any env interpretation | 15:42 |
| tristanC | fungi: clarkb: Good news then :) | 15:42 |
| fungi | tristanC: the one place we do currently need to keep an eye on and think about is our ansible implementation, but that would still require someone compromising our puppetmaster first and then using that to gain slighthly elevated privileges through our authorized_keys command filters | 15:42 |
| *** mrmartin has joined #openstack-infra | 15:42 | |
| clarkb | fungi which is easier via puppet/ansible directly :) | 15:43 |
| fungi | clarkb: indeed | 15:43 |
| *** emagana has joined #openstack-infra | 15:45 | |
| rcarrillocruz | hey folks | 15:45 |
| rcarrillocruz | jjb question | 15:45 |
| rcarrillocruz | is it possible to invoke a job template from a job template | 15:46 |
| rcarrillocruz | use case: i have job template foo that does something | 15:46 |
| *** ildikov_ has quit IRC | 15:46 | |
| rcarrillocruz | but i want a specialized version that does the same thing but install a package on the node before it runs | 15:46 |
| rcarrillocruz | so is it possible to create a new job template with a shell builder that does the package install and then invokes the generic job? | 15:47 |
| *** denis_makogon has quit IRC | 15:47 | |
| *** sabeen3 has joined #openstack-infra | 15:47 | |
| rcarrillocruz | i thought about a job group, but me thinks the jobs contained run on different nodes | 15:47 |
| *** viktors is now known as viktors|afk | 15:47 | |
| clarkb | you can chain jobs with zuul or a jenkins plugin. or you can have two templates. or you can pass a parameter to a single template that optionally enables additional behavior | 15:48 |
| rcarrillocruz | clarkb: and the chain jobs assures they run on the same node? | 15:48 |
| rcarrillocruz | - job | 15:48 |
| *** sabeen has quit IRC | 15:49 | |
| jeblair | or you can make the builder a macro | 15:49 |
| rcarrillocruz | - job | 15:49 |
| rcarrillocruz | ? | 15:49 |
| clarkb | no it doesnt ensure that | 15:49 |
| rcarrillocruz | jeblair: right, but then i'd put that macro in the general job-template | 15:50 |
| *** jlk_clone has joined #openstack-infra | 15:50 | |
| *** arnaud__ has quit IRC | 15:51 | |
| *** marcusvrn has quit IRC | 15:51 | |
| rcarrillocruz | oh, you mean making a macro the builder from the general job-template | 15:52 |
| rcarrillocruz | so it can be called from both job templates, generic and specialized | 15:52 |
| jeblair | yep, so both are very simple definitions. i'd probably either do that or clarkb's template-with-option idea. | 15:53 |
| fungi | fun. someone leaked the prenotification for the embargoed bash vulnerability and it ended up getting quoted in a news article | 15:53 |
| *** vigneshvar has quit IRC | 15:54 | |
| rcarrillocruz | k, thx guys :-) | 15:55 |
| *** arxcruz has quit IRC | 15:57 | |
| *** rfolco has quit IRC | 15:58 | |
| *** emagana has quit IRC | 15:58 | |
| *** emagana has joined #openstack-infra | 15:59 | |
| jeblair | clarkb, fungi, mordred, SergeyLukjanov, jhesketh: i'm going through the config review queue looking for changes that would be affected by the freeze that could be merged (eg, not WIP, and not Verify-1) | 15:59 |
| zaro | morning | 15:59 |
| jeblair | clarkb, fungi, mordred, SergeyLukjanov, jhesketh: i'm recording them here: https://etherpad.openstack.org/p/config-queue-flush | 16:00 |
| SergeyLukjanov | jeblair, ack | 16:00 |
| fungi | jeblair: good idea. i was starting to do that in an ad-hoc manner but coordination will help a bunch | 16:00 |
| fungi | hitlist style makes great sense for this | 16:00 |
| jeblair | i'm also just approving the ones that already have >=1 +2 (and not etherpadding them) | 16:00 |
| fungi | wfm | 16:01 |
| *** emagana has quit IRC | 16:01 | |
| *** emagana has joined #openstack-infra | 16:01 | |
| *** JayJ_ has quit IRC | 16:01 | |
| fungi | jeblair: did you use a filename pattern search to start working through them? i should have thought of that before now | 16:01 |
| *** JayJ_ has joined #openstack-infra | 16:01 | |
| *** hashar_ is now known as hashar | 16:01 | |
| jeblair | fungi: no; i'm just going by subject names. that's a fine idea though. :) | 16:02 |
| jeblair | (_somebody_ hasn't gotten around to figuring out how to do filename searches in gertty...) | 16:02 |
| *** hashar is now known as hasharConfCall | 16:03 | |
| *** k4n0 has quit IRC | 16:03 | |
| openstackgerrit | A change was merged to openstack-infra/config: add experimental job for nova with f20 virt-preview https://review.openstack.org/113350 | 16:04 |
| *** otherwiseguy has joined #openstack-infra | 16:04 | |
| *** clayg has quit IRC | 16:04 | |
| *** jlk_clone has quit IRC | 16:05 | |
| *** mmaglana has joined #openstack-infra | 16:05 | |
| *** jlk_clone has joined #openstack-infra | 16:05 | |
| jeblair | mordred, dhellmann: i'd like someone else to ack that https://review.openstack.org/#/c/120269/ is desired | 16:05 |
| jeblair | mordred, dhellmann: who should that person be? | 16:05 |
| *** jlk_clone is now known as jlk | 16:07 | |
| *** jlk has joined #openstack-infra | 16:07 | |
| *** jlibosva has quit IRC | 16:08 | |
| dims | jeblair: zzzeek would be my guess | 16:10 |
| jeblair | dims: i'm pretty sure he doesn't want anything to do with that project :) | 16:11 |
| dims | lol ok :) | 16:11 |
| jeblair | fungi, clarkb: i'm not sure i love the direct reference to an openstack core team from a stackforge project in 120285 | 16:12 |
| *** liusheng has quit IRC | 16:12 | |
| *** liusheng has joined #openstack-infra | 16:12 | |
| *** patrickeast has joined #openstack-infra | 16:13 | |
| mordred | jeblair: looking | 16:13 |
| clarkb | maybe tripleo wants it? if not then ya I think I agree | 16:14 |
| *** rfolco has joined #openstack-infra | 16:15 | |
| jeblair | EmilienM: i gave 120285 a -1; if you're around, let's try to discuss and resolve that today so we can get it merged | 16:16 |
| *** markmcclain1 has quit IRC | 16:16 | |
| *** markmcclain has joined #openstack-infra | 16:16 | |
| *** pballand has joined #openstack-infra | 16:17 | |
| *** VijayTripathi has quit IRC | 16:18 | |
| *** james_li has joined #openstack-infra | 16:18 | |
| fungi | agreed. either it's part of openstack managed by official teams, or it's in stackforge and has its own groups which just happen to contain the same reviewers | 16:18 |
| *** stevemar has quit IRC | 16:20 | |
| mordred | jeblair: unsure ... I'm fine with it, but the core team there is mushy | 16:20 |
| zaro | clarkb: jenkins has verified, i got a report from someone that could not sign into storyboard when their username on gerrit is 'c-launchpader'. that username was assigned by launchpad from the | 16:20 |
| zaro | clarkb: opps. ignore that. | 16:21 |
| fungi | jeblair: on the other hand, in the name of prior art, note that stackforge/windows-diskimage-builder has acl-config: /home/gerrit2/acls/openstack/diskimage-builder.config | 16:21 |
| zaro | clarkb: jenkins has verified, https://review.openstack.org/#/c/116347 | 16:21 |
| fungi | granted, that project was fairly contentious as well, so i think we probably need to figure out an appropriate stance on the "blending" of stackforge and openstack projects | 16:22 |
| jeblair | fungi: drat, i thought i checked that | 16:22 |
| jeblair | my grep must have been off | 16:22 |
| *** flaviof is now known as flaviof_zzz | 16:22 | |
| jeblair | happy to fix that though :) | 16:22 |
| fungi | i wholeheartedly support making it use its own separate acl definition with separate group names which just happen to contain the same gerrit users | 16:23 |
| *** MaxV has quit IRC | 16:25 | |
| fungi | for a counterexample, the stackforge/xstatic-.* projects _do_ have their own separate acl and group names, even though they're presumably mostly the same horizon reviewers in the end | 16:26 |
| openstackgerrit | David Lenwell proposed a change to openstack-infra/infra-manual: Add an introduction paragraph to the developer guide https://review.openstack.org/107024 | 16:29 |
| *** hasharConfCall has quit IRC | 16:32 | |
| *** r-daneel_ has quit IRC | 16:33 | |
| *** afazekas has joined #openstack-infra | 16:33 | |
| *** IAX has joined #openstack-infra | 16:34 | |
| *** radez is now known as radez_g0n3 | 16:34 | |
| *** openstackgerrit has quit IRC | 16:35 | |
| fungi | fwiw i queried gerrit for "status:open project:openstack-infra/config file:^modules/openstack_project/files/.*" for a quick and dirty list, and am working my way up from oldest-modified first while i gnaw on some lunch. any which i +2 but don't have an existing +2 already i'll add to the etherpad | 16:38 |
| *** finch has joined #openstack-infra | 16:40 | |
| *** Guest68510 has quit IRC | 16:40 | |
| finch | clarkb: so puppet 3.7.1 huh? | 16:40 |
| *** bswartz has quit IRC | 16:40 | |
| nibalizer | clarkb: fungi ^^ tell finch the tale of the puppet memory leaking | 16:40 |
| nibalizer | he is puppet core developer | 16:40 |
| finch | clarkb: if possible could you downgrade to 3.7.0 to help pin down what may have introduced the bloat? | 16:41 |
| *** daya_k has joined #openstack-infra | 16:41 | |
| sdague | tox question for folks | 16:42 |
| finch | I'm at puppetconf right now so I'll be randomly around | 16:42 |
| *** ramashri has joined #openstack-infra | 16:42 | |
| *** arnaud has joined #openstack-infra | 16:43 | |
| *** bhuvan has joined #openstack-infra | 16:45 | |
| fungi | nibalizer: finch it's 3.7.0-1puppetlabs1 technically | 16:45 |
| zaro | jeblair: i think hashar wanted to review this one. https://review.openstack.org/#/c/89603 | 16:45 |
| *** jistr has joined #openstack-infra | 16:45 | |
| fungi | nibalizer: finch: i don't believe we've tried 3.7.1 yet | 16:45 |
| nibalizer | oh i thought we were on 3.7.1 | 16:45 |
| nibalizer | oh weird | 16:46 |
| nibalizer | http://puppetboard.openstack.org/fact/puppetversion | 16:46 |
| jeblair | zaro: +3 thx | 16:46 |
| fungi | nibalizer: yeah, seems the master hasn't upgraded | 16:47 |
| finch | fungi: aaah, interesting. so did you just jump to 3.7.0? | 16:47 |
| *** afazekas has quit IRC | 16:47 | |
| fungi | finch: from 2.7, yeah | 16:47 |
| jgriffith | fungi: great summary on that sec issue, thanks! | 16:47 |
| fungi | jgriffith: yw | 16:48 |
| nibalizer | i would have thought unatended upgrades would have uped it | 16:48 |
| *** ihrachyshka has joined #openstack-infra | 16:48 | |
| fungi | nibalizer: me too | 16:48 |
| *** ihrachyshka has quit IRC | 16:48 | |
| jeblair | morganfainberg: is keystoneclient-federation going in the identity program in governance? | 16:48 |
| vishy | jgriffith, sdague: have you seen cinder hang on create in the gate before? http://logs.openstack.org/22/119522/9/check/check-tempest-dsvm-postgres-full/46a5f8c/logs/screen-c-vol.txt.gz | 16:48 |
| finch | fungi: oh word, that's a pretty hefty jump. for things like this I would like to know which version introduced the issue, would you be able to walk through Puppet versions to nail down which version is the culprit? | 16:48 |
| morganfainberg | jeblair, it should be, let me post a change for it. | 16:48 |
| finch | fungi: also you should make clarkb do it because his suffering nourishes me :) | 16:48 |
| sdague | vishy: can you like the line in question? | 16:48 |
| nibalizer | fungi: if you do this https://docs.puppetlabs.com/guides/rest_api.html#status you can authoritatively tell what the master is running | 16:49 |
| vishy | sdague: it is the very last line | 16:49 |
| sdague | vishy: click on the date | 16:49 |
| vishy | sdague: it never finishes the last create in the file | 16:49 |
| vishy | and apparently cinder-volume stops reporting its data at that point | 16:49 |
| *** marun has quit IRC | 16:49 | |
| fungi | finch: anyway, we have puppet-passenger running under apache on ubuntu trusty, and see ruby processes owned by the puppet user steadily growing in memory usage... this is on a vm with 2g memory and 2x vcpus | 16:49 |
| vishy | because all future creates fail to schedule | 16:49 |
| sdague | hmmmm | 16:50 |
| sdague | 55 fails is usually glance is dead | 16:50 |
| jeblair | fungi, clarkb: i just realized i should add changes i aprv to the etherpad too, so we can track merge failures. | 16:50 |
| fungi | nibalizer: Forbidden request: localhost(127.0.0.1) access to /status/puppetclient [find] at :119 | 16:51 |
| clarkb | sorry I stepped away to finish booting my morning | 16:52 |
| *** yamahata_ has quit IRC | 16:52 | |
| sdague | vishy: it looks like iscsi dies in apparently interesting ways - http://logs.openstack.org/22/119522/9/check/check-tempest-dsvm-postgres-full/46a5f8c/logs/syslog.txt.gz | 16:52 |
| *** shashankhegde has joined #openstack-infra | 16:52 | |
| clarkb | finch: I don't think it is likely that we would walk through versions | 16:53 |
| finch | fungi: passenger should regularly terminate and restart ruby workers, how have you tuned passenger? | 16:53 |
| finch | clarkb! | 16:53 |
| clarkb | it should be easily reproduceable. install puppet via puppetlabs repo. <- thats it really :) | 16:53 |
| nibalizer | fungi: yea you have to do the --cert `puppet config print hostcert` --key `puppet config print hostprivkey` -k thing | 16:53 |
| *** bswartz has joined #openstack-infra | 16:53 | |
| clarkb | fungi: we haven't tuned it. we installed your puppet passenger package | 16:53 |
| *** jamielenz has joined #openstack-infra | 16:53 | |
| jgriffith | vishy: no, that's a new one for me | 16:53 |
| *** jamielenz is now known as jamielennox | 16:53 | |
| *** shashankhegde has quit IRC | 16:53 | |
| morganfainberg | jeblair, https://review.openstack.org/123786 | 16:54 |
| finch | those settings _should_ work. clarkb how long lived are the ruby processes that passenger is launching? | 16:54 |
| *** dtroyer has quit IRC | 16:54 | |
| *** kylo has joined #openstack-infra | 16:54 | |
| clarkb | fungi: one is as old as yesterday | 16:54 |
| clarkb | one from ~10 hours ago | 16:55 |
| *** _nadya_ has quit IRC | 16:55 | |
| vishy | sdague: smoking gun: http://logs.openstack.org/22/119522/9/check/check-tempest-dsvm-postgres-full/46a5f8c/logs/syslog.txt.gz#_Sep_22_21_19_01 | 16:55 |
| *** arborism has joined #openstack-infra | 16:55 | |
| sdague | vishy: yeh, that lines up with the fails | 16:55 |
| vishy | jgriffith: looks like an lvm bug | 16:55 |
| jeblair | fungi: thoughts on anteaya's comment in 122220? | 16:56 |
| sdague | realistically the c-vol log runs way past where the fails happen | 16:56 |
| finch | clarkb: that definitely indicates that passenger is misbehaving | 16:56 |
| jgriffith | vishy: yeah, it's an lvm hang *again* | 16:56 |
| *** dtroyer has joined #openstack-infra | 16:56 | |
| jgriffith | vishy: I'm trying to see if there are many more of these around | 16:56 |
| *** harlowja_away is now known as harlowja | 16:56 | |
| *** derekh has quit IRC | 16:56 | |
| vishy | we should do a logstash search for errors like that in syslog | 16:56 |
| jgriffith | Yeah... trying that now :) | 16:57 |
| jgriffith | btw: https://bugs.launchpad.net/cinder/+bug/1366125 | 16:57 |
| finch | clarkb: fungi: could you pastebin the output of `passenger-memory-stats` ? | 16:57 |
| uvirtbot | Launchpad bug 1366125 in cinder "LVM hang in volume creation" [Undecided,New] | 16:57 |
| *** dannywilson has joined #openstack-infra | 16:59 | |
| fungi | nibalizer: http://paste.openstack.org/show/115010/ | 16:59 |
| clarkb | finch: one sec | 16:59 |
| jeblair | gah! 122122! | 17:00 |
| fungi | finch: http://paste.openstack.org/show/115011/ | 17:00 |
| finch | fungi: thanks | 17:00 |
| clarkb | finch: http://paste.openstack.org/show/115012/ | 17:00 |
| clarkb | fungi wins | 17:00 |
| fungi | finch: that command needs tty detection so it can turn off obnoxious ansi escapes automatically | 17:00 |
| nibalizer | fungi: yea its a giver :P | 17:01 |
| nibalizer | fungi: try that same curl but hit /production/status/no_key | 17:01 |
| *** jp_at_hp has quit IRC | 17:01 | |
| jgriffith | vishy: yeah, got a few more | 17:01 |
| clarkb | jeblair: 122122? | 17:01 |
| clarkb | looks like a tripleo change? | 17:01 |
| jgriffith | crud | 17:02 |
| *** dizquierdo has quit IRC | 17:02 | |
| jeblair | clarkb: yeah, and it's a bad one | 17:02 |
| clarkb | oh /me looks closer | 17:02 |
| jeblair | clarkb: see counterpart in 122504 | 17:02 |
| *** stevemar has joined #openstack-infra | 17:02 | |
| fungi | nibalizer: Forbidden request: puppetmaster.openstack.org(127.0.0.1) access to /status/no_key [find] authenticated at :119 | 17:03 |
| clarkb | oh fun | 17:03 |
| jeblair | just proposed https://review.openstack.org/#/c/123788/ | 17:03 |
| nibalizer | fungi: okay i give up :P | 17:03 |
| *** rwsu has quit IRC | 17:03 | |
| sdague | something up with the log server? | 17:03 |
| sdague | it's taking minutes to pull this syslog file | 17:03 |
| *** _buzz has quit IRC | 17:03 | |
| sdague | which reports as 441k | 17:04 |
| fungi | nibalizer: i can compare the last started time on the puppet processes to when 3.7.0 was installed if you're concerned it's running something older than its reporting to puppetdb | 17:04 |
| jgriffith | vishy: well crap, where are all these rbd results coming from | 17:04 |
| finch | fungi: this is a bit of a shot in the dark but you might want to turn off http keepalives: https://docs.puppetlabs.com/references/latest/configuration.html#httpkeepalivetimeout | 17:04 |
| *** dimtruck is now known as zz_dimtruck | 17:04 | |
| clarkb | sdague: it doesn't look particularly unhappy. have a link to the file? | 17:04 |
| sdague | clarkb: http://logs.openstack.org/22/119522/9/check/check-tempest-dsvm-postgres-full/46a5f8c/logs/syslog.txt.gz#_Sep_22_21_19_01 | 17:04 |
| fungi | nibalizer: is there some reason not to trust the entry on the puppetboard page for it, which looks to me like it agrees with the package version? | 17:05 |
| *** arborism has quit IRC | 17:05 | |
| sdague | jgriffith: http://logstash.openstack.org/#eyJzZWFyY2giOiJcImJsb2NrZWQgZm9yIG1vcmUgdGhhbiAxMjAgc2Vjb25kc1wiIiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiI2MDQ4MDAiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxNDExNTc4Mjc1ODA3fQ== | 17:05 |
| *** amcrn has joined #openstack-infra | 17:05 | |
| sdague | that seems to be basically fails | 17:05 |
| jgriffith | sdague: nice! | 17:06 |
| *** rwsu has joined #openstack-infra | 17:06 | |
| *** homeless has quit IRC | 17:06 | |
| jgriffith | sdague: way better than my lame ass multipart querie | 17:06 |
| *** _buzz has joined #openstack-infra | 17:06 | |
| sdague | heh | 17:06 |
| jgriffith | we were close though in terms of results | 17:06 |
| fungi | finch: you think that a 4s keepalive is too long? | 17:06 |
| sdague | yeh, I expect that 10% pass rate is fails during tempest test cleanups | 17:06 |
| *** homeless has joined #openstack-infra | 17:06 | |
| clarkb | it came right up for me. nothing for that file in the error log | 17:07 |
| finch | fungi: how many nodes do you have? and a colleague suggested it, but off the top of my head I have no idea | 17:07 |
| clarkb | hrm I do notice that when you paste a link here all the irssis and other irc clients seem to want to head the file | 17:07 |
| finch | there's been a looot of changes between Puppet 2.7 and 3.7 | 17:07 |
| clarkb | finch: 70-80 | 17:07 |
| fungi | finch: i think roughly 80 but i'll confirm | 17:07 |
| finch | fungi: oh that's tiny. huh. | 17:07 |
| clarkb | and we only hit the master 10 at a time | 17:07 |
| clarkb | sdague: I was getting terrible packet loss between home and rax last night but that seemed to be related to netflix hour and went away after 10pm | 17:08 |
| clarkb | sdague: so probably not related | 17:08 |
| *** unicell has quit IRC | 17:08 | |
| *** mfer has quit IRC | 17:08 | |
| *** rushiagr is now known as rushiagr_away | 17:08 | |
| *** todd_dsm has joined #openstack-infra | 17:10 | |
| clarkb | sdague: I do note (and this is based on my probably wrong infering) that you got fewer bytes than I did | 17:10 |
| clarkb | according to the apache log | 17:10 |
| clarkb | maybe you asked for >DEBUG | 17:10 |
| *** flaviof_zzz is now known as flaviof | 17:11 | |
| *** mfer has joined #openstack-infra | 17:11 | |
| finch | clarkb: fungi: passenger_max_pool_size might be the trick: https://www.phusionpassenger.com/documentation/Users%20guide%20Nginx.html#PassengerMaxPoolSize | 17:11 |
| *** dannywilson has quit IRC | 17:13 | |
| *** Ryan_Lane has joined #openstack-infra | 17:13 | |
| *** tty57 has quit IRC | 17:14 | |
| *** Sukhdev has quit IRC | 17:14 | |
| *** otherwiseguy has quit IRC | 17:14 | |
| *** dannywilson has joined #openstack-infra | 17:14 | |
| fungi | finch: would that control the number of ruby processes we see in the system process table, or something more subtle? | 17:15 |
| *** zz_dimtruck is now known as dimtruck | 17:16 | |
| clarkb | jeblair: the commit message formatting on the revert is funky. otherwise +1 oh you just fixed it even better | 17:17 |
| *** andreaf has quit IRC | 17:17 | |
| jeblair | also it had a conflict so i tried to remove just what was necessary | 17:18 |
| *** dannywilson has quit IRC | 17:18 | |
| *** andreaf has joined #openstack-infra | 17:18 | |
| dhellmann | jeblair: I'm not sure we care about python 3 for that lib. We want people to stop using it. | 17:18 |
| dhellmann | mordred: ^^ | 17:18 |
| clarkb | jeblair: I take it we are ok merging 98426 as is to get it into the move then we can add the job to layout.yaml post move? | 17:19 |
| finch | fungi: that should cap the number of ruby processes running based on memory, so if one process is devouring memory then passenger won't launch more | 17:20 |
| clarkb | finch: shouldn't it be killing these processes every 5 minutes or so though? | 17:20 |
| *** shashankhegde has joined #openstack-infra | 17:20 | |
| jeblair | clarkb: that was my thought | 17:20 |
| *** reed has joined #openstack-infra | 17:22 | |
| finch | clarkb: that's what I thought as well, hence me asking about the process lifetime. still looking | 17:22 |
| fungi | it seems we've lost openstackgerrit. retrieving | 17:23 |
| *** armax has joined #openstack-infra | 17:24 | |
| *** armax has quit IRC | 17:24 | |
| *** armax has joined #openstack-infra | 17:24 | |
| jeblair | AJaeger: should we proceed with 122620 now, or do you want to wait? | 17:24 |
| *** openstackgerrit has joined #openstack-infra | 17:24 | |
| finch | clarkb: another idea: passenger_pool_idle_time - set that to a low value so master processes are killed sooner | 17:25 |
| *** dustins has joined #openstack-infra | 17:26 | |
| *** harlowja has quit IRC | 17:27 | |
| *** harlowja has joined #openstack-infra | 17:27 | |
| *** emagana has quit IRC | 17:28 | |
| DuncanT | Hi. I'm finding log urls in logstash to be 404ing... e.g. the one in http://logstash.openstack.org/#eyJzZWFyY2giOiJcImJsb2NrZWQgZm9yIG1vcmUgdGhhbiAxMjAgc2Vjb25kc1wiIiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiI2MDQ4MDAiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxNDExNTc4Mjc1ODA3fQ== - Any hints please? | 17:29 |
| jeblair | AJaeger: actually, i think we need a bit more discussion on that. a quick graphite check suggests that will send 15-30 messages to the qa list every day. | 17:29 |
| *** emagana has joined #openstack-infra | 17:29 | |
| EmilienM | jeblair: I'm here | 17:31 |
| *** masayukig has quit IRC | 17:31 | |
| EmilienM | jeblair: just read your comment also... | 17:31 |
| *** asettle has quit IRC | 17:32 | |
| *** lcheng has quit IRC | 17:32 | |
| *** emagana has quit IRC | 17:33 | |
| vishy | sdague, rbd: bug 1373513 | 17:34 |
| uvirtbot | Launchpad bug 1373513 in cinder "Lvm hang during tempest tests" [High,Confirmed] https://launchpad.net/bugs/1373513 | 17:34 |
| openstackgerrit | A change was merged to openstack-infra/config: Create repo for keystoneclient-federation https://review.openstack.org/120670 | 17:35 |
| *** marcoemorais has joined #openstack-infra | 17:35 | |
| vishy | ah i see you found it already | 17:35 |
| openstackgerrit | A change was merged to openstack-infra/config: Fix exit code in rally-cli job https://review.openstack.org/120815 | 17:35 |
| mordred | dhellmann: good by me | 17:36 |
| openstackgerrit | A change was merged to openstack-infra/config: Simport - Simple python import library (not entry-point based) https://review.openstack.org/121108 | 17:36 |
| openstackgerrit | A change was merged to openstack-infra/config: Remove unnecessary metadata check https://review.openstack.org/121958 | 17:36 |
| *** masayukig has joined #openstack-infra | 17:36 | |
| jeblair | mordred, dhellmann: can one or both of you please -1 120269 then? :) | 17:36 |
| openstackgerrit | A change was merged to stackforge/python-jenkins: Support node startup with the JNLP Launcher https://review.openstack.org/89603 | 17:36 |
| dhellmann | jeblair: on it | 17:37 |
| *** AJaeger_ has joined #openstack-infra | 17:37 | |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: notification_utils: utility library for OpenStack notifications. https://review.openstack.org/121109 | 17:37 |
| dhellmann | jeblair: to be clear, that lib is not an oslo thing and I don't actually have any permissions in that repo because I'm not on the maintenance team | 17:38 |
| *** asselin has quit IRC | 17:38 | |
| jeblair | dhellmann: yeah, i'm not really sure who is :) | 17:38 |
| *** praneshp has joined #openstack-infra | 17:39 | |
| dhellmann | jeblair: ditto | 17:39 |
| *** asselin has joined #openstack-infra | 17:40 | |
| *** HeOS has quit IRC | 17:40 | |
| jeblair | sandywalsh: because i know you're on a new-project spree, in case you missed it, see: http://lists.openstack.org/pipermail/openstack-dev/2014-September/046904.html | 17:41 |
| *** dannywilson has joined #openstack-infra | 17:41 | |
| jogo | clarkb: did something happen to ElasticSearch? | 17:41 |
| sandywalsh | jeblair: eeek! | 17:41 |
| jeblair | sandywalsh: we're trying to get all the outstanding changes merged today so they don't need to be reproposed | 17:41 |
| clarkb | jogo: ? | 17:41 |
| sandywalsh | jeblair: ok, will get my dependent branches fixed up shortly. Have a quick question about that | 17:42 |
| sandywalsh | jeblair: I've been following https://wiki.openstack.org/wiki/Gerrit_Workflow#Add_dependency | 17:42 |
| jeblair | sandywalsh: so basically, we're happy to iterate quickly with you to get them in | 17:42 |
| jogo | clarkb: most recent timestamp I can find in ES is from Sept 23 20:31 | 17:42 |
| clarkb | jogo: it is behind | 17:42 |
| *** markmcclain has quit IRC | 17:42 | |
| jogo | clarkb: way behind http://status.openstack.org/elastic-recheck/ | 17:42 |
| clarkb | nothing "happened" to it as much as status quo | 17:42 |
| *** ramashri has quit IRC | 17:42 | |
| *** newbie|3 has joined #openstack-infra | 17:42 | |
| jogo | clarkb: any insight into how I can see if a log blew up recently? | 17:43 |
| sandywalsh | jeblair: but I was wondering if it's possible to define the parent dependency at 'git review' time (vs. having to git review -r <change> beforehand? | 17:43 |
| clarkb | jogo: no not really | 17:43 |
| fungi | sandywalsh: gerrit determines dependencies based on the history of the commit, so you generally end up needing to address merge conflicts anyway as that would imply some manner of rebase to order the commits as needed | 17:43 |
| sandywalsh | jeblair: that way, I can cherry pick from my existing branches (ideally) | 17:44 |
| jeblair | sdague: can you review 123028 please? | 17:44 |
| jeblair | sandywalsh: if you already have the change locally, you can just add a new commit without using git review -d | 17:45 |
| clarkb | things that do not mix. oil and water, gerrit and firefox | 17:45 |
| EmilienM | jeblair: about #120285 : I have no idea if that should be part of the program or not. | 17:45 |
| sandywalsh | jeblair: hmm, can you elaborate? | 17:45 |
| *** emagana has joined #openstack-infra | 17:45 | |
| jeblair | sandywalsh: eg, if you are making a bunch of new projects, you can just create a series of commits and run 'git review' and it will push all of them up and they will have their dependencies set correctly in gerrit | 17:45 |
| jogo | clarkb: hmm I don't see any log with massive file sizes | 17:46 |
| jogo | at least not in tempest jobs | 17:46 |
| *** e0ne has quit IRC | 17:46 | |
| *** gokrokve has quit IRC | 17:46 | |
| jeblair | sandywalsh: and if you need to go back to edit something in the middle, you can use 'git rebase -i' to edit a particular commit, but keep the whole chain intact | 17:46 |
| sandywalsh | jeblair: ah, so should I abandon the current branches and remove the change_id from the new branch? | 17:46 |
| *** pballand has quit IRC | 17:47 | |
| jeblair | sandywalsh: oh no, never do that -- keep the changeid in the commit message so that the existing gerrit review gets updated. i may not fully understand what you're asking :) | 17:47 |
| *** atiwari has joined #openstack-infra | 17:48 | |
| newbie|3 | Hi I have a question about a tempest test case that is testing a new feature that is in Juno, I defined an orchestration_feature_enabled section and set a flag there for this feature. This flag will set to true by default. If a user want to test Icehouse or older version will need to change this flag to false in the tempest.conf. | 17:49 |
| sandywalsh | jeblair: ah, so if I keep the existing change-id's in each commit, it'll get resolved at review time? | 17:49 |
| openstackgerrit | A change was merged to openstack-infra/config: Give oslo-release team permission to tag incubator https://review.openstack.org/122459 | 17:49 |
| jeblair | newbie|3: you may want to ask that question in the #openstack-qa channel | 17:49 |
| newbie|3 | thanks | 17:50 |
| *** newbie|3 has left #openstack-infra | 17:50 | |
| jogo | clarkb: any logs that show what files logstash is spending most of the time on or things like that? | 17:50 |
| openstackgerrit | A change was merged to openstack-infra/config: Add functional test gate job for openstackclient https://review.openstack.org/122599 | 17:50 |
| *** jcoufal has quit IRC | 17:51 | |
| jeblair | sandywalsh: the change id is how gerrit determines that a given commit is related to a change in its database. because each time a commit is changed (amended, rebased, etc), there's actually nothing in common between it and the old commit, so when you push it up for review, gerrit would have no way to know that it's a new version of a change it already knows about. | 17:51 |
| *** openstackgerrit has quit IRC | 17:51 | |
| jeblair | sandywalsh: so the commit-id header says "if you already have a change with this change id, consider this to be a new patchset for that change" | 17:51 |
| jogo | clarkb: having logstash so far behind makes it really hard to see what bugs we are hitting etc | 17:51 |
| clarkb | jogo: no not really. I don't have logstash feeding into itself for turtle reasons | 17:51 |
| clarkb | jogo: I understand... | 17:51 |
| sandywalsh | jeblair: ok, I think I got it. Will try ... cross fingers :) | 17:51 |
| clarkb | jogo: so this is one of those things that isn't working and without better cloud probably isn't oing to get much better | 17:52 |
| clarkb | either that or someone that knows how to elasticsearch will need to teach us | 17:52 |
| jogo | clarkb: hehe that would be funny logstash feeding itself | 17:52 |
| *** openstackgerrit has joined #openstack-infra | 17:52 | |
| *** MaxV has joined #openstack-infra | 17:52 | |
| jogo | clarkb: where is the main bottleneck? | 17:52 |
| jeblair | clarkb: oh, it's es that's the bottleneck? i thought it was the log processors | 17:52 |
| clarkb | jeblair: no I think it is es | 17:52 |
| jeblair | clarkb: i thought crm114 was a bottleneck | 17:53 |
| *** arnaud has quit IRC | 17:53 | |
| clarkb | jeblair: I don't think so. When Iturned off crm114 that one time it didn't increase throughput | 17:53 |
| clarkb | jeblair: because it is pipelined the crm114 slowness just gets "averaged" or whatever the term is | 17:54 |
| openstackgerrit | Barnaby Court proposed a change to openstack-infra/jenkins-job-builder: Adds credentials-binding plugin support to wrappers https://review.openstack.org/120184 | 17:54 |
| clarkb | jeblair: the crm114 subprocesses was leaking file descriptors which lead to bitbucketing of data which masked the issue for a while | 17:54 |
| clarkb | because we were indexing much less data | 17:55 |
| jeblair | clarkb: we have 65 workers online | 17:56 |
| clarkb | its also possible that upgraded ES would help. I should look through their release notes | 17:56 |
| clarkb | jeblair: huh should only be 60. I wonder if that is a gear bug | 17:56 |
| jeblair | clarkb: don't we have more than that? | 17:56 |
| clarkb | jeblair: no its 20 nodes X 3 workers per node | 17:57 |
| jeblair | oh we dropped from 4 to 3 | 17:57 |
| jogo | wow that is a beefy system | 17:57 |
| clarkb | jeblair: ya 4 led to OOMing | 17:57 |
| jeblair | clarkb: i think some of them are broken | 17:57 |
| jeblair | all the workers on 01 have 0 byte logfiles | 17:57 |
| openstackgerrit | A change was merged to openstack-infra/config: For requirements, run job to verify that requirements overlap https://review.openstack.org/98426 | 17:58 |
| jogo | jeblair: that may explain the backlog that I am seeing | 17:58 |
| openstackgerrit | A change was merged to openstack-infra/config: Enable functional testing for openstackclient https://review.openstack.org/122765 | 17:58 |
| *** emagana has quit IRC | 17:58 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add integration tests to the Horizon gate https://review.openstack.org/115004 | 17:58 |
| openstackgerrit | A change was merged to openstack-infra/config: Add keystone-formula project https://review.openstack.org/120324 | 17:58 |
| openstackgerrit | A change was merged to openstack-infra/config: Add glance-formula project https://review.openstack.org/122049 | 17:58 |
| *** daya_k has quit IRC | 17:58 | |
| *** emagana has joined #openstack-infra | 17:58 | |
| *** mfer has quit IRC | 17:59 | |
| clarkb | jeblair: gaierror: [Errno -3] Temporary failure in name resolution | 17:59 |
| clarkb | jeblair: so this could be the leaky fd thing again | 17:59 |
| sdague | jeblair: +1 on https://review.openstack.org/#/c/123028/ | 17:59 |
| jeblair | sdague: thx; aprvd | 18:00 |
| openstackgerrit | Bob Callaway proposed a change to openstack-infra/config: Add puppet-manila to Stackforge https://review.openstack.org/123802 | 18:00 |
| *** todd_dsm has quit IRC | 18:01 | |
| *** tonytan4ever has joined #openstack-infra | 18:01 | |
| clarkb | are we ready for 122437? | 18:01 |
| clarkb | is that something we might want to announce? | 18:01 |
| fungi | jeblair: regarding your comment on 122956, that's another one of those troubling stackforge/openstack co-mingling quandaries | 18:01 |
| *** mfer has joined #openstack-infra | 18:02 | |
| *** james_li has quit IRC | 18:02 | |
| *** emagana has quit IRC | 18:03 | |
| jeblair | clarkb: i think it should be announced. lets see if sdague is ready to announce it before approving | 18:04 |
| arosen | clarkb: remember when i was asking about that grub error i was encountering? | 18:05 |
| *** marun has joined #openstack-infra | 18:05 | |
| arosen | I think we tracked down why it is occurring in our cloud thanks to node pool :) | 18:05 |
| arosen | what ends up occurring is after the image is snapshotted nodepool deploys a bunch of nodes from that image right after. | 18:06 |
| *** radez_g0n3 is now known as radez | 18:06 | |
| arosen | We use shared stored and gluster in our cloud. | 18:06 |
| *** wenlock has joined #openstack-infra | 18:06 | |
| jeblair | fungi: if the change is correct, then, agreed. however, that doesn't make any sense to me, perhaps it's an error. | 18:06 |
| *** johnthetubaguy is now known as zz_johnthetubagu | 18:06 | |
| arosen | Our version of guster is 3.2 and in 3.3 they fixed a locking issue that if multiple writings are writing to the place on a mount point that data consistency will be ensured. | 18:07 |
| fungi | jeblair: perhaps. i was assuming they avoided adding then to the gate pipeline so they wouldn't co-gate with official projects, but that's also something they could solve with a unique branch designator suffix on their jobs | 18:08 |
| openstackgerrit | A change was merged to openstack-infra/config: Remove Nova v3 API tests https://review.openstack.org/123028 | 18:08 |
| jeblair | ianw, yolanda: are we installing dib from master or from pypi releases? if pypi, 123343 depends on 118246 being in a release; is it? | 18:08 |
| *** gokrokve has joined #openstack-infra | 18:08 | |
| jeblair | fungi: yeah, i'm leaning toward error because what would they gain running the neutronclient unit tests? | 18:08 |
| *** james_li has joined #openstack-infra | 18:09 | |
| clarkb | jeblair: jogo all 3 workers on 01 are zero length log files and one of three on 08 have a zero length log file | 18:09 |
| clarkb | in theory that means we have 56/60 workers doing stuff | 18:09 |
| clarkb | a quick glance at cacti seems to confirm | 18:09 |
| clarkb | arosen: neat | 18:10 |
| EmilienM | jeblair: about #120285 : I have no idea if that should be part of the program or not. | 18:10 |
| fungi | jeblair: ahh, right. i was talking about the ones in check but not gate for the first project (where they're running neutron dsvm jobs). but also now that i think about it, that won't actually be testing the gbp extension anyway | 18:12 |
| jeblair | EmilienM: i think it's up to lifeless to decide if it's in the tripleo program; if you or he don't want it to be, then you can just change the groups to be specific to the new project and not reference diskimage-builder-core | 18:12 |
| *** mrmartin has quit IRC | 18:13 | |
| *** andreykurilin_ has joined #openstack-infra | 18:13 | |
| EmilienM | jeblair: I don't have the pretension to be part of core team of this new project. I just want to be sure that people from TripleO can review this work. | 18:14 |
| clarkb | fungi: I wrote 122578 so you should probably review that one | 18:14 |
| fungi | clarkb: lgtm. honestly i thought we had already done that, but maybe not | 18:15 |
| jeblair | EmilienM: that sounds like a problem if you are proposing a project that only the tripleo core team can review, but you aren't in it. | 18:15 |
| *** emagana has joined #openstack-infra | 18:15 | |
| jogo | clarkb: so we have most of our workers and things are still behind, hmmmm | 18:15 |
| AJaeger_ | clarkb: regarding 122437: Should those braces get removed or is that really a nit? | 18:16 |
| jeblair | EmilienM: if the tripleo program wants this project, then i would expect them to adopt it into their program. if they don't want it, then i would expect another team to be reviewing it (which may have some of the same members) | 18:16 |
| *** vhoward has left #openstack-infra | 18:16 | |
| *** jistr has quit IRC | 18:16 | |
| fungi | AJaeger_: it's not as clean as it could be, but i believe it will work as written | 18:17 |
| AJaeger_ | fungi: yes, it will work as written. | 18:17 |
| EmilienM | jeblair: we had a discussion in the ML and TripleO folks agreed | 18:17 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: Sandbox - DevStack-like dev environment for StackTach.v3 https://review.openstack.org/120844 | 18:17 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: StackTach.v3 Quincy REST API https://review.openstack.org/120582 | 18:17 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: Winchester - A notification event processing library based on persistent streams. https://review.openstack.org/121182 | 18:17 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: StackDistiller - A notification extraction and transformation library. https://review.openstack.org/120858 | 18:17 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: Timex - A time expressions library https://review.openstack.org/120852 | 18:17 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: Klugman - cmdline tool and client library for StackTach.v3 https://review.openstack.org/120838 | 18:17 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: Quince - Quincy-compliant API implementation for StackTach.v3. Supports Winchester. https://review.openstack.org/120839 | 18:17 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: Notigen - OpenStack-like notification generator/simulator. https://review.openstack.org/120849 | 18:17 |
| EmilienM | jeblair: http://lists.openstack.org/pipermail/openstack-dev/2014-September/045395.html | 18:18 |
| fungi | puh-puh-puh-pow | 18:18 |
| AJaeger_ | sandywalsh: so you mastered the dependencies? Great! Let me review... | 18:18 |
| sandywalsh | AJaeger_: thanks ... jeblair gave me the foo | 18:19 |
| *** krtaylor has quit IRC | 18:20 | |
| jeblair | EmilienM: i think you were asking the right question in the first message (about openstack/stackforge), but i don't think the thread cleared it up. i think we need lifeless to indicate whether he thinks it should be in the tripleo program or not. | 18:20 |
| *** arnaud has joined #openstack-infra | 18:20 | |
| HenryG | In openstack-infra/config there is slave_db.pp to install mysql and pg backends with 'openstack_citest' user. I would like this to be done for the machines running the neutron-dsvm-functional job. I would appreciate any hints on how to achieve this. | 18:21 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Add new experimental jobs to test dib based nodes https://review.openstack.org/123245 | 18:21 |
| clarkb | fungi: jeblair ^ that hit a merge conflict | 18:21 |
| *** arnaud__ has joined #openstack-infra | 18:21 | |
| sandywalsh | jeblair: AJaeger_ I may have to rebase https://review.openstack.org/#/c/121109/ after the big dependency chain goes through, so please leave that one till last | 18:21 |
| EmilienM | jeblair: ok. So I'll get the insights from him | 18:22 |
| openstackgerrit | Bob Callaway proposed a change to openstack-infra/config: Add puppet-manila to Stackforge https://review.openstack.org/123802 | 18:22 |
| finch | clarkb: my life is going to be insane for the next 20 hours so if you want to poke more I can try to respond when I have internets, but I can definitely help more later. In any case, passenger should be restarting the ruby processes on a regular basis, and if it's not then that is probably an issue with the passenger config | 18:24 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: [WIP] Manage autoincrement in migration https://review.openstack.org/123809 | 18:25 |
| *** krtaylor has joined #openstack-infra | 18:25 | |
| zaro | clarkb: this doesn't fail on my local env. what bug number should i use to reverify? https://review.openstack.org/#/c/89604 | 18:26 |
| clarkb | fungi: ok | 18:26 |
| clarkb | zaro: did you rebase it with master when you tried locally? | 18:26 |
| *** zigo has quit IRC | 18:26 | |
| *** cnesa15 has joined #openstack-infra | 18:26 | |
| clarkb | zaro: I do not think that is a bug and rechecking won't fix it | 18:26 |
| zaro | nope | 18:27 |
| sandywalsh | AJaeger_: can I do a patch up branch at the end to reorder into alphabetical? Will only take a second once we have all the branches merged. | 18:27 |
| sandywalsh | AJaeger_: otherwise I'm in rebase hell | 18:27 |
| *** bdpayne has joined #openstack-infra | 18:27 | |
| zaro | clarkb: i'll try recheck to see if it happens again. | 18:28 |
| clarkb | zaro: it will happen again... | 18:28 |
| zaro | clarkb: can you give it a try? | 18:28 |
| clarkb | zaro: zuul always tests your changes against the target branch. I think that merging is causing the problem | 18:28 |
| *** zigo has joined #openstack-infra | 18:28 | |
| *** rmcall has joined #openstack-infra | 18:28 | |
| *** SumitNaiksatam has joined #openstack-infra | 18:29 | |
| zaro | clarkb: ok. i'll try rebase with master this time. | 18:29 |
| *** sdake_ has joined #openstack-infra | 18:29 | |
| *** bswartz has quit IRC | 18:30 | |
| zaro | clarkb: ok. failed after rebasing. thanks. | 18:30 |
| *** otherwiseguy has joined #openstack-infra | 18:31 | |
| clarkb | er finch ok | 18:31 |
| clarkb | silly tab complete | 18:31 |
| *** mriedem has quit IRC | 18:32 | |
| *** vhoward has joined #openstack-infra | 18:33 | |
| *** bswartz has joined #openstack-infra | 18:33 | |
| *** praneshp has quit IRC | 18:33 | |
| *** marcoemorais has quit IRC | 18:34 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Add os-client-config to stackforge https://review.openstack.org/123167 | 18:35 |
| *** marcoemorais has joined #openstack-infra | 18:35 | |
| clarkb | jeblair: fungi 118944 seems like a rather large chagne to just push through | 18:35 |
| clarkb | what do you guys think of deferring that one? | 18:35 |
| clarkb | jesusaurus: ^ | 18:35 |
| *** marcoemorais has quit IRC | 18:36 | |
| *** praneshp has joined #openstack-infra | 18:36 | |
| *** Sukhdev has joined #openstack-infra | 18:36 | |
| AJaeger_ | sandywalsh: Let's ask jeblair, clarkb or fungi what they think - https://review.openstack.org/#/q/owner:sandy.walsh%2540rackspace.com+status:open,n,z is the full patch set, I marked some as -1 because of ordering. | 18:36 |
| *** marcoemorais has joined #openstack-infra | 18:37 | |
| sandywalsh | AJaeger_: thanks ... I'm working on the ordering rebase now, just in case :) | 18:37 |
| *** marcoemorais has quit IRC | 18:37 | |
| fungi | jeblair: jesusaurus: clarkb: it looks like it would be a relatively easy one to repropose to the new project since the files it's touching don't see a lot of churn? | 18:37 |
| clarkb | AJaeger_: sandywalsh do we need alphabeitical to pass tests? | 18:37 |
| krotscheck | mordred, lifeless: So regarding managing the LP id’s in storyboard - a bit of trial-and-error shows me that you cannot change the autoincrement value to a number <= than the highest id that’s already in use. If I have a record ID of 10, and I try to change the auto_increment to 5, it ends up 11. | 18:37 |
| clarkb | if not it should be fine as is | 18:37 |
| *** marcoemorais has joined #openstack-infra | 18:37 | |
| clarkb | fungi: that is whawt I was thinking too | 18:37 |
| AJaeger_ | clarkb: no, we don't need them to pass the testsuite | 18:38 |
| *** marcoemorais has quit IRC | 18:38 | |
| *** marcoemorais has joined #openstack-infra | 18:38 | |
| *** andreaf has quit IRC | 18:38 | |
| AJaeger_ | clarkb: Ok, I'll remove my -1 | 18:38 |
| krotscheck | The workaround I thought of earlier, which was to first create the record and then modify the id in an update, also doesn’t work because with the next insert the autoincrement resets itself. | 18:39 |
| *** andreaf has joined #openstack-infra | 18:39 | |
| krotscheck | So I feel like the only real option is to set the autoincrement ID in storyboard to Large(tm) | 18:39 |
| krotscheck | And then insert the LP records underneath that. | 18:39 |
| * anteaya is back from the dentist | 18:39 | |
| anteaya | it went better this time | 18:39 |
| *** juzuluag has quit IRC | 18:39 | |
| fungi | krotscheck: as opposed to keeping a mapping table and providing a convenience lookup? | 18:39 |
| *** e0ne has joined #openstack-infra | 18:40 | |
| *** otherwiseguy has quit IRC | 18:40 | |
| AJaeger_ | clarkb, fungi let's merge 118944 in soonish - even if you defer. Would be nice to have bashate tests not failing the whole time, this is confusing... | 18:40 |
| *** denis_makogon has joined #openstack-infra | 18:40 | |
| notmyname | who is tracy jones and ryan? and is gerrit really going to have checks for certain tags in the commit message? http://lists.openstack.org/pipermail/openstack-dev/2014-September/047028.html | 18:40 |
| clarkb | notmyname: no to the second bit at least not globally. Individual projects can hack that into their tests if they want it | 18:41 |
| clarkb | notmyname: infra has no plans to implement that | 18:41 |
| notmyname | Clabbe: ok, thanks | 18:41 |
| notmyname | clarkb: | 18:41 |
| morganfainberg | clarkb, thanks for clarification. | 18:42 |
| krotscheck | fungi: maaaaybe. Storing the origin of an imported story makes some sense, I just don’t think I want a unique table called ‘launchpad-to-storyboard-mapping' | 18:42 |
| notmyname | clarkb: I saw no context for the message (and didn't recognize names), so I wasn't sure if this was some new thing imposed here at the end of the juno cycle | 18:42 |
| *** pcrews has quit IRC | 18:42 | |
| fungi | notmyname: yeah, looks like maybe it's only sahara judging from the subject line tag? | 18:42 |
| clarkb | notmyname: ya it is severly lacking in context not sure if that was maybe for an internal gerrit and was mis posted? | 18:42 |
| fungi | SergeyLukjanov: ^ ideas? | 18:43 |
| morganfainberg | notmyname, my guess is it might be missing [sahara] or some other tag | 18:43 |
| fungi | oh nevermind--i was looking at the previous message url | 18:43 |
| AJaeger_ | Or [oslo.vmware] ? | 18:43 |
| fungi | yeah no clue | 18:43 |
| * SergeyLukjanov reading | 18:43 | |
| fungi | enocontext | 18:43 |
| fungi | SergeyLukjanov: i was mistaken | 18:43 |
| clarkb | wow that merge check queue has been pretty impressive | 18:43 |
| morganfainberg | AJaeger_, yep | 18:44 |
| *** hashar has joined #openstack-infra | 18:44 | |
| clarkb | jeblair: ^ we rprobably should make the jobs in that pipeline a lower priority | 18:44 |
| mordred | krotscheck: yes, that's right. we're going to need to adjust up | 18:44 |
| AJaeger_ | morganfainberg: tracy jones works on nova only, just checked stackalytics | 18:44 |
| mordred | rather than low | 18:44 |
| morganfainberg | ah | 18:44 |
| anteaya | notmyname: tjones is the nova bug czar | 18:44 |
| anteaya | so this might be some quality check coming from the sdague recon work on nova bug tracker | 18:45 |
| krotscheck | mordred: Any thoughts on storing the origin id instead of even caring about the id? | 18:45 |
| anteaya | that is my guess | 18:45 |
| notmyname | anteaya: thanks | 18:45 |
| anteaya | np | 18:45 |
| morganfainberg | anteaya, names are start ringing more bells then | 18:45 |
| anteaya | notmyname: hey has that mentee been showing up in swift at all? | 18:45 |
| anteaya | morganfainberg: cool | 18:45 |
| krotscheck | mordred: It’s a thing that fungi suggested | 18:46 |
| mordred | krotscheck: if we do, we may want a lookup by old id mechanism | 18:46 |
| sdague | I wonder if tjones sent to the wrong list? | 18:46 |
| notmyname | anteaya: yes. she's been arounda while, and we chatted (briefly) this morning. we've also got an email thread going | 18:46 |
| anteaya | well I applaud any email that says "don't +2 your own patch" | 18:46 |
| anteaya | regardless of its target | 18:46 |
| fungi | krotscheck: oh, do we have extensible tagging? could we have an arbitrary bit of metadata which isn't baked into the db schema as an lp mapping specific column? | 18:46 |
| sdague | anteaya: sure, though I haven't seen that be an issue | 18:46 |
| anteaya | notmyname: yay, so happy to hear she is showing up | 18:47 |
| anteaya | sdague: glad to hear that too then | 18:47 |
| krotscheck | fungi: not yet | 18:47 |
| anteaya | sdague: I haven't seen it myself but I don't get out much | 18:47 |
| morganfainberg | sdague, likely if somone is +2ing their own patch... they wont have access to do it for too long, just a hunch | 18:47 |
| anteaya | notmyname: let me know if I can ever help at all | 18:47 |
| notmyname | anteaya: ok, thanks. I'm pretty focused on getting stuff for juno wrapped up. but I'm sure I'll ask questions later :-) | 18:47 |
| krotscheck | fungi: However the concept of a story’s federated origin is one we’ve been discussing, this could just be the first step. | 18:48 |
| anteaya | notmyname: I'll do my best when you have time | 18:48 |
| anteaya | notmyname: go you \o/ | 18:48 |
| *** dannywilson has quit IRC | 18:48 | |
| *** e0ne is now known as e0ne_ | 18:49 | |
| *** dannywilson has joined #openstack-infra | 18:49 | |
| *** flaviof is now known as flaviof_zzz | 18:49 | |
| sandywalsh | AJaeger_: if you run into problems, I have the rebase done as a precaution | 18:50 |
| *** andreaf has quit IRC | 18:50 | |
| *** andreaf has joined #openstack-infra | 18:51 | |
| clarkb | solum devs | 18:51 |
| clarkb | you are switching your job from f20 to trusty. in the past we switched from trusty to f20 because trusty rabbit did not work | 18:52 |
| clarkb | well I guess it isn't my job to debug that for them /me approves | 18:52 |
| clarkb | oh they resolved the trusty issues... why didn't they move to trusty then | 18:52 |
| *** dannywilson has quit IRC | 18:53 | |
| morganfainberg | notmyname, and there is your answer | 18:54 |
| AJaeger_ | sandywalsh: The cores have to give their +2 on these... | 18:54 |
| notmyname | morganfainberg: heh :-) | 18:54 |
| sandywalsh | AJaeger_: gotcha ... thanks again! (and thanks jeblair for the heads up on the deadline ... that could have been bad) | 18:55 |
| openstackgerrit | Barnaby Court proposed a change to openstack-infra/jenkins-job-builder: Adds credentials-binding plugin support to wrappers https://review.openstack.org/120184 | 18:55 |
| *** e0ne_ has quit IRC | 18:56 | |
| *** MaxV has quit IRC | 18:57 | |
| *** esker has joined #openstack-infra | 18:57 | |
| clarkb | the kolla change needs a rebase https://review.openstack.org/#/c/122972 | 18:58 |
| clarkb | sdake: ^ | 18:58 |
| *** emagana has quit IRC | 18:58 | |
| *** emagana has joined #openstack-infra | 18:58 | |
| *** MaxV has joined #openstack-infra | 18:59 | |
| *** lcheng has joined #openstack-infra | 18:59 | |
| *** HeOS has joined #openstack-infra | 19:00 | |
| AJaeger_ | wow, you should more often split up repos - all my patches have been approved ;) Thanks, infra team! | 19:00 |
| *** marcoemorais has quit IRC | 19:00 | |
| *** wenlock has quit IRC | 19:00 | |
| *** e0ne has joined #openstack-infra | 19:00 | |
| *** marcoemorais has joined #openstack-infra | 19:01 | |
| openstackgerrit | Sumit Naiksatam proposed a change to openstack-infra/config: Enabling jobs for GBP project https://review.openstack.org/122956 | 19:02 |
| *** morganfainberg is now known as morgan | 19:02 | |
| openstackgerrit | A change was merged to openstack-infra/config: Don't let a reqs sync fail kill the sync job https://review.openstack.org/122578 | 19:02 |
| *** denis_makogon has quit IRC | 19:02 | |
| *** esker has quit IRC | 19:03 | |
| *** emagana has quit IRC | 19:03 | |
| *** morgan is now known as morganfainberg | 19:03 | |
| jeblair | AJaeger_: we plan to make it a regular occurence! just not for these same files. ;) | 19:04 |
| clarkb | BobBall: jeblair I have read https://review.openstack.org/#/c/123785/1 and the bug that it is supposed to fix. I am not convinced we are fixing the bug though since we continue to use /tmp. You are relying on puppet running long enough to avoid the race which seems problematic for say if we get rid of puppet there | 19:04 |
| clarkb | BobBall: jeblair: we should be explicit about fixing the bug and check that /tmp is moutned properly before usint it | 19:05 |
| sdake | calrkb incoming | 19:05 |
| clarkb | or something like that. otherwise we are bound to hit this sort of bug again | 19:05 |
| sdake | clarkb incoming that is | 19:05 |
| jesusaurus | clarkb: fungi: yeah 118944 would be easy enough to repropose | 19:05 |
| *** baoli has quit IRC | 19:05 | |
| AJaeger_ | sandywalsh: http://logs.openstack.org/09/121109/5/check/gate-config-projects-yaml/390f36a/console.html - alphabetication test failure | 19:06 |
| sandywalsh | AJaeger_: k, on it ... thanks | 19:06 |
| *** cnesa15 has quit IRC | 19:06 | |
| *** AJaeger_ has quit IRC | 19:07 | |
| openstackgerrit | Steven Dake proposed a change to openstack-infra/config: Add Kolla project - Dockerizing OpenStack https://review.openstack.org/122972 | 19:07 |
| sdake | clarkb rebased | 19:07 |
| jeblair | clarkb: i agree the bug/problem could be better understood and likely a better fix devised. though i don't think the existing patch is a problem. (even if it weren't fixing a bug i'd probably accept it) | 19:07 |
| clarkb | jeblair: ok | 19:07 |
| jeblair | clarkb: that's not a strong opinion | 19:08 |
| *** cnesa13 has joined #openstack-infra | 19:08 | |
| anteaya | I don't get to vote in release management elections (has there been one?) or tripleo elections but I do find ttx's and SpamapS' emails always informative and entertaining | 19:08 |
| * clarkb wonders if fungi has an opinion | 19:08 | |
| clarkb | fungi: see 123785 if/when you have a chance | 19:08 |
| *** hashar has quit IRC | 19:09 | |
| *** rmcall has quit IRC | 19:10 | |
| *** asettle has joined #openstack-infra | 19:10 | |
| *** asettle has quit IRC | 19:11 | |
| fungi | clarkb: jeblair: yeah, i'm fine with the change as is. i agree it's not necessarily fixing anything specific, but we should try to closely couple creation and abandonment of temporarily files anywhere we can | 19:11 |
| *** rmcall has joined #openstack-infra | 19:12 | |
| *** rmcall has quit IRC | 19:12 | |
| fungi | the referenced bug needs more research before anything could be considered to actually fix it | 19:12 |
| openstackgerrit | A change was merged to openstack-infra/config: Add direct-release for training-guides and ha-guide https://review.openstack.org/123558 | 19:12 |
| openstackgerrit | Sumit Naiksatam proposed a change to openstack-infra/config: UI, automation repos for group based policy project https://review.openstack.org/122922 | 19:12 |
| openstackgerrit | A change was merged to openstack-infra/config: Remove Jenkins jobs of tricircle project https://review.openstack.org/123622 | 19:12 |
| clarkb | fungi: jeblair would it be appropriate to update the commit message to say related-bug instead of fixes-bug? | 19:12 |
| clarkb | (I don't want to cause unnecessary churn) | 19:12 |
| fungi | clarkb: sure, if you want to edit the commit message and approve it, go for it | 19:13 |
| jeblair | clarkb: wfm | 19:13 |
| clarkb | ok will do | 19:13 |
| *** coolsvap is now known as coolsvap|gone | 19:13 | |
| *** marcoemorais1 has joined #openstack-infra | 19:14 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Move static definition of forwarding.conf later in script https://review.openstack.org/123785 | 19:14 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: Sandbox - DevStack-like dev environment for StackTach.v3 https://review.openstack.org/120844 | 19:14 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: StackTach.v3 Quincy REST API https://review.openstack.org/120582 | 19:15 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: Winchester - A notification event processing library based on persistent streams. https://review.openstack.org/121182 | 19:15 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: StackDistiller - A notification extraction and transformation library. https://review.openstack.org/120858 | 19:15 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: Timex - A time expressions library https://review.openstack.org/120852 | 19:15 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: notification_utils: utility library for OpenStack notifications. https://review.openstack.org/121109 | 19:15 |
| *** marcoemorais has quit IRC | 19:15 | |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: Klugman - cmdline tool and client library for StackTach.v3 https://review.openstack.org/120838 | 19:15 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: Quince - Quincy-compliant API implementation for StackTach.v3. Supports Winchester. https://review.openstack.org/120839 | 19:15 |
| openstackgerrit | Sandy Walsh proposed a change to openstack-infra/config: Notigen - OpenStack-like notification generator/simulator. https://review.openstack.org/120849 | 19:15 |
| sandywalsh | AJaeger: that should fix up all the ordering too | 19:15 |
| lifeless | jeblair: I'm fine with tripleo-puppet-elements being created; I thought it had already | 19:15 |
| *** radez is now known as radez_g0n3 | 19:15 | |
| jeblair | lifeless: the question is whether it should be in the tripleo program | 19:17 |
| jeblair | lifeless: the proposed creation patch has it in stackforge (not in tripleo) with only dib-core able to review (defacto in tripleo) | 19:17 |
| openstackgerrit | A change was merged to openstack-infra/config: solum f20 gate is failing due to upstream dep. https://review.openstack.org/122782 | 19:17 |
| *** ChuckC has quit IRC | 19:18 | |
| jeblair | lifeless: those seem contradictory, and it's not clear to me which it should be | 19:18 |
| *** Longgeek has quit IRC | 19:18 | |
| openstackgerrit | A change was merged to openstack-infra/config: Use check-requirements templates in layout.yaml https://review.openstack.org/122947 | 19:18 |
| *** asettle has joined #openstack-infra | 19:19 | |
| lifeless | jeblair: whats the contradiction? | 19:19 |
| *** e0ne is now known as e0ne_ | 19:20 | |
| *** dimtruck is now known as zz_dimtruck | 19:21 | |
| *** melwitt has joined #openstack-infra | 19:21 | |
| *** loki184 has quit IRC | 19:21 | |
| openstackgerrit | A change was merged to openstack-infra/config: swiftonfile: Add py26 https://review.openstack.org/123378 | 19:22 |
| *** shashankhegde has quit IRC | 19:22 | |
| jeblair | lifeless: is it, or is it not, intended to be part of the tripleo program? | 19:22 |
| fungi | BobBall: i have a theory on your bug 1373505 there... check your fstab and the output of initctl show-config mounted-tmp | 19:23 |
| uvirtbot | Launchpad bug 1373505 in openstack-ci "Ubuntu Trusty race: forwarding.conf not found" [Undecided,In progress] https://launchpad.net/bugs/1373505 | 19:23 |
| lifeless | jeblair: it is | 19:23 |
| *** devkulkarni has joined #openstack-infra | 19:23 | |
| jeblair | lifeless: okay, so it should go into the openstack/ namespace and there should be an accompanying patch to openstack/governance to add it to the tripleo program | 19:24 |
| jeblair | EmilienM: ^ | 19:24 |
| lifeless | ah | 19:24 |
| lifeless | so you'll want that done for tripleo-ansible too | 19:24 |
| lifeless | and for kolla | 19:24 |
| arosen | anteaya: ping | 19:24 |
| devkulkarni | thanks jeblair clarkb for voting: https://review.openstack.org/#/c/122782/ | 19:24 |
| fungi | i think tripleo-ansible was already proposed to openstack rather than stackforge | 19:24 |
| arosen | can you update a public ssh key for me for our ci? | 19:24 |
| jeblair | lifeless: ya | 19:24 |
| lifeless | sdake: ^ | 19:25 |
| lifeless | SpamapS: ^ | 19:25 |
| clarkb | jeblair: lifeless: I think we care less about it being in stackforge initially if the dev groups are at least distinct in gerrit? | 19:25 |
| clarkb | the having tripleo core be core on stackforge project that wants to be in openstack is what initial prompted the questions. Seems like it should just be in tripleo if that is the case | 19:25 |
| jeblair | clarkb: i'm pretty sure lifeless just said he wants it in tripleo | 19:26 |
| openstackgerrit | Bob Callaway proposed a change to openstack-infra/config: Add puppet-manila to Stackforge https://review.openstack.org/123802 | 19:26 |
| clarkb | jeblair: ya and thats fine too. Just wanted to clarify the general case situation | 19:26 |
| *** mriedem has joined #openstack-infra | 19:27 | |
| *** DuncanT has quit IRC | 19:27 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Manage autoincrement in migration https://review.openstack.org/123821 | 19:28 |
| *** DuncanT- has joined #openstack-infra | 19:28 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add new experimental jobs to test dib based nodes https://review.openstack.org/123245 | 19:29 |
| *** bswartz has quit IRC | 19:29 | |
| *** markmcclain has joined #openstack-infra | 19:29 | |
| krotscheck | ^ That’s the last of 4 patches that should address the infra migration issues raised in the meeting yesterday | 19:29 |
| krotscheck | The script that should be executed on the storyboard server is here -> https://etherpad.openstack.org/p/infra-storyboard-migration | 19:30 |
| krotscheck | (Once those land) | 19:30 |
| anteaya | arosen: I have no permissions to update a public key | 19:31 |
| *** andreaf has quit IRC | 19:31 | |
| anteaya | arosen: and core is having a push to get as many config patches into config before the freeze in about 4.5 hours | 19:31 |
| EmilienM | jeblair: just read | 19:32 |
| anteaya | arosen: might I suggest you ping a core on friday and between you and I we can find a willing soul to do that update | 19:32 |
| openstackgerrit | Adam Gandelman proposed a change to openstack-infra/config: Disable ironic job for stable/icehouse https://review.openstack.org/123822 | 19:32 |
| *** andreaf has joined #openstack-infra | 19:32 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add os-client-config to stackforge https://review.openstack.org/123167 | 19:32 |
| anteaya | arosen: is that acceptable? | 19:32 |
| *** gyee has joined #openstack-infra | 19:34 | |
| *** sdake_ has quit IRC | 19:36 | |
| *** hashar has joined #openstack-infra | 19:38 | |
| openstackgerrit | Emilien Macchi proposed a change to openstack-infra/config: Introduce tripleo-puppet-elements into Stackforge https://review.openstack.org/120285 | 19:38 |
| *** rmcall has joined #openstack-infra | 19:38 | |
| EmilienM | jeblair: lifeless: updated ^^^^ - I'm looking at openstack/governance now. | 19:38 |
| koolhead17 | Alex_Gaynor: salute. | 19:38 |
| EmilienM | jeblair: lifeless: and the patch in governance: https://review.openstack.org/123826 | 19:41 |
| *** radez_g0n3 is now known as radez | 19:41 | |
| jeblair | EmilienM: thanks. we might not get to merging the patch to create it today while we wait to make sure the tc doesn't object to it | 19:42 |
| *** shashankhegde has joined #openstack-infra | 19:42 | |
| EmilienM | jeblair: today was not in my mind, but I don't want to forget this one. It has some time already... | 19:42 |
| *** emagana has joined #openstack-infra | 19:45 | |
| *** atiwari has quit IRC | 19:45 | |
| *** e0ne_ has quit IRC | 19:46 | |
| *** openstackgerrit has quit IRC | 19:46 | |
| *** openstackgerrit has joined #openstack-infra | 19:47 | |
| openstackgerrit | A change was merged to openstack-infra/config: Move static definition of forwarding.conf later in script https://review.openstack.org/123785 | 19:48 |
| *** pcrews has joined #openstack-infra | 19:50 | |
| *** coolsvap|gone has quit IRC | 19:51 | |
| *** wenlock has joined #openstack-infra | 19:52 | |
| arosen | anteaya: mind pointing me where the change needs to be made? | 19:53 |
| arosen | is this in the config repo? | 19:53 |
| *** ociuhandu has joined #openstack-infra | 19:54 | |
| anteaya | arosen: no this isn't a config repo change | 19:54 |
| anteaya | it can only be done via ssh or the gui with someone with gerrit permissions | 19:54 |
| *** lcheng has quit IRC | 19:54 | |
| anteaya | which I don't have | 19:54 |
| *** ChuckC has joined #openstack-infra | 19:54 | |
| clarkb | sdake: jeblair see comments on https://review.openstack.org/#/c/122972/ | 19:54 |
| clarkb | lifeless: ^ | 19:54 |
| fungi | arosen: i saw your post to the ml. i'll take care of it real quick | 19:54 |
| anteaya | fungi: thanks | 19:55 |
| arosen | fungi: awesome thanks :) | 19:55 |
| sdague | clarkb / fungi : in 9 minutes, when the top of the patches make it through, it's probably worth promoting - https://review.openstack.org/#/c/123774/ | 19:55 |
| sdague | that's a presumed fix for the #1 gate affecting bug | 19:55 |
| jeblair | clarkb: thx | 19:55 |
| *** _nadya_ has joined #openstack-infra | 19:55 | |
| clarkb | sdague: noted | 19:56 |
| *** mfer has quit IRC | 19:56 | |
| *** atiwari has joined #openstack-infra | 19:56 | |
| clarkb | https://jenkins04.openstack.org/job/experimental-tempest-dsvm-full-dibtest/1/console is running \o/ | 19:58 |
| clarkb | let us see how it does | 19:58 |
| *** david-ly_ is now known as david-lyle | 19:58 | |
| *** sballe__ has joined #openstack-infra | 20:00 | |
| *** _nadya_ has quit IRC | 20:00 | |
| dkranz | Is there a simple explanation why in https://review.openstack.org/#/c/123252/, jenkins says +1 but there are jobs that failed and are not marked as non-voting? | 20:00 |
| notmyname | seems to me that the wiki is logging you out very quickly these days (like maybe after an hour)? | 20:00 |
| fungi | arosen: i don't have a congress-ci account, just a vmware-congress-ci account. same one? | 20:00 |
| jeblair | dkranz: those jobs came from the experimental queue | 20:01 |
| Alex_Gaynor | koolhead17: ? | 20:01 |
| sdague | notmyname: yeh, I was noticing that as well today. I wonder if it's the wiki or the openid provider | 20:01 |
| fungi | arosen: account_id=13050 full_name="VMWare Congress CI"? | 20:01 |
| jeblair | dkranz: why the experimental queue has both voting and nonvoting jobs is curious. :) | 20:01 |
| clarkb | dkranz: looks like those jobs run in the exerimental queues. so they don't vote | 20:01 |
| sdague | clarkb: possition 2 change is about to fail | 20:01 |
| *** lcheng has joined #openstack-infra | 20:01 | |
| notmyname | sdague: I made edits before the swift team meeting. tried to edit after the meeting was over and had to log in again | 20:02 |
| *** bswartz has joined #openstack-infra | 20:02 | |
| clarkb | sdague: I am ready when it processes the head | 20:02 |
| dkranz | clarkb, jeblair : ok, I had just been used to being suspicious of failing jobs that were not marked as non-voting | 20:02 |
| sdague | man, it's taking a long time to process the head | 20:02 |
| clarkb | sdague: it has a bunch of results events it is chewing through | 20:03 |
| sdague | gotcha | 20:03 |
| sdague | ok, the head merged | 20:03 |
| clarkb | there it went. promoting now | 20:03 |
| *** marcoemorais1 has quit IRC | 20:04 | |
| sdague | great, thanks | 20:04 |
| clarkb | and done | 20:04 |
| arosen | fungi: sorry yes that's it. | 20:04 |
| *** marcoemorais has joined #openstack-infra | 20:04 | |
| *** atiwari has quit IRC | 20:05 | |
| *** marcoemorais has quit IRC | 20:05 | |
| jaypipes | jeblair: really diggin gertty :) | 20:05 |
| *** marcoemorais has joined #openstack-infra | 20:05 | |
| *** hashar has quit IRC | 20:05 | |
| fungi | arosen: it gives me "fatal: Identity in use by another account" so i think that e-mail address must already be associated with another existing gerrit account? | 20:05 |
| stevemar | what's it mean if a job is appearing as `NOT_REGISTERED`? - looking at 122605 on http://status.openstack.org/zuul/ | 20:06 |
| arosen | fungi: i guess we can keep the same email address that's already on there then. | 20:06 |
| *** zz_dimtruck is now known as dimtruck | 20:06 | |
| fungi | arosen: okay, added the requested key | 20:07 |
| sdague | so the zuul waiting job queue hasn't got to 0 in a long time. is that new normal with the merge checks? | 20:07 |
| *** packet has joined #openstack-infra | 20:07 | |
| anteaya | stevemar: it means that zuul/jenkins couldn't find it | 20:07 |
| arosen | fungi: thanks again | 20:08 |
| *** devkulkarni has quit IRC | 20:09 | |
| fungi | stevemar: yeah, either zuul's layout updated before the jjb created those jobs, or they disagree on what node type to use | 20:09 |
| *** boden has quit IRC | 20:09 | |
| *** boden has joined #openstack-infra | 20:10 | |
| fungi | stevemar: looks like it's registering for both devstack-precise and devstack-trusty node types now, so probably just a race between zuul and jjb | 20:10 |
| jeblair | jaypipes: woohoo! | 20:11 |
| fungi | stevemar: yeah... 2014-09-24 19:22:55,923 ERROR zuul.Gearman: Job <gear.Job 0x7f556975da10 handle: None name: build:check-osc-functional:bare-trusty unique: 31d513475ae84228b7216af001d6c5a2> is not registered with Gearman | 20:11 |
| fungi | stevemar: if you recheck once that change reports, it should be fine | 20:11 |
| jeblair | sdague: yeah, merge checks are counted as jobs in that graph | 20:12 |
| sdague | right, so the merge checks on nova seem to be taking up to 45 minutes | 20:12 |
| sdague | at least I saw that this morning | 20:12 |
| *** mfer has joined #openstack-infra | 20:12 | |
| stevemar | fungi, alrighty, i'll try another recheck when this one finishes up - hope that's the case | 20:12 |
| sdague | so... maybe it's better to just stop doing those | 20:13 |
| *** baoli has joined #openstack-infra | 20:13 | |
| sdague | as if that's going to add big chunks of time to restarting gate queue after a merge, that seems like it's not worth the early info | 20:13 |
| *** kashyap has quit IRC | 20:13 | |
| stevemar | merge check is all nova, thats impressive | 20:14 |
| sdague | stevemar: well... we merged a nova change :) | 20:14 |
| sdague | so that's what you'd expect | 20:14 |
| jeblair | sdague: i don't think they take that long | 20:14 |
| sdague | jeblair: well they've been queued 10 minutes at this point | 20:14 |
| jeblair | sdague: and the better solution is to have the merge check job take on the gear precedence of the pipeline they are in. then the impact should be less. | 20:14 |
| jeblair | sdague: also, we can throw more cloud at it. | 20:15 |
| sdague | jeblair: more cloud would be great | 20:15 |
| *** boden has quit IRC | 20:15 | |
| stevemar | wouldn't we have to take away cloud from somewhere to add more cloud at merge-check? | 20:15 |
| jeblair | sdague: time in queue is also not the same as the time it takes to process those changes since (due to lack of precedence pass-through) they are sharing the queue with all other merge work | 20:15 |
| jeblair | sdague: (it could be 5 mins before zuul gets around to starting the first merge-check, but that still counts as time in queue) | 20:16 |
| sdague | jeblair: sure, it looks like it's chewing through 10 - 15 a minute | 20:16 |
| sdague | but.... a nova merge creates ~300 of them | 20:17 |
| *** marcoemorais has quit IRC | 20:18 | |
| *** mwagner_lap has quit IRC | 20:18 | |
| *** marcoemorais has joined #openstack-infra | 20:18 | |
| *** marcoemorais has quit IRC | 20:18 | |
| *** marcoemorais has joined #openstack-infra | 20:18 | |
| sdague | so is the integrated queue on hold until that's processed? | 20:19 |
| clarkb | sdague: its more subtle than that | 20:19 |
| sdague | ok | 20:19 |
| *** mfer has quit IRC | 20:19 | |
| clarkb | sdague: it is a fifo, so merge requests for any pipeline are served in order | 20:20 |
| *** asettle has quit IRC | 20:20 | |
| clarkb | sdague: the merge check queue happens to put a ton of jobs on that fifo all at once | 20:20 |
| *** james_li has quit IRC | 20:20 | |
| jeblair | anyway, passing the precedence through should not be a difficult change if anyone wants to hack on that | 20:21 |
| *** dannywilson has joined #openstack-infra | 20:21 | |
| jeblair | nor is spinning up zm05 | 20:21 |
| sdague | jeblair: so what would the impact of that be? (the precedence change) | 20:22 |
| * SpamapS is just catching up | 20:22 | |
| clarkb | jeblair: can we just start with setting the precendence to normal or low? | 20:22 |
| clarkb | jeblair: that solves the issue for the gate | 20:22 |
| SpamapS | fungi: AFAIK, we never proposed tripleo-ansible to openstack/ .. it's been in stackforge for a few days now | 20:23 |
| jeblair | clarkb: no, the _feature_ to set precedce for merge workers does not exist | 20:23 |
| *** esker has joined #openstack-infra | 20:23 | |
| jeblair | sdague: the merge jobs for the merge-check queue could operate at low precedence meaning merge jobs for higher precedence pipelines such as check or gate would be handled first regardless of queue order | 20:24 |
| *** atiwari has joined #openstack-infra | 20:24 | |
| jeblair | sdague: this is the current state for _actual_ jobs, just not _merge_ jobs | 20:24 |
| *** james_li has joined #openstack-infra | 20:24 | |
| *** esker has quit IRC | 20:24 | |
| sdague | oh, so the issue is that merge workers are always high precedence? | 20:25 |
| sdague | so merges trump other work | 20:25 |
| jeblair | sdague: merge jobs are handled by zuul-merger workers, not by jenkins. they only handle merge jobs (and jenkins never handles merge jobs) | 20:26 |
| jeblair | sdague: so there's no conflict between jenkins worker nodes and the mergers | 20:26 |
| *** mfer has joined #openstack-infra | 20:26 | |
| jeblair | sdague: but all of the merge work, including prepping a change for test by a worker, is handled by the mergers and all of that work has the same precedence currently so it's strict fifo | 20:27 |
| *** packet has quit IRC | 20:27 | |
| sdague | ok, so forgive my next stupid question | 20:27 |
| *** packet has joined #openstack-infra | 20:28 | |
| sdague | is the merge queue having content delaying content being scheduled in other queues? | 20:28 |
| sdague | or is that just coincidence | 20:28 |
| clarkb | jeblair: gotcha | 20:28 |
| jeblair | sdague: so if we say "the merge job we're putting on the queue has the precedence of the pipeline it is for", then suddenly check and gate merge jobs get serviced first, and merge-check jobs get filled when there isn't anything higher-priority needing to be done | 20:28 |
| *** packet has quit IRC | 20:29 | |
| *** adalbas has quit IRC | 20:29 | |
| jeblair | sdague: sometimes, yes. the gate queue is currently waiting on mergers to create the changes that it will test, and they are busy doing merge-check work | 20:29 |
| *** packet has joined #openstack-infra | 20:30 | |
| ekarlso | phschwartz: u tharr ? | 20:30 |
| *** dkranz has quit IRC | 20:30 | |
| sdague | ok, so zm05 would just increase the throughput by 25% | 20:31 |
| *** berendt has quit IRC | 20:31 | |
| jeblair | yep | 20:31 |
| sdague | which would still mean that after a nova merge we'd take a 20+ minute delay | 20:31 |
| *** tonytan4ever has quit IRC | 20:31 | |
| sdague | ok, gotcha. Well I have to run for the day here shortly, so the fix isn't something I can really look at. | 20:32 |
| *** imcsk8 has quit IRC | 20:32 | |
| sdague | did want to bring up the behavior that I'm seeing, which is definitely impacting our throughput on bug fixes | 20:33 |
| *** MaxV has quit IRC | 20:34 | |
| sdague | to the point where I'd be in favor of just dropping the merge-check part to get the throughput back and be able to think about the real fix when not in crunch time | 20:34 |
| fungi | i'm not convinced the impact is a strict 1:1 though. when zuul's mergers are occupied processing merge-check jobs, nodepool is catching up on building nodes and the providers are catching up on pending deletes, so the ramp back up is a good bit faster compared to an outright delay | 20:34 |
| *** YorikSar has quit IRC | 20:34 | |
| fungi | it does make the jenkins job start times more bursty, but isn't necessarily impacting throughput directly | 20:35 |
| sdague | fungi: well it's injecting delays. And while it means you get all the nodes at once, there is enough variability in node times, that getting the nodes faster for the first patch in the queue I think really helps | 20:36 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/zuul: Add precedence to merge jobs https://review.openstack.org/123846 | 20:36 |
| *** james_li has left #openstack-infra | 20:36 | |
| jeblair | sdague, clarkb, fungi: ^ | 20:37 |
| sdague | or jeblair will just fix the world :) | 20:37 |
| *** Sukhdev has quit IRC | 20:37 | |
| *** dprince has quit IRC | 20:37 | |
| *** dustins has quit IRC | 20:38 | |
| jeblair | i just realized we passed change 123456; was uploaded yesterday | 20:39 |
| jeblair | to openstack/training-guides | 20:39 |
| sdague | yep, I noticed that yesterday | 20:39 |
| sdague | as I had 123424 IIRC | 20:39 |
| *** asettle has joined #openstack-infra | 20:45 | |
| *** radez is now known as radez_g0n3 | 20:46 | |
| *** tonytan4ever has joined #openstack-infra | 20:49 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Switch gerrit to project-config https://review.openstack.org/122894 | 20:50 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Doc updates for project-config https://review.openstack.org/122908 | 20:50 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Switch jenkins to project-config https://review.openstack.org/122893 | 20:50 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Switch specs to project-config https://review.openstack.org/122904 | 20:50 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Switch gerritbot to project-config https://review.openstack.org/122905 | 20:50 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Switch nodepool to project-config https://review.openstack.org/122902 | 20:50 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Switch accessbot to project-config https://review.openstack.org/122903 | 20:50 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Switch zuul and zuul-dev to project-config https://review.openstack.org/122533 | 20:50 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Move zuul layout into /etc/zuul/layout https://review.openstack.org/122532 | 20:50 |
| jeblair | rebased due to conflict ^ | 20:50 |
| boris-42 | jeblair hi there | 20:51 |
| *** imcsk8 has joined #openstack-infra | 20:51 | |
| boris-42 | jeblair https://review.openstack.org/#/c/123421/ we got from designate team +1 | 20:51 |
| boris-42 | jeblair is it enough? | 20:52 |
| *** dannywilson has quit IRC | 20:53 | |
| jeblair | boris-42: i'd like Kiall to weigh in if possible | 20:53 |
| boris-42 | ekarlso ^ | 20:53 |
| *** dannywilson has joined #openstack-infra | 20:53 | |
| boris-42 | jeblair hm but it's just experimental job on rally patches | 20:54 |
| boris-42 | jeblair or just to avoid mistakes? | 20:54 |
| jeblair | boris-42: oh, i thought it was being added to designate. sorry, it's fine then. | 20:54 |
| boris-42 | jeblair no we are just adding experimental to rally, to test that designate benchmarks works properly | 20:54 |
| boris-42 | jeblair and experimental to safe some resources | 20:55 |
| boris-42 | jeblair of inra | 20:55 |
| boris-42 | infra* | 20:55 |
| *** koolhead17 has quit IRC | 20:55 | |
| jeblair | boris-42: aprvd | 20:55 |
| boris-42 | jeblair thank you sir | 20:55 |
| jeblair | np, thanks for bringing that to my attention | 20:55 |
| clarkb | ok lunch has been consumed. I am reviewing that zuul change now | 20:56 |
| jeblair | zaro: the jjb config test is going to be disabled during the project-config freeze/move. we should be extra careful merging jjb changes (or just not merge them) until it's back up again. | 20:57 |
| arosen | anyone know off hand if there is a way to tell tempest which tests you want to run rather than skip? | 20:57 |
| * arosen through devstack-gate | 20:57 | |
| SergeyLukjanov | anteaya, hey, I'm now looking on 3rd party accs requests and have a question re http://lists.openstack.org/pipermail/third-party-requests/2014-September/000008.html | 20:57 |
| *** dannywilson has quit IRC | 20:58 | |
| clarkb | arosen: yes, tox -efull regextomatchhere | 20:58 |
| SergeyLukjanov | anteaya, sounds like we don't like microsoft-cinder-ci | 20:58 |
| *** dane_leblanc has quit IRC | 20:58 | |
| jeblair | zaro: actually, since it's not voting, i'll probably leave it running but it may fail at some point | 20:58 |
| anteaya | SergeyLukjanov: correct | 20:59 |
| clarkb | jeblair: zuul change is nice and simple. +2 | 20:59 |
| anteaya | SergeyLukjanov: Microsoft iscsi CI works for me | 21:00 |
| anteaya | SergeyLukjanov: how do you feel about that? | 21:00 |
| *** armax has quit IRC | 21:00 | |
| jeblair | anteaya: can you un-wip https://review.openstack.org/#/c/122199/5 ? | 21:01 |
| jeblair | anteaya: we need to merge that after we finish flushing the queue and before you start your extraction work | 21:01 |
| jeblair | (it should be the last change we merge before the freeze) | 21:01 |
| SergeyLukjanov | anteaya, I'm ok with it | 21:01 |
| jeblair | anteaya: and actually, it needs to be rebased so it does not depend on the repo creation | 21:01 |
| jeblair | anteaya: (the repo creation can depend on it, actually) | 21:02 |
| *** bcourt has quit IRC | 21:02 | |
| *** otherwiseguy has joined #openstack-infra | 21:02 | |
| anteaya | jeblair: done | 21:03 |
| anteaya | I will now rebase | 21:03 |
| jeblair | anteaya: cool, thanks | 21:03 |
| *** emagana has quit IRC | 21:03 | |
| anteaya | the done was for the un-wip'ing | 21:03 |
| jeblair | understood | 21:04 |
| jeblair | anteaya: the thanks was for past and future work ;) | 21:04 |
| *** emagana has joined #openstack-infra | 21:04 | |
| *** sballe__ has quit IRC | 21:05 | |
| *** emagana has quit IRC | 21:05 | |
| *** tonytan4ever has quit IRC | 21:05 | |
| *** emagana has joined #openstack-infra | 21:05 | |
| anteaya | jeblair: :D | 21:05 |
| *** homeless has quit IRC | 21:05 | |
| *** maxbit has quit IRC | 21:06 | |
| *** mfer has quit IRC | 21:06 | |
| *** marcoemorais has quit IRC | 21:06 | |
| *** homeless has joined #openstack-infra | 21:06 | |
| *** marcoemorais has joined #openstack-infra | 21:06 | |
| fungi | sandywalsh: seconding AJaeger's question on 120858, just want to make sure you intend to import that 0.10 tag for stackdistiller | 21:07 |
| *** marcoemorais has quit IRC | 21:07 | |
| *** marcoemorais has joined #openstack-infra | 21:07 | |
| fungi | sandywalsh: nevermind, i see you answered the same question earlier when anteaya asked | 21:08 |
| * fungi should look more closely at older review comments | 21:08 | |
| *** marcoemorais has quit IRC | 21:08 | |
| ekarlso | has K opened ? :P | 21:08 |
| sandywalsh | fungi: I can nuke it if it's a pain ... it's likely stale | 21:08 |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Removes redundant jobs from config gate and check https://review.openstack.org/122199 | 21:09 |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Creates a new repo, project-config https://review.openstack.org/121650 | 21:09 |
| fungi | sandywalsh: it's not a pain as long as you don't ask to have it deleted later ;) | 21:09 |
| anteaya | don't review them yet | 21:09 |
| *** aysyanne has quit IRC | 21:09 | |
| SergeyLukjanov | anteaya, I've asked for email in http://lists.openstack.org/pipermail/third-party-requests/2014-September/000011.html | 21:09 |
| anteaya | I forgot to add the source url | 21:09 |
| anteaya | sorry | 21:09 |
| sandywalsh | fungi: no, that's fine. Best to have it. I think there may be references to it | 21:09 |
| anteaya | SergeyLukjanov: well we don't need email anymore | 21:09 |
| anteaya | SergeyLukjanov: since we have the wikipages | 21:09 |
| SergeyLukjanov | anteaya, correct | 21:09 |
| *** marcoemorais has joined #openstack-infra | 21:10 | |
| SergeyLukjanov | will create an account for them, anteaya | 21:10 |
| *** boden has joined #openstack-infra | 21:10 | |
| SergeyLukjanov | anteaya, re anteaya, and re http://lists.openstack.org/pipermail/third-party-requests/2014-September/000013.html looks like we need some account name for them | 21:10 |
| *** marcoemorais has quit IRC | 21:10 | |
| *** marcoemorais has joined #openstack-infra | 21:10 | |
| SergeyLukjanov | anteaya, like brocade-fiber-ci | 21:10 |
| *** marcoemorais has quit IRC | 21:11 | |
| clarkb | https://jenkins04.openstack.org/job/experimental-tempest-dsvm-full-dibtest/1/ was a success | 21:11 |
| clarkb | jeblair: fungi ^ the test time is a little long but I Think that is true of hpcloud so not super worried about it right now | 21:11 |
| *** marcoemorais has joined #openstack-infra | 21:11 | |
| *** devkulkarni has joined #openstack-infra | 21:11 | |
| fungi | SergeyLukjanov: anteaya: it's fibre (if in the sense of "fibre channel scsi") | 21:11 |
| SergeyLukjanov | fungi, yup, typi | 21:12 |
| SergeyLukjanov | typo* | 21:12 |
| openstackgerrit | A change was merged to openstack-infra/config: Add rally-designate experimental job https://review.openstack.org/123421 | 21:13 |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Creates a new repo, project-config https://review.openstack.org/121650 | 21:13 |
| clarkb | fungi: jeblair also https://jenkins02.openstack.org/job/experimental-tempest-dsvm-neutron-full-dibtest/1/ | 21:13 |
| jeblair | anteaya: would it be possible to add the following files from the tools/ directory to the project-config migration: check_projects_yaml_alphabetized.sh check_upstream_url_scheme.py normalize_acl.py run-compare-xml.sh run-layout.sh | 21:13 |
| jeblair | anteaya: ^ oops, sent that in another window | 21:13 |
| *** wenlock has quit IRC | 21:13 | |
| anteaya | SergeyLukjanov: fibre works for me | 21:14 |
| bswartz | is anyone here familiar with ttx's wait_for_tarball.py script? | 21:14 |
| *** morgan_remote_ has joined #openstack-infra | 21:14 | |
| anteaya | jeblair: yes we can add to project-config | 21:14 |
| *** boden has quit IRC | 21:14 | |
| SergeyLukjanov | anteaya, okay, so, I'm creating 3 accounts from the third-party-requests ml | 21:14 |
| anteaya | can we add them here: https://etherpad.openstack.org/p/Le2P9YegAx so I can visualize? | 21:14 |
| anteaya | SergeyLukjanov: thanks | 21:15 |
| SergeyLukjanov | anteaya, sorry for delays - /me double booked on internal stuff and release | 21:15 |
| jeblair | anteaya: done, and thanks | 21:16 |
| anteaya | SergeyLukjanov: I understand | 21:16 |
| anteaya | SergeyLukjanov: thanks for clearing the list | 21:16 |
| fungi | sandywalsh: i'm +2 on that entire stack, but note that you didn't actually need to add sections for it to jenkins_job_builder/config/projects.yaml since you're not adding any jenkins job templates which need parameters specified (or any at all in fact) | 21:16 |
| clarkb | mordred: dhellmann: https://bugs.launchpad.net/bugs/1373623 just making sure you see that | 21:16 |
| davidlenwell | heya.. I'm sure this is way off topic.. but I was wondering if there what if any hold is there for not actually merging this doc change? https://review.openstack.org/#/c/107024/7 is it just docs so its not high on the list? or is the 1 -1 holding up merge? | 21:16 |
| uvirtbot | Launchpad bug 1373623 in pbr "prb fails to parse certain requirements" [Undecided,New] | 21:16 |
| anteaya | jeblair: thank you, I will create a new github:project-config and reorganized-project-config-03 with these changes for review | 21:17 |
| sandywalsh | fungi: thanks. We will be enabling the tests later, but good to know. | 21:18 |
| jeblair | davidlenwell: just workload for me. i'm currently working to make space in my queue for that, so i hope to get to infra-manual soon | 21:19 |
| davidlenwell | jeblair: thanks.. just making sure it wasn't held up on my end. | 21:19 |
| davidlenwell | trying to clear my review queue as well .. | 21:19 |
| stevemar | fungi, bah humbug, it's NOT_REGISTERED again, | 21:22 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Subscription https://review.openstack.org/104004 | 21:22 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Subscription events now appear in UI https://review.openstack.org/114404 | 21:22 |
| fungi | stevemar: i'll carefully compare logs and gearman status output but it looked correct | 21:22 |
| jeblair | anteaya: i don't think the dependency on https://review.openstack.org/#/c/122199/ is right. i'd start with a new git branch based on master, then cherry-pick c98c22d4ce11d67fee3e0edeee3424d987b49be0 onto it, then git-review that. | 21:23 |
| *** emagana has quit IRC | 21:23 | |
| ianw | jeblair: sorry, should have called out the version in the CL ... it will need 0.1.32; lifeless told me that it releases once a week and the last release was 7 days ago | 21:24 |
| *** emagana has joined #openstack-infra | 21:24 | |
| *** asettle has quit IRC | 21:24 | |
| fungi | stevemar: aha! zuul thinks it should run on bare-trusty but you have configured jenkins to associate it with devstack-trusty instead. i'm betting you need an override in the zuul parameter script to deal with our current overrides, since your job name doesn't have "dsvm" in it | 21:24 |
| *** asettle has joined #openstack-infra | 21:24 | |
| jeblair | ianw: okay, so we should hold off on that for now. thanks. | 21:24 |
| clarkb | fungi: the job name should have dsvm in it if it runs on devstack noes | 21:24 |
| *** mmedvede has quit IRC | 21:25 | |
| fungi | clarkb: good point. perhaps a change to rename the job is better | 21:25 |
| fungi | noting that the devstack-based functional test jobs for swift, neutron et all do have dsvm in their job names | 21:25 |
| fungi | stevemar: ^ | 21:25 |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Removes redundant jobs from config gate and check https://review.openstack.org/122199 | 21:25 |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Creates a new repo, project-config https://review.openstack.org/121650 | 21:25 |
| anteaya | jeblair: sorry I can do that next | 21:26 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/config: Project may now be assigned to multiple project groups. https://review.openstack.org/111815 | 21:26 |
| clarkb | fungi: horizon too. | 21:26 |
| *** JayJ_ has quit IRC | 21:26 | |
| stevemar | fungi, ahh, i didn't think having dsvm in the name was that necessary | 21:26 |
| *** emagana has quit IRC | 21:26 | |
| fungi | stevemar: we have a pattern match for that string so that zuul knows what sort of workers to expect jenkins to register for them | 21:26 |
| *** emagana has joined #openstack-infra | 21:27 | |
| stevemar | fungi, gotcha, so i need to add dsvm eh | 21:27 |
| stevemar | alrighty | 21:27 |
| anteaya | home heating issue back in 10 minutes | 21:27 |
| * krotscheck just updated https://review.openstack.org/111815 to add the project groups that have been added since it went up for review. He hopes he won’t have to do that too often. | 21:27 | |
| krotscheck | Also, I’ve got 3x +2 on https://review.openstack.org/#/c/111814/. | 21:27 |
| *** emagana has quit IRC | 21:28 | |
| *** emagana has joined #openstack-infra | 21:29 | |
| *** armax has joined #openstack-infra | 21:29 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/config: Add puppet-storyboard to storyboard https://review.openstack.org/118435 | 21:29 |
| openstackgerrit | Steve Martinelli proposed a change to openstack-infra/config: Rename osc-functional to osc-dsvm-functional https://review.openstack.org/123858 | 21:31 |
| stevemar | fungi, ^ | 21:32 |
| fungi | stevemar: lgtm | 21:33 |
| stevemar | hoping to get this one in quick :) i'm testing out a bunch of changes locally :D | 21:33 |
| openstackgerrit | A change was merged to openstack-infra/jeepyb: Multiple project groups. https://review.openstack.org/111814 | 21:33 |
| anteaya | back | 21:33 |
| *** emagana has quit IRC | 21:33 | |
| *** devkulkarni has left #openstack-infra | 21:34 | |
| *** emagana has joined #openstack-infra | 21:34 | |
| fungi | krotscheck: i approved the jeepyb prereq for the groups support in projects.yaml, though that latter change is going to merge-conflict with the flurry of new project and similar changes we're rushing to merge before the freeze in a couple hours. should we hold off and repropose it to the project-config repo tomorrow? | 21:34 |
| *** alexpilotti has joined #openstack-infra | 21:34 | |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Removes redundant jobs from config gate and check https://review.openstack.org/122199 | 21:35 |
| openstackgerrit | A change was merged to openstack-infra/storyboard: Event actor now added to message payload https://review.openstack.org/120201 | 21:35 |
| anteaya | jeblair: better ^? | 21:35 |
| fungi | krotscheck: alternatively we can try to get it in as the last change before the freeze | 21:35 |
| *** alexpilotti has quit IRC | 21:35 | |
| jeblair | fungi: second to last :) | 21:35 |
| krotscheck | fungi: I’m ambivalent. | 21:35 |
| fungi | jeblair: penultimate, right | 21:36 |
| *** alexpilotti has joined #openstack-infra | 21:36 | |
| fungi | krotscheck: but there are likely to be further updates from these other changes we're merging ahead of it | 21:36 |
| fungi | so it'll almost certainly need another rebase and probably additional entries | 21:36 |
| krotscheck | I don’t mind doing another patch, OR moving everything to a different CR altogether. I just don’t want to continually dance on quicksand. | 21:37 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Python based daemon management https://review.openstack.org/122890 | 21:38 |
| openstackgerrit | A change was merged to openstack-infra/config: Notigen - OpenStack-like notification generator/simulator. https://review.openstack.org/120849 | 21:39 |
| openstackgerrit | A change was merged to openstack-infra/config: Klugman - cmdline tool and client library for StackTach.v3 https://review.openstack.org/120838 | 21:40 |
| openstackgerrit | Sumit Naiksatam proposed a change to openstack-infra/config: UI, automation repos for group based policy project https://review.openstack.org/122922 | 21:40 |
| mwhudson | um, this feels like a silly question, but where do the artifacts uploaded at the end of something like https://jenkins06.openstack.org/job/gate-tempest-dsvm-full/9482/consoleText end up? | 21:40 |
| jeblair | boris-42: 123396 needs a rebase | 21:40 |
| boris-42 | jeblair I am facing some small issue with new job | 21:40 |
| clarkb | mwhudson: on http://logs.openstack.org there should be a link to them in the job | 21:40 |
| boris-42 | jeblair http://logs.openstack.org/42/123442/2/experimental/gate-rally-dsvm-designate-rally/ed32116/console.html | 21:40 |
| jeblair | mwhudson: huh, i thought we had a link in there | 21:40 |
| boris-42 | jeblair 2014-09-24 21:32:23.271 | /tmp/hudson7322189625713021231.sh: line 20: syntax error near unexpected token `{{' | 21:41 |
| boris-42 | how to access this file?) | 21:41 |
| clarkb | mwhudson: also the report from jenkins/zuul in gerrit has a link to them | 21:41 |
| jeblair | Detailed logs: http://logs.openstack.org/74/123774/2/gate/gate-tempest-dsvm-full/98861ab/ | 21:41 |
| jeblair | mwhudson: ^ there it is | 21:41 |
| mwhudson | oh yes | 21:41 |
| mwhudson | see, i said it was a silly question :) | 21:41 |
| mwhudson | thanks | 21:41 |
| jeblair | boris-42: it's one of the shell builders in the jjb configuration for that job | 21:41 |
| lifeless | mwhudson: oh hai | 21:41 |
| krotscheck | btw, does anyone have the time to poke at the storyboard logs to see if rabbit is now not dying on us? | 21:41 |
| mwhudson | lifeless: hello! | 21:41 |
| jeblair | krotscheck: can do | 21:41 |
| openstackgerrit | A change was merged to openstack-infra/config: Quince - Quincy-compliant API implementation for StackTach.v3. Supports Winchester. https://review.openstack.org/120839 | 21:41 |
| krotscheck | jeblair: awesome, tahnks | 21:42 |
| openstackgerrit | A change was merged to openstack-infra/config: Sandbox - DevStack-like dev environment for StackTach.v3 https://review.openstack.org/120844 | 21:42 |
| jeblair | krotscheck: [Wed Sep 03 07:13:22 2014] [error] ConnectionClosed | 21:43 |
| *** bswartz has quit IRC | 21:43 | |
| jeblair | krotscheck: that's the last connection closed exception in the log | 21:43 |
| krotscheck | jeblair: That’s promising. | 21:43 |
| jeblair | krotscheck: https://etherpad.openstack.org/p/oL5fQPtEVh | 21:43 |
| *** marcoemorais has quit IRC | 21:43 | |
| jeblair | krotscheck: there's the most recent related log entries | 21:43 |
| jeblair | which also look promising | 21:44 |
| openstackgerrit | A change was merged to openstack-infra/config: StackDistiller - A notification extraction and transformation library. https://review.openstack.org/120858 | 21:44 |
| jeblair | (eg, the underlying behavior is still happening but it looks like we are recovering) | 21:44 |
| krotscheck | Indeed! The [error] block there looks a little weird. | 21:44 |
| openstackgerrit | A change was merged to openstack-infra/config: Timex - A time expressions library https://review.openstack.org/120852 | 21:44 |
| *** asettle has quit IRC | 21:44 | |
| krotscheck | But yeah, looks like the recovery is there. | 21:44 |
| jeblair | krotscheck: i think that's from apache | 21:44 |
| krotscheck | Ah, point. | 21:44 |
| jeblair | krotscheck: (vs the INFO/WARNING which are from python logging) | 21:44 |
| krotscheck | Cooooooooool | 21:45 |
| krotscheck | jeblair: Thanks for checking :) | 21:45 |
| jeblair | krotscheck: np; i just pasted in a line i missed | 21:45 |
| arosen | I have a git repo on stackforge that needs to be in another projects requirement.txt file in order to work. If I haven't push anything to pip is there anyway to get around this? | 21:46 |
| jeblair | krotscheck: and while i'm here; i've pasted some other random errors in the logs too (no other context for those) | 21:46 |
| boris-42 | jeblair so not much lines here … https://github.com/openstack-infra/config/blob/master/modules/openstack_project/files/jenkins_job_builder/config/rally.yaml#L51-L60 | 21:46 |
| openstackgerrit | A change was merged to openstack-infra/config: Winchester - A notification event processing library based on persistent streams. https://review.openstack.org/121182 | 21:46 |
| openstackgerrit | A change was merged to openstack-infra/config: StackTach.v3 Quincy REST API https://review.openstack.org/120582 | 21:46 |
| boris-42 | jeblair oh this https://github.com/openstack-infra/config/blob/master/modules/openstack_project/files/jenkins_job_builder/config/rally.yaml#L91-L103 | 21:47 |
| clarkb | arosen: you can depend on tarballs or git urls. we usually recommend against this | 21:47 |
| openstackgerrit | A change was merged to openstack-infra/config: notification_utils: utility library for OpenStack notifications. https://review.openstack.org/121109 | 21:47 |
| krotscheck | jeblair: Thanks, I’ll dig into those. | 21:47 |
| *** harlowja has quit IRC | 21:47 | |
| fungi | clarkb: and also it isn't supported by pbr (re: the bug just filed a moment ago) | 21:47 |
| *** harlowja has joined #openstack-infra | 21:47 | |
| clarkb | fungi: ya that | 21:47 |
| openstackgerrit | A change was merged to openstack-infra/config: Allow nova-core/milestone to rebase nova changes https://review.openstack.org/122220 | 21:48 |
| arosen | clarkb: how do changes to clients get tested within tempest? I'm guessing they aren't? | 21:48 |
| fungi | arosen: devstack-gate clones, checks out and installs from local source | 21:48 |
| arosen | fungi: though when tempest is run doesn't it build a virtual env to run the tests? | 21:49 |
| clarkb | tempest is run with site packages enabled so it uses all of the things installed globally | 21:49 |
| fungi | arosen: there is a venv tempest installs itself into, but the clients/libs/servers are pip-installed from source into the system global context not a venv | 21:49 |
| arosen | Ah so that prevents one from adding dependencies to tempest and having it magically work because another project has them as well? | 21:50 |
| mwhudson | if i want to run devstack+tempest 'the way zuul does it', is it as simple as "git clone git://git.openstack.org/openstack-infra/devstack-gate && ./devstack-gate/devstack-vm-gate-wrap.sh" ? | 21:51 |
| fungi | mwhudson: it's more like 'git clone git://git.openstack.org/openstack-infra/devstack-gate && view README.rst' | 21:52 |
| *** marun has quit IRC | 21:52 | |
| jeblair | fungi, clarkb: 123802 needs an extra review | 21:52 |
| clarkb | looking | 21:53 |
| fungi | (well, view devstack-gate/README.rst) | 21:53 |
| mwhudson | fungi: ah, thanks | 21:53 |
| *** dannywilson has joined #openstack-infra | 21:53 | |
| clarkb | fungi: though now we can point people to dib at least for trusty devstack base node stuff | 21:53 |
| fungi | mwhudson: yeah, it's not extremely straightforward but we did try to document how to do it | 21:53 |
| clarkb | fungi: the tests are passing so that should get you a like for like install. However it may not set up users in a way that is consumable by others | 21:53 |
| jeblair | clarkb, fungi: should we '#status notice' a 2-hour notice of the freeze? | 21:53 |
| fungi | clarkb: sure, as soon as we put the images somewhere they can download from, right? | 21:53 |
| clarkb | mordred: ^ have you considered how to fix that? | 21:53 |
| lifeless | mwhudson: whatcya hacking on? | 21:54 |
| clarkb | jeblair: sure. I think reminders are good | 21:54 |
| mordred | clarkb: only marginally | 21:54 |
| mwhudson | lifeless: openstack on arm64 | 21:54 |
| mordred | clarkb: but we should certainly do that | 21:54 |
| lifeless | mwhudson: shiny! | 21:54 |
| mwhudson | lifeless: i can run tempest and get a bunch of failures | 21:54 |
| mordred | clarkb: we could also upload them to swift | 21:54 |
| mwhudson | but i don't understand how some of these work on intel | 21:54 |
| mordred | clarkb: or - rather, we could upload to swift then when we "upload" to glance we give the swift URL | 21:54 |
| clarkb | mordred: ya | 21:54 |
| clarkb | mordred: but one step at a time | 21:55 |
| fungi | jeblair: yeah, though hopefully us freezing config changes for a day isn't something terribly impacting to the rest of our dev community | 21:55 |
| mwhudson | so i want to understand how they do, and then try to figure out which arm64 failures are 'real' | 21:55 |
| mordred | totes | 21:55 |
| lifeless | mwhudson: ah | 21:55 |
| clarkb | I want to get rax uploads working and switch to dib, then we can publish to the masses | 21:55 |
| jeblair | fungi: mostly i'd like to give people a chance to come out of the woodwork if we missed something | 21:55 |
| fungi | sure | 21:55 |
| mwhudson | lifeless: also interested in running arm64 tests from zuul eventually | 21:55 |
| *** dims_ has joined #openstack-infra | 21:55 | |
| *** mriedem has quit IRC | 21:55 | |
| mordred | clarkb: what's up with rax uploads? | 21:56 |
| fungi | mwhudson: you have arm64 boards, or do you mean "eventually when you can get your hands on some"? | 21:56 |
| jeblair | The openstack-infra/config repo will be frozen for project-configuration changes starting at 00:01 UTC. If you have a pending configuration change that has not merged or is not in the queue, please see us in #openstack-infra. | 21:56 |
| clarkb | mordred: we need to disable nova agent and set hvm in the metadata | 21:56 |
| jeblair | clarkb, fungi: ^ ? | 21:56 |
| clarkb | mordred: ianw wrote a patch to do it | 21:56 |
| mwhudson | fungi: we have a small pile of them, yes | 21:56 |
| clarkb | jeblair: lgtm | 21:56 |
| fungi | jeblair: lgtm | 21:56 |
| anteaya | jeblair: lgtm | 21:57 |
| mordred | clarkb: oh - right. good | 21:57 |
| jeblair | #status notice The openstack-infra/config repo will be frozen for project-configuration changes starting at 00:01 UTC. If you have a pending configuration change that has not merged or is not in the queue, please see us in #openstack-infra. | 21:57 |
| openstackstatus | jeblair: sending notice | 21:57 |
| mwhudson | almost certainly not enough to do anything interesting in this area yet, which is something else i want to think about | 21:57 |
| clarkb | jeblair: fungi 123802 adds github-org back intp projects.yaml | 21:57 |
| clarkb | jeblair: fungi: is that something we care about? | 21:57 |
| *** rmcall has quit IRC | 21:57 | |
| *** todd_dsm has joined #openstack-infra | 21:57 | |
| *** emagana has quit IRC | 21:57 | |
| jeblair | clarkb: yes, we've -1d for that before | 21:57 |
| openstackgerrit | David Shrewsbury proposed a change to stackforge/dox: Use base class for config file parsers https://review.openstack.org/123864 | 21:57 |
| fungi | clarkb: it should probably be cleaned up, yes | 21:57 |
| clarkb | ok I will -1 | 21:57 |
| *** dims__ has joined #openstack-infra | 21:58 | |
| -openstackstatus- NOTICE: The openstack-infra/config repo will be frozen for project-configuration changes starting at 00:01 UTC. If you have a pending configuration change that has not merged or is not in the queue, please see us in #openstack-infra. | 21:58 | |
| ianw | clarkb / jeblair : yeah, https://review.openstack.org/#/c/123639/ (Add meta option for passing meta-data) | 21:58 |
| *** emagana has joined #openstack-infra | 21:58 | |
| *** emagana has quit IRC | 21:58 | |
| fungi | mwhudson: neat. the most powerful arm boards i have for now are 32-bit (quad-core though at least) | 21:58 |
| mwhudson | fungi: yeah, for a long time all arm32 board had at least one terrible flaw | 21:58 |
| *** emagana has joined #openstack-infra | 21:58 | |
| openstackstatus | jeblair: finished sending notice | 21:59 |
| mwhudson | like, terrible IO, or requiring random binary firmware to boot or ... | 21:59 |
| *** rmcall has joined #openstack-infra | 21:59 | |
| *** dims has quit IRC | 21:59 | |
| mwhudson | the arm64 is all under NDA still, but i think i can say that it's a heck of a lot nicer to work with | 21:59 |
| openstackgerrit | David Shrewsbury proposed a change to stackforge/dox: Use base class for config file parsers https://review.openstack.org/123864 | 21:59 |
| clarkb | I should resurrect my beagle* | 21:59 |
| fungi | mwhudson: heh, all the ones i have still have pretty atrocious i/o and require random binary firmware to boot | 21:59 |
| mwhudson | 8 cores, multiple gigs of ram, sata, ssd, 10G ethernet... | 22:00 |
| mwhudson | fungi: i said "at least one" carefully :) | 22:00 |
| *** dims_ has quit IRC | 22:00 | |
| clarkb | ok 123802 -1'd | 22:00 |
| arosen | clarkb: i tried: DEVSTACK_GATE_TEMPEST_REGEX='tempest.scenario.test_congress_*' but it still seems to run all the tests? | 22:00 |
| *** david-lyle has quit IRC | 22:00 | |
| reed | fungi, jeblair: what chances has this patch to go in before the freeze? https://review.openstack.org/#/c/119364/ | 22:00 |
| fungi | mwhudson: i'd gladly give up the additional cores, extra ram, faster network and disk for sane booting and non-proprietary firmware updating tools | 22:01 |
| clarkb | arosen: if you aren't running the -efull env it will do that | 22:01 |
| *** david-lyle has joined #openstack-infra | 22:01 | |
| clarkb | arosen: you may need to set another flag to do the full run | 22:01 |
| jeblair | reed: it's not affected by the freeze | 22:01 |
| fungi | mwhudson: but then again, what you have sounds server-oriented while i'm trying to do ultra-compact stuff instead | 22:01 |
| reed | of course, sorry | 22:01 |
| mwhudson | yes, this is very much server oriented | 22:02 |
| mwhudson | fungi: beagle bone black has non insane booting i think? | 22:02 |
| mwhudson | it's omap and so terrible IO of course :) | 22:02 |
| arosen | clarkb: it looks like we need to add another var to devstack-gate to do this | 22:02 |
| *** mjturek has quit IRC | 22:03 | |
| *** harlowja has quit IRC | 22:03 | |
| ianw | jeblair: two questions; firstly wasn't 100% sure what to do with config file failures, like the meta-data being too long, secondly i can probably put something in to check the values make it to the fake provider, but that doesn't seem that useful | 22:03 |
| arosen | clarkb: it only has a way to run with: -eall | 22:03 |
| clarkb | arosen: -eall may be the thing | 22:03 |
| clarkb | mtreinish: ^ | 22:03 |
| *** harlowja has joined #openstack-infra | 22:03 | |
| fungi | mwhudson: oh, and support for the entire soc in mailline linux kernel releases without needing hacked-up drivers out of android | 22:03 |
| *** rmcall has quit IRC | 22:03 | |
| jeblair | ianw: i'm not sure i have the context for this conversation | 22:03 |
| mwhudson | fungi: haha | 22:04 |
| fungi | s/mailline/mainline/ | 22:04 |
| *** rmcall_ has joined #openstack-infra | 22:04 | |
| mwhudson | yes | 22:04 |
| ianw | jeblair: sorry, https://review.openstack.org/#/c/123639 :) | 22:04 |
| jogo | fungi: its time to check if you have patches in repos that don't have PTLs running: https://wiki.openstack.org/wiki/PTL_Elections_September/October_2014 | 22:04 |
| jogo | fungi: so we can run against eachother | 22:04 |
| clarkb | are we going to make fungi ptl of all te misfit projects? | 22:05 |
| anteaya | he needs the work | 22:05 |
| jeblair | reed, fungi: in addition to devstack.org, i think we need to get openstackid.org added to the 'openstack' rackspace account to manage dns | 22:05 |
| clarkb | why did openstackid get its own domain? | 22:05 |
| fungi | jeblair: oh, right. i believe jbryce registered it but it's not manageable in rackspace yet | 22:05 |
| jeblair | clarkb: openid best practice | 22:05 |
| ociuhandu | SergeyLukjanov, anteaya: I was away and read now the talk you had on the naming for the microsoft cinder CI. I think iscsi should not be in the name as we’re currently adding samba support and that will also be tested in this CI. | 22:05 |
| reed | jeblair, how can I help? | 22:05 |
| clarkb | jeblair: oh interesting | 22:06 |
| fungi | clarkb: more specifically, to avoid cross-domain scripting within trusted subdomains | 22:06 |
| clarkb | gotcha | 22:06 |
| fungi | clarkb: so authentication fior openstack.org sites is not being handled by an openstack.org site | 22:06 |
| clarkb | ya | 22:06 |
| fungi | extra safety precaution | 22:06 |
| clarkb | which as a user seems weird | 22:06 |
| clarkb | but whatever | 22:06 |
| fungi | it's to deal with browser crazy | 22:07 |
| jeblair | clarkb: also i think morganfainberg told us to :) | 22:07 |
| jeblair | reed: tbh, i don't know the process | 22:07 |
| fungi | i like to blame everything on morganfainberg | 22:07 |
| anteaya | ociuhandu: it took me a week and a half to get you the account created | 22:07 |
| *** dannywilson has quit IRC | 22:07 | |
| mwhudson | fungi: another advantage of server parts is not having to worry about mali/powervr/... | 22:07 |
| fungi | reed: it's on me to find out how to get the authoritative nameservers for those domains switched to rackspace's so they can be added in our tenant for dns management | 22:07 |
| *** dannywilson has joined #openstack-infra | 22:07 | |
| anteaya | ociuhandu: I don't have any energy to discuss renames now since we are spliting the config repo tonight/tomorrow | 22:08 |
| fungi | reed: but if you want to find out for me, that'll help speed it along | 22:08 |
| anteaya | ociuhandu: if you want to discuss it try me next week | 22:08 |
| ociuhandu | anteaya: ok, thanks. Will do :) | 22:08 |
| reed | fungi, easy peasy :) I have the contact with the agency that manages those domains | 22:08 |
| anteaya | ociuhandu: thanks for your understanding | 22:08 |
| *** jgrimm is now known as zz_jgrimm | 22:08 | |
| clarkb | ianw: are the limits of 5 entries and 255 chars each imposed by nova? | 22:08 |
| ociuhandu | anteaya: sorry for missing the discussion earlier :( | 22:09 |
| *** harlowja has quit IRC | 22:09 | |
| *** harlowja_ has joined #openstack-infra | 22:09 | |
| clarkb | ianw: and can we apply them globally to an image or must we provide then when we boot servers? | 22:09 |
| jeblair | reed, fungi: it's probably a little bit of asking the agency to point NS records at the rackspace NS records, and it's also probably a bit of asking rackspace to add it to the openstack accound as a domain that it should be able to manage. | 22:09 |
| fungi | jeblair: yeah, depending on the provider, some don't let you add a domain for management until they see the authroitative glue listing them in the corresponding tld | 22:10 |
| anteaya | ociuhandu: that is okay, since I wouldn't have had the energy to dicuss it then either, we would have just not created an account for you | 22:10 |
| ianw | clarkb: the limit i got from http://docs.openstack.org/developer/python-novaclient/ref/v1_1/servers.html | 22:10 |
| jeblair | i mean, there's a 'create domain' button there. i could try pressing it. :) | 22:10 |
| anteaya | ociuhandu: so I think you are further ahead with the account now then you were | 22:10 |
| *** datsun180b has quit IRC | 22:10 | |
| jeblair | my guess is that just registers it though. probably the process involves opening a ticket. | 22:10 |
| ociuhandu | anteaya: that’s for sure, thanks :) | 22:10 |
| anteaya | ociuhandu: okay | 22:10 |
| openstackgerrit | Bob Callaway proposed a change to openstack-infra/config: Add puppet-manila to Stackforge https://review.openstack.org/123802 | 22:10 |
| *** boden has joined #openstack-infra | 22:11 | |
| *** imcsk8 has quit IRC | 22:11 | |
| *** imcsk8 has joined #openstack-infra | 22:11 | |
| stevemar | whats the impact of the config repo being 'frozen' ? | 22:11 |
| mattoliverau | Morning | 22:11 |
| fungi | jeblair: as reed pointed out, we apparently already have openstackid.org pointed to rackspace's nameservers at the registrar | 22:11 |
| anteaya | morning mattoliverau | 22:11 |
| clarkb | ianw: grepping for meta on that page it looks like you can attach meta data to images. at least when you make a snapshot. In our case we are uploading a new image directly. I think we should see if we can attach meta data when we upload the image | 22:11 |
| anteaya | stevemar: we won't be accepting changes to config during the freeze | 22:12 |
| clarkb | ianw: as I think that is where rax said they wanted it? | 22:12 |
| stevemar | anteaya, eep! | 22:12 |
| *** dannywilson has quit IRC | 22:12 | |
| anteaya | stevemar: any changes that are to repos taht are going to end up in the project-config repo will have to be abandoned | 22:12 |
| *** juzuluag has joined #openstack-infra | 22:12 | |
| anteaya | stevemar: and resubmitted from a project-config parent commit | 22:12 |
| stevemar | anteaya, whoa! okay... can this patch get love? https://review.openstack.org/#/c/123858/ | 22:13 |
| dhellmann | clarkb: thanks. I wonder if it's even legal to have a '-' in the middle of an egg name? | 22:13 |
| anteaya | stevemar: have you any patches that are not currently approved and in the gate queue? | 22:13 |
| clarkb | dhellmann: that I do not know | 22:13 |
| clarkb | dstufft: do you know ^ | 22:13 |
| morganfainberg | jeblair, fungi, huh? | 22:13 |
| dstufft | in an egg name? Yea I think so | 22:13 |
| fungi | morganfainberg: blaming you for the suggestion in the openstack openid provider design summit session that it should use a separate domain name | 22:14 |
| anteaya | stevemar: I love it | 22:14 |
| morganfainberg | fungi, oh yeah blame away. | 22:14 |
| stevemar | anteaya, yay | 22:14 |
| *** marcoemorais has joined #openstack-infra | 22:14 | |
| fungi | morganfainberg: s/blaming/crediting/ of course! ;) | 22:14 |
| morganfainberg | fungi, :) | 22:14 |
| anteaya | clarkb SergeyLukjanov jeblair 123858 adds dsvm- to job names so they will run, +2 from fungi, +1 from me | 22:14 |
| clarkb | anteaya: stevemar I am reviewing now | 22:15 |
| anteaya | clarkb: thanks | 22:15 |
| anteaya | stevemar: anything else? | 22:15 |
| morganfainberg | fungi, i took it as a compliment! I regularly use blame as a positive thing ;) [sometimes i don't phrase it like that though to save people getting upset] | 22:15 |
| ianw | clarkb: ok, i can move it | 22:15 |
| *** boden has quit IRC | 22:15 | |
| *** marun has joined #openstack-infra | 22:15 | |
| anteaya | morganfainberg: at least we are thinking of you | 22:15 |
| *** todd_dsm has quit IRC | 22:16 | |
| *** flaper87 is now known as flaper87|afk | 22:16 | |
| fungi | morganfainberg: git has completely changed my use of that word | 22:16 |
| morganfainberg | anteaya, hehe | 22:16 |
| anteaya | :D | 22:16 |
| morganfainberg | fungi, svn blame, now that was always a negative thing :P | 22:16 |
| fungi | cvs needed blame | 22:17 |
| morganfainberg | fungi, ++ | 22:17 |
| clarkb | morganfainberg: 'annotate' is the politically correct alias | 22:17 |
| stevemar | anteaya, nope, that's it | 22:18 |
| fungi | it had annotate, which was way too politically correct | 22:18 |
| * mwhudson looks at errors from puppet | 22:18 | |
| morganfainberg | ehe | 22:18 |
| anteaya | jeblair: you wanted to merge this, is is rebased, has no dependencies and jenkins is +1: https://review.openstack.org/#/c/122199/ | 22:18 |
| clarkb | fungi: borland starteam needed anything like that | 22:18 |
| fungi | clarkb: annotate actually came from cvs | 22:18 |
| *** homeless has quit IRC | 22:18 | |
| anteaya | stevemar: kk, thanks for paying attention | 22:18 |
| alexpilotti | fungi: hi, I need a last +2a on a config commit waiting since Sept 8th: https://review.openstack.org/#/c/119909/ | 22:18 |
| clarkb | yes Ihave used borland starteam | 22:18 |
| clarkb | do not recommend | 22:18 |
| mwhudson | Error: Could not install module 'puppetlabs-inifile' (v1.0.0) | 22:18 |
| mwhudson | Module 'puppetlabs-inifile' (v1.1.3) is already installed | 22:18 |
| alexpilotti | fungi: any chance you could please help with this one? | 22:18 |
| mwhudson | fungi: is there a version of the instructions for trusty rather than precise? | 22:18 |
| mwhudson | (if that's actually my problem) | 22:18 |
| stevemar | anteaya, np! i had no idea this happens... is there a freeze like this every release? | 22:19 |
| anteaya | no | 22:19 |
| anteaya | first time | 22:19 |
| clarkb | mwhudson: I think jesusaurus figured out why that happens (bash array iteration doesn't garuntee order) | 22:19 |
| fungi | alexpilotti: yep, i'm working on that one now | 22:19 |
| clarkb | mwhudson: that said it should be harmless. I think we are hitting it and should probably push a change to bump the version and maybe be more explicit about the order | 22:19 |
| anteaya | our config repo is too big and only limited folks can navigate it | 22:19 |
| morganfainberg | clarkb, it.. doesn't? and they still call it an array?! | 22:19 |
| anteaya | which reduces our reviewers | 22:19 |
| clarkb | mwhudson: and finally the instructions for precise should be the same as trusty | 22:19 |
| fungi | alexpilotti: trying to get it in before the freeze in a couple hours | 22:19 |
| alexpilotti | fungi: wow, perfect timing tx! | 22:19 |
| anteaya | so split to make it easier to review | 22:19 |
| clarkb | morganfainberg: well its an associative array | 22:19 |
| mwhudson | clarkb: oh | 22:19 |
| morganfainberg | clarkb, ah ok | 22:19 |
| morganfainberg | clarkb, sure. | 22:19 |
| morganfainberg | clarkb, makese sense once i start thinking about the use of it. | 22:20 |
| alexpilotti | fungi: that’d be really great! | 22:20 |
| mwhudson | clarkb: because later stuff fails too | 22:20 |
| mwhudson | cat: .ssh/id_rsa.pub: No such file or directory | 22:20 |
| clarkb | mwhudson: I think it expects you to have a key? that shouldn't be related to the puppet modules stuff | 22:20 |
| *** andreykurilin_ has quit IRC | 22:21 | |
| *** doug-fish has left #openstack-infra | 22:21 | |
| mwhudson | oh | 22:21 |
| morganfainberg | anteaya, I keep trying to review things in config, and it's hard for me to get my head wrapped around all the subtleties (and keep keystone knowledge even remotely close to the surface) even though i've worked on contributing to infra/config | 22:21 |
| morganfainberg | anteaya, i totally support the split :) | 22:21 |
| * mwhudson tries to read instructions more carefully again | 22:21 | |
| *** gondoi is now known as zz_gondoi | 22:21 | |
| anteaya | morganfainberg: good :D | 22:21 |
| *** imcsk8 has quit IRC | 22:21 | |
| *** imcsk8 has joined #openstack-infra | 22:21 | |
| anteaya | and yes, I think many folks, including me, are singing the same refrain | 22:21 |
| *** shashankhegde has quit IRC | 22:22 | |
| *** signed8bit has quit IRC | 22:22 | |
| jesusaurus | clarkb: yeah, bash arrays iterate in an arbitrary order based on their internal hash value (not they key value) | 22:23 |
| jesusaurus | clarkb: yolanda has a change up to create an array of keys to iterate through to enforce order | 22:23 |
| clarkb | jesusaurus: yeah so if we isntalled that module earlier with the version we wanted more reliably the error would go away | 22:23 |
| clarkb | jesusaurus: is that pushed up? | 22:23 |
| jesusaurus | clarkb: https://review.openstack.org/#/c/122132 | 22:24 |
| alexpilotti | fungi: tx! | 22:24 |
| jesusaurus | clarkb: indexed arrays are iterated in index order, associative arrays are iterated in a seemingly arbitrary (but deterministic) order | 22:25 |
| openstackgerrit | A change was merged to openstack-infra/config: Rename osc-functional to osc-dsvm-functional https://review.openstack.org/123858 | 22:25 |
| adam_g | here's a config change that'll get a failing job out of the stable/icehouse gate: https://review.openstack.org/#/c/123822/ | 22:25 |
| *** julim has quit IRC | 22:25 | |
| mwhudson | Could not find declared class openstack_project::single_use_slave | 22:26 |
| mwhudson | Error: Puppet::Parser::AST::Resource failed with error ArgumentError: Could not find declared class openstack_project::single_use_slave at line 1 on node devstack.openstacklocal | 22:26 |
| mwhudson | seems bad? | 22:26 |
| clarkb | jeblair: there is an interesting thread on dealing with db migrations in feature brances (for the neutron lbaasv2 branch). I don't know enough about alembic to chime in but probably something we want to track | 22:26 |
| jhesketh | Morning | 22:26 |
| clarkb | mwhudson: ya that should be fatal. And is probably related to your puppet module path | 22:26 |
| anteaya | morning jhesketh | 22:26 |
| fungi | clarkb: i think maybe it's a subset of the discussion from a cycle or two ago about how to deal with migrations on stable branches and rc | 22:26 |
| *** maxbit has joined #openstack-infra | 22:27 | |
| clarkb | fungi: hrm could be | 22:27 |
| *** homeless has joined #openstack-infra | 22:27 | |
| clarkb | basically the migrations branch | 22:27 |
| clarkb | and what do | 22:27 |
| fungi | clarkb: the whole "can't go back and reorder later" problem | 22:27 |
| openstackgerrit | A change was merged to openstack-infra/config: Run the precise nonha job on tripleo projects https://review.openstack.org/122099 | 22:27 |
| clarkb | mwhudson: in the puppet apply command from the readme | 22:27 |
| fungi | clarkb: i think the sanest suggestion at the time was to have gaps or stubs inserted which allowed inserting migrations at strategic points in the chain | 22:27 |
| mwhudson | clarkb: i'm just running the command from the readme :/ | 22:28 |
| mwhudson | oh | 22:28 |
| clarkb | mwhudson: make sure that the --modulepath=/some/path is pointing to where you have config cloned | 22:28 |
| mwhudson | yay sudo | 22:28 |
| clarkb | oh ya if there are perms issues that will help too :) | 22:28 |
| mwhudson | well it's more that i'm running sudo -s so $HOME is still ~ubuntu | 22:28 |
| clarkb | mwhudson: also if you find anything about the doc to be particularly troubleing we do accept patches and are happy to update if we get feedback too | 22:28 |
| openstackgerrit | Ian Wienand proposed a change to openstack-infra/nodepool: Add meta option for passing meta-data https://review.openstack.org/123639 | 22:29 |
| ianw | clarkb: ^ moved to create_image() call | 22:29 |
| clarkb | mwhudson: this process should be getting easier in the nearish future as we move more to prebaked images that can be public or built on your end | 22:29 |
| clarkb | mwhudson: however we build them for x86 and not sure wat would be involved for arm64 | 22:29 |
| mwhudson | well automation++ | 22:29 |
| *** imcsk8 has quit IRC | 22:29 | |
| *** imcsk8 has joined #openstack-infra | 22:29 | |
| openstackgerrit | Ian Wienand proposed a change to openstack-infra/nodepool: Add meta option for passing meta-data https://review.openstack.org/123639 | 22:30 |
| mwhudson | so long as the way the images were baked was public | 22:30 |
| openstackgerrit | A change was merged to openstack-infra/config: Adds cloudbase-init to StackForge https://review.openstack.org/119909 | 22:30 |
| fungi | mwhudson: yep, we document and release all the code/configuration which does it, except for redacting credentials | 22:30 |
| clarkb | mwhudson: yup we are trying to use disk image builder to do it. I would link you to things but we are in the middle of completely reorganizing the code right now | 22:30 |
| clarkb | we are super public about everything we do | 22:30 |
| anteaya | mwhudson: the reorganization should be complete tomorrow sometime | 22:31 |
| mwhudson | oh | 22:31 |
| mwhudson | that's a fairly short timeframe :) | 22:31 |
| anteaya | yeah | 22:31 |
| mwhudson | maybe i should just go and sit on the beach for the rest of the day or soemthing | 22:31 |
| openstackgerrit | A change was merged to openstack-infra/config: Packstack changes https://review.openstack.org/118333 | 22:31 |
| anteaya | we have been prepping for a week and a half | 22:31 |
| mwhudson | go me for timing | 22:31 |
| anteaya | :D | 22:31 |
| clarkb | ianw: you updated the snapshotimageudpater which I think is ok. we want to update the diskimageupdater instead | 22:32 |
| *** salv-orlando_ has joined #openstack-infra | 22:32 | |
| mwhudson | (i've been meaning to come and have this conversation in here for at least a couple of months) | 22:32 |
| anteaya | tomorrow about this time will be a great day for it | 22:32 |
| mwhudson | running things under sudo su and in ~root is working a lot better | 22:32 |
| *** dannywilson has joined #openstack-infra | 22:33 | |
| mwhudson | oh yeah, so the instance i'm running on this is behind a proxy | 22:34 |
| mwhudson | is that just going to lead to pain? | 22:34 |
| clarkb | mwhudson: if you have http_proxy set most things will work. I believe that pip may not always work though | 22:34 |
| *** nijaba_ has joined #openstack-infra | 22:35 | |
| *** asettle has joined #openstack-infra | 22:35 | |
| mwhudson | ok | 22:35 |
| *** nijaba has quit IRC | 22:35 | |
| *** salv-orlando has quit IRC | 22:35 | |
| *** salv-orlando_ is now known as salv-orlando | 22:35 | |
| clarkb | mwhudson: because puppet pip provider doesn't inherit http_proxy and because pip (well really python requests) has had tuoble going through proxies | 22:35 |
| fungi | wow, some serious server-to-server lag on freenode at the moment | 22:35 |
| mwhudson | something seems to be hanging | 22:35 |
| clarkb | hrm would our dib stuff need to run in qemu to arm64? | 22:36 |
| clarkb | I am sure fungi and lifeless would know | 22:36 |
| *** bknudson has quit IRC | 22:36 | |
| sandywalsh | AJaeger fungi jeblair: thanks for the help on those new projects! Much appreciated! | 22:37 |
| mwhudson | qemu-aarch64 is a thing now | 22:37 |
| mrodden | aarch64? | 22:37 |
| fungi | clarkb: depends on how you bootstrap the filesystem. you can cross-strap and cross-build enough for a bootable system depending on your needs | 22:37 |
| jeblair | sandywalsh: you're welcome | 22:38 |
| stevemar | fungi, how'd did you check the logs for the why a job was set as NOT_REGISTERED | 22:38 |
| openstackgerrit | Steve Baker proposed a change to openstack-infra/elastic-recheck: Add query for rare heat delete race bug 1355942 https://review.openstack.org/123876 | 22:38 |
| jeblair | incidentally, we have added 19 projects this week; current count is 426. | 22:38 |
| uvirtbot | Launchpad bug 1355942 in tempest "tempest.api.orchestration.stacks.test_stacks fails An object with that identifier already exists" [Undecided,Invalid] https://launchpad.net/bugs/1355942 | 22:38 |
| clarkb | fungi: well in our case I think we expect some things to compile and not sure how you get pip installs to do that right | 22:38 |
| ianw | clarkb: yeah, ok ... have to think about that a bit, will fix soon | 22:38 |
| clarkb | ianw: no rush and thank you | 22:38 |
| jeblair | biab | 22:38 |
| fungi | clarkb: i've definitely built arm binaries (even linux kernels) and chroots full of arm-targeted debian packages, you just can't expect to run the contents without an emulator | 22:39 |
| clarkb | fungi: yes you can cross compile, but how does pip do that when the gcc in the chroot is arm64 | 22:39 |
| fungi | built and bootstrapped arm binaries/filesystems from an amd64-based system | 22:39 |
| clarkb | fungi: you would have to cross compile with a gcc from elsewhere | 22:39 |
| fungi | clarkb: right, i didn't use pip for any of it | 22:39 |
| clarkb | or put the cross compile toolchain in the image too even though you only need it at image build time | 22:40 |
| *** _buzz has quit IRC | 22:40 | |
| fungi | clarkb: just downloading arm architecture packages and unpacking them into the chroot | 22:40 |
| clarkb | I am sure these things can be sorted | 22:40 |
| fungi | yeah, debian/ubuntu cross-architecture-strapping is already nontrivial, they've done a ton of work to get it to where it is. i wouldn't expect other package management systems to have even considered the possibility probably | 22:41 |
| clarkb | ya | 22:41 |
| mwhudson | clarkb: would running natively be especially hard? | 22:42 |
| mwhudson | assuming hw access | 22:42 |
| *** _buzz has joined #openstack-infra | 22:42 | |
| fungi | stevemar: those service logs are accessible to shell users on the zuul server. there aren't many of us | 22:42 |
| jogo | we are about to hit a gate reset https://jenkins04.openstack.org/job/gate-tempest-dsvm-full/14405/consoleFull | 22:42 |
| stevemar | fungi, ah okay, didn't want to bug you if i could do it myself | 22:43 |
| clarkb | mwhudson: yes, because we don't run any hardware | 22:43 |
| clarkb | mwhudson: if however you wanted ot run the things on your end that should work fine | 22:43 |
| jogo | and we have a nova patch that helps with one of our bigger gate bugs that bounced out of the gate https://review.openstack.org/#/c/123774/2 | 22:43 |
| jogo | can we get it promoted? | 22:43 |
| clarkb | we just wouldn't be able to test it very effectively | 22:43 |
| stevemar | fungi, could you take another looksy at why the osc-functional job is NOT_REGISTERED? i thought the last patch would have fixed it | 22:43 |
| mwhudson | clarkb: if you had access to a hypothetical arm64 cloud? | 22:43 |
| fungi | mwhudson: you might want to consider teaming up with tripleo though, and working on an alternative-processor-architecture region to the tripleo community cloud | 22:44 |
| jogo | 287 hits in 10 days | 22:44 |
| fungi | stevemar: did it already merge? | 22:44 |
| jogo | fungi: ^ | 22:44 |
| clarkb | mwhudson: if we had access to that it should be relatively easy. we intend on having image builds be farmed out to workers some of which could run on arm64 cloud | 22:44 |
| fungi | jogo: i can promote that, just a sec | 22:44 |
| * anteaya prepares to delete her github/project-config repo and replace it with the latest sample | 22:44 | |
| stevemar | fungi, yep, i waited for the POST job to finish before recheck-ing something | 22:44 |
| jogo | fungi: thanks! | 22:44 |
| clarkb | mwhudson: if you run https://git.openstack.org/cgit/openstack-infra/config/tree/tools/build-image.sh as a user with sudo access you should be able to generate the images we are trying to move to | 22:45 |
| clarkb | mwhudson: I think you need to override CONFIG_REF and set it to eg master right now though. the rev parse thing there doesn't work as I expected it to | 22:45 |
| fungi | stevemar: once that merges, the puppet update pulse hits roughly every 15 minutes and at some point in the ensuing 10 minutes pushes that to zuul. you should see a timestamp for zuul's most recent config update at the bottom of its status page | 22:45 |
| mwhudson | clarkb: let me finish my fight with devstack-gate ... :) | 22:45 |
| stevemar | fungi, so you're saying I need to work on one of my virtues :) | 22:46 |
| fungi | stevemar: yes, laziness is the highest of the hacker virtues | 22:46 |
| *** openstackgerrit has quit IRC | 22:47 | |
| stevemar | fungi, lol - i'll recheck again when i see the time stamp change, thanks for having all the answers :) | 22:47 |
| *** openstackgerrit_ has joined #openstack-infra | 22:47 | |
| *** openstackgerrit_ is now known as openstackgerrit | 22:48 | |
| *** xyang0 has quit IRC | 22:49 | |
| anteaya | jeblair: please confirm this is the expected output of the filter branch before the reoganization of project-config: https://github.com/anteaya/project-config | 22:49 |
| *** ZZelle_ has joined #openstack-infra | 22:51 | |
| *** dkehn_ has joined #openstack-infra | 22:51 | |
| lifeless | clarkb: yes, to build arm64 from intel | 22:54 |
| lifeless | clarkb: arm64 from arm64 is a nobrainer | 22:54 |
| lifeless | clarkb: some of our moonshot team have done the dib support forthis already | 22:54 |
| fungi | jogo: i promoted 123774,2 just now, right after that failure reported | 22:54 |
| openstackgerrit | Khai Do proposed a change to stackforge/python-jenkins: Support node configuration https://review.openstack.org/89604 | 22:55 |
| *** baoli has quit IRC | 22:56 | |
| jogo | fungi: thanks! hopefully it will land this time | 22:58 |
| *** atiwari has quit IRC | 22:59 | |
| *** david-lyle has quit IRC | 22:59 | |
| *** lcheng has quit IRC | 22:59 | |
| *** dmsimard is now known as dmsimard_away | 22:59 | |
| *** dkehn_ is now known as dkehnm | 23:00 | |
| *** ZZelle_ has quit IRC | 23:02 | |
| *** juzuluag has quit IRC | 23:04 | |
| *** dangers is now known as dangers_away | 23:07 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: multinode_setup allow fixed ip https://review.openstack.org/114841 | 23:08 |
| *** markmcclain has quit IRC | 23:08 | |
| *** packet has quit IRC | 23:10 | |
| *** jpich has joined #openstack-infra | 23:10 | |
| *** boden has joined #openstack-infra | 23:11 | |
| fungi | nibalizer: if you want 119543 approved before the project split freeze in 45 minutes, it's missing jjb configuration | 23:15 |
| *** boden has quit IRC | 23:16 | |
| *** pcm_ has quit IRC | 23:17 | |
| *** shashankhegde has joined #openstack-infra | 23:18 | |
| nibalizer | fungi: no worries! freeze away | 23:18 |
| nibalizer | im at puppetconf anyways | 23:18 |
| openstackgerrit | A change was merged to openstack-infra/config: Cleanup javascript build https://review.openstack.org/111407 | 23:19 |
| fungi | nibalizer: have fun with your puppetbeer | 23:19 |
| anteaya | jeblair: also this https://github.com/anteaya/reorganized-project-config-03 | 23:19 |
| *** morgan_remote_ has quit IRC | 23:20 | |
| *** Sukhdev has joined #openstack-infra | 23:21 | |
| *** zns has quit IRC | 23:22 | |
| *** dims__ has quit IRC | 23:22 | |
| *** otherwiseguy has quit IRC | 23:23 | |
| jeblair | anteaya: 03 doesn't seem to have had the mv commands applied | 23:27 |
| openstackgerrit | A change was merged to openstack-infra/config: Quote hostname in ansible clean workspaces command https://review.openstack.org/122858 | 23:27 |
| *** marcoemorais has quit IRC | 23:27 | |
| *** marcoemorais has joined #openstack-infra | 23:28 | |
| jeblair | anteaya: project-config lgtm | 23:28 |
| *** marcoemorais has quit IRC | 23:28 | |
| *** marcoemorais has joined #openstack-infra | 23:29 | |
| *** marcoemorais has quit IRC | 23:29 | |
| *** marcoemorais has joined #openstack-infra | 23:29 | |
| *** marun has quit IRC | 23:31 | |
| anteaya | you are correct -03 doesn't | 23:31 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Add flame project on StackForge https://review.openstack.org/123113 | 23:31 |
| anteaya | I hadn't committed the changes, d'oh | 23:32 |
| anteaya | they are stuck on local | 23:32 |
| *** rmcall_ has quit IRC | 23:33 | |
| anteaya | jeblair: how about now? https://github.com/anteaya/reorganized-project-config-03/ | 23:33 |
| *** rmcall has joined #openstack-infra | 23:35 | |
| jeblair | anteaya: looks good! | 23:36 |
| *** bknudson has joined #openstack-infra | 23:36 | |
| *** bknudson has quit IRC | 23:36 | |
| *** dims has joined #openstack-infra | 23:37 | |
| stevemar | fungi, anteaya thanks for all your help today :) my new job is actually running stuff! it's failing, but thats why we make things non-voting right! | 23:37 |
| *** coolsvap has joined #openstack-infra | 23:37 | |
| *** bknudson has joined #openstack-infra | 23:39 | |
| anteaya | jeblair: thanks | 23:40 |
| anteaya | stevemar: you are welcome, glad to have you around | 23:40 |
| anteaya | a big part of running stuff is watching it fail | 23:41 |
| anteaya | you are earning your stripes | 23:41 |
| mwhudson | ah uh | 23:41 |
| jeblair | nibalizer, clarkb: puppet question: https://review.openstack.org/#/c/122902/5/modules/openstack_project/manifests/nodepool_prod.pp | 23:42 |
| mwhudson | the instructions from https://github.com/openstack-infra/devstack-gate/blob/master/README.rst seem to be breaking DNS for me | 23:42 |
| jeblair | nibalizer, clarkb: the nodepool class invocation uses a value that comes from the project_config class instantiation; how do i make sure they are ordered correctly? | 23:42 |
| clarkb | mwhudson: oh yes, we install unbound and point at google dns | 23:43 |
| clarkb | mwhudson: if you have a firewall that will need to be turned off | 23:43 |
| *** dannywilson has quit IRC | 23:43 | |
| fungi | mwhudson: our puppet manifest installs a caching dns resolver and sets it to firward lookups to google's 8.8.8.8 recursive resolver, so if you're depending on locak dns entries for things that may break and need overriding | 23:43 |
| jeblair | nibalizer, clarkb: actually, strike that; the problem is that the vcsrepo that project_config creates isn't in place; so i really need the nodepool class to require => the vcsrepo in project_config | 23:43 |
| fungi | er, what clarkb said | 23:43 |
| mwhudson | ah yes, that's not going to work in this env | 23:43 |
| *** dannywilson has joined #openstack-infra | 23:43 | |
| * mwhudson is tempted to remember that softlayer will rent you physical systems by the hour | 23:44 | |
| openstackgerrit | A change was merged to openstack-infra/config: add openstack-rating channel to eavesdrop https://review.openstack.org/117057 | 23:44 |
| jroll | mwhudson: so will rackspace :P | 23:44 |
| fungi | mwhudson: we do that because our providers who donate virtualization services to us each have dns broken in different ways | 23:44 |
| jroll | (by the minute, even) | 23:44 |
| mwhudson | fungi: :-) | 23:44 |
| *** gyee has quit IRC | 23:45 | |
| mwhudson | jroll: really? i thought so to but couldn't find it last time i went looking | 23:46 |
| jroll | mwhudson: rackspace.com/onmetal | 23:46 |
| jroll | mwhudson: tl;dr, nova boot --flavor onmetal-compute1 | 23:47 |
| *** timrc is now known as timrc-afk | 23:47 | |
| jroll | (or io1 or memory1, but compute is the cheapest) | 23:47 |
| *** hdd has quit IRC | 23:47 | |
| fungi | jeblair: i take it the expectation is to split 120285 up into multiple changes once the corresponding governance change 123826 gets approved? | 23:47 |
| *** jaypipes has quit IRC | 23:47 | |
| mwhudson | jroll: oh right, the pricing being listed per month confused me i think | 23:47 |
| jroll | mwhudson: yeah, marketing fail | 23:47 |
| jroll | it's by the minute, maybe second, dunno | 23:47 |
| fungi | jeblair: since it's unlikely anyone's approving governance changes in the next 10 minutes | 23:48 |
| *** dannywilson has quit IRC | 23:48 | |
| openstackgerrit | A change was merged to openstack-infra/config: Disable ironic job for stable/icehouse https://review.openstack.org/123822 | 23:48 |
| mwhudson | $550/month is ???/hour | 23:48 |
| jeblair | fungi: what would the multiple changes be? | 23:48 |
| mwhudson | about 75c | 23:48 |
| fungi | jeblair: oh, good point. it just needs to be reproposed against the new repo | 23:48 |
| openstackgerrit | A change was merged to openstack-infra/config: Enabling jobs for GBP project https://review.openstack.org/122956 | 23:50 |
| stevemar | anteaya, i'm also great at watching downloads and installs progress - something neat about progress bars :P | 23:50 |
| jroll | mwhudson: they are a bit overkill for devstack, though, I typically run it on an 8gb cloud server to match what infra does | 23:50 |
| *** dannywilson has joined #openstack-infra | 23:50 | |
| mwhudson | clarkb: is it easy to disable this installing of unbound? | 23:50 |
| mwhudson | vi config/modules/openstack_project/manifests/template.pp ? | 23:50 |
| clarkb | mwhudson: yeah I think asselin added it to our puppet. one sec | 23:51 |
| anteaya | stevemar: yay, you are marked as easily enertained in my book | 23:51 |
| jeblair | nibalizer, clarkb: so i guess we can still use the require => metaparameter on a class? so just add: require => Vcsrepo['/etc/project-config'], | 23:51 |
| anteaya | stevemar: you will fit in well around here | 23:51 |
| clarkb | jeblair: ya that should still be correct | 23:51 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Add experimental zaqar-rally job https://review.openstack.org/123396 | 23:51 |
| jeblair | cool, i'll turn that into a parameter so it's not hardcoded, then update && test | 23:51 |
| clarkb | mwhudson: https://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/single_use_slave.pp#n19 needs to be set to false | 23:52 |
| mwhudson | clarkb: ok | 23:52 |
| jhesketh | Hey guys, are we going into repo freeze in 5min? | 23:52 |
| anteaya | jeblair fungi clarkb this is how I have config cleaned up after the filter branch: https://github.com/anteaya/cleaned-config | 23:52 |
| nibalizer | jeblair: sweet | 23:52 |
| anteaya | jhesketh nibalizer ^^ | 23:52 |
| clarkb | mwhudson: in your command as given in the readme add enable_unboud => false, after install_userse => false | 23:52 |
| anteaya | tell me what I have missed | 23:52 |
| fungi | jhesketh: yep | 23:53 |
| mwhudson | clarkb: i guess doing that again won't mysteriously fix this instance :) | 23:53 |
| clarkb | mwhudson: probably not | 23:53 |
| mwhudson | (it didn't) | 23:54 |
| *** dmsimard_away is now known as dmsimard | 23:54 | |
| anteaya | jhesketh: you could look at project-config, reorganized-project-config-03, and cleaned-config: https://github.com/anteaya?tab=repositories to ensure they look like they should | 23:54 |
| anteaya | jhesketh: this etherpad is helpful: https://etherpad.openstack.org/p/Le2P9YegAx | 23:54 |
| anteaya | and the spec: http://specs.openstack.org/openstack-infra/infra-specs/specs/config-repo-split.html | 23:55 |
| * jhesketh has a meeting in a minute, but will do later | 23:55 | |
| anteaya | kk | 23:55 |
| *** openstackstatus has quit IRC | 23:55 | |
| *** openstack has joined #openstack-infra | 23:56 | |
| -sendak.freenode.net- [freenode-info] channel flooding and no channel staff around to help? Please check with freenode support: http://freenode.net/faq.shtml#gettinghelp | 23:56 | |
| *** bknudson has quit IRC | 23:56 | |
| anteaya | yay | 23:56 |
| *** asettle has quit IRC | 23:57 | |
| jeblair | $config_dir = Vcsrepo['/etc/project-config'] | 23:57 |
| jeblair | ... | 23:57 |
| jeblair | require => $config_dir | 23:57 |
| jeblair | nibalizer, clarkb: ^ that is not a pattern that we have done before, but empirically it seems to work. :) | 23:58 |
| *** bknudson has joined #openstack-infra | 23:58 | |
| jeblair | is that a bad idea? | 23:58 |
| clarkb | jeblair: I don't think so. did similar with iptables iirc | 23:58 |
| jeblair | oh ok cool | 23:58 |
| clarkb | jeblair: beacuse hte iptable service is different on fedora and ubuntu | 23:58 |
| jeblair | then i think that will end up looking very nice | 23:59 |
| openstackgerrit | A change was merged to openstack-infra/config: Add puppet-storyboard to storyboard https://review.openstack.org/118435 | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
